Tutorial 2: Train MoCo on CIFAR-10

In this tutorial, we will train a model based on the MoCo Paper Momentum Contrast for Unsupervised Visual Representation Learning.

When training self-supervised models using contrastive loss we usually face one big problem. To get good results, we need many negative examples for the contrastive loss to work. Therefore, we need a large batch size. However, not everyone has access to a cluster full of GPUs or TPUs. To solve this problem, alternative approaches have been developed. Some of them use a memory bank to store old negative examples we can query to compensate for the smaller batch size. MoCo takes this approach one step further by including a momentum encoder.

We use the CIFAR-10 dataset for this tutorial.

In this tutorial you will learn:

  • How to use lightly to load a dataset and train a model

  • How to create a MoCo model with a memory bank

  • How to use the pre-trained model after self-supervised learning for a transfer learning task

Imports

Import the Python frameworks we need for this tutorial. Make sure you have lightly installed.

pip install lightly
import copy

import pytorch_lightning as pl
import torch
import torch.nn as nn
import torchvision

from lightly.data import LightlyDataset
from lightly.loss import NTXentLoss
from lightly.models import ResNetGenerator
from lightly.models.modules.heads import MoCoProjectionHead
from lightly.models.utils import (
    batch_shuffle,
    batch_unshuffle,
    deactivate_requires_grad,
    update_momentum,
)
from lightly.transforms import MoCoV2Transform, utils

Configuration

We set some configuration parameters for our experiment. Feel free to change them and analyze the effect.

The default configuration uses a batch size of 512. This requires around 6.4GB of GPU memory. When training for 100 epochs you should achieve around 73% test set accuracy. When training for 200 epochs accuracy increases to about 80%.

num_workers = 8
batch_size = 512
memory_bank_size = 4096
seed = 1
max_epochs = 100

Replace the path with the location of your CIFAR-10 dataset. We assume we have a train folder with subfolders for each class and .png images inside.

You can download CIFAR-10 in folders from Kaggle.

# The dataset structure should be like this:
# cifar10/train/
#  L airplane/
#    L 10008_airplane.png
#    L ...
#  L automobile/
#  L bird/
#  L cat/
#  L deer/
#  L dog/
#  L frog/
#  L horse/
#  L ship/
#  L truck/
path_to_train = "/datasets/cifar10/train/"
path_to_test = "/datasets/cifar10/test/"

Let’s set the seed to ensure reproducibility of the experiments

pl.seed_everything(seed)
1

Setup data augmentations and loaders

We start with our data preprocessing pipeline. We can implement augmentations from the MoCo paper using the transforms provided by lightly. Images from the CIFAR-10 dataset have a resolution of 32x32 pixels. Let’s use this resolution to train our model.

Note

We could use a higher input resolution to train our model. However, since the original resolution of CIFAR-10 images is low there is no real value in increasing the resolution. A higher resolution results in higher memory consumption and to compensate for that we would need to reduce the batch size.

# disable blur because we're working with tiny images
transform = MoCoV2Transform(
    input_size=32,
    gaussian_blur=0.0,
)

We don’t want any augmentation for our test data. Therefore, we create custom, torchvision based data transformations. Let’s ensure the size is correct and we normalize the data in the same way as we do with the training data.

# Augmentations typically used to train on cifar-10
train_classifier_transforms = torchvision.transforms.Compose(
    [
        torchvision.transforms.RandomCrop(32, padding=4),
        torchvision.transforms.RandomHorizontalFlip(),
        torchvision.transforms.ToTensor(),
        torchvision.transforms.Normalize(
            mean=utils.IMAGENET_NORMALIZE["mean"],
            std=utils.IMAGENET_NORMALIZE["std"],
        ),
    ]
)

# No additional augmentations for the test set
test_transforms = torchvision.transforms.Compose(
    [
        torchvision.transforms.Resize((32, 32)),
        torchvision.transforms.ToTensor(),
        torchvision.transforms.Normalize(
            mean=utils.IMAGENET_NORMALIZE["mean"],
            std=utils.IMAGENET_NORMALIZE["std"],
        ),
    ]
)

# We use the moco augmentations for training moco
dataset_train_moco = LightlyDataset(input_dir=path_to_train, transform=transform)

# Since we also train a linear classifier on the pre-trained moco model we
# reuse the test augmentations here (MoCo augmentations are very strong and
# usually reduce accuracy of models which are not used for contrastive learning.
# Our linear layer will be trained using cross entropy loss and labels provided
# by the dataset. Therefore we chose light augmentations.)
dataset_train_classifier = LightlyDataset(
    input_dir=path_to_train, transform=train_classifier_transforms
)

dataset_test = LightlyDataset(input_dir=path_to_test, transform=test_transforms)

Create the dataloaders to load and preprocess the data in the background.

dataloader_train_moco = torch.utils.data.DataLoader(
    dataset_train_moco,
    batch_size=batch_size,
    shuffle=True,
    drop_last=True,
    num_workers=num_workers,
)

dataloader_train_classifier = torch.utils.data.DataLoader(
    dataset_train_classifier,
    batch_size=batch_size,
    shuffle=True,
    drop_last=True,
    num_workers=num_workers,
)

dataloader_test = torch.utils.data.DataLoader(
    dataset_test,
    batch_size=batch_size,
    shuffle=False,
    drop_last=False,
    num_workers=num_workers,
)

Create the MoCo Lightning Module

Now we create our MoCo model. We use PyTorch Lightning to train our model. We follow the specification of the lightning module. In this example we set the number of features for the hidden dimension to 512. The momentum for the Momentum Encoder is set to 0.99 (default is 0.999) since other reports show that this works better for Cifar-10.

For the backbone we use the lightly variant of a resnet-18. You can use another model following our playground to use custom backbones.

Note

We use a split batch norm to simulate multi-gpu behaviour. Combined with the use of batch shuffling, this prevents the model from communicating through the batch norm layers.

class MocoModel(pl.LightningModule):
    def __init__(self):
        super().__init__()

        # create a ResNet backbone and remove the classification head
        resnet = ResNetGenerator("resnet-18", 1, num_splits=8)
        self.backbone = nn.Sequential(
            *list(resnet.children())[:-1],
            nn.AdaptiveAvgPool2d(1),
        )

        # create a moco model based on ResNet
        self.projection_head = MoCoProjectionHead(512, 512, 128)
        self.backbone_momentum = copy.deepcopy(self.backbone)
        self.projection_head_momentum = copy.deepcopy(self.projection_head)
        deactivate_requires_grad(self.backbone_momentum)
        deactivate_requires_grad(self.projection_head_momentum)

        # create our loss with the optional memory bank
        self.criterion = NTXentLoss(
            temperature=0.1, memory_bank_size=(memory_bank_size, 128)
        )

    def training_step(self, batch, batch_idx):
        (x_q, x_k), _, _ = batch

        # update momentum
        update_momentum(self.backbone, self.backbone_momentum, 0.99)
        update_momentum(self.projection_head, self.projection_head_momentum, 0.99)

        # get queries
        q = self.backbone(x_q).flatten(start_dim=1)
        q = self.projection_head(q)

        # get keys
        k, shuffle = batch_shuffle(x_k)
        k = self.backbone_momentum(k).flatten(start_dim=1)
        k = self.projection_head_momentum(k)
        k = batch_unshuffle(k, shuffle)

        loss = self.criterion(q, k)
        self.log("train_loss_ssl", loss)
        return loss

    def on_train_epoch_end(self):
        self.custom_histogram_weights()

    # We provide a helper method to log weights in tensorboard
    # which is useful for debugging.
    def custom_histogram_weights(self):
        for name, params in self.named_parameters():
            self.logger.experiment.add_histogram(name, params, self.current_epoch)

    def configure_optimizers(self):
        optim = torch.optim.SGD(
            self.parameters(),
            lr=6e-2,
            momentum=0.9,
            weight_decay=5e-4,
        )
        scheduler = torch.optim.lr_scheduler.CosineAnnealingLR(optim, max_epochs)
        return [optim], [scheduler]

Create the Classifier Lightning Module

We create a linear classifier using the features we extract using MoCo and train it on the dataset

class Classifier(pl.LightningModule):
    def __init__(self, backbone):
        super().__init__()
        # use the pretrained ResNet backbone
        self.backbone = backbone

        # freeze the backbone
        deactivate_requires_grad(backbone)

        # create a linear layer for our downstream classification model
        self.fc = nn.Linear(512, 10)

        self.criterion = nn.CrossEntropyLoss()
        self.validation_step_outputs = []

    def forward(self, x):
        y_hat = self.backbone(x).flatten(start_dim=1)
        y_hat = self.fc(y_hat)
        return y_hat

    def training_step(self, batch, batch_idx):
        x, y, _ = batch
        y_hat = self.forward(x)
        loss = self.criterion(y_hat, y)
        self.log("train_loss_fc", loss)
        return loss

    def on_train_epoch_end(self):
        self.custom_histogram_weights()

    # We provide a helper method to log weights in tensorboard
    # which is useful for debugging.
    def custom_histogram_weights(self):
        for name, params in self.named_parameters():
            self.logger.experiment.add_histogram(name, params, self.current_epoch)

    def validation_step(self, batch, batch_idx):
        x, y, _ = batch
        y_hat = self.forward(x)
        y_hat = torch.nn.functional.softmax(y_hat, dim=1)

        # calculate number of correct predictions
        _, predicted = torch.max(y_hat, 1)
        num = predicted.shape[0]
        correct = (predicted == y).float().sum()
        self.validation_step_outputs.append((num, correct))
        return num, correct

    def on_validation_epoch_end(self):
        # calculate and log top1 accuracy
        if self.validation_step_outputs:
            total_num = 0
            total_correct = 0
            for num, correct in self.validation_step_outputs:
                total_num += num
                total_correct += correct
            acc = total_correct / total_num
            self.log("val_acc", acc, on_epoch=True, prog_bar=True)
            self.validation_step_outputs.clear()

    def configure_optimizers(self):
        optim = torch.optim.SGD(self.fc.parameters(), lr=30.0)
        scheduler = torch.optim.lr_scheduler.CosineAnnealingLR(optim, max_epochs)
        return [optim], [scheduler]

Train the MoCo model

We can instantiate the model and train it using the lightning trainer.

model = MocoModel()
trainer = pl.Trainer(max_epochs=max_epochs, devices=1, accelerator="gpu")
trainer.fit(model, dataloader_train_moco)
/datasets/actions-runner/core_gpu_runner_01/hostedtoolcache/Python/3.10.13/x64/lib/python3.10/site-packages/lightning_fabric/plugins/environments/slurm.py:165: PossibleUserWarning: The `srun` command is available on your system but is not used. HINT: If your intention is to run Lightning on SLURM, prepend your python command with `srun` like so: srun python /datasets/actions-runner/core_gpu_runner_01/_work/li ...
  rank_zero_warn(

Training: 0it [00:00, ?it/s]
Training:   0%|          | 0/97 [00:00<?, ?it/s]
Epoch 0:   0%|          | 0/97 [00:00<?, ?it/s]
Epoch 0:   1%|          | 1/97 [00:02<04:23,  2.74s/it]
Epoch 0:   1%|          | 1/97 [00:02<04:28,  2.80s/it, loss=0.6, v_num=0]
Epoch 0:   2%|▏         | 2/97 [00:02<02:16,  1.44s/it, loss=0.6, v_num=0]
Epoch 0:   2%|▏         | 2/97 [00:02<02:19,  1.47s/it, loss=3.43, v_num=0]
Epoch 0:   3%|▎         | 3/97 [00:03<01:34,  1.00s/it, loss=3.43, v_num=0]
Epoch 0:   3%|▎         | 3/97 [00:03<01:35,  1.02s/it, loss=4.6, v_num=0]
Epoch 0:   4%|▍         | 4/97 [00:03<01:12,  1.27it/s, loss=4.6, v_num=0]
Epoch 0:   4%|▍         | 4/97 [00:03<01:14,  1.25it/s, loss=5.26, v_num=0]
Epoch 0:   5%|▌         | 5/97 [00:03<01:00,  1.53it/s, loss=5.26, v_num=0]
Epoch 0:   5%|▌         | 5/97 [00:03<01:01,  1.50it/s, loss=5.7, v_num=0]
Epoch 0:   6%|▌         | 6/97 [00:03<00:51,  1.76it/s, loss=5.7, v_num=0]
Epoch 0:   6%|▌         | 6/97 [00:03<00:52,  1.73it/s, loss=6.02, v_num=0]
Epoch 0:   7%|▋         | 7/97 [00:03<00:45,  1.98it/s, loss=6.02, v_num=0]
Epoch 0:   7%|▋         | 7/97 [00:03<00:46,  1.95it/s, loss=6.27, v_num=0]
Epoch 0:   8%|▊         | 8/97 [00:03<00:40,  2.18it/s, loss=6.27, v_num=0]
Epoch 0:   8%|▊         | 8/97 [00:03<00:41,  2.15it/s, loss=6.47, v_num=0]
Epoch 0:   9%|▉         | 9/97 [00:03<00:37,  2.36it/s, loss=6.47, v_num=0]
Epoch 0:   9%|▉         | 9/97 [00:03<00:37,  2.32it/s, loss=6.62, v_num=0]
Epoch 0:  10%|█         | 10/97 [00:03<00:34,  2.53it/s, loss=6.62, v_num=0]
Epoch 0:  10%|█         | 10/97 [00:04<00:34,  2.50it/s, loss=6.73, v_num=0]
Epoch 0:  11%|█▏        | 11/97 [00:04<00:31,  2.69it/s, loss=6.73, v_num=0]
Epoch 0:  11%|█▏        | 11/97 [00:04<00:32,  2.66it/s, loss=6.82, v_num=0]
Epoch 0:  12%|█▏        | 12/97 [00:04<00:29,  2.85it/s, loss=6.82, v_num=0]
Epoch 0:  12%|█▏        | 12/97 [00:04<00:30,  2.81it/s, loss=6.88, v_num=0]
Epoch 0:  13%|█▎        | 13/97 [00:04<00:28,  2.99it/s, loss=6.88, v_num=0]
Epoch 0:  13%|█▎        | 13/97 [00:04<00:28,  2.95it/s, loss=6.93, v_num=0]
Epoch 0:  14%|█▍        | 14/97 [00:04<00:26,  3.12it/s, loss=6.93, v_num=0]
Epoch 0:  14%|█▍        | 14/97 [00:04<00:26,  3.08it/s, loss=6.96, v_num=0]
Epoch 0:  15%|█▌        | 15/97 [00:04<00:25,  3.25it/s, loss=6.96, v_num=0]
Epoch 0:  15%|█▌        | 15/97 [00:04<00:25,  3.21it/s, loss=6.98, v_num=0]
Epoch 0:  16%|█▋        | 16/97 [00:04<00:24,  3.37it/s, loss=6.98, v_num=0]
Epoch 0:  16%|█▋        | 16/97 [00:04<00:24,  3.33it/s, loss=6.99, v_num=0]
Epoch 0:  18%|█▊        | 17/97 [00:04<00:22,  3.48it/s, loss=6.99, v_num=0]
Epoch 0:  18%|█▊        | 17/97 [00:04<00:23,  3.44it/s, loss=6.99, v_num=0]
Epoch 0:  19%|█▊        | 18/97 [00:05<00:22,  3.58it/s, loss=6.99, v_num=0]
Epoch 0:  19%|█▊        | 18/97 [00:05<00:22,  3.55it/s, loss=6.99, v_num=0]
Epoch 0:  20%|█▉        | 19/97 [00:05<00:21,  3.69it/s, loss=6.99, v_num=0]
Epoch 0:  20%|█▉        | 19/97 [00:05<00:21,  3.65it/s, loss=6.99, v_num=0]
Epoch 0:  21%|██        | 20/97 [00:05<00:20,  3.78it/s, loss=6.99, v_num=0]
Epoch 0:  21%|██        | 20/97 [00:05<00:20,  3.74it/s, loss=6.98, v_num=0]
Epoch 0:  22%|██▏       | 21/97 [00:05<00:19,  3.87it/s, loss=6.98, v_num=0]
Epoch 0:  22%|██▏       | 21/97 [00:05<00:19,  3.83it/s, loss=7.3, v_num=0]
Epoch 0:  23%|██▎       | 22/97 [00:05<00:18,  3.96it/s, loss=7.3, v_num=0]
Epoch 0:  23%|██▎       | 22/97 [00:05<00:19,  3.92it/s, loss=7.32, v_num=0]
Epoch 0:  24%|██▎       | 23/97 [00:05<00:18,  4.04it/s, loss=7.32, v_num=0]
Epoch 0:  24%|██▎       | 23/97 [00:05<00:18,  4.00it/s, loss=7.31, v_num=0]
Epoch 0:  25%|██▍       | 24/97 [00:05<00:17,  4.12it/s, loss=7.31, v_num=0]
Epoch 0:  25%|██▍       | 24/97 [00:05<00:17,  4.08it/s, loss=7.29, v_num=0]
Epoch 0:  26%|██▌       | 25/97 [00:05<00:17,  4.19it/s, loss=7.29, v_num=0]
Epoch 0:  26%|██▌       | 25/97 [00:06<00:17,  4.15it/s, loss=7.25, v_num=0]
Epoch 0:  27%|██▋       | 26/97 [00:06<00:16,  4.25it/s, loss=7.25, v_num=0]
Epoch 0:  27%|██▋       | 26/97 [00:06<00:16,  4.22it/s, loss=7.21, v_num=0]
Epoch 0:  28%|██▊       | 27/97 [00:06<00:16,  4.32it/s, loss=7.21, v_num=0]
Epoch 0:  28%|██▊       | 27/97 [00:06<00:16,  4.29it/s, loss=7.15, v_num=0]
Epoch 0:  29%|██▉       | 28/97 [00:06<00:15,  4.39it/s, loss=7.15, v_num=0]
Epoch 0:  29%|██▉       | 28/97 [00:06<00:15,  4.35it/s, loss=7.1, v_num=0]
Epoch 0:  30%|██▉       | 29/97 [00:06<00:15,  4.45it/s, loss=7.1, v_num=0]
Epoch 0:  30%|██▉       | 29/97 [00:06<00:15,  4.41it/s, loss=7.04, v_num=0]
Epoch 0:  31%|███       | 30/97 [00:06<00:14,  4.51it/s, loss=7.04, v_num=0]
Epoch 0:  31%|███       | 30/97 [00:06<00:14,  4.47it/s, loss=6.99, v_num=0]
Epoch 0:  32%|███▏      | 31/97 [00:06<00:14,  4.57it/s, loss=6.99, v_num=0]
Epoch 0:  32%|███▏      | 31/97 [00:06<00:14,  4.53it/s, loss=6.94, v_num=0]
Epoch 0:  33%|███▎      | 32/97 [00:06<00:14,  4.62it/s, loss=6.94, v_num=0]
Epoch 0:  33%|███▎      | 32/97 [00:06<00:14,  4.59it/s, loss=6.9, v_num=0]
Epoch 0:  34%|███▍      | 33/97 [00:07<00:13,  4.68it/s, loss=6.9, v_num=0]
Epoch 0:  34%|███▍      | 33/97 [00:07<00:13,  4.64it/s, loss=6.86, v_num=0]
Epoch 0:  35%|███▌      | 34/97 [00:07<00:13,  4.73it/s, loss=6.86, v_num=0]
Epoch 0:  35%|███▌      | 34/97 [00:07<00:13,  4.69it/s, loss=6.83, v_num=0]
Epoch 0:  36%|███▌      | 35/97 [00:07<00:12,  4.77it/s, loss=6.83, v_num=0]
Epoch 0:  36%|███▌      | 35/97 [00:07<00:13,  4.74it/s, loss=6.81, v_num=0]
Epoch 0:  37%|███▋      | 36/97 [00:07<00:12,  4.82it/s, loss=6.81, v_num=0]
Epoch 0:  37%|███▋      | 36/97 [00:07<00:12,  4.79it/s, loss=6.79, v_num=0]
Epoch 0:  38%|███▊      | 37/97 [00:07<00:12,  4.87it/s, loss=6.79, v_num=0]
Epoch 0:  38%|███▊      | 37/97 [00:07<00:12,  4.83it/s, loss=6.77, v_num=0]
Epoch 0:  39%|███▉      | 38/97 [00:07<00:12,  4.91it/s, loss=6.77, v_num=0]
Epoch 0:  39%|███▉      | 38/97 [00:07<00:12,  4.88it/s, loss=6.76, v_num=0]
Epoch 0:  40%|████      | 39/97 [00:07<00:11,  4.96it/s, loss=6.76, v_num=0]
Epoch 0:  40%|████      | 39/97 [00:07<00:11,  4.92it/s, loss=6.75, v_num=0]
Epoch 0:  41%|████      | 40/97 [00:08<00:11,  5.00it/s, loss=6.75, v_num=0]
Epoch 0:  41%|████      | 40/97 [00:08<00:11,  4.96it/s, loss=6.75, v_num=0]
Epoch 0:  42%|████▏     | 41/97 [00:08<00:11,  5.04it/s, loss=6.75, v_num=0]
Epoch 0:  42%|████▏     | 41/97 [00:08<00:11,  5.00it/s, loss=6.75, v_num=0]
Epoch 0:  43%|████▎     | 42/97 [00:08<00:10,  5.08it/s, loss=6.75, v_num=0]
Epoch 0:  43%|████▎     | 42/97 [00:08<00:10,  5.04it/s, loss=6.75, v_num=0]
Epoch 0:  44%|████▍     | 43/97 [00:08<00:10,  5.12it/s, loss=6.75, v_num=0]
Epoch 0:  44%|████▍     | 43/97 [00:08<00:10,  5.08it/s, loss=6.76, v_num=0]
Epoch 0:  45%|████▌     | 44/97 [00:08<00:10,  5.15it/s, loss=6.76, v_num=0]
Epoch 0:  45%|████▌     | 44/97 [00:08<00:10,  5.12it/s, loss=6.77, v_num=0]
Epoch 0:  46%|████▋     | 45/97 [00:08<00:10,  5.19it/s, loss=6.77, v_num=0]
Epoch 0:  46%|████▋     | 45/97 [00:08<00:10,  5.15it/s, loss=6.78, v_num=0]
Epoch 0:  47%|████▋     | 46/97 [00:08<00:09,  5.22it/s, loss=6.78, v_num=0]
Epoch 0:  47%|████▋     | 46/97 [00:08<00:09,  5.19it/s, loss=6.78, v_num=0]
Epoch 0:  48%|████▊     | 47/97 [00:08<00:09,  5.26it/s, loss=6.78, v_num=0]
Epoch 0:  48%|████▊     | 47/97 [00:09<00:09,  5.22it/s, loss=6.79, v_num=0]
Epoch 0:  49%|████▉     | 48/97 [00:09<00:09,  5.29it/s, loss=6.79, v_num=0]
Epoch 0:  49%|████▉     | 48/97 [00:09<00:09,  5.25it/s, loss=6.8, v_num=0]
Epoch 0:  51%|█████     | 49/97 [00:09<00:09,  5.32it/s, loss=6.8, v_num=0]
Epoch 0:  51%|█████     | 49/97 [00:09<00:09,  5.29it/s, loss=6.81, v_num=0]
Epoch 0:  52%|█████▏    | 50/97 [00:09<00:08,  5.35it/s, loss=6.81, v_num=0]
Epoch 0:  52%|█████▏    | 50/97 [00:09<00:08,  5.32it/s, loss=6.82, v_num=0]
Epoch 0:  53%|█████▎    | 51/97 [00:09<00:08,  5.38it/s, loss=6.82, v_num=0]
Epoch 0:  53%|█████▎    | 51/97 [00:09<00:08,  5.35it/s, loss=6.83, v_num=0]
Epoch 0:  54%|█████▎    | 52/97 [00:09<00:08,  5.41it/s, loss=6.83, v_num=0]
Epoch 0:  54%|█████▎    | 52/97 [00:09<00:08,  5.37it/s, loss=6.84, v_num=0]
Epoch 0:  55%|█████▍    | 53/97 [00:09<00:08,  5.43it/s, loss=6.84, v_num=0]
Epoch 0:  55%|█████▍    | 53/97 [00:09<00:08,  5.40it/s, loss=6.85, v_num=0]
Epoch 0:  56%|█████▌    | 54/97 [00:09<00:07,  5.46it/s, loss=6.85, v_num=0]
Epoch 0:  56%|█████▌    | 54/97 [00:09<00:07,  5.43it/s, loss=6.86, v_num=0]
Epoch 0:  57%|█████▋    | 55/97 [00:10<00:07,  5.49it/s, loss=6.86, v_num=0]
Epoch 0:  57%|█████▋    | 55/97 [00:10<00:07,  5.46it/s, loss=6.87, v_num=0]
Epoch 0:  58%|█████▊    | 56/97 [00:10<00:07,  5.51it/s, loss=6.87, v_num=0]
Epoch 0:  58%|█████▊    | 56/97 [00:10<00:07,  5.48it/s, loss=6.88, v_num=0]
Epoch 0:  59%|█████▉    | 57/97 [00:10<00:07,  5.54it/s, loss=6.88, v_num=0]
Epoch 0:  59%|█████▉    | 57/97 [00:10<00:07,  5.51it/s, loss=6.88, v_num=0]
Epoch 0:  60%|█████▉    | 58/97 [00:10<00:07,  5.56it/s, loss=6.88, v_num=0]
Epoch 0:  60%|█████▉    | 58/97 [00:10<00:07,  5.53it/s, loss=6.89, v_num=0]
Epoch 0:  61%|██████    | 59/97 [00:10<00:06,  5.58it/s, loss=6.89, v_num=0]
Epoch 0:  61%|██████    | 59/97 [00:10<00:06,  5.56it/s, loss=6.9, v_num=0]
Epoch 0:  62%|██████▏   | 60/97 [00:10<00:06,  5.61it/s, loss=6.9, v_num=0]
Epoch 0:  62%|██████▏   | 60/97 [00:10<00:06,  5.58it/s, loss=6.9, v_num=0]
Epoch 0:  63%|██████▎   | 61/97 [00:10<00:06,  5.63it/s, loss=6.9, v_num=0]
Epoch 0:  63%|██████▎   | 61/97 [00:10<00:06,  5.60it/s, loss=6.91, v_num=0]
Epoch 0:  64%|██████▍   | 62/97 [00:10<00:06,  5.65it/s, loss=6.91, v_num=0]
Epoch 0:  64%|██████▍   | 62/97 [00:11<00:06,  5.63it/s, loss=6.91, v_num=0]
Epoch 0:  65%|██████▍   | 63/97 [00:11<00:05,  5.68it/s, loss=6.91, v_num=0]
Epoch 0:  65%|██████▍   | 63/97 [00:11<00:06,  5.65it/s, loss=6.91, v_num=0]
Epoch 0:  66%|██████▌   | 64/97 [00:11<00:05,  5.70it/s, loss=6.91, v_num=0]
Epoch 0:  66%|██████▌   | 64/97 [00:11<00:05,  5.67it/s, loss=6.92, v_num=0]
Epoch 0:  67%|██████▋   | 65/97 [00:11<00:05,  5.72it/s, loss=6.92, v_num=0]
Epoch 0:  67%|██████▋   | 65/97 [00:11<00:05,  5.69it/s, loss=6.92, v_num=0]
Epoch 0:  68%|██████▊   | 66/97 [00:11<00:05,  5.74it/s, loss=6.92, v_num=0]
Epoch 0:  68%|██████▊   | 66/97 [00:11<00:05,  5.71it/s, loss=6.92, v_num=0]
Epoch 0:  69%|██████▉   | 67/97 [00:11<00:05,  5.76it/s, loss=6.92, v_num=0]
Epoch 0:  69%|██████▉   | 67/97 [00:11<00:05,  5.73it/s, loss=6.92, v_num=0]
Epoch 0:  70%|███████   | 68/97 [00:11<00:05,  5.77it/s, loss=6.92, v_num=0]
Epoch 0:  70%|███████   | 68/97 [00:11<00:05,  5.75it/s, loss=6.91, v_num=0]
Epoch 0:  71%|███████   | 69/97 [00:11<00:04,  5.80it/s, loss=6.91, v_num=0]
Epoch 0:  71%|███████   | 69/97 [00:11<00:04,  5.77it/s, loss=6.92, v_num=0]
Epoch 0:  72%|███████▏  | 70/97 [00:12<00:04,  5.81it/s, loss=6.92, v_num=0]
Epoch 0:  72%|███████▏  | 70/97 [00:12<00:04,  5.79it/s, loss=6.91, v_num=0]
Epoch 0:  73%|███████▎  | 71/97 [00:12<00:04,  5.83it/s, loss=6.91, v_num=0]
Epoch 0:  73%|███████▎  | 71/97 [00:12<00:04,  5.80it/s, loss=6.91, v_num=0]
Epoch 0:  74%|███████▍  | 72/97 [00:12<00:04,  5.85it/s, loss=6.91, v_num=0]
Epoch 0:  74%|███████▍  | 72/97 [00:12<00:04,  5.82it/s, loss=6.91, v_num=0]
Epoch 0:  75%|███████▌  | 73/97 [00:12<00:04,  5.87it/s, loss=6.91, v_num=0]
Epoch 0:  75%|███████▌  | 73/97 [00:12<00:04,  5.84it/s, loss=6.91, v_num=0]
Epoch 0:  76%|███████▋  | 74/97 [00:12<00:03,  5.88it/s, loss=6.91, v_num=0]
Epoch 0:  76%|███████▋  | 74/97 [00:12<00:03,  5.86it/s, loss=6.91, v_num=0]
Epoch 0:  77%|███████▋  | 75/97 [00:12<00:03,  5.90it/s, loss=6.91, v_num=0]
Epoch 0:  77%|███████▋  | 75/97 [00:12<00:03,  5.87it/s, loss=6.91, v_num=0]
Epoch 0:  78%|███████▊  | 76/97 [00:12<00:03,  5.92it/s, loss=6.91, v_num=0]
Epoch 0:  78%|███████▊  | 76/97 [00:12<00:03,  5.89it/s, loss=6.91, v_num=0]
Epoch 0:  79%|███████▉  | 77/97 [00:12<00:03,  5.93it/s, loss=6.91, v_num=0]
Epoch 0:  79%|███████▉  | 77/97 [00:13<00:03,  5.91it/s, loss=6.91, v_num=0]
Epoch 0:  80%|████████  | 78/97 [00:13<00:03,  5.95it/s, loss=6.91, v_num=0]
Epoch 0:  80%|████████  | 78/97 [00:13<00:03,  5.92it/s, loss=6.91, v_num=0]
Epoch 0:  81%|████████▏ | 79/97 [00:13<00:03,  5.96it/s, loss=6.91, v_num=0]
Epoch 0:  81%|████████▏ | 79/97 [00:13<00:03,  5.94it/s, loss=6.91, v_num=0]
Epoch 0:  82%|████████▏ | 80/97 [00:13<00:02,  5.98it/s, loss=6.91, v_num=0]
Epoch 0:  82%|████████▏ | 80/97 [00:13<00:02,  5.95it/s, loss=6.91, v_num=0]
Epoch 0:  84%|████████▎ | 81/97 [00:13<00:02,  5.99it/s, loss=6.91, v_num=0]
Epoch 0:  84%|████████▎ | 81/97 [00:13<00:02,  5.97it/s, loss=6.91, v_num=0]
Epoch 0:  85%|████████▍ | 82/97 [00:13<00:02,  6.00it/s, loss=6.91, v_num=0]
Epoch 0:  85%|████████▍ | 82/97 [00:13<00:02,  5.98it/s, loss=6.9, v_num=0]
Epoch 0:  86%|████████▌ | 83/97 [00:13<00:02,  6.02it/s, loss=6.9, v_num=0]
Epoch 0:  86%|████████▌ | 83/97 [00:13<00:02,  6.00it/s, loss=6.91, v_num=0]
Epoch 0:  87%|████████▋ | 84/97 [00:13<00:02,  6.03it/s, loss=6.91, v_num=0]
Epoch 0:  87%|████████▋ | 84/97 [00:13<00:02,  6.01it/s, loss=6.9, v_num=0]
Epoch 0:  88%|████████▊ | 85/97 [00:14<00:01,  6.05it/s, loss=6.9, v_num=0]
Epoch 0:  88%|████████▊ | 85/97 [00:14<00:01,  6.02it/s, loss=6.9, v_num=0]
Epoch 0:  89%|████████▊ | 86/97 [00:14<00:01,  6.06it/s, loss=6.9, v_num=0]
Epoch 0:  89%|████████▊ | 86/97 [00:14<00:01,  6.04it/s, loss=6.9, v_num=0]
Epoch 0:  90%|████████▉ | 87/97 [00:14<00:01,  6.08it/s, loss=6.9, v_num=0]
Epoch 0:  90%|████████▉ | 87/97 [00:14<00:01,  6.05it/s, loss=6.91, v_num=0]
Epoch 0:  91%|█████████ | 88/97 [00:14<00:01,  6.09it/s, loss=6.91, v_num=0]
Epoch 0:  91%|█████████ | 88/97 [00:14<00:01,  6.06it/s, loss=6.91, v_num=0]
Epoch 0:  92%|█████████▏| 89/97 [00:14<00:01,  6.10it/s, loss=6.91, v_num=0]
Epoch 0:  92%|█████████▏| 89/97 [00:14<00:01,  6.08it/s, loss=6.91, v_num=0]
Epoch 0:  93%|█████████▎| 90/97 [00:14<00:01,  6.11it/s, loss=6.91, v_num=0]
Epoch 0:  93%|█████████▎| 90/97 [00:14<00:01,  6.09it/s, loss=6.91, v_num=0]
Epoch 0:  94%|█████████▍| 91/97 [00:14<00:00,  6.12it/s, loss=6.91, v_num=0]
Epoch 0:  94%|█████████▍| 91/97 [00:14<00:00,  6.10it/s, loss=6.91, v_num=0]
Epoch 0:  95%|█████████▍| 92/97 [00:14<00:00,  6.14it/s, loss=6.91, v_num=0]
Epoch 0:  95%|█████████▍| 92/97 [00:15<00:00,  6.11it/s, loss=6.91, v_num=0]
Epoch 0:  96%|█████████▌| 93/97 [00:15<00:00,  6.15it/s, loss=6.91, v_num=0]
Epoch 0:  96%|█████████▌| 93/97 [00:15<00:00,  6.13it/s, loss=6.92, v_num=0]
Epoch 0:  97%|█████████▋| 94/97 [00:15<00:00,  6.16it/s, loss=6.92, v_num=0]
Epoch 0:  97%|█████████▋| 94/97 [00:15<00:00,  6.14it/s, loss=6.91, v_num=0]
Epoch 0:  98%|█████████▊| 95/97 [00:15<00:00,  6.17it/s, loss=6.91, v_num=0]
Epoch 0:  98%|█████████▊| 95/97 [00:15<00:00,  6.15it/s, loss=6.91, v_num=0]
Epoch 0:  99%|█████████▉| 96/97 [00:15<00:00,  6.18it/s, loss=6.91, v_num=0]
Epoch 0:  99%|█████████▉| 96/97 [00:15<00:00,  6.16it/s, loss=6.91, v_num=0]
Epoch 0: 100%|██████████| 97/97 [00:15<00:00,  6.19it/s, loss=6.91, v_num=0]
Epoch 0: 100%|██████████| 97/97 [00:15<00:00,  6.17it/s, loss=6.91, v_num=0]
Epoch 0: 100%|██████████| 97/97 [00:15<00:00,  6.17it/s, loss=6.91, v_num=0]
Epoch 0:   0%|          | 0/97 [00:00<?, ?it/s, loss=6.91, v_num=0]
Epoch 1:   0%|          | 0/97 [00:00<?, ?it/s, loss=6.91, v_num=0]
Epoch 1:   1%|          | 1/97 [00:01<02:06,  1.32s/it, loss=6.91, v_num=0]
Epoch 1:   1%|          | 1/97 [00:01<02:11,  1.37s/it, loss=6.92, v_num=0]
Epoch 1:   2%|▏         | 2/97 [00:01<01:08,  1.38it/s, loss=6.92, v_num=0]
Epoch 1:   2%|▏         | 2/97 [00:01<01:11,  1.33it/s, loss=6.92, v_num=0]
Epoch 1:   3%|▎         | 3/97 [00:01<00:49,  1.89it/s, loss=6.92, v_num=0]
Epoch 1:   3%|▎         | 3/97 [00:01<00:51,  1.83it/s, loss=6.93, v_num=0]
Epoch 1:   4%|▍         | 4/97 [00:01<00:40,  2.32it/s, loss=6.93, v_num=0]
Epoch 1:   4%|▍         | 4/97 [00:01<00:41,  2.25it/s, loss=6.93, v_num=0]
Epoch 1:   5%|▌         | 5/97 [00:01<00:34,  2.69it/s, loss=6.93, v_num=0]
Epoch 1:   5%|▌         | 5/97 [00:01<00:35,  2.62it/s, loss=6.94, v_num=0]
Epoch 1:   6%|▌         | 6/97 [00:01<00:30,  3.02it/s, loss=6.94, v_num=0]
Epoch 1:   6%|▌         | 6/97 [00:02<00:30,  2.94it/s, loss=6.94, v_num=0]
Epoch 1:   7%|▋         | 7/97 [00:02<00:27,  3.30it/s, loss=6.94, v_num=0]
Epoch 1:   7%|▋         | 7/97 [00:02<00:27,  3.22it/s, loss=6.94, v_num=0]
Epoch 1:   8%|▊         | 8/97 [00:02<00:25,  3.55it/s, loss=6.94, v_num=0]
Epoch 1:   8%|▊         | 8/97 [00:02<00:25,  3.46it/s, loss=6.95, v_num=0]
Epoch 1:   9%|▉         | 9/97 [00:02<00:23,  3.76it/s, loss=6.95, v_num=0]
Epoch 1:   9%|▉         | 9/97 [00:02<00:23,  3.67it/s, loss=6.95, v_num=0]
Epoch 1:  10%|█         | 10/97 [00:02<00:22,  3.95it/s, loss=6.95, v_num=0]
Epoch 1:  10%|█         | 10/97 [00:02<00:22,  3.87it/s, loss=6.95, v_num=0]
Epoch 1:  11%|█▏        | 11/97 [00:02<00:20,  4.13it/s, loss=6.95, v_num=0]
Epoch 1:  11%|█▏        | 11/97 [00:02<00:21,  4.04it/s, loss=6.96, v_num=0]
Epoch 1:  12%|█▏        | 12/97 [00:02<00:19,  4.29it/s, loss=6.96, v_num=0]
Epoch 1:  12%|█▏        | 12/97 [00:02<00:20,  4.21it/s, loss=6.96, v_num=0]
Epoch 1:  13%|█▎        | 13/97 [00:02<00:18,  4.44it/s, loss=6.96, v_num=0]
Epoch 1:  13%|█▎        | 13/97 [00:02<00:19,  4.35it/s, loss=6.97, v_num=0]
Epoch 1:  14%|█▍        | 14/97 [00:03<00:18,  4.57it/s, loss=6.97, v_num=0]
Epoch 1:  14%|█▍        | 14/97 [00:03<00:18,  4.49it/s, loss=6.98, v_num=0]
Epoch 1:  15%|█▌        | 15/97 [00:03<00:17,  4.70it/s, loss=6.98, v_num=0]
Epoch 1:  15%|█▌        | 15/97 [00:03<00:17,  4.61it/s, loss=6.98, v_num=0]
Epoch 1:  16%|█▋        | 16/97 [00:03<00:16,  4.80it/s, loss=6.98, v_num=0]
Epoch 1:  16%|█▋        | 16/97 [00:03<00:17,  4.73it/s, loss=6.99, v_num=0]
Epoch 1:  18%|█▊        | 17/97 [00:03<00:16,  4.90it/s, loss=6.99, v_num=0]
Epoch 1:  18%|█▊        | 17/97 [00:03<00:16,  4.82it/s, loss=6.99, v_num=0]
Epoch 1:  19%|█▊        | 18/97 [00:03<00:15,  5.00it/s, loss=6.99, v_num=0]
Epoch 1:  19%|█▊        | 18/97 [00:03<00:16,  4.92it/s, loss=7, v_num=0]
Epoch 1:  20%|█▉        | 19/97 [00:03<00:15,  5.08it/s, loss=7, v_num=0]
Epoch 1:  20%|█▉        | 19/97 [00:03<00:15,  5.01it/s, loss=7.01, v_num=0]
Epoch 1:  21%|██        | 20/97 [00:03<00:14,  5.17it/s, loss=7.01, v_num=0]
Epoch 1:  21%|██        | 20/97 [00:03<00:15,  5.10it/s, loss=7.01, v_num=0]
Epoch 1:  22%|██▏       | 21/97 [00:04<00:14,  5.24it/s, loss=7.01, v_num=0]
Epoch 1:  22%|██▏       | 21/97 [00:04<00:14,  5.17it/s, loss=7.02, v_num=0]
Epoch 1:  23%|██▎       | 22/97 [00:04<00:14,  5.32it/s, loss=7.02, v_num=0]
Epoch 1:  23%|██▎       | 22/97 [00:04<00:14,  5.25it/s, loss=7.03, v_num=0]
Epoch 1:  24%|██▎       | 23/97 [00:04<00:13,  5.38it/s, loss=7.03, v_num=0]
Epoch 1:  24%|██▎       | 23/97 [00:04<00:13,  5.31it/s, loss=7.04, v_num=0]
Epoch 1:  25%|██▍       | 24/97 [00:04<00:13,  5.45it/s, loss=7.04, v_num=0]
Epoch 1:  25%|██▍       | 24/97 [00:04<00:13,  5.38it/s, loss=7.04, v_num=0]
Epoch 1:  26%|██▌       | 25/97 [00:04<00:13,  5.51it/s, loss=7.04, v_num=0]
Epoch 1:  26%|██▌       | 25/97 [00:04<00:13,  5.44it/s, loss=7.04, v_num=0]
Epoch 1:  27%|██▋       | 26/97 [00:04<00:12,  5.56it/s, loss=7.04, v_num=0]
Epoch 1:  27%|██▋       | 26/97 [00:04<00:12,  5.50it/s, loss=7.05, v_num=0]
Epoch 1:  28%|██▊       | 27/97 [00:04<00:12,  5.61it/s, loss=7.05, v_num=0]
Epoch 1:  28%|██▊       | 27/97 [00:04<00:12,  5.55it/s, loss=7.06, v_num=0]
Epoch 1:  29%|██▉       | 28/97 [00:04<00:12,  5.66it/s, loss=7.06, v_num=0]
Epoch 1:  29%|██▉       | 28/97 [00:04<00:12,  5.60it/s, loss=7.06, v_num=0]
Epoch 1:  30%|██▉       | 29/97 [00:05<00:11,  5.71it/s, loss=7.06, v_num=0]
Epoch 1:  30%|██▉       | 29/97 [00:05<00:12,  5.65it/s, loss=7.07, v_num=0]
Epoch 1:  31%|███       | 30/97 [00:05<00:11,  5.75it/s, loss=7.07, v_num=0]
Epoch 1:  31%|███       | 30/97 [00:05<00:11,  5.69it/s, loss=7.08, v_num=0]
Epoch 1:  32%|███▏      | 31/97 [00:05<00:11,  5.80it/s, loss=7.08, v_num=0]
Epoch 1:  32%|███▏      | 31/97 [00:05<00:11,  5.74it/s, loss=7.08, v_num=0]
Epoch 1:  33%|███▎      | 32/97 [00:05<00:11,  5.84it/s, loss=7.08, v_num=0]
Epoch 1:  33%|███▎      | 32/97 [00:05<00:11,  5.78it/s, loss=7.09, v_num=0]
Epoch 1:  34%|███▍      | 33/97 [00:05<00:10,  5.88it/s, loss=7.09, v_num=0]
Epoch 1:  34%|███▍      | 33/97 [00:05<00:10,  5.82it/s, loss=7.1, v_num=0]
Epoch 1:  35%|███▌      | 34/97 [00:05<00:10,  5.91it/s, loss=7.1, v_num=0]
Epoch 1:  35%|███▌      | 34/97 [00:05<00:10,  5.86it/s, loss=7.11, v_num=0]
Epoch 1:  36%|███▌      | 35/97 [00:05<00:10,  5.95it/s, loss=7.11, v_num=0]
Epoch 1:  36%|███▌      | 35/97 [00:05<00:10,  5.89it/s, loss=7.12, v_num=0]
Epoch 1:  37%|███▋      | 36/97 [00:06<00:10,  5.98it/s, loss=7.12, v_num=0]
Epoch 1:  37%|███▋      | 36/97 [00:06<00:10,  5.93it/s, loss=7.13, v_num=0]
Epoch 1:  38%|███▊      | 37/97 [00:06<00:09,  6.01it/s, loss=7.13, v_num=0]
Epoch 1:  38%|███▊      | 37/97 [00:06<00:10,  5.96it/s, loss=7.14, v_num=0]
Epoch 1:  39%|███▉      | 38/97 [00:06<00:09,  6.04it/s, loss=7.14, v_num=0]
Epoch 1:  39%|███▉      | 38/97 [00:06<00:09,  5.99it/s, loss=7.14, v_num=0]
Epoch 1:  40%|████      | 39/97 [00:06<00:09,  6.07it/s, loss=7.14, v_num=0]
Epoch 1:  40%|████      | 39/97 [00:06<00:09,  6.02it/s, loss=7.16, v_num=0]
Epoch 1:  41%|████      | 40/97 [00:06<00:09,  6.10it/s, loss=7.16, v_num=0]
Epoch 1:  41%|████      | 40/97 [00:06<00:09,  6.05it/s, loss=7.16, v_num=0]
Epoch 1:  42%|████▏     | 41/97 [00:06<00:09,  6.12it/s, loss=7.16, v_num=0]
Epoch 1:  42%|████▏     | 41/97 [00:06<00:09,  6.08it/s, loss=7.17, v_num=0]
Epoch 1:  43%|████▎     | 42/97 [00:06<00:08,  6.15it/s, loss=7.17, v_num=0]
Epoch 1:  43%|████▎     | 42/97 [00:06<00:09,  6.10it/s, loss=7.17, v_num=0]
Epoch 1:  44%|████▍     | 43/97 [00:06<00:08,  6.18it/s, loss=7.17, v_num=0]
Epoch 1:  44%|████▍     | 43/97 [00:07<00:08,  6.13it/s, loss=7.18, v_num=0]
Epoch 1:  45%|████▌     | 44/97 [00:07<00:08,  6.20it/s, loss=7.18, v_num=0]
Epoch 1:  45%|████▌     | 44/97 [00:07<00:08,  6.15it/s, loss=7.19, v_num=0]
Epoch 1:  46%|████▋     | 45/97 [00:07<00:08,  6.22it/s, loss=7.19, v_num=0]
Epoch 1:  46%|████▋     | 45/97 [00:07<00:08,  6.17it/s, loss=7.2, v_num=0]
Epoch 1:  47%|████▋     | 46/97 [00:07<00:08,  6.24it/s, loss=7.2, v_num=0]
Epoch 1:  47%|████▋     | 46/97 [00:07<00:08,  6.20it/s, loss=7.21, v_num=0]
Epoch 1:  48%|████▊     | 47/97 [00:07<00:07,  6.26it/s, loss=7.21, v_num=0]
Epoch 1:  48%|████▊     | 47/97 [00:07<00:08,  6.22it/s, loss=7.21, v_num=0]
Epoch 1:  49%|████▉     | 48/97 [00:07<00:07,  6.28it/s, loss=7.21, v_num=0]
Epoch 1:  49%|████▉     | 48/97 [00:07<00:07,  6.24it/s, loss=7.21, v_num=0]
Epoch 1:  51%|█████     | 49/97 [00:07<00:07,  6.31it/s, loss=7.21, v_num=0]
Epoch 1:  51%|█████     | 49/97 [00:07<00:07,  6.26it/s, loss=7.22, v_num=0]
Epoch 1:  52%|█████▏    | 50/97 [00:07<00:07,  6.32it/s, loss=7.22, v_num=0]
Epoch 1:  52%|█████▏    | 50/97 [00:07<00:07,  6.28it/s, loss=7.22, v_num=0]
Epoch 1:  53%|█████▎    | 51/97 [00:08<00:07,  6.35it/s, loss=7.22, v_num=0]
Epoch 1:  53%|█████▎    | 51/97 [00:08<00:07,  6.30it/s, loss=7.23, v_num=0]
Epoch 1:  54%|█████▎    | 52/97 [00:08<00:07,  6.36it/s, loss=7.23, v_num=0]
Epoch 1:  54%|█████▎    | 52/97 [00:08<00:07,  6.32it/s, loss=7.23, v_num=0]
Epoch 1:  55%|█████▍    | 53/97 [00:08<00:06,  6.38it/s, loss=7.23, v_num=0]
Epoch 1:  55%|█████▍    | 53/97 [00:08<00:06,  6.34it/s, loss=7.24, v_num=0]
Epoch 1:  56%|█████▌    | 54/97 [00:08<00:06,  6.39it/s, loss=7.24, v_num=0]
Epoch 1:  56%|█████▌    | 54/97 [00:08<00:06,  6.35it/s, loss=7.24, v_num=0]
Epoch 1:  57%|█████▋    | 55/97 [00:08<00:06,  6.41it/s, loss=7.24, v_num=0]
Epoch 1:  57%|█████▋    | 55/97 [00:08<00:06,  6.37it/s, loss=7.24, v_num=0]
Epoch 1:  58%|█████▊    | 56/97 [00:08<00:06,  6.42it/s, loss=7.24, v_num=0]
Epoch 1:  58%|█████▊    | 56/97 [00:08<00:06,  6.38it/s, loss=7.24, v_num=0]
Epoch 1:  59%|█████▉    | 57/97 [00:08<00:06,  6.44it/s, loss=7.24, v_num=0]
Epoch 1:  59%|█████▉    | 57/97 [00:08<00:06,  6.40it/s, loss=7.25, v_num=0]
Epoch 1:  60%|█████▉    | 58/97 [00:08<00:06,  6.45it/s, loss=7.25, v_num=0]
Epoch 1:  60%|█████▉    | 58/97 [00:09<00:06,  6.42it/s, loss=7.25, v_num=0]
Epoch 1:  61%|██████    | 59/97 [00:09<00:05,  6.47it/s, loss=7.25, v_num=0]
Epoch 1:  61%|██████    | 59/97 [00:09<00:05,  6.43it/s, loss=7.25, v_num=0]
Epoch 1:  62%|██████▏   | 60/97 [00:09<00:05,  6.48it/s, loss=7.25, v_num=0]
Epoch 1:  62%|██████▏   | 60/97 [00:09<00:05,  6.44it/s, loss=7.25, v_num=0]
Epoch 1:  63%|██████▎   | 61/97 [00:09<00:05,  6.50it/s, loss=7.25, v_num=0]
Epoch 1:  63%|██████▎   | 61/97 [00:09<00:05,  6.46it/s, loss=7.26, v_num=0]
Epoch 1:  64%|██████▍   | 62/97 [00:09<00:05,  6.51it/s, loss=7.26, v_num=0]
Epoch 1:  64%|██████▍   | 62/97 [00:09<00:05,  6.47it/s, loss=7.26, v_num=0]
Epoch 1:  65%|██████▍   | 63/97 [00:09<00:05,  6.52it/s, loss=7.26, v_num=0]
Epoch 1:  65%|██████▍   | 63/97 [00:09<00:05,  6.48it/s, loss=7.25, v_num=0]
Epoch 1:  66%|██████▌   | 64/97 [00:09<00:05,  6.53it/s, loss=7.25, v_num=0]
Epoch 1:  66%|██████▌   | 64/97 [00:09<00:05,  6.50it/s, loss=7.25, v_num=0]
Epoch 1:  67%|██████▋   | 65/97 [00:09<00:04,  6.55it/s, loss=7.25, v_num=0]
Epoch 1:  67%|██████▋   | 65/97 [00:09<00:04,  6.51it/s, loss=7.25, v_num=0]
Epoch 1:  68%|██████▊   | 66/97 [00:10<00:04,  6.56it/s, loss=7.25, v_num=0]
Epoch 1:  68%|██████▊   | 66/97 [00:10<00:04,  6.52it/s, loss=7.24, v_num=0]
Epoch 1:  69%|██████▉   | 67/97 [00:10<00:04,  6.57it/s, loss=7.24, v_num=0]
Epoch 1:  69%|██████▉   | 67/97 [00:10<00:04,  6.53it/s, loss=7.24, v_num=0]
Epoch 1:  70%|███████   | 68/97 [00:10<00:04,  6.58it/s, loss=7.24, v_num=0]
Epoch 1:  70%|███████   | 68/97 [00:10<00:04,  6.55it/s, loss=7.24, v_num=0]
Epoch 1:  71%|███████   | 69/97 [00:10<00:04,  6.59it/s, loss=7.24, v_num=0]
Epoch 1:  71%|███████   | 69/97 [00:10<00:04,  6.56it/s, loss=7.24, v_num=0]
Epoch 1:  72%|███████▏  | 70/97 [00:10<00:04,  6.60it/s, loss=7.24, v_num=0]
Epoch 1:  72%|███████▏  | 70/97 [00:10<00:04,  6.57it/s, loss=7.24, v_num=0]
Epoch 1:  73%|███████▎  | 71/97 [00:10<00:03,  6.61it/s, loss=7.24, v_num=0]
Epoch 1:  73%|███████▎  | 71/97 [00:10<00:03,  6.58it/s, loss=7.24, v_num=0]
Epoch 1:  74%|███████▍  | 72/97 [00:10<00:03,  6.62it/s, loss=7.24, v_num=0]
Epoch 1:  74%|███████▍  | 72/97 [00:10<00:03,  6.59it/s, loss=7.24, v_num=0]
Epoch 1:  75%|███████▌  | 73/97 [00:11<00:03,  6.63it/s, loss=7.24, v_num=0]
Epoch 1:  75%|███████▌  | 73/97 [00:11<00:03,  6.60it/s, loss=7.24, v_num=0]
Epoch 1:  76%|███████▋  | 74/97 [00:11<00:03,  6.64it/s, loss=7.24, v_num=0]
Epoch 1:  76%|███████▋  | 74/97 [00:11<00:03,  6.61it/s, loss=7.24, v_num=0]
Epoch 1:  77%|███████▋  | 75/97 [00:11<00:03,  6.65it/s, loss=7.24, v_num=0]
Epoch 1:  77%|███████▋  | 75/97 [00:11<00:03,  6.62it/s, loss=7.23, v_num=0]
Epoch 1:  78%|███████▊  | 76/97 [00:11<00:03,  6.66it/s, loss=7.23, v_num=0]
Epoch 1:  78%|███████▊  | 76/97 [00:11<00:03,  6.63it/s, loss=7.22, v_num=0]
Epoch 1:  79%|███████▉  | 77/97 [00:11<00:02,  6.67it/s, loss=7.22, v_num=0]
Epoch 1:  79%|███████▉  | 77/97 [00:11<00:03,  6.63it/s, loss=7.21, v_num=0]
Epoch 1:  80%|████████  | 78/97 [00:11<00:02,  6.68it/s, loss=7.21, v_num=0]
Epoch 1:  80%|████████  | 78/97 [00:11<00:02,  6.64it/s, loss=7.2, v_num=0]
Epoch 1:  81%|████████▏ | 79/97 [00:11<00:02,  6.68it/s, loss=7.2, v_num=0]
Epoch 1:  81%|████████▏ | 79/97 [00:11<00:02,  6.65it/s, loss=7.19, v_num=0]
Epoch 1:  82%|████████▏ | 80/97 [00:11<00:02,  6.69it/s, loss=7.19, v_num=0]
Epoch 1:  82%|████████▏ | 80/97 [00:12<00:02,  6.66it/s, loss=7.19, v_num=0]
Epoch 1:  84%|████████▎ | 81/97 [00:12<00:02,  6.70it/s, loss=7.19, v_num=0]
Epoch 1:  84%|████████▎ | 81/97 [00:12<00:02,  6.67it/s, loss=7.18, v_num=0]
Epoch 1:  85%|████████▍ | 82/97 [00:12<00:02,  6.71it/s, loss=7.18, v_num=0]
Epoch 1:  85%|████████▍ | 82/97 [00:12<00:02,  6.68it/s, loss=7.17, v_num=0]
Epoch 1:  86%|████████▌ | 83/97 [00:12<00:02,  6.72it/s, loss=7.17, v_num=0]
Epoch 1:  86%|████████▌ | 83/97 [00:12<00:02,  6.69it/s, loss=7.17, v_num=0]
Epoch 1:  87%|████████▋ | 84/97 [00:12<00:01,  6.72it/s, loss=7.17, v_num=0]
Epoch 1:  87%|████████▋ | 84/97 [00:12<00:01,  6.70it/s, loss=7.17, v_num=0]
Epoch 1:  88%|████████▊ | 85/97 [00:12<00:01,  6.73it/s, loss=7.17, v_num=0]
Epoch 1:  88%|████████▊ | 85/97 [00:12<00:01,  6.70it/s, loss=7.16, v_num=0]
Epoch 1:  89%|████████▊ | 86/97 [00:12<00:01,  6.74it/s, loss=7.16, v_num=0]
Epoch 1:  89%|████████▊ | 86/97 [00:12<00:01,  6.71it/s, loss=7.15, v_num=0]
Epoch 1:  90%|████████▉ | 87/97 [00:12<00:01,  6.75it/s, loss=7.15, v_num=0]
Epoch 1:  90%|████████▉ | 87/97 [00:12<00:01,  6.72it/s, loss=7.15, v_num=0]
Epoch 1:  91%|█████████ | 88/97 [00:13<00:01,  6.75it/s, loss=7.15, v_num=0]
Epoch 1:  91%|█████████ | 88/97 [00:13<00:01,  6.72it/s, loss=7.14, v_num=0]
Epoch 1:  92%|█████████▏| 89/97 [00:13<00:01,  6.76it/s, loss=7.14, v_num=0]
Epoch 1:  92%|█████████▏| 89/97 [00:13<00:01,  6.73it/s, loss=7.13, v_num=0]
Epoch 1:  93%|█████████▎| 90/97 [00:13<00:01,  6.77it/s, loss=7.13, v_num=0]
Epoch 1:  93%|█████████▎| 90/97 [00:13<00:01,  6.74it/s, loss=7.11, v_num=0]
Epoch 1:  94%|█████████▍| 91/97 [00:13<00:00,  6.78it/s, loss=7.11, v_num=0]
Epoch 1:  94%|█████████▍| 91/97 [00:13<00:00,  6.75it/s, loss=7.1, v_num=0]
Epoch 1:  95%|█████████▍| 92/97 [00:13<00:00,  6.78it/s, loss=7.1, v_num=0]
Epoch 1:  95%|█████████▍| 92/97 [00:13<00:00,  6.75it/s, loss=7.1, v_num=0]
Epoch 1:  96%|█████████▌| 93/97 [00:13<00:00,  6.79it/s, loss=7.1, v_num=0]
Epoch 1:  96%|█████████▌| 93/97 [00:13<00:00,  6.76it/s, loss=7.09, v_num=0]
Epoch 1:  97%|█████████▋| 94/97 [00:13<00:00,  6.79it/s, loss=7.09, v_num=0]
Epoch 1:  97%|█████████▋| 94/97 [00:13<00:00,  6.77it/s, loss=7.08, v_num=0]
Epoch 1:  98%|█████████▊| 95/97 [00:13<00:00,  6.80it/s, loss=7.08, v_num=0]
Epoch 1:  98%|█████████▊| 95/97 [00:14<00:00,  6.77it/s, loss=7.07, v_num=0]
Epoch 1:  99%|█████████▉| 96/97 [00:14<00:00,  6.80it/s, loss=7.07, v_num=0]
Epoch 1:  99%|█████████▉| 96/97 [00:14<00:00,  6.78it/s, loss=7.07, v_num=0]
Epoch 1: 100%|██████████| 97/97 [00:14<00:00,  6.81it/s, loss=7.07, v_num=0]
Epoch 1: 100%|██████████| 97/97 [00:14<00:00,  6.79it/s, loss=7.06, v_num=0]
Epoch 1: 100%|██████████| 97/97 [00:14<00:00,  6.78it/s, loss=7.06, v_num=0]
Epoch 1:   0%|          | 0/97 [00:00<?, ?it/s, loss=7.06, v_num=0]
Epoch 2:   0%|          | 0/97 [00:00<?, ?it/s, loss=7.06, v_num=0]
Epoch 2:   1%|          | 1/97 [00:01<02:13,  1.39s/it, loss=7.06, v_num=0]
Epoch 2:   1%|          | 1/97 [00:01<02:18,  1.44s/it, loss=7.06, v_num=0]
Epoch 2:   2%|▏         | 2/97 [00:01<01:12,  1.31it/s, loss=7.06, v_num=0]
Epoch 2:   2%|▏         | 2/97 [00:01<01:15,  1.26it/s, loss=7.06, v_num=0]
Epoch 2:   3%|▎         | 3/97 [00:01<00:52,  1.81it/s, loss=7.06, v_num=0]
Epoch 2:   3%|▎         | 3/97 [00:01<00:53,  1.75it/s, loss=7.06, v_num=0]
Epoch 2:   4%|▍         | 4/97 [00:01<00:41,  2.23it/s, loss=7.06, v_num=0]
Epoch 2:   4%|▍         | 4/97 [00:01<00:43,  2.16it/s, loss=7.05, v_num=0]
Epoch 2:   5%|▌         | 5/97 [00:01<00:35,  2.59it/s, loss=7.05, v_num=0]
Epoch 2:   5%|▌         | 5/97 [00:01<00:36,  2.52it/s, loss=7.05, v_num=0]
Epoch 2:   6%|▌         | 6/97 [00:02<00:31,  2.91it/s, loss=7.05, v_num=0]
Epoch 2:   6%|▌         | 6/97 [00:02<00:32,  2.83it/s, loss=7.04, v_num=0]
Epoch 2:   7%|▋         | 7/97 [00:02<00:28,  3.18it/s, loss=7.04, v_num=0]
Epoch 2:   7%|▋         | 7/97 [00:02<00:29,  3.10it/s, loss=7.03, v_num=0]
Epoch 2:   8%|▊         | 8/97 [00:02<00:25,  3.43it/s, loss=7.03, v_num=0]
Epoch 2:   8%|▊         | 8/97 [00:02<00:26,  3.35it/s, loss=7.03, v_num=0]
Epoch 2:   9%|▉         | 9/97 [00:02<00:24,  3.64it/s, loss=7.03, v_num=0]
Epoch 2:   9%|▉         | 9/97 [00:02<00:24,  3.56it/s, loss=7.03, v_num=0]
Epoch 2:  10%|█         | 10/97 [00:02<00:22,  3.82it/s, loss=7.03, v_num=0]
Epoch 2:  10%|█         | 10/97 [00:02<00:23,  3.75it/s, loss=7.02, v_num=0]
Epoch 2:  11%|█▏        | 11/97 [00:02<00:21,  4.01it/s, loss=7.02, v_num=0]
Epoch 2:  11%|█▏        | 11/97 [00:02<00:21,  3.93it/s, loss=7.02, v_num=0]
Epoch 2:  12%|█▏        | 12/97 [00:02<00:20,  4.17it/s, loss=7.02, v_num=0]
Epoch 2:  12%|█▏        | 12/97 [00:02<00:20,  4.09it/s, loss=7.02, v_num=0]
Epoch 2:  13%|█▎        | 13/97 [00:03<00:19,  4.31it/s, loss=7.02, v_num=0]
Epoch 2:  13%|█▎        | 13/97 [00:03<00:19,  4.24it/s, loss=7.02, v_num=0]
Epoch 2:  14%|█▍        | 14/97 [00:03<00:18,  4.44it/s, loss=7.02, v_num=0]
Epoch 2:  14%|█▍        | 14/97 [00:03<00:18,  4.37it/s, loss=7.01, v_num=0]
Epoch 2:  15%|█▌        | 15/97 [00:03<00:17,  4.56it/s, loss=7.01, v_num=0]
Epoch 2:  15%|█▌        | 15/97 [00:03<00:18,  4.49it/s, loss=7.01, v_num=0]
Epoch 2:  16%|█▋        | 16/97 [00:03<00:17,  4.68it/s, loss=7.01, v_num=0]
Epoch 2:  16%|█▋        | 16/97 [00:03<00:17,  4.60it/s, loss=7.01, v_num=0]
Epoch 2:  18%|█▊        | 17/97 [00:03<00:16,  4.78it/s, loss=7.01, v_num=0]
Epoch 2:  18%|█▊        | 17/97 [00:03<00:16,  4.71it/s, loss=7.01, v_num=0]
Epoch 2:  19%|█▊        | 18/97 [00:03<00:16,  4.87it/s, loss=7.01, v_num=0]
Epoch 2:  19%|█▊        | 18/97 [00:03<00:16,  4.80it/s, loss=7.01, v_num=0]
Epoch 2:  20%|█▉        | 19/97 [00:03<00:15,  4.97it/s, loss=7.01, v_num=0]
Epoch 2:  20%|█▉        | 19/97 [00:03<00:15,  4.90it/s, loss=7.01, v_num=0]
Epoch 2:  21%|██        | 20/97 [00:03<00:15,  5.05it/s, loss=7.01, v_num=0]
Epoch 2:  21%|██        | 20/97 [00:04<00:15,  4.98it/s, loss=7.01, v_num=0]
Epoch 2:  22%|██▏       | 21/97 [00:04<00:14,  5.13it/s, loss=7.01, v_num=0]
Epoch 2:  22%|██▏       | 21/97 [00:04<00:15,  5.06it/s, loss=7, v_num=0]
Epoch 2:  23%|██▎       | 22/97 [00:04<00:14,  5.20it/s, loss=7, v_num=0]
Epoch 2:  23%|██▎       | 22/97 [00:04<00:14,  5.14it/s, loss=7, v_num=0]
Epoch 2:  24%|██▎       | 23/97 [00:04<00:14,  5.27it/s, loss=7, v_num=0]
Epoch 2:  24%|██▎       | 23/97 [00:04<00:14,  5.20it/s, loss=7, v_num=0]
Epoch 2:  25%|██▍       | 24/97 [00:04<00:13,  5.33it/s, loss=7, v_num=0]
Epoch 2:  25%|██▍       | 24/97 [00:04<00:13,  5.27it/s, loss=7, v_num=0]
Epoch 2:  26%|██▌       | 25/97 [00:04<00:13,  5.39it/s, loss=7, v_num=0]
Epoch 2:  26%|██▌       | 25/97 [00:04<00:13,  5.33it/s, loss=7, v_num=0]
Epoch 2:  27%|██▋       | 26/97 [00:04<00:13,  5.45it/s, loss=7, v_num=0]
Epoch 2:  27%|██▋       | 26/97 [00:04<00:13,  5.39it/s, loss=6.99, v_num=0]
Epoch 2:  28%|██▊       | 27/97 [00:04<00:12,  5.51it/s, loss=6.99, v_num=0]
Epoch 2:  28%|██▊       | 27/97 [00:04<00:12,  5.45it/s, loss=7, v_num=0]
Epoch 2:  29%|██▉       | 28/97 [00:05<00:12,  5.56it/s, loss=7, v_num=0]
Epoch 2:  29%|██▉       | 28/97 [00:05<00:12,  5.50it/s, loss=6.99, v_num=0]
Epoch 2:  30%|██▉       | 29/97 [00:05<00:12,  5.61it/s, loss=6.99, v_num=0]
Epoch 2:  30%|██▉       | 29/97 [00:05<00:12,  5.55it/s, loss=6.99, v_num=0]
Epoch 2:  31%|███       | 30/97 [00:05<00:11,  5.65it/s, loss=6.99, v_num=0]
Epoch 2:  31%|███       | 30/97 [00:05<00:11,  5.60it/s, loss=7, v_num=0]
Epoch 2:  32%|███▏      | 31/97 [00:05<00:11,  5.70it/s, loss=7, v_num=0]
Epoch 2:  32%|███▏      | 31/97 [00:05<00:11,  5.64it/s, loss=7, v_num=0]
Epoch 2:  33%|███▎      | 32/97 [00:05<00:11,  5.74it/s, loss=7, v_num=0]
Epoch 2:  33%|███▎      | 32/97 [00:05<00:11,  5.68it/s, loss=6.99, v_num=0]
Epoch 2:  34%|███▍      | 33/97 [00:05<00:11,  5.78it/s, loss=6.99, v_num=0]
Epoch 2:  34%|███▍      | 33/97 [00:05<00:11,  5.72it/s, loss=6.99, v_num=0]
Epoch 2:  35%|███▌      | 34/97 [00:05<00:10,  5.82it/s, loss=6.99, v_num=0]
Epoch 2:  35%|███▌      | 34/97 [00:05<00:10,  5.76it/s, loss=6.99, v_num=0]
Epoch 2:  36%|███▌      | 35/97 [00:05<00:10,  5.85it/s, loss=6.99, v_num=0]
Epoch 2:  36%|███▌      | 35/97 [00:06<00:10,  5.80it/s, loss=6.99, v_num=0]
Epoch 2:  37%|███▋      | 36/97 [00:06<00:10,  5.89it/s, loss=6.99, v_num=0]
Epoch 2:  37%|███▋      | 36/97 [00:06<00:10,  5.84it/s, loss=7, v_num=0]
Epoch 2:  38%|███▊      | 37/97 [00:06<00:10,  5.92it/s, loss=7, v_num=0]
Epoch 2:  38%|███▊      | 37/97 [00:06<00:10,  5.87it/s, loss=6.99, v_num=0]
Epoch 2:  39%|███▉      | 38/97 [00:06<00:09,  5.95it/s, loss=6.99, v_num=0]
Epoch 2:  39%|███▉      | 38/97 [00:06<00:09,  5.90it/s, loss=6.99, v_num=0]
Epoch 2:  40%|████      | 39/97 [00:06<00:09,  5.98it/s, loss=6.99, v_num=0]
Epoch 2:  40%|████      | 39/97 [00:06<00:09,  5.93it/s, loss=6.99, v_num=0]
Epoch 2:  41%|████      | 40/97 [00:06<00:09,  6.01it/s, loss=6.99, v_num=0]
Epoch 2:  41%|████      | 40/97 [00:06<00:09,  5.96it/s, loss=6.99, v_num=0]
Epoch 2:  42%|████▏     | 41/97 [00:06<00:09,  6.04it/s, loss=6.99, v_num=0]
Epoch 2:  42%|████▏     | 41/97 [00:06<00:09,  5.99it/s, loss=6.99, v_num=0]
Epoch 2:  43%|████▎     | 42/97 [00:06<00:09,  6.06it/s, loss=6.99, v_num=0]
Epoch 2:  43%|████▎     | 42/97 [00:06<00:09,  6.02it/s, loss=6.99, v_num=0]
Epoch 2:  44%|████▍     | 43/97 [00:07<00:08,  6.09it/s, loss=6.99, v_num=0]
Epoch 2:  44%|████▍     | 43/97 [00:07<00:08,  6.04it/s, loss=6.99, v_num=0]
Epoch 2:  45%|████▌     | 44/97 [00:07<00:08,  6.11it/s, loss=6.99, v_num=0]
Epoch 2:  45%|████▌     | 44/97 [00:07<00:08,  6.07it/s, loss=6.99, v_num=0]
Epoch 2:  46%|████▋     | 45/97 [00:07<00:08,  6.14it/s, loss=6.99, v_num=0]
Epoch 2:  46%|████▋     | 45/97 [00:07<00:08,  6.09it/s, loss=6.98, v_num=0]
Epoch 2:  47%|████▋     | 46/97 [00:07<00:08,  6.16it/s, loss=6.98, v_num=0]
Epoch 2:  47%|████▋     | 46/97 [00:07<00:08,  6.12it/s, loss=6.99, v_num=0]
Epoch 2:  48%|████▊     | 47/97 [00:07<00:08,  6.18it/s, loss=6.99, v_num=0]
Epoch 2:  48%|████▊     | 47/97 [00:07<00:08,  6.14it/s, loss=6.99, v_num=0]
Epoch 2:  49%|████▉     | 48/97 [00:07<00:07,  6.20it/s, loss=6.99, v_num=0]
Epoch 2:  49%|████▉     | 48/97 [00:07<00:07,  6.16it/s, loss=6.98, v_num=0]
Epoch 2:  51%|█████     | 49/97 [00:07<00:07,  6.22it/s, loss=6.98, v_num=0]
Epoch 2:  51%|█████     | 49/97 [00:07<00:07,  6.18it/s, loss=6.99, v_num=0]
Epoch 2:  52%|█████▏    | 50/97 [00:08<00:07,  6.24it/s, loss=6.99, v_num=0]
Epoch 2:  52%|█████▏    | 50/97 [00:08<00:07,  6.20it/s, loss=6.98, v_num=0]
Epoch 2:  53%|█████▎    | 51/97 [00:08<00:07,  6.26it/s, loss=6.98, v_num=0]
Epoch 2:  53%|█████▎    | 51/97 [00:08<00:07,  6.22it/s, loss=6.99, v_num=0]
Epoch 2:  54%|█████▎    | 52/97 [00:08<00:07,  6.28it/s, loss=6.99, v_num=0]
Epoch 2:  54%|█████▎    | 52/97 [00:08<00:07,  6.24it/s, loss=6.99, v_num=0]
Epoch 2:  55%|█████▍    | 53/97 [00:08<00:06,  6.29it/s, loss=6.99, v_num=0]
Epoch 2:  55%|█████▍    | 53/97 [00:08<00:07,  6.25it/s, loss=6.99, v_num=0]
Epoch 2:  56%|█████▌    | 54/97 [00:08<00:06,  6.31it/s, loss=6.99, v_num=0]
Epoch 2:  56%|█████▌    | 54/97 [00:08<00:06,  6.27it/s, loss=7, v_num=0]
Epoch 2:  57%|█████▋    | 55/97 [00:08<00:06,  6.33it/s, loss=7, v_num=0]
Epoch 2:  57%|█████▋    | 55/97 [00:08<00:06,  6.29it/s, loss=7, v_num=0]
Epoch 2:  58%|█████▊    | 56/97 [00:08<00:06,  6.34it/s, loss=7, v_num=0]
Epoch 2:  58%|█████▊    | 56/97 [00:08<00:06,  6.30it/s, loss=7, v_num=0]
Epoch 2:  59%|█████▉    | 57/97 [00:08<00:06,  6.36it/s, loss=7, v_num=0]
Epoch 2:  59%|█████▉    | 57/97 [00:09<00:06,  6.32it/s, loss=7.01, v_num=0]
Epoch 2:  60%|█████▉    | 58/97 [00:09<00:06,  6.37it/s, loss=7.01, v_num=0]
Epoch 2:  60%|█████▉    | 58/97 [00:09<00:06,  6.34it/s, loss=7.01, v_num=0]
Epoch 2:  61%|██████    | 59/97 [00:09<00:05,  6.39it/s, loss=7.01, v_num=0]
Epoch 2:  61%|██████    | 59/97 [00:09<00:05,  6.35it/s, loss=7.01, v_num=0]
Epoch 2:  62%|██████▏   | 60/97 [00:09<00:05,  6.40it/s, loss=7.01, v_num=0]
Epoch 2:  62%|██████▏   | 60/97 [00:09<00:05,  6.37it/s, loss=7, v_num=0]
Epoch 2:  63%|██████▎   | 61/97 [00:09<00:05,  6.41it/s, loss=7, v_num=0]
Epoch 2:  63%|██████▎   | 61/97 [00:09<00:05,  6.38it/s, loss=7, v_num=0]
Epoch 2:  64%|██████▍   | 62/97 [00:09<00:05,  6.43it/s, loss=7, v_num=0]
Epoch 2:  64%|██████▍   | 62/97 [00:09<00:05,  6.39it/s, loss=7, v_num=0]
Epoch 2:  65%|██████▍   | 63/97 [00:09<00:05,  6.44it/s, loss=7, v_num=0]
Epoch 2:  65%|██████▍   | 63/97 [00:09<00:05,  6.41it/s, loss=7, v_num=0]
Epoch 2:  66%|██████▌   | 64/97 [00:09<00:05,  6.46it/s, loss=7, v_num=0]
Epoch 2:  66%|██████▌   | 64/97 [00:09<00:05,  6.42it/s, loss=7, v_num=0]
Epoch 2:  67%|██████▋   | 65/97 [00:10<00:04,  6.47it/s, loss=7, v_num=0]
Epoch 2:  67%|██████▋   | 65/97 [00:10<00:04,  6.43it/s, loss=7, v_num=0]
Epoch 2:  68%|██████▊   | 66/97 [00:10<00:04,  6.48it/s, loss=7, v_num=0]
Epoch 2:  68%|██████▊   | 66/97 [00:10<00:04,  6.45it/s, loss=6.99, v_num=0]
Epoch 2:  69%|██████▉   | 67/97 [00:10<00:04,  6.49it/s, loss=6.99, v_num=0]
Epoch 2:  69%|██████▉   | 67/97 [00:10<00:04,  6.46it/s, loss=6.99, v_num=0]
Epoch 2:  70%|███████   | 68/97 [00:10<00:04,  6.51it/s, loss=6.99, v_num=0]
Epoch 2:  70%|███████   | 68/97 [00:10<00:04,  6.47it/s, loss=6.99, v_num=0]
Epoch 2:  71%|███████   | 69/97 [00:10<00:04,  6.52it/s, loss=6.99, v_num=0]
Epoch 2:  71%|███████   | 69/97 [00:10<00:04,  6.48it/s, loss=6.99, v_num=0]
Epoch 2:  72%|███████▏  | 70/97 [00:10<00:04,  6.53it/s, loss=6.99, v_num=0]
Epoch 2:  72%|███████▏  | 70/97 [00:10<00:04,  6.49it/s, loss=7, v_num=0]
Epoch 2:  73%|███████▎  | 71/97 [00:10<00:03,  6.54it/s, loss=7, v_num=0]
Epoch 2:  73%|███████▎  | 71/97 [00:10<00:03,  6.51it/s, loss=6.99, v_num=0]
Epoch 2:  74%|███████▍  | 72/97 [00:10<00:03,  6.55it/s, loss=6.99, v_num=0]
Epoch 2:  74%|███████▍  | 72/97 [00:11<00:03,  6.52it/s, loss=6.99, v_num=0]
Epoch 2:  75%|███████▌  | 73/97 [00:11<00:03,  6.56it/s, loss=6.99, v_num=0]
Epoch 2:  75%|███████▌  | 73/97 [00:11<00:03,  6.53it/s, loss=6.98, v_num=0]
Epoch 2:  76%|███████▋  | 74/97 [00:11<00:03,  6.57it/s, loss=6.98, v_num=0]
Epoch 2:  76%|███████▋  | 74/97 [00:11<00:03,  6.54it/s, loss=6.98, v_num=0]
Epoch 2:  77%|███████▋  | 75/97 [00:11<00:03,  6.58it/s, loss=6.98, v_num=0]
Epoch 2:  77%|███████▋  | 75/97 [00:11<00:03,  6.55it/s, loss=6.97, v_num=0]
Epoch 2:  78%|███████▊  | 76/97 [00:11<00:03,  6.59it/s, loss=6.97, v_num=0]
Epoch 2:  78%|███████▊  | 76/97 [00:11<00:03,  6.56it/s, loss=6.97, v_num=0]
Epoch 2:  79%|███████▉  | 77/97 [00:11<00:03,  6.60it/s, loss=6.97, v_num=0]
Epoch 2:  79%|███████▉  | 77/97 [00:11<00:03,  6.57it/s, loss=6.96, v_num=0]
Epoch 2:  80%|████████  | 78/97 [00:11<00:02,  6.61it/s, loss=6.96, v_num=0]
Epoch 2:  80%|████████  | 78/97 [00:11<00:02,  6.58it/s, loss=6.96, v_num=0]
Epoch 2:  81%|████████▏ | 79/97 [00:11<00:02,  6.62it/s, loss=6.96, v_num=0]
Epoch 2:  81%|████████▏ | 79/97 [00:11<00:02,  6.59it/s, loss=6.96, v_num=0]
Epoch 2:  82%|████████▏ | 80/97 [00:12<00:02,  6.63it/s, loss=6.96, v_num=0]
Epoch 2:  82%|████████▏ | 80/97 [00:12<00:02,  6.59it/s, loss=6.96, v_num=0]
Epoch 2:  84%|████████▎ | 81/97 [00:12<00:02,  6.63it/s, loss=6.96, v_num=0]
Epoch 2:  84%|████████▎ | 81/97 [00:12<00:02,  6.60it/s, loss=6.95, v_num=0]
Epoch 2:  85%|████████▍ | 82/97 [00:12<00:02,  6.64it/s, loss=6.95, v_num=0]
Epoch 2:  85%|████████▍ | 82/97 [00:12<00:02,  6.61it/s, loss=6.96, v_num=0]
Epoch 2:  86%|████████▌ | 83/97 [00:12<00:02,  6.64it/s, loss=6.96, v_num=0]
Epoch 2:  86%|████████▌ | 83/97 [00:12<00:02,  6.62it/s, loss=6.95, v_num=0]
Epoch 2:  87%|████████▋ | 84/97 [00:12<00:01,  6.65it/s, loss=6.95, v_num=0]
Epoch 2:  87%|████████▋ | 84/97 [00:12<00:01,  6.62it/s, loss=6.95, v_num=0]
Epoch 2:  88%|████████▊ | 85/97 [00:12<00:01,  6.66it/s, loss=6.95, v_num=0]
Epoch 2:  88%|████████▊ | 85/97 [00:12<00:01,  6.63it/s, loss=6.95, v_num=0]
Epoch 2:  89%|████████▊ | 86/97 [00:12<00:01,  6.67it/s, loss=6.95, v_num=0]
Epoch 2:  89%|████████▊ | 86/97 [00:12<00:01,  6.64it/s, loss=6.95, v_num=0]
Epoch 2:  90%|████████▉ | 87/97 [00:13<00:01,  6.68it/s, loss=6.95, v_num=0]
Epoch 2:  90%|████████▉ | 87/97 [00:13<00:01,  6.65it/s, loss=6.94, v_num=0]
Epoch 2:  91%|█████████ | 88/97 [00:13<00:01,  6.68it/s, loss=6.94, v_num=0]
Epoch 2:  91%|█████████ | 88/97 [00:13<00:01,  6.66it/s, loss=6.95, v_num=0]
Epoch 2:  92%|█████████▏| 89/97 [00:13<00:01,  6.69it/s, loss=6.95, v_num=0]
Epoch 2:  92%|█████████▏| 89/97 [00:13<00:01,  6.66it/s, loss=6.94, v_num=0]
Epoch 2:  93%|█████████▎| 90/97 [00:13<00:01,  6.70it/s, loss=6.94, v_num=0]
Epoch 2:  93%|█████████▎| 90/97 [00:13<00:01,  6.67it/s, loss=6.93, v_num=0]
Epoch 2:  94%|█████████▍| 91/97 [00:13<00:00,  6.71it/s, loss=6.93, v_num=0]
Epoch 2:  94%|█████████▍| 91/97 [00:13<00:00,  6.68it/s, loss=6.93, v_num=0]
Epoch 2:  95%|█████████▍| 92/97 [00:13<00:00,  6.71it/s, loss=6.93, v_num=0]
Epoch 2:  95%|█████████▍| 92/97 [00:13<00:00,  6.69it/s, loss=6.93, v_num=0]
Epoch 2:  96%|█████████▌| 93/97 [00:13<00:00,  6.72it/s, loss=6.93, v_num=0]
Epoch 2:  96%|█████████▌| 93/97 [00:13<00:00,  6.69it/s, loss=6.92, v_num=0]
Epoch 2:  97%|█████████▋| 94/97 [00:13<00:00,  6.73it/s, loss=6.92, v_num=0]
Epoch 2:  97%|█████████▋| 94/97 [00:14<00:00,  6.70it/s, loss=6.92, v_num=0]
Epoch 2:  98%|█████████▊| 95/97 [00:14<00:00,  6.73it/s, loss=6.92, v_num=0]
Epoch 2:  98%|█████████▊| 95/97 [00:14<00:00,  6.71it/s, loss=6.92, v_num=0]
Epoch 2:  99%|█████████▉| 96/97 [00:14<00:00,  6.74it/s, loss=6.92, v_num=0]
Epoch 2:  99%|█████████▉| 96/97 [00:14<00:00,  6.71it/s, loss=6.91, v_num=0]
Epoch 2: 100%|██████████| 97/97 [00:14<00:00,  6.74it/s, loss=6.91, v_num=0]
Epoch 2: 100%|██████████| 97/97 [00:14<00:00,  6.72it/s, loss=6.91, v_num=0]
Epoch 2: 100%|██████████| 97/97 [00:14<00:00,  6.72it/s, loss=6.91, v_num=0]
Epoch 2:   0%|          | 0/97 [00:00<?, ?it/s, loss=6.91, v_num=0]
Epoch 3:   0%|          | 0/97 [00:00<?, ?it/s, loss=6.91, v_num=0]
Epoch 3:   1%|          | 1/97 [00:01<02:13,  1.39s/it, loss=6.91, v_num=0]
Epoch 3:   1%|          | 1/97 [00:01<02:19,  1.45s/it, loss=6.91, v_num=0]
Epoch 3:   2%|▏         | 2/97 [00:01<01:12,  1.31it/s, loss=6.91, v_num=0]
Epoch 3:   2%|▏         | 2/97 [00:01<01:15,  1.26it/s, loss=6.9, v_num=0]
Epoch 3:   3%|▎         | 3/97 [00:01<00:52,  1.81it/s, loss=6.9, v_num=0]
Epoch 3:   3%|▎         | 3/97 [00:01<00:53,  1.75it/s, loss=6.9, v_num=0]
Epoch 3:   4%|▍         | 4/97 [00:01<00:41,  2.23it/s, loss=6.9, v_num=0]
Epoch 3:   4%|▍         | 4/97 [00:01<00:43,  2.16it/s, loss=6.91, v_num=0]
Epoch 3:   5%|▌         | 5/97 [00:01<00:35,  2.59it/s, loss=6.91, v_num=0]
Epoch 3:   5%|▌         | 5/97 [00:01<00:36,  2.52it/s, loss=6.9, v_num=0]
Epoch 3:   6%|▌         | 6/97 [00:02<00:31,  2.90it/s, loss=6.9, v_num=0]
Epoch 3:   6%|▌         | 6/97 [00:02<00:32,  2.83it/s, loss=6.9, v_num=0]
Epoch 3:   7%|▋         | 7/97 [00:02<00:28,  3.18it/s, loss=6.9, v_num=0]
Epoch 3:   7%|▋         | 7/97 [00:02<00:28,  3.11it/s, loss=6.9, v_num=0]
Epoch 3:   8%|▊         | 8/97 [00:02<00:25,  3.43it/s, loss=6.9, v_num=0]
Epoch 3:   8%|▊         | 8/97 [00:02<00:26,  3.35it/s, loss=6.89, v_num=0]
Epoch 3:   9%|▉         | 9/97 [00:02<00:24,  3.64it/s, loss=6.89, v_num=0]
Epoch 3:   9%|▉         | 9/97 [00:02<00:24,  3.56it/s, loss=6.89, v_num=0]
Epoch 3:  10%|█         | 10/97 [00:02<00:22,  3.83it/s, loss=6.89, v_num=0]
Epoch 3:  10%|█         | 10/97 [00:02<00:23,  3.75it/s, loss=6.89, v_num=0]
Epoch 3:  11%|█▏        | 11/97 [00:02<00:21,  4.01it/s, loss=6.89, v_num=0]
Epoch 3:  11%|█▏        | 11/97 [00:02<00:21,  3.93it/s, loss=6.88, v_num=0]
Epoch 3:  12%|█▏        | 12/97 [00:02<00:20,  4.16it/s, loss=6.88, v_num=0]
Epoch 3:  12%|█▏        | 12/97 [00:02<00:20,  4.09it/s, loss=6.88, v_num=0]
Epoch 3:  13%|█▎        | 13/97 [00:03<00:19,  4.32it/s, loss=6.88, v_num=0]
Epoch 3:  13%|█▎        | 13/97 [00:03<00:19,  4.23it/s, loss=6.88, v_num=0]
Epoch 3:  14%|█▍        | 14/97 [00:03<00:18,  4.44it/s, loss=6.88, v_num=0]
Epoch 3:  14%|█▍        | 14/97 [00:03<00:19,  4.36it/s, loss=6.87, v_num=0]
Epoch 3:  15%|█▌        | 15/97 [00:03<00:17,  4.56it/s, loss=6.87, v_num=0]
Epoch 3:  15%|█▌        | 15/97 [00:03<00:18,  4.49it/s, loss=6.87, v_num=0]
Epoch 3:  16%|█▋        | 16/97 [00:03<00:17,  4.68it/s, loss=6.87, v_num=0]
Epoch 3:  16%|█▋        | 16/97 [00:03<00:17,  4.60it/s, loss=6.87, v_num=0]
Epoch 3:  18%|█▊        | 17/97 [00:03<00:16,  4.78it/s, loss=6.87, v_num=0]
Epoch 3:  18%|█▊        | 17/97 [00:03<00:17,  4.70it/s, loss=6.87, v_num=0]
Epoch 3:  19%|█▊        | 18/97 [00:03<00:16,  4.87it/s, loss=6.87, v_num=0]
Epoch 3:  19%|█▊        | 18/97 [00:03<00:16,  4.80it/s, loss=6.87, v_num=0]
Epoch 3:  20%|█▉        | 19/97 [00:03<00:15,  4.97it/s, loss=6.87, v_num=0]
Epoch 3:  20%|█▉        | 19/97 [00:03<00:15,  4.89it/s, loss=6.87, v_num=0]
Epoch 3:  21%|██        | 20/97 [00:03<00:15,  5.04it/s, loss=6.87, v_num=0]
Epoch 3:  21%|██        | 20/97 [00:04<00:15,  4.98it/s, loss=6.88, v_num=0]
Epoch 3:  22%|██▏       | 21/97 [00:04<00:14,  5.12it/s, loss=6.88, v_num=0]
Epoch 3:  22%|██▏       | 21/97 [00:04<00:15,  5.06it/s, loss=6.87, v_num=0]
Epoch 3:  23%|██▎       | 22/97 [00:04<00:14,  5.20it/s, loss=6.87, v_num=0]
Epoch 3:  23%|██▎       | 22/97 [00:04<00:14,  5.13it/s, loss=6.87, v_num=0]
Epoch 3:  24%|██▎       | 23/97 [00:04<00:14,  5.27it/s, loss=6.87, v_num=0]
Epoch 3:  24%|██▎       | 23/97 [00:04<00:14,  5.20it/s, loss=6.87, v_num=0]
Epoch 3:  25%|██▍       | 24/97 [00:04<00:13,  5.33it/s, loss=6.87, v_num=0]
Epoch 3:  25%|██▍       | 24/97 [00:04<00:13,  5.27it/s, loss=6.87, v_num=0]
Epoch 3:  26%|██▌       | 25/97 [00:04<00:13,  5.39it/s, loss=6.87, v_num=0]
Epoch 3:  26%|██▌       | 25/97 [00:04<00:13,  5.33it/s, loss=6.87, v_num=0]
Epoch 3:  27%|██▋       | 26/97 [00:04<00:13,  5.45it/s, loss=6.87, v_num=0]
Epoch 3:  27%|██▋       | 26/97 [00:04<00:13,  5.39it/s, loss=6.87, v_num=0]
Epoch 3:  28%|██▊       | 27/97 [00:04<00:12,  5.50it/s, loss=6.87, v_num=0]
Epoch 3:  28%|██▊       | 27/97 [00:04<00:12,  5.44it/s, loss=6.87, v_num=0]
Epoch 3:  29%|██▉       | 28/97 [00:05<00:12,  5.56it/s, loss=6.87, v_num=0]
Epoch 3:  29%|██▉       | 28/97 [00:05<00:12,  5.49it/s, loss=6.86, v_num=0]
Epoch 3:  30%|██▉       | 29/97 [00:05<00:12,  5.60it/s, loss=6.86, v_num=0]
Epoch 3:  30%|██▉       | 29/97 [00:05<00:12,  5.54it/s, loss=6.86, v_num=0]
Epoch 3:  31%|███       | 30/97 [00:05<00:11,  5.65it/s, loss=6.86, v_num=0]
Epoch 3:  31%|███       | 30/97 [00:05<00:11,  5.59it/s, loss=6.86, v_num=0]
Epoch 3:  32%|███▏      | 31/97 [00:05<00:11,  5.69it/s, loss=6.86, v_num=0]
Epoch 3:  32%|███▏      | 31/97 [00:05<00:11,  5.63it/s, loss=6.86, v_num=0]
Epoch 3:  33%|███▎      | 32/97 [00:05<00:11,  5.73it/s, loss=6.86, v_num=0]
Epoch 3:  33%|███▎      | 32/97 [00:05<00:11,  5.68it/s, loss=6.86, v_num=0]
Epoch 3:  34%|███▍      | 33/97 [00:05<00:11,  5.77it/s, loss=6.86, v_num=0]
Epoch 3:  34%|███▍      | 33/97 [00:05<00:11,  5.72it/s, loss=6.85, v_num=0]
Epoch 3:  35%|███▌      | 34/97 [00:05<00:10,  5.81it/s, loss=6.85, v_num=0]
Epoch 3:  35%|███▌      | 34/97 [00:05<00:10,  5.75it/s, loss=6.85, v_num=0]
Epoch 3:  36%|███▌      | 35/97 [00:05<00:10,  5.84it/s, loss=6.85, v_num=0]
Epoch 3:  36%|███▌      | 35/97 [00:06<00:10,  5.79it/s, loss=6.85, v_num=0]
Epoch 3:  37%|███▋      | 36/97 [00:06<00:10,  5.88it/s, loss=6.85, v_num=0]
Epoch 3:  37%|███▋      | 36/97 [00:06<00:10,  5.83it/s, loss=6.85, v_num=0]
Epoch 3:  38%|███▊      | 37/97 [00:06<00:10,  5.91it/s, loss=6.85, v_num=0]
Epoch 3:  38%|███▊      | 37/97 [00:06<00:10,  5.86it/s, loss=6.84, v_num=0]
Epoch 3:  39%|███▉      | 38/97 [00:06<00:09,  5.94it/s, loss=6.84, v_num=0]
Epoch 3:  39%|███▉      | 38/97 [00:06<00:10,  5.89it/s, loss=6.84, v_num=0]
Epoch 3:  40%|████      | 39/97 [00:06<00:09,  5.97it/s, loss=6.84, v_num=0]
Epoch 3:  40%|████      | 39/97 [00:06<00:09,  5.92it/s, loss=6.84, v_num=0]
Epoch 3:  41%|████      | 40/97 [00:06<00:09,  6.00it/s, loss=6.84, v_num=0]
Epoch 3:  41%|████      | 40/97 [00:06<00:09,  5.95it/s, loss=6.83, v_num=0]
Epoch 3:  42%|████▏     | 41/97 [00:06<00:09,  6.03it/s, loss=6.83, v_num=0]
Epoch 3:  42%|████▏     | 41/97 [00:06<00:09,  5.98it/s, loss=6.83, v_num=0]
Epoch 3:  43%|████▎     | 42/97 [00:06<00:09,  6.05it/s, loss=6.83, v_num=0]
Epoch 3:  43%|████▎     | 42/97 [00:06<00:09,  6.01it/s, loss=6.83, v_num=0]
Epoch 3:  44%|████▍     | 43/97 [00:07<00:08,  6.08it/s, loss=6.83, v_num=0]
Epoch 3:  44%|████▍     | 43/97 [00:07<00:08,  6.03it/s, loss=6.83, v_num=0]
Epoch 3:  45%|████▌     | 44/97 [00:07<00:08,  6.10it/s, loss=6.83, v_num=0]
Epoch 3:  45%|████▌     | 44/97 [00:07<00:08,  6.06it/s, loss=6.83, v_num=0]
Epoch 3:  46%|████▋     | 45/97 [00:07<00:08,  6.12it/s, loss=6.83, v_num=0]
Epoch 3:  46%|████▋     | 45/97 [00:07<00:08,  6.08it/s, loss=6.83, v_num=0]
Epoch 3:  47%|████▋     | 46/97 [00:07<00:08,  6.15it/s, loss=6.83, v_num=0]
Epoch 3:  47%|████▋     | 46/97 [00:07<00:08,  6.10it/s, loss=6.82, v_num=0]
Epoch 3:  48%|████▊     | 47/97 [00:07<00:08,  6.17it/s, loss=6.82, v_num=0]
Epoch 3:  48%|████▊     | 47/97 [00:07<00:08,  6.13it/s, loss=6.81, v_num=0]
Epoch 3:  49%|████▉     | 48/97 [00:07<00:07,  6.19it/s, loss=6.81, v_num=0]
Epoch 3:  49%|████▉     | 48/97 [00:07<00:07,  6.15it/s, loss=6.81, v_num=0]
Epoch 3:  51%|█████     | 49/97 [00:07<00:07,  6.21it/s, loss=6.81, v_num=0]
Epoch 3:  51%|█████     | 49/97 [00:07<00:07,  6.16it/s, loss=6.81, v_num=0]
Epoch 3:  52%|█████▏    | 50/97 [00:08<00:07,  6.23it/s, loss=6.81, v_num=0]
Epoch 3:  52%|█████▏    | 50/97 [00:08<00:07,  6.18it/s, loss=6.81, v_num=0]
Epoch 3:  53%|█████▎    | 51/97 [00:08<00:07,  6.25it/s, loss=6.81, v_num=0]
Epoch 3:  53%|█████▎    | 51/97 [00:08<00:07,  6.20it/s, loss=6.81, v_num=0]
Epoch 3:  54%|█████▎    | 52/97 [00:08<00:07,  6.26it/s, loss=6.81, v_num=0]
Epoch 3:  54%|█████▎    | 52/97 [00:08<00:07,  6.22it/s, loss=6.81, v_num=0]
Epoch 3:  55%|█████▍    | 53/97 [00:08<00:07,  6.28it/s, loss=6.81, v_num=0]
Epoch 3:  55%|█████▍    | 53/97 [00:08<00:07,  6.24it/s, loss=6.8, v_num=0]
Epoch 3:  56%|█████▌    | 54/97 [00:08<00:06,  6.30it/s, loss=6.8, v_num=0]
Epoch 3:  56%|█████▌    | 54/97 [00:08<00:06,  6.26it/s, loss=6.8, v_num=0]
Epoch 3:  57%|█████▋    | 55/97 [00:08<00:06,  6.32it/s, loss=6.8, v_num=0]
Epoch 3:  57%|█████▋    | 55/97 [00:08<00:06,  6.27it/s, loss=6.79, v_num=0]
Epoch 3:  58%|█████▊    | 56/97 [00:08<00:06,  6.33it/s, loss=6.79, v_num=0]
Epoch 3:  58%|█████▊    | 56/97 [00:08<00:06,  6.29it/s, loss=6.78, v_num=0]
Epoch 3:  59%|█████▉    | 57/97 [00:08<00:06,  6.34it/s, loss=6.78, v_num=0]
Epoch 3:  59%|█████▉    | 57/97 [00:09<00:06,  6.30it/s, loss=6.78, v_num=0]
Epoch 3:  60%|█████▉    | 58/97 [00:09<00:06,  6.35it/s, loss=6.78, v_num=0]
Epoch 3:  60%|█████▉    | 58/97 [00:09<00:06,  6.32it/s, loss=6.78, v_num=0]
Epoch 3:  61%|██████    | 59/97 [00:09<00:05,  6.37it/s, loss=6.78, v_num=0]
Epoch 3:  61%|██████    | 59/97 [00:09<00:06,  6.33it/s, loss=6.77, v_num=0]
Epoch 3:  62%|██████▏   | 60/97 [00:09<00:05,  6.38it/s, loss=6.77, v_num=0]
Epoch 3:  62%|██████▏   | 60/97 [00:09<00:05,  6.35it/s, loss=6.76, v_num=0]
Epoch 3:  63%|██████▎   | 61/97 [00:09<00:05,  6.39it/s, loss=6.76, v_num=0]
Epoch 3:  63%|██████▎   | 61/97 [00:09<00:05,  6.36it/s, loss=6.76, v_num=0]
Epoch 3:  64%|██████▍   | 62/97 [00:09<00:05,  6.41it/s, loss=6.76, v_num=0]
Epoch 3:  64%|██████▍   | 62/97 [00:09<00:05,  6.37it/s, loss=6.75, v_num=0]
Epoch 3:  65%|██████▍   | 63/97 [00:09<00:05,  6.42it/s, loss=6.75, v_num=0]
Epoch 3:  65%|██████▍   | 63/97 [00:09<00:05,  6.38it/s, loss=6.74, v_num=0]
Epoch 3:  66%|██████▌   | 64/97 [00:09<00:05,  6.43it/s, loss=6.74, v_num=0]
Epoch 3:  66%|██████▌   | 64/97 [00:10<00:05,  6.39it/s, loss=6.73, v_num=0]
Epoch 3:  67%|██████▋   | 65/97 [00:10<00:04,  6.44it/s, loss=6.73, v_num=0]
Epoch 3:  67%|██████▋   | 65/97 [00:10<00:04,  6.41it/s, loss=6.73, v_num=0]
Epoch 3:  68%|██████▊   | 66/97 [00:10<00:04,  6.45it/s, loss=6.73, v_num=0]
Epoch 3:  68%|██████▊   | 66/97 [00:10<00:04,  6.42it/s, loss=6.72, v_num=0]
Epoch 3:  69%|██████▉   | 67/97 [00:10<00:04,  6.46it/s, loss=6.72, v_num=0]
Epoch 3:  69%|██████▉   | 67/97 [00:10<00:04,  6.43it/s, loss=6.72, v_num=0]
Epoch 3:  70%|███████   | 68/97 [00:10<00:04,  6.47it/s, loss=6.72, v_num=0]
Epoch 3:  70%|███████   | 68/97 [00:10<00:04,  6.44it/s, loss=6.72, v_num=0]
Epoch 3:  71%|███████   | 69/97 [00:10<00:04,  6.49it/s, loss=6.72, v_num=0]
Epoch 3:  71%|███████   | 69/97 [00:10<00:04,  6.45it/s, loss=6.72, v_num=0]
Epoch 3:  72%|███████▏  | 70/97 [00:10<00:04,  6.50it/s, loss=6.72, v_num=0]
Epoch 3:  72%|███████▏  | 70/97 [00:10<00:04,  6.46it/s, loss=6.71, v_num=0]
Epoch 3:  73%|███████▎  | 71/97 [00:10<00:03,  6.51it/s, loss=6.71, v_num=0]
Epoch 3:  73%|███████▎  | 71/97 [00:10<00:04,  6.48it/s, loss=6.71, v_num=0]
Epoch 3:  74%|███████▍  | 72/97 [00:11<00:03,  6.52it/s, loss=6.71, v_num=0]
Epoch 3:  74%|███████▍  | 72/97 [00:11<00:03,  6.49it/s, loss=6.71, v_num=0]
Epoch 3:  75%|███████▌  | 73/97 [00:11<00:03,  6.53it/s, loss=6.71, v_num=0]
Epoch 3:  75%|███████▌  | 73/97 [00:11<00:03,  6.50it/s, loss=6.71, v_num=0]
Epoch 3:  76%|███████▋  | 74/97 [00:11<00:03,  6.54it/s, loss=6.71, v_num=0]
Epoch 3:  76%|███████▋  | 74/97 [00:11<00:03,  6.51it/s, loss=6.7, v_num=0]
Epoch 3:  77%|███████▋  | 75/97 [00:11<00:03,  6.55it/s, loss=6.7, v_num=0]
Epoch 3:  77%|███████▋  | 75/97 [00:11<00:03,  6.52it/s, loss=6.71, v_num=0]
Epoch 3:  78%|███████▊  | 76/97 [00:11<00:03,  6.56it/s, loss=6.71, v_num=0]
Epoch 3:  78%|███████▊  | 76/97 [00:11<00:03,  6.53it/s, loss=6.71, v_num=0]
Epoch 3:  79%|███████▉  | 77/97 [00:11<00:03,  6.57it/s, loss=6.71, v_num=0]
Epoch 3:  79%|███████▉  | 77/97 [00:11<00:03,  6.54it/s, loss=6.71, v_num=0]
Epoch 3:  80%|████████  | 78/97 [00:11<00:02,  6.58it/s, loss=6.71, v_num=0]
Epoch 3:  80%|████████  | 78/97 [00:11<00:02,  6.55it/s, loss=6.7, v_num=0]
Epoch 3:  81%|████████▏ | 79/97 [00:11<00:02,  6.59it/s, loss=6.7, v_num=0]
Epoch 3:  81%|████████▏ | 79/97 [00:12<00:02,  6.56it/s, loss=6.69, v_num=0]
Epoch 3:  82%|████████▏ | 80/97 [00:12<00:02,  6.59it/s, loss=6.69, v_num=0]
Epoch 3:  82%|████████▏ | 80/97 [00:12<00:02,  6.56it/s, loss=6.69, v_num=0]
Epoch 3:  84%|████████▎ | 81/97 [00:12<00:02,  6.60it/s, loss=6.69, v_num=0]
Epoch 3:  84%|████████▎ | 81/97 [00:12<00:02,  6.57it/s, loss=6.68, v_num=0]
Epoch 3:  85%|████████▍ | 82/97 [00:12<00:02,  6.61it/s, loss=6.68, v_num=0]
Epoch 3:  85%|████████▍ | 82/97 [00:12<00:02,  6.58it/s, loss=6.68, v_num=0]
Epoch 3:  86%|████████▌ | 83/97 [00:12<00:02,  6.62it/s, loss=6.68, v_num=0]
Epoch 3:  86%|████████▌ | 83/97 [00:12<00:02,  6.59it/s, loss=6.68, v_num=0]
Epoch 3:  87%|████████▋ | 84/97 [00:12<00:01,  6.63it/s, loss=6.68, v_num=0]
Epoch 3:  87%|████████▋ | 84/97 [00:12<00:01,  6.60it/s, loss=6.68, v_num=0]
Epoch 3:  88%|████████▊ | 85/97 [00:12<00:01,  6.63it/s, loss=6.68, v_num=0]
Epoch 3:  88%|████████▊ | 85/97 [00:12<00:01,  6.60it/s, loss=6.68, v_num=0]
Epoch 3:  89%|████████▊ | 86/97 [00:12<00:01,  6.64it/s, loss=6.68, v_num=0]
Epoch 3:  89%|████████▊ | 86/97 [00:13<00:01,  6.61it/s, loss=6.68, v_num=0]
Epoch 3:  90%|████████▉ | 87/97 [00:13<00:01,  6.65it/s, loss=6.68, v_num=0]
Epoch 3:  90%|████████▉ | 87/97 [00:13<00:01,  6.62it/s, loss=6.67, v_num=0]
Epoch 3:  91%|█████████ | 88/97 [00:13<00:01,  6.66it/s, loss=6.67, v_num=0]
Epoch 3:  91%|█████████ | 88/97 [00:13<00:01,  6.63it/s, loss=6.66, v_num=0]
Epoch 3:  92%|█████████▏| 89/97 [00:13<00:01,  6.67it/s, loss=6.66, v_num=0]
Epoch 3:  92%|█████████▏| 89/97 [00:13<00:01,  6.64it/s, loss=6.66, v_num=0]
Epoch 3:  93%|█████████▎| 90/97 [00:13<00:01,  6.67it/s, loss=6.66, v_num=0]
Epoch 3:  93%|█████████▎| 90/97 [00:13<00:01,  6.64it/s, loss=6.65, v_num=0]
Epoch 3:  94%|█████████▍| 91/97 [00:13<00:00,  6.68it/s, loss=6.65, v_num=0]
Epoch 3:  94%|█████████▍| 91/97 [00:13<00:00,  6.65it/s, loss=6.65, v_num=0]
Epoch 3:  95%|█████████▍| 92/97 [00:13<00:00,  6.69it/s, loss=6.65, v_num=0]
Epoch 3:  95%|█████████▍| 92/97 [00:13<00:00,  6.66it/s, loss=6.63, v_num=0]
Epoch 3:  96%|█████████▌| 93/97 [00:13<00:00,  6.69it/s, loss=6.63, v_num=0]
Epoch 3:  96%|█████████▌| 93/97 [00:13<00:00,  6.66it/s, loss=6.63, v_num=0]
Epoch 3:  97%|█████████▋| 94/97 [00:14<00:00,  6.70it/s, loss=6.63, v_num=0]
Epoch 3:  97%|█████████▋| 94/97 [00:14<00:00,  6.67it/s, loss=6.62, v_num=0]
Epoch 3:  98%|█████████▊| 95/97 [00:14<00:00,  6.70it/s, loss=6.62, v_num=0]
Epoch 3:  98%|█████████▊| 95/97 [00:14<00:00,  6.68it/s, loss=6.61, v_num=0]
Epoch 3:  99%|█████████▉| 96/97 [00:14<00:00,  6.71it/s, loss=6.61, v_num=0]
Epoch 3:  99%|█████████▉| 96/97 [00:14<00:00,  6.68it/s, loss=6.6, v_num=0]
Epoch 3: 100%|██████████| 97/97 [00:14<00:00,  6.72it/s, loss=6.6, v_num=0]
Epoch 3: 100%|██████████| 97/97 [00:14<00:00,  6.69it/s, loss=6.6, v_num=0]
Epoch 3: 100%|██████████| 97/97 [00:14<00:00,  6.69it/s, loss=6.6, v_num=0]
Epoch 3:   0%|          | 0/97 [00:00<?, ?it/s, loss=6.6, v_num=0]
Epoch 4:   0%|          | 0/97 [00:00<?, ?it/s, loss=6.6, v_num=0]
Epoch 4:   1%|          | 1/97 [00:01<02:11,  1.37s/it, loss=6.6, v_num=0]
Epoch 4:   1%|          | 1/97 [00:01<02:16,  1.43s/it, loss=6.6, v_num=0]
Epoch 4:   2%|▏         | 2/97 [00:01<01:11,  1.32it/s, loss=6.6, v_num=0]
Epoch 4:   2%|▏         | 2/97 [00:01<01:14,  1.28it/s, loss=6.6, v_num=0]
Epoch 4:   3%|▎         | 3/97 [00:01<00:51,  1.82it/s, loss=6.6, v_num=0]
Epoch 4:   3%|▎         | 3/97 [00:01<00:53,  1.76it/s, loss=6.59, v_num=0]
Epoch 4:   4%|▍         | 4/97 [00:01<00:41,  2.24it/s, loss=6.59, v_num=0]
Epoch 4:   4%|▍         | 4/97 [00:01<00:42,  2.18it/s, loss=6.59, v_num=0]
Epoch 4:   5%|▌         | 5/97 [00:01<00:35,  2.61it/s, loss=6.59, v_num=0]
Epoch 4:   5%|▌         | 5/97 [00:01<00:36,  2.54it/s, loss=6.58, v_num=0]
Epoch 4:   6%|▌         | 6/97 [00:02<00:31,  2.92it/s, loss=6.58, v_num=0]
Epoch 4:   6%|▌         | 6/97 [00:02<00:31,  2.85it/s, loss=6.57, v_num=0]
Epoch 4:   7%|▋         | 7/97 [00:02<00:28,  3.20it/s, loss=6.57, v_num=0]
Epoch 4:   7%|▋         | 7/97 [00:02<00:28,  3.12it/s, loss=6.56, v_num=0]
Epoch 4:   8%|▊         | 8/97 [00:02<00:25,  3.44it/s, loss=6.56, v_num=0]
Epoch 4:   8%|▊         | 8/97 [00:02<00:26,  3.36it/s, loss=6.55, v_num=0]
Epoch 4:   9%|▉         | 9/97 [00:02<00:24,  3.64it/s, loss=6.55, v_num=0]
Epoch 4:   9%|▉         | 9/97 [00:02<00:24,  3.57it/s, loss=6.54, v_num=0]
Epoch 4:  10%|█         | 10/97 [00:02<00:22,  3.84it/s, loss=6.54, v_num=0]
Epoch 4:  10%|█         | 10/97 [00:02<00:23,  3.76it/s, loss=6.54, v_num=0]
Epoch 4:  11%|█▏        | 11/97 [00:02<00:21,  4.02it/s, loss=6.54, v_num=0]
Epoch 4:  11%|█▏        | 11/97 [00:02<00:21,  3.94it/s, loss=6.54, v_num=0]
Epoch 4:  12%|█▏        | 12/97 [00:02<00:20,  4.18it/s, loss=6.54, v_num=0]
Epoch 4:  12%|█▏        | 12/97 [00:02<00:20,  4.10it/s, loss=6.52, v_num=0]
Epoch 4:  13%|█▎        | 13/97 [00:03<00:19,  4.32it/s, loss=6.52, v_num=0]
Epoch 4:  13%|█▎        | 13/97 [00:03<00:19,  4.24it/s, loss=6.52, v_num=0]
Epoch 4:  14%|█▍        | 14/97 [00:03<00:18,  4.45it/s, loss=6.52, v_num=0]
Epoch 4:  14%|█▍        | 14/97 [00:03<00:18,  4.38it/s, loss=6.52, v_num=0]
Epoch 4:  15%|█▌        | 15/97 [00:03<00:17,  4.58it/s, loss=6.52, v_num=0]
Epoch 4:  15%|█▌        | 15/97 [00:03<00:18,  4.50it/s, loss=6.52, v_num=0]
Epoch 4:  16%|█▋        | 16/97 [00:03<00:17,  4.69it/s, loss=6.52, v_num=0]
Epoch 4:  16%|█▋        | 16/97 [00:03<00:17,  4.61it/s, loss=6.51, v_num=0]
Epoch 4:  18%|█▊        | 17/97 [00:03<00:16,  4.78it/s, loss=6.51, v_num=0]
Epoch 4:  18%|█▊        | 17/97 [00:03<00:16,  4.71it/s, loss=6.51, v_num=0]
Epoch 4:  19%|█▊        | 18/97 [00:03<00:16,  4.88it/s, loss=6.51, v_num=0]
Epoch 4:  19%|█▊        | 18/97 [00:03<00:16,  4.81it/s, loss=6.51, v_num=0]
Epoch 4:  20%|█▉        | 19/97 [00:03<00:15,  4.98it/s, loss=6.51, v_num=0]
Epoch 4:  20%|█▉        | 19/97 [00:03<00:15,  4.90it/s, loss=6.51, v_num=0]
Epoch 4:  21%|██        | 20/97 [00:03<00:15,  5.06it/s, loss=6.51, v_num=0]
Epoch 4:  21%|██        | 20/97 [00:04<00:15,  4.98it/s, loss=6.51, v_num=0]
Epoch 4:  22%|██▏       | 21/97 [00:04<00:14,  5.13it/s, loss=6.51, v_num=0]
Epoch 4:  22%|██▏       | 21/97 [00:04<00:15,  5.06it/s, loss=6.5, v_num=0]
Epoch 4:  23%|██▎       | 22/97 [00:04<00:14,  5.20it/s, loss=6.5, v_num=0]
Epoch 4:  23%|██▎       | 22/97 [00:04<00:14,  5.13it/s, loss=6.5, v_num=0]
Epoch 4:  24%|██▎       | 23/97 [00:04<00:14,  5.27it/s, loss=6.5, v_num=0]
Epoch 4:  24%|██▎       | 23/97 [00:04<00:14,  5.20it/s, loss=6.51, v_num=0]
Epoch 4:  25%|██▍       | 24/97 [00:04<00:13,  5.32it/s, loss=6.51, v_num=0]
Epoch 4:  25%|██▍       | 24/97 [00:04<00:13,  5.26it/s, loss=6.5, v_num=0]
Epoch 4:  26%|██▌       | 25/97 [00:04<00:13,  5.38it/s, loss=6.5, v_num=0]
Epoch 4:  26%|██▌       | 25/97 [00:04<00:13,  5.31it/s, loss=6.5, v_num=0]
Epoch 4:  27%|██▋       | 26/97 [00:04<00:13,  5.43it/s, loss=6.5, v_num=0]
Epoch 4:  27%|██▋       | 26/97 [00:04<00:13,  5.37it/s, loss=6.5, v_num=0]
Epoch 4:  28%|██▊       | 27/97 [00:04<00:12,  5.49it/s, loss=6.5, v_num=0]
Epoch 4:  28%|██▊       | 27/97 [00:04<00:12,  5.43it/s, loss=6.5, v_num=0]
Epoch 4:  29%|██▉       | 28/97 [00:05<00:12,  5.54it/s, loss=6.5, v_num=0]
Epoch 4:  29%|██▉       | 28/97 [00:05<00:12,  5.48it/s, loss=6.5, v_num=0]
Epoch 4:  30%|██▉       | 29/97 [00:05<00:12,  5.59it/s, loss=6.5, v_num=0]
Epoch 4:  30%|██▉       | 29/97 [00:05<00:12,  5.53it/s, loss=6.51, v_num=0]
Epoch 4:  31%|███       | 30/97 [00:05<00:11,  5.63it/s, loss=6.51, v_num=0]
Epoch 4:  31%|███       | 30/97 [00:05<00:12,  5.58it/s, loss=6.51, v_num=0]
Epoch 4:  32%|███▏      | 31/97 [00:05<00:11,  5.68it/s, loss=6.51, v_num=0]
Epoch 4:  32%|███▏      | 31/97 [00:05<00:11,  5.62it/s, loss=6.5, v_num=0]
Epoch 4:  33%|███▎      | 32/97 [00:05<00:11,  5.72it/s, loss=6.5, v_num=0]
Epoch 4:  33%|███▎      | 32/97 [00:05<00:11,  5.66it/s, loss=6.51, v_num=0]
Epoch 4:  34%|███▍      | 33/97 [00:05<00:11,  5.75it/s, loss=6.51, v_num=0]
Epoch 4:  34%|███▍      | 33/97 [00:05<00:11,  5.70it/s, loss=6.5, v_num=0]
Epoch 4:  35%|███▌      | 34/97 [00:05<00:10,  5.79it/s, loss=6.5, v_num=0]
Epoch 4:  35%|███▌      | 34/97 [00:05<00:10,  5.74it/s, loss=6.49, v_num=0]
Epoch 4:  36%|███▌      | 35/97 [00:06<00:10,  5.83it/s, loss=6.49, v_num=0]
Epoch 4:  36%|███▌      | 35/97 [00:06<00:10,  5.77it/s, loss=6.49, v_num=0]
Epoch 4:  37%|███▋      | 36/97 [00:06<00:10,  5.86it/s, loss=6.49, v_num=0]
Epoch 4:  37%|███▋      | 36/97 [00:06<00:10,  5.81it/s, loss=6.49, v_num=0]
Epoch 4:  38%|███▊      | 37/97 [00:06<00:10,  5.89it/s, loss=6.49, v_num=0]
Epoch 4:  38%|███▊      | 37/97 [00:06<00:10,  5.84it/s, loss=6.48, v_num=0]
Epoch 4:  39%|███▉      | 38/97 [00:06<00:09,  5.93it/s, loss=6.48, v_num=0]
Epoch 4:  39%|███▉      | 38/97 [00:06<00:10,  5.87it/s, loss=6.48, v_num=0]
Epoch 4:  40%|████      | 39/97 [00:06<00:09,  5.95it/s, loss=6.48, v_num=0]
Epoch 4:  40%|████      | 39/97 [00:06<00:09,  5.90it/s, loss=6.47, v_num=0]
Epoch 4:  41%|████      | 40/97 [00:06<00:09,  5.98it/s, loss=6.47, v_num=0]
Epoch 4:  41%|████      | 40/97 [00:06<00:09,  5.93it/s, loss=6.47, v_num=0]
Epoch 4:  42%|████▏     | 41/97 [00:06<00:09,  6.01it/s, loss=6.47, v_num=0]
Epoch 4:  42%|████▏     | 41/97 [00:06<00:09,  5.96it/s, loss=6.47, v_num=0]
Epoch 4:  43%|████▎     | 42/97 [00:06<00:09,  6.04it/s, loss=6.47, v_num=0]
Epoch 4:  43%|████▎     | 42/97 [00:07<00:09,  5.99it/s, loss=6.46, v_num=0]
Epoch 4:  44%|████▍     | 43/97 [00:07<00:08,  6.07it/s, loss=6.46, v_num=0]
Epoch 4:  44%|████▍     | 43/97 [00:07<00:08,  6.02it/s, loss=6.46, v_num=0]
Epoch 4:  45%|████▌     | 44/97 [00:07<00:08,  6.09it/s, loss=6.46, v_num=0]
Epoch 4:  45%|████▌     | 44/97 [00:07<00:08,  6.04it/s, loss=6.45, v_num=0]
Epoch 4:  46%|████▋     | 45/97 [00:07<00:08,  6.11it/s, loss=6.45, v_num=0]
Epoch 4:  46%|████▋     | 45/97 [00:07<00:08,  6.07it/s, loss=6.45, v_num=0]
Epoch 4:  47%|████▋     | 46/97 [00:07<00:08,  6.14it/s, loss=6.45, v_num=0]
Epoch 4:  47%|████▋     | 46/97 [00:07<00:08,  6.09it/s, loss=6.46, v_num=0]
Epoch 4:  48%|████▊     | 47/97 [00:07<00:08,  6.16it/s, loss=6.46, v_num=0]
Epoch 4:  48%|████▊     | 47/97 [00:07<00:08,  6.11it/s, loss=6.45, v_num=0]
Epoch 4:  49%|████▉     | 48/97 [00:07<00:07,  6.18it/s, loss=6.45, v_num=0]
Epoch 4:  49%|████▉     | 48/97 [00:07<00:07,  6.13it/s, loss=6.44, v_num=0]
Epoch 4:  51%|█████     | 49/97 [00:07<00:07,  6.20it/s, loss=6.44, v_num=0]
Epoch 4:  51%|█████     | 49/97 [00:07<00:07,  6.16it/s, loss=6.44, v_num=0]
Epoch 4:  52%|█████▏    | 50/97 [00:08<00:07,  6.22it/s, loss=6.44, v_num=0]
Epoch 4:  52%|█████▏    | 50/97 [00:08<00:07,  6.18it/s, loss=6.43, v_num=0]
Epoch 4:  53%|█████▎    | 51/97 [00:08<00:07,  6.24it/s, loss=6.43, v_num=0]
Epoch 4:  53%|█████▎    | 51/97 [00:08<00:07,  6.20it/s, loss=6.43, v_num=0]
Epoch 4:  54%|█████▎    | 52/97 [00:08<00:07,  6.26it/s, loss=6.43, v_num=0]
Epoch 4:  54%|█████▎    | 52/97 [00:08<00:07,  6.22it/s, loss=6.43, v_num=0]
Epoch 4:  55%|█████▍    | 53/97 [00:08<00:07,  6.27it/s, loss=6.43, v_num=0]
Epoch 4:  55%|█████▍    | 53/97 [00:08<00:07,  6.23it/s, loss=6.42, v_num=0]
Epoch 4:  56%|█████▌    | 54/97 [00:08<00:06,  6.29it/s, loss=6.42, v_num=0]
Epoch 4:  56%|█████▌    | 54/97 [00:08<00:06,  6.25it/s, loss=6.42, v_num=0]
Epoch 4:  57%|█████▋    | 55/97 [00:08<00:06,  6.31it/s, loss=6.42, v_num=0]
Epoch 4:  57%|█████▋    | 55/97 [00:08<00:06,  6.26it/s, loss=6.42, v_num=0]
Epoch 4:  58%|█████▊    | 56/97 [00:08<00:06,  6.32it/s, loss=6.42, v_num=0]
Epoch 4:  58%|█████▊    | 56/97 [00:08<00:06,  6.28it/s, loss=6.42, v_num=0]
Epoch 4:  59%|█████▉    | 57/97 [00:08<00:06,  6.34it/s, loss=6.42, v_num=0]
Epoch 4:  59%|█████▉    | 57/97 [00:09<00:06,  6.30it/s, loss=6.41, v_num=0]
Epoch 4:  60%|█████▉    | 58/97 [00:09<00:06,  6.35it/s, loss=6.41, v_num=0]
Epoch 4:  60%|█████▉    | 58/97 [00:09<00:06,  6.31it/s, loss=6.41, v_num=0]
Epoch 4:  61%|██████    | 59/97 [00:09<00:05,  6.37it/s, loss=6.41, v_num=0]
Epoch 4:  61%|██████    | 59/97 [00:09<00:06,  6.33it/s, loss=6.41, v_num=0]
Epoch 4:  62%|██████▏   | 60/97 [00:09<00:05,  6.38it/s, loss=6.41, v_num=0]
Epoch 4:  62%|██████▏   | 60/97 [00:09<00:05,  6.34it/s, loss=6.4, v_num=0]
Epoch 4:  63%|██████▎   | 61/97 [00:09<00:05,  6.39it/s, loss=6.4, v_num=0]
Epoch 4:  63%|██████▎   | 61/97 [00:09<00:05,  6.35it/s, loss=6.4, v_num=0]
Epoch 4:  64%|██████▍   | 62/97 [00:09<00:05,  6.40it/s, loss=6.4, v_num=0]
Epoch 4:  64%|██████▍   | 62/97 [00:09<00:05,  6.37it/s, loss=6.4, v_num=0]
Epoch 4:  65%|██████▍   | 63/97 [00:09<00:05,  6.42it/s, loss=6.4, v_num=0]
Epoch 4:  65%|██████▍   | 63/97 [00:09<00:05,  6.38it/s, loss=6.39, v_num=0]
Epoch 4:  66%|██████▌   | 64/97 [00:09<00:05,  6.43it/s, loss=6.39, v_num=0]
Epoch 4:  66%|██████▌   | 64/97 [00:10<00:05,  6.39it/s, loss=6.39, v_num=0]
Epoch 4:  67%|██████▋   | 65/97 [00:10<00:04,  6.44it/s, loss=6.39, v_num=0]
Epoch 4:  67%|██████▋   | 65/97 [00:10<00:04,  6.41it/s, loss=6.39, v_num=0]
Epoch 4:  68%|██████▊   | 66/97 [00:10<00:04,  6.46it/s, loss=6.39, v_num=0]
Epoch 4:  68%|██████▊   | 66/97 [00:10<00:04,  6.42it/s, loss=6.38, v_num=0]
Epoch 4:  69%|██████▉   | 67/97 [00:10<00:04,  6.47it/s, loss=6.38, v_num=0]
Epoch 4:  69%|██████▉   | 67/97 [00:10<00:04,  6.43it/s, loss=6.38, v_num=0]
Epoch 4:  70%|███████   | 68/97 [00:10<00:04,  6.48it/s, loss=6.38, v_num=0]
Epoch 4:  70%|███████   | 68/97 [00:10<00:04,  6.44it/s, loss=6.38, v_num=0]
Epoch 4:  71%|███████   | 69/97 [00:10<00:04,  6.49it/s, loss=6.38, v_num=0]
Epoch 4:  71%|███████   | 69/97 [00:10<00:04,  6.46it/s, loss=6.37, v_num=0]
Epoch 4:  72%|███████▏  | 70/97 [00:10<00:04,  6.50it/s, loss=6.37, v_num=0]
Epoch 4:  72%|███████▏  | 70/97 [00:10<00:04,  6.47it/s, loss=6.35, v_num=0]
Epoch 4:  73%|███████▎  | 71/97 [00:10<00:03,  6.51it/s, loss=6.35, v_num=0]
Epoch 4:  73%|███████▎  | 71/97 [00:10<00:04,  6.48it/s, loss=6.35, v_num=0]
Epoch 4:  74%|███████▍  | 72/97 [00:11<00:03,  6.52it/s, loss=6.35, v_num=0]
Epoch 4:  74%|███████▍  | 72/97 [00:11<00:03,  6.49it/s, loss=6.34, v_num=0]
Epoch 4:  75%|███████▌  | 73/97 [00:11<00:03,  6.53it/s, loss=6.34, v_num=0]
Epoch 4:  75%|███████▌  | 73/97 [00:11<00:03,  6.50it/s, loss=6.35, v_num=0]
Epoch 4:  76%|███████▋  | 74/97 [00:11<00:03,  6.54it/s, loss=6.35, v_num=0]
Epoch 4:  76%|███████▋  | 74/97 [00:11<00:03,  6.51it/s, loss=6.34, v_num=0]
Epoch 4:  77%|███████▋  | 75/97 [00:11<00:03,  6.55it/s, loss=6.34, v_num=0]
Epoch 4:  77%|███████▋  | 75/97 [00:11<00:03,  6.51it/s, loss=6.33, v_num=0]
Epoch 4:  78%|███████▊  | 76/97 [00:11<00:03,  6.56it/s, loss=6.33, v_num=0]
Epoch 4:  78%|███████▊  | 76/97 [00:11<00:03,  6.52it/s, loss=6.33, v_num=0]
Epoch 4:  79%|███████▉  | 77/97 [00:11<00:03,  6.56it/s, loss=6.33, v_num=0]
Epoch 4:  79%|███████▉  | 77/97 [00:11<00:03,  6.53it/s, loss=6.33, v_num=0]
Epoch 4:  80%|████████  | 78/97 [00:11<00:02,  6.57it/s, loss=6.33, v_num=0]
Epoch 4:  80%|████████  | 78/97 [00:11<00:02,  6.54it/s, loss=6.33, v_num=0]
Epoch 4:  81%|████████▏ | 79/97 [00:12<00:02,  6.58it/s, loss=6.33, v_num=0]
Epoch 4:  81%|████████▏ | 79/97 [00:12<00:02,  6.55it/s, loss=6.32, v_num=0]
Epoch 4:  82%|████████▏ | 80/97 [00:12<00:02,  6.59it/s, loss=6.32, v_num=0]
Epoch 4:  82%|████████▏ | 80/97 [00:12<00:02,  6.56it/s, loss=6.32, v_num=0]
Epoch 4:  84%|████████▎ | 81/97 [00:12<00:02,  6.60it/s, loss=6.32, v_num=0]
Epoch 4:  84%|████████▎ | 81/97 [00:12<00:02,  6.57it/s, loss=6.31, v_num=0]
Epoch 4:  85%|████████▍ | 82/97 [00:12<00:02,  6.61it/s, loss=6.31, v_num=0]
Epoch 4:  85%|████████▍ | 82/97 [00:12<00:02,  6.58it/s, loss=6.31, v_num=0]
Epoch 4:  86%|████████▌ | 83/97 [00:12<00:02,  6.61it/s, loss=6.31, v_num=0]
Epoch 4:  86%|████████▌ | 83/97 [00:12<00:02,  6.59it/s, loss=6.31, v_num=0]
Epoch 4:  87%|████████▋ | 84/97 [00:12<00:01,  6.62it/s, loss=6.31, v_num=0]
Epoch 4:  87%|████████▋ | 84/97 [00:12<00:01,  6.59it/s, loss=6.3, v_num=0]
Epoch 4:  88%|████████▊ | 85/97 [00:12<00:01,  6.63it/s, loss=6.3, v_num=0]
Epoch 4:  88%|████████▊ | 85/97 [00:12<00:01,  6.60it/s, loss=6.3, v_num=0]
Epoch 4:  89%|████████▊ | 86/97 [00:12<00:01,  6.64it/s, loss=6.3, v_num=0]
Epoch 4:  89%|████████▊ | 86/97 [00:13<00:01,  6.61it/s, loss=6.3, v_num=0]
Epoch 4:  90%|████████▉ | 87/97 [00:13<00:01,  6.65it/s, loss=6.3, v_num=0]
Epoch 4:  90%|████████▉ | 87/97 [00:13<00:01,  6.62it/s, loss=6.29, v_num=0]
Epoch 4:  91%|█████████ | 88/97 [00:13<00:01,  6.66it/s, loss=6.29, v_num=0]
Epoch 4:  91%|█████████ | 88/97 [00:13<00:01,  6.63it/s, loss=6.29, v_num=0]
Epoch 4:  92%|█████████▏| 89/97 [00:13<00:01,  6.66it/s, loss=6.29, v_num=0]
Epoch 4:  92%|█████████▏| 89/97 [00:13<00:01,  6.63it/s, loss=6.29, v_num=0]
Epoch 4:  93%|█████████▎| 90/97 [00:13<00:01,  6.67it/s, loss=6.29, v_num=0]
Epoch 4:  93%|█████████▎| 90/97 [00:13<00:01,  6.64it/s, loss=6.29, v_num=0]
Epoch 4:  94%|█████████▍| 91/97 [00:13<00:00,  6.67it/s, loss=6.29, v_num=0]
Epoch 4:  94%|█████████▍| 91/97 [00:13<00:00,  6.65it/s, loss=6.29, v_num=0]
Epoch 4:  95%|█████████▍| 92/97 [00:13<00:00,  6.68it/s, loss=6.29, v_num=0]
Epoch 4:  95%|█████████▍| 92/97 [00:13<00:00,  6.65it/s, loss=6.3, v_num=0]
Epoch 4:  96%|█████████▌| 93/97 [00:13<00:00,  6.69it/s, loss=6.3, v_num=0]
Epoch 4:  96%|█████████▌| 93/97 [00:13<00:00,  6.66it/s, loss=6.28, v_num=0]
Epoch 4:  97%|█████████▋| 94/97 [00:14<00:00,  6.69it/s, loss=6.28, v_num=0]
Epoch 4:  97%|█████████▋| 94/97 [00:14<00:00,  6.67it/s, loss=6.28, v_num=0]
Epoch 4:  98%|█████████▊| 95/97 [00:14<00:00,  6.70it/s, loss=6.28, v_num=0]
Epoch 4:  98%|█████████▊| 95/97 [00:14<00:00,  6.67it/s, loss=6.28, v_num=0]
Epoch 4:  99%|█████████▉| 96/97 [00:14<00:00,  6.71it/s, loss=6.28, v_num=0]
Epoch 4:  99%|█████████▉| 96/97 [00:14<00:00,  6.68it/s, loss=6.28, v_num=0]
Epoch 4: 100%|██████████| 97/97 [00:14<00:00,  6.71it/s, loss=6.28, v_num=0]
Epoch 4: 100%|██████████| 97/97 [00:14<00:00,  6.69it/s, loss=6.27, v_num=0]
Epoch 4: 100%|██████████| 97/97 [00:14<00:00,  6.69it/s, loss=6.27, v_num=0]
Epoch 4:   0%|          | 0/97 [00:00<?, ?it/s, loss=6.27, v_num=0]
Epoch 5:   0%|          | 0/97 [00:00<?, ?it/s, loss=6.27, v_num=0]
Epoch 5:   1%|          | 1/97 [00:01<02:11,  1.37s/it, loss=6.27, v_num=0]
Epoch 5:   1%|          | 1/97 [00:01<02:16,  1.42s/it, loss=6.26, v_num=0]
Epoch 5:   2%|▏         | 2/97 [00:01<01:11,  1.33it/s, loss=6.26, v_num=0]
Epoch 5:   2%|▏         | 2/97 [00:01<01:14,  1.28it/s, loss=6.26, v_num=0]
Epoch 5:   3%|▎         | 3/97 [00:01<00:51,  1.81it/s, loss=6.26, v_num=0]
Epoch 5:   3%|▎         | 3/97 [00:01<00:53,  1.76it/s, loss=6.25, v_num=0]
Epoch 5:   4%|▍         | 4/97 [00:01<00:41,  2.24it/s, loss=6.25, v_num=0]
Epoch 5:   4%|▍         | 4/97 [00:01<00:42,  2.17it/s, loss=6.25, v_num=0]
Epoch 5:   5%|▌         | 5/97 [00:01<00:35,  2.60it/s, loss=6.25, v_num=0]
Epoch 5:   5%|▌         | 5/97 [00:01<00:36,  2.53it/s, loss=6.24, v_num=0]
Epoch 5:   6%|▌         | 6/97 [00:02<00:31,  2.92it/s, loss=6.24, v_num=0]
Epoch 5:   6%|▌         | 6/97 [00:02<00:32,  2.84it/s, loss=6.24, v_num=0]
Epoch 5:   7%|▋         | 7/97 [00:02<00:28,  3.19it/s, loss=6.24, v_num=0]
Epoch 5:   7%|▋         | 7/97 [00:02<00:28,  3.11it/s, loss=6.23, v_num=0]
Epoch 5:   8%|▊         | 8/97 [00:02<00:25,  3.44it/s, loss=6.23, v_num=0]
Epoch 5:   8%|▊         | 8/97 [00:02<00:26,  3.36it/s, loss=6.22, v_num=0]
Epoch 5:   9%|▉         | 9/97 [00:02<00:24,  3.64it/s, loss=6.22, v_num=0]
Epoch 5:   9%|▉         | 9/97 [00:02<00:24,  3.56it/s, loss=6.21, v_num=0]
Epoch 5:  10%|█         | 10/97 [00:02<00:22,  3.83it/s, loss=6.21, v_num=0]
Epoch 5:  10%|█         | 10/97 [00:02<00:23,  3.76it/s, loss=6.21, v_num=0]
Epoch 5:  11%|█▏        | 11/97 [00:02<00:21,  4.00it/s, loss=6.21, v_num=0]
Epoch 5:  11%|█▏        | 11/97 [00:02<00:21,  3.92it/s, loss=6.22, v_num=0]
Epoch 5:  12%|█▏        | 12/97 [00:02<00:20,  4.16it/s, loss=6.22, v_num=0]
Epoch 5:  12%|█▏        | 12/97 [00:02<00:20,  4.08it/s, loss=6.22, v_num=0]
Epoch 5:  13%|█▎        | 13/97 [00:03<00:19,  4.30it/s, loss=6.22, v_num=0]
Epoch 5:  13%|█▎        | 13/97 [00:03<00:19,  4.23it/s, loss=6.21, v_num=0]
Epoch 5:  14%|█▍        | 14/97 [00:03<00:18,  4.44it/s, loss=6.21, v_num=0]
Epoch 5:  14%|█▍        | 14/97 [00:03<00:19,  4.36it/s, loss=6.2, v_num=0]
Epoch 5:  15%|█▌        | 15/97 [00:03<00:17,  4.56it/s, loss=6.2, v_num=0]
Epoch 5:  15%|█▌        | 15/97 [00:03<00:18,  4.48it/s, loss=6.19, v_num=0]
Epoch 5:  16%|█▋        | 16/97 [00:03<00:17,  4.68it/s, loss=6.19, v_num=0]
Epoch 5:  16%|█▋        | 16/97 [00:03<00:17,  4.60it/s, loss=6.19, v_num=0]
Epoch 5:  18%|█▊        | 17/97 [00:03<00:16,  4.77it/s, loss=6.19, v_num=0]
Epoch 5:  18%|█▊        | 17/97 [00:03<00:17,  4.70it/s, loss=6.18, v_num=0]
Epoch 5:  19%|█▊        | 18/97 [00:03<00:16,  4.87it/s, loss=6.18, v_num=0]
Epoch 5:  19%|█▊        | 18/97 [00:03<00:16,  4.79it/s, loss=6.17, v_num=0]
Epoch 5:  20%|█▉        | 19/97 [00:03<00:15,  4.95it/s, loss=6.17, v_num=0]
Epoch 5:  20%|█▉        | 19/97 [00:03<00:15,  4.88it/s, loss=6.18, v_num=0]
Epoch 5:  21%|██        | 20/97 [00:03<00:15,  5.04it/s, loss=6.18, v_num=0]
Epoch 5:  21%|██        | 20/97 [00:04<00:15,  4.97it/s, loss=6.18, v_num=0]
Epoch 5:  22%|██▏       | 21/97 [00:04<00:14,  5.12it/s, loss=6.18, v_num=0]
Epoch 5:  22%|██▏       | 21/97 [00:04<00:15,  5.05it/s, loss=6.18, v_num=0]
Epoch 5:  23%|██▎       | 22/97 [00:04<00:14,  5.19it/s, loss=6.18, v_num=0]
Epoch 5:  23%|██▎       | 22/97 [00:04<00:14,  5.12it/s, loss=6.18, v_num=0]
Epoch 5:  24%|██▎       | 23/97 [00:04<00:14,  5.25it/s, loss=6.18, v_num=0]
Epoch 5:  24%|██▎       | 23/97 [00:04<00:14,  5.19it/s, loss=6.17, v_num=0]
Epoch 5:  25%|██▍       | 24/97 [00:04<00:13,  5.32it/s, loss=6.17, v_num=0]
Epoch 5:  25%|██▍       | 24/97 [00:04<00:13,  5.25it/s, loss=6.17, v_num=0]
Epoch 5:  26%|██▌       | 25/97 [00:04<00:13,  5.38it/s, loss=6.17, v_num=0]
Epoch 5:  26%|██▌       | 25/97 [00:04<00:13,  5.31it/s, loss=6.16, v_num=0]
Epoch 5:  27%|██▋       | 26/97 [00:04<00:13,  5.43it/s, loss=6.16, v_num=0]
Epoch 5:  27%|██▋       | 26/97 [00:04<00:13,  5.37it/s, loss=6.16, v_num=0]
Epoch 5:  28%|██▊       | 27/97 [00:04<00:12,  5.48it/s, loss=6.16, v_num=0]
Epoch 5:  28%|██▊       | 27/97 [00:04<00:12,  5.42it/s, loss=6.16, v_num=0]
Epoch 5:  29%|██▉       | 28/97 [00:05<00:12,  5.54it/s, loss=6.16, v_num=0]
Epoch 5:  29%|██▉       | 28/97 [00:05<00:12,  5.48it/s, loss=6.15, v_num=0]
Epoch 5:  30%|██▉       | 29/97 [00:05<00:12,  5.58it/s, loss=6.15, v_num=0]
Epoch 5:  30%|██▉       | 29/97 [00:05<00:12,  5.53it/s, loss=6.14, v_num=0]
Epoch 5:  31%|███       | 30/97 [00:05<00:11,  5.63it/s, loss=6.14, v_num=0]
Epoch 5:  31%|███       | 30/97 [00:05<00:12,  5.57it/s, loss=6.14, v_num=0]
Epoch 5:  32%|███▏      | 31/97 [00:05<00:11,  5.67it/s, loss=6.14, v_num=0]
Epoch 5:  32%|███▏      | 31/97 [00:05<00:11,  5.62it/s, loss=6.13, v_num=0]
Epoch 5:  33%|███▎      | 32/97 [00:05<00:11,  5.71it/s, loss=6.13, v_num=0]
Epoch 5:  33%|███▎      | 32/97 [00:05<00:11,  5.66it/s, loss=6.12, v_num=0]
Epoch 5:  34%|███▍      | 33/97 [00:05<00:11,  5.75it/s, loss=6.12, v_num=0]
Epoch 5:  34%|███▍      | 33/97 [00:05<00:11,  5.70it/s, loss=6.12, v_num=0]
Epoch 5:  35%|███▌      | 34/97 [00:05<00:10,  5.78it/s, loss=6.12, v_num=0]
Epoch 5:  35%|███▌      | 34/97 [00:05<00:10,  5.73it/s, loss=6.12, v_num=0]
Epoch 5:  36%|███▌      | 35/97 [00:06<00:10,  5.82it/s, loss=6.12, v_num=0]
Epoch 5:  36%|███▌      | 35/97 [00:06<00:10,  5.77it/s, loss=6.11, v_num=0]
Epoch 5:  37%|███▋      | 36/97 [00:06<00:10,  5.85it/s, loss=6.11, v_num=0]
Epoch 5:  37%|███▋      | 36/97 [00:06<00:10,  5.80it/s, loss=6.1, v_num=0]
Epoch 5:  38%|███▊      | 37/97 [00:06<00:10,  5.89it/s, loss=6.1, v_num=0]
Epoch 5:  38%|███▊      | 37/97 [00:06<00:10,  5.84it/s, loss=6.11, v_num=0]
Epoch 5:  39%|███▉      | 38/97 [00:06<00:09,  5.92it/s, loss=6.11, v_num=0]
Epoch 5:  39%|███▉      | 38/97 [00:06<00:10,  5.87it/s, loss=6.11, v_num=0]
Epoch 5:  40%|████      | 39/97 [00:06<00:09,  5.95it/s, loss=6.11, v_num=0]
Epoch 5:  40%|████      | 39/97 [00:06<00:09,  5.90it/s, loss=6.1, v_num=0]
Epoch 5:  41%|████      | 40/97 [00:06<00:09,  5.98it/s, loss=6.1, v_num=0]
Epoch 5:  41%|████      | 40/97 [00:06<00:09,  5.93it/s, loss=6.09, v_num=0]
Epoch 5:  42%|████▏     | 41/97 [00:06<00:09,  6.00it/s, loss=6.09, v_num=0]
Epoch 5:  42%|████▏     | 41/97 [00:06<00:09,  5.96it/s, loss=6.1, v_num=0]
Epoch 5:  43%|████▎     | 42/97 [00:06<00:09,  6.03it/s, loss=6.1, v_num=0]
Epoch 5:  43%|████▎     | 42/97 [00:07<00:09,  5.98it/s, loss=6.09, v_num=0]
Epoch 5:  44%|████▍     | 43/97 [00:07<00:08,  6.06it/s, loss=6.09, v_num=0]
Epoch 5:  44%|████▍     | 43/97 [00:07<00:08,  6.01it/s, loss=6.1, v_num=0]
Epoch 5:  45%|████▌     | 44/97 [00:07<00:08,  6.08it/s, loss=6.1, v_num=0]
Epoch 5:  45%|████▌     | 44/97 [00:07<00:08,  6.03it/s, loss=6.09, v_num=0]
Epoch 5:  46%|████▋     | 45/97 [00:07<00:08,  6.10it/s, loss=6.09, v_num=0]
Epoch 5:  46%|████▋     | 45/97 [00:07<00:08,  6.06it/s, loss=6.09, v_num=0]
Epoch 5:  47%|████▋     | 46/97 [00:07<00:08,  6.13it/s, loss=6.09, v_num=0]
Epoch 5:  47%|████▋     | 46/97 [00:07<00:08,  6.08it/s, loss=6.09, v_num=0]
Epoch 5:  48%|████▊     | 47/97 [00:07<00:08,  6.14it/s, loss=6.09, v_num=0]
Epoch 5:  48%|████▊     | 47/97 [00:07<00:08,  6.10it/s, loss=6.09, v_num=0]
Epoch 5:  49%|████▉     | 48/97 [00:07<00:07,  6.16it/s, loss=6.09, v_num=0]
Epoch 5:  49%|████▉     | 48/97 [00:07<00:08,  6.12it/s, loss=6.09, v_num=0]
Epoch 5:  51%|█████     | 49/97 [00:07<00:07,  6.18it/s, loss=6.09, v_num=0]
Epoch 5:  51%|█████     | 49/97 [00:07<00:07,  6.14it/s, loss=6.09, v_num=0]
Epoch 5:  52%|█████▏    | 50/97 [00:08<00:07,  6.20it/s, loss=6.09, v_num=0]
Epoch 5:  52%|█████▏    | 50/97 [00:08<00:07,  6.16it/s, loss=6.08, v_num=0]
Epoch 5:  53%|█████▎    | 51/97 [00:08<00:07,  6.22it/s, loss=6.08, v_num=0]
Epoch 5:  53%|█████▎    | 51/97 [00:08<00:07,  6.18it/s, loss=6.08, v_num=0]
Epoch 5:  54%|█████▎    | 52/97 [00:08<00:07,  6.24it/s, loss=6.08, v_num=0]
Epoch 5:  54%|█████▎    | 52/97 [00:08<00:07,  6.20it/s, loss=6.07, v_num=0]
Epoch 5:  55%|█████▍    | 53/97 [00:08<00:07,  6.26it/s, loss=6.07, v_num=0]
Epoch 5:  55%|█████▍    | 53/97 [00:08<00:07,  6.22it/s, loss=6.07, v_num=0]
Epoch 5:  56%|█████▌    | 54/97 [00:08<00:06,  6.27it/s, loss=6.07, v_num=0]
Epoch 5:  56%|█████▌    | 54/97 [00:08<00:06,  6.23it/s, loss=6.06, v_num=0]
Epoch 5:  57%|█████▋    | 55/97 [00:08<00:06,  6.29it/s, loss=6.06, v_num=0]
Epoch 5:  57%|█████▋    | 55/97 [00:08<00:06,  6.25it/s, loss=6.06, v_num=0]
Epoch 5:  58%|█████▊    | 56/97 [00:08<00:06,  6.30it/s, loss=6.06, v_num=0]
Epoch 5:  58%|█████▊    | 56/97 [00:08<00:06,  6.26it/s, loss=6.06, v_num=0]
Epoch 5:  59%|█████▉    | 57/97 [00:09<00:06,  6.32it/s, loss=6.06, v_num=0]
Epoch 5:  59%|█████▉    | 57/97 [00:09<00:06,  6.28it/s, loss=6.05, v_num=0]
Epoch 5:  60%|█████▉    | 58/97 [00:09<00:06,  6.33it/s, loss=6.05, v_num=0]
Epoch 5:  60%|█████▉    | 58/97 [00:09<00:06,  6.29it/s, loss=6.06, v_num=0]
Epoch 5:  61%|██████    | 59/97 [00:09<00:05,  6.35it/s, loss=6.06, v_num=0]
Epoch 5:  61%|██████    | 59/97 [00:09<00:06,  6.31it/s, loss=6.05, v_num=0]
Epoch 5:  62%|██████▏   | 60/97 [00:09<00:05,  6.36it/s, loss=6.05, v_num=0]
Epoch 5:  62%|██████▏   | 60/97 [00:09<00:05,  6.32it/s, loss=6.05, v_num=0]
Epoch 5:  63%|██████▎   | 61/97 [00:09<00:05,  6.37it/s, loss=6.05, v_num=0]
Epoch 5:  63%|██████▎   | 61/97 [00:09<00:05,  6.34it/s, loss=6.04, v_num=0]
Epoch 5:  64%|██████▍   | 62/97 [00:09<00:05,  6.39it/s, loss=6.04, v_num=0]
Epoch 5:  64%|██████▍   | 62/97 [00:09<00:05,  6.35it/s, loss=6.04, v_num=0]
Epoch 5:  65%|██████▍   | 63/97 [00:09<00:05,  6.40it/s, loss=6.04, v_num=0]
Epoch 5:  65%|██████▍   | 63/97 [00:09<00:05,  6.36it/s, loss=6.02, v_num=0]
Epoch 5:  66%|██████▌   | 64/97 [00:09<00:05,  6.41it/s, loss=6.02, v_num=0]
Epoch 5:  66%|██████▌   | 64/97 [00:10<00:05,  6.38it/s, loss=6.02, v_num=0]
Epoch 5:  67%|██████▋   | 65/97 [00:10<00:04,  6.42it/s, loss=6.02, v_num=0]
Epoch 5:  67%|██████▋   | 65/97 [00:10<00:05,  6.39it/s, loss=6.01, v_num=0]
Epoch 5:  68%|██████▊   | 66/97 [00:10<00:04,  6.44it/s, loss=6.01, v_num=0]
Epoch 5:  68%|██████▊   | 66/97 [00:10<00:04,  6.40it/s, loss=6.01, v_num=0]
Epoch 5:  69%|██████▉   | 67/97 [00:10<00:04,  6.45it/s, loss=6.01, v_num=0]
Epoch 5:  69%|██████▉   | 67/97 [00:10<00:04,  6.41it/s, loss=6.02, v_num=0]
Epoch 5:  70%|███████   | 68/97 [00:10<00:04,  6.46it/s, loss=6.02, v_num=0]
Epoch 5:  70%|███████   | 68/97 [00:10<00:04,  6.43it/s, loss=6.02, v_num=0]
Epoch 5:  71%|███████   | 69/97 [00:10<00:04,  6.47it/s, loss=6.02, v_num=0]
Epoch 5:  71%|███████   | 69/97 [00:10<00:04,  6.44it/s, loss=6.02, v_num=0]
Epoch 5:  72%|███████▏  | 70/97 [00:10<00:04,  6.48it/s, loss=6.02, v_num=0]
Epoch 5:  72%|███████▏  | 70/97 [00:10<00:04,  6.45it/s, loss=6.02, v_num=0]
Epoch 5:  73%|███████▎  | 71/97 [00:10<00:04,  6.49it/s, loss=6.02, v_num=0]
Epoch 5:  73%|███████▎  | 71/97 [00:10<00:04,  6.46it/s, loss=6.02, v_num=0]
Epoch 5:  74%|███████▍  | 72/97 [00:11<00:03,  6.50it/s, loss=6.02, v_num=0]
Epoch 5:  74%|███████▍  | 72/97 [00:11<00:03,  6.47it/s, loss=6.01, v_num=0]
Epoch 5:  75%|███████▌  | 73/97 [00:11<00:03,  6.51it/s, loss=6.01, v_num=0]
Epoch 5:  75%|███████▌  | 73/97 [00:11<00:03,  6.48it/s, loss=6.01, v_num=0]
Epoch 5:  76%|███████▋  | 74/97 [00:11<00:03,  6.52it/s, loss=6.01, v_num=0]
Epoch 5:  76%|███████▋  | 74/97 [00:11<00:03,  6.49it/s, loss=6.01, v_num=0]
Epoch 5:  77%|███████▋  | 75/97 [00:11<00:03,  6.53it/s, loss=6.01, v_num=0]
Epoch 5:  77%|███████▋  | 75/97 [00:11<00:03,  6.50it/s, loss=6, v_num=0]
Epoch 5:  78%|███████▊  | 76/97 [00:11<00:03,  6.54it/s, loss=6, v_num=0]
Epoch 5:  78%|███████▊  | 76/97 [00:11<00:03,  6.51it/s, loss=6, v_num=0]
Epoch 5:  79%|███████▉  | 77/97 [00:11<00:03,  6.55it/s, loss=6, v_num=0]
Epoch 5:  79%|███████▉  | 77/97 [00:11<00:03,  6.52it/s, loss=6, v_num=0]
Epoch 5:  80%|████████  | 78/97 [00:11<00:02,  6.56it/s, loss=6, v_num=0]
Epoch 5:  80%|████████  | 78/97 [00:11<00:02,  6.53it/s, loss=5.99, v_num=0]
Epoch 5:  81%|████████▏ | 79/97 [00:12<00:02,  6.57it/s, loss=5.99, v_num=0]
Epoch 5:  81%|████████▏ | 79/97 [00:12<00:02,  6.54it/s, loss=5.99, v_num=0]
Epoch 5:  82%|████████▏ | 80/97 [00:12<00:02,  6.58it/s, loss=5.99, v_num=0]
Epoch 5:  82%|████████▏ | 80/97 [00:12<00:02,  6.55it/s, loss=5.99, v_num=0]
Epoch 5:  84%|████████▎ | 81/97 [00:12<00:02,  6.59it/s, loss=5.99, v_num=0]
Epoch 5:  84%|████████▎ | 81/97 [00:12<00:02,  6.56it/s, loss=6, v_num=0]
Epoch 5:  85%|████████▍ | 82/97 [00:12<00:02,  6.59it/s, loss=6, v_num=0]
Epoch 5:  85%|████████▍ | 82/97 [00:12<00:02,  6.56it/s, loss=6, v_num=0]
Epoch 5:  86%|████████▌ | 83/97 [00:12<00:02,  6.60it/s, loss=6, v_num=0]
Epoch 5:  86%|████████▌ | 83/97 [00:12<00:02,  6.57it/s, loss=6, v_num=0]
Epoch 5:  87%|████████▋ | 84/97 [00:12<00:01,  6.61it/s, loss=6, v_num=0]
Epoch 5:  87%|████████▋ | 84/97 [00:12<00:01,  6.58it/s, loss=5.99, v_num=0]
Epoch 5:  88%|████████▊ | 85/97 [00:12<00:01,  6.62it/s, loss=5.99, v_num=0]
Epoch 5:  88%|████████▊ | 85/97 [00:12<00:01,  6.59it/s, loss=5.99, v_num=0]
Epoch 5:  89%|████████▊ | 86/97 [00:12<00:01,  6.63it/s, loss=5.99, v_num=0]
Epoch 5:  89%|████████▊ | 86/97 [00:13<00:01,  6.60it/s, loss=5.98, v_num=0]
Epoch 5:  90%|████████▉ | 87/97 [00:13<00:01,  6.63it/s, loss=5.98, v_num=0]
Epoch 5:  90%|████████▉ | 87/97 [00:13<00:01,  6.61it/s, loss=5.96, v_num=0]
Epoch 5:  91%|█████████ | 88/97 [00:13<00:01,  6.64it/s, loss=5.96, v_num=0]
Epoch 5:  91%|█████████ | 88/97 [00:13<00:01,  6.61it/s, loss=5.97, v_num=0]
Epoch 5:  92%|█████████▏| 89/97 [00:13<00:01,  6.65it/s, loss=5.97, v_num=0]
Epoch 5:  92%|█████████▏| 89/97 [00:13<00:01,  6.62it/s, loss=5.96, v_num=0]
Epoch 5:  93%|█████████▎| 90/97 [00:13<00:01,  6.66it/s, loss=5.96, v_num=0]
Epoch 5:  93%|█████████▎| 90/97 [00:13<00:01,  6.63it/s, loss=5.96, v_num=0]
Epoch 5:  94%|█████████▍| 91/97 [00:13<00:00,  6.66it/s, loss=5.96, v_num=0]
Epoch 5:  94%|█████████▍| 91/97 [00:13<00:00,  6.64it/s, loss=5.96, v_num=0]
Epoch 5:  95%|█████████▍| 92/97 [00:13<00:00,  6.67it/s, loss=5.96, v_num=0]
Epoch 5:  95%|█████████▍| 92/97 [00:13<00:00,  6.64it/s, loss=5.95, v_num=0]
Epoch 5:  96%|█████████▌| 93/97 [00:13<00:00,  6.68it/s, loss=5.95, v_num=0]
Epoch 5:  96%|█████████▌| 93/97 [00:13<00:00,  6.65it/s, loss=5.95, v_num=0]
Epoch 5:  97%|█████████▋| 94/97 [00:14<00:00,  6.68it/s, loss=5.95, v_num=0]
Epoch 5:  97%|█████████▋| 94/97 [00:14<00:00,  6.66it/s, loss=5.95, v_num=0]
Epoch 5:  98%|█████████▊| 95/97 [00:14<00:00,  6.69it/s, loss=5.95, v_num=0]
Epoch 5:  98%|█████████▊| 95/97 [00:14<00:00,  6.66it/s, loss=5.95, v_num=0]
Epoch 5:  99%|█████████▉| 96/97 [00:14<00:00,  6.69it/s, loss=5.95, v_num=0]
Epoch 5:  99%|█████████▉| 96/97 [00:14<00:00,  6.67it/s, loss=5.95, v_num=0]
Epoch 5: 100%|██████████| 97/97 [00:14<00:00,  6.70it/s, loss=5.95, v_num=0]
Epoch 5: 100%|██████████| 97/97 [00:14<00:00,  6.68it/s, loss=5.95, v_num=0]
Epoch 5: 100%|██████████| 97/97 [00:14<00:00,  6.67it/s, loss=5.95, v_num=0]
Epoch 5:   0%|          | 0/97 [00:00<?, ?it/s, loss=5.95, v_num=0]
Epoch 6:   0%|          | 0/97 [00:00<?, ?it/s, loss=5.95, v_num=0]
Epoch 6:   1%|          | 1/97 [00:01<02:15,  1.41s/it, loss=5.95, v_num=0]
Epoch 6:   1%|          | 1/97 [00:01<02:20,  1.46s/it, loss=5.94, v_num=0]
Epoch 6:   2%|▏         | 2/97 [00:01<01:13,  1.29it/s, loss=5.94, v_num=0]
Epoch 6:   2%|▏         | 2/97 [00:01<01:16,  1.25it/s, loss=5.94, v_num=0]
Epoch 6:   3%|▎         | 3/97 [00:01<00:52,  1.79it/s, loss=5.94, v_num=0]
Epoch 6:   3%|▎         | 3/97 [00:01<00:54,  1.73it/s, loss=5.93, v_num=0]
Epoch 6:   4%|▍         | 4/97 [00:01<00:42,  2.21it/s, loss=5.93, v_num=0]
Epoch 6:   4%|▍         | 4/97 [00:01<00:43,  2.14it/s, loss=5.93, v_num=0]
Epoch 6:   5%|▌         | 5/97 [00:01<00:35,  2.56it/s, loss=5.93, v_num=0]
Epoch 6:   5%|▌         | 5/97 [00:02<00:36,  2.49it/s, loss=5.91, v_num=0]
Epoch 6:   6%|▌         | 6/97 [00:02<00:31,  2.88it/s, loss=5.91, v_num=0]
Epoch 6:   6%|▌         | 6/97 [00:02<00:32,  2.80it/s, loss=5.91, v_num=0]
Epoch 6:   7%|▋         | 7/97 [00:02<00:28,  3.15it/s, loss=5.91, v_num=0]
Epoch 6:   7%|▋         | 7/97 [00:02<00:29,  3.07it/s, loss=5.92, v_num=0]
Epoch 6:   8%|▊         | 8/97 [00:02<00:26,  3.40it/s, loss=5.92, v_num=0]
Epoch 6:   8%|▊         | 8/97 [00:02<00:26,  3.32it/s, loss=5.92, v_num=0]
Epoch 6:   9%|▉         | 9/97 [00:02<00:24,  3.59it/s, loss=5.92, v_num=0]
Epoch 6:   9%|▉         | 9/97 [00:02<00:25,  3.52it/s, loss=5.92, v_num=0]
Epoch 6:  10%|█         | 10/97 [00:02<00:22,  3.80it/s, loss=5.92, v_num=0]
Epoch 6:  10%|█         | 10/97 [00:02<00:23,  3.71it/s, loss=5.91, v_num=0]
Epoch 6:  11%|█▏        | 11/97 [00:02<00:21,  3.97it/s, loss=5.91, v_num=0]
Epoch 6:  11%|█▏        | 11/97 [00:02<00:22,  3.89it/s, loss=5.9, v_num=0]
Epoch 6:  12%|█▏        | 12/97 [00:02<00:20,  4.13it/s, loss=5.9, v_num=0]
Epoch 6:  12%|█▏        | 12/97 [00:02<00:20,  4.05it/s, loss=5.9, v_num=0]
Epoch 6:  13%|█▎        | 13/97 [00:03<00:19,  4.28it/s, loss=5.9, v_num=0]
Epoch 6:  13%|█▎        | 13/97 [00:03<00:20,  4.20it/s, loss=5.89, v_num=0]
Epoch 6:  14%|█▍        | 14/97 [00:03<00:18,  4.41it/s, loss=5.89, v_num=0]
Epoch 6:  14%|█▍        | 14/97 [00:03<00:19,  4.33it/s, loss=5.89, v_num=0]
Epoch 6:  15%|█▌        | 15/97 [00:03<00:18,  4.53it/s, loss=5.89, v_num=0]
Epoch 6:  15%|█▌        | 15/97 [00:03<00:18,  4.45it/s, loss=5.9, v_num=0]
Epoch 6:  16%|█▋        | 16/97 [00:03<00:17,  4.65it/s, loss=5.9, v_num=0]
Epoch 6:  16%|█▋        | 16/97 [00:03<00:17,  4.57it/s, loss=5.89, v_num=0]
Epoch 6:  18%|█▊        | 17/97 [00:03<00:16,  4.74it/s, loss=5.89, v_num=0]
Epoch 6:  18%|█▊        | 17/97 [00:03<00:17,  4.67it/s, loss=5.89, v_num=0]
Epoch 6:  19%|█▊        | 18/97 [00:03<00:16,  4.84it/s, loss=5.89, v_num=0]
Epoch 6:  19%|█▊        | 18/97 [00:03<00:16,  4.77it/s, loss=5.9, v_num=0]
Epoch 6:  20%|█▉        | 19/97 [00:03<00:15,  4.92it/s, loss=5.9, v_num=0]
Epoch 6:  20%|█▉        | 19/97 [00:03<00:16,  4.86it/s, loss=5.89, v_num=0]
Epoch 6:  21%|██        | 20/97 [00:03<00:15,  5.01it/s, loss=5.89, v_num=0]
Epoch 6:  21%|██        | 20/97 [00:04<00:15,  4.94it/s, loss=5.88, v_num=0]
Epoch 6:  22%|██▏       | 21/97 [00:04<00:14,  5.09it/s, loss=5.88, v_num=0]
Epoch 6:  22%|██▏       | 21/97 [00:04<00:15,  5.02it/s, loss=5.88, v_num=0]
Epoch 6:  23%|██▎       | 22/97 [00:04<00:14,  5.16it/s, loss=5.88, v_num=0]
Epoch 6:  23%|██▎       | 22/97 [00:04<00:14,  5.09it/s, loss=5.87, v_num=0]
Epoch 6:  24%|██▎       | 23/97 [00:04<00:14,  5.23it/s, loss=5.87, v_num=0]
Epoch 6:  24%|██▎       | 23/97 [00:04<00:14,  5.16it/s, loss=5.87, v_num=0]
Epoch 6:  25%|██▍       | 24/97 [00:04<00:13,  5.30it/s, loss=5.87, v_num=0]
Epoch 6:  25%|██▍       | 24/97 [00:04<00:13,  5.23it/s, loss=5.86, v_num=0]
Epoch 6:  26%|██▌       | 25/97 [00:04<00:13,  5.35it/s, loss=5.86, v_num=0]
Epoch 6:  26%|██▌       | 25/97 [00:04<00:13,  5.29it/s, loss=5.86, v_num=0]
Epoch 6:  27%|██▋       | 26/97 [00:04<00:13,  5.41it/s, loss=5.86, v_num=0]
Epoch 6:  27%|██▋       | 26/97 [00:04<00:13,  5.35it/s, loss=5.86, v_num=0]
Epoch 6:  28%|██▊       | 27/97 [00:04<00:12,  5.46it/s, loss=5.86, v_num=0]
Epoch 6:  28%|██▊       | 27/97 [00:04<00:12,  5.40it/s, loss=5.86, v_num=0]
Epoch 6:  29%|██▉       | 28/97 [00:05<00:12,  5.51it/s, loss=5.86, v_num=0]
Epoch 6:  29%|██▉       | 28/97 [00:05<00:12,  5.45it/s, loss=5.86, v_num=0]
Epoch 6:  30%|██▉       | 29/97 [00:05<00:12,  5.56it/s, loss=5.86, v_num=0]
Epoch 6:  30%|██▉       | 29/97 [00:05<00:12,  5.50it/s, loss=5.85, v_num=0]
Epoch 6:  31%|███       | 30/97 [00:05<00:11,  5.60it/s, loss=5.85, v_num=0]
Epoch 6:  31%|███       | 30/97 [00:05<00:12,  5.55it/s, loss=5.86, v_num=0]
Epoch 6:  32%|███▏      | 31/97 [00:05<00:11,  5.65it/s, loss=5.86, v_num=0]
Epoch 6:  32%|███▏      | 31/97 [00:05<00:11,  5.59it/s, loss=5.86, v_num=0]
Epoch 6:  33%|███▎      | 32/97 [00:05<00:11,  5.69it/s, loss=5.86, v_num=0]
Epoch 6:  33%|███▎      | 32/97 [00:05<00:11,  5.64it/s, loss=5.86, v_num=0]
Epoch 6:  34%|███▍      | 33/97 [00:05<00:11,  5.73it/s, loss=5.86, v_num=0]
Epoch 6:  34%|███▍      | 33/97 [00:05<00:11,  5.67it/s, loss=5.86, v_num=0]
Epoch 6:  35%|███▌      | 34/97 [00:05<00:10,  5.77it/s, loss=5.86, v_num=0]
Epoch 6:  35%|███▌      | 34/97 [00:05<00:11,  5.71it/s, loss=5.86, v_num=0]
Epoch 6:  36%|███▌      | 35/97 [00:06<00:10,  5.81it/s, loss=5.86, v_num=0]
Epoch 6:  36%|███▌      | 35/97 [00:06<00:10,  5.75it/s, loss=5.85, v_num=0]
Epoch 6:  37%|███▋      | 36/97 [00:06<00:10,  5.84it/s, loss=5.85, v_num=0]
Epoch 6:  37%|███▋      | 36/97 [00:06<00:10,  5.79it/s, loss=5.86, v_num=0]
Epoch 6:  38%|███▊      | 37/97 [00:06<00:10,  5.87it/s, loss=5.86, v_num=0]
Epoch 6:  38%|███▊      | 37/97 [00:06<00:10,  5.82it/s, loss=5.85, v_num=0]
Epoch 6:  39%|███▉      | 38/97 [00:06<00:09,  5.90it/s, loss=5.85, v_num=0]
Epoch 6:  39%|███▉      | 38/97 [00:06<00:10,  5.85it/s, loss=5.85, v_num=0]
Epoch 6:  40%|████      | 39/97 [00:06<00:09,  5.93it/s, loss=5.85, v_num=0]
Epoch 6:  40%|████      | 39/97 [00:06<00:09,  5.88it/s, loss=5.85, v_num=0]
Epoch 6:  41%|████      | 40/97 [00:06<00:09,  5.96it/s, loss=5.85, v_num=0]
Epoch 6:  41%|████      | 40/97 [00:06<00:09,  5.91it/s, loss=5.85, v_num=0]
Epoch 6:  42%|████▏     | 41/97 [00:06<00:09,  5.98it/s, loss=5.85, v_num=0]
Epoch 6:  42%|████▏     | 41/97 [00:06<00:09,  5.94it/s, loss=5.85, v_num=0]
Epoch 6:  43%|████▎     | 42/97 [00:06<00:09,  6.01it/s, loss=5.85, v_num=0]
Epoch 6:  43%|████▎     | 42/97 [00:07<00:09,  5.96it/s, loss=5.85, v_num=0]
Epoch 6:  44%|████▍     | 43/97 [00:07<00:08,  6.03it/s, loss=5.85, v_num=0]
Epoch 6:  44%|████▍     | 43/97 [00:07<00:09,  5.99it/s, loss=5.85, v_num=0]
Epoch 6:  45%|████▌     | 44/97 [00:07<00:08,  6.06it/s, loss=5.85, v_num=0]
Epoch 6:  45%|████▌     | 44/97 [00:07<00:08,  6.01it/s, loss=5.84, v_num=0]
Epoch 6:  46%|████▋     | 45/97 [00:07<00:08,  6.08it/s, loss=5.84, v_num=0]
Epoch 6:  46%|████▋     | 45/97 [00:07<00:08,  6.03it/s, loss=5.85, v_num=0]
Epoch 6:  47%|████▋     | 46/97 [00:07<00:08,  6.10it/s, loss=5.85, v_num=0]
Epoch 6:  47%|████▋     | 46/97 [00:07<00:08,  6.06it/s, loss=5.84, v_num=0]
Epoch 6:  48%|████▊     | 47/97 [00:07<00:08,  6.12it/s, loss=5.84, v_num=0]
Epoch 6:  48%|████▊     | 47/97 [00:07<00:08,  6.08it/s, loss=5.83, v_num=0]
Epoch 6:  49%|████▉     | 48/97 [00:07<00:07,  6.15it/s, loss=5.83, v_num=0]
Epoch 6:  49%|████▉     | 48/97 [00:07<00:08,  6.10it/s, loss=5.83, v_num=0]
Epoch 6:  51%|█████     | 49/97 [00:07<00:07,  6.17it/s, loss=5.83, v_num=0]
Epoch 6:  51%|█████     | 49/97 [00:08<00:07,  6.12it/s, loss=5.84, v_num=0]
Epoch 6:  52%|█████▏    | 50/97 [00:08<00:07,  6.19it/s, loss=5.84, v_num=0]
Epoch 6:  52%|█████▏    | 50/97 [00:08<00:07,  6.14it/s, loss=5.83, v_num=0]
Epoch 6:  53%|█████▎    | 51/97 [00:08<00:07,  6.21it/s, loss=5.83, v_num=0]
Epoch 6:  53%|█████▎    | 51/97 [00:08<00:07,  6.16it/s, loss=5.83, v_num=0]
Epoch 6:  54%|█████▎    | 52/97 [00:08<00:07,  6.22it/s, loss=5.83, v_num=0]
Epoch 6:  54%|█████▎    | 52/97 [00:08<00:07,  6.18it/s, loss=5.83, v_num=0]
Epoch 6:  55%|█████▍    | 53/97 [00:08<00:07,  6.24it/s, loss=5.83, v_num=0]
Epoch 6:  55%|█████▍    | 53/97 [00:08<00:07,  6.20it/s, loss=5.82, v_num=0]
Epoch 6:  56%|█████▌    | 54/97 [00:08<00:06,  6.26it/s, loss=5.82, v_num=0]
Epoch 6:  56%|█████▌    | 54/97 [00:08<00:06,  6.22it/s, loss=5.82, v_num=0]
Epoch 6:  57%|█████▋    | 55/97 [00:08<00:06,  6.27it/s, loss=5.82, v_num=0]
Epoch 6:  57%|█████▋    | 55/97 [00:08<00:06,  6.23it/s, loss=5.81, v_num=0]
Epoch 6:  58%|█████▊    | 56/97 [00:08<00:06,  6.29it/s, loss=5.81, v_num=0]
Epoch 6:  58%|█████▊    | 56/97 [00:08<00:06,  6.25it/s, loss=5.81, v_num=0]
Epoch 6:  59%|█████▉    | 57/97 [00:09<00:06,  6.30it/s, loss=5.81, v_num=0]
Epoch 6:  59%|█████▉    | 57/97 [00:09<00:06,  6.27it/s, loss=5.8, v_num=0]
Epoch 6:  60%|█████▉    | 58/97 [00:09<00:06,  6.32it/s, loss=5.8, v_num=0]
Epoch 6:  60%|█████▉    | 58/97 [00:09<00:06,  6.28it/s, loss=5.79, v_num=0]
Epoch 6:  61%|██████    | 59/97 [00:09<00:06,  6.33it/s, loss=5.79, v_num=0]
Epoch 6:  61%|██████    | 59/97 [00:09<00:06,  6.29it/s, loss=5.79, v_num=0]
Epoch 6:  62%|██████▏   | 60/97 [00:09<00:05,  6.34it/s, loss=5.79, v_num=0]
Epoch 6:  62%|██████▏   | 60/97 [00:09<00:05,  6.31it/s, loss=5.79, v_num=0]
Epoch 6:  63%|██████▎   | 61/97 [00:09<00:05,  6.36it/s, loss=5.79, v_num=0]
Epoch 6:  63%|██████▎   | 61/97 [00:09<00:05,  6.32it/s, loss=5.79, v_num=0]
Epoch 6:  64%|██████▍   | 62/97 [00:09<00:05,  6.37it/s, loss=5.79, v_num=0]
Epoch 6:  64%|██████▍   | 62/97 [00:09<00:05,  6.34it/s, loss=5.79, v_num=0]
Epoch 6:  65%|██████▍   | 63/97 [00:09<00:05,  6.38it/s, loss=5.79, v_num=0]
Epoch 6:  65%|██████▍   | 63/97 [00:09<00:05,  6.35it/s, loss=5.8, v_num=0]
Epoch 6:  66%|██████▌   | 64/97 [00:10<00:05,  6.40it/s, loss=5.8, v_num=0]
Epoch 6:  66%|██████▌   | 64/97 [00:10<00:05,  6.36it/s, loss=5.8, v_num=0]
Epoch 6:  67%|██████▋   | 65/97 [00:10<00:04,  6.41it/s, loss=5.8, v_num=0]
Epoch 6:  67%|██████▋   | 65/97 [00:10<00:05,  6.38it/s, loss=5.79, v_num=0]
Epoch 6:  68%|██████▊   | 66/97 [00:10<00:04,  6.42it/s, loss=5.79, v_num=0]
Epoch 6:  68%|██████▊   | 66/97 [00:10<00:04,  6.39it/s, loss=5.79, v_num=0]
Epoch 6:  69%|██████▉   | 67/97 [00:10<00:04,  6.44it/s, loss=5.79, v_num=0]
Epoch 6:  69%|██████▉   | 67/97 [00:10<00:04,  6.40it/s, loss=5.79, v_num=0]
Epoch 6:  70%|███████   | 68/97 [00:10<00:04,  6.45it/s, loss=5.79, v_num=0]
Epoch 6:  70%|███████   | 68/97 [00:10<00:04,  6.41it/s, loss=5.77, v_num=0]
Epoch 6:  71%|███████   | 69/97 [00:10<00:04,  6.46it/s, loss=5.77, v_num=0]
Epoch 6:  71%|███████   | 69/97 [00:10<00:04,  6.42it/s, loss=5.77, v_num=0]
Epoch 6:  72%|███████▏  | 70/97 [00:10<00:04,  6.47it/s, loss=5.77, v_num=0]
Epoch 6:  72%|███████▏  | 70/97 [00:10<00:04,  6.44it/s, loss=5.77, v_num=0]
Epoch 6:  73%|███████▎  | 71/97 [00:10<00:04,  6.48it/s, loss=5.77, v_num=0]
Epoch 6:  73%|███████▎  | 71/97 [00:11<00:04,  6.45it/s, loss=5.77, v_num=0]
Epoch 6:  74%|███████▍  | 72/97 [00:11<00:03,  6.49it/s, loss=5.77, v_num=0]
Epoch 6:  74%|███████▍  | 72/97 [00:11<00:03,  6.46it/s, loss=5.76, v_num=0]
Epoch 6:  75%|███████▌  | 73/97 [00:11<00:03,  6.50it/s, loss=5.76, v_num=0]
Epoch 6:  75%|███████▌  | 73/97 [00:11<00:03,  6.47it/s, loss=5.75, v_num=0]
Epoch 6:  76%|███████▋  | 74/97 [00:11<00:03,  6.51it/s, loss=5.75, v_num=0]
Epoch 6:  76%|███████▋  | 74/97 [00:11<00:03,  6.48it/s, loss=5.75, v_num=0]
Epoch 6:  77%|███████▋  | 75/97 [00:11<00:03,  6.52it/s, loss=5.75, v_num=0]
Epoch 6:  77%|███████▋  | 75/97 [00:11<00:03,  6.49it/s, loss=5.74, v_num=0]
Epoch 6:  78%|███████▊  | 76/97 [00:11<00:03,  6.52it/s, loss=5.74, v_num=0]
Epoch 6:  78%|███████▊  | 76/97 [00:11<00:03,  6.49it/s, loss=5.74, v_num=0]
Epoch 6:  79%|███████▉  | 77/97 [00:11<00:03,  6.53it/s, loss=5.74, v_num=0]
Epoch 6:  79%|███████▉  | 77/97 [00:11<00:03,  6.50it/s, loss=5.74, v_num=0]
Epoch 6:  80%|████████  | 78/97 [00:11<00:02,  6.54it/s, loss=5.74, v_num=0]
Epoch 6:  80%|████████  | 78/97 [00:11<00:02,  6.51it/s, loss=5.73, v_num=0]
Epoch 6:  81%|████████▏ | 79/97 [00:12<00:02,  6.55it/s, loss=5.73, v_num=0]
Epoch 6:  81%|████████▏ | 79/97 [00:12<00:02,  6.52it/s, loss=5.73, v_num=0]
Epoch 6:  82%|████████▏ | 80/97 [00:12<00:02,  6.56it/s, loss=5.73, v_num=0]
Epoch 6:  82%|████████▏ | 80/97 [00:12<00:02,  6.53it/s, loss=5.73, v_num=0]
Epoch 6:  84%|████████▎ | 81/97 [00:12<00:02,  6.57it/s, loss=5.73, v_num=0]
Epoch 6:  84%|████████▎ | 81/97 [00:12<00:02,  6.54it/s, loss=5.72, v_num=0]
Epoch 6:  85%|████████▍ | 82/97 [00:12<00:02,  6.58it/s, loss=5.72, v_num=0]
Epoch 6:  85%|████████▍ | 82/97 [00:12<00:02,  6.55it/s, loss=5.72, v_num=0]
Epoch 6:  86%|████████▌ | 83/97 [00:12<00:02,  6.58it/s, loss=5.72, v_num=0]
Epoch 6:  86%|████████▌ | 83/97 [00:12<00:02,  6.55it/s, loss=5.72, v_num=0]
Epoch 6:  87%|████████▋ | 84/97 [00:12<00:01,  6.59it/s, loss=5.72, v_num=0]
Epoch 6:  87%|████████▋ | 84/97 [00:12<00:01,  6.56it/s, loss=5.72, v_num=0]
Epoch 6:  88%|████████▊ | 85/97 [00:12<00:01,  6.60it/s, loss=5.72, v_num=0]
Epoch 6:  88%|████████▊ | 85/97 [00:12<00:01,  6.57it/s, loss=5.72, v_num=0]
Epoch 6:  89%|████████▊ | 86/97 [00:13<00:01,  6.61it/s, loss=5.72, v_num=0]
Epoch 6:  89%|████████▊ | 86/97 [00:13<00:01,  6.58it/s, loss=5.72, v_num=0]
Epoch 6:  90%|████████▉ | 87/97 [00:13<00:01,  6.61it/s, loss=5.72, v_num=0]
Epoch 6:  90%|████████▉ | 87/97 [00:13<00:01,  6.59it/s, loss=5.71, v_num=0]
Epoch 6:  91%|█████████ | 88/97 [00:13<00:01,  6.62it/s, loss=5.71, v_num=0]
Epoch 6:  91%|█████████ | 88/97 [00:13<00:01,  6.59it/s, loss=5.72, v_num=0]
Epoch 6:  92%|█████████▏| 89/97 [00:13<00:01,  6.63it/s, loss=5.72, v_num=0]
Epoch 6:  92%|█████████▏| 89/97 [00:13<00:01,  6.60it/s, loss=5.72, v_num=0]
Epoch 6:  93%|█████████▎| 90/97 [00:13<00:01,  6.64it/s, loss=5.72, v_num=0]
Epoch 6:  93%|█████████▎| 90/97 [00:13<00:01,  6.61it/s, loss=5.72, v_num=0]
Epoch 6:  94%|█████████▍| 91/97 [00:13<00:00,  6.64it/s, loss=5.72, v_num=0]
Epoch 6:  94%|█████████▍| 91/97 [00:13<00:00,  6.62it/s, loss=5.71, v_num=0]
Epoch 6:  95%|█████████▍| 92/97 [00:13<00:00,  6.65it/s, loss=5.71, v_num=0]
Epoch 6:  95%|█████████▍| 92/97 [00:13<00:00,  6.62it/s, loss=5.71, v_num=0]
Epoch 6:  96%|█████████▌| 93/97 [00:13<00:00,  6.65it/s, loss=5.71, v_num=0]
Epoch 6:  96%|█████████▌| 93/97 [00:14<00:00,  6.63it/s, loss=5.71, v_num=0]
Epoch 6:  97%|█████████▋| 94/97 [00:14<00:00,  6.66it/s, loss=5.71, v_num=0]
Epoch 6:  97%|█████████▋| 94/97 [00:14<00:00,  6.63it/s, loss=5.71, v_num=0]
Epoch 6:  98%|█████████▊| 95/97 [00:14<00:00,  6.67it/s, loss=5.71, v_num=0]
Epoch 6:  98%|█████████▊| 95/97 [00:14<00:00,  6.64it/s, loss=5.72, v_num=0]
Epoch 6:  99%|█████████▉| 96/97 [00:14<00:00,  6.67it/s, loss=5.72, v_num=0]
Epoch 6:  99%|█████████▉| 96/97 [00:14<00:00,  6.65it/s, loss=5.72, v_num=0]
Epoch 6: 100%|██████████| 97/97 [00:14<00:00,  6.68it/s, loss=5.72, v_num=0]
Epoch 6: 100%|██████████| 97/97 [00:14<00:00,  6.65it/s, loss=5.71, v_num=0]
Epoch 6: 100%|██████████| 97/97 [00:14<00:00,  6.65it/s, loss=5.71, v_num=0]
Epoch 6:   0%|          | 0/97 [00:00<?, ?it/s, loss=5.71, v_num=0]
Epoch 7:   0%|          | 0/97 [00:00<?, ?it/s, loss=5.71, v_num=0]
Epoch 7:   1%|          | 1/97 [00:01<02:13,  1.39s/it, loss=5.71, v_num=0]
Epoch 7:   1%|          | 1/97 [00:01<02:18,  1.44s/it, loss=5.71, v_num=0]
Epoch 7:   2%|▏         | 2/97 [00:01<01:12,  1.31it/s, loss=5.71, v_num=0]
Epoch 7:   2%|▏         | 2/97 [00:01<01:15,  1.27it/s, loss=5.7, v_num=0]
Epoch 7:   3%|▎         | 3/97 [00:01<00:51,  1.81it/s, loss=5.7, v_num=0]
Epoch 7:   3%|▎         | 3/97 [00:01<00:53,  1.75it/s, loss=5.7, v_num=0]
Epoch 7:   4%|▍         | 4/97 [00:01<00:41,  2.23it/s, loss=5.7, v_num=0]
Epoch 7:   4%|▍         | 4/97 [00:01<00:43,  2.16it/s, loss=5.7, v_num=0]
Epoch 7:   5%|▌         | 5/97 [00:01<00:35,  2.59it/s, loss=5.7, v_num=0]
Epoch 7:   5%|▌         | 5/97 [00:01<00:36,  2.51it/s, loss=5.7, v_num=0]
Epoch 7:   6%|▌         | 6/97 [00:02<00:31,  2.89it/s, loss=5.7, v_num=0]
Epoch 7:   6%|▌         | 6/97 [00:02<00:32,  2.82it/s, loss=5.69, v_num=0]
Epoch 7:   7%|▋         | 7/97 [00:02<00:28,  3.17it/s, loss=5.69, v_num=0]
Epoch 7:   7%|▋         | 7/97 [00:02<00:29,  3.09it/s, loss=5.69, v_num=0]
Epoch 7:   8%|▊         | 8/97 [00:02<00:26,  3.42it/s, loss=5.69, v_num=0]
Epoch 7:   8%|▊         | 8/97 [00:02<00:26,  3.34it/s, loss=5.68, v_num=0]
Epoch 7:   9%|▉         | 9/97 [00:02<00:24,  3.62it/s, loss=5.68, v_num=0]
Epoch 7:   9%|▉         | 9/97 [00:02<00:24,  3.54it/s, loss=5.68, v_num=0]
Epoch 7:  10%|█         | 10/97 [00:02<00:22,  3.81it/s, loss=5.68, v_num=0]
Epoch 7:  10%|█         | 10/97 [00:02<00:23,  3.73it/s, loss=5.69, v_num=0]
Epoch 7:  11%|█▏        | 11/97 [00:02<00:21,  3.99it/s, loss=5.69, v_num=0]
Epoch 7:  11%|█▏        | 11/97 [00:02<00:22,  3.91it/s, loss=5.69, v_num=0]
Epoch 7:  12%|█▏        | 12/97 [00:02<00:20,  4.15it/s, loss=5.69, v_num=0]
Epoch 7:  12%|█▏        | 12/97 [00:02<00:20,  4.07it/s, loss=5.68, v_num=0]
Epoch 7:  13%|█▎        | 13/97 [00:03<00:19,  4.28it/s, loss=5.68, v_num=0]
Epoch 7:  13%|█▎        | 13/97 [00:03<00:19,  4.20it/s, loss=5.67, v_num=0]
Epoch 7:  14%|█▍        | 14/97 [00:03<00:18,  4.42it/s, loss=5.67, v_num=0]
Epoch 7:  14%|█▍        | 14/97 [00:03<00:19,  4.34it/s, loss=5.68, v_num=0]
Epoch 7:  15%|█▌        | 15/97 [00:03<00:18,  4.53it/s, loss=5.68, v_num=0]
Epoch 7:  15%|█▌        | 15/97 [00:03<00:18,  4.46it/s, loss=5.67, v_num=0]
Epoch 7:  16%|█▋        | 16/97 [00:03<00:17,  4.65it/s, loss=5.67, v_num=0]
Epoch 7:  16%|█▋        | 16/97 [00:03<00:17,  4.57it/s, loss=5.67, v_num=0]
Epoch 7:  18%|█▊        | 17/97 [00:03<00:16,  4.75it/s, loss=5.67, v_num=0]
Epoch 7:  18%|█▊        | 17/97 [00:03<00:17,  4.68it/s, loss=5.67, v_num=0]
Epoch 7:  19%|█▊        | 18/97 [00:03<00:16,  4.84it/s, loss=5.67, v_num=0]
Epoch 7:  19%|█▊        | 18/97 [00:03<00:16,  4.77it/s, loss=5.66, v_num=0]
Epoch 7:  20%|█▉        | 19/97 [00:03<00:15,  4.93it/s, loss=5.66, v_num=0]
Epoch 7:  20%|█▉        | 19/97 [00:03<00:16,  4.86it/s, loss=5.65, v_num=0]
Epoch 7:  21%|██        | 20/97 [00:03<00:15,  5.01it/s, loss=5.65, v_num=0]
Epoch 7:  21%|██        | 20/97 [00:04<00:15,  4.94it/s, loss=5.66, v_num=0]
Epoch 7:  22%|██▏       | 21/97 [00:04<00:14,  5.08it/s, loss=5.66, v_num=0]
Epoch 7:  22%|██▏       | 21/97 [00:04<00:15,  5.02it/s, loss=5.65, v_num=0]
Epoch 7:  23%|██▎       | 22/97 [00:04<00:14,  5.16it/s, loss=5.65, v_num=0]
Epoch 7:  23%|██▎       | 22/97 [00:04<00:14,  5.09it/s, loss=5.65, v_num=0]
Epoch 7:  24%|██▎       | 23/97 [00:04<00:14,  5.23it/s, loss=5.65, v_num=0]
Epoch 7:  24%|██▎       | 23/97 [00:04<00:14,  5.16it/s, loss=5.65, v_num=0]
Epoch 7:  25%|██▍       | 24/97 [00:04<00:13,  5.29it/s, loss=5.65, v_num=0]
Epoch 7:  25%|██▍       | 24/97 [00:04<00:13,  5.22it/s, loss=5.64, v_num=0]
Epoch 7:  26%|██▌       | 25/97 [00:04<00:13,  5.34it/s, loss=5.64, v_num=0]
Epoch 7:  26%|██▌       | 25/97 [00:04<00:13,  5.28it/s, loss=5.63, v_num=0]
Epoch 7:  27%|██▋       | 26/97 [00:04<00:13,  5.40it/s, loss=5.63, v_num=0]
Epoch 7:  27%|██▋       | 26/97 [00:04<00:13,  5.33it/s, loss=5.63, v_num=0]
Epoch 7:  28%|██▊       | 27/97 [00:04<00:12,  5.45it/s, loss=5.63, v_num=0]
Epoch 7:  28%|██▊       | 27/97 [00:05<00:12,  5.39it/s, loss=5.62, v_num=0]
Epoch 7:  29%|██▉       | 28/97 [00:05<00:12,  5.51it/s, loss=5.62, v_num=0]
Epoch 7:  29%|██▉       | 28/97 [00:05<00:12,  5.44it/s, loss=5.61, v_num=0]
Epoch 7:  30%|██▉       | 29/97 [00:05<00:12,  5.54it/s, loss=5.61, v_num=0]
Epoch 7:  30%|██▉       | 29/97 [00:05<00:12,  5.49it/s, loss=5.6, v_num=0]
Epoch 7:  31%|███       | 30/97 [00:05<00:11,  5.59it/s, loss=5.6, v_num=0]
Epoch 7:  31%|███       | 30/97 [00:05<00:12,  5.53it/s, loss=5.6, v_num=0]
Epoch 7:  32%|███▏      | 31/97 [00:05<00:11,  5.63it/s, loss=5.6, v_num=0]
Epoch 7:  32%|███▏      | 31/97 [00:05<00:11,  5.58it/s, loss=5.6, v_num=0]
Epoch 7:  33%|███▎      | 32/97 [00:05<00:11,  5.67it/s, loss=5.6, v_num=0]
Epoch 7:  33%|███▎      | 32/97 [00:05<00:11,  5.62it/s, loss=5.6, v_num=0]
Epoch 7:  34%|███▍      | 33/97 [00:05<00:11,  5.72it/s, loss=5.6, v_num=0]
Epoch 7:  34%|███▍      | 33/97 [00:05<00:11,  5.66it/s, loss=5.6, v_num=0]
Epoch 7:  35%|███▌      | 34/97 [00:05<00:10,  5.75it/s, loss=5.6, v_num=0]
Epoch 7:  35%|███▌      | 34/97 [00:05<00:11,  5.70it/s, loss=5.59, v_num=0]
Epoch 7:  36%|███▌      | 35/97 [00:06<00:10,  5.79it/s, loss=5.59, v_num=0]
Epoch 7:  36%|███▌      | 35/97 [00:06<00:10,  5.73it/s, loss=5.58, v_num=0]
Epoch 7:  37%|███▋      | 36/97 [00:06<00:10,  5.82it/s, loss=5.58, v_num=0]
Epoch 7:  37%|███▋      | 36/97 [00:06<00:10,  5.77it/s, loss=5.59, v_num=0]
Epoch 7:  38%|███▊      | 37/97 [00:06<00:10,  5.85it/s, loss=5.59, v_num=0]
Epoch 7:  38%|███▊      | 37/97 [00:06<00:10,  5.80it/s, loss=5.59, v_num=0]
Epoch 7:  39%|███▉      | 38/97 [00:06<00:10,  5.89it/s, loss=5.59, v_num=0]
Epoch 7:  39%|███▉      | 38/97 [00:06<00:10,  5.83it/s, loss=5.59, v_num=0]
Epoch 7:  40%|████      | 39/97 [00:06<00:09,  5.91it/s, loss=5.59, v_num=0]
Epoch 7:  40%|████      | 39/97 [00:06<00:09,  5.86it/s, loss=5.59, v_num=0]
Epoch 7:  41%|████      | 40/97 [00:06<00:09,  5.95it/s, loss=5.59, v_num=0]
Epoch 7:  41%|████      | 40/97 [00:06<00:09,  5.89it/s, loss=5.58, v_num=0]
Epoch 7:  42%|████▏     | 41/97 [00:06<00:09,  5.97it/s, loss=5.58, v_num=0]
Epoch 7:  42%|████▏     | 41/97 [00:06<00:09,  5.92it/s, loss=5.58, v_num=0]
Epoch 7:  43%|████▎     | 42/97 [00:07<00:09,  5.99it/s, loss=5.58, v_num=0]
Epoch 7:  43%|████▎     | 42/97 [00:07<00:09,  5.94it/s, loss=5.58, v_num=0]
Epoch 7:  44%|████▍     | 43/97 [00:07<00:08,  6.02it/s, loss=5.58, v_num=0]
Epoch 7:  44%|████▍     | 43/97 [00:07<00:09,  5.97it/s, loss=5.58, v_num=0]
Epoch 7:  45%|████▌     | 44/97 [00:07<00:08,  6.04it/s, loss=5.58, v_num=0]
Epoch 7:  45%|████▌     | 44/97 [00:07<00:08,  6.00it/s, loss=5.57, v_num=0]
Epoch 7:  46%|████▋     | 45/97 [00:07<00:08,  6.07it/s, loss=5.57, v_num=0]
Epoch 7:  46%|████▋     | 45/97 [00:07<00:08,  6.02it/s, loss=5.57, v_num=0]
Epoch 7:  47%|████▋     | 46/97 [00:07<00:08,  6.09it/s, loss=5.57, v_num=0]
Epoch 7:  47%|████▋     | 46/97 [00:07<00:08,  6.04it/s, loss=5.57, v_num=0]
Epoch 7:  48%|████▊     | 47/97 [00:07<00:08,  6.11it/s, loss=5.57, v_num=0]
Epoch 7:  48%|████▊     | 47/97 [00:07<00:08,  6.07it/s, loss=5.57, v_num=0]
Epoch 7:  49%|████▉     | 48/97 [00:07<00:07,  6.13it/s, loss=5.57, v_num=0]
Epoch 7:  49%|████▉     | 48/97 [00:07<00:08,  6.09it/s, loss=5.58, v_num=0]
Epoch 7:  51%|█████     | 49/97 [00:07<00:07,  6.15it/s, loss=5.58, v_num=0]
Epoch 7:  51%|█████     | 49/97 [00:08<00:07,  6.11it/s, loss=5.57, v_num=0]
Epoch 7:  52%|█████▏    | 50/97 [00:08<00:07,  6.17it/s, loss=5.57, v_num=0]
Epoch 7:  52%|█████▏    | 50/97 [00:08<00:07,  6.13it/s, loss=5.57, v_num=0]
Epoch 7:  53%|█████▎    | 51/97 [00:08<00:07,  6.18it/s, loss=5.57, v_num=0]
Epoch 7:  53%|█████▎    | 51/97 [00:08<00:07,  6.14it/s, loss=5.56, v_num=0]
Epoch 7:  54%|█████▎    | 52/97 [00:08<00:07,  6.20it/s, loss=5.56, v_num=0]
Epoch 7:  54%|█████▎    | 52/97 [00:08<00:07,  6.16it/s, loss=5.55, v_num=0]
Epoch 7:  55%|█████▍    | 53/97 [00:08<00:07,  6.22it/s, loss=5.55, v_num=0]
Epoch 7:  55%|█████▍    | 53/97 [00:08<00:07,  6.18it/s, loss=5.54, v_num=0]
Epoch 7:  56%|█████▌    | 54/97 [00:08<00:06,  6.23it/s, loss=5.54, v_num=0]
Epoch 7:  56%|█████▌    | 54/97 [00:08<00:06,  6.19it/s, loss=5.55, v_num=0]
Epoch 7:  57%|█████▋    | 55/97 [00:08<00:06,  6.25it/s, loss=5.55, v_num=0]
Epoch 7:  57%|█████▋    | 55/97 [00:08<00:06,  6.21it/s, loss=5.55, v_num=0]
Epoch 7:  58%|█████▊    | 56/97 [00:08<00:06,  6.26it/s, loss=5.55, v_num=0]
Epoch 7:  58%|█████▊    | 56/97 [00:08<00:06,  6.23it/s, loss=5.55, v_num=0]
Epoch 7:  59%|█████▉    | 57/97 [00:09<00:06,  6.28it/s, loss=5.55, v_num=0]
Epoch 7:  59%|█████▉    | 57/97 [00:09<00:06,  6.24it/s, loss=5.55, v_num=0]
Epoch 7:  60%|█████▉    | 58/97 [00:09<00:06,  6.30it/s, loss=5.55, v_num=0]
Epoch 7:  60%|█████▉    | 58/97 [00:09<00:06,  6.26it/s, loss=5.55, v_num=0]
Epoch 7:  61%|██████    | 59/97 [00:09<00:06,  6.31it/s, loss=5.55, v_num=0]
Epoch 7:  61%|██████    | 59/97 [00:09<00:06,  6.27it/s, loss=5.55, v_num=0]
Epoch 7:  62%|██████▏   | 60/97 [00:09<00:05,  6.33it/s, loss=5.55, v_num=0]
Epoch 7:  62%|██████▏   | 60/97 [00:09<00:05,  6.29it/s, loss=5.55, v_num=0]
Epoch 7:  63%|██████▎   | 61/97 [00:09<00:05,  6.34it/s, loss=5.55, v_num=0]
Epoch 7:  63%|██████▎   | 61/97 [00:09<00:05,  6.30it/s, loss=5.55, v_num=0]
Epoch 7:  64%|██████▍   | 62/97 [00:09<00:05,  6.36it/s, loss=5.55, v_num=0]
Epoch 7:  64%|██████▍   | 62/97 [00:09<00:05,  6.32it/s, loss=5.54, v_num=0]
Epoch 7:  65%|██████▍   | 63/97 [00:09<00:05,  6.37it/s, loss=5.54, v_num=0]
Epoch 7:  65%|██████▍   | 63/97 [00:09<00:05,  6.33it/s, loss=5.55, v_num=0]
Epoch 7:  66%|██████▌   | 64/97 [00:10<00:05,  6.38it/s, loss=5.55, v_num=0]
Epoch 7:  66%|██████▌   | 64/97 [00:10<00:05,  6.34it/s, loss=5.55, v_num=0]
Epoch 7:  67%|██████▋   | 65/97 [00:10<00:05,  6.39it/s, loss=5.55, v_num=0]
Epoch 7:  67%|██████▋   | 65/97 [00:10<00:05,  6.36it/s, loss=5.55, v_num=0]
Epoch 7:  68%|██████▊   | 66/97 [00:10<00:04,  6.40it/s, loss=5.55, v_num=0]
Epoch 7:  68%|██████▊   | 66/97 [00:10<00:04,  6.37it/s, loss=5.54, v_num=0]
Epoch 7:  69%|██████▉   | 67/97 [00:10<00:04,  6.42it/s, loss=5.54, v_num=0]
Epoch 7:  69%|██████▉   | 67/97 [00:10<00:04,  6.38it/s, loss=5.54, v_num=0]
Epoch 7:  70%|███████   | 68/97 [00:10<00:04,  6.43it/s, loss=5.54, v_num=0]
Epoch 7:  70%|███████   | 68/97 [00:10<00:04,  6.39it/s, loss=5.54, v_num=0]
Epoch 7:  71%|███████   | 69/97 [00:10<00:04,  6.44it/s, loss=5.54, v_num=0]
Epoch 7:  71%|███████   | 69/97 [00:10<00:04,  6.41it/s, loss=5.53, v_num=0]
Epoch 7:  72%|███████▏  | 70/97 [00:10<00:04,  6.45it/s, loss=5.53, v_num=0]
Epoch 7:  72%|███████▏  | 70/97 [00:10<00:04,  6.42it/s, loss=5.52, v_num=0]
Epoch 7:  73%|███████▎  | 71/97 [00:10<00:04,  6.46it/s, loss=5.52, v_num=0]
Epoch 7:  73%|███████▎  | 71/97 [00:11<00:04,  6.43it/s, loss=5.53, v_num=0]
Epoch 7:  74%|███████▍  | 72/97 [00:11<00:03,  6.47it/s, loss=5.53, v_num=0]
Epoch 7:  74%|███████▍  | 72/97 [00:11<00:03,  6.44it/s, loss=5.53, v_num=0]
Epoch 7:  75%|███████▌  | 73/97 [00:11<00:03,  6.48it/s, loss=5.53, v_num=0]
Epoch 7:  75%|███████▌  | 73/97 [00:11<00:03,  6.45it/s, loss=5.53, v_num=0]
Epoch 7:  76%|███████▋  | 74/97 [00:11<00:03,  6.49it/s, loss=5.53, v_num=0]
Epoch 7:  76%|███████▋  | 74/97 [00:11<00:03,  6.46it/s, loss=5.52, v_num=0]
Epoch 7:  77%|███████▋  | 75/97 [00:11<00:03,  6.50it/s, loss=5.52, v_num=0]
Epoch 7:  77%|███████▋  | 75/97 [00:11<00:03,  6.47it/s, loss=5.53, v_num=0]
Epoch 7:  78%|███████▊  | 76/97 [00:11<00:03,  6.51it/s, loss=5.53, v_num=0]
Epoch 7:  78%|███████▊  | 76/97 [00:11<00:03,  6.48it/s, loss=5.52, v_num=0]
Epoch 7:  79%|███████▉  | 77/97 [00:11<00:03,  6.52it/s, loss=5.52, v_num=0]
Epoch 7:  79%|███████▉  | 77/97 [00:11<00:03,  6.49it/s, loss=5.51, v_num=0]
Epoch 7:  80%|████████  | 78/97 [00:11<00:02,  6.53it/s, loss=5.51, v_num=0]
Epoch 7:  80%|████████  | 78/97 [00:11<00:02,  6.50it/s, loss=5.5, v_num=0]
Epoch 7:  81%|████████▏ | 79/97 [00:12<00:02,  6.54it/s, loss=5.5, v_num=0]
Epoch 7:  81%|████████▏ | 79/97 [00:12<00:02,  6.51it/s, loss=5.5, v_num=0]
Epoch 7:  82%|████████▏ | 80/97 [00:12<00:02,  6.55it/s, loss=5.5, v_num=0]
Epoch 7:  82%|████████▏ | 80/97 [00:12<00:02,  6.52it/s, loss=5.5, v_num=0]
Epoch 7:  84%|████████▎ | 81/97 [00:12<00:02,  6.56it/s, loss=5.5, v_num=0]
Epoch 7:  84%|████████▎ | 81/97 [00:12<00:02,  6.53it/s, loss=5.51, v_num=0]
Epoch 7:  85%|████████▍ | 82/97 [00:12<00:02,  6.57it/s, loss=5.51, v_num=0]
Epoch 7:  85%|████████▍ | 82/97 [00:12<00:02,  6.54it/s, loss=5.5, v_num=0]
Epoch 7:  86%|████████▌ | 83/97 [00:12<00:02,  6.58it/s, loss=5.5, v_num=0]
Epoch 7:  86%|████████▌ | 83/97 [00:12<00:02,  6.54it/s, loss=5.5, v_num=0]
Epoch 7:  87%|████████▋ | 84/97 [00:12<00:01,  6.58it/s, loss=5.5, v_num=0]
Epoch 7:  87%|████████▋ | 84/97 [00:12<00:01,  6.55it/s, loss=5.5, v_num=0]
Epoch 7:  88%|████████▊ | 85/97 [00:12<00:01,  6.59it/s, loss=5.5, v_num=0]
Epoch 7:  88%|████████▊ | 85/97 [00:12<00:01,  6.56it/s, loss=5.5, v_num=0]
Epoch 7:  89%|████████▊ | 86/97 [00:13<00:01,  6.60it/s, loss=5.5, v_num=0]
Epoch 7:  89%|████████▊ | 86/97 [00:13<00:01,  6.57it/s, loss=5.5, v_num=0]
Epoch 7:  90%|████████▉ | 87/97 [00:13<00:01,  6.61it/s, loss=5.5, v_num=0]
Epoch 7:  90%|████████▉ | 87/97 [00:13<00:01,  6.58it/s, loss=5.49, v_num=0]
Epoch 7:  91%|█████████ | 88/97 [00:13<00:01,  6.62it/s, loss=5.49, v_num=0]
Epoch 7:  91%|█████████ | 88/97 [00:13<00:01,  6.59it/s, loss=5.48, v_num=0]
Epoch 7:  92%|█████████▏| 89/97 [00:13<00:01,  6.62it/s, loss=5.48, v_num=0]
Epoch 7:  92%|█████████▏| 89/97 [00:13<00:01,  6.59it/s, loss=5.48, v_num=0]
Epoch 7:  93%|█████████▎| 90/97 [00:13<00:01,  6.63it/s, loss=5.48, v_num=0]
Epoch 7:  93%|█████████▎| 90/97 [00:13<00:01,  6.60it/s, loss=5.49, v_num=0]
Epoch 7:  94%|█████████▍| 91/97 [00:13<00:00,  6.64it/s, loss=5.49, v_num=0]
Epoch 7:  94%|█████████▍| 91/97 [00:13<00:00,  6.61it/s, loss=5.48, v_num=0]
Epoch 7:  95%|█████████▍| 92/97 [00:13<00:00,  6.64it/s, loss=5.48, v_num=0]
Epoch 7:  95%|█████████▍| 92/97 [00:13<00:00,  6.62it/s, loss=5.48, v_num=0]
Epoch 7:  96%|█████████▌| 93/97 [00:13<00:00,  6.65it/s, loss=5.48, v_num=0]
Epoch 7:  96%|█████████▌| 93/97 [00:14<00:00,  6.62it/s, loss=5.47, v_num=0]
Epoch 7:  97%|█████████▋| 94/97 [00:14<00:00,  6.65it/s, loss=5.47, v_num=0]
Epoch 7:  97%|█████████▋| 94/97 [00:14<00:00,  6.63it/s, loss=5.47, v_num=0]
Epoch 7:  98%|█████████▊| 95/97 [00:14<00:00,  6.66it/s, loss=5.47, v_num=0]
Epoch 7:  98%|█████████▊| 95/97 [00:14<00:00,  6.64it/s, loss=5.47, v_num=0]
Epoch 7:  99%|█████████▉| 96/97 [00:14<00:00,  6.67it/s, loss=5.47, v_num=0]
Epoch 7:  99%|█████████▉| 96/97 [00:14<00:00,  6.64it/s, loss=5.47, v_num=0]
Epoch 7: 100%|██████████| 97/97 [00:14<00:00,  6.67it/s, loss=5.47, v_num=0]
Epoch 7: 100%|██████████| 97/97 [00:14<00:00,  6.65it/s, loss=5.47, v_num=0]
Epoch 7: 100%|██████████| 97/97 [00:14<00:00,  6.65it/s, loss=5.47, v_num=0]
Epoch 7:   0%|          | 0/97 [00:00<?, ?it/s, loss=5.47, v_num=0]
Epoch 8:   0%|          | 0/97 [00:00<?, ?it/s, loss=5.47, v_num=0]
Epoch 8:   1%|          | 1/97 [00:01<02:13,  1.39s/it, loss=5.47, v_num=0]
Epoch 8:   1%|          | 1/97 [00:01<02:19,  1.45s/it, loss=5.45, v_num=0]
Epoch 8:   2%|▏         | 2/97 [00:01<01:12,  1.31it/s, loss=5.45, v_num=0]
Epoch 8:   2%|▏         | 2/97 [00:01<01:15,  1.26it/s, loss=5.45, v_num=0]
Epoch 8:   3%|▎         | 3/97 [00:01<00:52,  1.80it/s, loss=5.45, v_num=0]
Epoch 8:   3%|▎         | 3/97 [00:01<00:53,  1.74it/s, loss=5.44, v_num=0]
Epoch 8:   4%|▍         | 4/97 [00:01<00:41,  2.22it/s, loss=5.44, v_num=0]
Epoch 8:   4%|▍         | 4/97 [00:01<00:43,  2.15it/s, loss=5.44, v_num=0]
Epoch 8:   5%|▌         | 5/97 [00:01<00:35,  2.58it/s, loss=5.44, v_num=0]
Epoch 8:   5%|▌         | 5/97 [00:01<00:36,  2.51it/s, loss=5.43, v_num=0]
Epoch 8:   6%|▌         | 6/97 [00:02<00:31,  2.89it/s, loss=5.43, v_num=0]
Epoch 8:   6%|▌         | 6/97 [00:02<00:32,  2.82it/s, loss=5.43, v_num=0]
Epoch 8:   7%|▋         | 7/97 [00:02<00:28,  3.17it/s, loss=5.43, v_num=0]
Epoch 8:   7%|▋         | 7/97 [00:02<00:29,  3.09it/s, loss=5.43, v_num=0]
Epoch 8:   8%|▊         | 8/97 [00:02<00:26,  3.40it/s, loss=5.43, v_num=0]
Epoch 8:   8%|▊         | 8/97 [00:02<00:26,  3.33it/s, loss=5.43, v_num=0]
Epoch 8:   9%|▉         | 9/97 [00:02<00:24,  3.62it/s, loss=5.43, v_num=0]
Epoch 8:   9%|▉         | 9/97 [00:02<00:24,  3.54it/s, loss=5.43, v_num=0]
Epoch 8:  10%|█         | 10/97 [00:02<00:22,  3.81it/s, loss=5.43, v_num=0]
Epoch 8:  10%|█         | 10/97 [00:02<00:23,  3.73it/s, loss=5.43, v_num=0]
Epoch 8:  11%|█▏        | 11/97 [00:02<00:21,  3.98it/s, loss=5.43, v_num=0]
Epoch 8:  11%|█▏        | 11/97 [00:02<00:22,  3.90it/s, loss=5.44, v_num=0]
Epoch 8:  12%|█▏        | 12/97 [00:02<00:20,  4.14it/s, loss=5.44, v_num=0]
Epoch 8:  12%|█▏        | 12/97 [00:02<00:20,  4.06it/s, loss=5.44, v_num=0]
Epoch 8:  13%|█▎        | 13/97 [00:03<00:19,  4.28it/s, loss=5.44, v_num=0]
Epoch 8:  13%|█▎        | 13/97 [00:03<00:19,  4.21it/s, loss=5.44, v_num=0]
Epoch 8:  14%|█▍        | 14/97 [00:03<00:18,  4.42it/s, loss=5.44, v_num=0]
Epoch 8:  14%|█▍        | 14/97 [00:03<00:19,  4.34it/s, loss=5.44, v_num=0]
Epoch 8:  15%|█▌        | 15/97 [00:03<00:18,  4.54it/s, loss=5.44, v_num=0]
Epoch 8:  15%|█▌        | 15/97 [00:03<00:18,  4.46it/s, loss=5.44, v_num=0]
Epoch 8:  16%|█▋        | 16/97 [00:03<00:17,  4.65it/s, loss=5.44, v_num=0]
Epoch 8:  16%|█▋        | 16/97 [00:03<00:17,  4.58it/s, loss=5.44, v_num=0]
Epoch 8:  18%|█▊        | 17/97 [00:03<00:16,  4.75it/s, loss=5.44, v_num=0]
Epoch 8:  18%|█▊        | 17/97 [00:03<00:17,  4.68it/s, loss=5.44, v_num=0]
Epoch 8:  19%|█▊        | 18/97 [00:03<00:16,  4.85it/s, loss=5.44, v_num=0]
Epoch 8:  19%|█▊        | 18/97 [00:03<00:16,  4.78it/s, loss=5.44, v_num=0]
Epoch 8:  20%|█▉        | 19/97 [00:03<00:15,  4.93it/s, loss=5.44, v_num=0]
Epoch 8:  20%|█▉        | 19/97 [00:03<00:16,  4.86it/s, loss=5.43, v_num=0]
Epoch 8:  21%|██        | 20/97 [00:03<00:15,  5.02it/s, loss=5.43, v_num=0]
Epoch 8:  21%|██        | 20/97 [00:04<00:15,  4.95it/s, loss=5.43, v_num=0]
Epoch 8:  22%|██▏       | 21/97 [00:04<00:14,  5.10it/s, loss=5.43, v_num=0]
Epoch 8:  22%|██▏       | 21/97 [00:04<00:15,  5.03it/s, loss=5.45, v_num=0]
Epoch 8:  23%|██▎       | 22/97 [00:04<00:14,  5.17it/s, loss=5.45, v_num=0]
Epoch 8:  23%|██▎       | 22/97 [00:04<00:14,  5.10it/s, loss=5.44, v_num=0]
Epoch 8:  24%|██▎       | 23/97 [00:04<00:14,  5.23it/s, loss=5.44, v_num=0]
Epoch 8:  24%|██▎       | 23/97 [00:04<00:14,  5.17it/s, loss=5.44, v_num=0]
Epoch 8:  25%|██▍       | 24/97 [00:04<00:13,  5.30it/s, loss=5.44, v_num=0]
Epoch 8:  25%|██▍       | 24/97 [00:04<00:13,  5.23it/s, loss=5.45, v_num=0]
Epoch 8:  26%|██▌       | 25/97 [00:04<00:13,  5.36it/s, loss=5.45, v_num=0]
Epoch 8:  26%|██▌       | 25/97 [00:04<00:13,  5.29it/s, loss=5.44, v_num=0]
Epoch 8:  27%|██▋       | 26/97 [00:04<00:13,  5.41it/s, loss=5.44, v_num=0]
Epoch 8:  27%|██▋       | 26/97 [00:04<00:13,  5.35it/s, loss=5.43, v_num=0]
Epoch 8:  28%|██▊       | 27/97 [00:04<00:12,  5.47it/s, loss=5.43, v_num=0]
Epoch 8:  28%|██▊       | 27/97 [00:04<00:12,  5.41it/s, loss=5.44, v_num=0]
Epoch 8:  29%|██▉       | 28/97 [00:05<00:12,  5.52it/s, loss=5.44, v_num=0]
Epoch 8:  29%|██▉       | 28/97 [00:05<00:12,  5.46it/s, loss=5.43, v_num=0]
Epoch 8:  30%|██▉       | 29/97 [00:05<00:12,  5.56it/s, loss=5.43, v_num=0]
Epoch 8:  30%|██▉       | 29/97 [00:05<00:12,  5.51it/s, loss=5.43, v_num=0]
Epoch 8:  31%|███       | 30/97 [00:05<00:11,  5.61it/s, loss=5.43, v_num=0]
Epoch 8:  31%|███       | 30/97 [00:05<00:12,  5.55it/s, loss=5.42, v_num=0]
Epoch 8:  32%|███▏      | 31/97 [00:05<00:11,  5.65it/s, loss=5.42, v_num=0]
Epoch 8:  32%|███▏      | 31/97 [00:05<00:11,  5.60it/s, loss=5.41, v_num=0]
Epoch 8:  33%|███▎      | 32/97 [00:05<00:11,  5.69it/s, loss=5.41, v_num=0]
Epoch 8:  33%|███▎      | 32/97 [00:05<00:11,  5.64it/s, loss=5.41, v_num=0]
Epoch 8:  34%|███▍      | 33/97 [00:05<00:11,  5.73it/s, loss=5.41, v_num=0]
Epoch 8:  34%|███▍      | 33/97 [00:05<00:11,  5.68it/s, loss=5.4, v_num=0]
Epoch 8:  35%|███▌      | 34/97 [00:05<00:10,  5.77it/s, loss=5.4, v_num=0]
Epoch 8:  35%|███▌      | 34/97 [00:05<00:11,  5.72it/s, loss=5.4, v_num=0]
Epoch 8:  36%|███▌      | 35/97 [00:06<00:10,  5.80it/s, loss=5.4, v_num=0]
Epoch 8:  36%|███▌      | 35/97 [00:06<00:10,  5.75it/s, loss=5.4, v_num=0]
Epoch 8:  37%|███▋      | 36/97 [00:06<00:10,  5.84it/s, loss=5.4, v_num=0]
Epoch 8:  37%|███▋      | 36/97 [00:06<00:10,  5.79it/s, loss=5.39, v_num=0]
Epoch 8:  38%|███▊      | 37/97 [00:06<00:10,  5.87it/s, loss=5.39, v_num=0]
Epoch 8:  38%|███▊      | 37/97 [00:06<00:10,  5.82it/s, loss=5.39, v_num=0]
Epoch 8:  39%|███▉      | 38/97 [00:06<00:09,  5.90it/s, loss=5.39, v_num=0]
Epoch 8:  39%|███▉      | 38/97 [00:06<00:10,  5.85it/s, loss=5.38, v_num=0]
Epoch 8:  40%|████      | 39/97 [00:06<00:09,  5.94it/s, loss=5.38, v_num=0]
Epoch 8:  40%|████      | 39/97 [00:06<00:09,  5.88it/s, loss=5.38, v_num=0]
Epoch 8:  41%|████      | 40/97 [00:06<00:09,  5.96it/s, loss=5.38, v_num=0]
Epoch 8:  41%|████      | 40/97 [00:06<00:09,  5.91it/s, loss=5.38, v_num=0]
Epoch 8:  42%|████▏     | 41/97 [00:06<00:09,  5.99it/s, loss=5.38, v_num=0]
Epoch 8:  42%|████▏     | 41/97 [00:06<00:09,  5.94it/s, loss=5.37, v_num=0]
Epoch 8:  43%|████▎     | 42/97 [00:06<00:09,  6.01it/s, loss=5.37, v_num=0]
Epoch 8:  43%|████▎     | 42/97 [00:07<00:09,  5.97it/s, loss=5.36, v_num=0]
Epoch 8:  44%|████▍     | 43/97 [00:07<00:08,  6.04it/s, loss=5.36, v_num=0]
Epoch 8:  44%|████▍     | 43/97 [00:07<00:09,  5.99it/s, loss=5.36, v_num=0]
Epoch 8:  45%|████▌     | 44/97 [00:07<00:08,  6.06it/s, loss=5.36, v_num=0]
Epoch 8:  45%|████▌     | 44/97 [00:07<00:08,  6.02it/s, loss=5.36, v_num=0]
Epoch 8:  46%|████▋     | 45/97 [00:07<00:08,  6.09it/s, loss=5.36, v_num=0]
Epoch 8:  46%|████▋     | 45/97 [00:07<00:08,  6.04it/s, loss=5.36, v_num=0]
Epoch 8:  47%|████▋     | 46/97 [00:07<00:08,  6.11it/s, loss=5.36, v_num=0]
Epoch 8:  47%|████▋     | 46/97 [00:07<00:08,  6.07it/s, loss=5.37, v_num=0]
Epoch 8:  48%|████▊     | 47/97 [00:07<00:08,  6.13it/s, loss=5.37, v_num=0]
Epoch 8:  48%|████▊     | 47/97 [00:07<00:08,  6.09it/s, loss=5.36, v_num=0]
Epoch 8:  49%|████▉     | 48/97 [00:07<00:07,  6.15it/s, loss=5.36, v_num=0]
Epoch 8:  49%|████▉     | 48/97 [00:07<00:08,  6.11it/s, loss=5.35, v_num=0]
Epoch 8:  51%|█████     | 49/97 [00:07<00:07,  6.17it/s, loss=5.35, v_num=0]
Epoch 8:  51%|█████     | 49/97 [00:07<00:07,  6.13it/s, loss=5.36, v_num=0]
Epoch 8:  52%|█████▏    | 50/97 [00:08<00:07,  6.19it/s, loss=5.36, v_num=0]
Epoch 8:  52%|█████▏    | 50/97 [00:08<00:07,  6.15it/s, loss=5.36, v_num=0]
Epoch 8:  53%|█████▎    | 51/97 [00:08<00:07,  6.21it/s, loss=5.36, v_num=0]
Epoch 8:  53%|█████▎    | 51/97 [00:08<00:07,  6.16it/s, loss=5.35, v_num=0]
Epoch 8:  54%|█████▎    | 52/97 [00:08<00:07,  6.22it/s, loss=5.35, v_num=0]
Epoch 8:  54%|█████▎    | 52/97 [00:08<00:07,  6.18it/s, loss=5.34, v_num=0]
Epoch 8:  55%|█████▍    | 53/97 [00:08<00:07,  6.24it/s, loss=5.34, v_num=0]
Epoch 8:  55%|█████▍    | 53/97 [00:08<00:07,  6.20it/s, loss=5.34, v_num=0]
Epoch 8:  56%|█████▌    | 54/97 [00:08<00:06,  6.26it/s, loss=5.34, v_num=0]
Epoch 8:  56%|█████▌    | 54/97 [00:08<00:06,  6.22it/s, loss=5.34, v_num=0]
Epoch 8:  57%|█████▋    | 55/97 [00:08<00:06,  6.28it/s, loss=5.34, v_num=0]
Epoch 8:  57%|█████▋    | 55/97 [00:08<00:06,  6.23it/s, loss=5.34, v_num=0]
Epoch 8:  58%|█████▊    | 56/97 [00:08<00:06,  6.29it/s, loss=5.34, v_num=0]
Epoch 8:  58%|█████▊    | 56/97 [00:08<00:06,  6.25it/s, loss=5.33, v_num=0]
Epoch 8:  59%|█████▉    | 57/97 [00:09<00:06,  6.31it/s, loss=5.33, v_num=0]
Epoch 8:  59%|█████▉    | 57/97 [00:09<00:06,  6.27it/s, loss=5.33, v_num=0]
Epoch 8:  60%|█████▉    | 58/97 [00:09<00:06,  6.32it/s, loss=5.33, v_num=0]
Epoch 8:  60%|█████▉    | 58/97 [00:09<00:06,  6.28it/s, loss=5.33, v_num=0]
Epoch 8:  61%|██████    | 59/97 [00:09<00:05,  6.34it/s, loss=5.33, v_num=0]
Epoch 8:  61%|██████    | 59/97 [00:09<00:06,  6.30it/s, loss=5.33, v_num=0]
Epoch 8:  62%|██████▏   | 60/97 [00:09<00:05,  6.35it/s, loss=5.33, v_num=0]
Epoch 8:  62%|██████▏   | 60/97 [00:09<00:05,  6.31it/s, loss=5.33, v_num=0]
Epoch 8:  63%|██████▎   | 61/97 [00:09<00:05,  6.36it/s, loss=5.33, v_num=0]
Epoch 8:  63%|██████▎   | 61/97 [00:09<00:05,  6.33it/s, loss=5.33, v_num=0]
Epoch 8:  64%|██████▍   | 62/97 [00:09<00:05,  6.38it/s, loss=5.33, v_num=0]
Epoch 8:  64%|██████▍   | 62/97 [00:09<00:05,  6.34it/s, loss=5.32, v_num=0]
Epoch 8:  65%|██████▍   | 63/97 [00:09<00:05,  6.39it/s, loss=5.32, v_num=0]
Epoch 8:  65%|██████▍   | 63/97 [00:09<00:05,  6.35it/s, loss=5.32, v_num=0]
Epoch 8:  66%|██████▌   | 64/97 [00:09<00:05,  6.40it/s, loss=5.32, v_num=0]
Epoch 8:  66%|██████▌   | 64/97 [00:10<00:05,  6.37it/s, loss=5.31, v_num=0]
Epoch 8:  67%|██████▋   | 65/97 [00:10<00:04,  6.41it/s, loss=5.31, v_num=0]
Epoch 8:  67%|██████▋   | 65/97 [00:10<00:05,  6.38it/s, loss=5.32, v_num=0]
Epoch 8:  68%|██████▊   | 66/97 [00:10<00:04,  6.43it/s, loss=5.32, v_num=0]
Epoch 8:  68%|██████▊   | 66/97 [00:10<00:04,  6.39it/s, loss=5.3, v_num=0]
Epoch 8:  69%|██████▉   | 67/97 [00:10<00:04,  6.44it/s, loss=5.3, v_num=0]
Epoch 8:  69%|██████▉   | 67/97 [00:10<00:04,  6.40it/s, loss=5.31, v_num=0]
Epoch 8:  70%|███████   | 68/97 [00:10<00:04,  6.45it/s, loss=5.31, v_num=0]
Epoch 8:  70%|███████   | 68/97 [00:10<00:04,  6.42it/s, loss=5.31, v_num=0]
Epoch 8:  71%|███████   | 69/97 [00:10<00:04,  6.46it/s, loss=5.31, v_num=0]
Epoch 8:  71%|███████   | 69/97 [00:10<00:04,  6.43it/s, loss=5.31, v_num=0]
Epoch 8:  72%|███████▏  | 70/97 [00:10<00:04,  6.47it/s, loss=5.31, v_num=0]
Epoch 8:  72%|███████▏  | 70/97 [00:10<00:04,  6.44it/s, loss=5.3, v_num=0]
Epoch 8:  73%|███████▎  | 71/97 [00:10<00:04,  6.48it/s, loss=5.3, v_num=0]
Epoch 8:  73%|███████▎  | 71/97 [00:11<00:04,  6.45it/s, loss=5.3, v_num=0]
Epoch 8:  74%|███████▍  | 72/97 [00:11<00:03,  6.50it/s, loss=5.3, v_num=0]
Epoch 8:  74%|███████▍  | 72/97 [00:11<00:03,  6.46it/s, loss=5.28, v_num=0]
Epoch 8:  75%|███████▌  | 73/97 [00:11<00:03,  6.50it/s, loss=5.28, v_num=0]
Epoch 8:  75%|███████▌  | 73/97 [00:11<00:03,  6.47it/s, loss=5.28, v_num=0]
Epoch 8:  76%|███████▋  | 74/97 [00:11<00:03,  6.52it/s, loss=5.28, v_num=0]
Epoch 8:  76%|███████▋  | 74/97 [00:11<00:03,  6.48it/s, loss=5.28, v_num=0]
Epoch 8:  77%|███████▋  | 75/97 [00:11<00:03,  6.52it/s, loss=5.28, v_num=0]
Epoch 8:  77%|███████▋  | 75/97 [00:11<00:03,  6.49it/s, loss=5.28, v_num=0]
Epoch 8:  78%|███████▊  | 76/97 [00:11<00:03,  6.53it/s, loss=5.28, v_num=0]
Epoch 8:  78%|███████▊  | 76/97 [00:11<00:03,  6.50it/s, loss=5.27, v_num=0]
Epoch 8:  79%|███████▉  | 77/97 [00:11<00:03,  6.54it/s, loss=5.27, v_num=0]
Epoch 8:  79%|███████▉  | 77/97 [00:11<00:03,  6.51it/s, loss=5.28, v_num=0]
Epoch 8:  80%|████████  | 78/97 [00:11<00:02,  6.55it/s, loss=5.28, v_num=0]
Epoch 8:  80%|████████  | 78/97 [00:11<00:02,  6.52it/s, loss=5.28, v_num=0]
Epoch 8:  81%|████████▏ | 79/97 [00:12<00:02,  6.56it/s, loss=5.28, v_num=0]
Epoch 8:  81%|████████▏ | 79/97 [00:12<00:02,  6.53it/s, loss=5.28, v_num=0]
Epoch 8:  82%|████████▏ | 80/97 [00:12<00:02,  6.57it/s, loss=5.28, v_num=0]
Epoch 8:  82%|████████▏ | 80/97 [00:12<00:02,  6.54it/s, loss=5.27, v_num=0]
Epoch 8:  84%|████████▎ | 81/97 [00:12<00:02,  6.58it/s, loss=5.27, v_num=0]
Epoch 8:  84%|████████▎ | 81/97 [00:12<00:02,  6.55it/s, loss=5.27, v_num=0]
Epoch 8:  85%|████████▍ | 82/97 [00:12<00:02,  6.58it/s, loss=5.27, v_num=0]
Epoch 8:  85%|████████▍ | 82/97 [00:12<00:02,  6.55it/s, loss=5.27, v_num=0]
Epoch 8:  86%|████████▌ | 83/97 [00:12<00:02,  6.59it/s, loss=5.27, v_num=0]
Epoch 8:  86%|████████▌ | 83/97 [00:12<00:02,  6.56it/s, loss=5.28, v_num=0]
Epoch 8:  87%|████████▋ | 84/97 [00:12<00:01,  6.60it/s, loss=5.28, v_num=0]
Epoch 8:  87%|████████▋ | 84/97 [00:12<00:01,  6.57it/s, loss=5.26, v_num=0]
Epoch 8:  88%|████████▊ | 85/97 [00:12<00:01,  6.61it/s, loss=5.26, v_num=0]
Epoch 8:  88%|████████▊ | 85/97 [00:12<00:01,  6.58it/s, loss=5.26, v_num=0]
Epoch 8:  89%|████████▊ | 86/97 [00:12<00:01,  6.62it/s, loss=5.26, v_num=0]
Epoch 8:  89%|████████▊ | 86/97 [00:13<00:01,  6.59it/s, loss=5.26, v_num=0]
Epoch 8:  90%|████████▉ | 87/97 [00:13<00:01,  6.63it/s, loss=5.26, v_num=0]
Epoch 8:  90%|████████▉ | 87/97 [00:13<00:01,  6.60it/s, loss=5.25, v_num=0]
Epoch 8:  91%|█████████ | 88/97 [00:13<00:01,  6.63it/s, loss=5.25, v_num=0]
Epoch 8:  91%|█████████ | 88/97 [00:13<00:01,  6.60it/s, loss=5.25, v_num=0]
Epoch 8:  92%|█████████▏| 89/97 [00:13<00:01,  6.64it/s, loss=5.25, v_num=0]
Epoch 8:  92%|█████████▏| 89/97 [00:13<00:01,  6.61it/s, loss=5.25, v_num=0]
Epoch 8:  93%|█████████▎| 90/97 [00:13<00:01,  6.65it/s, loss=5.25, v_num=0]
Epoch 8:  93%|█████████▎| 90/97 [00:13<00:01,  6.62it/s, loss=5.26, v_num=0]
Epoch 8:  94%|█████████▍| 91/97 [00:13<00:00,  6.65it/s, loss=5.26, v_num=0]
Epoch 8:  94%|█████████▍| 91/97 [00:13<00:00,  6.63it/s, loss=5.26, v_num=0]
Epoch 8:  95%|█████████▍| 92/97 [00:13<00:00,  6.66it/s, loss=5.26, v_num=0]
Epoch 8:  95%|█████████▍| 92/97 [00:13<00:00,  6.63it/s, loss=5.27, v_num=0]
Epoch 8:  96%|█████████▌| 93/97 [00:13<00:00,  6.67it/s, loss=5.27, v_num=0]
Epoch 8:  96%|█████████▌| 93/97 [00:14<00:00,  6.64it/s, loss=5.27, v_num=0]
Epoch 8:  97%|█████████▋| 94/97 [00:14<00:00,  6.67it/s, loss=5.27, v_num=0]
Epoch 8:  97%|█████████▋| 94/97 [00:14<00:00,  6.65it/s, loss=5.27, v_num=0]
Epoch 8:  98%|█████████▊| 95/97 [00:14<00:00,  6.68it/s, loss=5.27, v_num=0]
Epoch 8:  98%|█████████▊| 95/97 [00:14<00:00,  6.65it/s, loss=5.27, v_num=0]
Epoch 8:  99%|█████████▉| 96/97 [00:14<00:00,  6.68it/s, loss=5.27, v_num=0]
Epoch 8:  99%|█████████▉| 96/97 [00:14<00:00,  6.66it/s, loss=5.27, v_num=0]
Epoch 8: 100%|██████████| 97/97 [00:14<00:00,  6.69it/s, loss=5.27, v_num=0]
Epoch 8: 100%|██████████| 97/97 [00:14<00:00,  6.67it/s, loss=5.26, v_num=0]
Epoch 8: 100%|██████████| 97/97 [00:14<00:00,  6.67it/s, loss=5.26, v_num=0]
Epoch 8:   0%|          | 0/97 [00:00<?, ?it/s, loss=5.26, v_num=0]
Epoch 9:   0%|          | 0/97 [00:00<?, ?it/s, loss=5.26, v_num=0]
Epoch 9:   1%|          | 1/97 [00:01<02:13,  1.39s/it, loss=5.26, v_num=0]
Epoch 9:   1%|          | 1/97 [00:01<02:18,  1.44s/it, loss=5.26, v_num=0]
Epoch 9:   2%|▏         | 2/97 [00:01<01:12,  1.31it/s, loss=5.26, v_num=0]
Epoch 9:   2%|▏         | 2/97 [00:01<01:15,  1.27it/s, loss=5.26, v_num=0]
Epoch 9:   3%|▎         | 3/97 [00:01<00:51,  1.81it/s, loss=5.26, v_num=0]
Epoch 9:   3%|▎         | 3/97 [00:01<00:53,  1.75it/s, loss=5.26, v_num=0]
Epoch 9:   4%|▍         | 4/97 [00:01<00:41,  2.23it/s, loss=5.26, v_num=0]
Epoch 9:   4%|▍         | 4/97 [00:01<00:43,  2.16it/s, loss=5.26, v_num=0]
Epoch 9:   5%|▌         | 5/97 [00:01<00:35,  2.59it/s, loss=5.26, v_num=0]
Epoch 9:   5%|▌         | 5/97 [00:01<00:36,  2.51it/s, loss=5.25, v_num=0]
Epoch 9:   6%|▌         | 6/97 [00:02<00:31,  2.89it/s, loss=5.25, v_num=0]
Epoch 9:   6%|▌         | 6/97 [00:02<00:32,  2.82it/s, loss=5.24, v_num=0]
Epoch 9:   7%|▋         | 7/97 [00:02<00:28,  3.17it/s, loss=5.24, v_num=0]
Epoch 9:   7%|▋         | 7/97 [00:02<00:29,  3.09it/s, loss=5.25, v_num=0]
Epoch 9:   8%|▊         | 8/97 [00:02<00:26,  3.42it/s, loss=5.25, v_num=0]
Epoch 9:   8%|▊         | 8/97 [00:02<00:26,  3.33it/s, loss=5.24, v_num=0]
Epoch 9:   9%|▉         | 9/97 [00:02<00:24,  3.62it/s, loss=5.24, v_num=0]
Epoch 9:   9%|▉         | 9/97 [00:02<00:24,  3.55it/s, loss=5.24, v_num=0]
Epoch 9:  10%|█         | 10/97 [00:02<00:22,  3.82it/s, loss=5.24, v_num=0]
Epoch 9:  10%|█         | 10/97 [00:02<00:23,  3.74it/s, loss=5.24, v_num=0]
Epoch 9:  11%|█▏        | 11/97 [00:02<00:21,  3.99it/s, loss=5.24, v_num=0]
Epoch 9:  11%|█▏        | 11/97 [00:02<00:22,  3.90it/s, loss=5.24, v_num=0]
Epoch 9:  12%|█▏        | 12/97 [00:02<00:20,  4.14it/s, loss=5.24, v_num=0]
Epoch 9:  12%|█▏        | 12/97 [00:02<00:20,  4.06it/s, loss=5.24, v_num=0]
Epoch 9:  13%|█▎        | 13/97 [00:03<00:19,  4.29it/s, loss=5.24, v_num=0]
Epoch 9:  13%|█▎        | 13/97 [00:03<00:19,  4.21it/s, loss=5.23, v_num=0]
Epoch 9:  14%|█▍        | 14/97 [00:03<00:18,  4.41it/s, loss=5.23, v_num=0]
Epoch 9:  14%|█▍        | 14/97 [00:03<00:19,  4.34it/s, loss=5.22, v_num=0]
Epoch 9:  15%|█▌        | 15/97 [00:03<00:18,  4.54it/s, loss=5.22, v_num=0]
Epoch 9:  15%|█▌        | 15/97 [00:03<00:18,  4.46it/s, loss=5.21, v_num=0]
Epoch 9:  16%|█▋        | 16/97 [00:03<00:17,  4.64it/s, loss=5.21, v_num=0]
Epoch 9:  16%|█▋        | 16/97 [00:03<00:17,  4.57it/s, loss=5.21, v_num=0]
Epoch 9:  18%|█▊        | 17/97 [00:03<00:16,  4.74it/s, loss=5.21, v_num=0]
Epoch 9:  18%|█▊        | 17/97 [00:03<00:17,  4.67it/s, loss=5.21, v_num=0]
Epoch 9:  19%|█▊        | 18/97 [00:03<00:16,  4.84it/s, loss=5.21, v_num=0]
Epoch 9:  19%|█▊        | 18/97 [00:03<00:16,  4.77it/s, loss=5.21, v_num=0]
Epoch 9:  20%|█▉        | 19/97 [00:03<00:15,  4.93it/s, loss=5.21, v_num=0]
Epoch 9:  20%|█▉        | 19/97 [00:03<00:16,  4.86it/s, loss=5.2, v_num=0]
Epoch 9:  21%|██        | 20/97 [00:03<00:15,  5.01it/s, loss=5.2, v_num=0]
Epoch 9:  21%|██        | 20/97 [00:04<00:15,  4.94it/s, loss=5.2, v_num=0]
Epoch 9:  22%|██▏       | 21/97 [00:04<00:14,  5.08it/s, loss=5.2, v_num=0]
Epoch 9:  22%|██▏       | 21/97 [00:04<00:15,  5.02it/s, loss=5.2, v_num=0]
Epoch 9:  23%|██▎       | 22/97 [00:04<00:14,  5.16it/s, loss=5.2, v_num=0]
Epoch 9:  23%|██▎       | 22/97 [00:04<00:14,  5.09it/s, loss=5.19, v_num=0]
Epoch 9:  24%|██▎       | 23/97 [00:04<00:14,  5.22it/s, loss=5.19, v_num=0]
Epoch 9:  24%|██▎       | 23/97 [00:04<00:14,  5.16it/s, loss=5.19, v_num=0]
Epoch 9:  25%|██▍       | 24/97 [00:04<00:13,  5.28it/s, loss=5.19, v_num=0]
Epoch 9:  25%|██▍       | 24/97 [00:04<00:13,  5.22it/s, loss=5.19, v_num=0]
Epoch 9:  26%|██▌       | 25/97 [00:04<00:13,  5.34it/s, loss=5.19, v_num=0]
Epoch 9:  26%|██▌       | 25/97 [00:04<00:13,  5.28it/s, loss=5.18, v_num=0]
Epoch 9:  27%|██▋       | 26/97 [00:04<00:13,  5.40it/s, loss=5.18, v_num=0]
Epoch 9:  27%|██▋       | 26/97 [00:04<00:13,  5.34it/s, loss=5.18, v_num=0]
Epoch 9:  28%|██▊       | 27/97 [00:04<00:12,  5.45it/s, loss=5.18, v_num=0]
Epoch 9:  28%|██▊       | 27/97 [00:05<00:12,  5.39it/s, loss=5.18, v_num=0]
Epoch 9:  29%|██▉       | 28/97 [00:05<00:12,  5.50it/s, loss=5.18, v_num=0]
Epoch 9:  29%|██▉       | 28/97 [00:05<00:12,  5.44it/s, loss=5.19, v_num=0]
Epoch 9:  30%|██▉       | 29/97 [00:05<00:12,  5.55it/s, loss=5.19, v_num=0]
Epoch 9:  30%|██▉       | 29/97 [00:05<00:12,  5.49it/s, loss=5.18, v_num=0]
Epoch 9:  31%|███       | 30/97 [00:05<00:11,  5.60it/s, loss=5.18, v_num=0]
Epoch 9:  31%|███       | 30/97 [00:05<00:12,  5.54it/s, loss=5.18, v_num=0]
Epoch 9:  32%|███▏      | 31/97 [00:05<00:11,  5.64it/s, loss=5.18, v_num=0]
Epoch 9:  32%|███▏      | 31/97 [00:05<00:11,  5.58it/s, loss=5.18, v_num=0]
Epoch 9:  33%|███▎      | 32/97 [00:05<00:11,  5.68it/s, loss=5.18, v_num=0]
Epoch 9:  33%|███▎      | 32/97 [00:05<00:11,  5.62it/s, loss=5.18, v_num=0]
Epoch 9:  34%|███▍      | 33/97 [00:05<00:11,  5.72it/s, loss=5.18, v_num=0]
Epoch 9:  34%|███▍      | 33/97 [00:05<00:11,  5.66it/s, loss=5.18, v_num=0]
Epoch 9:  35%|███▌      | 34/97 [00:05<00:10,  5.75it/s, loss=5.18, v_num=0]
Epoch 9:  35%|███▌      | 34/97 [00:05<00:11,  5.70it/s, loss=5.17, v_num=0]
Epoch 9:  36%|███▌      | 35/97 [00:06<00:10,  5.79it/s, loss=5.17, v_num=0]
Epoch 9:  36%|███▌      | 35/97 [00:06<00:10,  5.74it/s, loss=5.18, v_num=0]
Epoch 9:  37%|███▋      | 36/97 [00:06<00:10,  5.82it/s, loss=5.18, v_num=0]
Epoch 9:  37%|███▋      | 36/97 [00:06<00:10,  5.77it/s, loss=5.2, v_num=0]
Epoch 9:  38%|███▊      | 37/97 [00:06<00:10,  5.86it/s, loss=5.2, v_num=0]
Epoch 9:  38%|███▊      | 37/97 [00:06<00:10,  5.81it/s, loss=5.19, v_num=0]
Epoch 9:  39%|███▉      | 38/97 [00:06<00:10,  5.89it/s, loss=5.19, v_num=0]
Epoch 9:  39%|███▉      | 38/97 [00:06<00:10,  5.84it/s, loss=5.19, v_num=0]
Epoch 9:  40%|████      | 39/97 [00:06<00:09,  5.92it/s, loss=5.19, v_num=0]
Epoch 9:  40%|████      | 39/97 [00:06<00:09,  5.87it/s, loss=5.19, v_num=0]
Epoch 9:  41%|████      | 40/97 [00:06<00:09,  5.95it/s, loss=5.19, v_num=0]
Epoch 9:  41%|████      | 40/97 [00:06<00:09,  5.90it/s, loss=5.18, v_num=0]
Epoch 9:  42%|████▏     | 41/97 [00:06<00:09,  5.97it/s, loss=5.18, v_num=0]
Epoch 9:  42%|████▏     | 41/97 [00:06<00:09,  5.93it/s, loss=5.17, v_num=0]
Epoch 9:  43%|████▎     | 42/97 [00:06<00:09,  6.00it/s, loss=5.17, v_num=0]
Epoch 9:  43%|████▎     | 42/97 [00:07<00:09,  5.95it/s, loss=5.17, v_num=0]
Epoch 9:  44%|████▍     | 43/97 [00:07<00:08,  6.03it/s, loss=5.17, v_num=0]
Epoch 9:  44%|████▍     | 43/97 [00:07<00:09,  5.98it/s, loss=5.17, v_num=0]
Epoch 9:  45%|████▌     | 44/97 [00:07<00:08,  6.04it/s, loss=5.17, v_num=0]
Epoch 9:  45%|████▌     | 44/97 [00:07<00:08,  6.00it/s, loss=5.17, v_num=0]
Epoch 9:  46%|████▋     | 45/97 [00:07<00:08,  6.06it/s, loss=5.17, v_num=0]
Epoch 9:  46%|████▋     | 45/97 [00:07<00:08,  6.02it/s, loss=5.18, v_num=0]
Epoch 9:  47%|████▋     | 46/97 [00:07<00:08,  6.09it/s, loss=5.18, v_num=0]
Epoch 9:  47%|████▋     | 46/97 [00:07<00:08,  6.04it/s, loss=5.17, v_num=0]
Epoch 9:  48%|████▊     | 47/97 [00:07<00:08,  6.11it/s, loss=5.17, v_num=0]
Epoch 9:  48%|████▊     | 47/97 [00:07<00:08,  6.07it/s, loss=5.17, v_num=0]
Epoch 9:  49%|████▉     | 48/97 [00:07<00:07,  6.13it/s, loss=5.17, v_num=0]
Epoch 9:  49%|████▉     | 48/97 [00:07<00:08,  6.09it/s, loss=5.16, v_num=0]
Epoch 9:  51%|█████     | 49/97 [00:07<00:07,  6.15it/s, loss=5.16, v_num=0]
Epoch 9:  51%|█████     | 49/97 [00:08<00:07,  6.11it/s, loss=5.16, v_num=0]
Epoch 9:  52%|█████▏    | 50/97 [00:08<00:07,  6.17it/s, loss=5.16, v_num=0]
Epoch 9:  52%|█████▏    | 50/97 [00:08<00:07,  6.13it/s, loss=5.17, v_num=0]
Epoch 9:  53%|█████▎    | 51/97 [00:08<00:07,  6.19it/s, loss=5.17, v_num=0]
Epoch 9:  53%|█████▎    | 51/97 [00:08<00:07,  6.15it/s, loss=5.15, v_num=0]
Epoch 9:  54%|█████▎    | 52/97 [00:08<00:07,  6.21it/s, loss=5.15, v_num=0]
Epoch 9:  54%|█████▎    | 52/97 [00:08<00:07,  6.17it/s, loss=5.15, v_num=0]
Epoch 9:  55%|█████▍    | 53/97 [00:08<00:07,  6.23it/s, loss=5.15, v_num=0]
Epoch 9:  55%|█████▍    | 53/97 [00:08<00:07,  6.19it/s, loss=5.14, v_num=0]
Epoch 9:  56%|█████▌    | 54/97 [00:08<00:06,  6.24it/s, loss=5.14, v_num=0]
Epoch 9:  56%|█████▌    | 54/97 [00:08<00:06,  6.20it/s, loss=5.14, v_num=0]
Epoch 9:  57%|█████▋    | 55/97 [00:08<00:06,  6.26it/s, loss=5.14, v_num=0]
Epoch 9:  57%|█████▋    | 55/97 [00:08<00:06,  6.22it/s, loss=5.13, v_num=0]
Epoch 9:  58%|█████▊    | 56/97 [00:08<00:06,  6.28it/s, loss=5.13, v_num=0]
Epoch 9:  58%|█████▊    | 56/97 [00:08<00:06,  6.24it/s, loss=5.12, v_num=0]
Epoch 9:  59%|█████▉    | 57/97 [00:09<00:06,  6.29it/s, loss=5.12, v_num=0]
Epoch 9:  59%|█████▉    | 57/97 [00:09<00:06,  6.25it/s, loss=5.12, v_num=0]
Epoch 9:  60%|█████▉    | 58/97 [00:09<00:06,  6.31it/s, loss=5.12, v_num=0]
Epoch 9:  60%|█████▉    | 58/97 [00:09<00:06,  6.27it/s, loss=5.12, v_num=0]
Epoch 9:  61%|██████    | 59/97 [00:09<00:06,  6.32it/s, loss=5.12, v_num=0]
Epoch 9:  61%|██████    | 59/97 [00:09<00:06,  6.29it/s, loss=5.12, v_num=0]
Epoch 9:  62%|██████▏   | 60/97 [00:09<00:05,  6.34it/s, loss=5.12, v_num=0]
Epoch 9:  62%|██████▏   | 60/97 [00:09<00:05,  6.30it/s, loss=5.13, v_num=0]
Epoch 9:  63%|██████▎   | 61/97 [00:09<00:05,  6.35it/s, loss=5.13, v_num=0]
Epoch 9:  63%|██████▎   | 61/97 [00:09<00:05,  6.32it/s, loss=5.13, v_num=0]
Epoch 9:  64%|██████▍   | 62/97 [00:09<00:05,  6.36it/s, loss=5.13, v_num=0]
Epoch 9:  64%|██████▍   | 62/97 [00:09<00:05,  6.33it/s, loss=5.12, v_num=0]
Epoch 9:  65%|██████▍   | 63/97 [00:09<00:05,  6.38it/s, loss=5.12, v_num=0]
Epoch 9:  65%|██████▍   | 63/97 [00:09<00:05,  6.34it/s, loss=5.12, v_num=0]
Epoch 9:  66%|██████▌   | 64/97 [00:10<00:05,  6.39it/s, loss=5.12, v_num=0]
Epoch 9:  66%|██████▌   | 64/97 [00:10<00:05,  6.36it/s, loss=5.11, v_num=0]
Epoch 9:  67%|██████▋   | 65/97 [00:10<00:04,  6.40it/s, loss=5.11, v_num=0]
Epoch 9:  67%|██████▋   | 65/97 [00:10<00:05,  6.37it/s, loss=5.11, v_num=0]
Epoch 9:  68%|██████▊   | 66/97 [00:10<00:04,  6.42it/s, loss=5.11, v_num=0]
Epoch 9:  68%|██████▊   | 66/97 [00:10<00:04,  6.38it/s, loss=5.11, v_num=0]
Epoch 9:  69%|██████▉   | 67/97 [00:10<00:04,  6.43it/s, loss=5.11, v_num=0]
Epoch 9:  69%|██████▉   | 67/97 [00:10<00:04,  6.39it/s, loss=5.11, v_num=0]
Epoch 9:  70%|███████   | 68/97 [00:10<00:04,  6.44it/s, loss=5.11, v_num=0]
Epoch 9:  70%|███████   | 68/97 [00:10<00:04,  6.41it/s, loss=5.1, v_num=0]
Epoch 9:  71%|███████   | 69/97 [00:10<00:04,  6.45it/s, loss=5.1, v_num=0]
Epoch 9:  71%|███████   | 69/97 [00:10<00:04,  6.42it/s, loss=5.1, v_num=0]
Epoch 9:  72%|███████▏  | 70/97 [00:10<00:04,  6.46it/s, loss=5.1, v_num=0]
Epoch 9:  72%|███████▏  | 70/97 [00:10<00:04,  6.43it/s, loss=5.09, v_num=0]
Epoch 9:  73%|███████▎  | 71/97 [00:10<00:04,  6.47it/s, loss=5.09, v_num=0]
Epoch 9:  73%|███████▎  | 71/97 [00:11<00:04,  6.44it/s, loss=5.09, v_num=0]
Epoch 9:  74%|███████▍  | 72/97 [00:11<00:03,  6.48it/s, loss=5.09, v_num=0]
Epoch 9:  74%|███████▍  | 72/97 [00:11<00:03,  6.45it/s, loss=5.09, v_num=0]
Epoch 9:  75%|███████▌  | 73/97 [00:11<00:03,  6.49it/s, loss=5.09, v_num=0]
Epoch 9:  75%|███████▌  | 73/97 [00:11<00:03,  6.46it/s, loss=5.09, v_num=0]
Epoch 9:  76%|███████▋  | 74/97 [00:11<00:03,  6.50it/s, loss=5.09, v_num=0]
Epoch 9:  76%|███████▋  | 74/97 [00:11<00:03,  6.47it/s, loss=5.09, v_num=0]
Epoch 9:  77%|███████▋  | 75/97 [00:11<00:03,  6.51it/s, loss=5.09, v_num=0]
Epoch 9:  77%|███████▋  | 75/97 [00:11<00:03,  6.48it/s, loss=5.09, v_num=0]
Epoch 9:  78%|███████▊  | 76/97 [00:11<00:03,  6.52it/s, loss=5.09, v_num=0]
Epoch 9:  78%|███████▊  | 76/97 [00:11<00:03,  6.49it/s, loss=5.08, v_num=0]
Epoch 9:  79%|███████▉  | 77/97 [00:11<00:03,  6.53it/s, loss=5.08, v_num=0]
Epoch 9:  79%|███████▉  | 77/97 [00:11<00:03,  6.50it/s, loss=5.07, v_num=0]
Epoch 9:  80%|████████  | 78/97 [00:11<00:02,  6.54it/s, loss=5.07, v_num=0]
Epoch 9:  80%|████████  | 78/97 [00:11<00:02,  6.51it/s, loss=5.06, v_num=0]
Epoch 9:  81%|████████▏ | 79/97 [00:12<00:02,  6.55it/s, loss=5.06, v_num=0]
Epoch 9:  81%|████████▏ | 79/97 [00:12<00:02,  6.52it/s, loss=5.06, v_num=0]
Epoch 9:  82%|████████▏ | 80/97 [00:12<00:02,  6.56it/s, loss=5.06, v_num=0]
Epoch 9:  82%|████████▏ | 80/97 [00:12<00:02,  6.53it/s, loss=5.06, v_num=0]
Epoch 9:  84%|████████▎ | 81/97 [00:12<00:02,  6.57it/s, loss=5.06, v_num=0]
Epoch 9:  84%|████████▎ | 81/97 [00:12<00:02,  6.54it/s, loss=5.07, v_num=0]
Epoch 9:  85%|████████▍ | 82/97 [00:12<00:02,  6.57it/s, loss=5.07, v_num=0]
Epoch 9:  85%|████████▍ | 82/97 [00:12<00:02,  6.54it/s, loss=5.07, v_num=0]
Epoch 9:  86%|████████▌ | 83/97 [00:12<00:02,  6.58it/s, loss=5.07, v_num=0]
Epoch 9:  86%|████████▌ | 83/97 [00:12<00:02,  6.55it/s, loss=5.07, v_num=0]
Epoch 9:  87%|████████▋ | 84/97 [00:12<00:01,  6.59it/s, loss=5.07, v_num=0]
Epoch 9:  87%|████████▋ | 84/97 [00:12<00:01,  6.56it/s, loss=5.07, v_num=0]
Epoch 9:  88%|████████▊ | 85/97 [00:12<00:01,  6.59it/s, loss=5.07, v_num=0]
Epoch 9:  88%|████████▊ | 85/97 [00:12<00:01,  6.57it/s, loss=5.05, v_num=0]
Epoch 9:  89%|████████▊ | 86/97 [00:13<00:01,  6.60it/s, loss=5.05, v_num=0]
Epoch 9:  89%|████████▊ | 86/97 [00:13<00:01,  6.57it/s, loss=5.05, v_num=0]
Epoch 9:  90%|████████▉ | 87/97 [00:13<00:01,  6.61it/s, loss=5.05, v_num=0]
Epoch 9:  90%|████████▉ | 87/97 [00:13<00:01,  6.58it/s, loss=5.05, v_num=0]
Epoch 9:  91%|█████████ | 88/97 [00:13<00:01,  6.62it/s, loss=5.05, v_num=0]
Epoch 9:  91%|█████████ | 88/97 [00:13<00:01,  6.59it/s, loss=5.05, v_num=0]
Epoch 9:  92%|█████████▏| 89/97 [00:13<00:01,  6.63it/s, loss=5.05, v_num=0]
Epoch 9:  92%|█████████▏| 89/97 [00:13<00:01,  6.60it/s, loss=5.05, v_num=0]
Epoch 9:  93%|█████████▎| 90/97 [00:13<00:01,  6.63it/s, loss=5.05, v_num=0]
Epoch 9:  93%|█████████▎| 90/97 [00:13<00:01,  6.61it/s, loss=5.04, v_num=0]
Epoch 9:  94%|█████████▍| 91/97 [00:13<00:00,  6.64it/s, loss=5.04, v_num=0]
Epoch 9:  94%|█████████▍| 91/97 [00:13<00:00,  6.61it/s, loss=5.04, v_num=0]
Epoch 9:  95%|█████████▍| 92/97 [00:13<00:00,  6.65it/s, loss=5.04, v_num=0]
Epoch 9:  95%|█████████▍| 92/97 [00:13<00:00,  6.62it/s, loss=5.04, v_num=0]
Epoch 9:  96%|█████████▌| 93/97 [00:13<00:00,  6.65it/s, loss=5.04, v_num=0]
Epoch 9:  96%|█████████▌| 93/97 [00:14<00:00,  6.63it/s, loss=5.04, v_num=0]
Epoch 9:  97%|█████████▋| 94/97 [00:14<00:00,  6.66it/s, loss=5.04, v_num=0]
Epoch 9:  97%|█████████▋| 94/97 [00:14<00:00,  6.63it/s, loss=5.04, v_num=0]
Epoch 9:  98%|█████████▊| 95/97 [00:14<00:00,  6.67it/s, loss=5.04, v_num=0]
Epoch 9:  98%|█████████▊| 95/97 [00:14<00:00,  6.64it/s, loss=5.04, v_num=0]
Epoch 9:  99%|█████████▉| 96/97 [00:14<00:00,  6.67it/s, loss=5.04, v_num=0]
Epoch 9:  99%|█████████▉| 96/97 [00:14<00:00,  6.65it/s, loss=5.04, v_num=0]
Epoch 9: 100%|██████████| 97/97 [00:14<00:00,  6.68it/s, loss=5.04, v_num=0]
Epoch 9: 100%|██████████| 97/97 [00:14<00:00,  6.65it/s, loss=5.04, v_num=0]
Epoch 9: 100%|██████████| 97/97 [00:14<00:00,  6.65it/s, loss=5.04, v_num=0]
Epoch 9:   0%|          | 0/97 [00:00<?, ?it/s, loss=5.04, v_num=0]
Epoch 10:   0%|          | 0/97 [00:00<?, ?it/s, loss=5.04, v_num=0]
Epoch 10:   1%|          | 1/97 [00:01<02:11,  1.37s/it, loss=5.04, v_num=0]
Epoch 10:   1%|          | 1/97 [00:01<02:16,  1.43s/it, loss=5.04, v_num=0]
Epoch 10:   2%|▏         | 2/97 [00:01<01:11,  1.33it/s, loss=5.04, v_num=0]
Epoch 10:   2%|▏         | 2/97 [00:01<01:14,  1.28it/s, loss=5.03, v_num=0]
Epoch 10:   3%|▎         | 3/97 [00:01<00:51,  1.82it/s, loss=5.03, v_num=0]
Epoch 10:   3%|▎         | 3/97 [00:01<00:53,  1.76it/s, loss=5.03, v_num=0]
Epoch 10:   4%|▍         | 4/97 [00:01<00:41,  2.25it/s, loss=5.03, v_num=0]
Epoch 10:   4%|▍         | 4/97 [00:01<00:42,  2.18it/s, loss=5.03, v_num=0]
Epoch 10:   5%|▌         | 5/97 [00:01<00:35,  2.60it/s, loss=5.03, v_num=0]
Epoch 10:   5%|▌         | 5/97 [00:01<00:36,  2.53it/s, loss=5.03, v_num=0]
Epoch 10:   6%|▌         | 6/97 [00:02<00:31,  2.91it/s, loss=5.03, v_num=0]
Epoch 10:   6%|▌         | 6/97 [00:02<00:32,  2.84it/s, loss=5.04, v_num=0]
Epoch 10:   7%|▋         | 7/97 [00:02<00:28,  3.20it/s, loss=5.04, v_num=0]
Epoch 10:   7%|▋         | 7/97 [00:02<00:28,  3.11it/s, loss=5.04, v_num=0]
Epoch 10:   8%|▊         | 8/97 [00:02<00:25,  3.44it/s, loss=5.04, v_num=0]
Epoch 10:   8%|▊         | 8/97 [00:02<00:26,  3.36it/s, loss=5.03, v_num=0]
Epoch 10:   9%|▉         | 9/97 [00:02<00:24,  3.65it/s, loss=5.03, v_num=0]
Epoch 10:   9%|▉         | 9/97 [00:02<00:24,  3.57it/s, loss=5.03, v_num=0]
Epoch 10:  10%|█         | 10/97 [00:02<00:22,  3.84it/s, loss=5.03, v_num=0]
Epoch 10:  10%|█         | 10/97 [00:02<00:23,  3.76it/s, loss=5.02, v_num=0]
Epoch 10:  11%|█▏        | 11/97 [00:02<00:21,  4.01it/s, loss=5.02, v_num=0]
Epoch 10:  11%|█▏        | 11/97 [00:02<00:21,  3.93it/s, loss=5.02, v_num=0]
Epoch 10:  12%|█▏        | 12/97 [00:02<00:20,  4.17it/s, loss=5.02, v_num=0]
Epoch 10:  12%|█▏        | 12/97 [00:02<00:20,  4.09it/s, loss=5.02, v_num=0]
Epoch 10:  13%|█▎        | 13/97 [00:03<00:19,  4.32it/s, loss=5.02, v_num=0]
Epoch 10:  13%|█▎        | 13/97 [00:03<00:19,  4.24it/s, loss=5.01, v_num=0]
Epoch 10:  14%|█▍        | 14/97 [00:03<00:18,  4.45it/s, loss=5.01, v_num=0]
Epoch 10:  14%|█▍        | 14/97 [00:03<00:18,  4.37it/s, loss=5.01, v_num=0]
Epoch 10:  15%|█▌        | 15/97 [00:03<00:17,  4.57it/s, loss=5.01, v_num=0]
Epoch 10:  15%|█▌        | 15/97 [00:03<00:18,  4.49it/s, loss=5.01, v_num=0]
Epoch 10:  16%|█▋        | 16/97 [00:03<00:17,  4.68it/s, loss=5.01, v_num=0]
Epoch 10:  16%|█▋        | 16/97 [00:03<00:17,  4.60it/s, loss=5.01, v_num=0]
Epoch 10:  18%|█▊        | 17/97 [00:03<00:16,  4.77it/s, loss=5.01, v_num=0]
Epoch 10:  18%|█▊        | 17/97 [00:03<00:17,  4.70it/s, loss=5.01, v_num=0]
Epoch 10:  19%|█▊        | 18/97 [00:03<00:16,  4.87it/s, loss=5.01, v_num=0]
Epoch 10:  19%|█▊        | 18/97 [00:03<00:16,  4.80it/s, loss=5, v_num=0]
Epoch 10:  20%|█▉        | 19/97 [00:03<00:15,  4.96it/s, loss=5, v_num=0]
Epoch 10:  20%|█▉        | 19/97 [00:03<00:15,  4.89it/s, loss=5.01, v_num=0]
Epoch 10:  21%|██        | 20/97 [00:03<00:15,  5.04it/s, loss=5.01, v_num=0]
Epoch 10:  21%|██        | 20/97 [00:04<00:15,  4.97it/s, loss=5, v_num=0]
Epoch 10:  22%|██▏       | 21/97 [00:04<00:14,  5.12it/s, loss=5, v_num=0]
Epoch 10:  22%|██▏       | 21/97 [00:04<00:15,  5.05it/s, loss=4.99, v_num=0]
Epoch 10:  23%|██▎       | 22/97 [00:04<00:14,  5.19it/s, loss=4.99, v_num=0]
Epoch 10:  23%|██▎       | 22/97 [00:04<00:14,  5.12it/s, loss=4.99, v_num=0]
Epoch 10:  24%|██▎       | 23/97 [00:04<00:14,  5.26it/s, loss=4.99, v_num=0]
Epoch 10:  24%|██▎       | 23/97 [00:04<00:14,  5.19it/s, loss=4.99, v_num=0]
Epoch 10:  25%|██▍       | 24/97 [00:04<00:13,  5.32it/s, loss=4.99, v_num=0]
Epoch 10:  25%|██▍       | 24/97 [00:04<00:13,  5.25it/s, loss=4.99, v_num=0]
Epoch 10:  26%|██▌       | 25/97 [00:04<00:13,  5.37it/s, loss=4.99, v_num=0]
Epoch 10:  26%|██▌       | 25/97 [00:04<00:13,  5.31it/s, loss=4.99, v_num=0]
Epoch 10:  27%|██▋       | 26/97 [00:04<00:13,  5.43it/s, loss=4.99, v_num=0]
Epoch 10:  27%|██▋       | 26/97 [00:04<00:13,  5.37it/s, loss=4.97, v_num=0]
Epoch 10:  28%|██▊       | 27/97 [00:04<00:12,  5.49it/s, loss=4.97, v_num=0]
Epoch 10:  28%|██▊       | 27/97 [00:04<00:12,  5.42it/s, loss=4.96, v_num=0]
Epoch 10:  29%|██▉       | 28/97 [00:05<00:12,  5.54it/s, loss=4.96, v_num=0]
Epoch 10:  29%|██▉       | 28/97 [00:05<00:12,  5.48it/s, loss=4.96, v_num=0]
Epoch 10:  30%|██▉       | 29/97 [00:05<00:12,  5.58it/s, loss=4.96, v_num=0]
Epoch 10:  30%|██▉       | 29/97 [00:05<00:12,  5.52it/s, loss=4.96, v_num=0]
Epoch 10:  31%|███       | 30/97 [00:05<00:11,  5.63it/s, loss=4.96, v_num=0]
Epoch 10:  31%|███       | 30/97 [00:05<00:12,  5.57it/s, loss=4.96, v_num=0]
Epoch 10:  32%|███▏      | 31/97 [00:05<00:11,  5.67it/s, loss=4.96, v_num=0]
Epoch 10:  32%|███▏      | 31/97 [00:05<00:11,  5.61it/s, loss=4.95, v_num=0]
Epoch 10:  33%|███▎      | 32/97 [00:05<00:11,  5.71it/s, loss=4.95, v_num=0]
Epoch 10:  33%|███▎      | 32/97 [00:05<00:11,  5.65it/s, loss=4.94, v_num=0]
Epoch 10:  34%|███▍      | 33/97 [00:05<00:11,  5.75it/s, loss=4.94, v_num=0]
Epoch 10:  34%|███▍      | 33/97 [00:05<00:11,  5.69it/s, loss=4.95, v_num=0]
Epoch 10:  35%|███▌      | 34/97 [00:05<00:10,  5.78it/s, loss=4.95, v_num=0]
Epoch 10:  35%|███▌      | 34/97 [00:05<00:10,  5.73it/s, loss=4.94, v_num=0]
Epoch 10:  36%|███▌      | 35/97 [00:06<00:10,  5.82it/s, loss=4.94, v_num=0]
Epoch 10:  36%|███▌      | 35/97 [00:06<00:10,  5.77it/s, loss=4.94, v_num=0]
Epoch 10:  37%|███▋      | 36/97 [00:06<00:10,  5.85it/s, loss=4.94, v_num=0]
Epoch 10:  37%|███▋      | 36/97 [00:06<00:10,  5.80it/s, loss=4.94, v_num=0]
Epoch 10:  38%|███▊      | 37/97 [00:06<00:10,  5.89it/s, loss=4.94, v_num=0]
Epoch 10:  38%|███▊      | 37/97 [00:06<00:10,  5.83it/s, loss=4.94, v_num=0]
Epoch 10:  39%|███▉      | 38/97 [00:06<00:09,  5.91it/s, loss=4.94, v_num=0]
Epoch 10:  39%|███▉      | 38/97 [00:06<00:10,  5.86it/s, loss=4.94, v_num=0]
Epoch 10:  40%|████      | 39/97 [00:06<00:09,  5.95it/s, loss=4.94, v_num=0]
Epoch 10:  40%|████      | 39/97 [00:06<00:09,  5.89it/s, loss=4.93, v_num=0]
Epoch 10:  41%|████      | 40/97 [00:06<00:09,  5.97it/s, loss=4.93, v_num=0]
Epoch 10:  41%|████      | 40/97 [00:06<00:09,  5.92it/s, loss=4.94, v_num=0]
Epoch 10:  42%|████▏     | 41/97 [00:06<00:09,  6.00it/s, loss=4.94, v_num=0]
Epoch 10:  42%|████▏     | 41/97 [00:06<00:09,  5.95it/s, loss=4.94, v_num=0]
Epoch 10:  43%|████▎     | 42/97 [00:06<00:09,  6.02it/s, loss=4.94, v_num=0]
Epoch 10:  43%|████▎     | 42/97 [00:07<00:09,  5.98it/s, loss=4.94, v_num=0]
Epoch 10:  44%|████▍     | 43/97 [00:07<00:08,  6.05it/s, loss=4.94, v_num=0]
Epoch 10:  44%|████▍     | 43/97 [00:07<00:08,  6.00it/s, loss=4.93, v_num=0]
Epoch 10:  45%|████▌     | 44/97 [00:07<00:08,  6.07it/s, loss=4.93, v_num=0]
Epoch 10:  45%|████▌     | 44/97 [00:07<00:08,  6.03it/s, loss=4.93, v_num=0]
Epoch 10:  46%|████▋     | 45/97 [00:07<00:08,  6.09it/s, loss=4.93, v_num=0]
Epoch 10:  46%|████▋     | 45/97 [00:07<00:08,  6.05it/s, loss=4.92, v_num=0]
Epoch 10:  47%|████▋     | 46/97 [00:07<00:08,  6.12it/s, loss=4.92, v_num=0]
Epoch 10:  47%|████▋     | 46/97 [00:07<00:08,  6.07it/s, loss=4.92, v_num=0]
Epoch 10:  48%|████▊     | 47/97 [00:07<00:08,  6.13it/s, loss=4.92, v_num=0]
Epoch 10:  48%|████▊     | 47/97 [00:07<00:08,  6.09it/s, loss=4.94, v_num=0]
Epoch 10:  49%|████▉     | 48/97 [00:07<00:07,  6.15it/s, loss=4.94, v_num=0]
Epoch 10:  49%|████▉     | 48/97 [00:07<00:08,  6.11it/s, loss=4.94, v_num=0]
Epoch 10:  51%|█████     | 49/97 [00:07<00:07,  6.17it/s, loss=4.94, v_num=0]
Epoch 10:  51%|█████     | 49/97 [00:07<00:07,  6.13it/s, loss=4.94, v_num=0]
Epoch 10:  52%|█████▏    | 50/97 [00:08<00:07,  6.19it/s, loss=4.94, v_num=0]
Epoch 10:  52%|█████▏    | 50/97 [00:08<00:07,  6.15it/s, loss=4.95, v_num=0]
Epoch 10:  53%|█████▎    | 51/97 [00:08<00:07,  6.21it/s, loss=4.95, v_num=0]
Epoch 10:  53%|█████▎    | 51/97 [00:08<00:07,  6.16it/s, loss=4.94, v_num=0]
Epoch 10:  54%|█████▎    | 52/97 [00:08<00:07,  6.22it/s, loss=4.94, v_num=0]
Epoch 10:  54%|█████▎    | 52/97 [00:08<00:07,  6.18it/s, loss=4.94, v_num=0]
Epoch 10:  55%|█████▍    | 53/97 [00:08<00:07,  6.24it/s, loss=4.94, v_num=0]
Epoch 10:  55%|█████▍    | 53/97 [00:08<00:07,  6.20it/s, loss=4.94, v_num=0]
Epoch 10:  56%|█████▌    | 54/97 [00:08<00:06,  6.25it/s, loss=4.94, v_num=0]
Epoch 10:  56%|█████▌    | 54/97 [00:08<00:06,  6.22it/s, loss=4.94, v_num=0]
Epoch 10:  57%|█████▋    | 55/97 [00:08<00:06,  6.27it/s, loss=4.94, v_num=0]
Epoch 10:  57%|█████▋    | 55/97 [00:08<00:06,  6.23it/s, loss=4.93, v_num=0]
Epoch 10:  58%|█████▊    | 56/97 [00:08<00:06,  6.29it/s, loss=4.93, v_num=0]
Epoch 10:  58%|█████▊    | 56/97 [00:08<00:06,  6.25it/s, loss=4.93, v_num=0]
Epoch 10:  59%|█████▉    | 57/97 [00:09<00:06,  6.31it/s, loss=4.93, v_num=0]
Epoch 10:  59%|█████▉    | 57/97 [00:09<00:06,  6.27it/s, loss=4.93, v_num=0]
Epoch 10:  60%|█████▉    | 58/97 [00:09<00:06,  6.32it/s, loss=4.93, v_num=0]
Epoch 10:  60%|█████▉    | 58/97 [00:09<00:06,  6.28it/s, loss=4.93, v_num=0]
Epoch 10:  61%|██████    | 59/97 [00:09<00:05,  6.34it/s, loss=4.93, v_num=0]
Epoch 10:  61%|██████    | 59/97 [00:09<00:06,  6.30it/s, loss=4.93, v_num=0]
Epoch 10:  62%|██████▏   | 60/97 [00:09<00:05,  6.35it/s, loss=4.93, v_num=0]
Epoch 10:  62%|██████▏   | 60/97 [00:09<00:05,  6.31it/s, loss=4.93, v_num=0]
Epoch 10:  63%|██████▎   | 61/97 [00:09<00:05,  6.36it/s, loss=4.93, v_num=0]
Epoch 10:  63%|██████▎   | 61/97 [00:09<00:05,  6.32it/s, loss=4.92, v_num=0]
Epoch 10:  64%|██████▍   | 62/97 [00:09<00:05,  6.37it/s, loss=4.92, v_num=0]
Epoch 10:  64%|██████▍   | 62/97 [00:09<00:05,  6.33it/s, loss=4.91, v_num=0]
Epoch 10:  65%|██████▍   | 63/97 [00:09<00:05,  6.38it/s, loss=4.91, v_num=0]
Epoch 10:  65%|██████▍   | 63/97 [00:09<00:05,  6.35it/s, loss=4.91, v_num=0]
Epoch 10:  66%|██████▌   | 64/97 [00:10<00:05,  6.40it/s, loss=4.91, v_num=0]
Epoch 10:  66%|██████▌   | 64/97 [00:10<00:05,  6.36it/s, loss=4.91, v_num=0]
Epoch 10:  67%|██████▋   | 65/97 [00:10<00:04,  6.41it/s, loss=4.91, v_num=0]
Epoch 10:  67%|██████▋   | 65/97 [00:10<00:05,  6.37it/s, loss=4.9, v_num=0]
Epoch 10:  68%|██████▊   | 66/97 [00:10<00:04,  6.42it/s, loss=4.9, v_num=0]
Epoch 10:  68%|██████▊   | 66/97 [00:10<00:04,  6.39it/s, loss=4.9, v_num=0]
Epoch 10:  69%|██████▉   | 67/97 [00:10<00:04,  6.43it/s, loss=4.9, v_num=0]
Epoch 10:  69%|██████▉   | 67/97 [00:10<00:04,  6.40it/s, loss=4.9, v_num=0]
Epoch 10:  70%|███████   | 68/97 [00:10<00:04,  6.45it/s, loss=4.9, v_num=0]
Epoch 10:  70%|███████   | 68/97 [00:10<00:04,  6.41it/s, loss=4.89, v_num=0]
Epoch 10:  71%|███████   | 69/97 [00:10<00:04,  6.45it/s, loss=4.89, v_num=0]
Epoch 10:  71%|███████   | 69/97 [00:10<00:04,  6.42it/s, loss=4.88, v_num=0]
Epoch 10:  72%|███████▏  | 70/97 [00:10<00:04,  6.47it/s, loss=4.88, v_num=0]
Epoch 10:  72%|███████▏  | 70/97 [00:10<00:04,  6.43it/s, loss=4.87, v_num=0]
Epoch 10:  73%|███████▎  | 71/97 [00:10<00:04,  6.48it/s, loss=4.87, v_num=0]
Epoch 10:  73%|███████▎  | 71/97 [00:11<00:04,  6.44it/s, loss=4.87, v_num=0]
Epoch 10:  74%|███████▍  | 72/97 [00:11<00:03,  6.49it/s, loss=4.87, v_num=0]
Epoch 10:  74%|███████▍  | 72/97 [00:11<00:03,  6.45it/s, loss=4.87, v_num=0]
Epoch 10:  75%|███████▌  | 73/97 [00:11<00:03,  6.50it/s, loss=4.87, v_num=0]
Epoch 10:  75%|███████▌  | 73/97 [00:11<00:03,  6.46it/s, loss=4.88, v_num=0]
Epoch 10:  76%|███████▋  | 74/97 [00:11<00:03,  6.51it/s, loss=4.88, v_num=0]
Epoch 10:  76%|███████▋  | 74/97 [00:11<00:03,  6.47it/s, loss=4.87, v_num=0]
Epoch 10:  77%|███████▋  | 75/97 [00:11<00:03,  6.51it/s, loss=4.87, v_num=0]
Epoch 10:  77%|███████▋  | 75/97 [00:11<00:03,  6.48it/s, loss=4.88, v_num=0]
Epoch 10:  78%|███████▊  | 76/97 [00:11<00:03,  6.52it/s, loss=4.88, v_num=0]
Epoch 10:  78%|███████▊  | 76/97 [00:11<00:03,  6.49it/s, loss=4.87, v_num=0]
Epoch 10:  79%|███████▉  | 77/97 [00:11<00:03,  6.53it/s, loss=4.87, v_num=0]
Epoch 10:  79%|███████▉  | 77/97 [00:11<00:03,  6.50it/s, loss=4.87, v_num=0]
Epoch 10:  80%|████████  | 78/97 [00:11<00:02,  6.54it/s, loss=4.87, v_num=0]
Epoch 10:  80%|████████  | 78/97 [00:11<00:02,  6.51it/s, loss=4.87, v_num=0]
Epoch 10:  81%|████████▏ | 79/97 [00:12<00:02,  6.55it/s, loss=4.87, v_num=0]
Epoch 10:  81%|████████▏ | 79/97 [00:12<00:02,  6.52it/s, loss=4.86, v_num=0]
Epoch 10:  82%|████████▏ | 80/97 [00:12<00:02,  6.56it/s, loss=4.86, v_num=0]
Epoch 10:  82%|████████▏ | 80/97 [00:12<00:02,  6.53it/s, loss=4.86, v_num=0]
Epoch 10:  84%|████████▎ | 81/97 [00:12<00:02,  6.57it/s, loss=4.86, v_num=0]
Epoch 10:  84%|████████▎ | 81/97 [00:12<00:02,  6.54it/s, loss=4.87, v_num=0]
Epoch 10:  85%|████████▍ | 82/97 [00:12<00:02,  6.57it/s, loss=4.87, v_num=0]
Epoch 10:  85%|████████▍ | 82/97 [00:12<00:02,  6.55it/s, loss=4.87, v_num=0]
Epoch 10:  86%|████████▌ | 83/97 [00:12<00:02,  6.58it/s, loss=4.87, v_num=0]
Epoch 10:  86%|████████▌ | 83/97 [00:12<00:02,  6.55it/s, loss=4.89, v_num=0]
Epoch 10:  87%|████████▋ | 84/97 [00:12<00:01,  6.59it/s, loss=4.89, v_num=0]
Epoch 10:  87%|████████▋ | 84/97 [00:12<00:01,  6.56it/s, loss=4.88, v_num=0]
Epoch 10:  88%|████████▊ | 85/97 [00:12<00:01,  6.60it/s, loss=4.88, v_num=0]
Epoch 10:  88%|████████▊ | 85/97 [00:12<00:01,  6.57it/s, loss=4.88, v_num=0]
Epoch 10:  89%|████████▊ | 86/97 [00:13<00:01,  6.61it/s, loss=4.88, v_num=0]
Epoch 10:  89%|████████▊ | 86/97 [00:13<00:01,  6.58it/s, loss=4.88, v_num=0]
Epoch 10:  90%|████████▉ | 87/97 [00:13<00:01,  6.61it/s, loss=4.88, v_num=0]
Epoch 10:  90%|████████▉ | 87/97 [00:13<00:01,  6.59it/s, loss=4.88, v_num=0]
Epoch 10:  91%|█████████ | 88/97 [00:13<00:01,  6.62it/s, loss=4.88, v_num=0]
Epoch 10:  91%|█████████ | 88/97 [00:13<00:01,  6.59it/s, loss=4.88, v_num=0]
Epoch 10:  92%|█████████▏| 89/97 [00:13<00:01,  6.63it/s, loss=4.88, v_num=0]
Epoch 10:  92%|█████████▏| 89/97 [00:13<00:01,  6.60it/s, loss=4.88, v_num=0]
Epoch 10:  93%|█████████▎| 90/97 [00:13<00:01,  6.64it/s, loss=4.88, v_num=0]
Epoch 10:  93%|█████████▎| 90/97 [00:13<00:01,  6.61it/s, loss=4.87, v_num=0]
Epoch 10:  94%|█████████▍| 91/97 [00:13<00:00,  6.64it/s, loss=4.87, v_num=0]
Epoch 10:  94%|█████████▍| 91/97 [00:13<00:00,  6.62it/s, loss=4.88, v_num=0]
Epoch 10:  95%|█████████▍| 92/97 [00:13<00:00,  6.65it/s, loss=4.88, v_num=0]
Epoch 10:  95%|█████████▍| 92/97 [00:13<00:00,  6.62it/s, loss=4.89, v_num=0]
Epoch 10:  96%|█████████▌| 93/97 [00:13<00:00,  6.66it/s, loss=4.89, v_num=0]
Epoch 10:  96%|█████████▌| 93/97 [00:14<00:00,  6.63it/s, loss=4.88, v_num=0]
Epoch 10:  97%|█████████▋| 94/97 [00:14<00:00,  6.66it/s, loss=4.88, v_num=0]
Epoch 10:  97%|█████████▋| 94/97 [00:14<00:00,  6.64it/s, loss=4.88, v_num=0]
Epoch 10:  98%|█████████▊| 95/97 [00:14<00:00,  6.67it/s, loss=4.88, v_num=0]
Epoch 10:  98%|█████████▊| 95/97 [00:14<00:00,  6.64it/s, loss=4.87, v_num=0]
Epoch 10:  99%|█████████▉| 96/97 [00:14<00:00,  6.68it/s, loss=4.87, v_num=0]
Epoch 10:  99%|█████████▉| 96/97 [00:14<00:00,  6.65it/s, loss=4.88, v_num=0]
Epoch 10: 100%|██████████| 97/97 [00:14<00:00,  6.68it/s, loss=4.88, v_num=0]
Epoch 10: 100%|██████████| 97/97 [00:14<00:00,  6.66it/s, loss=4.88, v_num=0]
Epoch 10: 100%|██████████| 97/97 [00:14<00:00,  6.66it/s, loss=4.88, v_num=0]
Epoch 10:   0%|          | 0/97 [00:00<?, ?it/s, loss=4.88, v_num=0]
Epoch 11:   0%|          | 0/97 [00:00<?, ?it/s, loss=4.88, v_num=0]
Epoch 11:   1%|          | 1/97 [00:01<02:14,  1.40s/it, loss=4.88, v_num=0]
Epoch 11:   1%|          | 1/97 [00:01<02:19,  1.46s/it, loss=4.88, v_num=0]
Epoch 11:   2%|▏         | 2/97 [00:01<01:12,  1.30it/s, loss=4.88, v_num=0]
Epoch 11:   2%|▏         | 2/97 [00:01<01:15,  1.26it/s, loss=4.88, v_num=0]
Epoch 11:   3%|▎         | 3/97 [00:01<00:52,  1.79it/s, loss=4.88, v_num=0]
Epoch 11:   3%|▎         | 3/97 [00:01<00:54,  1.73it/s, loss=4.88, v_num=0]
Epoch 11:   4%|▍         | 4/97 [00:01<00:42,  2.21it/s, loss=4.88, v_num=0]
Epoch 11:   4%|▍         | 4/97 [00:01<00:43,  2.14it/s, loss=4.87, v_num=0]
Epoch 11:   5%|▌         | 5/97 [00:01<00:35,  2.56it/s, loss=4.87, v_num=0]
Epoch 11:   5%|▌         | 5/97 [00:02<00:36,  2.49it/s, loss=4.86, v_num=0]
Epoch 11:   6%|▌         | 6/97 [00:02<00:31,  2.87it/s, loss=4.86, v_num=0]
Epoch 11:   6%|▌         | 6/97 [00:02<00:32,  2.80it/s, loss=4.85, v_num=0]
Epoch 11:   7%|▋         | 7/97 [00:02<00:28,  3.15it/s, loss=4.85, v_num=0]
Epoch 11:   7%|▋         | 7/97 [00:02<00:29,  3.07it/s, loss=4.86, v_num=0]
Epoch 11:   8%|▊         | 8/97 [00:02<00:26,  3.40it/s, loss=4.86, v_num=0]
Epoch 11:   8%|▊         | 8/97 [00:02<00:26,  3.31it/s, loss=4.86, v_num=0]
Epoch 11:   9%|▉         | 9/97 [00:02<00:24,  3.60it/s, loss=4.86, v_num=0]
Epoch 11:   9%|▉         | 9/97 [00:02<00:25,  3.52it/s, loss=4.86, v_num=0]
Epoch 11:  10%|█         | 10/97 [00:02<00:22,  3.79it/s, loss=4.86, v_num=0]
Epoch 11:  10%|█         | 10/97 [00:02<00:23,  3.71it/s, loss=4.85, v_num=0]
Epoch 11:  11%|█▏        | 11/97 [00:02<00:21,  3.97it/s, loss=4.85, v_num=0]
Epoch 11:  11%|█▏        | 11/97 [00:02<00:22,  3.89it/s, loss=4.84, v_num=0]
Epoch 11:  12%|█▏        | 12/97 [00:02<00:20,  4.12it/s, loss=4.84, v_num=0]
Epoch 11:  12%|█▏        | 12/97 [00:02<00:21,  4.05it/s, loss=4.85, v_num=0]
Epoch 11:  13%|█▎        | 13/97 [00:03<00:19,  4.27it/s, loss=4.85, v_num=0]
Epoch 11:  13%|█▎        | 13/97 [00:03<00:20,  4.19it/s, loss=4.85, v_num=0]
Epoch 11:  14%|█▍        | 14/97 [00:03<00:18,  4.40it/s, loss=4.85, v_num=0]
Epoch 11:  14%|█▍        | 14/97 [00:03<00:19,  4.32it/s, loss=4.84, v_num=0]
Epoch 11:  15%|█▌        | 15/97 [00:03<00:18,  4.53it/s, loss=4.84, v_num=0]
Epoch 11:  15%|█▌        | 15/97 [00:03<00:18,  4.45it/s, loss=4.83, v_num=0]
Epoch 11:  16%|█▋        | 16/97 [00:03<00:17,  4.64it/s, loss=4.83, v_num=0]
Epoch 11:  16%|█▋        | 16/97 [00:03<00:17,  4.56it/s, loss=4.83, v_num=0]
Epoch 11:  18%|█▊        | 17/97 [00:03<00:16,  4.73it/s, loss=4.83, v_num=0]
Epoch 11:  18%|█▊        | 17/97 [00:03<00:17,  4.66it/s, loss=4.82, v_num=0]
Epoch 11:  19%|█▊        | 18/97 [00:03<00:16,  4.83it/s, loss=4.82, v_num=0]
Epoch 11:  19%|█▊        | 18/97 [00:03<00:16,  4.76it/s, loss=4.82, v_num=0]
Epoch 11:  20%|█▉        | 19/97 [00:03<00:15,  4.92it/s, loss=4.82, v_num=0]
Epoch 11:  20%|█▉        | 19/97 [00:03<00:16,  4.85it/s, loss=4.81, v_num=0]
Epoch 11:  21%|██        | 20/97 [00:03<00:15,  5.00it/s, loss=4.81, v_num=0]
Epoch 11:  21%|██        | 20/97 [00:04<00:15,  4.93it/s, loss=4.81, v_num=0]
Epoch 11:  22%|██▏       | 21/97 [00:04<00:14,  5.08it/s, loss=4.81, v_num=0]
Epoch 11:  22%|██▏       | 21/97 [00:04<00:15,  5.01it/s, loss=4.8, v_num=0]
Epoch 11:  23%|██▎       | 22/97 [00:04<00:14,  5.15it/s, loss=4.8, v_num=0]
Epoch 11:  23%|██▎       | 22/97 [00:04<00:14,  5.08it/s, loss=4.79, v_num=0]
Epoch 11:  24%|██▎       | 23/97 [00:04<00:14,  5.20it/s, loss=4.79, v_num=0]
Epoch 11:  24%|██▎       | 23/97 [00:04<00:14,  5.14it/s, loss=4.79, v_num=0]
Epoch 11:  25%|██▍       | 24/97 [00:04<00:13,  5.27it/s, loss=4.79, v_num=0]
Epoch 11:  25%|██▍       | 24/97 [00:04<00:14,  5.21it/s, loss=4.78, v_num=0]
Epoch 11:  26%|██▌       | 25/97 [00:04<00:13,  5.33it/s, loss=4.78, v_num=0]
Epoch 11:  26%|██▌       | 25/97 [00:04<00:13,  5.27it/s, loss=4.77, v_num=0]
Epoch 11:  27%|██▋       | 26/97 [00:04<00:13,  5.39it/s, loss=4.77, v_num=0]
Epoch 11:  27%|██▋       | 26/97 [00:04<00:13,  5.33it/s, loss=4.78, v_num=0]
Epoch 11:  28%|██▊       | 27/97 [00:04<00:12,  5.44it/s, loss=4.78, v_num=0]
Epoch 11:  28%|██▊       | 27/97 [00:05<00:13,  5.38it/s, loss=4.77, v_num=0]
Epoch 11:  29%|██▉       | 28/97 [00:05<00:12,  5.50it/s, loss=4.77, v_num=0]
Epoch 11:  29%|██▉       | 28/97 [00:05<00:12,  5.43it/s, loss=4.76, v_num=0]
Epoch 11:  30%|██▉       | 29/97 [00:05<00:12,  5.54it/s, loss=4.76, v_num=0]
Epoch 11:  30%|██▉       | 29/97 [00:05<00:12,  5.48it/s, loss=4.75, v_num=0]
Epoch 11:  31%|███       | 30/97 [00:05<00:11,  5.59it/s, loss=4.75, v_num=0]
Epoch 11:  31%|███       | 30/97 [00:05<00:12,  5.53it/s, loss=4.75, v_num=0]
Epoch 11:  32%|███▏      | 31/97 [00:05<00:11,  5.63it/s, loss=4.75, v_num=0]
Epoch 11:  32%|███▏      | 31/97 [00:05<00:11,  5.57it/s, loss=4.75, v_num=0]
Epoch 11:  33%|███▎      | 32/97 [00:05<00:11,  5.67it/s, loss=4.75, v_num=0]
Epoch 11:  33%|███▎      | 32/97 [00:05<00:11,  5.61it/s, loss=4.75, v_num=0]
Epoch 11:  34%|███▍      | 33/97 [00:05<00:11,  5.71it/s, loss=4.75, v_num=0]
Epoch 11:  34%|███▍      | 33/97 [00:05<00:11,  5.66it/s, loss=4.74, v_num=0]
Epoch 11:  35%|███▌      | 34/97 [00:05<00:10,  5.75it/s, loss=4.74, v_num=0]
Epoch 11:  35%|███▌      | 34/97 [00:05<00:11,  5.69it/s, loss=4.75, v_num=0]
Epoch 11:  36%|███▌      | 35/97 [00:06<00:10,  5.78it/s, loss=4.75, v_num=0]
Epoch 11:  36%|███▌      | 35/97 [00:06<00:10,  5.73it/s, loss=4.74, v_num=0]
Epoch 11:  37%|███▋      | 36/97 [00:06<00:10,  5.82it/s, loss=4.74, v_num=0]
Epoch 11:  37%|███▋      | 36/97 [00:06<00:10,  5.77it/s, loss=4.74, v_num=0]
Epoch 11:  38%|███▊      | 37/97 [00:06<00:10,  5.85it/s, loss=4.74, v_num=0]
Epoch 11:  38%|███▊      | 37/97 [00:06<00:10,  5.80it/s, loss=4.75, v_num=0]
Epoch 11:  39%|███▉      | 38/97 [00:06<00:10,  5.88it/s, loss=4.75, v_num=0]
Epoch 11:  39%|███▉      | 38/97 [00:06<00:10,  5.83it/s, loss=4.75, v_num=0]
Epoch 11:  40%|████      | 39/97 [00:06<00:09,  5.91it/s, loss=4.75, v_num=0]
Epoch 11:  40%|████      | 39/97 [00:06<00:09,  5.86it/s, loss=4.75, v_num=0]
Epoch 11:  41%|████      | 40/97 [00:06<00:09,  5.94it/s, loss=4.75, v_num=0]
Epoch 11:  41%|████      | 40/97 [00:06<00:09,  5.89it/s, loss=4.75, v_num=0]
Epoch 11:  42%|████▏     | 41/97 [00:06<00:09,  5.97it/s, loss=4.75, v_num=0]
Epoch 11:  42%|████▏     | 41/97 [00:06<00:09,  5.92it/s, loss=4.74, v_num=0]
Epoch 11:  43%|████▎     | 42/97 [00:07<00:09,  5.99it/s, loss=4.74, v_num=0]
Epoch 11:  43%|████▎     | 42/97 [00:07<00:09,  5.95it/s, loss=4.75, v_num=0]
Epoch 11:  44%|████▍     | 43/97 [00:07<00:08,  6.02it/s, loss=4.75, v_num=0]
Epoch 11:  44%|████▍     | 43/97 [00:07<00:09,  5.97it/s, loss=4.75, v_num=0]
Epoch 11:  45%|████▌     | 44/97 [00:07<00:08,  6.05it/s, loss=4.75, v_num=0]
Epoch 11:  45%|████▌     | 44/97 [00:07<00:08,  6.00it/s, loss=4.75, v_num=0]
Epoch 11:  46%|████▋     | 45/97 [00:07<00:08,  6.07it/s, loss=4.75, v_num=0]
Epoch 11:  46%|████▋     | 45/97 [00:07<00:08,  6.02it/s, loss=4.75, v_num=0]
Epoch 11:  47%|████▋     | 46/97 [00:07<00:08,  6.09it/s, loss=4.75, v_num=0]
Epoch 11:  47%|████▋     | 46/97 [00:07<00:08,  6.05it/s, loss=4.75, v_num=0]
Epoch 11:  48%|████▊     | 47/97 [00:07<00:08,  6.11it/s, loss=4.75, v_num=0]
Epoch 11:  48%|████▊     | 47/97 [00:07<00:08,  6.07it/s, loss=4.75, v_num=0]
Epoch 11:  49%|████▉     | 48/97 [00:07<00:07,  6.13it/s, loss=4.75, v_num=0]
Epoch 11:  49%|████▉     | 48/97 [00:07<00:08,  6.09it/s, loss=4.76, v_num=0]
Epoch 11:  51%|█████     | 49/97 [00:07<00:07,  6.16it/s, loss=4.76, v_num=0]
Epoch 11:  51%|█████     | 49/97 [00:08<00:07,  6.11it/s, loss=4.75, v_num=0]
Epoch 11:  52%|█████▏    | 50/97 [00:08<00:07,  6.17it/s, loss=4.75, v_num=0]
Epoch 11:  52%|█████▏    | 50/97 [00:08<00:07,  6.13it/s, loss=4.74, v_num=0]
Epoch 11:  53%|█████▎    | 51/97 [00:08<00:07,  6.19it/s, loss=4.74, v_num=0]
Epoch 11:  53%|█████▎    | 51/97 [00:08<00:07,  6.15it/s, loss=4.75, v_num=0]
Epoch 11:  54%|█████▎    | 52/97 [00:08<00:07,  6.21it/s, loss=4.75, v_num=0]
Epoch 11:  54%|█████▎    | 52/97 [00:08<00:07,  6.17it/s, loss=4.74, v_num=0]
Epoch 11:  55%|█████▍    | 53/97 [00:08<00:07,  6.23it/s, loss=4.74, v_num=0]
Epoch 11:  55%|█████▍    | 53/97 [00:08<00:07,  6.19it/s, loss=4.76, v_num=0]
Epoch 11:  56%|█████▌    | 54/97 [00:08<00:06,  6.24it/s, loss=4.76, v_num=0]
Epoch 11:  56%|█████▌    | 54/97 [00:08<00:06,  6.20it/s, loss=4.75, v_num=0]
Epoch 11:  57%|█████▋    | 55/97 [00:08<00:06,  6.26it/s, loss=4.75, v_num=0]
Epoch 11:  57%|█████▋    | 55/97 [00:08<00:06,  6.22it/s, loss=4.75, v_num=0]
Epoch 11:  58%|█████▊    | 56/97 [00:08<00:06,  6.28it/s, loss=4.75, v_num=0]
Epoch 11:  58%|█████▊    | 56/97 [00:08<00:06,  6.24it/s, loss=4.75, v_num=0]
Epoch 11:  59%|█████▉    | 57/97 [00:09<00:06,  6.29it/s, loss=4.75, v_num=0]
Epoch 11:  59%|█████▉    | 57/97 [00:09<00:06,  6.25it/s, loss=4.74, v_num=0]
Epoch 11:  60%|█████▉    | 58/97 [00:09<00:06,  6.30it/s, loss=4.74, v_num=0]
Epoch 11:  60%|█████▉    | 58/97 [00:09<00:06,  6.27it/s, loss=4.73, v_num=0]
Epoch 11:  61%|██████    | 59/97 [00:09<00:06,  6.32it/s, loss=4.73, v_num=0]
Epoch 11:  61%|██████    | 59/97 [00:09<00:06,  6.28it/s, loss=4.72, v_num=0]
Epoch 11:  62%|██████▏   | 60/97 [00:09<00:05,  6.34it/s, loss=4.72, v_num=0]
Epoch 11:  62%|██████▏   | 60/97 [00:09<00:05,  6.30it/s, loss=4.72, v_num=0]
Epoch 11:  63%|██████▎   | 61/97 [00:09<00:05,  6.34it/s, loss=4.72, v_num=0]
Epoch 11:  63%|██████▎   | 61/97 [00:09<00:05,  6.31it/s, loss=4.72, v_num=0]
Epoch 11:  64%|██████▍   | 62/97 [00:09<00:05,  6.36it/s, loss=4.72, v_num=0]
Epoch 11:  64%|██████▍   | 62/97 [00:09<00:05,  6.32it/s, loss=4.71, v_num=0]
Epoch 11:  65%|██████▍   | 63/97 [00:09<00:05,  6.37it/s, loss=4.71, v_num=0]
Epoch 11:  65%|██████▍   | 63/97 [00:09<00:05,  6.34it/s, loss=4.71, v_num=0]
Epoch 11:  66%|██████▌   | 64/97 [00:10<00:05,  6.38it/s, loss=4.71, v_num=0]
Epoch 11:  66%|██████▌   | 64/97 [00:10<00:05,  6.35it/s, loss=4.72, v_num=0]
Epoch 11:  67%|██████▋   | 65/97 [00:10<00:05,  6.40it/s, loss=4.72, v_num=0]
Epoch 11:  67%|██████▋   | 65/97 [00:10<00:05,  6.36it/s, loss=4.72, v_num=0]
Epoch 11:  68%|██████▊   | 66/97 [00:10<00:04,  6.41it/s, loss=4.72, v_num=0]
Epoch 11:  68%|██████▊   | 66/97 [00:10<00:04,  6.37it/s, loss=4.71, v_num=0]
Epoch 11:  69%|██████▉   | 67/97 [00:10<00:04,  6.42it/s, loss=4.71, v_num=0]
Epoch 11:  69%|██████▉   | 67/97 [00:10<00:04,  6.39it/s, loss=4.71, v_num=0]
Epoch 11:  70%|███████   | 68/97 [00:10<00:04,  6.43it/s, loss=4.71, v_num=0]
Epoch 11:  70%|███████   | 68/97 [00:10<00:04,  6.40it/s, loss=4.71, v_num=0]
Epoch 11:  71%|███████   | 69/97 [00:10<00:04,  6.44it/s, loss=4.71, v_num=0]
Epoch 11:  71%|███████   | 69/97 [00:10<00:04,  6.41it/s, loss=4.71, v_num=0]
Epoch 11:  72%|███████▏  | 70/97 [00:10<00:04,  6.45it/s, loss=4.71, v_num=0]
Epoch 11:  72%|███████▏  | 70/97 [00:10<00:04,  6.42it/s, loss=4.71, v_num=0]
Epoch 11:  73%|███████▎  | 71/97 [00:10<00:04,  6.46it/s, loss=4.71, v_num=0]
Epoch 11:  73%|███████▎  | 71/97 [00:11<00:04,  6.43it/s, loss=4.71, v_num=0]
Epoch 11:  74%|███████▍  | 72/97 [00:11<00:03,  6.48it/s, loss=4.71, v_num=0]
Epoch 11:  74%|███████▍  | 72/97 [00:11<00:03,  6.44it/s, loss=4.71, v_num=0]
Epoch 11:  75%|███████▌  | 73/97 [00:11<00:03,  6.49it/s, loss=4.71, v_num=0]
Epoch 11:  75%|███████▌  | 73/97 [00:11<00:03,  6.45it/s, loss=4.7, v_num=0]
Epoch 11:  76%|███████▋  | 74/97 [00:11<00:03,  6.50it/s, loss=4.7, v_num=0]
Epoch 11:  76%|███████▋  | 74/97 [00:11<00:03,  6.46it/s, loss=4.69, v_num=0]
Epoch 11:  77%|███████▋  | 75/97 [00:11<00:03,  6.50it/s, loss=4.69, v_num=0]
Epoch 11:  77%|███████▋  | 75/97 [00:11<00:03,  6.47it/s, loss=4.69, v_num=0]
Epoch 11:  78%|███████▊  | 76/97 [00:11<00:03,  6.51it/s, loss=4.69, v_num=0]
Epoch 11:  78%|███████▊  | 76/97 [00:11<00:03,  6.48it/s, loss=4.69, v_num=0]
Epoch 11:  79%|███████▉  | 77/97 [00:11<00:03,  6.53it/s, loss=4.69, v_num=0]
Epoch 11:  79%|███████▉  | 77/97 [00:11<00:03,  6.49it/s, loss=4.68, v_num=0]
Epoch 11:  80%|████████  | 78/97 [00:11<00:02,  6.53it/s, loss=4.68, v_num=0]
Epoch 11:  80%|████████  | 78/97 [00:11<00:02,  6.50it/s, loss=4.69, v_num=0]
Epoch 11:  81%|████████▏ | 79/97 [00:12<00:02,  6.54it/s, loss=4.69, v_num=0]
Epoch 11:  81%|████████▏ | 79/97 [00:12<00:02,  6.51it/s, loss=4.69, v_num=0]
Epoch 11:  82%|████████▏ | 80/97 [00:12<00:02,  6.55it/s, loss=4.69, v_num=0]
Epoch 11:  82%|████████▏ | 80/97 [00:12<00:02,  6.52it/s, loss=4.69, v_num=0]
Epoch 11:  84%|████████▎ | 81/97 [00:12<00:02,  6.56it/s, loss=4.69, v_num=0]
Epoch 11:  84%|████████▎ | 81/97 [00:12<00:02,  6.53it/s, loss=4.69, v_num=0]
Epoch 11:  85%|████████▍ | 82/97 [00:12<00:02,  6.56it/s, loss=4.69, v_num=0]
Epoch 11:  85%|████████▍ | 82/97 [00:12<00:02,  6.54it/s, loss=4.69, v_num=0]
Epoch 11:  86%|████████▌ | 83/97 [00:12<00:02,  6.57it/s, loss=4.69, v_num=0]
Epoch 11:  86%|████████▌ | 83/97 [00:12<00:02,  6.54it/s, loss=4.67, v_num=0]
Epoch 11:  87%|████████▋ | 84/97 [00:12<00:01,  6.58it/s, loss=4.67, v_num=0]
Epoch 11:  87%|████████▋ | 84/97 [00:12<00:01,  6.55it/s, loss=4.67, v_num=0]
Epoch 11:  88%|████████▊ | 85/97 [00:12<00:01,  6.59it/s, loss=4.67, v_num=0]
Epoch 11:  88%|████████▊ | 85/97 [00:12<00:01,  6.56it/s, loss=4.66, v_num=0]
Epoch 11:  89%|████████▊ | 86/97 [00:13<00:01,  6.60it/s, loss=4.66, v_num=0]
Epoch 11:  89%|████████▊ | 86/97 [00:13<00:01,  6.57it/s, loss=4.65, v_num=0]
Epoch 11:  90%|████████▉ | 87/97 [00:13<00:01,  6.60it/s, loss=4.65, v_num=0]
Epoch 11:  90%|████████▉ | 87/97 [00:13<00:01,  6.57it/s, loss=4.65, v_num=0]
Epoch 11:  91%|█████████ | 88/97 [00:13<00:01,  6.61it/s, loss=4.65, v_num=0]
Epoch 11:  91%|█████████ | 88/97 [00:13<00:01,  6.58it/s, loss=4.64, v_num=0]
Epoch 11:  92%|█████████▏| 89/97 [00:13<00:01,  6.62it/s, loss=4.64, v_num=0]
Epoch 11:  92%|█████████▏| 89/97 [00:13<00:01,  6.59it/s, loss=4.65, v_num=0]
Epoch 11:  93%|█████████▎| 90/97 [00:13<00:01,  6.62it/s, loss=4.65, v_num=0]
Epoch 11:  93%|█████████▎| 90/97 [00:13<00:01,  6.60it/s, loss=4.64, v_num=0]
Epoch 11:  94%|█████████▍| 91/97 [00:13<00:00,  6.63it/s, loss=4.64, v_num=0]
Epoch 11:  94%|█████████▍| 91/97 [00:13<00:00,  6.60it/s, loss=4.64, v_num=0]
Epoch 11:  95%|█████████▍| 92/97 [00:13<00:00,  6.64it/s, loss=4.64, v_num=0]
Epoch 11:  95%|█████████▍| 92/97 [00:13<00:00,  6.61it/s, loss=4.64, v_num=0]
Epoch 11:  96%|█████████▌| 93/97 [00:13<00:00,  6.64it/s, loss=4.64, v_num=0]
Epoch 11:  96%|█████████▌| 93/97 [00:14<00:00,  6.62it/s, loss=4.63, v_num=0]
Epoch 11:  97%|█████████▋| 94/97 [00:14<00:00,  6.65it/s, loss=4.63, v_num=0]
Epoch 11:  97%|█████████▋| 94/97 [00:14<00:00,  6.63it/s, loss=4.62, v_num=0]
Epoch 11:  98%|█████████▊| 95/97 [00:14<00:00,  6.66it/s, loss=4.62, v_num=0]
Epoch 11:  98%|█████████▊| 95/97 [00:14<00:00,  6.63it/s, loss=4.62, v_num=0]
Epoch 11:  99%|█████████▉| 96/97 [00:14<00:00,  6.66it/s, loss=4.62, v_num=0]
Epoch 11:  99%|█████████▉| 96/97 [00:14<00:00,  6.64it/s, loss=4.63, v_num=0]
Epoch 11: 100%|██████████| 97/97 [00:14<00:00,  6.67it/s, loss=4.63, v_num=0]
Epoch 11: 100%|██████████| 97/97 [00:14<00:00,  6.65it/s, loss=4.64, v_num=0]
Epoch 11: 100%|██████████| 97/97 [00:14<00:00,  6.65it/s, loss=4.64, v_num=0]
Epoch 11:   0%|          | 0/97 [00:00<?, ?it/s, loss=4.64, v_num=0]
Epoch 12:   0%|          | 0/97 [00:00<?, ?it/s, loss=4.64, v_num=0]
Epoch 12:   1%|          | 1/97 [00:01<02:17,  1.44s/it, loss=4.64, v_num=0]
Epoch 12:   1%|          | 1/97 [00:01<02:23,  1.49s/it, loss=4.63, v_num=0]
Epoch 12:   2%|▏         | 2/97 [00:01<01:14,  1.27it/s, loss=4.63, v_num=0]
Epoch 12:   2%|▏         | 2/97 [00:01<01:17,  1.23it/s, loss=4.64, v_num=0]
Epoch 12:   3%|▎         | 3/97 [00:01<00:53,  1.76it/s, loss=4.64, v_num=0]
Epoch 12:   3%|▎         | 3/97 [00:01<00:55,  1.70it/s, loss=4.64, v_num=0]
Epoch 12:   4%|▍         | 4/97 [00:01<00:42,  2.17it/s, loss=4.64, v_num=0]
Epoch 12:   4%|▍         | 4/97 [00:01<00:44,  2.11it/s, loss=4.64, v_num=0]
Epoch 12:   5%|▌         | 5/97 [00:01<00:36,  2.52it/s, loss=4.64, v_num=0]
Epoch 12:   5%|▌         | 5/97 [00:02<00:37,  2.46it/s, loss=4.63, v_num=0]
Epoch 12:   6%|▌         | 6/97 [00:02<00:32,  2.83it/s, loss=4.63, v_num=0]
Epoch 12:   6%|▌         | 6/97 [00:02<00:32,  2.76it/s, loss=4.64, v_num=0]
Epoch 12:   7%|▋         | 7/97 [00:02<00:28,  3.11it/s, loss=4.64, v_num=0]
Epoch 12:   7%|▋         | 7/97 [00:02<00:29,  3.03it/s, loss=4.63, v_num=0]
Epoch 12:   8%|▊         | 8/97 [00:02<00:26,  3.35it/s, loss=4.63, v_num=0]
Epoch 12:   8%|▊         | 8/97 [00:02<00:27,  3.27it/s, loss=4.63, v_num=0]
Epoch 12:   9%|▉         | 9/97 [00:02<00:24,  3.55it/s, loss=4.63, v_num=0]
Epoch 12:   9%|▉         | 9/97 [00:02<00:25,  3.47it/s, loss=4.62, v_num=0]
Epoch 12:  10%|█         | 10/97 [00:02<00:23,  3.74it/s, loss=4.62, v_num=0]
Epoch 12:  10%|█         | 10/97 [00:02<00:23,  3.67it/s, loss=4.62, v_num=0]
Epoch 12:  11%|█▏        | 11/97 [00:02<00:21,  3.92it/s, loss=4.62, v_num=0]
Epoch 12:  11%|█▏        | 11/97 [00:02<00:22,  3.84it/s, loss=4.61, v_num=0]
Epoch 12:  12%|█▏        | 12/97 [00:02<00:20,  4.07it/s, loss=4.61, v_num=0]
Epoch 12:  12%|█▏        | 12/97 [00:03<00:21,  4.00it/s, loss=4.6, v_num=0]
Epoch 12:  13%|█▎        | 13/97 [00:03<00:19,  4.22it/s, loss=4.6, v_num=0]
Epoch 12:  13%|█▎        | 13/97 [00:03<00:20,  4.14it/s, loss=4.61, v_num=0]
Epoch 12:  14%|█▍        | 14/97 [00:03<00:19,  4.35it/s, loss=4.61, v_num=0]
Epoch 12:  14%|█▍        | 14/97 [00:03<00:19,  4.28it/s, loss=4.6, v_num=0]
Epoch 12:  15%|█▌        | 15/97 [00:03<00:18,  4.47it/s, loss=4.6, v_num=0]
Epoch 12:  15%|█▌        | 15/97 [00:03<00:18,  4.40it/s, loss=4.61, v_num=0]
Epoch 12:  16%|█▋        | 16/97 [00:03<00:17,  4.58it/s, loss=4.61, v_num=0]
Epoch 12:  16%|█▋        | 16/97 [00:03<00:17,  4.51it/s, loss=4.61, v_num=0]
Epoch 12:  18%|█▊        | 17/97 [00:03<00:17,  4.68it/s, loss=4.61, v_num=0]
Epoch 12:  18%|█▊        | 17/97 [00:03<00:17,  4.61it/s, loss=4.62, v_num=0]
Epoch 12:  19%|█▊        | 18/97 [00:03<00:16,  4.78it/s, loss=4.62, v_num=0]
Epoch 12:  19%|█▊        | 18/97 [00:03<00:16,  4.71it/s, loss=4.62, v_num=0]
Epoch 12:  20%|█▉        | 19/97 [00:03<00:16,  4.87it/s, loss=4.62, v_num=0]
Epoch 12:  20%|█▉        | 19/97 [00:03<00:16,  4.80it/s, loss=4.61, v_num=0]
Epoch 12:  21%|██        | 20/97 [00:04<00:15,  4.95it/s, loss=4.61, v_num=0]
Epoch 12:  21%|██        | 20/97 [00:04<00:15,  4.88it/s, loss=4.6, v_num=0]
Epoch 12:  22%|██▏       | 21/97 [00:04<00:15,  5.03it/s, loss=4.6, v_num=0]
Epoch 12:  22%|██▏       | 21/97 [00:04<00:15,  4.96it/s, loss=4.6, v_num=0]
Epoch 12:  23%|██▎       | 22/97 [00:04<00:14,  5.10it/s, loss=4.6, v_num=0]
Epoch 12:  23%|██▎       | 22/97 [00:04<00:14,  5.03it/s, loss=4.59, v_num=0]
Epoch 12:  24%|██▎       | 23/97 [00:04<00:14,  5.17it/s, loss=4.59, v_num=0]
Epoch 12:  24%|██▎       | 23/97 [00:04<00:14,  5.10it/s, loss=4.58, v_num=0]
Epoch 12:  25%|██▍       | 24/97 [00:04<00:13,  5.23it/s, loss=4.58, v_num=0]
Epoch 12:  25%|██▍       | 24/97 [00:04<00:14,  5.16it/s, loss=4.58, v_num=0]
Epoch 12:  26%|██▌       | 25/97 [00:04<00:13,  5.28it/s, loss=4.58, v_num=0]
Epoch 12:  26%|██▌       | 25/97 [00:04<00:13,  5.22it/s, loss=4.59, v_num=0]
Epoch 12:  27%|██▋       | 26/97 [00:04<00:13,  5.34it/s, loss=4.59, v_num=0]
Epoch 12:  27%|██▋       | 26/97 [00:04<00:13,  5.28it/s, loss=4.59, v_num=0]
Epoch 12:  28%|██▊       | 27/97 [00:05<00:12,  5.40it/s, loss=4.59, v_num=0]
Epoch 12:  28%|██▊       | 27/97 [00:05<00:13,  5.34it/s, loss=4.6, v_num=0]
Epoch 12:  29%|██▉       | 28/97 [00:05<00:12,  5.45it/s, loss=4.6, v_num=0]
Epoch 12:  29%|██▉       | 28/97 [00:05<00:12,  5.39it/s, loss=4.6, v_num=0]
Epoch 12:  30%|██▉       | 29/97 [00:05<00:12,  5.49it/s, loss=4.6, v_num=0]
Epoch 12:  30%|██▉       | 29/97 [00:05<00:12,  5.44it/s, loss=4.6, v_num=0]
Epoch 12:  31%|███       | 30/97 [00:05<00:12,  5.53it/s, loss=4.6, v_num=0]
Epoch 12:  31%|███       | 30/97 [00:05<00:12,  5.48it/s, loss=4.6, v_num=0]
Epoch 12:  32%|███▏      | 31/97 [00:05<00:11,  5.58it/s, loss=4.6, v_num=0]
Epoch 12:  32%|███▏      | 31/97 [00:05<00:11,  5.52it/s, loss=4.6, v_num=0]
Epoch 12:  33%|███▎      | 32/97 [00:05<00:11,  5.62it/s, loss=4.6, v_num=0]
Epoch 12:  33%|███▎      | 32/97 [00:05<00:11,  5.56it/s, loss=4.6, v_num=0]
Epoch 12:  34%|███▍      | 33/97 [00:05<00:11,  5.65it/s, loss=4.6, v_num=0]
Epoch 12:  34%|███▍      | 33/97 [00:05<00:11,  5.60it/s, loss=4.59, v_num=0]
Epoch 12:  35%|███▌      | 34/97 [00:05<00:11,  5.69it/s, loss=4.59, v_num=0]
Epoch 12:  35%|███▌      | 34/97 [00:06<00:11,  5.64it/s, loss=4.6, v_num=0]
Epoch 12:  36%|███▌      | 35/97 [00:06<00:10,  5.73it/s, loss=4.6, v_num=0]
Epoch 12:  36%|███▌      | 35/97 [00:06<00:10,  5.68it/s, loss=4.59, v_num=0]
Epoch 12:  37%|███▋      | 36/97 [00:06<00:10,  5.76it/s, loss=4.59, v_num=0]
Epoch 12:  37%|███▋      | 36/97 [00:06<00:10,  5.71it/s, loss=4.6, v_num=0]
Epoch 12:  38%|███▊      | 37/97 [00:06<00:10,  5.79it/s, loss=4.6, v_num=0]
Epoch 12:  38%|███▊      | 37/97 [00:06<00:10,  5.74it/s, loss=4.6, v_num=0]
Epoch 12:  39%|███▉      | 38/97 [00:06<00:10,  5.82it/s, loss=4.6, v_num=0]
Epoch 12:  39%|███▉      | 38/97 [00:06<00:10,  5.78it/s, loss=4.59, v_num=0]
Epoch 12:  40%|████      | 39/97 [00:06<00:09,  5.85it/s, loss=4.59, v_num=0]
Epoch 12:  40%|████      | 39/97 [00:06<00:09,  5.81it/s, loss=4.59, v_num=0]
Epoch 12:  41%|████      | 40/97 [00:06<00:09,  5.88it/s, loss=4.59, v_num=0]
Epoch 12:  41%|████      | 40/97 [00:06<00:09,  5.84it/s, loss=4.58, v_num=0]
Epoch 12:  42%|████▏     | 41/97 [00:06<00:09,  5.92it/s, loss=4.58, v_num=0]
Epoch 12:  42%|████▏     | 41/97 [00:06<00:09,  5.87it/s, loss=4.57, v_num=0]
Epoch 12:  43%|████▎     | 42/97 [00:07<00:09,  5.94it/s, loss=4.57, v_num=0]
Epoch 12:  43%|████▎     | 42/97 [00:07<00:09,  5.90it/s, loss=4.58, v_num=0]
Epoch 12:  44%|████▍     | 43/97 [00:07<00:09,  5.97it/s, loss=4.58, v_num=0]
Epoch 12:  44%|████▍     | 43/97 [00:07<00:09,  5.92it/s, loss=4.58, v_num=0]
Epoch 12:  45%|████▌     | 44/97 [00:07<00:08,  5.99it/s, loss=4.58, v_num=0]
Epoch 12:  45%|████▌     | 44/97 [00:07<00:08,  5.95it/s, loss=4.57, v_num=0]
Epoch 12:  46%|████▋     | 45/97 [00:07<00:08,  6.02it/s, loss=4.57, v_num=0]
Epoch 12:  46%|████▋     | 45/97 [00:07<00:08,  5.97it/s, loss=4.57, v_num=0]
Epoch 12:  47%|████▋     | 46/97 [00:07<00:08,  6.04it/s, loss=4.57, v_num=0]
Epoch 12:  47%|████▋     | 46/97 [00:07<00:08,  6.00it/s, loss=4.57, v_num=0]
Epoch 12:  48%|████▊     | 47/97 [00:07<00:08,  6.07it/s, loss=4.57, v_num=0]
Epoch 12:  48%|████▊     | 47/97 [00:07<00:08,  6.02it/s, loss=4.57, v_num=0]
Epoch 12:  49%|████▉     | 48/97 [00:07<00:08,  6.08it/s, loss=4.57, v_num=0]
Epoch 12:  49%|████▉     | 48/97 [00:07<00:08,  6.04it/s, loss=4.57, v_num=0]
Epoch 12:  51%|█████     | 49/97 [00:08<00:07,  6.11it/s, loss=4.57, v_num=0]
Epoch 12:  51%|█████     | 49/97 [00:08<00:07,  6.07it/s, loss=4.56, v_num=0]
Epoch 12:  52%|█████▏    | 50/97 [00:08<00:07,  6.13it/s, loss=4.56, v_num=0]
Epoch 12:  52%|█████▏    | 50/97 [00:08<00:07,  6.09it/s, loss=4.56, v_num=0]
Epoch 12:  53%|█████▎    | 51/97 [00:08<00:07,  6.15it/s, loss=4.56, v_num=0]
Epoch 12:  53%|█████▎    | 51/97 [00:08<00:07,  6.11it/s, loss=4.55, v_num=0]
Epoch 12:  54%|█████▎    | 52/97 [00:08<00:07,  6.17it/s, loss=4.55, v_num=0]
Epoch 12:  54%|█████▎    | 52/97 [00:08<00:07,  6.13it/s, loss=4.56, v_num=0]
Epoch 12:  55%|█████▍    | 53/97 [00:08<00:07,  6.19it/s, loss=4.56, v_num=0]
Epoch 12:  55%|█████▍    | 53/97 [00:08<00:07,  6.15it/s, loss=4.56, v_num=0]
Epoch 12:  56%|█████▌    | 54/97 [00:08<00:06,  6.21it/s, loss=4.56, v_num=0]
Epoch 12:  56%|█████▌    | 54/97 [00:08<00:06,  6.16it/s, loss=4.56, v_num=0]
Epoch 12:  57%|█████▋    | 55/97 [00:08<00:06,  6.22it/s, loss=4.56, v_num=0]
Epoch 12:  57%|█████▋    | 55/97 [00:08<00:06,  6.18it/s, loss=4.56, v_num=0]
Epoch 12:  58%|█████▊    | 56/97 [00:08<00:06,  6.24it/s, loss=4.56, v_num=0]
Epoch 12:  58%|█████▊    | 56/97 [00:09<00:06,  6.20it/s, loss=4.55, v_num=0]
Epoch 12:  59%|█████▉    | 57/97 [00:09<00:06,  6.25it/s, loss=4.55, v_num=0]
Epoch 12:  59%|█████▉    | 57/97 [00:09<00:06,  6.22it/s, loss=4.54, v_num=0]
Epoch 12:  60%|█████▉    | 58/97 [00:09<00:06,  6.27it/s, loss=4.54, v_num=0]
Epoch 12:  60%|█████▉    | 58/97 [00:09<00:06,  6.23it/s, loss=4.54, v_num=0]
Epoch 12:  61%|██████    | 59/97 [00:09<00:06,  6.29it/s, loss=4.54, v_num=0]
Epoch 12:  61%|██████    | 59/97 [00:09<00:06,  6.25it/s, loss=4.55, v_num=0]
Epoch 12:  62%|██████▏   | 60/97 [00:09<00:05,  6.30it/s, loss=4.55, v_num=0]
Epoch 12:  62%|██████▏   | 60/97 [00:09<00:05,  6.26it/s, loss=4.55, v_num=0]
Epoch 12:  63%|██████▎   | 61/97 [00:09<00:05,  6.32it/s, loss=4.55, v_num=0]
Epoch 12:  63%|██████▎   | 61/97 [00:09<00:05,  6.28it/s, loss=4.56, v_num=0]
Epoch 12:  64%|██████▍   | 62/97 [00:09<00:05,  6.33it/s, loss=4.56, v_num=0]
Epoch 12:  64%|██████▍   | 62/97 [00:09<00:05,  6.29it/s, loss=4.55, v_num=0]
Epoch 12:  65%|██████▍   | 63/97 [00:09<00:05,  6.34it/s, loss=4.55, v_num=0]
Epoch 12:  65%|██████▍   | 63/97 [00:09<00:05,  6.31it/s, loss=4.55, v_num=0]
Epoch 12:  66%|██████▌   | 64/97 [00:10<00:05,  6.36it/s, loss=4.55, v_num=0]
Epoch 12:  66%|██████▌   | 64/97 [00:10<00:05,  6.32it/s, loss=4.55, v_num=0]
Epoch 12:  67%|██████▋   | 65/97 [00:10<00:05,  6.37it/s, loss=4.55, v_num=0]
Epoch 12:  67%|██████▋   | 65/97 [00:10<00:05,  6.33it/s, loss=4.55, v_num=0]
Epoch 12:  68%|██████▊   | 66/97 [00:10<00:04,  6.38it/s, loss=4.55, v_num=0]
Epoch 12:  68%|██████▊   | 66/97 [00:10<00:04,  6.35it/s, loss=4.55, v_num=0]
Epoch 12:  69%|██████▉   | 67/97 [00:10<00:04,  6.39it/s, loss=4.55, v_num=0]
Epoch 12:  69%|██████▉   | 67/97 [00:10<00:04,  6.36it/s, loss=4.56, v_num=0]
Epoch 12:  70%|███████   | 68/97 [00:10<00:04,  6.41it/s, loss=4.56, v_num=0]
Epoch 12:  70%|███████   | 68/97 [00:10<00:04,  6.37it/s, loss=4.57, v_num=0]
Epoch 12:  71%|███████   | 69/97 [00:10<00:04,  6.42it/s, loss=4.57, v_num=0]
Epoch 12:  71%|███████   | 69/97 [00:10<00:04,  6.38it/s, loss=4.57, v_num=0]
Epoch 12:  72%|███████▏  | 70/97 [00:10<00:04,  6.43it/s, loss=4.57, v_num=0]
Epoch 12:  72%|███████▏  | 70/97 [00:10<00:04,  6.40it/s, loss=4.58, v_num=0]
Epoch 12:  73%|███████▎  | 71/97 [00:11<00:04,  6.44it/s, loss=4.58, v_num=0]
Epoch 12:  73%|███████▎  | 71/97 [00:11<00:04,  6.41it/s, loss=4.59, v_num=0]
Epoch 12:  74%|███████▍  | 72/97 [00:11<00:03,  6.45it/s, loss=4.59, v_num=0]
Epoch 12:  74%|███████▍  | 72/97 [00:11<00:03,  6.42it/s, loss=4.58, v_num=0]
Epoch 12:  75%|███████▌  | 73/97 [00:11<00:03,  6.46it/s, loss=4.58, v_num=0]
Epoch 12:  75%|███████▌  | 73/97 [00:11<00:03,  6.43it/s, loss=4.58, v_num=0]
Epoch 12:  76%|███████▋  | 74/97 [00:11<00:03,  6.47it/s, loss=4.58, v_num=0]
Epoch 12:  76%|███████▋  | 74/97 [00:11<00:03,  6.44it/s, loss=4.58, v_num=0]
Epoch 12:  77%|███████▋  | 75/97 [00:11<00:03,  6.48it/s, loss=4.58, v_num=0]
Epoch 12:  77%|███████▋  | 75/97 [00:11<00:03,  6.45it/s, loss=4.58, v_num=0]
Epoch 12:  78%|███████▊  | 76/97 [00:11<00:03,  6.49it/s, loss=4.58, v_num=0]
Epoch 12:  78%|███████▊  | 76/97 [00:11<00:03,  6.46it/s, loss=4.58, v_num=0]
Epoch 12:  79%|███████▉  | 77/97 [00:11<00:03,  6.50it/s, loss=4.58, v_num=0]
Epoch 12:  79%|███████▉  | 77/97 [00:11<00:03,  6.47it/s, loss=4.58, v_num=0]
Epoch 12:  80%|████████  | 78/97 [00:11<00:02,  6.51it/s, loss=4.58, v_num=0]
Epoch 12:  80%|████████  | 78/97 [00:12<00:02,  6.48it/s, loss=4.58, v_num=0]
Epoch 12:  81%|████████▏ | 79/97 [00:12<00:02,  6.52it/s, loss=4.58, v_num=0]
Epoch 12:  81%|████████▏ | 79/97 [00:12<00:02,  6.49it/s, loss=4.58, v_num=0]
Epoch 12:  82%|████████▏ | 80/97 [00:12<00:02,  6.53it/s, loss=4.58, v_num=0]
Epoch 12:  82%|████████▏ | 80/97 [00:12<00:02,  6.50it/s, loss=4.58, v_num=0]
Epoch 12:  84%|████████▎ | 81/97 [00:12<00:02,  6.54it/s, loss=4.58, v_num=0]
Epoch 12:  84%|████████▎ | 81/97 [00:12<00:02,  6.51it/s, loss=4.57, v_num=0]
Epoch 12:  85%|████████▍ | 82/97 [00:12<00:02,  6.54it/s, loss=4.57, v_num=0]
Epoch 12:  85%|████████▍ | 82/97 [00:12<00:02,  6.52it/s, loss=4.57, v_num=0]
Epoch 12:  86%|████████▌ | 83/97 [00:12<00:02,  6.55it/s, loss=4.57, v_num=0]
Epoch 12:  86%|████████▌ | 83/97 [00:12<00:02,  6.52it/s, loss=4.57, v_num=0]
Epoch 12:  87%|████████▋ | 84/97 [00:12<00:01,  6.56it/s, loss=4.57, v_num=0]
Epoch 12:  87%|████████▋ | 84/97 [00:12<00:01,  6.53it/s, loss=4.57, v_num=0]
Epoch 12:  88%|████████▊ | 85/97 [00:12<00:01,  6.57it/s, loss=4.57, v_num=0]
Epoch 12:  88%|████████▊ | 85/97 [00:12<00:01,  6.54it/s, loss=4.56, v_num=0]
Epoch 12:  89%|████████▊ | 86/97 [00:13<00:01,  6.58it/s, loss=4.56, v_num=0]
Epoch 12:  89%|████████▊ | 86/97 [00:13<00:01,  6.55it/s, loss=4.56, v_num=0]
Epoch 12:  90%|████████▉ | 87/97 [00:13<00:01,  6.58it/s, loss=4.56, v_num=0]
Epoch 12:  90%|████████▉ | 87/97 [00:13<00:01,  6.56it/s, loss=4.55, v_num=0]
Epoch 12:  91%|█████████ | 88/97 [00:13<00:01,  6.59it/s, loss=4.55, v_num=0]
Epoch 12:  91%|█████████ | 88/97 [00:13<00:01,  6.57it/s, loss=4.54, v_num=0]
Epoch 12:  92%|█████████▏| 89/97 [00:13<00:01,  6.60it/s, loss=4.54, v_num=0]
Epoch 12:  92%|█████████▏| 89/97 [00:13<00:01,  6.57it/s, loss=4.53, v_num=0]
Epoch 12:  93%|█████████▎| 90/97 [00:13<00:01,  6.61it/s, loss=4.53, v_num=0]
Epoch 12:  93%|█████████▎| 90/97 [00:13<00:01,  6.58it/s, loss=4.53, v_num=0]
Epoch 12:  94%|█████████▍| 91/97 [00:13<00:00,  6.61it/s, loss=4.53, v_num=0]
Epoch 12:  94%|█████████▍| 91/97 [00:13<00:00,  6.59it/s, loss=4.53, v_num=0]
Epoch 12:  95%|█████████▍| 92/97 [00:13<00:00,  6.62it/s, loss=4.53, v_num=0]
Epoch 12:  95%|█████████▍| 92/97 [00:13<00:00,  6.60it/s, loss=4.52, v_num=0]
Epoch 12:  96%|█████████▌| 93/97 [00:14<00:00,  6.63it/s, loss=4.52, v_num=0]
Epoch 12:  96%|█████████▌| 93/97 [00:14<00:00,  6.60it/s, loss=4.52, v_num=0]
Epoch 12:  97%|█████████▋| 94/97 [00:14<00:00,  6.63it/s, loss=4.52, v_num=0]
Epoch 12:  97%|█████████▋| 94/97 [00:14<00:00,  6.61it/s, loss=4.51, v_num=0]
Epoch 12:  98%|█████████▊| 95/97 [00:14<00:00,  6.64it/s, loss=4.51, v_num=0]
Epoch 12:  98%|█████████▊| 95/97 [00:14<00:00,  6.62it/s, loss=4.5, v_num=0]
Epoch 12:  99%|█████████▉| 96/97 [00:14<00:00,  6.65it/s, loss=4.5, v_num=0]
Epoch 12:  99%|█████████▉| 96/97 [00:14<00:00,  6.62it/s, loss=4.51, v_num=0]
Epoch 12: 100%|██████████| 97/97 [00:14<00:00,  6.65it/s, loss=4.51, v_num=0]
Epoch 12: 100%|██████████| 97/97 [00:14<00:00,  6.63it/s, loss=4.5, v_num=0]
Epoch 12: 100%|██████████| 97/97 [00:14<00:00,  6.63it/s, loss=4.5, v_num=0]
Epoch 12:   0%|          | 0/97 [00:00<?, ?it/s, loss=4.5, v_num=0]
Epoch 13:   0%|          | 0/97 [00:00<?, ?it/s, loss=4.5, v_num=0]
Epoch 13:   1%|          | 1/97 [00:01<02:12,  1.38s/it, loss=4.5, v_num=0]
Epoch 13:   1%|          | 1/97 [00:01<02:17,  1.43s/it, loss=4.49, v_num=0]
Epoch 13:   2%|▏         | 2/97 [00:01<01:12,  1.32it/s, loss=4.49, v_num=0]
Epoch 13:   2%|▏         | 2/97 [00:01<01:15,  1.27it/s, loss=4.49, v_num=0]
Epoch 13:   3%|▎         | 3/97 [00:01<00:51,  1.81it/s, loss=4.49, v_num=0]
Epoch 13:   3%|▎         | 3/97 [00:01<00:53,  1.75it/s, loss=4.49, v_num=0]
Epoch 13:   4%|▍         | 4/97 [00:01<00:41,  2.23it/s, loss=4.49, v_num=0]
Epoch 13:   4%|▍         | 4/97 [00:01<00:43,  2.16it/s, loss=4.48, v_num=0]
Epoch 13:   5%|▌         | 5/97 [00:01<00:35,  2.59it/s, loss=4.48, v_num=0]
Epoch 13:   5%|▌         | 5/97 [00:01<00:36,  2.51it/s, loss=4.49, v_num=0]
Epoch 13:   6%|▌         | 6/97 [00:02<00:31,  2.90it/s, loss=4.49, v_num=0]
Epoch 13:   6%|▌         | 6/97 [00:02<00:32,  2.82it/s, loss=4.49, v_num=0]
Epoch 13:   7%|▋         | 7/97 [00:02<00:28,  3.17it/s, loss=4.49, v_num=0]
Epoch 13:   7%|▋         | 7/97 [00:02<00:29,  3.09it/s, loss=4.49, v_num=0]
Epoch 13:   8%|▊         | 8/97 [00:02<00:26,  3.41it/s, loss=4.49, v_num=0]
Epoch 13:   8%|▊         | 8/97 [00:02<00:26,  3.33it/s, loss=4.49, v_num=0]
Epoch 13:   9%|▉         | 9/97 [00:02<00:24,  3.62it/s, loss=4.49, v_num=0]
Epoch 13:   9%|▉         | 9/97 [00:02<00:24,  3.54it/s, loss=4.49, v_num=0]
Epoch 13:  10%|█         | 10/97 [00:02<00:22,  3.80it/s, loss=4.49, v_num=0]
Epoch 13:  10%|█         | 10/97 [00:02<00:23,  3.72it/s, loss=4.48, v_num=0]
Epoch 13:  11%|█▏        | 11/97 [00:02<00:21,  3.98it/s, loss=4.48, v_num=0]
Epoch 13:  11%|█▏        | 11/97 [00:02<00:22,  3.90it/s, loss=4.47, v_num=0]
Epoch 13:  12%|█▏        | 12/97 [00:02<00:20,  4.13it/s, loss=4.47, v_num=0]
Epoch 13:  12%|█▏        | 12/97 [00:02<00:20,  4.06it/s, loss=4.47, v_num=0]
Epoch 13:  13%|█▎        | 13/97 [00:03<00:19,  4.28it/s, loss=4.47, v_num=0]
Epoch 13:  13%|█▎        | 13/97 [00:03<00:19,  4.20it/s, loss=4.46, v_num=0]
Epoch 13:  14%|█▍        | 14/97 [00:03<00:18,  4.41it/s, loss=4.46, v_num=0]
Epoch 13:  14%|█▍        | 14/97 [00:03<00:19,  4.34it/s, loss=4.46, v_num=0]
Epoch 13:  15%|█▌        | 15/97 [00:03<00:18,  4.54it/s, loss=4.46, v_num=0]
Epoch 13:  15%|█▌        | 15/97 [00:03<00:18,  4.46it/s, loss=4.45, v_num=0]
Epoch 13:  16%|█▋        | 16/97 [00:03<00:17,  4.65it/s, loss=4.45, v_num=0]
Epoch 13:  16%|█▋        | 16/97 [00:03<00:17,  4.57it/s, loss=4.45, v_num=0]
Epoch 13:  18%|█▊        | 17/97 [00:03<00:16,  4.75it/s, loss=4.45, v_num=0]
Epoch 13:  18%|█▊        | 17/97 [00:03<00:17,  4.67it/s, loss=4.45, v_num=0]
Epoch 13:  19%|█▊        | 18/97 [00:03<00:16,  4.84it/s, loss=4.45, v_num=0]
Epoch 13:  19%|█▊        | 18/97 [00:03<00:16,  4.77it/s, loss=4.46, v_num=0]
Epoch 13:  20%|█▉        | 19/97 [00:03<00:15,  4.93it/s, loss=4.46, v_num=0]
Epoch 13:  20%|█▉        | 19/97 [00:03<00:16,  4.86it/s, loss=4.46, v_num=0]
Epoch 13:  21%|██        | 20/97 [00:03<00:15,  5.01it/s, loss=4.46, v_num=0]
Epoch 13:  21%|██        | 20/97 [00:04<00:15,  4.94it/s, loss=4.46, v_num=0]
Epoch 13:  22%|██▏       | 21/97 [00:04<00:14,  5.09it/s, loss=4.46, v_num=0]
Epoch 13:  22%|██▏       | 21/97 [00:04<00:15,  5.02it/s, loss=4.47, v_num=0]
Epoch 13:  23%|██▎       | 22/97 [00:04<00:14,  5.16it/s, loss=4.47, v_num=0]
Epoch 13:  23%|██▎       | 22/97 [00:04<00:14,  5.09it/s, loss=4.47, v_num=0]
Epoch 13:  24%|██▎       | 23/97 [00:04<00:14,  5.23it/s, loss=4.47, v_num=0]
Epoch 13:  24%|██▎       | 23/97 [00:04<00:14,  5.16it/s, loss=4.47, v_num=0]
Epoch 13:  25%|██▍       | 24/97 [00:04<00:13,  5.28it/s, loss=4.47, v_num=0]
Epoch 13:  25%|██▍       | 24/97 [00:04<00:13,  5.22it/s, loss=4.47, v_num=0]
Epoch 13:  26%|██▌       | 25/97 [00:04<00:13,  5.34it/s, loss=4.47, v_num=0]
Epoch 13:  26%|██▌       | 25/97 [00:04<00:13,  5.28it/s, loss=4.46, v_num=0]
Epoch 13:  27%|██▋       | 26/97 [00:04<00:13,  5.40it/s, loss=4.46, v_num=0]
Epoch 13:  27%|██▋       | 26/97 [00:04<00:13,  5.33it/s, loss=4.47, v_num=0]
Epoch 13:  28%|██▊       | 27/97 [00:04<00:12,  5.45it/s, loss=4.47, v_num=0]
Epoch 13:  28%|██▊       | 27/97 [00:05<00:12,  5.39it/s, loss=4.46, v_num=0]
Epoch 13:  29%|██▉       | 28/97 [00:05<00:12,  5.50it/s, loss=4.46, v_num=0]
Epoch 13:  29%|██▉       | 28/97 [00:05<00:12,  5.44it/s, loss=4.47, v_num=0]
Epoch 13:  30%|██▉       | 29/97 [00:05<00:12,  5.55it/s, loss=4.47, v_num=0]
Epoch 13:  30%|██▉       | 29/97 [00:05<00:12,  5.49it/s, loss=4.46, v_num=0]
Epoch 13:  31%|███       | 30/97 [00:05<00:11,  5.59it/s, loss=4.46, v_num=0]
Epoch 13:  31%|███       | 30/97 [00:05<00:12,  5.53it/s, loss=4.46, v_num=0]
Epoch 13:  32%|███▏      | 31/97 [00:05<00:11,  5.63it/s, loss=4.46, v_num=0]
Epoch 13:  32%|███▏      | 31/97 [00:05<00:11,  5.57it/s, loss=4.47, v_num=0]
Epoch 13:  33%|███▎      | 32/97 [00:05<00:11,  5.67it/s, loss=4.47, v_num=0]
Epoch 13:  33%|███▎      | 32/97 [00:05<00:11,  5.62it/s, loss=4.47, v_num=0]
Epoch 13:  34%|███▍      | 33/97 [00:05<00:11,  5.71it/s, loss=4.47, v_num=0]
Epoch 13:  34%|███▍      | 33/97 [00:05<00:11,  5.65it/s, loss=4.47, v_num=0]
Epoch 13:  35%|███▌      | 34/97 [00:05<00:10,  5.74it/s, loss=4.47, v_num=0]
Epoch 13:  35%|███▌      | 34/97 [00:05<00:11,  5.69it/s, loss=4.47, v_num=0]
Epoch 13:  36%|███▌      | 35/97 [00:06<00:10,  5.78it/s, loss=4.47, v_num=0]
Epoch 13:  36%|███▌      | 35/97 [00:06<00:10,  5.73it/s, loss=4.48, v_num=0]
Epoch 13:  37%|███▋      | 36/97 [00:06<00:10,  5.81it/s, loss=4.48, v_num=0]
Epoch 13:  37%|███▋      | 36/97 [00:06<00:10,  5.76it/s, loss=4.49, v_num=0]
Epoch 13:  38%|███▊      | 37/97 [00:06<00:10,  5.84it/s, loss=4.49, v_num=0]
Epoch 13:  38%|███▊      | 37/97 [00:06<00:10,  5.79it/s, loss=4.5, v_num=0]
Epoch 13:  39%|███▉      | 38/97 [00:06<00:10,  5.87it/s, loss=4.5, v_num=0]
Epoch 13:  39%|███▉      | 38/97 [00:06<00:10,  5.82it/s, loss=4.49, v_num=0]
Epoch 13:  40%|████      | 39/97 [00:06<00:09,  5.90it/s, loss=4.49, v_num=0]
Epoch 13:  40%|████      | 39/97 [00:06<00:09,  5.85it/s, loss=4.48, v_num=0]
Epoch 13:  41%|████      | 40/97 [00:06<00:09,  5.92it/s, loss=4.48, v_num=0]
Epoch 13:  41%|████      | 40/97 [00:06<00:09,  5.88it/s, loss=4.48, v_num=0]
Epoch 13:  42%|████▏     | 41/97 [00:06<00:09,  5.96it/s, loss=4.48, v_num=0]
Epoch 13:  42%|████▏     | 41/97 [00:06<00:09,  5.90it/s, loss=4.48, v_num=0]
Epoch 13:  43%|████▎     | 42/97 [00:07<00:09,  5.98it/s, loss=4.48, v_num=0]
Epoch 13:  43%|████▎     | 42/97 [00:07<00:09,  5.93it/s, loss=4.47, v_num=0]
Epoch 13:  44%|████▍     | 43/97 [00:07<00:08,  6.00it/s, loss=4.47, v_num=0]
Epoch 13:  44%|████▍     | 43/97 [00:07<00:09,  5.95it/s, loss=4.48, v_num=0]
Epoch 13:  45%|████▌     | 44/97 [00:07<00:08,  6.02it/s, loss=4.48, v_num=0]
Epoch 13:  45%|████▌     | 44/97 [00:07<00:08,  5.98it/s, loss=4.48, v_num=0]
Epoch 13:  46%|████▋     | 45/97 [00:07<00:08,  6.05it/s, loss=4.48, v_num=0]
Epoch 13:  46%|████▋     | 45/97 [00:07<00:08,  6.00it/s, loss=4.48, v_num=0]
Epoch 13:  47%|████▋     | 46/97 [00:07<00:08,  6.07it/s, loss=4.48, v_num=0]
Epoch 13:  47%|████▋     | 46/97 [00:07<00:08,  6.03it/s, loss=4.47, v_num=0]
Epoch 13:  48%|████▊     | 47/97 [00:07<00:08,  6.10it/s, loss=4.47, v_num=0]
Epoch 13:  48%|████▊     | 47/97 [00:07<00:08,  6.05it/s, loss=4.47, v_num=0]
Epoch 13:  49%|████▉     | 48/97 [00:07<00:08,  6.11it/s, loss=4.47, v_num=0]
Epoch 13:  49%|████▉     | 48/97 [00:07<00:08,  6.07it/s, loss=4.47, v_num=0]
Epoch 13:  51%|█████     | 49/97 [00:07<00:07,  6.13it/s, loss=4.47, v_num=0]
Epoch 13:  51%|█████     | 49/97 [00:08<00:07,  6.09it/s, loss=4.47, v_num=0]
Epoch 13:  52%|█████▏    | 50/97 [00:08<00:07,  6.15it/s, loss=4.47, v_num=0]
Epoch 13:  52%|█████▏    | 50/97 [00:08<00:07,  6.11it/s, loss=4.48, v_num=0]
Epoch 13:  53%|█████▎    | 51/97 [00:08<00:07,  6.17it/s, loss=4.48, v_num=0]
Epoch 13:  53%|█████▎    | 51/97 [00:08<00:07,  6.13it/s, loss=4.47, v_num=0]
Epoch 13:  54%|█████▎    | 52/97 [00:08<00:07,  6.19it/s, loss=4.47, v_num=0]
Epoch 13:  54%|█████▎    | 52/97 [00:08<00:07,  6.15it/s, loss=4.47, v_num=0]
Epoch 13:  55%|█████▍    | 53/97 [00:08<00:07,  6.20it/s, loss=4.47, v_num=0]
Epoch 13:  55%|█████▍    | 53/97 [00:08<00:07,  6.16it/s, loss=4.46, v_num=0]
Epoch 13:  56%|█████▌    | 54/97 [00:08<00:06,  6.22it/s, loss=4.46, v_num=0]
Epoch 13:  56%|█████▌    | 54/97 [00:08<00:06,  6.18it/s, loss=4.45, v_num=0]
Epoch 13:  57%|█████▋    | 55/97 [00:08<00:06,  6.24it/s, loss=4.45, v_num=0]
Epoch 13:  57%|█████▋    | 55/97 [00:08<00:06,  6.20it/s, loss=4.45, v_num=0]
Epoch 13:  58%|█████▊    | 56/97 [00:08<00:06,  6.25it/s, loss=4.45, v_num=0]
Epoch 13:  58%|█████▊    | 56/97 [00:09<00:06,  6.21it/s, loss=4.45, v_num=0]
Epoch 13:  59%|█████▉    | 57/97 [00:09<00:06,  6.27it/s, loss=4.45, v_num=0]
Epoch 13:  59%|█████▉    | 57/97 [00:09<00:06,  6.23it/s, loss=4.44, v_num=0]
Epoch 13:  60%|█████▉    | 58/97 [00:09<00:06,  6.28it/s, loss=4.44, v_num=0]
Epoch 13:  60%|█████▉    | 58/97 [00:09<00:06,  6.24it/s, loss=4.44, v_num=0]
Epoch 13:  61%|██████    | 59/97 [00:09<00:06,  6.30it/s, loss=4.44, v_num=0]
Epoch 13:  61%|██████    | 59/97 [00:09<00:06,  6.26it/s, loss=4.44, v_num=0]
Epoch 13:  62%|██████▏   | 60/97 [00:09<00:05,  6.31it/s, loss=4.44, v_num=0]
Epoch 13:  62%|██████▏   | 60/97 [00:09<00:05,  6.27it/s, loss=4.44, v_num=0]
Epoch 13:  63%|██████▎   | 61/97 [00:09<00:05,  6.33it/s, loss=4.44, v_num=0]
Epoch 13:  63%|██████▎   | 61/97 [00:09<00:05,  6.29it/s, loss=4.44, v_num=0]
Epoch 13:  64%|██████▍   | 62/97 [00:09<00:05,  6.34it/s, loss=4.44, v_num=0]
Epoch 13:  64%|██████▍   | 62/97 [00:09<00:05,  6.30it/s, loss=4.43, v_num=0]
Epoch 13:  65%|██████▍   | 63/97 [00:09<00:05,  6.35it/s, loss=4.43, v_num=0]
Epoch 13:  65%|██████▍   | 63/97 [00:09<00:05,  6.32it/s, loss=4.42, v_num=0]
Epoch 13:  66%|██████▌   | 64/97 [00:10<00:05,  6.36it/s, loss=4.42, v_num=0]
Epoch 13:  66%|██████▌   | 64/97 [00:10<00:05,  6.33it/s, loss=4.42, v_num=0]
Epoch 13:  67%|██████▋   | 65/97 [00:10<00:05,  6.38it/s, loss=4.42, v_num=0]
Epoch 13:  67%|██████▋   | 65/97 [00:10<00:05,  6.34it/s, loss=4.42, v_num=0]
Epoch 13:  68%|██████▊   | 66/97 [00:10<00:04,  6.39it/s, loss=4.42, v_num=0]
Epoch 13:  68%|██████▊   | 66/97 [00:10<00:04,  6.36it/s, loss=4.43, v_num=0]
Epoch 13:  69%|██████▉   | 67/97 [00:10<00:04,  6.40it/s, loss=4.43, v_num=0]
Epoch 13:  69%|██████▉   | 67/97 [00:10<00:04,  6.37it/s, loss=4.43, v_num=0]
Epoch 13:  70%|███████   | 68/97 [00:10<00:04,  6.41it/s, loss=4.43, v_num=0]
Epoch 13:  70%|███████   | 68/97 [00:10<00:04,  6.38it/s, loss=4.43, v_num=0]
Epoch 13:  71%|███████   | 69/97 [00:10<00:04,  6.42it/s, loss=4.43, v_num=0]
Epoch 13:  71%|███████   | 69/97 [00:10<00:04,  6.39it/s, loss=4.43, v_num=0]
Epoch 13:  72%|███████▏  | 70/97 [00:10<00:04,  6.43it/s, loss=4.43, v_num=0]
Epoch 13:  72%|███████▏  | 70/97 [00:10<00:04,  6.40it/s, loss=4.42, v_num=0]
Epoch 13:  73%|███████▎  | 71/97 [00:11<00:04,  6.45it/s, loss=4.42, v_num=0]
Epoch 13:  73%|███████▎  | 71/97 [00:11<00:04,  6.41it/s, loss=4.42, v_num=0]
Epoch 13:  74%|███████▍  | 72/97 [00:11<00:03,  6.45it/s, loss=4.42, v_num=0]
Epoch 13:  74%|███████▍  | 72/97 [00:11<00:03,  6.42it/s, loss=4.42, v_num=0]
Epoch 13:  75%|███████▌  | 73/97 [00:11<00:03,  6.47it/s, loss=4.42, v_num=0]
Epoch 13:  75%|███████▌  | 73/97 [00:11<00:03,  6.43it/s, loss=4.42, v_num=0]
Epoch 13:  76%|███████▋  | 74/97 [00:11<00:03,  6.47it/s, loss=4.42, v_num=0]
Epoch 13:  76%|███████▋  | 74/97 [00:11<00:03,  6.44it/s, loss=4.42, v_num=0]
Epoch 13:  77%|███████▋  | 75/97 [00:11<00:03,  6.48it/s, loss=4.42, v_num=0]
Epoch 13:  77%|███████▋  | 75/97 [00:11<00:03,  6.45it/s, loss=4.43, v_num=0]
Epoch 13:  78%|███████▊  | 76/97 [00:11<00:03,  6.49it/s, loss=4.43, v_num=0]
Epoch 13:  78%|███████▊  | 76/97 [00:11<00:03,  6.46it/s, loss=4.42, v_num=0]
Epoch 13:  79%|███████▉  | 77/97 [00:11<00:03,  6.50it/s, loss=4.42, v_num=0]
Epoch 13:  79%|███████▉  | 77/97 [00:11<00:03,  6.47it/s, loss=4.42, v_num=0]
Epoch 13:  80%|████████  | 78/97 [00:11<00:02,  6.51it/s, loss=4.42, v_num=0]
Epoch 13:  80%|████████  | 78/97 [00:12<00:02,  6.48it/s, loss=4.42, v_num=0]
Epoch 13:  81%|████████▏ | 79/97 [00:12<00:02,  6.52it/s, loss=4.42, v_num=0]
Epoch 13:  81%|████████▏ | 79/97 [00:12<00:02,  6.49it/s, loss=4.42, v_num=0]
Epoch 13:  82%|████████▏ | 80/97 [00:12<00:02,  6.53it/s, loss=4.42, v_num=0]
Epoch 13:  82%|████████▏ | 80/97 [00:12<00:02,  6.50it/s, loss=4.42, v_num=0]
Epoch 13:  84%|████████▎ | 81/97 [00:12<00:02,  6.54it/s, loss=4.42, v_num=0]
Epoch 13:  84%|████████▎ | 81/97 [00:12<00:02,  6.51it/s, loss=4.41, v_num=0]
Epoch 13:  85%|████████▍ | 82/97 [00:12<00:02,  6.54it/s, loss=4.41, v_num=0]
Epoch 13:  85%|████████▍ | 82/97 [00:12<00:02,  6.51it/s, loss=4.42, v_num=0]
Epoch 13:  86%|████████▌ | 83/97 [00:12<00:02,  6.55it/s, loss=4.42, v_num=0]
Epoch 13:  86%|████████▌ | 83/97 [00:12<00:02,  6.52it/s, loss=4.43, v_num=0]
Epoch 13:  87%|████████▋ | 84/97 [00:12<00:01,  6.56it/s, loss=4.43, v_num=0]
Epoch 13:  87%|████████▋ | 84/97 [00:12<00:01,  6.53it/s, loss=4.43, v_num=0]
Epoch 13:  88%|████████▊ | 85/97 [00:12<00:01,  6.57it/s, loss=4.43, v_num=0]
Epoch 13:  88%|████████▊ | 85/97 [00:13<00:01,  6.54it/s, loss=4.42, v_num=0]
Epoch 13:  89%|████████▊ | 86/97 [00:13<00:01,  6.57it/s, loss=4.42, v_num=0]
Epoch 13:  89%|████████▊ | 86/97 [00:13<00:01,  6.55it/s, loss=4.41, v_num=0]
Epoch 13:  90%|████████▉ | 87/97 [00:13<00:01,  6.58it/s, loss=4.41, v_num=0]
Epoch 13:  90%|████████▉ | 87/97 [00:13<00:01,  6.55it/s, loss=4.41, v_num=0]
Epoch 13:  91%|█████████ | 88/97 [00:13<00:01,  6.59it/s, loss=4.41, v_num=0]
Epoch 13:  91%|█████████ | 88/97 [00:13<00:01,  6.56it/s, loss=4.41, v_num=0]
Epoch 13:  92%|█████████▏| 89/97 [00:13<00:01,  6.60it/s, loss=4.41, v_num=0]
Epoch 13:  92%|█████████▏| 89/97 [00:13<00:01,  6.57it/s, loss=4.41, v_num=0]
Epoch 13:  93%|█████████▎| 90/97 [00:13<00:01,  6.60it/s, loss=4.41, v_num=0]
Epoch 13:  93%|█████████▎| 90/97 [00:13<00:01,  6.58it/s, loss=4.41, v_num=0]
Epoch 13:  94%|█████████▍| 91/97 [00:13<00:00,  6.61it/s, loss=4.41, v_num=0]
Epoch 13:  94%|█████████▍| 91/97 [00:13<00:00,  6.58it/s, loss=4.41, v_num=0]
Epoch 13:  95%|█████████▍| 92/97 [00:13<00:00,  6.62it/s, loss=4.41, v_num=0]
Epoch 13:  95%|█████████▍| 92/97 [00:13<00:00,  6.59it/s, loss=4.42, v_num=0]
Epoch 13:  96%|█████████▌| 93/97 [00:14<00:00,  6.62it/s, loss=4.42, v_num=0]
Epoch 13:  96%|█████████▌| 93/97 [00:14<00:00,  6.60it/s, loss=4.43, v_num=0]
Epoch 13:  97%|█████████▋| 94/97 [00:14<00:00,  6.63it/s, loss=4.43, v_num=0]
Epoch 13:  97%|█████████▋| 94/97 [00:14<00:00,  6.60it/s, loss=4.43, v_num=0]
Epoch 13:  98%|█████████▊| 95/97 [00:14<00:00,  6.64it/s, loss=4.43, v_num=0]
Epoch 13:  98%|█████████▊| 95/97 [00:14<00:00,  6.61it/s, loss=4.43, v_num=0]
Epoch 13:  99%|█████████▉| 96/97 [00:14<00:00,  6.64it/s, loss=4.43, v_num=0]
Epoch 13:  99%|█████████▉| 96/97 [00:14<00:00,  6.62it/s, loss=4.43, v_num=0]
Epoch 13: 100%|██████████| 97/97 [00:14<00:00,  6.65it/s, loss=4.43, v_num=0]
Epoch 13: 100%|██████████| 97/97 [00:14<00:00,  6.62it/s, loss=4.43, v_num=0]
Epoch 13: 100%|██████████| 97/97 [00:14<00:00,  6.62it/s, loss=4.43, v_num=0]
Epoch 13:   0%|          | 0/97 [00:00<?, ?it/s, loss=4.43, v_num=0]
Epoch 14:   0%|          | 0/97 [00:00<?, ?it/s, loss=4.43, v_num=0]
Epoch 14:   1%|          | 1/97 [00:01<02:12,  1.38s/it, loss=4.43, v_num=0]
Epoch 14:   1%|          | 1/97 [00:01<02:17,  1.44s/it, loss=4.43, v_num=0]
Epoch 14:   2%|▏         | 2/97 [00:01<01:12,  1.31it/s, loss=4.43, v_num=0]
Epoch 14:   2%|▏         | 2/97 [00:01<01:15,  1.27it/s, loss=4.43, v_num=0]
Epoch 14:   3%|▎         | 3/97 [00:01<00:52,  1.81it/s, loss=4.43, v_num=0]
Epoch 14:   3%|▎         | 3/97 [00:01<00:53,  1.75it/s, loss=4.42, v_num=0]
Epoch 14:   4%|▍         | 4/97 [00:01<00:41,  2.22it/s, loss=4.42, v_num=0]
Epoch 14:   4%|▍         | 4/97 [00:01<00:43,  2.16it/s, loss=4.42, v_num=0]
Epoch 14:   5%|▌         | 5/97 [00:01<00:35,  2.58it/s, loss=4.42, v_num=0]
Epoch 14:   5%|▌         | 5/97 [00:01<00:36,  2.51it/s, loss=4.41, v_num=0]
Epoch 14:   6%|▌         | 6/97 [00:02<00:31,  2.89it/s, loss=4.41, v_num=0]
Epoch 14:   6%|▌         | 6/97 [00:02<00:32,  2.82it/s, loss=4.4, v_num=0]
Epoch 14:   7%|▋         | 7/97 [00:02<00:28,  3.17it/s, loss=4.4, v_num=0]
Epoch 14:   7%|▋         | 7/97 [00:02<00:29,  3.09it/s, loss=4.4, v_num=0]
Epoch 14:   8%|▊         | 8/97 [00:02<00:26,  3.41it/s, loss=4.4, v_num=0]
Epoch 14:   8%|▊         | 8/97 [00:02<00:26,  3.33it/s, loss=4.4, v_num=0]
Epoch 14:   9%|▉         | 9/97 [00:02<00:24,  3.61it/s, loss=4.4, v_num=0]
Epoch 14:   9%|▉         | 9/97 [00:02<00:24,  3.54it/s, loss=4.4, v_num=0]
Epoch 14:  10%|█         | 10/97 [00:02<00:22,  3.81it/s, loss=4.4, v_num=0]
Epoch 14:  10%|█         | 10/97 [00:02<00:23,  3.73it/s, loss=4.41, v_num=0]
Epoch 14:  11%|█▏        | 11/97 [00:02<00:21,  3.98it/s, loss=4.41, v_num=0]
Epoch 14:  11%|█▏        | 11/97 [00:02<00:22,  3.90it/s, loss=4.41, v_num=0]
Epoch 14:  12%|█▏        | 12/97 [00:02<00:20,  4.14it/s, loss=4.41, v_num=0]
Epoch 14:  12%|█▏        | 12/97 [00:02<00:20,  4.06it/s, loss=4.41, v_num=0]
Epoch 14:  13%|█▎        | 13/97 [00:03<00:19,  4.28it/s, loss=4.41, v_num=0]
Epoch 14:  13%|█▎        | 13/97 [00:03<00:19,  4.20it/s, loss=4.4, v_num=0]
Epoch 14:  14%|█▍        | 14/97 [00:03<00:18,  4.42it/s, loss=4.4, v_num=0]
Epoch 14:  14%|█▍        | 14/97 [00:03<00:19,  4.34it/s, loss=4.4, v_num=0]
Epoch 14:  15%|█▌        | 15/97 [00:03<00:18,  4.53it/s, loss=4.4, v_num=0]
Epoch 14:  15%|█▌        | 15/97 [00:03<00:18,  4.46it/s, loss=4.39, v_num=0]
Epoch 14:  16%|█▋        | 16/97 [00:03<00:17,  4.65it/s, loss=4.39, v_num=0]
Epoch 14:  16%|█▋        | 16/97 [00:03<00:17,  4.57it/s, loss=4.38, v_num=0]
Epoch 14:  18%|█▊        | 17/97 [00:03<00:16,  4.74it/s, loss=4.38, v_num=0]
Epoch 14:  18%|█▊        | 17/97 [00:03<00:17,  4.67it/s, loss=4.38, v_num=0]
Epoch 14:  19%|█▊        | 18/97 [00:03<00:16,  4.84it/s, loss=4.38, v_num=0]
Epoch 14:  19%|█▊        | 18/97 [00:03<00:16,  4.77it/s, loss=4.37, v_num=0]
Epoch 14:  20%|█▉        | 19/97 [00:03<00:15,  4.93it/s, loss=4.37, v_num=0]
Epoch 14:  20%|█▉        | 19/97 [00:03<00:16,  4.86it/s, loss=4.37, v_num=0]
Epoch 14:  21%|██        | 20/97 [00:03<00:15,  5.01it/s, loss=4.37, v_num=0]
Epoch 14:  21%|██        | 20/97 [00:04<00:15,  4.94it/s, loss=4.36, v_num=0]
Epoch 14:  22%|██▏       | 21/97 [00:04<00:14,  5.08it/s, loss=4.36, v_num=0]
Epoch 14:  22%|██▏       | 21/97 [00:04<00:15,  5.01it/s, loss=4.36, v_num=0]
Epoch 14:  23%|██▎       | 22/97 [00:04<00:14,  5.16it/s, loss=4.36, v_num=0]
Epoch 14:  23%|██▎       | 22/97 [00:04<00:14,  5.09it/s, loss=4.36, v_num=0]
Epoch 14:  24%|██▎       | 23/97 [00:04<00:14,  5.22it/s, loss=4.36, v_num=0]
Epoch 14:  24%|██▎       | 23/97 [00:04<00:14,  5.15it/s, loss=4.36, v_num=0]
Epoch 14:  25%|██▍       | 24/97 [00:04<00:13,  5.28it/s, loss=4.36, v_num=0]
Epoch 14:  25%|██▍       | 24/97 [00:04<00:13,  5.22it/s, loss=4.36, v_num=0]
Epoch 14:  26%|██▌       | 25/97 [00:04<00:13,  5.34it/s, loss=4.36, v_num=0]
Epoch 14:  26%|██▌       | 25/97 [00:04<00:13,  5.28it/s, loss=4.36, v_num=0]
Epoch 14:  27%|██▋       | 26/97 [00:04<00:13,  5.39it/s, loss=4.36, v_num=0]
Epoch 14:  27%|██▋       | 26/97 [00:04<00:13,  5.34it/s, loss=4.36, v_num=0]
Epoch 14:  28%|██▊       | 27/97 [00:04<00:12,  5.45it/s, loss=4.36, v_num=0]
Epoch 14:  28%|██▊       | 27/97 [00:05<00:12,  5.39it/s, loss=4.35, v_num=0]
Epoch 14:  29%|██▉       | 28/97 [00:05<00:12,  5.50it/s, loss=4.35, v_num=0]
Epoch 14:  29%|██▉       | 28/97 [00:05<00:12,  5.44it/s, loss=4.34, v_num=0]
Epoch 14:  30%|██▉       | 29/97 [00:05<00:12,  5.55it/s, loss=4.34, v_num=0]
Epoch 14:  30%|██▉       | 29/97 [00:05<00:12,  5.49it/s, loss=4.34, v_num=0]
Epoch 14:  31%|███       | 30/97 [00:05<00:11,  5.59it/s, loss=4.34, v_num=0]
Epoch 14:  31%|███       | 30/97 [00:05<00:12,  5.53it/s, loss=4.33, v_num=0]
Epoch 14:  32%|███▏      | 31/97 [00:05<00:11,  5.63it/s, loss=4.33, v_num=0]
Epoch 14:  32%|███▏      | 31/97 [00:05<00:11,  5.58it/s, loss=4.33, v_num=0]
Epoch 14:  33%|███▎      | 32/97 [00:05<00:11,  5.68it/s, loss=4.33, v_num=0]
Epoch 14:  33%|███▎      | 32/97 [00:05<00:11,  5.62it/s, loss=4.33, v_num=0]
Epoch 14:  34%|███▍      | 33/97 [00:05<00:11,  5.71it/s, loss=4.33, v_num=0]
Epoch 14:  34%|███▍      | 33/97 [00:05<00:11,  5.66it/s, loss=4.34, v_num=0]
Epoch 14:  35%|███▌      | 34/97 [00:05<00:10,  5.75it/s, loss=4.34, v_num=0]
Epoch 14:  35%|███▌      | 34/97 [00:05<00:11,  5.70it/s, loss=4.34, v_num=0]
Epoch 14:  36%|███▌      | 35/97 [00:06<00:10,  5.78it/s, loss=4.34, v_num=0]
Epoch 14:  36%|███▌      | 35/97 [00:06<00:10,  5.73it/s, loss=4.34, v_num=0]
Epoch 14:  37%|███▋      | 36/97 [00:06<00:10,  5.82it/s, loss=4.34, v_num=0]
Epoch 14:  37%|███▋      | 36/97 [00:06<00:10,  5.77it/s, loss=4.35, v_num=0]
Epoch 14:  38%|███▊      | 37/97 [00:06<00:10,  5.85it/s, loss=4.35, v_num=0]
Epoch 14:  38%|███▊      | 37/97 [00:06<00:10,  5.80it/s, loss=4.35, v_num=0]
Epoch 14:  39%|███▉      | 38/97 [00:06<00:10,  5.88it/s, loss=4.35, v_num=0]
Epoch 14:  39%|███▉      | 38/97 [00:06<00:10,  5.83it/s, loss=4.35, v_num=0]
Epoch 14:  40%|████      | 39/97 [00:06<00:09,  5.91it/s, loss=4.35, v_num=0]
Epoch 14:  40%|████      | 39/97 [00:06<00:09,  5.86it/s, loss=4.34, v_num=0]
Epoch 14:  41%|████      | 40/97 [00:06<00:09,  5.94it/s, loss=4.34, v_num=0]
Epoch 14:  41%|████      | 40/97 [00:06<00:09,  5.89it/s, loss=4.34, v_num=0]
Epoch 14:  42%|████▏     | 41/97 [00:06<00:09,  5.97it/s, loss=4.34, v_num=0]
Epoch 14:  42%|████▏     | 41/97 [00:06<00:09,  5.92it/s, loss=4.34, v_num=0]
Epoch 14:  43%|████▎     | 42/97 [00:07<00:09,  5.99it/s, loss=4.34, v_num=0]
Epoch 14:  43%|████▎     | 42/97 [00:07<00:09,  5.95it/s, loss=4.34, v_num=0]
Epoch 14:  44%|████▍     | 43/97 [00:07<00:08,  6.01it/s, loss=4.34, v_num=0]
Epoch 14:  44%|████▍     | 43/97 [00:07<00:09,  5.97it/s, loss=4.34, v_num=0]
Epoch 14:  45%|████▌     | 44/97 [00:07<00:08,  6.04it/s, loss=4.34, v_num=0]
Epoch 14:  45%|████▌     | 44/97 [00:07<00:08,  5.99it/s, loss=4.34, v_num=0]
Epoch 14:  46%|████▋     | 45/97 [00:07<00:08,  6.06it/s, loss=4.34, v_num=0]
Epoch 14:  46%|████▋     | 45/97 [00:07<00:08,  6.02it/s, loss=4.34, v_num=0]
Epoch 14:  47%|████▋     | 46/97 [00:07<00:08,  6.08it/s, loss=4.34, v_num=0]
Epoch 14:  47%|████▋     | 46/97 [00:07<00:08,  6.04it/s, loss=4.34, v_num=0]
Epoch 14:  48%|████▊     | 47/97 [00:07<00:08,  6.11it/s, loss=4.34, v_num=0]
Epoch 14:  48%|████▊     | 47/97 [00:07<00:08,  6.06it/s, loss=4.34, v_num=0]
Epoch 14:  49%|████▉     | 48/97 [00:07<00:07,  6.13it/s, loss=4.34, v_num=0]
Epoch 14:  49%|████▉     | 48/97 [00:07<00:08,  6.08it/s, loss=4.34, v_num=0]
Epoch 14:  51%|█████     | 49/97 [00:07<00:07,  6.15it/s, loss=4.34, v_num=0]
Epoch 14:  51%|█████     | 49/97 [00:08<00:07,  6.10it/s, loss=4.35, v_num=0]
Epoch 14:  52%|█████▏    | 50/97 [00:08<00:07,  6.17it/s, loss=4.35, v_num=0]
Epoch 14:  52%|█████▏    | 50/97 [00:08<00:07,  6.12it/s, loss=4.34, v_num=0]
Epoch 14:  53%|█████▎    | 51/97 [00:08<00:07,  6.18it/s, loss=4.34, v_num=0]
Epoch 14:  53%|█████▎    | 51/97 [00:08<00:07,  6.14it/s, loss=4.34, v_num=0]
Epoch 14:  54%|█████▎    | 52/97 [00:08<00:07,  6.20it/s, loss=4.34, v_num=0]
Epoch 14:  54%|█████▎    | 52/97 [00:08<00:07,  6.16it/s, loss=4.34, v_num=0]
Epoch 14:  55%|█████▍    | 53/97 [00:08<00:07,  6.22it/s, loss=4.34, v_num=0]
Epoch 14:  55%|█████▍    | 53/97 [00:08<00:07,  6.18it/s, loss=4.34, v_num=0]
Epoch 14:  56%|█████▌    | 54/97 [00:08<00:06,  6.24it/s, loss=4.34, v_num=0]
Epoch 14:  56%|█████▌    | 54/97 [00:08<00:06,  6.20it/s, loss=4.33, v_num=0]
Epoch 14:  57%|█████▋    | 55/97 [00:08<00:06,  6.25it/s, loss=4.33, v_num=0]
Epoch 14:  57%|█████▋    | 55/97 [00:08<00:06,  6.21it/s, loss=4.34, v_num=0]
Epoch 14:  58%|█████▊    | 56/97 [00:08<00:06,  6.27it/s, loss=4.34, v_num=0]
Epoch 14:  58%|█████▊    | 56/97 [00:08<00:06,  6.23it/s, loss=4.32, v_num=0]
Epoch 14:  59%|█████▉    | 57/97 [00:09<00:06,  6.28it/s, loss=4.32, v_num=0]
Epoch 14:  59%|█████▉    | 57/97 [00:09<00:06,  6.25it/s, loss=4.32, v_num=0]
Epoch 14:  60%|█████▉    | 58/97 [00:09<00:06,  6.30it/s, loss=4.32, v_num=0]
Epoch 14:  60%|█████▉    | 58/97 [00:09<00:06,  6.26it/s, loss=4.32, v_num=0]
Epoch 14:  61%|██████    | 59/97 [00:09<00:06,  6.32it/s, loss=4.32, v_num=0]
Epoch 14:  61%|██████    | 59/97 [00:09<00:06,  6.28it/s, loss=4.33, v_num=0]
Epoch 14:  62%|██████▏   | 60/97 [00:09<00:05,  6.33it/s, loss=4.33, v_num=0]
Epoch 14:  62%|██████▏   | 60/97 [00:09<00:05,  6.29it/s, loss=4.33, v_num=0]
Epoch 14:  63%|██████▎   | 61/97 [00:09<00:05,  6.34it/s, loss=4.33, v_num=0]
Epoch 14:  63%|██████▎   | 61/97 [00:09<00:05,  6.30it/s, loss=4.32, v_num=0]
Epoch 14:  64%|██████▍   | 62/97 [00:09<00:05,  6.35it/s, loss=4.32, v_num=0]
Epoch 14:  64%|██████▍   | 62/97 [00:09<00:05,  6.32it/s, loss=4.32, v_num=0]
Epoch 14:  65%|██████▍   | 63/97 [00:09<00:05,  6.36it/s, loss=4.32, v_num=0]
Epoch 14:  65%|██████▍   | 63/97 [00:09<00:05,  6.33it/s, loss=4.32, v_num=0]
Epoch 14:  66%|██████▌   | 64/97 [00:10<00:05,  6.38it/s, loss=4.32, v_num=0]
Epoch 14:  66%|██████▌   | 64/97 [00:10<00:05,  6.34it/s, loss=4.32, v_num=0]
Epoch 14:  67%|██████▋   | 65/97 [00:10<00:05,  6.39it/s, loss=4.32, v_num=0]
Epoch 14:  67%|██████▋   | 65/97 [00:10<00:05,  6.35it/s, loss=4.32, v_num=0]
Epoch 14:  68%|██████▊   | 66/97 [00:10<00:04,  6.40it/s, loss=4.32, v_num=0]
Epoch 14:  68%|██████▊   | 66/97 [00:10<00:04,  6.36it/s, loss=4.31, v_num=0]
Epoch 14:  69%|██████▉   | 67/97 [00:10<00:04,  6.41it/s, loss=4.31, v_num=0]
Epoch 14:  69%|██████▉   | 67/97 [00:10<00:04,  6.38it/s, loss=4.31, v_num=0]
Epoch 14:  70%|███████   | 68/97 [00:10<00:04,  6.42it/s, loss=4.31, v_num=0]
Epoch 14:  70%|███████   | 68/97 [00:10<00:04,  6.39it/s, loss=4.31, v_num=0]
Epoch 14:  71%|███████   | 69/97 [00:10<00:04,  6.43it/s, loss=4.31, v_num=0]
Epoch 14:  71%|███████   | 69/97 [00:10<00:04,  6.40it/s, loss=4.31, v_num=0]
Epoch 14:  72%|███████▏  | 70/97 [00:10<00:04,  6.44it/s, loss=4.31, v_num=0]
Epoch 14:  72%|███████▏  | 70/97 [00:10<00:04,  6.41it/s, loss=4.3, v_num=0]
Epoch 14:  73%|███████▎  | 71/97 [00:10<00:04,  6.45it/s, loss=4.3, v_num=0]
Epoch 14:  73%|███████▎  | 71/97 [00:11<00:04,  6.42it/s, loss=4.3, v_num=0]
Epoch 14:  74%|███████▍  | 72/97 [00:11<00:03,  6.47it/s, loss=4.3, v_num=0]
Epoch 14:  74%|███████▍  | 72/97 [00:11<00:03,  6.43it/s, loss=4.29, v_num=0]
Epoch 14:  75%|███████▌  | 73/97 [00:11<00:03,  6.48it/s, loss=4.29, v_num=0]
Epoch 14:  75%|███████▌  | 73/97 [00:11<00:03,  6.44it/s, loss=4.29, v_num=0]
Epoch 14:  76%|███████▋  | 74/97 [00:11<00:03,  6.49it/s, loss=4.29, v_num=0]
Epoch 14:  76%|███████▋  | 74/97 [00:11<00:03,  6.45it/s, loss=4.29, v_num=0]
Epoch 14:  77%|███████▋  | 75/97 [00:11<00:03,  6.50it/s, loss=4.29, v_num=0]
Epoch 14:  77%|███████▋  | 75/97 [00:11<00:03,  6.46it/s, loss=4.29, v_num=0]
Epoch 14:  78%|███████▊  | 76/97 [00:11<00:03,  6.51it/s, loss=4.29, v_num=0]
Epoch 14:  78%|███████▊  | 76/97 [00:11<00:03,  6.47it/s, loss=4.29, v_num=0]
Epoch 14:  79%|███████▉  | 77/97 [00:11<00:03,  6.51it/s, loss=4.29, v_num=0]
Epoch 14:  79%|███████▉  | 77/97 [00:11<00:03,  6.48it/s, loss=4.28, v_num=0]
Epoch 14:  80%|████████  | 78/97 [00:11<00:02,  6.52it/s, loss=4.28, v_num=0]
Epoch 14:  80%|████████  | 78/97 [00:12<00:02,  6.49it/s, loss=4.28, v_num=0]
Epoch 14:  81%|████████▏ | 79/97 [00:12<00:02,  6.53it/s, loss=4.28, v_num=0]
Epoch 14:  81%|████████▏ | 79/97 [00:12<00:02,  6.50it/s, loss=4.28, v_num=0]
Epoch 14:  82%|████████▏ | 80/97 [00:12<00:02,  6.54it/s, loss=4.28, v_num=0]
Epoch 14:  82%|████████▏ | 80/97 [00:12<00:02,  6.51it/s, loss=4.28, v_num=0]
Epoch 14:  84%|████████▎ | 81/97 [00:12<00:02,  6.55it/s, loss=4.28, v_num=0]
Epoch 14:  84%|████████▎ | 81/97 [00:12<00:02,  6.52it/s, loss=4.28, v_num=0]
Epoch 14:  85%|████████▍ | 82/97 [00:12<00:02,  6.56it/s, loss=4.28, v_num=0]
Epoch 14:  85%|████████▍ | 82/97 [00:12<00:02,  6.53it/s, loss=4.28, v_num=0]
Epoch 14:  86%|████████▌ | 83/97 [00:12<00:02,  6.56it/s, loss=4.28, v_num=0]
Epoch 14:  86%|████████▌ | 83/97 [00:12<00:02,  6.54it/s, loss=4.28, v_num=0]
Epoch 14:  87%|████████▋ | 84/97 [00:12<00:01,  6.57it/s, loss=4.28, v_num=0]
Epoch 14:  87%|████████▋ | 84/97 [00:12<00:01,  6.55it/s, loss=4.28, v_num=0]
Epoch 14:  88%|████████▊ | 85/97 [00:12<00:01,  6.58it/s, loss=4.28, v_num=0]
Epoch 14:  88%|████████▊ | 85/97 [00:12<00:01,  6.55it/s, loss=4.28, v_num=0]
Epoch 14:  89%|████████▊ | 86/97 [00:13<00:01,  6.59it/s, loss=4.28, v_num=0]
Epoch 14:  89%|████████▊ | 86/97 [00:13<00:01,  6.56it/s, loss=4.28, v_num=0]
Epoch 14:  90%|████████▉ | 87/97 [00:13<00:01,  6.60it/s, loss=4.28, v_num=0]
Epoch 14:  90%|████████▉ | 87/97 [00:13<00:01,  6.57it/s, loss=4.28, v_num=0]
Epoch 14:  91%|█████████ | 88/97 [00:13<00:01,  6.60it/s, loss=4.28, v_num=0]
Epoch 14:  91%|█████████ | 88/97 [00:13<00:01,  6.58it/s, loss=4.29, v_num=0]
Epoch 14:  92%|█████████▏| 89/97 [00:13<00:01,  6.61it/s, loss=4.29, v_num=0]
Epoch 14:  92%|█████████▏| 89/97 [00:13<00:01,  6.58it/s, loss=4.28, v_num=0]
Epoch 14:  93%|█████████▎| 90/97 [00:13<00:01,  6.62it/s, loss=4.28, v_num=0]
Epoch 14:  93%|█████████▎| 90/97 [00:13<00:01,  6.59it/s, loss=4.28, v_num=0]
Epoch 14:  94%|█████████▍| 91/97 [00:13<00:00,  6.63it/s, loss=4.28, v_num=0]
Epoch 14:  94%|█████████▍| 91/97 [00:13<00:00,  6.60it/s, loss=4.27, v_num=0]
Epoch 14:  95%|█████████▍| 92/97 [00:13<00:00,  6.63it/s, loss=4.27, v_num=0]
Epoch 14:  95%|█████████▍| 92/97 [00:13<00:00,  6.61it/s, loss=4.29, v_num=0]
Epoch 14:  96%|█████████▌| 93/97 [00:14<00:00,  6.64it/s, loss=4.29, v_num=0]
Epoch 14:  96%|█████████▌| 93/97 [00:14<00:00,  6.61it/s, loss=4.29, v_num=0]
Epoch 14:  97%|█████████▋| 94/97 [00:14<00:00,  6.65it/s, loss=4.29, v_num=0]
Epoch 14:  97%|█████████▋| 94/97 [00:14<00:00,  6.62it/s, loss=4.29, v_num=0]
Epoch 14:  98%|█████████▊| 95/97 [00:14<00:00,  6.65it/s, loss=4.29, v_num=0]
Epoch 14:  98%|█████████▊| 95/97 [00:14<00:00,  6.63it/s, loss=4.28, v_num=0]
Epoch 14:  99%|█████████▉| 96/97 [00:14<00:00,  6.66it/s, loss=4.28, v_num=0]
Epoch 14:  99%|█████████▉| 96/97 [00:14<00:00,  6.63it/s, loss=4.29, v_num=0]
Epoch 14: 100%|██████████| 97/97 [00:14<00:00,  6.66it/s, loss=4.29, v_num=0]
Epoch 14: 100%|██████████| 97/97 [00:14<00:00,  6.64it/s, loss=4.29, v_num=0]
Epoch 14: 100%|██████████| 97/97 [00:14<00:00,  6.64it/s, loss=4.29, v_num=0]
Epoch 14:   0%|          | 0/97 [00:00<?, ?it/s, loss=4.29, v_num=0]
Epoch 15:   0%|          | 0/97 [00:00<?, ?it/s, loss=4.29, v_num=0]
Epoch 15:   1%|          | 1/97 [00:01<02:12,  1.38s/it, loss=4.29, v_num=0]
Epoch 15:   1%|          | 1/97 [00:01<02:17,  1.43s/it, loss=4.29, v_num=0]
Epoch 15:   2%|▏         | 2/97 [00:01<01:12,  1.31it/s, loss=4.29, v_num=0]
Epoch 15:   2%|▏         | 2/97 [00:01<01:15,  1.26it/s, loss=4.29, v_num=0]
Epoch 15:   3%|▎         | 3/97 [00:01<00:52,  1.81it/s, loss=4.29, v_num=0]
Epoch 15:   3%|▎         | 3/97 [00:01<00:53,  1.75it/s, loss=4.28, v_num=0]
Epoch 15:   4%|▍         | 4/97 [00:01<00:41,  2.23it/s, loss=4.28, v_num=0]
Epoch 15:   4%|▍         | 4/97 [00:01<00:43,  2.16it/s, loss=4.27, v_num=0]
Epoch 15:   5%|▌         | 5/97 [00:01<00:35,  2.59it/s, loss=4.27, v_num=0]
Epoch 15:   5%|▌         | 5/97 [00:01<00:36,  2.51it/s, loss=4.27, v_num=0]
Epoch 15:   6%|▌         | 6/97 [00:02<00:31,  2.90it/s, loss=4.27, v_num=0]
Epoch 15:   6%|▌         | 6/97 [00:02<00:32,  2.82it/s, loss=4.26, v_num=0]
Epoch 15:   7%|▋         | 7/97 [00:02<00:28,  3.17it/s, loss=4.26, v_num=0]
Epoch 15:   7%|▋         | 7/97 [00:02<00:29,  3.09it/s, loss=4.26, v_num=0]
Epoch 15:   8%|▊         | 8/97 [00:02<00:26,  3.41it/s, loss=4.26, v_num=0]
Epoch 15:   8%|▊         | 8/97 [00:02<00:26,  3.33it/s, loss=4.26, v_num=0]
Epoch 15:   9%|▉         | 9/97 [00:02<00:24,  3.61it/s, loss=4.26, v_num=0]
Epoch 15:   9%|▉         | 9/97 [00:02<00:24,  3.53it/s, loss=4.27, v_num=0]
Epoch 15:  10%|█         | 10/97 [00:02<00:22,  3.80it/s, loss=4.27, v_num=0]
Epoch 15:  10%|█         | 10/97 [00:02<00:23,  3.72it/s, loss=4.27, v_num=0]
Epoch 15:  11%|█▏        | 11/97 [00:02<00:21,  3.97it/s, loss=4.27, v_num=0]
Epoch 15:  11%|█▏        | 11/97 [00:02<00:22,  3.89it/s, loss=4.26, v_num=0]
Epoch 15:  12%|█▏        | 12/97 [00:02<00:20,  4.13it/s, loss=4.26, v_num=0]
Epoch 15:  12%|█▏        | 12/97 [00:02<00:20,  4.05it/s, loss=4.26, v_num=0]
Epoch 15:  13%|█▎        | 13/97 [00:03<00:19,  4.27it/s, loss=4.26, v_num=0]
Epoch 15:  13%|█▎        | 13/97 [00:03<00:20,  4.20it/s, loss=4.26, v_num=0]
Epoch 15:  14%|█▍        | 14/97 [00:03<00:18,  4.40it/s, loss=4.26, v_num=0]
Epoch 15:  14%|█▍        | 14/97 [00:03<00:19,  4.32it/s, loss=4.26, v_num=0]
Epoch 15:  15%|█▌        | 15/97 [00:03<00:18,  4.52it/s, loss=4.26, v_num=0]
Epoch 15:  15%|█▌        | 15/97 [00:03<00:18,  4.45it/s, loss=4.25, v_num=0]
Epoch 15:  16%|█▋        | 16/97 [00:03<00:17,  4.64it/s, loss=4.25, v_num=0]
Epoch 15:  16%|█▋        | 16/97 [00:03<00:17,  4.56it/s, loss=4.24, v_num=0]
Epoch 15:  18%|█▊        | 17/97 [00:03<00:16,  4.73it/s, loss=4.24, v_num=0]
Epoch 15:  18%|█▊        | 17/97 [00:03<00:17,  4.66it/s, loss=4.24, v_num=0]
Epoch 15:  19%|█▊        | 18/97 [00:03<00:16,  4.82it/s, loss=4.24, v_num=0]
Epoch 15:  19%|█▊        | 18/97 [00:03<00:16,  4.75it/s, loss=4.24, v_num=0]
Epoch 15:  20%|█▉        | 19/97 [00:03<00:15,  4.91it/s, loss=4.24, v_num=0]
Epoch 15:  20%|█▉        | 19/97 [00:03<00:16,  4.84it/s, loss=4.23, v_num=0]
Epoch 15:  21%|██        | 20/97 [00:04<00:15,  5.00it/s, loss=4.23, v_num=0]
Epoch 15:  21%|██        | 20/97 [00:04<00:15,  4.93it/s, loss=4.23, v_num=0]
Epoch 15:  22%|██▏       | 21/97 [00:04<00:14,  5.08it/s, loss=4.23, v_num=0]
Epoch 15:  22%|██▏       | 21/97 [00:04<00:15,  5.01it/s, loss=4.22, v_num=0]
Epoch 15:  23%|██▎       | 22/97 [00:04<00:14,  5.15it/s, loss=4.22, v_num=0]
Epoch 15:  23%|██▎       | 22/97 [00:04<00:14,  5.08it/s, loss=4.23, v_num=0]
Epoch 15:  24%|██▎       | 23/97 [00:04<00:14,  5.22it/s, loss=4.23, v_num=0]
Epoch 15:  24%|██▎       | 23/97 [00:04<00:14,  5.15it/s, loss=4.22, v_num=0]
Epoch 15:  25%|██▍       | 24/97 [00:04<00:13,  5.28it/s, loss=4.22, v_num=0]
Epoch 15:  25%|██▍       | 24/97 [00:04<00:14,  5.21it/s, loss=4.22, v_num=0]
Epoch 15:  26%|██▌       | 25/97 [00:04<00:13,  5.34it/s, loss=4.22, v_num=0]
Epoch 15:  26%|██▌       | 25/97 [00:04<00:13,  5.27it/s, loss=4.22, v_num=0]
Epoch 15:  27%|██▋       | 26/97 [00:04<00:13,  5.40it/s, loss=4.22, v_num=0]
Epoch 15:  27%|██▋       | 26/97 [00:04<00:13,  5.33it/s, loss=4.22, v_num=0]
Epoch 15:  28%|██▊       | 27/97 [00:04<00:12,  5.45it/s, loss=4.22, v_num=0]
Epoch 15:  28%|██▊       | 27/97 [00:05<00:12,  5.39it/s, loss=4.21, v_num=0]
Epoch 15:  29%|██▉       | 28/97 [00:05<00:12,  5.50it/s, loss=4.21, v_num=0]
Epoch 15:  29%|██▉       | 28/97 [00:05<00:12,  5.44it/s, loss=4.22, v_num=0]
Epoch 15:  30%|██▉       | 29/97 [00:05<00:12,  5.55it/s, loss=4.22, v_num=0]
Epoch 15:  30%|██▉       | 29/97 [00:05<00:12,  5.49it/s, loss=4.21, v_num=0]
Epoch 15:  31%|███       | 30/97 [00:05<00:11,  5.59it/s, loss=4.21, v_num=0]
Epoch 15:  31%|███       | 30/97 [00:05<00:12,  5.53it/s, loss=4.21, v_num=0]
Epoch 15:  32%|███▏      | 31/97 [00:05<00:11,  5.63it/s, loss=4.21, v_num=0]
Epoch 15:  32%|███▏      | 31/97 [00:05<00:11,  5.58it/s, loss=4.21, v_num=0]
Epoch 15:  33%|███▎      | 32/97 [00:05<00:11,  5.66it/s, loss=4.21, v_num=0]
Epoch 15:  33%|███▎      | 32/97 [00:05<00:11,  5.61it/s, loss=4.21, v_num=0]
Epoch 15:  34%|███▍      | 33/97 [00:05<00:11,  5.70it/s, loss=4.21, v_num=0]
Epoch 15:  34%|███▍      | 33/97 [00:05<00:11,  5.65it/s, loss=4.21, v_num=0]
Epoch 15:  35%|███▌      | 34/97 [00:05<00:10,  5.74it/s, loss=4.21, v_num=0]
Epoch 15:  35%|███▌      | 34/97 [00:05<00:11,  5.69it/s, loss=4.21, v_num=0]
Epoch 15:  36%|███▌      | 35/97 [00:06<00:10,  5.78it/s, loss=4.21, v_num=0]
Epoch 15:  36%|███▌      | 35/97 [00:06<00:10,  5.72it/s, loss=4.21, v_num=0]
Epoch 15:  37%|███▋      | 36/97 [00:06<00:10,  5.81it/s, loss=4.21, v_num=0]
Epoch 15:  37%|███▋      | 36/97 [00:06<00:10,  5.76it/s, loss=4.21, v_num=0]
Epoch 15:  38%|███▊      | 37/97 [00:06<00:10,  5.84it/s, loss=4.21, v_num=0]
Epoch 15:  38%|███▊      | 37/97 [00:06<00:10,  5.79it/s, loss=4.2, v_num=0]
Epoch 15:  39%|███▉      | 38/97 [00:06<00:10,  5.87it/s, loss=4.2, v_num=0]
Epoch 15:  39%|███▉      | 38/97 [00:06<00:10,  5.82it/s, loss=4.21, v_num=0]
Epoch 15:  40%|████      | 39/97 [00:06<00:09,  5.90it/s, loss=4.21, v_num=0]
Epoch 15:  40%|████      | 39/97 [00:06<00:09,  5.85it/s, loss=4.21, v_num=0]
Epoch 15:  41%|████      | 40/97 [00:06<00:09,  5.93it/s, loss=4.21, v_num=0]
Epoch 15:  41%|████      | 40/97 [00:06<00:09,  5.88it/s, loss=4.21, v_num=0]
Epoch 15:  42%|████▏     | 41/97 [00:06<00:09,  5.96it/s, loss=4.21, v_num=0]
Epoch 15:  42%|████▏     | 41/97 [00:06<00:09,  5.91it/s, loss=4.21, v_num=0]
Epoch 15:  43%|████▎     | 42/97 [00:07<00:09,  5.98it/s, loss=4.21, v_num=0]
Epoch 15:  43%|████▎     | 42/97 [00:07<00:09,  5.94it/s, loss=4.2, v_num=0]
Epoch 15:  44%|████▍     | 43/97 [00:07<00:08,  6.00it/s, loss=4.2, v_num=0]
Epoch 15:  44%|████▍     | 43/97 [00:07<00:09,  5.96it/s, loss=4.21, v_num=0]
Epoch 15:  45%|████▌     | 44/97 [00:07<00:08,  6.03it/s, loss=4.21, v_num=0]
Epoch 15:  45%|████▌     | 44/97 [00:07<00:08,  5.98it/s, loss=4.2, v_num=0]
Epoch 15:  46%|████▋     | 45/97 [00:07<00:08,  6.05it/s, loss=4.2, v_num=0]
Epoch 15:  46%|████▋     | 45/97 [00:07<00:08,  6.01it/s, loss=4.21, v_num=0]
Epoch 15:  47%|████▋     | 46/97 [00:07<00:08,  6.08it/s, loss=4.21, v_num=0]
Epoch 15:  47%|████▋     | 46/97 [00:07<00:08,  6.03it/s, loss=4.21, v_num=0]
Epoch 15:  48%|████▊     | 47/97 [00:07<00:08,  6.09it/s, loss=4.21, v_num=0]
Epoch 15:  48%|████▊     | 47/97 [00:07<00:08,  6.05it/s, loss=4.21, v_num=0]
Epoch 15:  49%|████▉     | 48/97 [00:07<00:08,  6.12it/s, loss=4.21, v_num=0]
Epoch 15:  49%|████▉     | 48/97 [00:07<00:08,  6.07it/s, loss=4.2, v_num=0]
Epoch 15:  51%|█████     | 49/97 [00:07<00:07,  6.13it/s, loss=4.2, v_num=0]
Epoch 15:  51%|█████     | 49/97 [00:08<00:07,  6.09it/s, loss=4.21, v_num=0]
Epoch 15:  52%|█████▏    | 50/97 [00:08<00:07,  6.15it/s, loss=4.21, v_num=0]
Epoch 15:  52%|█████▏    | 50/97 [00:08<00:07,  6.11it/s, loss=4.21, v_num=0]
Epoch 15:  53%|█████▎    | 51/97 [00:08<00:07,  6.17it/s, loss=4.21, v_num=0]
Epoch 15:  53%|█████▎    | 51/97 [00:08<00:07,  6.13it/s, loss=4.21, v_num=0]
Epoch 15:  54%|█████▎    | 52/97 [00:08<00:07,  6.19it/s, loss=4.21, v_num=0]
Epoch 15:  54%|█████▎    | 52/97 [00:08<00:07,  6.15it/s, loss=4.21, v_num=0]
Epoch 15:  55%|█████▍    | 53/97 [00:08<00:07,  6.21it/s, loss=4.21, v_num=0]
Epoch 15:  55%|█████▍    | 53/97 [00:08<00:07,  6.17it/s, loss=4.21, v_num=0]
Epoch 15:  56%|█████▌    | 54/97 [00:08<00:06,  6.22it/s, loss=4.21, v_num=0]
Epoch 15:  56%|█████▌    | 54/97 [00:08<00:06,  6.18it/s, loss=4.2, v_num=0]
Epoch 15:  57%|█████▋    | 55/97 [00:08<00:06,  6.24it/s, loss=4.2, v_num=0]
Epoch 15:  57%|█████▋    | 55/97 [00:08<00:06,  6.20it/s, loss=4.2, v_num=0]
Epoch 15:  58%|█████▊    | 56/97 [00:08<00:06,  6.25it/s, loss=4.2, v_num=0]
Epoch 15:  58%|█████▊    | 56/97 [00:09<00:06,  6.22it/s, loss=4.19, v_num=0]
Epoch 15:  59%|█████▉    | 57/97 [00:09<00:06,  6.27it/s, loss=4.19, v_num=0]
Epoch 15:  59%|█████▉    | 57/97 [00:09<00:06,  6.23it/s, loss=4.19, v_num=0]
Epoch 15:  60%|█████▉    | 58/97 [00:09<00:06,  6.28it/s, loss=4.19, v_num=0]
Epoch 15:  60%|█████▉    | 58/97 [00:09<00:06,  6.25it/s, loss=4.18, v_num=0]
Epoch 15:  61%|██████    | 59/97 [00:09<00:06,  6.30it/s, loss=4.18, v_num=0]
Epoch 15:  61%|██████    | 59/97 [00:09<00:06,  6.26it/s, loss=4.18, v_num=0]
Epoch 15:  62%|██████▏   | 60/97 [00:09<00:05,  6.31it/s, loss=4.18, v_num=0]
Epoch 15:  62%|██████▏   | 60/97 [00:09<00:05,  6.28it/s, loss=4.19, v_num=0]
Epoch 15:  63%|██████▎   | 61/97 [00:09<00:05,  6.32it/s, loss=4.19, v_num=0]
Epoch 15:  63%|██████▎   | 61/97 [00:09<00:05,  6.29it/s, loss=4.19, v_num=0]
Epoch 15:  64%|██████▍   | 62/97 [00:09<00:05,  6.34it/s, loss=4.19, v_num=0]
Epoch 15:  64%|██████▍   | 62/97 [00:09<00:05,  6.30it/s, loss=4.19, v_num=0]
Epoch 15:  65%|██████▍   | 63/97 [00:09<00:05,  6.35it/s, loss=4.19, v_num=0]
Epoch 15:  65%|██████▍   | 63/97 [00:09<00:05,  6.31it/s, loss=4.17, v_num=0]
Epoch 15:  66%|██████▌   | 64/97 [00:10<00:05,  6.36it/s, loss=4.17, v_num=0]
Epoch 15:  66%|██████▌   | 64/97 [00:10<00:05,  6.33it/s, loss=4.17, v_num=0]
Epoch 15:  67%|██████▋   | 65/97 [00:10<00:05,  6.38it/s, loss=4.17, v_num=0]
Epoch 15:  67%|██████▋   | 65/97 [00:10<00:05,  6.34it/s, loss=4.17, v_num=0]
Epoch 15:  68%|██████▊   | 66/97 [00:10<00:04,  6.39it/s, loss=4.17, v_num=0]
Epoch 15:  68%|██████▊   | 66/97 [00:10<00:04,  6.35it/s, loss=4.17, v_num=0]
Epoch 15:  69%|██████▉   | 67/97 [00:10<00:04,  6.40it/s, loss=4.17, v_num=0]
Epoch 15:  69%|██████▉   | 67/97 [00:10<00:04,  6.37it/s, loss=4.17, v_num=0]
Epoch 15:  70%|███████   | 68/97 [00:10<00:04,  6.41it/s, loss=4.17, v_num=0]
Epoch 15:  70%|███████   | 68/97 [00:10<00:04,  6.38it/s, loss=4.17, v_num=0]
Epoch 15:  71%|███████   | 69/97 [00:10<00:04,  6.42it/s, loss=4.17, v_num=0]
Epoch 15:  71%|███████   | 69/97 [00:10<00:04,  6.39it/s, loss=4.17, v_num=0]
Epoch 15:  72%|███████▏  | 70/97 [00:10<00:04,  6.43it/s, loss=4.17, v_num=0]
Epoch 15:  72%|███████▏  | 70/97 [00:10<00:04,  6.40it/s, loss=4.15, v_num=0]
Epoch 15:  73%|███████▎  | 71/97 [00:11<00:04,  6.44it/s, loss=4.15, v_num=0]
Epoch 15:  73%|███████▎  | 71/97 [00:11<00:04,  6.41it/s, loss=4.15, v_num=0]
Epoch 15:  74%|███████▍  | 72/97 [00:11<00:03,  6.46it/s, loss=4.15, v_num=0]
Epoch 15:  74%|███████▍  | 72/97 [00:11<00:03,  6.42it/s, loss=4.14, v_num=0]
Epoch 15:  75%|███████▌  | 73/97 [00:11<00:03,  6.47it/s, loss=4.14, v_num=0]
Epoch 15:  75%|███████▌  | 73/97 [00:11<00:03,  6.43it/s, loss=4.14, v_num=0]
Epoch 15:  76%|███████▋  | 74/97 [00:11<00:03,  6.48it/s, loss=4.14, v_num=0]
Epoch 15:  76%|███████▋  | 74/97 [00:11<00:03,  6.44it/s, loss=4.14, v_num=0]
Epoch 15:  77%|███████▋  | 75/97 [00:11<00:03,  6.48it/s, loss=4.14, v_num=0]
Epoch 15:  77%|███████▋  | 75/97 [00:11<00:03,  6.45it/s, loss=4.14, v_num=0]
Epoch 15:  78%|███████▊  | 76/97 [00:11<00:03,  6.49it/s, loss=4.14, v_num=0]
Epoch 15:  78%|███████▊  | 76/97 [00:11<00:03,  6.46it/s, loss=4.14, v_num=0]
Epoch 15:  79%|███████▉  | 77/97 [00:11<00:03,  6.50it/s, loss=4.14, v_num=0]
Epoch 15:  79%|███████▉  | 77/97 [00:11<00:03,  6.47it/s, loss=4.15, v_num=0]
Epoch 15:  80%|████████  | 78/97 [00:11<00:02,  6.51it/s, loss=4.15, v_num=0]
Epoch 15:  80%|████████  | 78/97 [00:12<00:02,  6.48it/s, loss=4.15, v_num=0]
Epoch 15:  81%|████████▏ | 79/97 [00:12<00:02,  6.52it/s, loss=4.15, v_num=0]
Epoch 15:  81%|████████▏ | 79/97 [00:12<00:02,  6.49it/s, loss=4.14, v_num=0]
Epoch 15:  82%|████████▏ | 80/97 [00:12<00:02,  6.53it/s, loss=4.14, v_num=0]
Epoch 15:  82%|████████▏ | 80/97 [00:12<00:02,  6.50it/s, loss=4.14, v_num=0]
Epoch 15:  84%|████████▎ | 81/97 [00:12<00:02,  6.54it/s, loss=4.14, v_num=0]
Epoch 15:  84%|████████▎ | 81/97 [00:12<00:02,  6.51it/s, loss=4.14, v_num=0]
Epoch 15:  85%|████████▍ | 82/97 [00:12<00:02,  6.54it/s, loss=4.14, v_num=0]
Epoch 15:  85%|████████▍ | 82/97 [00:12<00:02,  6.51it/s, loss=4.13, v_num=0]
Epoch 15:  86%|████████▌ | 83/97 [00:12<00:02,  6.55it/s, loss=4.13, v_num=0]
Epoch 15:  86%|████████▌ | 83/97 [00:12<00:02,  6.52it/s, loss=4.15, v_num=0]
Epoch 15:  87%|████████▋ | 84/97 [00:12<00:01,  6.56it/s, loss=4.15, v_num=0]
Epoch 15:  87%|████████▋ | 84/97 [00:12<00:01,  6.53it/s, loss=4.15, v_num=0]
Epoch 15:  88%|████████▊ | 85/97 [00:12<00:01,  6.56it/s, loss=4.15, v_num=0]
Epoch 15:  88%|████████▊ | 85/97 [00:13<00:01,  6.53it/s, loss=4.14, v_num=0]
Epoch 15:  89%|████████▊ | 86/97 [00:13<00:01,  6.57it/s, loss=4.14, v_num=0]
Epoch 15:  89%|████████▊ | 86/97 [00:13<00:01,  6.54it/s, loss=4.13, v_num=0]
Epoch 15:  90%|████████▉ | 87/97 [00:13<00:01,  6.58it/s, loss=4.13, v_num=0]
Epoch 15:  90%|████████▉ | 87/97 [00:13<00:01,  6.55it/s, loss=4.13, v_num=0]
Epoch 15:  91%|█████████ | 88/97 [00:13<00:01,  6.59it/s, loss=4.13, v_num=0]
Epoch 15:  91%|█████████ | 88/97 [00:13<00:01,  6.56it/s, loss=4.13, v_num=0]
Epoch 15:  92%|█████████▏| 89/97 [00:13<00:01,  6.59it/s, loss=4.13, v_num=0]
Epoch 15:  92%|█████████▏| 89/97 [00:13<00:01,  6.57it/s, loss=4.13, v_num=0]
Epoch 15:  93%|█████████▎| 90/97 [00:13<00:01,  6.60it/s, loss=4.13, v_num=0]
Epoch 15:  93%|█████████▎| 90/97 [00:13<00:01,  6.57it/s, loss=4.14, v_num=0]
Epoch 15:  94%|█████████▍| 91/97 [00:13<00:00,  6.61it/s, loss=4.14, v_num=0]
Epoch 15:  94%|█████████▍| 91/97 [00:13<00:00,  6.58it/s, loss=4.14, v_num=0]
Epoch 15:  95%|█████████▍| 92/97 [00:13<00:00,  6.61it/s, loss=4.14, v_num=0]
Epoch 15:  95%|█████████▍| 92/97 [00:13<00:00,  6.58it/s, loss=4.14, v_num=0]
Epoch 15:  96%|█████████▌| 93/97 [00:14<00:00,  6.62it/s, loss=4.14, v_num=0]
Epoch 15:  96%|█████████▌| 93/97 [00:14<00:00,  6.59it/s, loss=4.15, v_num=0]
Epoch 15:  97%|█████████▋| 94/97 [00:14<00:00,  6.62it/s, loss=4.15, v_num=0]
Epoch 15:  97%|█████████▋| 94/97 [00:14<00:00,  6.60it/s, loss=4.14, v_num=0]
Epoch 15:  98%|█████████▊| 95/97 [00:14<00:00,  6.63it/s, loss=4.14, v_num=0]
Epoch 15:  98%|█████████▊| 95/97 [00:14<00:00,  6.61it/s, loss=4.14, v_num=0]
Epoch 15:  99%|█████████▉| 96/97 [00:14<00:00,  6.64it/s, loss=4.14, v_num=0]
Epoch 15:  99%|█████████▉| 96/97 [00:14<00:00,  6.61it/s, loss=4.14, v_num=0]
Epoch 15: 100%|██████████| 97/97 [00:14<00:00,  6.65it/s, loss=4.14, v_num=0]
Epoch 15: 100%|██████████| 97/97 [00:14<00:00,  6.62it/s, loss=4.14, v_num=0]
Epoch 15: 100%|██████████| 97/97 [00:14<00:00,  6.62it/s, loss=4.14, v_num=0]
Epoch 15:   0%|          | 0/97 [00:00<?, ?it/s, loss=4.14, v_num=0]
Epoch 16:   0%|          | 0/97 [00:00<?, ?it/s, loss=4.14, v_num=0]
Epoch 16:   1%|          | 1/97 [00:01<02:13,  1.39s/it, loss=4.14, v_num=0]
Epoch 16:   1%|          | 1/97 [00:01<02:18,  1.44s/it, loss=4.14, v_num=0]
Epoch 16:   2%|▏         | 2/97 [00:01<01:12,  1.30it/s, loss=4.14, v_num=0]
Epoch 16:   2%|▏         | 2/97 [00:01<01:15,  1.26it/s, loss=4.13, v_num=0]
Epoch 16:   3%|▎         | 3/97 [00:01<00:52,  1.79it/s, loss=4.13, v_num=0]
Epoch 16:   3%|▎         | 3/97 [00:01<00:54,  1.74it/s, loss=4.13, v_num=0]
Epoch 16:   4%|▍         | 4/97 [00:01<00:42,  2.21it/s, loss=4.13, v_num=0]
Epoch 16:   4%|▍         | 4/97 [00:01<00:43,  2.15it/s, loss=4.14, v_num=0]
Epoch 16:   5%|▌         | 5/97 [00:01<00:35,  2.57it/s, loss=4.14, v_num=0]
Epoch 16:   5%|▌         | 5/97 [00:02<00:36,  2.50it/s, loss=4.14, v_num=0]
Epoch 16:   6%|▌         | 6/97 [00:02<00:31,  2.89it/s, loss=4.14, v_num=0]
Epoch 16:   6%|▌         | 6/97 [00:02<00:32,  2.81it/s, loss=4.14, v_num=0]
Epoch 16:   7%|▋         | 7/97 [00:02<00:28,  3.16it/s, loss=4.14, v_num=0]
Epoch 16:   7%|▋         | 7/97 [00:02<00:29,  3.08it/s, loss=4.15, v_num=0]
Epoch 16:   8%|▊         | 8/97 [00:02<00:26,  3.40it/s, loss=4.15, v_num=0]
Epoch 16:   8%|▊         | 8/97 [00:02<00:26,  3.32it/s, loss=4.15, v_num=0]
Epoch 16:   9%|▉         | 9/97 [00:02<00:24,  3.60it/s, loss=4.15, v_num=0]
Epoch 16:   9%|▉         | 9/97 [00:02<00:24,  3.53it/s, loss=4.16, v_num=0]
Epoch 16:  10%|█         | 10/97 [00:02<00:22,  3.80it/s, loss=4.16, v_num=0]
Epoch 16:  10%|█         | 10/97 [00:02<00:23,  3.72it/s, loss=4.15, v_num=0]
Epoch 16:  11%|█▏        | 11/97 [00:02<00:21,  3.97it/s, loss=4.15, v_num=0]
Epoch 16:  11%|█▏        | 11/97 [00:02<00:22,  3.89it/s, loss=4.15, v_num=0]
Epoch 16:  12%|█▏        | 12/97 [00:02<00:20,  4.12it/s, loss=4.15, v_num=0]
Epoch 16:  12%|█▏        | 12/97 [00:02<00:21,  4.05it/s, loss=4.15, v_num=0]
Epoch 16:  13%|█▎        | 13/97 [00:03<00:19,  4.26it/s, loss=4.15, v_num=0]
Epoch 16:  13%|█▎        | 13/97 [00:03<00:20,  4.18it/s, loss=4.15, v_num=0]
Epoch 16:  14%|█▍        | 14/97 [00:03<00:18,  4.40it/s, loss=4.15, v_num=0]
Epoch 16:  14%|█▍        | 14/97 [00:03<00:19,  4.32it/s, loss=4.15, v_num=0]
Epoch 16:  15%|█▌        | 15/97 [00:03<00:18,  4.51it/s, loss=4.15, v_num=0]
Epoch 16:  15%|█▌        | 15/97 [00:03<00:18,  4.44it/s, loss=4.15, v_num=0]
Epoch 16:  16%|█▋        | 16/97 [00:03<00:17,  4.62it/s, loss=4.15, v_num=0]
Epoch 16:  16%|█▋        | 16/97 [00:03<00:17,  4.54it/s, loss=4.14, v_num=0]
Epoch 16:  18%|█▊        | 17/97 [00:03<00:16,  4.71it/s, loss=4.14, v_num=0]
Epoch 16:  18%|█▊        | 17/97 [00:03<00:17,  4.64it/s, loss=4.14, v_num=0]
Epoch 16:  19%|█▊        | 18/97 [00:03<00:16,  4.81it/s, loss=4.14, v_num=0]
Epoch 16:  19%|█▊        | 18/97 [00:03<00:16,  4.74it/s, loss=4.14, v_num=0]
Epoch 16:  20%|█▉        | 19/97 [00:03<00:15,  4.90it/s, loss=4.14, v_num=0]
Epoch 16:  20%|█▉        | 19/97 [00:03<00:16,  4.83it/s, loss=4.14, v_num=0]
Epoch 16:  21%|██        | 20/97 [00:04<00:15,  4.98it/s, loss=4.14, v_num=0]
Epoch 16:  21%|██        | 20/97 [00:04<00:15,  4.92it/s, loss=4.14, v_num=0]
Epoch 16:  22%|██▏       | 21/97 [00:04<00:15,  5.06it/s, loss=4.14, v_num=0]
Epoch 16:  22%|██▏       | 21/97 [00:04<00:15,  5.00it/s, loss=4.14, v_num=0]
Epoch 16:  23%|██▎       | 22/97 [00:04<00:14,  5.14it/s, loss=4.14, v_num=0]
Epoch 16:  23%|██▎       | 22/97 [00:04<00:14,  5.07it/s, loss=4.14, v_num=0]
Epoch 16:  24%|██▎       | 23/97 [00:04<00:14,  5.20it/s, loss=4.14, v_num=0]
Epoch 16:  24%|██▎       | 23/97 [00:04<00:14,  5.13it/s, loss=4.14, v_num=0]
Epoch 16:  25%|██▍       | 24/97 [00:04<00:13,  5.26it/s, loss=4.14, v_num=0]
Epoch 16:  25%|██▍       | 24/97 [00:04<00:14,  5.20it/s, loss=4.14, v_num=0]
Epoch 16:  26%|██▌       | 25/97 [00:04<00:13,  5.32it/s, loss=4.14, v_num=0]
Epoch 16:  26%|██▌       | 25/97 [00:04<00:13,  5.26it/s, loss=4.13, v_num=0]
Epoch 16:  27%|██▋       | 26/97 [00:04<00:13,  5.37it/s, loss=4.13, v_num=0]
Epoch 16:  27%|██▋       | 26/97 [00:04<00:13,  5.31it/s, loss=4.13, v_num=0]
Epoch 16:  28%|██▊       | 27/97 [00:04<00:12,  5.43it/s, loss=4.13, v_num=0]
Epoch 16:  28%|██▊       | 27/97 [00:05<00:13,  5.37it/s, loss=4.12, v_num=0]
Epoch 16:  29%|██▉       | 28/97 [00:05<00:12,  5.49it/s, loss=4.12, v_num=0]
Epoch 16:  29%|██▉       | 28/97 [00:05<00:12,  5.42it/s, loss=4.12, v_num=0]
Epoch 16:  30%|██▉       | 29/97 [00:05<00:12,  5.53it/s, loss=4.12, v_num=0]
Epoch 16:  30%|██▉       | 29/97 [00:05<00:12,  5.47it/s, loss=4.11, v_num=0]
Epoch 16:  31%|███       | 30/97 [00:05<00:12,  5.57it/s, loss=4.11, v_num=0]
Epoch 16:  31%|███       | 30/97 [00:05<00:12,  5.52it/s, loss=4.12, v_num=0]
Epoch 16:  32%|███▏      | 31/97 [00:05<00:11,  5.62it/s, loss=4.12, v_num=0]
Epoch 16:  32%|███▏      | 31/97 [00:05<00:11,  5.56it/s, loss=4.12, v_num=0]
Epoch 16:  33%|███▎      | 32/97 [00:05<00:11,  5.66it/s, loss=4.12, v_num=0]
Epoch 16:  33%|███▎      | 32/97 [00:05<00:11,  5.60it/s, loss=4.1, v_num=0]
Epoch 16:  34%|███▍      | 33/97 [00:05<00:11,  5.69it/s, loss=4.1, v_num=0]
Epoch 16:  34%|███▍      | 33/97 [00:05<00:11,  5.64it/s, loss=4.1, v_num=0]
Epoch 16:  35%|███▌      | 34/97 [00:05<00:10,  5.73it/s, loss=4.1, v_num=0]
Epoch 16:  35%|███▌      | 34/97 [00:05<00:11,  5.68it/s, loss=4.1, v_num=0]
Epoch 16:  36%|███▌      | 35/97 [00:06<00:10,  5.77it/s, loss=4.1, v_num=0]
Epoch 16:  36%|███▌      | 35/97 [00:06<00:10,  5.72it/s, loss=4.1, v_num=0]
Epoch 16:  37%|███▋      | 36/97 [00:06<00:10,  5.80it/s, loss=4.1, v_num=0]
Epoch 16:  37%|███▋      | 36/97 [00:06<00:10,  5.75it/s, loss=4.11, v_num=0]
Epoch 16:  38%|███▊      | 37/97 [00:06<00:10,  5.84it/s, loss=4.11, v_num=0]
Epoch 16:  38%|███▊      | 37/97 [00:06<00:10,  5.79it/s, loss=4.1, v_num=0]
Epoch 16:  39%|███▉      | 38/97 [00:06<00:10,  5.87it/s, loss=4.1, v_num=0]
Epoch 16:  39%|███▉      | 38/97 [00:06<00:10,  5.82it/s, loss=4.1, v_num=0]
Epoch 16:  40%|████      | 39/97 [00:06<00:09,  5.90it/s, loss=4.1, v_num=0]
Epoch 16:  40%|████      | 39/97 [00:06<00:09,  5.85it/s, loss=4.09, v_num=0]
Epoch 16:  41%|████      | 40/97 [00:06<00:09,  5.93it/s, loss=4.09, v_num=0]
Epoch 16:  41%|████      | 40/97 [00:06<00:09,  5.88it/s, loss=4.1, v_num=0]
Epoch 16:  42%|████▏     | 41/97 [00:06<00:09,  5.95it/s, loss=4.1, v_num=0]
Epoch 16:  42%|████▏     | 41/97 [00:06<00:09,  5.91it/s, loss=4.1, v_num=0]
Epoch 16:  43%|████▎     | 42/97 [00:07<00:09,  5.98it/s, loss=4.1, v_num=0]
Epoch 16:  43%|████▎     | 42/97 [00:07<00:09,  5.93it/s, loss=4.1, v_num=0]
Epoch 16:  44%|████▍     | 43/97 [00:07<00:08,  6.01it/s, loss=4.1, v_num=0]
Epoch 16:  44%|████▍     | 43/97 [00:07<00:09,  5.96it/s, loss=4.1, v_num=0]
Epoch 16:  45%|████▌     | 44/97 [00:07<00:08,  6.03it/s, loss=4.1, v_num=0]
Epoch 16:  45%|████▌     | 44/97 [00:07<00:08,  5.98it/s, loss=4.1, v_num=0]
Epoch 16:  46%|████▋     | 45/97 [00:07<00:08,  6.05it/s, loss=4.1, v_num=0]
Epoch 16:  46%|████▋     | 45/97 [00:07<00:08,  6.01it/s, loss=4.1, v_num=0]
Epoch 16:  47%|████▋     | 46/97 [00:07<00:08,  6.08it/s, loss=4.1, v_num=0]
Epoch 16:  47%|████▋     | 46/97 [00:07<00:08,  6.03it/s, loss=4.1, v_num=0]
Epoch 16:  48%|████▊     | 47/97 [00:07<00:08,  6.10it/s, loss=4.1, v_num=0]
Epoch 16:  48%|████▊     | 47/97 [00:07<00:08,  6.05it/s, loss=4.11, v_num=0]
Epoch 16:  49%|████▉     | 48/97 [00:07<00:08,  6.12it/s, loss=4.11, v_num=0]
Epoch 16:  49%|████▉     | 48/97 [00:07<00:08,  6.07it/s, loss=4.11, v_num=0]
Epoch 16:  51%|█████     | 49/97 [00:07<00:07,  6.13it/s, loss=4.11, v_num=0]
Epoch 16:  51%|█████     | 49/97 [00:08<00:07,  6.09it/s, loss=4.12, v_num=0]
Epoch 16:  52%|█████▏    | 50/97 [00:08<00:07,  6.15it/s, loss=4.12, v_num=0]
Epoch 16:  52%|█████▏    | 50/97 [00:08<00:07,  6.11it/s, loss=4.11, v_num=0]
Epoch 16:  53%|█████▎    | 51/97 [00:08<00:07,  6.17it/s, loss=4.11, v_num=0]
Epoch 16:  53%|█████▎    | 51/97 [00:08<00:07,  6.13it/s, loss=4.1, v_num=0]
Epoch 16:  54%|█████▎    | 52/97 [00:08<00:07,  6.19it/s, loss=4.1, v_num=0]
Epoch 16:  54%|█████▎    | 52/97 [00:08<00:07,  6.15it/s, loss=4.11, v_num=0]
Epoch 16:  55%|█████▍    | 53/97 [00:08<00:07,  6.21it/s, loss=4.11, v_num=0]
Epoch 16:  55%|█████▍    | 53/97 [00:08<00:07,  6.17it/s, loss=4.11, v_num=0]
Epoch 16:  56%|█████▌    | 54/97 [00:08<00:06,  6.22it/s, loss=4.11, v_num=0]
Epoch 16:  56%|█████▌    | 54/97 [00:08<00:06,  6.18it/s, loss=4.11, v_num=0]
Epoch 16:  57%|█████▋    | 55/97 [00:08<00:06,  6.24it/s, loss=4.11, v_num=0]
Epoch 16:  57%|█████▋    | 55/97 [00:08<00:06,  6.20it/s, loss=4.11, v_num=0]
Epoch 16:  58%|█████▊    | 56/97 [00:08<00:06,  6.25it/s, loss=4.11, v_num=0]
Epoch 16:  58%|█████▊    | 56/97 [00:09<00:06,  6.21it/s, loss=4.11, v_num=0]
Epoch 16:  59%|█████▉    | 57/97 [00:09<00:06,  6.27it/s, loss=4.11, v_num=0]
Epoch 16:  59%|█████▉    | 57/97 [00:09<00:06,  6.23it/s, loss=4.11, v_num=0]
Epoch 16:  60%|█████▉    | 58/97 [00:09<00:06,  6.29it/s, loss=4.11, v_num=0]
Epoch 16:  60%|█████▉    | 58/97 [00:09<00:06,  6.25it/s, loss=4.11, v_num=0]
Epoch 16:  61%|██████    | 59/97 [00:09<00:06,  6.30it/s, loss=4.11, v_num=0]
Epoch 16:  61%|██████    | 59/97 [00:09<00:06,  6.26it/s, loss=4.11, v_num=0]
Epoch 16:  62%|██████▏   | 60/97 [00:09<00:05,  6.31it/s, loss=4.11, v_num=0]
Epoch 16:  62%|██████▏   | 60/97 [00:09<00:05,  6.27it/s, loss=4.11, v_num=0]
Epoch 16:  63%|██████▎   | 61/97 [00:09<00:05,  6.32it/s, loss=4.11, v_num=0]
Epoch 16:  63%|██████▎   | 61/97 [00:09<00:05,  6.29it/s, loss=4.1, v_num=0]
Epoch 16:  64%|██████▍   | 62/97 [00:09<00:05,  6.33it/s, loss=4.1, v_num=0]
Epoch 16:  64%|██████▍   | 62/97 [00:09<00:05,  6.30it/s, loss=4.1, v_num=0]
Epoch 16:  65%|██████▍   | 63/97 [00:09<00:05,  6.35it/s, loss=4.1, v_num=0]
Epoch 16:  65%|██████▍   | 63/97 [00:09<00:05,  6.31it/s, loss=4.09, v_num=0]
Epoch 16:  66%|██████▌   | 64/97 [00:10<00:05,  6.36it/s, loss=4.09, v_num=0]
Epoch 16:  66%|██████▌   | 64/97 [00:10<00:05,  6.32it/s, loss=4.09, v_num=0]
Epoch 16:  67%|██████▋   | 65/97 [00:10<00:05,  6.37it/s, loss=4.09, v_num=0]
Epoch 16:  67%|██████▋   | 65/97 [00:10<00:05,  6.33it/s, loss=4.09, v_num=0]
Epoch 16:  68%|██████▊   | 66/97 [00:10<00:04,  6.38it/s, loss=4.09, v_num=0]
Epoch 16:  68%|██████▊   | 66/97 [00:10<00:04,  6.35it/s, loss=4.09, v_num=0]
Epoch 16:  69%|██████▉   | 67/97 [00:10<00:04,  6.39it/s, loss=4.09, v_num=0]
Epoch 16:  69%|██████▉   | 67/97 [00:10<00:04,  6.36it/s, loss=4.08, v_num=0]
Epoch 16:  70%|███████   | 68/97 [00:10<00:04,  6.41it/s, loss=4.08, v_num=0]
Epoch 16:  70%|███████   | 68/97 [00:10<00:04,  6.37it/s, loss=4.07, v_num=0]
Epoch 16:  71%|███████   | 69/97 [00:10<00:04,  6.42it/s, loss=4.07, v_num=0]
Epoch 16:  71%|███████   | 69/97 [00:10<00:04,  6.38it/s, loss=4.07, v_num=0]
Epoch 16:  72%|███████▏  | 70/97 [00:10<00:04,  6.43it/s, loss=4.07, v_num=0]
Epoch 16:  72%|███████▏  | 70/97 [00:10<00:04,  6.40it/s, loss=4.08, v_num=0]
Epoch 16:  73%|███████▎  | 71/97 [00:11<00:04,  6.44it/s, loss=4.08, v_num=0]
Epoch 16:  73%|███████▎  | 71/97 [00:11<00:04,  6.41it/s, loss=4.09, v_num=0]
Epoch 16:  74%|███████▍  | 72/97 [00:11<00:03,  6.45it/s, loss=4.09, v_num=0]
Epoch 16:  74%|███████▍  | 72/97 [00:11<00:03,  6.42it/s, loss=4.09, v_num=0]
Epoch 16:  75%|███████▌  | 73/97 [00:11<00:03,  6.46it/s, loss=4.09, v_num=0]
Epoch 16:  75%|███████▌  | 73/97 [00:11<00:03,  6.43it/s, loss=4.09, v_num=0]
Epoch 16:  76%|███████▋  | 74/97 [00:11<00:03,  6.47it/s, loss=4.09, v_num=0]
Epoch 16:  76%|███████▋  | 74/97 [00:11<00:03,  6.44it/s, loss=4.08, v_num=0]
Epoch 16:  77%|███████▋  | 75/97 [00:11<00:03,  6.48it/s, loss=4.08, v_num=0]
Epoch 16:  77%|███████▋  | 75/97 [00:11<00:03,  6.45it/s, loss=4.08, v_num=0]
Epoch 16:  78%|███████▊  | 76/97 [00:11<00:03,  6.49it/s, loss=4.08, v_num=0]
Epoch 16:  78%|███████▊  | 76/97 [00:11<00:03,  6.46it/s, loss=4.07, v_num=0]
Epoch 16:  79%|███████▉  | 77/97 [00:11<00:03,  6.49it/s, loss=4.07, v_num=0]
Epoch 16:  79%|███████▉  | 77/97 [00:11<00:03,  6.47it/s, loss=4.07, v_num=0]
Epoch 16:  80%|████████  | 78/97 [00:11<00:02,  6.50it/s, loss=4.07, v_num=0]
Epoch 16:  80%|████████  | 78/97 [00:12<00:02,  6.47it/s, loss=4.08, v_num=0]
Epoch 16:  81%|████████▏ | 79/97 [00:12<00:02,  6.52it/s, loss=4.08, v_num=0]
Epoch 16:  81%|████████▏ | 79/97 [00:12<00:02,  6.48it/s, loss=4.07, v_num=0]
Epoch 16:  82%|████████▏ | 80/97 [00:12<00:02,  6.52it/s, loss=4.07, v_num=0]
Epoch 16:  82%|████████▏ | 80/97 [00:12<00:02,  6.49it/s, loss=4.07, v_num=0]
Epoch 16:  84%|████████▎ | 81/97 [00:12<00:02,  6.53it/s, loss=4.07, v_num=0]
Epoch 16:  84%|████████▎ | 81/97 [00:12<00:02,  6.50it/s, loss=4.07, v_num=0]
Epoch 16:  85%|████████▍ | 82/97 [00:12<00:02,  6.53it/s, loss=4.07, v_num=0]
Epoch 16:  85%|████████▍ | 82/97 [00:12<00:02,  6.50it/s, loss=4.07, v_num=0]
Epoch 16:  86%|████████▌ | 83/97 [00:12<00:02,  6.54it/s, loss=4.07, v_num=0]
Epoch 16:  86%|████████▌ | 83/97 [00:12<00:02,  6.51it/s, loss=4.07, v_num=0]
Epoch 16:  87%|████████▋ | 84/97 [00:12<00:01,  6.55it/s, loss=4.07, v_num=0]
Epoch 16:  87%|████████▋ | 84/97 [00:12<00:01,  6.52it/s, loss=4.06, v_num=0]
Epoch 16:  88%|████████▊ | 85/97 [00:12<00:01,  6.56it/s, loss=4.06, v_num=0]
Epoch 16:  88%|████████▊ | 85/97 [00:13<00:01,  6.53it/s, loss=4.06, v_num=0]
Epoch 16:  89%|████████▊ | 86/97 [00:13<00:01,  6.57it/s, loss=4.06, v_num=0]
Epoch 16:  89%|████████▊ | 86/97 [00:13<00:01,  6.54it/s, loss=4.06, v_num=0]
Epoch 16:  90%|████████▉ | 87/97 [00:13<00:01,  6.57it/s, loss=4.06, v_num=0]
Epoch 16:  90%|████████▉ | 87/97 [00:13<00:01,  6.55it/s, loss=4.06, v_num=0]
Epoch 16:  91%|█████████ | 88/97 [00:13<00:01,  6.58it/s, loss=4.06, v_num=0]
Epoch 16:  91%|█████████ | 88/97 [00:13<00:01,  6.55it/s, loss=4.06, v_num=0]
Epoch 16:  92%|█████████▏| 89/97 [00:13<00:01,  6.59it/s, loss=4.06, v_num=0]
Epoch 16:  92%|█████████▏| 89/97 [00:13<00:01,  6.56it/s, loss=4.05, v_num=0]
Epoch 16:  93%|█████████▎| 90/97 [00:13<00:01,  6.60it/s, loss=4.05, v_num=0]
Epoch 16:  93%|█████████▎| 90/97 [00:13<00:01,  6.57it/s, loss=4.05, v_num=0]
Epoch 16:  94%|█████████▍| 91/97 [00:13<00:00,  6.60it/s, loss=4.05, v_num=0]
Epoch 16:  94%|█████████▍| 91/97 [00:13<00:00,  6.57it/s, loss=4.04, v_num=0]
Epoch 16:  95%|█████████▍| 92/97 [00:13<00:00,  6.61it/s, loss=4.04, v_num=0]
Epoch 16:  95%|█████████▍| 92/97 [00:13<00:00,  6.58it/s, loss=4.04, v_num=0]
Epoch 16:  96%|█████████▌| 93/97 [00:14<00:00,  6.61it/s, loss=4.04, v_num=0]
Epoch 16:  96%|█████████▌| 93/97 [00:14<00:00,  6.59it/s, loss=4.04, v_num=0]
Epoch 16:  97%|█████████▋| 94/97 [00:14<00:00,  6.62it/s, loss=4.04, v_num=0]
Epoch 16:  97%|█████████▋| 94/97 [00:14<00:00,  6.60it/s, loss=4.05, v_num=0]
Epoch 16:  98%|█████████▊| 95/97 [00:14<00:00,  6.63it/s, loss=4.05, v_num=0]
Epoch 16:  98%|█████████▊| 95/97 [00:14<00:00,  6.60it/s, loss=4.04, v_num=0]
Epoch 16:  99%|█████████▉| 96/97 [00:14<00:00,  6.64it/s, loss=4.04, v_num=0]
Epoch 16:  99%|█████████▉| 96/97 [00:14<00:00,  6.61it/s, loss=4.04, v_num=0]
Epoch 16: 100%|██████████| 97/97 [00:14<00:00,  6.64it/s, loss=4.04, v_num=0]
Epoch 16: 100%|██████████| 97/97 [00:14<00:00,  6.62it/s, loss=4.03, v_num=0]
Epoch 16: 100%|██████████| 97/97 [00:14<00:00,  6.62it/s, loss=4.03, v_num=0]
Epoch 16:   0%|          | 0/97 [00:00<?, ?it/s, loss=4.03, v_num=0]
Epoch 17:   0%|          | 0/97 [00:00<?, ?it/s, loss=4.03, v_num=0]
Epoch 17:   1%|          | 1/97 [00:01<02:10,  1.36s/it, loss=4.03, v_num=0]
Epoch 17:   1%|          | 1/97 [00:01<02:15,  1.42s/it, loss=4.03, v_num=0]
Epoch 17:   2%|▏         | 2/97 [00:01<01:11,  1.34it/s, loss=4.03, v_num=0]
Epoch 17:   2%|▏         | 2/97 [00:01<01:13,  1.29it/s, loss=4.04, v_num=0]
Epoch 17:   3%|▎         | 3/97 [00:01<00:51,  1.82it/s, loss=4.04, v_num=0]
Epoch 17:   3%|▎         | 3/97 [00:01<00:53,  1.76it/s, loss=4.04, v_num=0]
Epoch 17:   4%|▍         | 4/97 [00:01<00:41,  2.24it/s, loss=4.04, v_num=0]
Epoch 17:   4%|▍         | 4/97 [00:01<00:42,  2.18it/s, loss=4.05, v_num=0]
Epoch 17:   5%|▌         | 5/97 [00:01<00:35,  2.60it/s, loss=4.05, v_num=0]
Epoch 17:   5%|▌         | 5/97 [00:01<00:36,  2.53it/s, loss=4.05, v_num=0]
Epoch 17:   6%|▌         | 6/97 [00:02<00:31,  2.92it/s, loss=4.05, v_num=0]
Epoch 17:   6%|▌         | 6/97 [00:02<00:32,  2.84it/s, loss=4.05, v_num=0]
Epoch 17:   7%|▋         | 7/97 [00:02<00:28,  3.19it/s, loss=4.05, v_num=0]
Epoch 17:   7%|▋         | 7/97 [00:02<00:28,  3.11it/s, loss=4.05, v_num=0]
Epoch 17:   8%|▊         | 8/97 [00:02<00:25,  3.44it/s, loss=4.05, v_num=0]
Epoch 17:   8%|▊         | 8/97 [00:02<00:26,  3.36it/s, loss=4.05, v_num=0]
Epoch 17:   9%|▉         | 9/97 [00:02<00:24,  3.65it/s, loss=4.05, v_num=0]
Epoch 17:   9%|▉         | 9/97 [00:02<00:24,  3.57it/s, loss=4.04, v_num=0]
Epoch 17:  10%|█         | 10/97 [00:02<00:22,  3.84it/s, loss=4.04, v_num=0]
Epoch 17:  10%|█         | 10/97 [00:02<00:23,  3.76it/s, loss=4.04, v_num=0]
Epoch 17:  11%|█▏        | 11/97 [00:02<00:21,  4.02it/s, loss=4.04, v_num=0]
Epoch 17:  11%|█▏        | 11/97 [00:02<00:21,  3.93it/s, loss=4.04, v_num=0]
Epoch 17:  12%|█▏        | 12/97 [00:02<00:20,  4.17it/s, loss=4.04, v_num=0]
Epoch 17:  12%|█▏        | 12/97 [00:02<00:20,  4.09it/s, loss=4.04, v_num=0]
Epoch 17:  13%|█▎        | 13/97 [00:03<00:19,  4.32it/s, loss=4.04, v_num=0]
Epoch 17:  13%|█▎        | 13/97 [00:03<00:19,  4.24it/s, loss=4.04, v_num=0]
Epoch 17:  14%|█▍        | 14/97 [00:03<00:18,  4.45it/s, loss=4.04, v_num=0]
Epoch 17:  14%|█▍        | 14/97 [00:03<00:18,  4.37it/s, loss=4.05, v_num=0]
Epoch 17:  15%|█▌        | 15/97 [00:03<00:17,  4.57it/s, loss=4.05, v_num=0]
Epoch 17:  15%|█▌        | 15/97 [00:03<00:18,  4.49it/s, loss=4.04, v_num=0]
Epoch 17:  16%|█▋        | 16/97 [00:03<00:17,  4.68it/s, loss=4.04, v_num=0]
Epoch 17:  16%|█▋        | 16/97 [00:03<00:17,  4.60it/s, loss=4.04, v_num=0]
Epoch 17:  18%|█▊        | 17/97 [00:03<00:16,  4.77it/s, loss=4.04, v_num=0]
Epoch 17:  18%|█▊        | 17/97 [00:03<00:17,  4.70it/s, loss=4.03, v_num=0]
Epoch 17:  19%|█▊        | 18/97 [00:03<00:16,  4.87it/s, loss=4.03, v_num=0]
Epoch 17:  19%|█▊        | 18/97 [00:03<00:16,  4.80it/s, loss=4.04, v_num=0]
Epoch 17:  20%|█▉        | 19/97 [00:03<00:15,  4.96it/s, loss=4.04, v_num=0]
Epoch 17:  20%|█▉        | 19/97 [00:03<00:15,  4.89it/s, loss=4.04, v_num=0]
Epoch 17:  21%|██        | 20/97 [00:03<00:15,  5.04it/s, loss=4.04, v_num=0]
Epoch 17:  21%|██        | 20/97 [00:04<00:15,  4.97it/s, loss=4.04, v_num=0]
Epoch 17:  22%|██▏       | 21/97 [00:04<00:14,  5.11it/s, loss=4.04, v_num=0]
Epoch 17:  22%|██▏       | 21/97 [00:04<00:15,  5.05it/s, loss=4.04, v_num=0]
Epoch 17:  23%|██▎       | 22/97 [00:04<00:14,  5.19it/s, loss=4.04, v_num=0]
Epoch 17:  23%|██▎       | 22/97 [00:04<00:14,  5.12it/s, loss=4.04, v_num=0]
Epoch 17:  24%|██▎       | 23/97 [00:04<00:14,  5.25it/s, loss=4.04, v_num=0]
Epoch 17:  24%|██▎       | 23/97 [00:04<00:14,  5.18it/s, loss=4.04, v_num=0]
Epoch 17:  25%|██▍       | 24/97 [00:04<00:13,  5.32it/s, loss=4.04, v_num=0]
Epoch 17:  25%|██▍       | 24/97 [00:04<00:13,  5.25it/s, loss=4.03, v_num=0]
Epoch 17:  26%|██▌       | 25/97 [00:04<00:13,  5.37it/s, loss=4.03, v_num=0]
Epoch 17:  26%|██▌       | 25/97 [00:04<00:13,  5.30it/s, loss=4.03, v_num=0]
Epoch 17:  27%|██▋       | 26/97 [00:04<00:13,  5.43it/s, loss=4.03, v_num=0]
Epoch 17:  27%|██▋       | 26/97 [00:04<00:13,  5.36it/s, loss=4.03, v_num=0]
Epoch 17:  28%|██▊       | 27/97 [00:04<00:12,  5.48it/s, loss=4.03, v_num=0]
Epoch 17:  28%|██▊       | 27/97 [00:04<00:12,  5.42it/s, loss=4.04, v_num=0]
Epoch 17:  29%|██▉       | 28/97 [00:05<00:12,  5.53it/s, loss=4.04, v_num=0]
Epoch 17:  29%|██▉       | 28/97 [00:05<00:12,  5.46it/s, loss=4.04, v_num=0]
Epoch 17:  30%|██▉       | 29/97 [00:05<00:12,  5.58it/s, loss=4.04, v_num=0]
Epoch 17:  30%|██▉       | 29/97 [00:05<00:12,  5.51it/s, loss=4.05, v_num=0]
Epoch 17:  31%|███       | 30/97 [00:05<00:11,  5.61it/s, loss=4.05, v_num=0]
Epoch 17:  31%|███       | 30/97 [00:05<00:12,  5.56it/s, loss=4.05, v_num=0]
Epoch 17:  32%|███▏      | 31/97 [00:05<00:11,  5.66it/s, loss=4.05, v_num=0]
Epoch 17:  32%|███▏      | 31/97 [00:05<00:11,  5.60it/s, loss=4.06, v_num=0]
Epoch 17:  33%|███▎      | 32/97 [00:05<00:11,  5.70it/s, loss=4.06, v_num=0]
Epoch 17:  33%|███▎      | 32/97 [00:05<00:11,  5.64it/s, loss=4.07, v_num=0]
Epoch 17:  34%|███▍      | 33/97 [00:05<00:11,  5.74it/s, loss=4.07, v_num=0]
Epoch 17:  34%|███▍      | 33/97 [00:05<00:11,  5.68it/s, loss=4.07, v_num=0]
Epoch 17:  35%|███▌      | 34/97 [00:05<00:10,  5.77it/s, loss=4.07, v_num=0]
Epoch 17:  35%|███▌      | 34/97 [00:05<00:11,  5.72it/s, loss=4.07, v_num=0]
Epoch 17:  36%|███▌      | 35/97 [00:06<00:10,  5.81it/s, loss=4.07, v_num=0]
Epoch 17:  36%|███▌      | 35/97 [00:06<00:10,  5.75it/s, loss=4.07, v_num=0]
Epoch 17:  37%|███▋      | 36/97 [00:06<00:10,  5.83it/s, loss=4.07, v_num=0]
Epoch 17:  37%|███▋      | 36/97 [00:06<00:10,  5.78it/s, loss=4.07, v_num=0]
Epoch 17:  38%|███▊      | 37/97 [00:06<00:10,  5.87it/s, loss=4.07, v_num=0]
Epoch 17:  38%|███▊      | 37/97 [00:06<00:10,  5.82it/s, loss=4.08, v_num=0]
Epoch 17:  39%|███▉      | 38/97 [00:06<00:10,  5.89it/s, loss=4.08, v_num=0]
Epoch 17:  39%|███▉      | 38/97 [00:06<00:10,  5.84it/s, loss=4.06, v_num=0]
Epoch 17:  40%|████      | 39/97 [00:06<00:09,  5.92it/s, loss=4.06, v_num=0]
Epoch 17:  40%|████      | 39/97 [00:06<00:09,  5.87it/s, loss=4.06, v_num=0]
Epoch 17:  41%|████      | 40/97 [00:06<00:09,  5.95it/s, loss=4.06, v_num=0]
Epoch 17:  41%|████      | 40/97 [00:06<00:09,  5.90it/s, loss=4.07, v_num=0]
Epoch 17:  42%|████▏     | 41/97 [00:06<00:09,  5.98it/s, loss=4.07, v_num=0]
Epoch 17:  42%|████▏     | 41/97 [00:06<00:09,  5.93it/s, loss=4.07, v_num=0]
Epoch 17:  43%|████▎     | 42/97 [00:06<00:09,  6.01it/s, loss=4.07, v_num=0]
Epoch 17:  43%|████▎     | 42/97 [00:07<00:09,  5.96it/s, loss=4.06, v_num=0]
Epoch 17:  44%|████▍     | 43/97 [00:07<00:08,  6.03it/s, loss=4.06, v_num=0]
Epoch 17:  44%|████▍     | 43/97 [00:07<00:09,  5.98it/s, loss=4.05, v_num=0]
Epoch 17:  45%|████▌     | 44/97 [00:07<00:08,  6.06it/s, loss=4.05, v_num=0]
Epoch 17:  45%|████▌     | 44/97 [00:07<00:08,  6.01it/s, loss=4.05, v_num=0]
Epoch 17:  46%|████▋     | 45/97 [00:07<00:08,  6.08it/s, loss=4.05, v_num=0]
Epoch 17:  46%|████▋     | 45/97 [00:07<00:08,  6.03it/s, loss=4.05, v_num=0]
Epoch 17:  47%|████▋     | 46/97 [00:07<00:08,  6.10it/s, loss=4.05, v_num=0]
Epoch 17:  47%|████▋     | 46/97 [00:07<00:08,  6.05it/s, loss=4.04, v_num=0]
Epoch 17:  48%|████▊     | 47/97 [00:07<00:08,  6.11it/s, loss=4.04, v_num=0]
Epoch 17:  48%|████▊     | 47/97 [00:07<00:08,  6.07it/s, loss=4.04, v_num=0]
Epoch 17:  49%|████▉     | 48/97 [00:07<00:07,  6.14it/s, loss=4.04, v_num=0]
Epoch 17:  49%|████▉     | 48/97 [00:07<00:08,  6.09it/s, loss=4.03, v_num=0]
Epoch 17:  51%|█████     | 49/97 [00:07<00:07,  6.15it/s, loss=4.03, v_num=0]
Epoch 17:  51%|█████     | 49/97 [00:08<00:07,  6.11it/s, loss=4.02, v_num=0]
Epoch 17:  52%|█████▏    | 50/97 [00:08<00:07,  6.17it/s, loss=4.02, v_num=0]
Epoch 17:  52%|█████▏    | 50/97 [00:08<00:07,  6.13it/s, loss=4.02, v_num=0]
Epoch 17:  53%|█████▎    | 51/97 [00:08<00:07,  6.19it/s, loss=4.02, v_num=0]
Epoch 17:  53%|█████▎    | 51/97 [00:08<00:07,  6.15it/s, loss=4.01, v_num=0]
Epoch 17:  54%|█████▎    | 52/97 [00:08<00:07,  6.20it/s, loss=4.01, v_num=0]
Epoch 17:  54%|█████▎    | 52/97 [00:08<00:07,  6.16it/s, loss=4, v_num=0]
Epoch 17:  55%|█████▍    | 53/97 [00:08<00:07,  6.22it/s, loss=4, v_num=0]
Epoch 17:  55%|█████▍    | 53/97 [00:08<00:07,  6.18it/s, loss=4, v_num=0]
Epoch 17:  56%|█████▌    | 54/97 [00:08<00:06,  6.24it/s, loss=4, v_num=0]
Epoch 17:  56%|█████▌    | 54/97 [00:08<00:06,  6.19it/s, loss=4, v_num=0]
Epoch 17:  57%|█████▋    | 55/97 [00:08<00:06,  6.25it/s, loss=4, v_num=0]
Epoch 17:  57%|█████▋    | 55/97 [00:08<00:06,  6.21it/s, loss=3.99, v_num=0]
Epoch 17:  58%|█████▊    | 56/97 [00:08<00:06,  6.26it/s, loss=3.99, v_num=0]
Epoch 17:  58%|█████▊    | 56/97 [00:09<00:06,  6.22it/s, loss=3.99, v_num=0]
Epoch 17:  59%|█████▉    | 57/97 [00:09<00:06,  6.28it/s, loss=3.99, v_num=0]
Epoch 17:  59%|█████▉    | 57/97 [00:09<00:06,  6.24it/s, loss=3.99, v_num=0]
Epoch 17:  60%|█████▉    | 58/97 [00:09<00:06,  6.29it/s, loss=3.99, v_num=0]
Epoch 17:  60%|█████▉    | 58/97 [00:09<00:06,  6.25it/s, loss=4, v_num=0]
Epoch 17:  61%|██████    | 59/97 [00:09<00:06,  6.30it/s, loss=4, v_num=0]
Epoch 17:  61%|██████    | 59/97 [00:09<00:06,  6.27it/s, loss=4, v_num=0]
Epoch 17:  62%|██████▏   | 60/97 [00:09<00:05,  6.32it/s, loss=4, v_num=0]
Epoch 17:  62%|██████▏   | 60/97 [00:09<00:05,  6.28it/s, loss=4, v_num=0]
Epoch 17:  63%|██████▎   | 61/97 [00:09<00:05,  6.33it/s, loss=4, v_num=0]
Epoch 17:  63%|██████▎   | 61/97 [00:09<00:05,  6.29it/s, loss=4.01, v_num=0]
Epoch 17:  64%|██████▍   | 62/97 [00:09<00:05,  6.34it/s, loss=4.01, v_num=0]
Epoch 17:  64%|██████▍   | 62/97 [00:09<00:05,  6.31it/s, loss=4.02, v_num=0]
Epoch 17:  65%|██████▍   | 63/97 [00:09<00:05,  6.35it/s, loss=4.02, v_num=0]
Epoch 17:  65%|██████▍   | 63/97 [00:09<00:05,  6.32it/s, loss=4.02, v_num=0]
Epoch 17:  66%|██████▌   | 64/97 [00:10<00:05,  6.37it/s, loss=4.02, v_num=0]
Epoch 17:  66%|██████▌   | 64/97 [00:10<00:05,  6.33it/s, loss=4.02, v_num=0]
Epoch 17:  67%|██████▋   | 65/97 [00:10<00:05,  6.38it/s, loss=4.02, v_num=0]
Epoch 17:  67%|██████▋   | 65/97 [00:10<00:05,  6.34it/s, loss=4.02, v_num=0]
Epoch 17:  68%|██████▊   | 66/97 [00:10<00:04,  6.39it/s, loss=4.02, v_num=0]
Epoch 17:  68%|██████▊   | 66/97 [00:10<00:04,  6.35it/s, loss=4.03, v_num=0]
Epoch 17:  69%|██████▉   | 67/97 [00:10<00:04,  6.40it/s, loss=4.03, v_num=0]
Epoch 17:  69%|██████▉   | 67/97 [00:10<00:04,  6.37it/s, loss=4.04, v_num=0]
Epoch 17:  70%|███████   | 68/97 [00:10<00:04,  6.41it/s, loss=4.04, v_num=0]
Epoch 17:  70%|███████   | 68/97 [00:10<00:04,  6.38it/s, loss=4.03, v_num=0]
Epoch 17:  71%|███████   | 69/97 [00:10<00:04,  6.42it/s, loss=4.03, v_num=0]
Epoch 17:  71%|███████   | 69/97 [00:10<00:04,  6.39it/s, loss=4.03, v_num=0]
Epoch 17:  72%|███████▏  | 70/97 [00:10<00:04,  6.44it/s, loss=4.03, v_num=0]
Epoch 17:  72%|███████▏  | 70/97 [00:10<00:04,  6.40it/s, loss=4.03, v_num=0]
Epoch 17:  73%|███████▎  | 71/97 [00:11<00:04,  6.44it/s, loss=4.03, v_num=0]
Epoch 17:  73%|███████▎  | 71/97 [00:11<00:04,  6.41it/s, loss=4.03, v_num=0]
Epoch 17:  74%|███████▍  | 72/97 [00:11<00:03,  6.46it/s, loss=4.03, v_num=0]
Epoch 17:  74%|███████▍  | 72/97 [00:11<00:03,  6.42it/s, loss=4.03, v_num=0]
Epoch 17:  75%|███████▌  | 73/97 [00:11<00:03,  6.47it/s, loss=4.03, v_num=0]
Epoch 17:  75%|███████▌  | 73/97 [00:11<00:03,  6.43it/s, loss=4.03, v_num=0]
Epoch 17:  76%|███████▋  | 74/97 [00:11<00:03,  6.48it/s, loss=4.03, v_num=0]
Epoch 17:  76%|███████▋  | 74/97 [00:11<00:03,  6.44it/s, loss=4.03, v_num=0]
Epoch 17:  77%|███████▋  | 75/97 [00:11<00:03,  6.48it/s, loss=4.03, v_num=0]
Epoch 17:  77%|███████▋  | 75/97 [00:11<00:03,  6.45it/s, loss=4.03, v_num=0]
Epoch 17:  78%|███████▊  | 76/97 [00:11<00:03,  6.50it/s, loss=4.03, v_num=0]
Epoch 17:  78%|███████▊  | 76/97 [00:11<00:03,  6.46it/s, loss=4.03, v_num=0]
Epoch 17:  79%|███████▉  | 77/97 [00:11<00:03,  6.50it/s, loss=4.03, v_num=0]
Epoch 17:  79%|███████▉  | 77/97 [00:11<00:03,  6.47it/s, loss=4.03, v_num=0]
Epoch 17:  80%|████████  | 78/97 [00:11<00:02,  6.52it/s, loss=4.03, v_num=0]
Epoch 17:  80%|████████  | 78/97 [00:12<00:02,  6.48it/s, loss=4.02, v_num=0]
Epoch 17:  81%|████████▏ | 79/97 [00:12<00:02,  6.52it/s, loss=4.02, v_num=0]
Epoch 17:  81%|████████▏ | 79/97 [00:12<00:02,  6.49it/s, loss=4.03, v_num=0]
Epoch 17:  82%|████████▏ | 80/97 [00:12<00:02,  6.53it/s, loss=4.03, v_num=0]
Epoch 17:  82%|████████▏ | 80/97 [00:12<00:02,  6.50it/s, loss=4.01, v_num=0]
Epoch 17:  84%|████████▎ | 81/97 [00:12<00:02,  6.54it/s, loss=4.01, v_num=0]
Epoch 17:  84%|████████▎ | 81/97 [00:12<00:02,  6.51it/s, loss=4.01, v_num=0]
Epoch 17:  85%|████████▍ | 82/97 [00:12<00:02,  6.55it/s, loss=4.01, v_num=0]
Epoch 17:  85%|████████▍ | 82/97 [00:12<00:02,  6.52it/s, loss=4.01, v_num=0]
Epoch 17:  86%|████████▌ | 83/97 [00:12<00:02,  6.55it/s, loss=4.01, v_num=0]
Epoch 17:  86%|████████▌ | 83/97 [00:12<00:02,  6.53it/s, loss=4.01, v_num=0]
Epoch 17:  87%|████████▋ | 84/97 [00:12<00:01,  6.56it/s, loss=4.01, v_num=0]
Epoch 17:  87%|████████▋ | 84/97 [00:12<00:01,  6.53it/s, loss=4.01, v_num=0]
Epoch 17:  88%|████████▊ | 85/97 [00:12<00:01,  6.57it/s, loss=4.01, v_num=0]
Epoch 17:  88%|████████▊ | 85/97 [00:12<00:01,  6.54it/s, loss=4.01, v_num=0]
Epoch 17:  89%|████████▊ | 86/97 [00:13<00:01,  6.58it/s, loss=4.01, v_num=0]
Epoch 17:  89%|████████▊ | 86/97 [00:13<00:01,  6.55it/s, loss=4.01, v_num=0]
Epoch 17:  90%|████████▉ | 87/97 [00:13<00:01,  6.59it/s, loss=4.01, v_num=0]
Epoch 17:  90%|████████▉ | 87/97 [00:13<00:01,  6.56it/s, loss=4.01, v_num=0]
Epoch 17:  91%|█████████ | 88/97 [00:13<00:01,  6.59it/s, loss=4.01, v_num=0]
Epoch 17:  91%|█████████ | 88/97 [00:13<00:01,  6.57it/s, loss=4, v_num=0]
Epoch 17:  92%|█████████▏| 89/97 [00:13<00:01,  6.60it/s, loss=4, v_num=0]
Epoch 17:  92%|█████████▏| 89/97 [00:13<00:01,  6.57it/s, loss=4, v_num=0]
Epoch 17:  93%|█████████▎| 90/97 [00:13<00:01,  6.61it/s, loss=4, v_num=0]
Epoch 17:  93%|█████████▎| 90/97 [00:13<00:01,  6.58it/s, loss=4.01, v_num=0]
Epoch 17:  94%|█████████▍| 91/97 [00:13<00:00,  6.62it/s, loss=4.01, v_num=0]
Epoch 17:  94%|█████████▍| 91/97 [00:13<00:00,  6.59it/s, loss=4.01, v_num=0]
Epoch 17:  95%|█████████▍| 92/97 [00:13<00:00,  6.62it/s, loss=4.01, v_num=0]
Epoch 17:  95%|█████████▍| 92/97 [00:13<00:00,  6.60it/s, loss=4.01, v_num=0]
Epoch 17:  96%|█████████▌| 93/97 [00:14<00:00,  6.63it/s, loss=4.01, v_num=0]
Epoch 17:  96%|█████████▌| 93/97 [00:14<00:00,  6.60it/s, loss=4.01, v_num=0]
Epoch 17:  97%|█████████▋| 94/97 [00:14<00:00,  6.64it/s, loss=4.01, v_num=0]
Epoch 17:  97%|█████████▋| 94/97 [00:14<00:00,  6.61it/s, loss=4.01, v_num=0]
Epoch 17:  98%|█████████▊| 95/97 [00:14<00:00,  6.64it/s, loss=4.01, v_num=0]
Epoch 17:  98%|█████████▊| 95/97 [00:14<00:00,  6.62it/s, loss=4.01, v_num=0]
Epoch 17:  99%|█████████▉| 96/97 [00:14<00:00,  6.65it/s, loss=4.01, v_num=0]
Epoch 17:  99%|█████████▉| 96/97 [00:14<00:00,  6.62it/s, loss=4.01, v_num=0]
Epoch 17: 100%|██████████| 97/97 [00:14<00:00,  6.66it/s, loss=4.01, v_num=0]
Epoch 17: 100%|██████████| 97/97 [00:14<00:00,  6.63it/s, loss=4, v_num=0]
Epoch 17: 100%|██████████| 97/97 [00:14<00:00,  6.63it/s, loss=4, v_num=0]
Epoch 17:   0%|          | 0/97 [00:00<?, ?it/s, loss=4, v_num=0]
Epoch 18:   0%|          | 0/97 [00:00<?, ?it/s, loss=4, v_num=0]
Epoch 18:   1%|          | 1/97 [00:01<02:16,  1.42s/it, loss=4, v_num=0]
Epoch 18:   1%|          | 1/97 [00:01<02:21,  1.48s/it, loss=4.01, v_num=0]
Epoch 18:   2%|▏         | 2/97 [00:01<01:14,  1.28it/s, loss=4.01, v_num=0]
Epoch 18:   2%|▏         | 2/97 [00:01<01:16,  1.24it/s, loss=4, v_num=0]
Epoch 18:   3%|▎         | 3/97 [00:01<00:53,  1.77it/s, loss=4, v_num=0]
Epoch 18:   3%|▎         | 3/97 [00:01<00:54,  1.71it/s, loss=4, v_num=0]
Epoch 18:   4%|▍         | 4/97 [00:01<00:42,  2.18it/s, loss=4, v_num=0]
Epoch 18:   4%|▍         | 4/97 [00:01<00:43,  2.12it/s, loss=4, v_num=0]
Epoch 18:   5%|▌         | 5/97 [00:01<00:36,  2.54it/s, loss=4, v_num=0]
Epoch 18:   5%|▌         | 5/97 [00:02<00:37,  2.47it/s, loss=4, v_num=0]
Epoch 18:   6%|▌         | 6/97 [00:02<00:31,  2.85it/s, loss=4, v_num=0]
Epoch 18:   6%|▌         | 6/97 [00:02<00:32,  2.77it/s, loss=4, v_num=0]
Epoch 18:   7%|▋         | 7/97 [00:02<00:28,  3.12it/s, loss=4, v_num=0]
Epoch 18:   7%|▋         | 7/97 [00:02<00:29,  3.04it/s, loss=3.99, v_num=0]
Epoch 18:   8%|▊         | 8/97 [00:02<00:26,  3.36it/s, loss=3.99, v_num=0]
Epoch 18:   8%|▊         | 8/97 [00:02<00:27,  3.28it/s, loss=3.98, v_num=0]
Epoch 18:   9%|▉         | 9/97 [00:02<00:24,  3.57it/s, loss=3.98, v_num=0]
Epoch 18:   9%|▉         | 9/97 [00:02<00:25,  3.49it/s, loss=3.98, v_num=0]
Epoch 18:  10%|█         | 10/97 [00:02<00:23,  3.76it/s, loss=3.98, v_num=0]
Epoch 18:  10%|█         | 10/97 [00:02<00:23,  3.68it/s, loss=3.98, v_num=0]
Epoch 18:  11%|█▏        | 11/97 [00:02<00:21,  3.94it/s, loss=3.98, v_num=0]
Epoch 18:  11%|█▏        | 11/97 [00:02<00:22,  3.86it/s, loss=3.98, v_num=0]
Epoch 18:  12%|█▏        | 12/97 [00:02<00:20,  4.09it/s, loss=3.98, v_num=0]
Epoch 18:  12%|█▏        | 12/97 [00:02<00:21,  4.02it/s, loss=3.97, v_num=0]
Epoch 18:  13%|█▎        | 13/97 [00:03<00:19,  4.24it/s, loss=3.97, v_num=0]
Epoch 18:  13%|█▎        | 13/97 [00:03<00:20,  4.16it/s, loss=3.96, v_num=0]
Epoch 18:  14%|█▍        | 14/97 [00:03<00:19,  4.37it/s, loss=3.96, v_num=0]
Epoch 18:  14%|█▍        | 14/97 [00:03<00:19,  4.29it/s, loss=3.96, v_num=0]
Epoch 18:  15%|█▌        | 15/97 [00:03<00:18,  4.49it/s, loss=3.96, v_num=0]
Epoch 18:  15%|█▌        | 15/97 [00:03<00:18,  4.41it/s, loss=3.96, v_num=0]
Epoch 18:  16%|█▋        | 16/97 [00:03<00:17,  4.60it/s, loss=3.96, v_num=0]
Epoch 18:  16%|█▋        | 16/97 [00:03<00:17,  4.53it/s, loss=3.96, v_num=0]
Epoch 18:  18%|█▊        | 17/97 [00:03<00:17,  4.70it/s, loss=3.96, v_num=0]
Epoch 18:  18%|█▊        | 17/97 [00:03<00:17,  4.63it/s, loss=3.96, v_num=0]
Epoch 18:  19%|█▊        | 18/97 [00:03<00:16,  4.80it/s, loss=3.96, v_num=0]
Epoch 18:  19%|█▊        | 18/97 [00:03<00:16,  4.72it/s, loss=3.94, v_num=0]
Epoch 18:  20%|█▉        | 19/97 [00:03<00:15,  4.88it/s, loss=3.94, v_num=0]
Epoch 18:  20%|█▉        | 19/97 [00:03<00:16,  4.81it/s, loss=3.95, v_num=0]
Epoch 18:  21%|██        | 20/97 [00:04<00:15,  4.97it/s, loss=3.95, v_num=0]
Epoch 18:  21%|██        | 20/97 [00:04<00:15,  4.90it/s, loss=3.94, v_num=0]
Epoch 18:  22%|██▏       | 21/97 [00:04<00:15,  5.04it/s, loss=3.94, v_num=0]
Epoch 18:  22%|██▏       | 21/97 [00:04<00:15,  4.98it/s, loss=3.94, v_num=0]
Epoch 18:  23%|██▎       | 22/97 [00:04<00:14,  5.12it/s, loss=3.94, v_num=0]
Epoch 18:  23%|██▎       | 22/97 [00:04<00:14,  5.05it/s, loss=3.94, v_num=0]
Epoch 18:  24%|██▎       | 23/97 [00:04<00:14,  5.18it/s, loss=3.94, v_num=0]
Epoch 18:  24%|██▎       | 23/97 [00:04<00:14,  5.12it/s, loss=3.94, v_num=0]
Epoch 18:  25%|██▍       | 24/97 [00:04<00:13,  5.24it/s, loss=3.94, v_num=0]
Epoch 18:  25%|██▍       | 24/97 [00:04<00:14,  5.18it/s, loss=3.93, v_num=0]
Epoch 18:  26%|██▌       | 25/97 [00:04<00:13,  5.30it/s, loss=3.93, v_num=0]
Epoch 18:  26%|██▌       | 25/97 [00:04<00:13,  5.24it/s, loss=3.93, v_num=0]
Epoch 18:  27%|██▋       | 26/97 [00:04<00:13,  5.36it/s, loss=3.93, v_num=0]
Epoch 18:  27%|██▋       | 26/97 [00:04<00:13,  5.30it/s, loss=3.92, v_num=0]
Epoch 18:  28%|██▊       | 27/97 [00:04<00:12,  5.42it/s, loss=3.92, v_num=0]
Epoch 18:  28%|██▊       | 27/97 [00:05<00:13,  5.35it/s, loss=3.93, v_num=0]
Epoch 18:  29%|██▉       | 28/97 [00:05<00:12,  5.46it/s, loss=3.93, v_num=0]
Epoch 18:  29%|██▉       | 28/97 [00:05<00:12,  5.41it/s, loss=3.92, v_num=0]
Epoch 18:  30%|██▉       | 29/97 [00:05<00:12,  5.51it/s, loss=3.92, v_num=0]
Epoch 18:  30%|██▉       | 29/97 [00:05<00:12,  5.45it/s, loss=3.92, v_num=0]
Epoch 18:  31%|███       | 30/97 [00:05<00:12,  5.55it/s, loss=3.92, v_num=0]
Epoch 18:  31%|███       | 30/97 [00:05<00:12,  5.50it/s, loss=3.91, v_num=0]
Epoch 18:  32%|███▏      | 31/97 [00:05<00:11,  5.59it/s, loss=3.91, v_num=0]
Epoch 18:  32%|███▏      | 31/97 [00:05<00:11,  5.53it/s, loss=3.91, v_num=0]
Epoch 18:  33%|███▎      | 32/97 [00:05<00:11,  5.64it/s, loss=3.91, v_num=0]
Epoch 18:  33%|███▎      | 32/97 [00:05<00:11,  5.58it/s, loss=3.91, v_num=0]
Epoch 18:  34%|███▍      | 33/97 [00:05<00:11,  5.67it/s, loss=3.91, v_num=0]
Epoch 18:  34%|███▍      | 33/97 [00:05<00:11,  5.62it/s, loss=3.93, v_num=0]
Epoch 18:  35%|███▌      | 34/97 [00:05<00:11,  5.71it/s, loss=3.93, v_num=0]
Epoch 18:  35%|███▌      | 34/97 [00:06<00:11,  5.66it/s, loss=3.93, v_num=0]
Epoch 18:  36%|███▌      | 35/97 [00:06<00:10,  5.75it/s, loss=3.93, v_num=0]
Epoch 18:  36%|███▌      | 35/97 [00:06<00:10,  5.69it/s, loss=3.93, v_num=0]
Epoch 18:  37%|███▋      | 36/97 [00:06<00:10,  5.78it/s, loss=3.93, v_num=0]
Epoch 18:  37%|███▋      | 36/97 [00:06<00:10,  5.73it/s, loss=3.93, v_num=0]
Epoch 18:  38%|███▊      | 37/97 [00:06<00:10,  5.81it/s, loss=3.93, v_num=0]
Epoch 18:  38%|███▊      | 37/97 [00:06<00:10,  5.76it/s, loss=3.93, v_num=0]
Epoch 18:  39%|███▉      | 38/97 [00:06<00:10,  5.85it/s, loss=3.93, v_num=0]
Epoch 18:  39%|███▉      | 38/97 [00:06<00:10,  5.79it/s, loss=3.93, v_num=0]
Epoch 18:  40%|████      | 39/97 [00:06<00:09,  5.87it/s, loss=3.93, v_num=0]
Epoch 18:  40%|████      | 39/97 [00:06<00:09,  5.83it/s, loss=3.91, v_num=0]
Epoch 18:  41%|████      | 40/97 [00:06<00:09,  5.90it/s, loss=3.91, v_num=0]
Epoch 18:  41%|████      | 40/97 [00:06<00:09,  5.86it/s, loss=3.91, v_num=0]
Epoch 18:  42%|████▏     | 41/97 [00:06<00:09,  5.93it/s, loss=3.91, v_num=0]
Epoch 18:  42%|████▏     | 41/97 [00:06<00:09,  5.88it/s, loss=3.91, v_num=0]
Epoch 18:  43%|████▎     | 42/97 [00:07<00:09,  5.96it/s, loss=3.91, v_num=0]
Epoch 18:  43%|████▎     | 42/97 [00:07<00:09,  5.91it/s, loss=3.91, v_num=0]
Epoch 18:  44%|████▍     | 43/97 [00:07<00:09,  5.98it/s, loss=3.91, v_num=0]
Epoch 18:  44%|████▍     | 43/97 [00:07<00:09,  5.94it/s, loss=3.92, v_num=0]
Epoch 18:  45%|████▌     | 44/97 [00:07<00:08,  6.01it/s, loss=3.92, v_num=0]
Epoch 18:  45%|████▌     | 44/97 [00:07<00:08,  5.96it/s, loss=3.92, v_num=0]
Epoch 18:  46%|████▋     | 45/97 [00:07<00:08,  6.03it/s, loss=3.92, v_num=0]
Epoch 18:  46%|████▋     | 45/97 [00:07<00:08,  5.99it/s, loss=3.92, v_num=0]
Epoch 18:  47%|████▋     | 46/97 [00:07<00:08,  6.06it/s, loss=3.92, v_num=0]
Epoch 18:  47%|████▋     | 46/97 [00:07<00:08,  6.01it/s, loss=3.92, v_num=0]
Epoch 18:  48%|████▊     | 47/97 [00:07<00:08,  6.08it/s, loss=3.92, v_num=0]
Epoch 18:  48%|████▊     | 47/97 [00:07<00:08,  6.03it/s, loss=3.93, v_num=0]
Epoch 18:  49%|████▉     | 48/97 [00:07<00:08,  6.09it/s, loss=3.93, v_num=0]
Epoch 18:  49%|████▉     | 48/97 [00:07<00:08,  6.05it/s, loss=3.93, v_num=0]
Epoch 18:  51%|█████     | 49/97 [00:08<00:07,  6.11it/s, loss=3.93, v_num=0]
Epoch 18:  51%|█████     | 49/97 [00:08<00:07,  6.07it/s, loss=3.94, v_num=0]
Epoch 18:  52%|█████▏    | 50/97 [00:08<00:07,  6.13it/s, loss=3.94, v_num=0]
Epoch 18:  52%|█████▏    | 50/97 [00:08<00:07,  6.09it/s, loss=3.93, v_num=0]
Epoch 18:  53%|█████▎    | 51/97 [00:08<00:07,  6.15it/s, loss=3.93, v_num=0]
Epoch 18:  53%|█████▎    | 51/97 [00:08<00:07,  6.11it/s, loss=3.93, v_num=0]
Epoch 18:  54%|█████▎    | 52/97 [00:08<00:07,  6.17it/s, loss=3.93, v_num=0]
Epoch 18:  54%|█████▎    | 52/97 [00:08<00:07,  6.13it/s, loss=3.93, v_num=0]
Epoch 18:  55%|█████▍    | 53/97 [00:08<00:07,  6.18it/s, loss=3.93, v_num=0]
Epoch 18:  55%|█████▍    | 53/97 [00:08<00:07,  6.15it/s, loss=3.92, v_num=0]
Epoch 18:  56%|█████▌    | 54/97 [00:08<00:06,  6.20it/s, loss=3.92, v_num=0]
Epoch 18:  56%|█████▌    | 54/97 [00:08<00:06,  6.16it/s, loss=3.91, v_num=0]
Epoch 18:  57%|█████▋    | 55/97 [00:08<00:06,  6.22it/s, loss=3.91, v_num=0]
Epoch 18:  57%|█████▋    | 55/97 [00:08<00:06,  6.18it/s, loss=3.91, v_num=0]
Epoch 18:  58%|█████▊    | 56/97 [00:08<00:06,  6.23it/s, loss=3.91, v_num=0]
Epoch 18:  58%|█████▊    | 56/97 [00:09<00:06,  6.19it/s, loss=3.91, v_num=0]
Epoch 18:  59%|█████▉    | 57/97 [00:09<00:06,  6.25it/s, loss=3.91, v_num=0]
Epoch 18:  59%|█████▉    | 57/97 [00:09<00:06,  6.21it/s, loss=3.9, v_num=0]
Epoch 18:  60%|█████▉    | 58/97 [00:09<00:06,  6.27it/s, loss=3.9, v_num=0]
Epoch 18:  60%|█████▉    | 58/97 [00:09<00:06,  6.23it/s, loss=3.9, v_num=0]
Epoch 18:  61%|██████    | 59/97 [00:09<00:06,  6.28it/s, loss=3.9, v_num=0]
Epoch 18:  61%|██████    | 59/97 [00:09<00:06,  6.24it/s, loss=3.91, v_num=0]
Epoch 18:  62%|██████▏   | 60/97 [00:09<00:05,  6.29it/s, loss=3.91, v_num=0]
Epoch 18:  62%|██████▏   | 60/97 [00:09<00:05,  6.26it/s, loss=3.92, v_num=0]
Epoch 18:  63%|██████▎   | 61/97 [00:09<00:05,  6.31it/s, loss=3.92, v_num=0]
Epoch 18:  63%|██████▎   | 61/97 [00:09<00:05,  6.27it/s, loss=3.91, v_num=0]
Epoch 18:  64%|██████▍   | 62/97 [00:09<00:05,  6.32it/s, loss=3.91, v_num=0]
Epoch 18:  64%|██████▍   | 62/97 [00:09<00:05,  6.28it/s, loss=3.9, v_num=0]
Epoch 18:  65%|██████▍   | 63/97 [00:09<00:05,  6.33it/s, loss=3.9, v_num=0]
Epoch 18:  65%|██████▍   | 63/97 [00:10<00:05,  6.30it/s, loss=3.9, v_num=0]
Epoch 18:  66%|██████▌   | 64/97 [00:10<00:05,  6.35it/s, loss=3.9, v_num=0]
Epoch 18:  66%|██████▌   | 64/97 [00:10<00:05,  6.31it/s, loss=3.91, v_num=0]
Epoch 18:  67%|██████▋   | 65/97 [00:10<00:05,  6.36it/s, loss=3.91, v_num=0]
Epoch 18:  67%|██████▋   | 65/97 [00:10<00:05,  6.32it/s, loss=3.91, v_num=0]
Epoch 18:  68%|██████▊   | 66/97 [00:10<00:04,  6.37it/s, loss=3.91, v_num=0]
Epoch 18:  68%|██████▊   | 66/97 [00:10<00:04,  6.34it/s, loss=3.91, v_num=0]
Epoch 18:  69%|██████▉   | 67/97 [00:10<00:04,  6.38it/s, loss=3.91, v_num=0]
Epoch 18:  69%|██████▉   | 67/97 [00:10<00:04,  6.35it/s, loss=3.9, v_num=0]
Epoch 18:  70%|███████   | 68/97 [00:10<00:04,  6.39it/s, loss=3.9, v_num=0]
Epoch 18:  70%|███████   | 68/97 [00:10<00:04,  6.36it/s, loss=3.91, v_num=0]
Epoch 18:  71%|███████   | 69/97 [00:10<00:04,  6.41it/s, loss=3.91, v_num=0]
Epoch 18:  71%|███████   | 69/97 [00:10<00:04,  6.37it/s, loss=3.9, v_num=0]
Epoch 18:  72%|███████▏  | 70/97 [00:10<00:04,  6.42it/s, loss=3.9, v_num=0]
Epoch 18:  72%|███████▏  | 70/97 [00:10<00:04,  6.39it/s, loss=3.91, v_num=0]
Epoch 18:  73%|███████▎  | 71/97 [00:11<00:04,  6.43it/s, loss=3.91, v_num=0]
Epoch 18:  73%|███████▎  | 71/97 [00:11<00:04,  6.40it/s, loss=3.91, v_num=0]
Epoch 18:  74%|███████▍  | 72/97 [00:11<00:03,  6.44it/s, loss=3.91, v_num=0]
Epoch 18:  74%|███████▍  | 72/97 [00:11<00:03,  6.41it/s, loss=3.91, v_num=0]
Epoch 18:  75%|███████▌  | 73/97 [00:11<00:03,  6.45it/s, loss=3.91, v_num=0]
Epoch 18:  75%|███████▌  | 73/97 [00:11<00:03,  6.42it/s, loss=3.91, v_num=0]
Epoch 18:  76%|███████▋  | 74/97 [00:11<00:03,  6.46it/s, loss=3.91, v_num=0]
Epoch 18:  76%|███████▋  | 74/97 [00:11<00:03,  6.43it/s, loss=3.93, v_num=0]
Epoch 18:  77%|███████▋  | 75/97 [00:11<00:03,  6.47it/s, loss=3.93, v_num=0]
Epoch 18:  77%|███████▋  | 75/97 [00:11<00:03,  6.44it/s, loss=3.93, v_num=0]
Epoch 18:  78%|███████▊  | 76/97 [00:11<00:03,  6.48it/s, loss=3.93, v_num=0]
Epoch 18:  78%|███████▊  | 76/97 [00:11<00:03,  6.45it/s, loss=3.94, v_num=0]
Epoch 18:  79%|███████▉  | 77/97 [00:11<00:03,  6.49it/s, loss=3.94, v_num=0]
Epoch 18:  79%|███████▉  | 77/97 [00:11<00:03,  6.46it/s, loss=3.94, v_num=0]
Epoch 18:  80%|████████  | 78/97 [00:12<00:02,  6.50it/s, loss=3.94, v_num=0]
Epoch 18:  80%|████████  | 78/97 [00:12<00:02,  6.47it/s, loss=3.96, v_num=0]
Epoch 18:  81%|████████▏ | 79/97 [00:12<00:02,  6.51it/s, loss=3.96, v_num=0]
Epoch 18:  81%|████████▏ | 79/97 [00:12<00:02,  6.48it/s, loss=3.96, v_num=0]
Epoch 18:  82%|████████▏ | 80/97 [00:12<00:02,  6.52it/s, loss=3.96, v_num=0]
Epoch 18:  82%|████████▏ | 80/97 [00:12<00:02,  6.49it/s, loss=3.95, v_num=0]
Epoch 18:  84%|████████▎ | 81/97 [00:12<00:02,  6.52it/s, loss=3.95, v_num=0]
Epoch 18:  84%|████████▎ | 81/97 [00:12<00:02,  6.50it/s, loss=3.95, v_num=0]
Epoch 18:  85%|████████▍ | 82/97 [00:12<00:02,  6.53it/s, loss=3.95, v_num=0]
Epoch 18:  85%|████████▍ | 82/97 [00:12<00:02,  6.50it/s, loss=3.97, v_num=0]
Epoch 18:  86%|████████▌ | 83/97 [00:12<00:02,  6.54it/s, loss=3.97, v_num=0]
Epoch 18:  86%|████████▌ | 83/97 [00:12<00:02,  6.51it/s, loss=3.95, v_num=0]
Epoch 18:  87%|████████▋ | 84/97 [00:12<00:01,  6.55it/s, loss=3.95, v_num=0]
Epoch 18:  87%|████████▋ | 84/97 [00:12<00:01,  6.52it/s, loss=3.95, v_num=0]
Epoch 18:  88%|████████▊ | 85/97 [00:12<00:01,  6.55it/s, loss=3.95, v_num=0]
Epoch 18:  88%|████████▊ | 85/97 [00:13<00:01,  6.53it/s, loss=3.95, v_num=0]
Epoch 18:  89%|████████▊ | 86/97 [00:13<00:01,  6.56it/s, loss=3.95, v_num=0]
Epoch 18:  89%|████████▊ | 86/97 [00:13<00:01,  6.53it/s, loss=3.95, v_num=0]
Epoch 18:  90%|████████▉ | 87/97 [00:13<00:01,  6.57it/s, loss=3.95, v_num=0]
Epoch 18:  90%|████████▉ | 87/97 [00:13<00:01,  6.54it/s, loss=3.95, v_num=0]
Epoch 18:  91%|█████████ | 88/97 [00:13<00:01,  6.58it/s, loss=3.95, v_num=0]
Epoch 18:  91%|█████████ | 88/97 [00:13<00:01,  6.55it/s, loss=3.95, v_num=0]
Epoch 18:  92%|█████████▏| 89/97 [00:13<00:01,  6.59it/s, loss=3.95, v_num=0]
Epoch 18:  92%|█████████▏| 89/97 [00:13<00:01,  6.56it/s, loss=3.94, v_num=0]
Epoch 18:  93%|█████████▎| 90/97 [00:13<00:01,  6.59it/s, loss=3.94, v_num=0]
Epoch 18:  93%|█████████▎| 90/97 [00:13<00:01,  6.57it/s, loss=3.94, v_num=0]
Epoch 18:  94%|█████████▍| 91/97 [00:13<00:00,  6.60it/s, loss=3.94, v_num=0]
Epoch 18:  94%|█████████▍| 91/97 [00:13<00:00,  6.57it/s, loss=3.94, v_num=0]
Epoch 18:  95%|█████████▍| 92/97 [00:13<00:00,  6.61it/s, loss=3.94, v_num=0]
Epoch 18:  95%|█████████▍| 92/97 [00:13<00:00,  6.58it/s, loss=3.94, v_num=0]
Epoch 18:  96%|█████████▌| 93/97 [00:14<00:00,  6.61it/s, loss=3.94, v_num=0]
Epoch 18:  96%|█████████▌| 93/97 [00:14<00:00,  6.58it/s, loss=3.93, v_num=0]
Epoch 18:  97%|█████████▋| 94/97 [00:14<00:00,  6.62it/s, loss=3.93, v_num=0]
Epoch 18:  97%|█████████▋| 94/97 [00:14<00:00,  6.59it/s, loss=3.92, v_num=0]
Epoch 18:  98%|█████████▊| 95/97 [00:14<00:00,  6.62it/s, loss=3.92, v_num=0]
Epoch 18:  98%|█████████▊| 95/97 [00:14<00:00,  6.60it/s, loss=3.91, v_num=0]
Epoch 18:  99%|█████████▉| 96/97 [00:14<00:00,  6.63it/s, loss=3.91, v_num=0]
Epoch 18:  99%|█████████▉| 96/97 [00:14<00:00,  6.60it/s, loss=3.91, v_num=0]
Epoch 18: 100%|██████████| 97/97 [00:14<00:00,  6.64it/s, loss=3.91, v_num=0]
Epoch 18: 100%|██████████| 97/97 [00:14<00:00,  6.61it/s, loss=3.9, v_num=0]
Epoch 18: 100%|██████████| 97/97 [00:14<00:00,  6.61it/s, loss=3.9, v_num=0]
Epoch 18:   0%|          | 0/97 [00:00<?, ?it/s, loss=3.9, v_num=0]
Epoch 19:   0%|          | 0/97 [00:00<?, ?it/s, loss=3.9, v_num=0]
Epoch 19:   1%|          | 1/97 [00:01<02:13,  1.39s/it, loss=3.9, v_num=0]
Epoch 19:   1%|          | 1/97 [00:01<02:18,  1.44s/it, loss=3.89, v_num=0]
Epoch 19:   2%|▏         | 2/97 [00:01<01:12,  1.31it/s, loss=3.89, v_num=0]
Epoch 19:   2%|▏         | 2/97 [00:01<01:14,  1.27it/s, loss=3.89, v_num=0]
Epoch 19:   3%|▎         | 3/97 [00:01<00:51,  1.81it/s, loss=3.89, v_num=0]
Epoch 19:   3%|▎         | 3/97 [00:01<00:53,  1.75it/s, loss=3.89, v_num=0]
Epoch 19:   4%|▍         | 4/97 [00:01<00:41,  2.23it/s, loss=3.89, v_num=0]
Epoch 19:   4%|▍         | 4/97 [00:01<00:43,  2.16it/s, loss=3.89, v_num=0]
Epoch 19:   5%|▌         | 5/97 [00:01<00:35,  2.58it/s, loss=3.89, v_num=0]
Epoch 19:   5%|▌         | 5/97 [00:01<00:36,  2.51it/s, loss=3.88, v_num=0]
Epoch 19:   6%|▌         | 6/97 [00:02<00:31,  2.89it/s, loss=3.88, v_num=0]
Epoch 19:   6%|▌         | 6/97 [00:02<00:32,  2.81it/s, loss=3.88, v_num=0]
Epoch 19:   7%|▋         | 7/97 [00:02<00:28,  3.16it/s, loss=3.88, v_num=0]
Epoch 19:   7%|▋         | 7/97 [00:02<00:29,  3.09it/s, loss=3.88, v_num=0]
Epoch 19:   8%|▊         | 8/97 [00:02<00:26,  3.40it/s, loss=3.88, v_num=0]
Epoch 19:   8%|▊         | 8/97 [00:02<00:26,  3.33it/s, loss=3.88, v_num=0]
Epoch 19:   9%|▉         | 9/97 [00:02<00:24,  3.61it/s, loss=3.88, v_num=0]
Epoch 19:   9%|▉         | 9/97 [00:02<00:24,  3.53it/s, loss=3.88, v_num=0]
Epoch 19:  10%|█         | 10/97 [00:02<00:22,  3.80it/s, loss=3.88, v_num=0]
Epoch 19:  10%|█         | 10/97 [00:02<00:23,  3.73it/s, loss=3.88, v_num=0]
Epoch 19:  11%|█▏        | 11/97 [00:02<00:21,  3.98it/s, loss=3.88, v_num=0]
Epoch 19:  11%|█▏        | 11/97 [00:02<00:22,  3.90it/s, loss=3.87, v_num=0]
Epoch 19:  12%|█▏        | 12/97 [00:02<00:20,  4.14it/s, loss=3.87, v_num=0]
Epoch 19:  12%|█▏        | 12/97 [00:02<00:20,  4.06it/s, loss=3.87, v_num=0]
Epoch 19:  13%|█▎        | 13/97 [00:03<00:19,  4.28it/s, loss=3.87, v_num=0]
Epoch 19:  13%|█▎        | 13/97 [00:03<00:19,  4.20it/s, loss=3.87, v_num=0]
Epoch 19:  14%|█▍        | 14/97 [00:03<00:18,  4.41it/s, loss=3.87, v_num=0]
Epoch 19:  14%|█▍        | 14/97 [00:03<00:19,  4.34it/s, loss=3.87, v_num=0]
Epoch 19:  15%|█▌        | 15/97 [00:03<00:18,  4.53it/s, loss=3.87, v_num=0]
Epoch 19:  15%|█▌        | 15/97 [00:03<00:18,  4.46it/s, loss=3.87, v_num=0]
Epoch 19:  16%|█▋        | 16/97 [00:03<00:17,  4.64it/s, loss=3.87, v_num=0]
Epoch 19:  16%|█▋        | 16/97 [00:03<00:17,  4.57it/s, loss=3.86, v_num=0]
Epoch 19:  18%|█▊        | 17/97 [00:03<00:16,  4.75it/s, loss=3.86, v_num=0]
Epoch 19:  18%|█▊        | 17/97 [00:03<00:17,  4.67it/s, loss=3.86, v_num=0]
Epoch 19:  19%|█▊        | 18/97 [00:03<00:16,  4.84it/s, loss=3.86, v_num=0]
Epoch 19:  19%|█▊        | 18/97 [00:03<00:16,  4.77it/s, loss=3.87, v_num=0]
Epoch 19:  20%|█▉        | 19/97 [00:03<00:15,  4.93it/s, loss=3.87, v_num=0]
Epoch 19:  20%|█▉        | 19/97 [00:03<00:16,  4.86it/s, loss=3.87, v_num=0]
Epoch 19:  21%|██        | 20/97 [00:03<00:15,  5.01it/s, loss=3.87, v_num=0]
Epoch 19:  21%|██        | 20/97 [00:04<00:15,  4.94it/s, loss=3.87, v_num=0]
Epoch 19:  22%|██▏       | 21/97 [00:04<00:14,  5.09it/s, loss=3.87, v_num=0]
Epoch 19:  22%|██▏       | 21/97 [00:04<00:15,  5.02it/s, loss=3.87, v_num=0]
Epoch 19:  23%|██▎       | 22/97 [00:04<00:14,  5.16it/s, loss=3.87, v_num=0]
Epoch 19:  23%|██▎       | 22/97 [00:04<00:14,  5.09it/s, loss=3.86, v_num=0]
Epoch 19:  24%|██▎       | 23/97 [00:04<00:14,  5.22it/s, loss=3.86, v_num=0]
Epoch 19:  24%|██▎       | 23/97 [00:04<00:14,  5.16it/s, loss=3.86, v_num=0]
Epoch 19:  25%|██▍       | 24/97 [00:04<00:13,  5.29it/s, loss=3.86, v_num=0]
Epoch 19:  25%|██▍       | 24/97 [00:04<00:13,  5.22it/s, loss=3.87, v_num=0]
Epoch 19:  26%|██▌       | 25/97 [00:04<00:13,  5.35it/s, loss=3.87, v_num=0]
Epoch 19:  26%|██▌       | 25/97 [00:04<00:13,  5.28it/s, loss=3.88, v_num=0]
Epoch 19:  27%|██▋       | 26/97 [00:04<00:13,  5.40it/s, loss=3.88, v_num=0]
Epoch 19:  27%|██▋       | 26/97 [00:04<00:13,  5.34it/s, loss=3.88, v_num=0]
Epoch 19:  28%|██▊       | 27/97 [00:04<00:12,  5.45it/s, loss=3.88, v_num=0]
Epoch 19:  28%|██▊       | 27/97 [00:05<00:12,  5.39it/s, loss=3.88, v_num=0]
Epoch 19:  29%|██▉       | 28/97 [00:05<00:12,  5.50it/s, loss=3.88, v_num=0]
Epoch 19:  29%|██▉       | 28/97 [00:05<00:12,  5.44it/s, loss=3.87, v_num=0]
Epoch 19:  30%|██▉       | 29/97 [00:05<00:12,  5.55it/s, loss=3.87, v_num=0]
Epoch 19:  30%|██▉       | 29/97 [00:05<00:12,  5.49it/s, loss=3.87, v_num=0]
Epoch 19:  31%|███       | 30/97 [00:05<00:11,  5.59it/s, loss=3.87, v_num=0]
Epoch 19:  31%|███       | 30/97 [00:05<00:12,  5.54it/s, loss=3.87, v_num=0]
Epoch 19:  32%|███▏      | 31/97 [00:05<00:11,  5.63it/s, loss=3.87, v_num=0]
Epoch 19:  32%|███▏      | 31/97 [00:05<00:11,  5.58it/s, loss=3.88, v_num=0]
Epoch 19:  33%|███▎      | 32/97 [00:05<00:11,  5.68it/s, loss=3.88, v_num=0]
Epoch 19:  33%|███▎      | 32/97 [00:05<00:11,  5.62it/s, loss=3.88, v_num=0]
Epoch 19:  34%|███▍      | 33/97 [00:05<00:11,  5.72it/s, loss=3.88, v_num=0]
Epoch 19:  34%|███▍      | 33/97 [00:05<00:11,  5.66it/s, loss=3.88, v_num=0]
Epoch 19:  35%|███▌      | 34/97 [00:05<00:10,  5.75it/s, loss=3.88, v_num=0]
Epoch 19:  35%|███▌      | 34/97 [00:05<00:11,  5.70it/s, loss=3.88, v_num=0]
Epoch 19:  36%|███▌      | 35/97 [00:06<00:10,  5.79it/s, loss=3.88, v_num=0]
Epoch 19:  36%|███▌      | 35/97 [00:06<00:10,  5.73it/s, loss=3.88, v_num=0]
Epoch 19:  37%|███▋      | 36/97 [00:06<00:10,  5.82it/s, loss=3.88, v_num=0]
Epoch 19:  37%|███▋      | 36/97 [00:06<00:10,  5.77it/s, loss=3.88, v_num=0]
Epoch 19:  38%|███▊      | 37/97 [00:06<00:10,  5.85it/s, loss=3.88, v_num=0]
Epoch 19:  38%|███▊      | 37/97 [00:06<00:10,  5.80it/s, loss=3.88, v_num=0]
Epoch 19:  39%|███▉      | 38/97 [00:06<00:10,  5.88it/s, loss=3.88, v_num=0]
Epoch 19:  39%|███▉      | 38/97 [00:06<00:10,  5.83it/s, loss=3.88, v_num=0]
Epoch 19:  40%|████      | 39/97 [00:06<00:09,  5.91it/s, loss=3.88, v_num=0]
Epoch 19:  40%|████      | 39/97 [00:06<00:09,  5.86it/s, loss=3.88, v_num=0]
Epoch 19:  41%|████      | 40/97 [00:06<00:09,  5.94it/s, loss=3.88, v_num=0]
Epoch 19:  41%|████      | 40/97 [00:06<00:09,  5.89it/s, loss=3.89, v_num=0]
Epoch 19:  42%|████▏     | 41/97 [00:06<00:09,  5.97it/s, loss=3.89, v_num=0]
Epoch 19:  42%|████▏     | 41/97 [00:06<00:09,  5.92it/s, loss=3.88, v_num=0]
Epoch 19:  43%|████▎     | 42/97 [00:07<00:09,  5.99it/s, loss=3.88, v_num=0]
Epoch 19:  43%|████▎     | 42/97 [00:07<00:09,  5.95it/s, loss=3.89, v_num=0]
Epoch 19:  44%|████▍     | 43/97 [00:07<00:08,  6.02it/s, loss=3.89, v_num=0]
Epoch 19:  44%|████▍     | 43/97 [00:07<00:09,  5.97it/s, loss=3.88, v_num=0]
Epoch 19:  45%|████▌     | 44/97 [00:07<00:08,  6.04it/s, loss=3.88, v_num=0]
Epoch 19:  45%|████▌     | 44/97 [00:07<00:08,  5.99it/s, loss=3.88, v_num=0]
Epoch 19:  46%|████▋     | 45/97 [00:07<00:08,  6.06it/s, loss=3.88, v_num=0]
Epoch 19:  46%|████▋     | 45/97 [00:07<00:08,  6.01it/s, loss=3.87, v_num=0]
Epoch 19:  47%|████▋     | 46/97 [00:07<00:08,  6.08it/s, loss=3.87, v_num=0]
Epoch 19:  47%|████▋     | 46/97 [00:07<00:08,  6.03it/s, loss=3.86, v_num=0]
Epoch 19:  48%|████▊     | 47/97 [00:07<00:08,  6.10it/s, loss=3.86, v_num=0]
Epoch 19:  48%|████▊     | 47/97 [00:07<00:08,  6.06it/s, loss=3.86, v_num=0]
Epoch 19:  49%|████▉     | 48/97 [00:07<00:08,  6.12it/s, loss=3.86, v_num=0]
Epoch 19:  49%|████▉     | 48/97 [00:07<00:08,  6.08it/s, loss=3.87, v_num=0]
Epoch 19:  51%|█████     | 49/97 [00:07<00:07,  6.14it/s, loss=3.87, v_num=0]
Epoch 19:  51%|█████     | 49/97 [00:08<00:07,  6.10it/s, loss=3.87, v_num=0]
Epoch 19:  52%|█████▏    | 50/97 [00:08<00:07,  6.16it/s, loss=3.87, v_num=0]
Epoch 19:  52%|█████▏    | 50/97 [00:08<00:07,  6.12it/s, loss=3.87, v_num=0]
Epoch 19:  53%|█████▎    | 51/97 [00:08<00:07,  6.18it/s, loss=3.87, v_num=0]
Epoch 19:  53%|█████▎    | 51/97 [00:08<00:07,  6.14it/s, loss=3.86, v_num=0]
Epoch 19:  54%|█████▎    | 52/97 [00:08<00:07,  6.20it/s, loss=3.86, v_num=0]
Epoch 19:  54%|█████▎    | 52/97 [00:08<00:07,  6.16it/s, loss=3.87, v_num=0]
Epoch 19:  55%|█████▍    | 53/97 [00:08<00:07,  6.21it/s, loss=3.87, v_num=0]
Epoch 19:  55%|█████▍    | 53/97 [00:08<00:07,  6.17it/s, loss=3.86, v_num=0]
Epoch 19:  56%|█████▌    | 54/97 [00:08<00:06,  6.23it/s, loss=3.86, v_num=0]
Epoch 19:  56%|█████▌    | 54/97 [00:08<00:06,  6.19it/s, loss=3.87, v_num=0]
Epoch 19:  57%|█████▋    | 55/97 [00:08<00:06,  6.24it/s, loss=3.87, v_num=0]
Epoch 19:  57%|█████▋    | 55/97 [00:08<00:06,  6.20it/s, loss=3.86, v_num=0]
Epoch 19:  58%|█████▊    | 56/97 [00:08<00:06,  6.26it/s, loss=3.86, v_num=0]
Epoch 19:  58%|█████▊    | 56/97 [00:09<00:06,  6.22it/s, loss=3.85, v_num=0]
Epoch 19:  59%|█████▉    | 57/97 [00:09<00:06,  6.27it/s, loss=3.85, v_num=0]
Epoch 19:  59%|█████▉    | 57/97 [00:09<00:06,  6.23it/s, loss=3.86, v_num=0]
Epoch 19:  60%|█████▉    | 58/97 [00:09<00:06,  6.29it/s, loss=3.86, v_num=0]
Epoch 19:  60%|█████▉    | 58/97 [00:09<00:06,  6.25it/s, loss=3.85, v_num=0]
Epoch 19:  61%|██████    | 59/97 [00:09<00:06,  6.30it/s, loss=3.85, v_num=0]
Epoch 19:  61%|██████    | 59/97 [00:09<00:06,  6.26it/s, loss=3.85, v_num=0]
Epoch 19:  62%|██████▏   | 60/97 [00:09<00:05,  6.32it/s, loss=3.85, v_num=0]
Epoch 19:  62%|██████▏   | 60/97 [00:09<00:05,  6.28it/s, loss=3.85, v_num=0]
Epoch 19:  63%|██████▎   | 61/97 [00:09<00:05,  6.33it/s, loss=3.85, v_num=0]
Epoch 19:  63%|██████▎   | 61/97 [00:09<00:05,  6.29it/s, loss=3.84, v_num=0]
Epoch 19:  64%|██████▍   | 62/97 [00:09<00:05,  6.34it/s, loss=3.84, v_num=0]
Epoch 19:  64%|██████▍   | 62/97 [00:09<00:05,  6.31it/s, loss=3.84, v_num=0]
Epoch 19:  65%|██████▍   | 63/97 [00:09<00:05,  6.36it/s, loss=3.84, v_num=0]
Epoch 19:  65%|██████▍   | 63/97 [00:09<00:05,  6.32it/s, loss=3.85, v_num=0]
Epoch 19:  66%|██████▌   | 64/97 [00:10<00:05,  6.37it/s, loss=3.85, v_num=0]
Epoch 19:  66%|██████▌   | 64/97 [00:10<00:05,  6.33it/s, loss=3.85, v_num=0]
Epoch 19:  67%|██████▋   | 65/97 [00:10<00:05,  6.38it/s, loss=3.85, v_num=0]
Epoch 19:  67%|██████▋   | 65/97 [00:10<00:05,  6.35it/s, loss=3.85, v_num=0]
Epoch 19:  68%|██████▊   | 66/97 [00:10<00:04,  6.39it/s, loss=3.85, v_num=0]
Epoch 19:  68%|██████▊   | 66/97 [00:10<00:04,  6.36it/s, loss=3.85, v_num=0]
Epoch 19:  69%|██████▉   | 67/97 [00:10<00:04,  6.40it/s, loss=3.85, v_num=0]
Epoch 19:  69%|██████▉   | 67/97 [00:10<00:04,  6.37it/s, loss=3.86, v_num=0]
Epoch 19:  70%|███████   | 68/97 [00:10<00:04,  6.42it/s, loss=3.86, v_num=0]
Epoch 19:  70%|███████   | 68/97 [00:10<00:04,  6.38it/s, loss=3.84, v_num=0]
Epoch 19:  71%|███████   | 69/97 [00:10<00:04,  6.43it/s, loss=3.84, v_num=0]
Epoch 19:  71%|███████   | 69/97 [00:10<00:04,  6.39it/s, loss=3.84, v_num=0]
Epoch 19:  72%|███████▏  | 70/97 [00:10<00:04,  6.44it/s, loss=3.84, v_num=0]
Epoch 19:  72%|███████▏  | 70/97 [00:10<00:04,  6.41it/s, loss=3.84, v_num=0]
Epoch 19:  73%|███████▎  | 71/97 [00:11<00:04,  6.45it/s, loss=3.84, v_num=0]
Epoch 19:  73%|███████▎  | 71/97 [00:11<00:04,  6.42it/s, loss=3.85, v_num=0]
Epoch 19:  74%|███████▍  | 72/97 [00:11<00:03,  6.46it/s, loss=3.85, v_num=0]
Epoch 19:  74%|███████▍  | 72/97 [00:11<00:03,  6.43it/s, loss=3.85, v_num=0]
Epoch 19:  75%|███████▌  | 73/97 [00:11<00:03,  6.47it/s, loss=3.85, v_num=0]
Epoch 19:  75%|███████▌  | 73/97 [00:11<00:03,  6.44it/s, loss=3.86, v_num=0]
Epoch 19:  76%|███████▋  | 74/97 [00:11<00:03,  6.48it/s, loss=3.86, v_num=0]
Epoch 19:  76%|███████▋  | 74/97 [00:11<00:03,  6.45it/s, loss=3.85, v_num=0]
Epoch 19:  77%|███████▋  | 75/97 [00:11<00:03,  6.49it/s, loss=3.85, v_num=0]
Epoch 19:  77%|███████▋  | 75/97 [00:11<00:03,  6.46it/s, loss=3.86, v_num=0]
Epoch 19:  78%|███████▊  | 76/97 [00:11<00:03,  6.50it/s, loss=3.86, v_num=0]
Epoch 19:  78%|███████▊  | 76/97 [00:11<00:03,  6.47it/s, loss=3.85, v_num=0]
Epoch 19:  79%|███████▉  | 77/97 [00:11<00:03,  6.51it/s, loss=3.85, v_num=0]
Epoch 19:  79%|███████▉  | 77/97 [00:11<00:03,  6.48it/s, loss=3.85, v_num=0]
Epoch 19:  80%|████████  | 78/97 [00:11<00:02,  6.51it/s, loss=3.85, v_num=0]
Epoch 19:  80%|████████  | 78/97 [00:12<00:02,  6.48it/s, loss=3.84, v_num=0]
Epoch 19:  81%|████████▏ | 79/97 [00:12<00:02,  6.52it/s, loss=3.84, v_num=0]
Epoch 19:  81%|████████▏ | 79/97 [00:12<00:02,  6.49it/s, loss=3.84, v_num=0]
Epoch 19:  82%|████████▏ | 80/97 [00:12<00:02,  6.53it/s, loss=3.84, v_num=0]
Epoch 19:  82%|████████▏ | 80/97 [00:12<00:02,  6.50it/s, loss=3.83, v_num=0]
Epoch 19:  84%|████████▎ | 81/97 [00:12<00:02,  6.54it/s, loss=3.83, v_num=0]
Epoch 19:  84%|████████▎ | 81/97 [00:12<00:02,  6.51it/s, loss=3.84, v_num=0]
Epoch 19:  85%|████████▍ | 82/97 [00:12<00:02,  6.55it/s, loss=3.84, v_num=0]
Epoch 19:  85%|████████▍ | 82/97 [00:12<00:02,  6.52it/s, loss=3.84, v_num=0]
Epoch 19:  86%|████████▌ | 83/97 [00:12<00:02,  6.56it/s, loss=3.84, v_num=0]
Epoch 19:  86%|████████▌ | 83/97 [00:12<00:02,  6.53it/s, loss=3.84, v_num=0]
Epoch 19:  87%|████████▋ | 84/97 [00:12<00:01,  6.56it/s, loss=3.84, v_num=0]
Epoch 19:  87%|████████▋ | 84/97 [00:12<00:01,  6.54it/s, loss=3.84, v_num=0]
Epoch 19:  88%|████████▊ | 85/97 [00:12<00:01,  6.57it/s, loss=3.84, v_num=0]
Epoch 19:  88%|████████▊ | 85/97 [00:12<00:01,  6.54it/s, loss=3.84, v_num=0]
Epoch 19:  89%|████████▊ | 86/97 [00:13<00:01,  6.58it/s, loss=3.84, v_num=0]
Epoch 19:  89%|████████▊ | 86/97 [00:13<00:01,  6.55it/s, loss=3.84, v_num=0]
Epoch 19:  90%|████████▉ | 87/97 [00:13<00:01,  6.59it/s, loss=3.84, v_num=0]
Epoch 19:  90%|████████▉ | 87/97 [00:13<00:01,  6.56it/s, loss=3.84, v_num=0]
Epoch 19:  91%|█████████ | 88/97 [00:13<00:01,  6.59it/s, loss=3.84, v_num=0]
Epoch 19:  91%|█████████ | 88/97 [00:13<00:01,  6.57it/s, loss=3.84, v_num=0]
Epoch 19:  92%|█████████▏| 89/97 [00:13<00:01,  6.60it/s, loss=3.84, v_num=0]
Epoch 19:  92%|█████████▏| 89/97 [00:13<00:01,  6.57it/s, loss=3.84, v_num=0]
Epoch 19:  93%|█████████▎| 90/97 [00:13<00:01,  6.61it/s, loss=3.84, v_num=0]
Epoch 19:  93%|█████████▎| 90/97 [00:13<00:01,  6.58it/s, loss=3.84, v_num=0]
Epoch 19:  94%|█████████▍| 91/97 [00:13<00:00,  6.62it/s, loss=3.84, v_num=0]
Epoch 19:  94%|█████████▍| 91/97 [00:13<00:00,  6.59it/s, loss=3.84, v_num=0]
Epoch 19:  95%|█████████▍| 92/97 [00:13<00:00,  6.62it/s, loss=3.84, v_num=0]
Epoch 19:  95%|█████████▍| 92/97 [00:13<00:00,  6.60it/s, loss=3.83, v_num=0]
Epoch 19:  96%|█████████▌| 93/97 [00:14<00:00,  6.63it/s, loss=3.83, v_num=0]
Epoch 19:  96%|█████████▌| 93/97 [00:14<00:00,  6.60it/s, loss=3.83, v_num=0]
Epoch 19:  97%|█████████▋| 94/97 [00:14<00:00,  6.64it/s, loss=3.83, v_num=0]
Epoch 19:  97%|█████████▋| 94/97 [00:14<00:00,  6.61it/s, loss=3.83, v_num=0]
Epoch 19:  98%|█████████▊| 95/97 [00:14<00:00,  6.64it/s, loss=3.83, v_num=0]
Epoch 19:  98%|█████████▊| 95/97 [00:14<00:00,  6.62it/s, loss=3.82, v_num=0]
Epoch 19:  99%|█████████▉| 96/97 [00:14<00:00,  6.65it/s, loss=3.82, v_num=0]
Epoch 19:  99%|█████████▉| 96/97 [00:14<00:00,  6.62it/s, loss=3.83, v_num=0]
Epoch 19: 100%|██████████| 97/97 [00:14<00:00,  6.66it/s, loss=3.83, v_num=0]
Epoch 19: 100%|██████████| 97/97 [00:14<00:00,  6.63it/s, loss=3.83, v_num=0]
Epoch 19: 100%|██████████| 97/97 [00:14<00:00,  6.63it/s, loss=3.83, v_num=0]
Epoch 19:   0%|          | 0/97 [00:00<?, ?it/s, loss=3.83, v_num=0]
Epoch 20:   0%|          | 0/97 [00:00<?, ?it/s, loss=3.83, v_num=0]
Epoch 20:   1%|          | 1/97 [00:01<02:13,  1.39s/it, loss=3.83, v_num=0]
Epoch 20:   1%|          | 1/97 [00:01<02:18,  1.44s/it, loss=3.83, v_num=0]
Epoch 20:   2%|▏         | 2/97 [00:01<01:12,  1.31it/s, loss=3.83, v_num=0]
Epoch 20:   2%|▏         | 2/97 [00:01<01:15,  1.27it/s, loss=3.84, v_num=0]
Epoch 20:   3%|▎         | 3/97 [00:01<00:52,  1.80it/s, loss=3.84, v_num=0]
Epoch 20:   3%|▎         | 3/97 [00:01<00:53,  1.74it/s, loss=3.84, v_num=0]
Epoch 20:   4%|▍         | 4/97 [00:01<00:41,  2.22it/s, loss=3.84, v_num=0]
Epoch 20:   4%|▍         | 4/97 [00:01<00:43,  2.15it/s, loss=3.84, v_num=0]
Epoch 20:   5%|▌         | 5/97 [00:01<00:35,  2.58it/s, loss=3.84, v_num=0]
Epoch 20:   5%|▌         | 5/97 [00:01<00:36,  2.51it/s, loss=3.84, v_num=0]
Epoch 20:   6%|▌         | 6/97 [00:02<00:31,  2.90it/s, loss=3.84, v_num=0]
Epoch 20:   6%|▌         | 6/97 [00:02<00:32,  2.82it/s, loss=3.84, v_num=0]
Epoch 20:   7%|▋         | 7/97 [00:02<00:28,  3.16it/s, loss=3.84, v_num=0]
Epoch 20:   7%|▋         | 7/97 [00:02<00:29,  3.09it/s, loss=3.83, v_num=0]
Epoch 20:   8%|▊         | 8/97 [00:02<00:26,  3.41it/s, loss=3.83, v_num=0]
Epoch 20:   8%|▊         | 8/97 [00:02<00:26,  3.33it/s, loss=3.83, v_num=0]
Epoch 20:   9%|▉         | 9/97 [00:02<00:24,  3.61it/s, loss=3.83, v_num=0]
Epoch 20:   9%|▉         | 9/97 [00:02<00:24,  3.53it/s, loss=3.83, v_num=0]
Epoch 20:  10%|█         | 10/97 [00:02<00:22,  3.81it/s, loss=3.83, v_num=0]
Epoch 20:  10%|█         | 10/97 [00:02<00:23,  3.73it/s, loss=3.82, v_num=0]
Epoch 20:  11%|█▏        | 11/97 [00:02<00:21,  3.98it/s, loss=3.82, v_num=0]
Epoch 20:  11%|█▏        | 11/97 [00:02<00:22,  3.90it/s, loss=3.82, v_num=0]
Epoch 20:  12%|█▏        | 12/97 [00:02<00:20,  4.13it/s, loss=3.82, v_num=0]
Epoch 20:  12%|█▏        | 12/97 [00:02<00:20,  4.06it/s, loss=3.83, v_num=0]
Epoch 20:  13%|█▎        | 13/97 [00:03<00:19,  4.28it/s, loss=3.83, v_num=0]
Epoch 20:  13%|█▎        | 13/97 [00:03<00:19,  4.20it/s, loss=3.83, v_num=0]
Epoch 20:  14%|█▍        | 14/97 [00:03<00:18,  4.41it/s, loss=3.83, v_num=0]
Epoch 20:  14%|█▍        | 14/97 [00:03<00:19,  4.34it/s, loss=3.82, v_num=0]
Epoch 20:  15%|█▌        | 15/97 [00:03<00:18,  4.54it/s, loss=3.82, v_num=0]
Epoch 20:  15%|█▌        | 15/97 [00:03<00:18,  4.46it/s, loss=3.82, v_num=0]
Epoch 20:  16%|█▋        | 16/97 [00:03<00:17,  4.65it/s, loss=3.82, v_num=0]
Epoch 20:  16%|█▋        | 16/97 [00:03<00:17,  4.57it/s, loss=3.83, v_num=0]
Epoch 20:  18%|█▊        | 17/97 [00:03<00:16,  4.74it/s, loss=3.83, v_num=0]
Epoch 20:  18%|█▊        | 17/97 [00:03<00:17,  4.67it/s, loss=3.82, v_num=0]
Epoch 20:  19%|█▊        | 18/97 [00:03<00:16,  4.83it/s, loss=3.82, v_num=0]
Epoch 20:  19%|█▊        | 18/97 [00:03<00:16,  4.76it/s, loss=3.81, v_num=0]
Epoch 20:  20%|█▉        | 19/97 [00:03<00:15,  4.93it/s, loss=3.81, v_num=0]
Epoch 20:  20%|█▉        | 19/97 [00:03<00:16,  4.86it/s, loss=3.81, v_num=0]
Epoch 20:  21%|██        | 20/97 [00:03<00:15,  5.01it/s, loss=3.81, v_num=0]
Epoch 20:  21%|██        | 20/97 [00:04<00:15,  4.94it/s, loss=3.81, v_num=0]
Epoch 20:  22%|██▏       | 21/97 [00:04<00:14,  5.08it/s, loss=3.81, v_num=0]
Epoch 20:  22%|██▏       | 21/97 [00:04<00:15,  5.02it/s, loss=3.81, v_num=0]
Epoch 20:  23%|██▎       | 22/97 [00:04<00:14,  5.15it/s, loss=3.81, v_num=0]
Epoch 20:  23%|██▎       | 22/97 [00:04<00:14,  5.08it/s, loss=3.8, v_num=0]
Epoch 20:  24%|██▎       | 23/97 [00:04<00:14,  5.21it/s, loss=3.8, v_num=0]
Epoch 20:  24%|██▎       | 23/97 [00:04<00:14,  5.15it/s, loss=3.8, v_num=0]
Epoch 20:  25%|██▍       | 24/97 [00:04<00:13,  5.28it/s, loss=3.8, v_num=0]
Epoch 20:  25%|██▍       | 24/97 [00:04<00:13,  5.22it/s, loss=3.79, v_num=0]
Epoch 20:  26%|██▌       | 25/97 [00:04<00:13,  5.34it/s, loss=3.79, v_num=0]
Epoch 20:  26%|██▌       | 25/97 [00:04<00:13,  5.27it/s, loss=3.78, v_num=0]
Epoch 20:  27%|██▋       | 26/97 [00:04<00:13,  5.40it/s, loss=3.78, v_num=0]
Epoch 20:  27%|██▋       | 26/97 [00:04<00:13,  5.33it/s, loss=3.78, v_num=0]
Epoch 20:  28%|██▊       | 27/97 [00:04<00:12,  5.45it/s, loss=3.78, v_num=0]
Epoch 20:  28%|██▊       | 27/97 [00:05<00:12,  5.39it/s, loss=3.78, v_num=0]
Epoch 20:  29%|██▉       | 28/97 [00:05<00:12,  5.50it/s, loss=3.78, v_num=0]
Epoch 20:  29%|██▉       | 28/97 [00:05<00:12,  5.44it/s, loss=3.78, v_num=0]
Epoch 20:  30%|██▉       | 29/97 [00:05<00:12,  5.54it/s, loss=3.78, v_num=0]
Epoch 20:  30%|██▉       | 29/97 [00:05<00:12,  5.48it/s, loss=3.79, v_num=0]
Epoch 20:  31%|███       | 30/97 [00:05<00:12,  5.58it/s, loss=3.79, v_num=0]
Epoch 20:  31%|███       | 30/97 [00:05<00:12,  5.53it/s, loss=3.79, v_num=0]
Epoch 20:  32%|███▏      | 31/97 [00:05<00:11,  5.62it/s, loss=3.79, v_num=0]
Epoch 20:  32%|███▏      | 31/97 [00:05<00:11,  5.57it/s, loss=3.79, v_num=0]
Epoch 20:  33%|███▎      | 32/97 [00:05<00:11,  5.67it/s, loss=3.79, v_num=0]
Epoch 20:  33%|███▎      | 32/97 [00:05<00:11,  5.61it/s, loss=3.79, v_num=0]
Epoch 20:  34%|███▍      | 33/97 [00:05<00:11,  5.70it/s, loss=3.79, v_num=0]
Epoch 20:  34%|███▍      | 33/97 [00:05<00:11,  5.65it/s, loss=3.78, v_num=0]
Epoch 20:  35%|███▌      | 34/97 [00:05<00:10,  5.74it/s, loss=3.78, v_num=0]
Epoch 20:  35%|███▌      | 34/97 [00:05<00:11,  5.69it/s, loss=3.78, v_num=0]
Epoch 20:  36%|███▌      | 35/97 [00:06<00:10,  5.78it/s, loss=3.78, v_num=0]
Epoch 20:  36%|███▌      | 35/97 [00:06<00:10,  5.72it/s, loss=3.78, v_num=0]
Epoch 20:  37%|███▋      | 36/97 [00:06<00:10,  5.81it/s, loss=3.78, v_num=0]
Epoch 20:  37%|███▋      | 36/97 [00:06<00:10,  5.76it/s, loss=3.78, v_num=0]
Epoch 20:  38%|███▊      | 37/97 [00:06<00:10,  5.84it/s, loss=3.78, v_num=0]
Epoch 20:  38%|███▊      | 37/97 [00:06<00:10,  5.79it/s, loss=3.79, v_num=0]
Epoch 20:  39%|███▉      | 38/97 [00:06<00:10,  5.88it/s, loss=3.79, v_num=0]
Epoch 20:  39%|███▉      | 38/97 [00:06<00:10,  5.82it/s, loss=3.79, v_num=0]
Epoch 20:  40%|████      | 39/97 [00:06<00:09,  5.90it/s, loss=3.79, v_num=0]
Epoch 20:  40%|████      | 39/97 [00:06<00:09,  5.85it/s, loss=3.79, v_num=0]
Epoch 20:  41%|████      | 40/97 [00:06<00:09,  5.94it/s, loss=3.79, v_num=0]
Epoch 20:  41%|████      | 40/97 [00:06<00:09,  5.88it/s, loss=3.79, v_num=0]
Epoch 20:  42%|████▏     | 41/97 [00:06<00:09,  5.96it/s, loss=3.79, v_num=0]
Epoch 20:  42%|████▏     | 41/97 [00:06<00:09,  5.91it/s, loss=3.79, v_num=0]
Epoch 20:  43%|████▎     | 42/97 [00:07<00:09,  5.99it/s, loss=3.79, v_num=0]
Epoch 20:  43%|████▎     | 42/97 [00:07<00:09,  5.94it/s, loss=3.8, v_num=0]
Epoch 20:  44%|████▍     | 43/97 [00:07<00:08,  6.01it/s, loss=3.8, v_num=0]
Epoch 20:  44%|████▍     | 43/97 [00:07<00:09,  5.97it/s, loss=3.81, v_num=0]
Epoch 20:  45%|████▌     | 44/97 [00:07<00:08,  6.04it/s, loss=3.81, v_num=0]
Epoch 20:  45%|████▌     | 44/97 [00:07<00:08,  5.99it/s, loss=3.82, v_num=0]
Epoch 20:  46%|████▋     | 45/97 [00:07<00:08,  6.06it/s, loss=3.82, v_num=0]
Epoch 20:  46%|████▋     | 45/97 [00:07<00:08,  6.01it/s, loss=3.82, v_num=0]
Epoch 20:  47%|████▋     | 46/97 [00:07<00:08,  6.08it/s, loss=3.82, v_num=0]
Epoch 20:  47%|████▋     | 46/97 [00:07<00:08,  6.04it/s, loss=3.82, v_num=0]
Epoch 20:  48%|████▊     | 47/97 [00:07<00:08,  6.10it/s, loss=3.82, v_num=0]
Epoch 20:  48%|████▊     | 47/97 [00:07<00:08,  6.06it/s, loss=3.81, v_num=0]
Epoch 20:  49%|████▉     | 48/97 [00:07<00:08,  6.12it/s, loss=3.81, v_num=0]
Epoch 20:  49%|████▉     | 48/97 [00:07<00:08,  6.08it/s, loss=3.81, v_num=0]
Epoch 20:  51%|█████     | 49/97 [00:07<00:07,  6.14it/s, loss=3.81, v_num=0]
Epoch 20:  51%|█████     | 49/97 [00:08<00:07,  6.10it/s, loss=3.8, v_num=0]
Epoch 20:  52%|█████▏    | 50/97 [00:08<00:07,  6.16it/s, loss=3.8, v_num=0]
Epoch 20:  52%|█████▏    | 50/97 [00:08<00:07,  6.12it/s, loss=3.79, v_num=0]
Epoch 20:  53%|█████▎    | 51/97 [00:08<00:07,  6.18it/s, loss=3.79, v_num=0]
Epoch 20:  53%|█████▎    | 51/97 [00:08<00:07,  6.14it/s, loss=3.79, v_num=0]
Epoch 20:  54%|█████▎    | 52/97 [00:08<00:07,  6.20it/s, loss=3.79, v_num=0]
Epoch 20:  54%|█████▎    | 52/97 [00:08<00:07,  6.16it/s, loss=3.78, v_num=0]
Epoch 20:  55%|█████▍    | 53/97 [00:08<00:07,  6.22it/s, loss=3.78, v_num=0]
Epoch 20:  55%|█████▍    | 53/97 [00:08<00:07,  6.18it/s, loss=3.78, v_num=0]
Epoch 20:  56%|█████▌    | 54/97 [00:08<00:06,  6.23it/s, loss=3.78, v_num=0]
Epoch 20:  56%|█████▌    | 54/97 [00:08<00:06,  6.19it/s, loss=3.78, v_num=0]
Epoch 20:  57%|█████▋    | 55/97 [00:08<00:06,  6.25it/s, loss=3.78, v_num=0]
Epoch 20:  57%|█████▋    | 55/97 [00:08<00:06,  6.21it/s, loss=3.78, v_num=0]
Epoch 20:  58%|█████▊    | 56/97 [00:08<00:06,  6.27it/s, loss=3.78, v_num=0]
Epoch 20:  58%|█████▊    | 56/97 [00:08<00:06,  6.23it/s, loss=3.78, v_num=0]
Epoch 20:  59%|█████▉    | 57/97 [00:09<00:06,  6.28it/s, loss=3.78, v_num=0]
Epoch 20:  59%|█████▉    | 57/97 [00:09<00:06,  6.24it/s, loss=3.78, v_num=0]
Epoch 20:  60%|█████▉    | 58/97 [00:09<00:06,  6.30it/s, loss=3.78, v_num=0]
Epoch 20:  60%|█████▉    | 58/97 [00:09<00:06,  6.26it/s, loss=3.79, v_num=0]
Epoch 20:  61%|██████    | 59/97 [00:09<00:06,  6.31it/s, loss=3.79, v_num=0]
Epoch 20:  61%|██████    | 59/97 [00:09<00:06,  6.27it/s, loss=3.78, v_num=0]
Epoch 20:  62%|██████▏   | 60/97 [00:09<00:05,  6.33it/s, loss=3.78, v_num=0]
Epoch 20:  62%|██████▏   | 60/97 [00:09<00:05,  6.29it/s, loss=3.79, v_num=0]
Epoch 20:  63%|██████▎   | 61/97 [00:09<00:05,  6.34it/s, loss=3.79, v_num=0]
Epoch 20:  63%|██████▎   | 61/97 [00:09<00:05,  6.30it/s, loss=3.79, v_num=0]
Epoch 20:  64%|██████▍   | 62/97 [00:09<00:05,  6.36it/s, loss=3.79, v_num=0]
Epoch 20:  64%|██████▍   | 62/97 [00:09<00:05,  6.32it/s, loss=3.78, v_num=0]
Epoch 20:  65%|██████▍   | 63/97 [00:09<00:05,  6.37it/s, loss=3.78, v_num=0]
Epoch 20:  65%|██████▍   | 63/97 [00:09<00:05,  6.33it/s, loss=3.78, v_num=0]
Epoch 20:  66%|██████▌   | 64/97 [00:10<00:05,  6.38it/s, loss=3.78, v_num=0]
Epoch 20:  66%|██████▌   | 64/97 [00:10<00:05,  6.34it/s, loss=3.77, v_num=0]
Epoch 20:  67%|██████▋   | 65/97 [00:10<00:05,  6.39it/s, loss=3.77, v_num=0]
Epoch 20:  67%|██████▋   | 65/97 [00:10<00:05,  6.36it/s, loss=3.77, v_num=0]
Epoch 20:  68%|██████▊   | 66/97 [00:10<00:04,  6.40it/s, loss=3.77, v_num=0]
Epoch 20:  68%|██████▊   | 66/97 [00:10<00:04,  6.37it/s, loss=3.78, v_num=0]
Epoch 20:  69%|██████▉   | 67/97 [00:10<00:04,  6.42it/s, loss=3.78, v_num=0]
Epoch 20:  69%|██████▉   | 67/97 [00:10<00:04,  6.38it/s, loss=3.78, v_num=0]
Epoch 20:  70%|███████   | 68/97 [00:10<00:04,  6.43it/s, loss=3.78, v_num=0]
Epoch 20:  70%|███████   | 68/97 [00:10<00:04,  6.39it/s, loss=3.78, v_num=0]
Epoch 20:  71%|███████   | 69/97 [00:10<00:04,  6.44it/s, loss=3.78, v_num=0]
Epoch 20:  71%|███████   | 69/97 [00:10<00:04,  6.41it/s, loss=3.79, v_num=0]
Epoch 20:  72%|███████▏  | 70/97 [00:10<00:04,  6.45it/s, loss=3.79, v_num=0]
Epoch 20:  72%|███████▏  | 70/97 [00:10<00:04,  6.42it/s, loss=3.8, v_num=0]
Epoch 20:  73%|███████▎  | 71/97 [00:10<00:04,  6.46it/s, loss=3.8, v_num=0]
Epoch 20:  73%|███████▎  | 71/97 [00:11<00:04,  6.43it/s, loss=3.8, v_num=0]
Epoch 20:  74%|███████▍  | 72/97 [00:11<00:03,  6.47it/s, loss=3.8, v_num=0]
Epoch 20:  74%|███████▍  | 72/97 [00:11<00:03,  6.44it/s, loss=3.81, v_num=0]
Epoch 20:  75%|███████▌  | 73/97 [00:11<00:03,  6.48it/s, loss=3.81, v_num=0]
Epoch 20:  75%|███████▌  | 73/97 [00:11<00:03,  6.45it/s, loss=3.81, v_num=0]
Epoch 20:  76%|███████▋  | 74/97 [00:11<00:03,  6.49it/s, loss=3.81, v_num=0]
Epoch 20:  76%|███████▋  | 74/97 [00:11<00:03,  6.46it/s, loss=3.8, v_num=0]
Epoch 20:  77%|███████▋  | 75/97 [00:11<00:03,  6.50it/s, loss=3.8, v_num=0]
Epoch 20:  77%|███████▋  | 75/97 [00:11<00:03,  6.47it/s, loss=3.79, v_num=0]
Epoch 20:  78%|███████▊  | 76/97 [00:11<00:03,  6.51it/s, loss=3.79, v_num=0]
Epoch 20:  78%|███████▊  | 76/97 [00:11<00:03,  6.48it/s, loss=3.79, v_num=0]
Epoch 20:  79%|███████▉  | 77/97 [00:11<00:03,  6.52it/s, loss=3.79, v_num=0]
Epoch 20:  79%|███████▉  | 77/97 [00:11<00:03,  6.49it/s, loss=3.79, v_num=0]
Epoch 20:  80%|████████  | 78/97 [00:11<00:02,  6.53it/s, loss=3.79, v_num=0]
Epoch 20:  80%|████████  | 78/97 [00:12<00:02,  6.50it/s, loss=3.78, v_num=0]
Epoch 20:  81%|████████▏ | 79/97 [00:12<00:02,  6.54it/s, loss=3.78, v_num=0]
Epoch 20:  81%|████████▏ | 79/97 [00:12<00:02,  6.51it/s, loss=3.78, v_num=0]
Epoch 20:  82%|████████▏ | 80/97 [00:12<00:02,  6.54it/s, loss=3.78, v_num=0]
Epoch 20:  82%|████████▏ | 80/97 [00:12<00:02,  6.51it/s, loss=3.77, v_num=0]
Epoch 20:  84%|████████▎ | 81/97 [00:12<00:02,  6.55it/s, loss=3.77, v_num=0]
Epoch 20:  84%|████████▎ | 81/97 [00:12<00:02,  6.52it/s, loss=3.76, v_num=0]
Epoch 20:  85%|████████▍ | 82/97 [00:12<00:02,  6.56it/s, loss=3.76, v_num=0]
Epoch 20:  85%|████████▍ | 82/97 [00:12<00:02,  6.53it/s, loss=3.76, v_num=0]
Epoch 20:  86%|████████▌ | 83/97 [00:12<00:02,  6.57it/s, loss=3.76, v_num=0]
Epoch 20:  86%|████████▌ | 83/97 [00:12<00:02,  6.54it/s, loss=3.75, v_num=0]
Epoch 20:  87%|████████▋ | 84/97 [00:12<00:01,  6.57it/s, loss=3.75, v_num=0]
Epoch 20:  87%|████████▋ | 84/97 [00:12<00:01,  6.54it/s, loss=3.76, v_num=0]
Epoch 20:  88%|████████▊ | 85/97 [00:12<00:01,  6.58it/s, loss=3.76, v_num=0]
Epoch 20:  88%|████████▊ | 85/97 [00:12<00:01,  6.55it/s, loss=3.76, v_num=0]
Epoch 20:  89%|████████▊ | 86/97 [00:13<00:01,  6.59it/s, loss=3.76, v_num=0]
Epoch 20:  89%|████████▊ | 86/97 [00:13<00:01,  6.56it/s, loss=3.75, v_num=0]
Epoch 20:  90%|████████▉ | 87/97 [00:13<00:01,  6.60it/s, loss=3.75, v_num=0]
Epoch 20:  90%|████████▉ | 87/97 [00:13<00:01,  6.57it/s, loss=3.75, v_num=0]
Epoch 20:  91%|█████████ | 88/97 [00:13<00:01,  6.60it/s, loss=3.75, v_num=0]
Epoch 20:  91%|█████████ | 88/97 [00:13<00:01,  6.58it/s, loss=3.75, v_num=0]
Epoch 20:  92%|█████████▏| 89/97 [00:13<00:01,  6.61it/s, loss=3.75, v_num=0]
Epoch 20:  92%|█████████▏| 89/97 [00:13<00:01,  6.58it/s, loss=3.75, v_num=0]
Epoch 20:  93%|█████████▎| 90/97 [00:13<00:01,  6.62it/s, loss=3.75, v_num=0]
Epoch 20:  93%|█████████▎| 90/97 [00:13<00:01,  6.59it/s, loss=3.75, v_num=0]
Epoch 20:  94%|█████████▍| 91/97 [00:13<00:00,  6.62it/s, loss=3.75, v_num=0]
Epoch 20:  94%|█████████▍| 91/97 [00:13<00:00,  6.60it/s, loss=3.75, v_num=0]
Epoch 20:  95%|█████████▍| 92/97 [00:13<00:00,  6.63it/s, loss=3.75, v_num=0]
Epoch 20:  95%|█████████▍| 92/97 [00:13<00:00,  6.60it/s, loss=3.75, v_num=0]
Epoch 20:  96%|█████████▌| 93/97 [00:14<00:00,  6.64it/s, loss=3.75, v_num=0]
Epoch 20:  96%|█████████▌| 93/97 [00:14<00:00,  6.61it/s, loss=3.75, v_num=0]
Epoch 20:  97%|█████████▋| 94/97 [00:14<00:00,  6.64it/s, loss=3.75, v_num=0]
Epoch 20:  97%|█████████▋| 94/97 [00:14<00:00,  6.62it/s, loss=3.75, v_num=0]
Epoch 20:  98%|█████████▊| 95/97 [00:14<00:00,  6.65it/s, loss=3.75, v_num=0]
Epoch 20:  98%|█████████▊| 95/97 [00:14<00:00,  6.62it/s, loss=3.76, v_num=0]
Epoch 20:  99%|█████████▉| 96/97 [00:14<00:00,  6.66it/s, loss=3.76, v_num=0]
Epoch 20:  99%|█████████▉| 96/97 [00:14<00:00,  6.63it/s, loss=3.76, v_num=0]
Epoch 20: 100%|██████████| 97/97 [00:14<00:00,  6.66it/s, loss=3.76, v_num=0]
Epoch 20: 100%|██████████| 97/97 [00:14<00:00,  6.64it/s, loss=3.76, v_num=0]
Epoch 20: 100%|██████████| 97/97 [00:14<00:00,  6.64it/s, loss=3.76, v_num=0]
Epoch 20:   0%|          | 0/97 [00:00<?, ?it/s, loss=3.76, v_num=0]
Epoch 21:   0%|          | 0/97 [00:00<?, ?it/s, loss=3.76, v_num=0]
Epoch 21:   1%|          | 1/97 [00:01<02:12,  1.38s/it, loss=3.76, v_num=0]
Epoch 21:   1%|          | 1/97 [00:01<02:17,  1.43s/it, loss=3.76, v_num=0]
Epoch 21:   2%|▏         | 2/97 [00:01<01:12,  1.31it/s, loss=3.76, v_num=0]
Epoch 21:   2%|▏         | 2/97 [00:01<01:14,  1.27it/s, loss=3.77, v_num=0]
Epoch 21:   3%|▎         | 3/97 [00:01<00:51,  1.81it/s, loss=3.77, v_num=0]
Epoch 21:   3%|▎         | 3/97 [00:01<00:53,  1.75it/s, loss=3.78, v_num=0]
Epoch 21:   4%|▍         | 4/97 [00:01<00:41,  2.23it/s, loss=3.78, v_num=0]
Epoch 21:   4%|▍         | 4/97 [00:01<00:43,  2.16it/s, loss=3.79, v_num=0]
Epoch 21:   5%|▌         | 5/97 [00:01<00:35,  2.59it/s, loss=3.79, v_num=0]
Epoch 21:   5%|▌         | 5/97 [00:01<00:36,  2.52it/s, loss=3.78, v_num=0]
Epoch 21:   6%|▌         | 6/97 [00:02<00:31,  2.89it/s, loss=3.78, v_num=0]
Epoch 21:   6%|▌         | 6/97 [00:02<00:32,  2.82it/s, loss=3.78, v_num=0]
Epoch 21:   7%|▋         | 7/97 [00:02<00:28,  3.17it/s, loss=3.78, v_num=0]
Epoch 21:   7%|▋         | 7/97 [00:02<00:29,  3.09it/s, loss=3.77, v_num=0]
Epoch 21:   8%|▊         | 8/97 [00:02<00:26,  3.41it/s, loss=3.77, v_num=0]
Epoch 21:   8%|▊         | 8/97 [00:02<00:26,  3.33it/s, loss=3.77, v_num=0]
Epoch 21:   9%|▉         | 9/97 [00:02<00:24,  3.62it/s, loss=3.77, v_num=0]
Epoch 21:   9%|▉         | 9/97 [00:02<00:24,  3.54it/s, loss=3.77, v_num=0]
Epoch 21:  10%|█         | 10/97 [00:02<00:22,  3.81it/s, loss=3.77, v_num=0]
Epoch 21:  10%|█         | 10/97 [00:02<00:23,  3.73it/s, loss=3.77, v_num=0]
Epoch 21:  11%|█▏        | 11/97 [00:02<00:21,  3.99it/s, loss=3.77, v_num=0]
Epoch 21:  11%|█▏        | 11/97 [00:02<00:22,  3.91it/s, loss=3.77, v_num=0]
Epoch 21:  12%|█▏        | 12/97 [00:02<00:20,  4.15it/s, loss=3.77, v_num=0]
Epoch 21:  12%|█▏        | 12/97 [00:02<00:20,  4.07it/s, loss=3.77, v_num=0]
Epoch 21:  13%|█▎        | 13/97 [00:03<00:19,  4.29it/s, loss=3.77, v_num=0]
Epoch 21:  13%|█▎        | 13/97 [00:03<00:19,  4.21it/s, loss=3.77, v_num=0]
Epoch 21:  14%|█▍        | 14/97 [00:03<00:18,  4.42it/s, loss=3.77, v_num=0]
Epoch 21:  14%|█▍        | 14/97 [00:03<00:19,  4.34it/s, loss=3.76, v_num=0]
Epoch 21:  15%|█▌        | 15/97 [00:03<00:18,  4.54it/s, loss=3.76, v_num=0]
Epoch 21:  15%|█▌        | 15/97 [00:03<00:18,  4.46it/s, loss=3.76, v_num=0]
Epoch 21:  16%|█▋        | 16/97 [00:03<00:17,  4.65it/s, loss=3.76, v_num=0]
Epoch 21:  16%|█▋        | 16/97 [00:03<00:17,  4.57it/s, loss=3.75, v_num=0]
Epoch 21:  18%|█▊        | 17/97 [00:03<00:16,  4.75it/s, loss=3.75, v_num=0]
Epoch 21:  18%|█▊        | 17/97 [00:03<00:17,  4.67it/s, loss=3.76, v_num=0]
Epoch 21:  19%|█▊        | 18/97 [00:03<00:16,  4.84it/s, loss=3.76, v_num=0]
Epoch 21:  19%|█▊        | 18/97 [00:03<00:16,  4.77it/s, loss=3.76, v_num=0]
Epoch 21:  20%|█▉        | 19/97 [00:03<00:15,  4.92it/s, loss=3.76, v_num=0]
Epoch 21:  20%|█▉        | 19/97 [00:03<00:16,  4.86it/s, loss=3.76, v_num=0]
Epoch 21:  21%|██        | 20/97 [00:03<00:15,  5.01it/s, loss=3.76, v_num=0]
Epoch 21:  21%|██        | 20/97 [00:04<00:15,  4.94it/s, loss=3.76, v_num=0]
Epoch 21:  22%|██▏       | 21/97 [00:04<00:14,  5.08it/s, loss=3.76, v_num=0]
Epoch 21:  22%|██▏       | 21/97 [00:04<00:15,  5.02it/s, loss=3.76, v_num=0]
Epoch 21:  23%|██▎       | 22/97 [00:04<00:14,  5.15it/s, loss=3.76, v_num=0]
Epoch 21:  23%|██▎       | 22/97 [00:04<00:14,  5.09it/s, loss=3.75, v_num=0]
Epoch 21:  24%|██▎       | 23/97 [00:04<00:14,  5.22it/s, loss=3.75, v_num=0]
Epoch 21:  24%|██▎       | 23/97 [00:04<00:14,  5.16it/s, loss=3.75, v_num=0]
Epoch 21:  25%|██▍       | 24/97 [00:04<00:13,  5.28it/s, loss=3.75, v_num=0]
Epoch 21:  25%|██▍       | 24/97 [00:04<00:13,  5.22it/s, loss=3.75, v_num=0]
Epoch 21:  26%|██▌       | 25/97 [00:04<00:13,  5.34it/s, loss=3.75, v_num=0]
Epoch 21:  26%|██▌       | 25/97 [00:04<00:13,  5.28it/s, loss=3.76, v_num=0]
Epoch 21:  27%|██▋       | 26/97 [00:04<00:13,  5.40it/s, loss=3.76, v_num=0]
Epoch 21:  27%|██▋       | 26/97 [00:04<00:13,  5.33it/s, loss=3.76, v_num=0]
Epoch 21:  28%|██▊       | 27/97 [00:04<00:12,  5.45it/s, loss=3.76, v_num=0]
Epoch 21:  28%|██▊       | 27/97 [00:05<00:12,  5.39it/s, loss=3.75, v_num=0]
Epoch 21:  29%|██▉       | 28/97 [00:05<00:12,  5.50it/s, loss=3.75, v_num=0]
Epoch 21:  29%|██▉       | 28/97 [00:05<00:12,  5.44it/s, loss=3.76, v_num=0]
Epoch 21:  30%|██▉       | 29/97 [00:05<00:12,  5.55it/s, loss=3.76, v_num=0]
Epoch 21:  30%|██▉       | 29/97 [00:05<00:12,  5.49it/s, loss=3.75, v_num=0]
Epoch 21:  31%|███       | 30/97 [00:05<00:11,  5.59it/s, loss=3.75, v_num=0]
Epoch 21:  31%|███       | 30/97 [00:05<00:12,  5.54it/s, loss=3.75, v_num=0]
Epoch 21:  32%|███▏      | 31/97 [00:05<00:11,  5.63it/s, loss=3.75, v_num=0]
Epoch 21:  32%|███▏      | 31/97 [00:05<00:11,  5.58it/s, loss=3.74, v_num=0]
Epoch 21:  33%|███▎      | 32/97 [00:05<00:11,  5.67it/s, loss=3.74, v_num=0]
Epoch 21:  33%|███▎      | 32/97 [00:05<00:11,  5.62it/s, loss=3.75, v_num=0]
Epoch 21:  34%|███▍      | 33/97 [00:05<00:11,  5.71it/s, loss=3.75, v_num=0]
Epoch 21:  34%|███▍      | 33/97 [00:05<00:11,  5.66it/s, loss=3.75, v_num=0]
Epoch 21:  35%|███▌      | 34/97 [00:05<00:10,  5.75it/s, loss=3.75, v_num=0]
Epoch 21:  35%|███▌      | 34/97 [00:05<00:11,  5.70it/s, loss=3.75, v_num=0]
Epoch 21:  36%|███▌      | 35/97 [00:06<00:10,  5.79it/s, loss=3.75, v_num=0]
Epoch 21:  36%|███▌      | 35/97 [00:06<00:10,  5.73it/s, loss=3.75, v_num=0]
Epoch 21:  37%|███▋      | 36/97 [00:06<00:10,  5.82it/s, loss=3.75, v_num=0]
Epoch 21:  37%|███▋      | 36/97 [00:06<00:10,  5.77it/s, loss=3.75, v_num=0]
Epoch 21:  38%|███▊      | 37/97 [00:06<00:10,  5.85it/s, loss=3.75, v_num=0]
Epoch 21:  38%|███▊      | 37/97 [00:06<00:10,  5.80it/s, loss=3.75, v_num=0]
Epoch 21:  39%|███▉      | 38/97 [00:06<00:10,  5.88it/s, loss=3.75, v_num=0]
Epoch 21:  39%|███▉      | 38/97 [00:06<00:10,  5.83it/s, loss=3.75, v_num=0]
Epoch 21:  40%|████      | 39/97 [00:06<00:09,  5.91it/s, loss=3.75, v_num=0]
Epoch 21:  40%|████      | 39/97 [00:06<00:09,  5.86it/s, loss=3.75, v_num=0]
Epoch 21:  41%|████      | 40/97 [00:06<00:09,  5.94it/s, loss=3.75, v_num=0]
Epoch 21:  41%|████      | 40/97 [00:06<00:09,  5.89it/s, loss=3.74, v_num=0]
Epoch 21:  42%|████▏     | 41/97 [00:06<00:09,  5.97it/s, loss=3.74, v_num=0]
Epoch 21:  42%|████▏     | 41/97 [00:06<00:09,  5.92it/s, loss=3.74, v_num=0]
Epoch 21:  43%|████▎     | 42/97 [00:07<00:09,  5.99it/s, loss=3.74, v_num=0]
Epoch 21:  43%|████▎     | 42/97 [00:07<00:09,  5.95it/s, loss=3.75, v_num=0]
Epoch 21:  44%|████▍     | 43/97 [00:07<00:08,  6.02it/s, loss=3.75, v_num=0]
Epoch 21:  44%|████▍     | 43/97 [00:07<00:09,  5.97it/s, loss=3.74, v_num=0]
Epoch 21:  45%|████▌     | 44/97 [00:07<00:08,  6.05it/s, loss=3.74, v_num=0]
Epoch 21:  45%|████▌     | 44/97 [00:07<00:08,  6.00it/s, loss=3.74, v_num=0]
Epoch 21:  46%|████▋     | 45/97 [00:07<00:08,  6.07it/s, loss=3.74, v_num=0]
Epoch 21:  46%|████▋     | 45/97 [00:07<00:08,  6.02it/s, loss=3.74, v_num=0]
Epoch 21:  47%|████▋     | 46/97 [00:07<00:08,  6.09it/s, loss=3.74, v_num=0]
Epoch 21:  47%|████▋     | 46/97 [00:07<00:08,  6.04it/s, loss=3.74, v_num=0]
Epoch 21:  48%|████▊     | 47/97 [00:07<00:08,  6.11it/s, loss=3.74, v_num=0]
Epoch 21:  48%|████▊     | 47/97 [00:07<00:08,  6.06it/s, loss=3.74, v_num=0]
Epoch 21:  49%|████▉     | 48/97 [00:07<00:08,  6.12it/s, loss=3.74, v_num=0]
Epoch 21:  49%|████▉     | 48/97 [00:07<00:08,  6.08it/s, loss=3.74, v_num=0]
Epoch 21:  51%|█████     | 49/97 [00:07<00:07,  6.14it/s, loss=3.74, v_num=0]
Epoch 21:  51%|█████     | 49/97 [00:08<00:07,  6.10it/s, loss=3.74, v_num=0]
Epoch 21:  52%|█████▏    | 50/97 [00:08<00:07,  6.16it/s, loss=3.74, v_num=0]
Epoch 21:  52%|█████▏    | 50/97 [00:08<00:07,  6.12it/s, loss=3.74, v_num=0]
Epoch 21:  53%|█████▎    | 51/97 [00:08<00:07,  6.18it/s, loss=3.74, v_num=0]
Epoch 21:  53%|█████▎    | 51/97 [00:08<00:07,  6.14it/s, loss=3.74, v_num=0]
Epoch 21:  54%|█████▎    | 52/97 [00:08<00:07,  6.20it/s, loss=3.74, v_num=0]
Epoch 21:  54%|█████▎    | 52/97 [00:08<00:07,  6.16it/s, loss=3.73, v_num=0]
Epoch 21:  55%|█████▍    | 53/97 [00:08<00:07,  6.22it/s, loss=3.73, v_num=0]
Epoch 21:  55%|█████▍    | 53/97 [00:08<00:07,  6.18it/s, loss=3.73, v_num=0]
Epoch 21:  56%|█████▌    | 54/97 [00:08<00:06,  6.24it/s, loss=3.73, v_num=0]
Epoch 21:  56%|█████▌    | 54/97 [00:08<00:06,  6.20it/s, loss=3.74, v_num=0]
Epoch 21:  57%|█████▋    | 55/97 [00:08<00:06,  6.26it/s, loss=3.74, v_num=0]
Epoch 21:  57%|█████▋    | 55/97 [00:08<00:06,  6.21it/s, loss=3.73, v_num=0]
Epoch 21:  58%|█████▊    | 56/97 [00:08<00:06,  6.27it/s, loss=3.73, v_num=0]
Epoch 21:  58%|█████▊    | 56/97 [00:08<00:06,  6.23it/s, loss=3.73, v_num=0]
Epoch 21:  59%|█████▉    | 57/97 [00:09<00:06,  6.28it/s, loss=3.73, v_num=0]
Epoch 21:  59%|█████▉    | 57/97 [00:09<00:06,  6.25it/s, loss=3.73, v_num=0]
Epoch 21:  60%|█████▉    | 58/97 [00:09<00:06,  6.30it/s, loss=3.73, v_num=0]
Epoch 21:  60%|█████▉    | 58/97 [00:09<00:06,  6.26it/s, loss=3.72, v_num=0]
Epoch 21:  61%|██████    | 59/97 [00:09<00:06,  6.31it/s, loss=3.72, v_num=0]
Epoch 21:  61%|██████    | 59/97 [00:09<00:06,  6.28it/s, loss=3.71, v_num=0]
Epoch 21:  62%|██████▏   | 60/97 [00:09<00:05,  6.33it/s, loss=3.71, v_num=0]
Epoch 21:  62%|██████▏   | 60/97 [00:09<00:05,  6.29it/s, loss=3.71, v_num=0]
Epoch 21:  63%|██████▎   | 61/97 [00:09<00:05,  6.34it/s, loss=3.71, v_num=0]
Epoch 21:  63%|██████▎   | 61/97 [00:09<00:05,  6.30it/s, loss=3.72, v_num=0]
Epoch 21:  64%|██████▍   | 62/97 [00:09<00:05,  6.35it/s, loss=3.72, v_num=0]
Epoch 21:  64%|██████▍   | 62/97 [00:09<00:05,  6.32it/s, loss=3.72, v_num=0]
Epoch 21:  65%|██████▍   | 63/97 [00:09<00:05,  6.37it/s, loss=3.72, v_num=0]
Epoch 21:  65%|██████▍   | 63/97 [00:09<00:05,  6.33it/s, loss=3.72, v_num=0]
Epoch 21:  66%|██████▌   | 64/97 [00:10<00:05,  6.38it/s, loss=3.72, v_num=0]
Epoch 21:  66%|██████▌   | 64/97 [00:10<00:05,  6.34it/s, loss=3.72, v_num=0]
Epoch 21:  67%|██████▋   | 65/97 [00:10<00:05,  6.39it/s, loss=3.72, v_num=0]
Epoch 21:  67%|██████▋   | 65/97 [00:10<00:05,  6.36it/s, loss=3.71, v_num=0]
Epoch 21:  68%|██████▊   | 66/97 [00:10<00:04,  6.40it/s, loss=3.71, v_num=0]
Epoch 21:  68%|██████▊   | 66/97 [00:10<00:04,  6.37it/s, loss=3.72, v_num=0]
Epoch 21:  69%|██████▉   | 67/97 [00:10<00:04,  6.42it/s, loss=3.72, v_num=0]
Epoch 21:  69%|██████▉   | 67/97 [00:10<00:04,  6.38it/s, loss=3.72, v_num=0]
Epoch 21:  70%|███████   | 68/97 [00:10<00:04,  6.43it/s, loss=3.72, v_num=0]
Epoch 21:  70%|███████   | 68/97 [00:10<00:04,  6.39it/s, loss=3.72, v_num=0]
Epoch 21:  71%|███████   | 69/97 [00:10<00:04,  6.44it/s, loss=3.72, v_num=0]
Epoch 21:  71%|███████   | 69/97 [00:10<00:04,  6.41it/s, loss=3.71, v_num=0]
Epoch 21:  72%|███████▏  | 70/97 [00:10<00:04,  6.45it/s, loss=3.71, v_num=0]
Epoch 21:  72%|███████▏  | 70/97 [00:10<00:04,  6.42it/s, loss=3.71, v_num=0]
Epoch 21:  73%|███████▎  | 71/97 [00:10<00:04,  6.46it/s, loss=3.71, v_num=0]
Epoch 21:  73%|███████▎  | 71/97 [00:11<00:04,  6.43it/s, loss=3.72, v_num=0]
Epoch 21:  74%|███████▍  | 72/97 [00:11<00:03,  6.47it/s, loss=3.72, v_num=0]
Epoch 21:  74%|███████▍  | 72/97 [00:11<00:03,  6.44it/s, loss=3.72, v_num=0]
Epoch 21:  75%|███████▌  | 73/97 [00:11<00:03,  6.48it/s, loss=3.72, v_num=0]
Epoch 21:  75%|███████▌  | 73/97 [00:11<00:03,  6.45it/s, loss=3.72, v_num=0]
Epoch 21:  76%|███████▋  | 74/97 [00:11<00:03,  6.49it/s, loss=3.72, v_num=0]
Epoch 21:  76%|███████▋  | 74/97 [00:11<00:03,  6.46it/s, loss=3.72, v_num=0]
Epoch 21:  77%|███████▋  | 75/97 [00:11<00:03,  6.50it/s, loss=3.72, v_num=0]
Epoch 21:  77%|███████▋  | 75/97 [00:11<00:03,  6.47it/s, loss=3.72, v_num=0]
Epoch 21:  78%|███████▊  | 76/97 [00:11<00:03,  6.51it/s, loss=3.72, v_num=0]
Epoch 21:  78%|███████▊  | 76/97 [00:11<00:03,  6.48it/s, loss=3.71, v_num=0]
Epoch 21:  79%|███████▉  | 77/97 [00:11<00:03,  6.52it/s, loss=3.71, v_num=0]
Epoch 21:  79%|███████▉  | 77/97 [00:11<00:03,  6.49it/s, loss=3.71, v_num=0]
Epoch 21:  80%|████████  | 78/97 [00:11<00:02,  6.53it/s, loss=3.71, v_num=0]
Epoch 21:  80%|████████  | 78/97 [00:12<00:02,  6.50it/s, loss=3.72, v_num=0]
Epoch 21:  81%|████████▏ | 79/97 [00:12<00:02,  6.54it/s, loss=3.72, v_num=0]
Epoch 21:  81%|████████▏ | 79/97 [00:12<00:02,  6.51it/s, loss=3.71, v_num=0]
Epoch 21:  82%|████████▏ | 80/97 [00:12<00:02,  6.55it/s, loss=3.71, v_num=0]
Epoch 21:  82%|████████▏ | 80/97 [00:12<00:02,  6.52it/s, loss=3.71, v_num=0]
Epoch 21:  84%|████████▎ | 81/97 [00:12<00:02,  6.55it/s, loss=3.71, v_num=0]
Epoch 21:  84%|████████▎ | 81/97 [00:12<00:02,  6.53it/s, loss=3.7, v_num=0]
Epoch 21:  85%|████████▍ | 82/97 [00:12<00:02,  6.56it/s, loss=3.7, v_num=0]
Epoch 21:  85%|████████▍ | 82/97 [00:12<00:02,  6.53it/s, loss=3.7, v_num=0]
Epoch 21:  86%|████████▌ | 83/97 [00:12<00:02,  6.56it/s, loss=3.7, v_num=0]
Epoch 21:  86%|████████▌ | 83/97 [00:12<00:02,  6.54it/s, loss=3.69, v_num=0]
Epoch 21:  87%|████████▋ | 84/97 [00:12<00:01,  6.57it/s, loss=3.69, v_num=0]
Epoch 21:  87%|████████▋ | 84/97 [00:12<00:01,  6.54it/s, loss=3.69, v_num=0]
Epoch 21:  88%|████████▊ | 85/97 [00:12<00:01,  6.58it/s, loss=3.69, v_num=0]
Epoch 21:  88%|████████▊ | 85/97 [00:12<00:01,  6.55it/s, loss=3.69, v_num=0]
Epoch 21:  89%|████████▊ | 86/97 [00:13<00:01,  6.59it/s, loss=3.69, v_num=0]
Epoch 21:  89%|████████▊ | 86/97 [00:13<00:01,  6.56it/s, loss=3.68, v_num=0]
Epoch 21:  90%|████████▉ | 87/97 [00:13<00:01,  6.60it/s, loss=3.68, v_num=0]
Epoch 21:  90%|████████▉ | 87/97 [00:13<00:01,  6.57it/s, loss=3.68, v_num=0]
Epoch 21:  91%|█████████ | 88/97 [00:13<00:01,  6.61it/s, loss=3.68, v_num=0]
Epoch 21:  91%|█████████ | 88/97 [00:13<00:01,  6.58it/s, loss=3.68, v_num=0]
Epoch 21:  92%|█████████▏| 89/97 [00:13<00:01,  6.61it/s, loss=3.68, v_num=0]
Epoch 21:  92%|█████████▏| 89/97 [00:13<00:01,  6.58it/s, loss=3.69, v_num=0]
Epoch 21:  93%|█████████▎| 90/97 [00:13<00:01,  6.62it/s, loss=3.69, v_num=0]
Epoch 21:  93%|█████████▎| 90/97 [00:13<00:01,  6.59it/s, loss=3.69, v_num=0]
Epoch 21:  94%|█████████▍| 91/97 [00:13<00:00,  6.62it/s, loss=3.69, v_num=0]
Epoch 21:  94%|█████████▍| 91/97 [00:13<00:00,  6.59it/s, loss=3.7, v_num=0]
Epoch 21:  95%|█████████▍| 92/97 [00:13<00:00,  6.63it/s, loss=3.7, v_num=0]
Epoch 21:  95%|█████████▍| 92/97 [00:13<00:00,  6.60it/s, loss=3.69, v_num=0]
Epoch 21:  96%|█████████▌| 93/97 [00:14<00:00,  6.63it/s, loss=3.69, v_num=0]
Epoch 21:  96%|█████████▌| 93/97 [00:14<00:00,  6.61it/s, loss=3.69, v_num=0]
Epoch 21:  97%|█████████▋| 94/97 [00:14<00:00,  6.64it/s, loss=3.69, v_num=0]
Epoch 21:  97%|█████████▋| 94/97 [00:14<00:00,  6.61it/s, loss=3.68, v_num=0]
Epoch 21:  98%|█████████▊| 95/97 [00:14<00:00,  6.65it/s, loss=3.68, v_num=0]
Epoch 21:  98%|█████████▊| 95/97 [00:14<00:00,  6.62it/s, loss=3.68, v_num=0]
Epoch 21:  99%|█████████▉| 96/97 [00:14<00:00,  6.65it/s, loss=3.68, v_num=0]
Epoch 21:  99%|█████████▉| 96/97 [00:14<00:00,  6.63it/s, loss=3.68, v_num=0]
Epoch 21: 100%|██████████| 97/97 [00:14<00:00,  6.66it/s, loss=3.68, v_num=0]
Epoch 21: 100%|██████████| 97/97 [00:14<00:00,  6.63it/s, loss=3.69, v_num=0]
Epoch 21: 100%|██████████| 97/97 [00:14<00:00,  6.63it/s, loss=3.69, v_num=0]
Epoch 21:   0%|          | 0/97 [00:00<?, ?it/s, loss=3.69, v_num=0]
Epoch 22:   0%|          | 0/97 [00:00<?, ?it/s, loss=3.69, v_num=0]
Epoch 22:   1%|          | 1/97 [00:01<02:13,  1.39s/it, loss=3.69, v_num=0]
Epoch 22:   1%|          | 1/97 [00:01<02:18,  1.45s/it, loss=3.69, v_num=0]
Epoch 22:   2%|▏         | 2/97 [00:01<01:12,  1.31it/s, loss=3.69, v_num=0]
Epoch 22:   2%|▏         | 2/97 [00:01<01:15,  1.26it/s, loss=3.7, v_num=0]
Epoch 22:   3%|▎         | 3/97 [00:01<00:52,  1.80it/s, loss=3.7, v_num=0]
Epoch 22:   3%|▎         | 3/97 [00:01<00:53,  1.74it/s, loss=3.7, v_num=0]
Epoch 22:   4%|▍         | 4/97 [00:01<00:41,  2.23it/s, loss=3.7, v_num=0]
Epoch 22:   4%|▍         | 4/97 [00:01<00:43,  2.16it/s, loss=3.7, v_num=0]
Epoch 22:   5%|▌         | 5/97 [00:01<00:35,  2.57it/s, loss=3.7, v_num=0]
Epoch 22:   5%|▌         | 5/97 [00:01<00:36,  2.50it/s, loss=3.69, v_num=0]
Epoch 22:   6%|▌         | 6/97 [00:02<00:31,  2.89it/s, loss=3.69, v_num=0]
Epoch 22:   6%|▌         | 6/97 [00:02<00:32,  2.81it/s, loss=3.7, v_num=0]
Epoch 22:   7%|▋         | 7/97 [00:02<00:28,  3.16it/s, loss=3.7, v_num=0]
Epoch 22:   7%|▋         | 7/97 [00:02<00:29,  3.09it/s, loss=3.69, v_num=0]
Epoch 22:   8%|▊         | 8/97 [00:02<00:26,  3.41it/s, loss=3.69, v_num=0]
Epoch 22:   8%|▊         | 8/97 [00:02<00:26,  3.33it/s, loss=3.69, v_num=0]
Epoch 22:   9%|▉         | 9/97 [00:02<00:24,  3.61it/s, loss=3.69, v_num=0]
Epoch 22:   9%|▉         | 9/97 [00:02<00:24,  3.53it/s, loss=3.69, v_num=0]
Epoch 22:  10%|█         | 10/97 [00:02<00:22,  3.81it/s, loss=3.69, v_num=0]
Epoch 22:  10%|█         | 10/97 [00:02<00:23,  3.73it/s, loss=3.69, v_num=0]
Epoch 22:  11%|█▏        | 11/97 [00:02<00:21,  3.98it/s, loss=3.69, v_num=0]
Epoch 22:  11%|█▏        | 11/97 [00:02<00:22,  3.90it/s, loss=3.69, v_num=0]
Epoch 22:  12%|█▏        | 12/97 [00:02<00:20,  4.13it/s, loss=3.69, v_num=0]
Epoch 22:  12%|█▏        | 12/97 [00:02<00:20,  4.05it/s, loss=3.68, v_num=0]
Epoch 22:  13%|█▎        | 13/97 [00:03<00:19,  4.27it/s, loss=3.68, v_num=0]
Epoch 22:  13%|█▎        | 13/97 [00:03<00:20,  4.19it/s, loss=3.68, v_num=0]
Epoch 22:  14%|█▍        | 14/97 [00:03<00:18,  4.40it/s, loss=3.68, v_num=0]
Epoch 22:  14%|█▍        | 14/97 [00:03<00:19,  4.33it/s, loss=3.67, v_num=0]
Epoch 22:  15%|█▌        | 15/97 [00:03<00:18,  4.52it/s, loss=3.67, v_num=0]
Epoch 22:  15%|█▌        | 15/97 [00:03<00:18,  4.45it/s, loss=3.67, v_num=0]
Epoch 22:  16%|█▋        | 16/97 [00:03<00:17,  4.64it/s, loss=3.67, v_num=0]
Epoch 22:  16%|█▋        | 16/97 [00:03<00:17,  4.56it/s, loss=3.66, v_num=0]
Epoch 22:  18%|█▊        | 17/97 [00:03<00:16,  4.72it/s, loss=3.66, v_num=0]
Epoch 22:  18%|█▊        | 17/97 [00:03<00:17,  4.65it/s, loss=3.66, v_num=0]
Epoch 22:  19%|█▊        | 18/97 [00:03<00:16,  4.82it/s, loss=3.66, v_num=0]
Epoch 22:  19%|█▊        | 18/97 [00:03<00:16,  4.75it/s, loss=3.66, v_num=0]
Epoch 22:  20%|█▉        | 19/97 [00:03<00:15,  4.91it/s, loss=3.66, v_num=0]
Epoch 22:  20%|█▉        | 19/97 [00:03<00:16,  4.84it/s, loss=3.65, v_num=0]
Epoch 22:  21%|██        | 20/97 [00:04<00:15,  4.99it/s, loss=3.65, v_num=0]
Epoch 22:  21%|██        | 20/97 [00:04<00:15,  4.92it/s, loss=3.65, v_num=0]
Epoch 22:  22%|██▏       | 21/97 [00:04<00:14,  5.07it/s, loss=3.65, v_num=0]
Epoch 22:  22%|██▏       | 21/97 [00:04<00:15,  5.00it/s, loss=3.64, v_num=0]
Epoch 22:  23%|██▎       | 22/97 [00:04<00:14,  5.14it/s, loss=3.64, v_num=0]
Epoch 22:  23%|██▎       | 22/97 [00:04<00:14,  5.07it/s, loss=3.64, v_num=0]
Epoch 22:  24%|██▎       | 23/97 [00:04<00:14,  5.21it/s, loss=3.64, v_num=0]
Epoch 22:  24%|██▎       | 23/97 [00:04<00:14,  5.14it/s, loss=3.64, v_num=0]
Epoch 22:  25%|██▍       | 24/97 [00:04<00:13,  5.27it/s, loss=3.64, v_num=0]
Epoch 22:  25%|██▍       | 24/97 [00:04<00:14,  5.21it/s, loss=3.64, v_num=0]
Epoch 22:  26%|██▌       | 25/97 [00:04<00:13,  5.33it/s, loss=3.64, v_num=0]
Epoch 22:  26%|██▌       | 25/97 [00:04<00:13,  5.26it/s, loss=3.65, v_num=0]
Epoch 22:  27%|██▋       | 26/97 [00:04<00:13,  5.38it/s, loss=3.65, v_num=0]
Epoch 22:  27%|██▋       | 26/97 [00:04<00:13,  5.32it/s, loss=3.65, v_num=0]
Epoch 22:  28%|██▊       | 27/97 [00:04<00:12,  5.44it/s, loss=3.65, v_num=0]
Epoch 22:  28%|██▊       | 27/97 [00:05<00:13,  5.38it/s, loss=3.67, v_num=0]
Epoch 22:  29%|██▉       | 28/97 [00:05<00:12,  5.49it/s, loss=3.67, v_num=0]
Epoch 22:  29%|██▉       | 28/97 [00:05<00:12,  5.42it/s, loss=3.68, v_num=0]
Epoch 22:  30%|██▉       | 29/97 [00:05<00:12,  5.53it/s, loss=3.68, v_num=0]
Epoch 22:  30%|██▉       | 29/97 [00:05<00:12,  5.47it/s, loss=3.68, v_num=0]
Epoch 22:  31%|███       | 30/97 [00:05<00:12,  5.58it/s, loss=3.68, v_num=0]
Epoch 22:  31%|███       | 30/97 [00:05<00:12,  5.52it/s, loss=3.68, v_num=0]
Epoch 22:  32%|███▏      | 31/97 [00:05<00:11,  5.61it/s, loss=3.68, v_num=0]
Epoch 22:  32%|███▏      | 31/97 [00:05<00:11,  5.56it/s, loss=3.68, v_num=0]
Epoch 22:  33%|███▎      | 32/97 [00:05<00:11,  5.66it/s, loss=3.68, v_num=0]
Epoch 22:  33%|███▎      | 32/97 [00:05<00:11,  5.60it/s, loss=3.68, v_num=0]
Epoch 22:  34%|███▍      | 33/97 [00:05<00:11,  5.69it/s, loss=3.68, v_num=0]
Epoch 22:  34%|███▍      | 33/97 [00:05<00:11,  5.64it/s, loss=3.7, v_num=0]
Epoch 22:  35%|███▌      | 34/97 [00:05<00:10,  5.73it/s, loss=3.7, v_num=0]
Epoch 22:  35%|███▌      | 34/97 [00:05<00:11,  5.68it/s, loss=3.7, v_num=0]
Epoch 22:  36%|███▌      | 35/97 [00:06<00:10,  5.77it/s, loss=3.7, v_num=0]
Epoch 22:  36%|███▌      | 35/97 [00:06<00:10,  5.71it/s, loss=3.7, v_num=0]
Epoch 22:  37%|███▋      | 36/97 [00:06<00:10,  5.80it/s, loss=3.7, v_num=0]
Epoch 22:  37%|███▋      | 36/97 [00:06<00:10,  5.74it/s, loss=3.71, v_num=0]
Epoch 22:  38%|███▊      | 37/97 [00:06<00:10,  5.83it/s, loss=3.71, v_num=0]
Epoch 22:  38%|███▊      | 37/97 [00:06<00:10,  5.78it/s, loss=3.71, v_num=0]
Epoch 22:  39%|███▉      | 38/97 [00:06<00:10,  5.86it/s, loss=3.71, v_num=0]
Epoch 22:  39%|███▉      | 38/97 [00:06<00:10,  5.81it/s, loss=3.71, v_num=0]
Epoch 22:  40%|████      | 39/97 [00:06<00:09,  5.89it/s, loss=3.71, v_num=0]
Epoch 22:  40%|████      | 39/97 [00:06<00:09,  5.84it/s, loss=3.72, v_num=0]
Epoch 22:  41%|████      | 40/97 [00:06<00:09,  5.91it/s, loss=3.72, v_num=0]
Epoch 22:  41%|████      | 40/97 [00:06<00:09,  5.87it/s, loss=3.72, v_num=0]
Epoch 22:  42%|████▏     | 41/97 [00:06<00:09,  5.94it/s, loss=3.72, v_num=0]
Epoch 22:  42%|████▏     | 41/97 [00:06<00:09,  5.90it/s, loss=3.72, v_num=0]
Epoch 22:  43%|████▎     | 42/97 [00:07<00:09,  5.97it/s, loss=3.72, v_num=0]
Epoch 22:  43%|████▎     | 42/97 [00:07<00:09,  5.92it/s, loss=3.71, v_num=0]
Epoch 22:  44%|████▍     | 43/97 [00:07<00:09,  5.99it/s, loss=3.71, v_num=0]
Epoch 22:  44%|████▍     | 43/97 [00:07<00:09,  5.95it/s, loss=3.71, v_num=0]
Epoch 22:  45%|████▌     | 44/97 [00:07<00:08,  6.02it/s, loss=3.71, v_num=0]
Epoch 22:  45%|████▌     | 44/97 [00:07<00:08,  5.97it/s, loss=3.71, v_num=0]
Epoch 22:  46%|████▋     | 45/97 [00:07<00:08,  6.04it/s, loss=3.71, v_num=0]
Epoch 22:  46%|████▋     | 45/97 [00:07<00:08,  6.00it/s, loss=3.71, v_num=0]
Epoch 22:  47%|████▋     | 46/97 [00:07<00:08,  6.06it/s, loss=3.71, v_num=0]
Epoch 22:  47%|████▋     | 46/97 [00:07<00:08,  6.02it/s, loss=3.71, v_num=0]
Epoch 22:  48%|████▊     | 47/97 [00:07<00:08,  6.08it/s, loss=3.71, v_num=0]
Epoch 22:  48%|████▊     | 47/97 [00:07<00:08,  6.04it/s, loss=3.7, v_num=0]
Epoch 22:  49%|████▉     | 48/97 [00:07<00:08,  6.10it/s, loss=3.7, v_num=0]
Epoch 22:  49%|████▉     | 48/97 [00:07<00:08,  6.06it/s, loss=3.7, v_num=0]
Epoch 22:  51%|█████     | 49/97 [00:08<00:07,  6.12it/s, loss=3.7, v_num=0]
Epoch 22:  51%|█████     | 49/97 [00:08<00:07,  6.08it/s, loss=3.69, v_num=0]
Epoch 22:  52%|█████▏    | 50/97 [00:08<00:07,  6.14it/s, loss=3.69, v_num=0]
Epoch 22:  52%|█████▏    | 50/97 [00:08<00:07,  6.10it/s, loss=3.69, v_num=0]
Epoch 22:  53%|█████▎    | 51/97 [00:08<00:07,  6.16it/s, loss=3.69, v_num=0]
Epoch 22:  53%|█████▎    | 51/97 [00:08<00:07,  6.12it/s, loss=3.68, v_num=0]
Epoch 22:  54%|█████▎    | 52/97 [00:08<00:07,  6.18it/s, loss=3.68, v_num=0]
Epoch 22:  54%|█████▎    | 52/97 [00:08<00:07,  6.14it/s, loss=3.67, v_num=0]
Epoch 22:  55%|█████▍    | 53/97 [00:08<00:07,  6.19it/s, loss=3.67, v_num=0]
Epoch 22:  55%|█████▍    | 53/97 [00:08<00:07,  6.16it/s, loss=3.67, v_num=0]
Epoch 22:  56%|█████▌    | 54/97 [00:08<00:06,  6.21it/s, loss=3.67, v_num=0]
Epoch 22:  56%|█████▌    | 54/97 [00:08<00:06,  6.17it/s, loss=3.66, v_num=0]
Epoch 22:  57%|█████▋    | 55/97 [00:08<00:06,  6.23it/s, loss=3.66, v_num=0]
Epoch 22:  57%|█████▋    | 55/97 [00:08<00:06,  6.19it/s, loss=3.65, v_num=0]
Epoch 22:  58%|█████▊    | 56/97 [00:08<00:06,  6.24it/s, loss=3.65, v_num=0]
Epoch 22:  58%|█████▊    | 56/97 [00:09<00:06,  6.20it/s, loss=3.64, v_num=0]
Epoch 22:  59%|█████▉    | 57/97 [00:09<00:06,  6.26it/s, loss=3.64, v_num=0]
Epoch 22:  59%|█████▉    | 57/97 [00:09<00:06,  6.22it/s, loss=3.64, v_num=0]
Epoch 22:  60%|█████▉    | 58/97 [00:09<00:06,  6.27it/s, loss=3.64, v_num=0]
Epoch 22:  60%|█████▉    | 58/97 [00:09<00:06,  6.24it/s, loss=3.64, v_num=0]
Epoch 22:  61%|██████    | 59/97 [00:09<00:06,  6.29it/s, loss=3.64, v_num=0]
Epoch 22:  61%|██████    | 59/97 [00:09<00:06,  6.25it/s, loss=3.64, v_num=0]
Epoch 22:  62%|██████▏   | 60/97 [00:09<00:05,  6.30it/s, loss=3.64, v_num=0]
Epoch 22:  62%|██████▏   | 60/97 [00:09<00:05,  6.27it/s, loss=3.64, v_num=0]
Epoch 22:  63%|██████▎   | 61/97 [00:09<00:05,  6.32it/s, loss=3.64, v_num=0]
Epoch 22:  63%|██████▎   | 61/97 [00:09<00:05,  6.28it/s, loss=3.65, v_num=0]
Epoch 22:  64%|██████▍   | 62/97 [00:09<00:05,  6.33it/s, loss=3.65, v_num=0]
Epoch 22:  64%|██████▍   | 62/97 [00:09<00:05,  6.30it/s, loss=3.64, v_num=0]
Epoch 22:  65%|██████▍   | 63/97 [00:09<00:05,  6.34it/s, loss=3.64, v_num=0]
Epoch 22:  65%|██████▍   | 63/97 [00:09<00:05,  6.31it/s, loss=3.64, v_num=0]
Epoch 22:  66%|██████▌   | 64/97 [00:10<00:05,  6.36it/s, loss=3.64, v_num=0]
Epoch 22:  66%|██████▌   | 64/97 [00:10<00:05,  6.32it/s, loss=3.64, v_num=0]
Epoch 22:  67%|██████▋   | 65/97 [00:10<00:05,  6.37it/s, loss=3.64, v_num=0]
Epoch 22:  67%|██████▋   | 65/97 [00:10<00:05,  6.33it/s, loss=3.63, v_num=0]
Epoch 22:  68%|██████▊   | 66/97 [00:10<00:04,  6.38it/s, loss=3.63, v_num=0]
Epoch 22:  68%|██████▊   | 66/97 [00:10<00:04,  6.35it/s, loss=3.63, v_num=0]
Epoch 22:  69%|██████▉   | 67/97 [00:10<00:04,  6.39it/s, loss=3.63, v_num=0]
Epoch 22:  69%|██████▉   | 67/97 [00:10<00:04,  6.36it/s, loss=3.63, v_num=0]
Epoch 22:  70%|███████   | 68/97 [00:10<00:04,  6.40it/s, loss=3.63, v_num=0]
Epoch 22:  70%|███████   | 68/97 [00:10<00:04,  6.37it/s, loss=3.63, v_num=0]
Epoch 22:  71%|███████   | 69/97 [00:10<00:04,  6.42it/s, loss=3.63, v_num=0]
Epoch 22:  71%|███████   | 69/97 [00:10<00:04,  6.38it/s, loss=3.62, v_num=0]
Epoch 22:  72%|███████▏  | 70/97 [00:10<00:04,  6.43it/s, loss=3.62, v_num=0]
Epoch 22:  72%|███████▏  | 70/97 [00:10<00:04,  6.39it/s, loss=3.63, v_num=0]
Epoch 22:  73%|███████▎  | 71/97 [00:11<00:04,  6.44it/s, loss=3.63, v_num=0]
Epoch 22:  73%|███████▎  | 71/97 [00:11<00:04,  6.40it/s, loss=3.64, v_num=0]
Epoch 22:  74%|███████▍  | 72/97 [00:11<00:03,  6.45it/s, loss=3.64, v_num=0]
Epoch 22:  74%|███████▍  | 72/97 [00:11<00:03,  6.41it/s, loss=3.63, v_num=0]
Epoch 22:  75%|███████▌  | 73/97 [00:11<00:03,  6.46it/s, loss=3.63, v_num=0]
Epoch 22:  75%|███████▌  | 73/97 [00:11<00:03,  6.42it/s, loss=3.63, v_num=0]
Epoch 22:  76%|███████▋  | 74/97 [00:11<00:03,  6.47it/s, loss=3.63, v_num=0]
Epoch 22:  76%|███████▋  | 74/97 [00:11<00:03,  6.44it/s, loss=3.64, v_num=0]
Epoch 22:  77%|███████▋  | 75/97 [00:11<00:03,  6.48it/s, loss=3.64, v_num=0]
Epoch 22:  77%|███████▋  | 75/97 [00:11<00:03,  6.45it/s, loss=3.64, v_num=0]
Epoch 22:  78%|███████▊  | 76/97 [00:11<00:03,  6.49it/s, loss=3.64, v_num=0]
Epoch 22:  78%|███████▊  | 76/97 [00:11<00:03,  6.45it/s, loss=3.64, v_num=0]
Epoch 22:  79%|███████▉  | 77/97 [00:11<00:03,  6.49it/s, loss=3.64, v_num=0]
Epoch 22:  79%|███████▉  | 77/97 [00:11<00:03,  6.46it/s, loss=3.64, v_num=0]
Epoch 22:  80%|████████  | 78/97 [00:11<00:02,  6.51it/s, loss=3.64, v_num=0]
Epoch 22:  80%|████████  | 78/97 [00:12<00:02,  6.47it/s, loss=3.64, v_num=0]
Epoch 22:  81%|████████▏ | 79/97 [00:12<00:02,  6.51it/s, loss=3.64, v_num=0]
Epoch 22:  81%|████████▏ | 79/97 [00:12<00:02,  6.48it/s, loss=3.63, v_num=0]
Epoch 22:  82%|████████▏ | 80/97 [00:12<00:02,  6.52it/s, loss=3.63, v_num=0]
Epoch 22:  82%|████████▏ | 80/97 [00:12<00:02,  6.49it/s, loss=3.63, v_num=0]
Epoch 22:  84%|████████▎ | 81/97 [00:12<00:02,  6.53it/s, loss=3.63, v_num=0]
Epoch 22:  84%|████████▎ | 81/97 [00:12<00:02,  6.50it/s, loss=3.64, v_num=0]
Epoch 22:  85%|████████▍ | 82/97 [00:12<00:02,  6.54it/s, loss=3.64, v_num=0]
Epoch 22:  85%|████████▍ | 82/97 [00:12<00:02,  6.51it/s, loss=3.63, v_num=0]
Epoch 22:  86%|████████▌ | 83/97 [00:12<00:02,  6.55it/s, loss=3.63, v_num=0]
Epoch 22:  86%|████████▌ | 83/97 [00:12<00:02,  6.52it/s, loss=3.63, v_num=0]
Epoch 22:  87%|████████▋ | 84/97 [00:12<00:01,  6.55it/s, loss=3.63, v_num=0]
Epoch 22:  87%|████████▋ | 84/97 [00:12<00:01,  6.53it/s, loss=3.63, v_num=0]
Epoch 22:  88%|████████▊ | 85/97 [00:12<00:01,  6.56it/s, loss=3.63, v_num=0]
Epoch 22:  88%|████████▊ | 85/97 [00:13<00:01,  6.53it/s, loss=3.62, v_num=0]
Epoch 22:  89%|████████▊ | 86/97 [00:13<00:01,  6.57it/s, loss=3.62, v_num=0]
Epoch 22:  89%|████████▊ | 86/97 [00:13<00:01,  6.54it/s, loss=3.62, v_num=0]
Epoch 22:  90%|████████▉ | 87/97 [00:13<00:01,  6.58it/s, loss=3.62, v_num=0]
Epoch 22:  90%|████████▉ | 87/97 [00:13<00:01,  6.55it/s, loss=3.62, v_num=0]
Epoch 22:  91%|█████████ | 88/97 [00:13<00:01,  6.58it/s, loss=3.62, v_num=0]
Epoch 22:  91%|█████████ | 88/97 [00:13<00:01,  6.56it/s, loss=3.62, v_num=0]
Epoch 22:  92%|█████████▏| 89/97 [00:13<00:01,  6.59it/s, loss=3.62, v_num=0]
Epoch 22:  92%|█████████▏| 89/97 [00:13<00:01,  6.56it/s, loss=3.63, v_num=0]
Epoch 22:  93%|█████████▎| 90/97 [00:13<00:01,  6.60it/s, loss=3.63, v_num=0]
Epoch 22:  93%|█████████▎| 90/97 [00:13<00:01,  6.57it/s, loss=3.62, v_num=0]
Epoch 22:  94%|█████████▍| 91/97 [00:13<00:00,  6.60it/s, loss=3.62, v_num=0]
Epoch 22:  94%|█████████▍| 91/97 [00:13<00:00,  6.58it/s, loss=3.63, v_num=0]
Epoch 22:  95%|█████████▍| 92/97 [00:13<00:00,  6.61it/s, loss=3.63, v_num=0]
Epoch 22:  95%|█████████▍| 92/97 [00:13<00:00,  6.58it/s, loss=3.63, v_num=0]
Epoch 22:  96%|█████████▌| 93/97 [00:14<00:00,  6.62it/s, loss=3.63, v_num=0]
Epoch 22:  96%|█████████▌| 93/97 [00:14<00:00,  6.59it/s, loss=3.63, v_num=0]
Epoch 22:  97%|█████████▋| 94/97 [00:14<00:00,  6.62it/s, loss=3.63, v_num=0]
Epoch 22:  97%|█████████▋| 94/97 [00:14<00:00,  6.60it/s, loss=3.64, v_num=0]
Epoch 22:  98%|█████████▊| 95/97 [00:14<00:00,  6.63it/s, loss=3.64, v_num=0]
Epoch 22:  98%|█████████▊| 95/97 [00:14<00:00,  6.60it/s, loss=3.64, v_num=0]
Epoch 22:  99%|█████████▉| 96/97 [00:14<00:00,  6.64it/s, loss=3.64, v_num=0]
Epoch 22:  99%|█████████▉| 96/97 [00:14<00:00,  6.61it/s, loss=3.64, v_num=0]
Epoch 22: 100%|██████████| 97/97 [00:14<00:00,  6.64it/s, loss=3.64, v_num=0]
Epoch 22: 100%|██████████| 97/97 [00:14<00:00,  6.62it/s, loss=3.63, v_num=0]
Epoch 22: 100%|██████████| 97/97 [00:14<00:00,  6.62it/s, loss=3.63, v_num=0]
Epoch 22:   0%|          | 0/97 [00:00<?, ?it/s, loss=3.63, v_num=0]
Epoch 23:   0%|          | 0/97 [00:00<?, ?it/s, loss=3.63, v_num=0]
Epoch 23:   1%|          | 1/97 [00:01<02:12,  1.38s/it, loss=3.63, v_num=0]
Epoch 23:   1%|          | 1/97 [00:01<02:17,  1.43s/it, loss=3.62, v_num=0]
Epoch 23:   2%|▏         | 2/97 [00:01<01:12,  1.32it/s, loss=3.62, v_num=0]
Epoch 23:   2%|▏         | 2/97 [00:01<01:14,  1.27it/s, loss=3.62, v_num=0]
Epoch 23:   3%|▎         | 3/97 [00:01<00:52,  1.80it/s, loss=3.62, v_num=0]
Epoch 23:   3%|▎         | 3/97 [00:01<00:53,  1.74it/s, loss=3.62, v_num=0]
Epoch 23:   4%|▍         | 4/97 [00:01<00:41,  2.22it/s, loss=3.62, v_num=0]
Epoch 23:   4%|▍         | 4/97 [00:01<00:43,  2.16it/s, loss=3.61, v_num=0]
Epoch 23:   5%|▌         | 5/97 [00:01<00:35,  2.59it/s, loss=3.61, v_num=0]
Epoch 23:   5%|▌         | 5/97 [00:01<00:36,  2.51it/s, loss=3.61, v_num=0]
Epoch 23:   6%|▌         | 6/97 [00:02<00:31,  2.90it/s, loss=3.61, v_num=0]
Epoch 23:   6%|▌         | 6/97 [00:02<00:32,  2.82it/s, loss=3.62, v_num=0]
Epoch 23:   7%|▋         | 7/97 [00:02<00:28,  3.17it/s, loss=3.62, v_num=0]
Epoch 23:   7%|▋         | 7/97 [00:02<00:29,  3.09it/s, loss=3.63, v_num=0]
Epoch 23:   8%|▊         | 8/97 [00:02<00:26,  3.41it/s, loss=3.63, v_num=0]
Epoch 23:   8%|▊         | 8/97 [00:02<00:26,  3.34it/s, loss=3.63, v_num=0]
Epoch 23:   9%|▉         | 9/97 [00:02<00:24,  3.63it/s, loss=3.63, v_num=0]
Epoch 23:   9%|▉         | 9/97 [00:02<00:24,  3.55it/s, loss=3.63, v_num=0]
Epoch 23:  10%|█         | 10/97 [00:02<00:22,  3.82it/s, loss=3.63, v_num=0]
Epoch 23:  10%|█         | 10/97 [00:02<00:23,  3.74it/s, loss=3.63, v_num=0]
Epoch 23:  11%|█▏        | 11/97 [00:02<00:21,  3.99it/s, loss=3.63, v_num=0]
Epoch 23:  11%|█▏        | 11/97 [00:02<00:21,  3.91it/s, loss=3.63, v_num=0]
Epoch 23:  12%|█▏        | 12/97 [00:02<00:20,  4.15it/s, loss=3.63, v_num=0]
Epoch 23:  12%|█▏        | 12/97 [00:02<00:20,  4.07it/s, loss=3.63, v_num=0]
Epoch 23:  13%|█▎        | 13/97 [00:03<00:19,  4.29it/s, loss=3.63, v_num=0]
Epoch 23:  13%|█▎        | 13/97 [00:03<00:19,  4.21it/s, loss=3.63, v_num=0]
Epoch 23:  14%|█▍        | 14/97 [00:03<00:18,  4.42it/s, loss=3.63, v_num=0]
Epoch 23:  14%|█▍        | 14/97 [00:03<00:19,  4.35it/s, loss=3.63, v_num=0]
Epoch 23:  15%|█▌        | 15/97 [00:03<00:18,  4.54it/s, loss=3.63, v_num=0]
Epoch 23:  15%|█▌        | 15/97 [00:03<00:18,  4.47it/s, loss=3.62, v_num=0]
Epoch 23:  16%|█▋        | 16/97 [00:03<00:17,  4.65it/s, loss=3.62, v_num=0]
Epoch 23:  16%|█▋        | 16/97 [00:03<00:17,  4.58it/s, loss=3.61, v_num=0]
Epoch 23:  18%|█▊        | 17/97 [00:03<00:16,  4.76it/s, loss=3.61, v_num=0]
Epoch 23:  18%|█▊        | 17/97 [00:03<00:17,  4.68it/s, loss=3.61, v_num=0]
Epoch 23:  19%|█▊        | 18/97 [00:03<00:16,  4.85it/s, loss=3.61, v_num=0]
Epoch 23:  19%|█▊        | 18/97 [00:03<00:16,  4.78it/s, loss=3.61, v_num=0]
Epoch 23:  20%|█▉        | 19/97 [00:03<00:15,  4.93it/s, loss=3.61, v_num=0]
Epoch 23:  20%|█▉        | 19/97 [00:03<00:16,  4.86it/s, loss=3.62, v_num=0]
Epoch 23:  21%|██        | 20/97 [00:04<00:15,  4.99it/s, loss=3.62, v_num=0]
Epoch 23:  21%|██        | 20/97 [00:04<00:15,  4.93it/s, loss=3.62, v_num=0]
Epoch 23:  22%|██▏       | 21/97 [00:04<00:14,  5.07it/s, loss=3.62, v_num=0]
Epoch 23:  22%|██▏       | 21/97 [00:04<00:15,  5.00it/s, loss=3.62, v_num=0]
Epoch 23:  23%|██▎       | 22/97 [00:04<00:14,  5.14it/s, loss=3.62, v_num=0]
Epoch 23:  23%|██▎       | 22/97 [00:04<00:14,  5.07it/s, loss=3.63, v_num=0]
Epoch 23:  24%|██▎       | 23/97 [00:04<00:14,  5.21it/s, loss=3.63, v_num=0]
Epoch 23:  24%|██▎       | 23/97 [00:04<00:14,  5.14it/s, loss=3.63, v_num=0]
Epoch 23:  25%|██▍       | 24/97 [00:04<00:13,  5.27it/s, loss=3.63, v_num=0]
Epoch 23:  25%|██▍       | 24/97 [00:04<00:14,  5.21it/s, loss=3.63, v_num=0]
Epoch 23:  26%|██▌       | 25/97 [00:04<00:13,  5.34it/s, loss=3.63, v_num=0]
Epoch 23:  26%|██▌       | 25/97 [00:04<00:13,  5.27it/s, loss=3.62, v_num=0]
Epoch 23:  27%|██▋       | 26/97 [00:04<00:13,  5.39it/s, loss=3.62, v_num=0]
Epoch 23:  27%|██▋       | 26/97 [00:04<00:13,  5.33it/s, loss=3.62, v_num=0]
Epoch 23:  28%|██▊       | 27/97 [00:04<00:12,  5.44it/s, loss=3.62, v_num=0]
Epoch 23:  28%|██▊       | 27/97 [00:05<00:13,  5.38it/s, loss=3.61, v_num=0]
Epoch 23:  29%|██▉       | 28/97 [00:05<00:12,  5.49it/s, loss=3.61, v_num=0]
Epoch 23:  29%|██▉       | 28/97 [00:05<00:12,  5.43it/s, loss=3.61, v_num=0]
Epoch 23:  30%|██▉       | 29/97 [00:05<00:12,  5.54it/s, loss=3.61, v_num=0]
Epoch 23:  30%|██▉       | 29/97 [00:05<00:12,  5.48it/s, loss=3.6, v_num=0]
Epoch 23:  31%|███       | 30/97 [00:05<00:12,  5.58it/s, loss=3.6, v_num=0]
Epoch 23:  31%|███       | 30/97 [00:05<00:12,  5.52it/s, loss=3.6, v_num=0]
Epoch 23:  32%|███▏      | 31/97 [00:05<00:11,  5.62it/s, loss=3.6, v_num=0]
Epoch 23:  32%|███▏      | 31/97 [00:05<00:11,  5.56it/s, loss=3.61, v_num=0]
Epoch 23:  33%|███▎      | 32/97 [00:05<00:11,  5.66it/s, loss=3.61, v_num=0]
Epoch 23:  33%|███▎      | 32/97 [00:05<00:11,  5.61it/s, loss=3.61, v_num=0]
Epoch 23:  34%|███▍      | 33/97 [00:05<00:11,  5.70it/s, loss=3.61, v_num=0]
Epoch 23:  34%|███▍      | 33/97 [00:05<00:11,  5.65it/s, loss=3.61, v_num=0]
Epoch 23:  35%|███▌      | 34/97 [00:05<00:10,  5.74it/s, loss=3.61, v_num=0]
Epoch 23:  35%|███▌      | 34/97 [00:05<00:11,  5.68it/s, loss=3.61, v_num=0]
Epoch 23:  36%|███▌      | 35/97 [00:06<00:10,  5.77it/s, loss=3.61, v_num=0]
Epoch 23:  36%|███▌      | 35/97 [00:06<00:10,  5.72it/s, loss=3.61, v_num=0]
Epoch 23:  37%|███▋      | 36/97 [00:06<00:10,  5.81it/s, loss=3.61, v_num=0]
Epoch 23:  37%|███▋      | 36/97 [00:06<00:10,  5.75it/s, loss=3.61, v_num=0]
Epoch 23:  38%|███▊      | 37/97 [00:06<00:10,  5.84it/s, loss=3.61, v_num=0]
Epoch 23:  38%|███▊      | 37/97 [00:06<00:10,  5.79it/s, loss=3.61, v_num=0]
Epoch 23:  39%|███▉      | 38/97 [00:06<00:10,  5.87it/s, loss=3.61, v_num=0]
Epoch 23:  39%|███▉      | 38/97 [00:06<00:10,  5.82it/s, loss=3.62, v_num=0]
Epoch 23:  40%|████      | 39/97 [00:06<00:09,  5.90it/s, loss=3.62, v_num=0]
Epoch 23:  40%|████      | 39/97 [00:06<00:09,  5.85it/s, loss=3.62, v_num=0]
Epoch 23:  41%|████      | 40/97 [00:06<00:09,  5.93it/s, loss=3.62, v_num=0]
Epoch 23:  41%|████      | 40/97 [00:06<00:09,  5.88it/s, loss=3.61, v_num=0]
Epoch 23:  42%|████▏     | 41/97 [00:06<00:09,  5.95it/s, loss=3.61, v_num=0]
Epoch 23:  42%|████▏     | 41/97 [00:06<00:09,  5.91it/s, loss=3.61, v_num=0]
Epoch 23:  43%|████▎     | 42/97 [00:07<00:09,  5.98it/s, loss=3.61, v_num=0]
Epoch 23:  43%|████▎     | 42/97 [00:07<00:09,  5.93it/s, loss=3.61, v_num=0]
Epoch 23:  44%|████▍     | 43/97 [00:07<00:09,  6.00it/s, loss=3.61, v_num=0]
Epoch 23:  44%|████▍     | 43/97 [00:07<00:09,  5.95it/s, loss=3.61, v_num=0]
Epoch 23:  45%|████▌     | 44/97 [00:07<00:08,  6.02it/s, loss=3.61, v_num=0]
Epoch 23:  45%|████▌     | 44/97 [00:07<00:08,  5.98it/s, loss=3.62, v_num=0]
Epoch 23:  46%|████▋     | 45/97 [00:07<00:08,  6.04it/s, loss=3.62, v_num=0]
Epoch 23:  46%|████▋     | 45/97 [00:07<00:08,  6.00it/s, loss=3.62, v_num=0]
Epoch 23:  47%|████▋     | 46/97 [00:07<00:08,  6.06it/s, loss=3.62, v_num=0]
Epoch 23:  47%|████▋     | 46/97 [00:07<00:08,  6.02it/s, loss=3.62, v_num=0]
Epoch 23:  48%|████▊     | 47/97 [00:07<00:08,  6.08it/s, loss=3.62, v_num=0]
Epoch 23:  48%|████▊     | 47/97 [00:07<00:08,  6.04it/s, loss=3.62, v_num=0]
Epoch 23:  49%|████▉     | 48/97 [00:07<00:08,  6.10it/s, loss=3.62, v_num=0]
Epoch 23:  49%|████▉     | 48/97 [00:07<00:08,  6.06it/s, loss=3.63, v_num=0]
Epoch 23:  51%|█████     | 49/97 [00:08<00:07,  6.12it/s, loss=3.63, v_num=0]
Epoch 23:  51%|█████     | 49/97 [00:08<00:07,  6.08it/s, loss=3.63, v_num=0]
Epoch 23:  52%|█████▏    | 50/97 [00:08<00:07,  6.14it/s, loss=3.63, v_num=0]
Epoch 23:  52%|█████▏    | 50/97 [00:08<00:07,  6.10it/s, loss=3.64, v_num=0]
Epoch 23:  53%|█████▎    | 51/97 [00:08<00:07,  6.16it/s, loss=3.64, v_num=0]
Epoch 23:  53%|█████▎    | 51/97 [00:08<00:07,  6.12it/s, loss=3.63, v_num=0]
Epoch 23:  54%|█████▎    | 52/97 [00:08<00:07,  6.18it/s, loss=3.63, v_num=0]
Epoch 23:  54%|█████▎    | 52/97 [00:08<00:07,  6.14it/s, loss=3.62, v_num=0]
Epoch 23:  55%|█████▍    | 53/97 [00:08<00:07,  6.20it/s, loss=3.62, v_num=0]
Epoch 23:  55%|█████▍    | 53/97 [00:08<00:07,  6.16it/s, loss=3.62, v_num=0]
Epoch 23:  56%|█████▌    | 54/97 [00:08<00:06,  6.22it/s, loss=3.62, v_num=0]
Epoch 23:  56%|█████▌    | 54/97 [00:08<00:06,  6.18it/s, loss=3.62, v_num=0]
Epoch 23:  57%|█████▋    | 55/97 [00:08<00:06,  6.23it/s, loss=3.62, v_num=0]
Epoch 23:  57%|█████▋    | 55/97 [00:08<00:06,  6.19it/s, loss=3.63, v_num=0]
Epoch 23:  58%|█████▊    | 56/97 [00:08<00:06,  6.25it/s, loss=3.63, v_num=0]
Epoch 23:  58%|█████▊    | 56/97 [00:09<00:06,  6.21it/s, loss=3.62, v_num=0]
Epoch 23:  59%|█████▉    | 57/97 [00:09<00:06,  6.26it/s, loss=3.62, v_num=0]
Epoch 23:  59%|█████▉    | 57/97 [00:09<00:06,  6.22it/s, loss=3.62, v_num=0]
Epoch 23:  60%|█████▉    | 58/97 [00:09<00:06,  6.28it/s, loss=3.62, v_num=0]
Epoch 23:  60%|█████▉    | 58/97 [00:09<00:06,  6.24it/s, loss=3.62, v_num=0]
Epoch 23:  61%|██████    | 59/97 [00:09<00:06,  6.30it/s, loss=3.62, v_num=0]
Epoch 23:  61%|██████    | 59/97 [00:09<00:06,  6.26it/s, loss=3.62, v_num=0]
Epoch 23:  62%|██████▏   | 60/97 [00:09<00:05,  6.31it/s, loss=3.62, v_num=0]
Epoch 23:  62%|██████▏   | 60/97 [00:09<00:05,  6.27it/s, loss=3.63, v_num=0]
Epoch 23:  63%|██████▎   | 61/97 [00:09<00:05,  6.32it/s, loss=3.63, v_num=0]
Epoch 23:  63%|██████▎   | 61/97 [00:09<00:05,  6.28it/s, loss=3.63, v_num=0]
Epoch 23:  64%|██████▍   | 62/97 [00:09<00:05,  6.34it/s, loss=3.63, v_num=0]
Epoch 23:  64%|██████▍   | 62/97 [00:09<00:05,  6.30it/s, loss=3.62, v_num=0]
Epoch 23:  65%|██████▍   | 63/97 [00:09<00:05,  6.35it/s, loss=3.62, v_num=0]
Epoch 23:  65%|██████▍   | 63/97 [00:09<00:05,  6.31it/s, loss=3.62, v_num=0]
Epoch 23:  66%|██████▌   | 64/97 [00:10<00:05,  6.36it/s, loss=3.62, v_num=0]
Epoch 23:  66%|██████▌   | 64/97 [00:10<00:05,  6.33it/s, loss=3.61, v_num=0]
Epoch 23:  67%|██████▋   | 65/97 [00:10<00:05,  6.37it/s, loss=3.61, v_num=0]
Epoch 23:  67%|██████▋   | 65/97 [00:10<00:05,  6.34it/s, loss=3.61, v_num=0]
Epoch 23:  68%|██████▊   | 66/97 [00:10<00:04,  6.39it/s, loss=3.61, v_num=0]
Epoch 23:  68%|██████▊   | 66/97 [00:10<00:04,  6.35it/s, loss=3.6, v_num=0]
Epoch 23:  69%|██████▉   | 67/97 [00:10<00:04,  6.40it/s, loss=3.6, v_num=0]
Epoch 23:  69%|██████▉   | 67/97 [00:10<00:04,  6.36it/s, loss=3.61, v_num=0]
Epoch 23:  70%|███████   | 68/97 [00:10<00:04,  6.41it/s, loss=3.61, v_num=0]
Epoch 23:  70%|███████   | 68/97 [00:10<00:04,  6.37it/s, loss=3.6, v_num=0]
Epoch 23:  71%|███████   | 69/97 [00:10<00:04,  6.42it/s, loss=3.6, v_num=0]
Epoch 23:  71%|███████   | 69/97 [00:10<00:04,  6.38it/s, loss=3.6, v_num=0]
Epoch 23:  72%|███████▏  | 70/97 [00:10<00:04,  6.43it/s, loss=3.6, v_num=0]
Epoch 23:  72%|███████▏  | 70/97 [00:10<00:04,  6.39it/s, loss=3.59, v_num=0]
Epoch 23:  73%|███████▎  | 71/97 [00:11<00:04,  6.44it/s, loss=3.59, v_num=0]
Epoch 23:  73%|███████▎  | 71/97 [00:11<00:04,  6.40it/s, loss=3.59, v_num=0]
Epoch 23:  74%|███████▍  | 72/97 [00:11<00:03,  6.45it/s, loss=3.59, v_num=0]
Epoch 23:  74%|███████▍  | 72/97 [00:11<00:03,  6.42it/s, loss=3.59, v_num=0]
Epoch 23:  75%|███████▌  | 73/97 [00:11<00:03,  6.46it/s, loss=3.59, v_num=0]
Epoch 23:  75%|███████▌  | 73/97 [00:11<00:03,  6.42it/s, loss=3.57, v_num=0]
Epoch 23:  76%|███████▋  | 74/97 [00:11<00:03,  6.47it/s, loss=3.57, v_num=0]
Epoch 23:  76%|███████▋  | 74/97 [00:11<00:03,  6.43it/s, loss=3.57, v_num=0]
Epoch 23:  77%|███████▋  | 75/97 [00:11<00:03,  6.48it/s, loss=3.57, v_num=0]
Epoch 23:  77%|███████▋  | 75/97 [00:11<00:03,  6.44it/s, loss=3.57, v_num=0]
Epoch 23:  78%|███████▊  | 76/97 [00:11<00:03,  6.48it/s, loss=3.57, v_num=0]
Epoch 23:  78%|███████▊  | 76/97 [00:11<00:03,  6.45it/s, loss=3.58, v_num=0]
Epoch 23:  79%|███████▉  | 77/97 [00:11<00:03,  6.50it/s, loss=3.58, v_num=0]
Epoch 23:  79%|███████▉  | 77/97 [00:11<00:03,  6.46it/s, loss=3.58, v_num=0]
Epoch 23:  80%|████████  | 78/97 [00:11<00:02,  6.50it/s, loss=3.58, v_num=0]
Epoch 23:  80%|████████  | 78/97 [00:12<00:02,  6.47it/s, loss=3.57, v_num=0]
Epoch 23:  81%|████████▏ | 79/97 [00:12<00:02,  6.51it/s, loss=3.57, v_num=0]
Epoch 23:  81%|████████▏ | 79/97 [00:12<00:02,  6.48it/s, loss=3.57, v_num=0]
Epoch 23:  82%|████████▏ | 80/97 [00:12<00:02,  6.52it/s, loss=3.57, v_num=0]
Epoch 23:  82%|████████▏ | 80/97 [00:12<00:02,  6.49it/s, loss=3.57, v_num=0]
Epoch 23:  84%|████████▎ | 81/97 [00:12<00:02,  6.53it/s, loss=3.57, v_num=0]
Epoch 23:  84%|████████▎ | 81/97 [00:12<00:02,  6.50it/s, loss=3.57, v_num=0]
Epoch 23:  85%|████████▍ | 82/97 [00:12<00:02,  6.54it/s, loss=3.57, v_num=0]
Epoch 23:  85%|████████▍ | 82/97 [00:12<00:02,  6.51it/s, loss=3.57, v_num=0]
Epoch 23:  86%|████████▌ | 83/97 [00:12<00:02,  6.54it/s, loss=3.57, v_num=0]
Epoch 23:  86%|████████▌ | 83/97 [00:12<00:02,  6.51it/s, loss=3.57, v_num=0]
Epoch 23:  87%|████████▋ | 84/97 [00:12<00:01,  6.55it/s, loss=3.57, v_num=0]
Epoch 23:  87%|████████▋ | 84/97 [00:12<00:01,  6.52it/s, loss=3.57, v_num=0]
Epoch 23:  88%|████████▊ | 85/97 [00:12<00:01,  6.56it/s, loss=3.57, v_num=0]
Epoch 23:  88%|████████▊ | 85/97 [00:13<00:01,  6.53it/s, loss=3.57, v_num=0]
Epoch 23:  89%|████████▊ | 86/97 [00:13<00:01,  6.57it/s, loss=3.57, v_num=0]
Epoch 23:  89%|████████▊ | 86/97 [00:13<00:01,  6.54it/s, loss=3.58, v_num=0]
Epoch 23:  90%|████████▉ | 87/97 [00:13<00:01,  6.58it/s, loss=3.58, v_num=0]
Epoch 23:  90%|████████▉ | 87/97 [00:13<00:01,  6.55it/s, loss=3.57, v_num=0]
Epoch 23:  91%|█████████ | 88/97 [00:13<00:01,  6.58it/s, loss=3.57, v_num=0]
Epoch 23:  91%|█████████ | 88/97 [00:13<00:01,  6.55it/s, loss=3.57, v_num=0]
Epoch 23:  92%|█████████▏| 89/97 [00:13<00:01,  6.59it/s, loss=3.57, v_num=0]
Epoch 23:  92%|█████████▏| 89/97 [00:13<00:01,  6.56it/s, loss=3.56, v_num=0]
Epoch 23:  93%|█████████▎| 90/97 [00:13<00:01,  6.60it/s, loss=3.56, v_num=0]
Epoch 23:  93%|█████████▎| 90/97 [00:13<00:01,  6.57it/s, loss=3.56, v_num=0]
Epoch 23:  94%|█████████▍| 91/97 [00:13<00:00,  6.60it/s, loss=3.56, v_num=0]
Epoch 23:  94%|█████████▍| 91/97 [00:13<00:00,  6.58it/s, loss=3.56, v_num=0]
Epoch 23:  95%|█████████▍| 92/97 [00:13<00:00,  6.61it/s, loss=3.56, v_num=0]
Epoch 23:  95%|█████████▍| 92/97 [00:13<00:00,  6.58it/s, loss=3.56, v_num=0]
Epoch 23:  96%|█████████▌| 93/97 [00:14<00:00,  6.62it/s, loss=3.56, v_num=0]
Epoch 23:  96%|█████████▌| 93/97 [00:14<00:00,  6.59it/s, loss=3.57, v_num=0]
Epoch 23:  97%|█████████▋| 94/97 [00:14<00:00,  6.62it/s, loss=3.57, v_num=0]
Epoch 23:  97%|█████████▋| 94/97 [00:14<00:00,  6.60it/s, loss=3.56, v_num=0]
Epoch 23:  98%|█████████▊| 95/97 [00:14<00:00,  6.63it/s, loss=3.56, v_num=0]
Epoch 23:  98%|█████████▊| 95/97 [00:14<00:00,  6.61it/s, loss=3.56, v_num=0]
Epoch 23:  99%|█████████▉| 96/97 [00:14<00:00,  6.64it/s, loss=3.56, v_num=0]
Epoch 23:  99%|█████████▉| 96/97 [00:14<00:00,  6.61it/s, loss=3.55, v_num=0]
Epoch 23: 100%|██████████| 97/97 [00:14<00:00,  6.65it/s, loss=3.55, v_num=0]
Epoch 23: 100%|██████████| 97/97 [00:14<00:00,  6.62it/s, loss=3.55, v_num=0]
Epoch 23: 100%|██████████| 97/97 [00:14<00:00,  6.62it/s, loss=3.55, v_num=0]
Epoch 23:   0%|          | 0/97 [00:00<?, ?it/s, loss=3.55, v_num=0]
Epoch 24:   0%|          | 0/97 [00:00<?, ?it/s, loss=3.55, v_num=0]
Epoch 24:   1%|          | 1/97 [00:01<02:13,  1.39s/it, loss=3.55, v_num=0]
Epoch 24:   1%|          | 1/97 [00:01<02:18,  1.45s/it, loss=3.55, v_num=0]
Epoch 24:   2%|▏         | 2/97 [00:01<01:12,  1.30it/s, loss=3.55, v_num=0]
Epoch 24:   2%|▏         | 2/97 [00:01<01:15,  1.26it/s, loss=3.54, v_num=0]
Epoch 24:   3%|▎         | 3/97 [00:01<00:52,  1.80it/s, loss=3.54, v_num=0]
Epoch 24:   3%|▎         | 3/97 [00:01<00:54,  1.74it/s, loss=3.54, v_num=0]
Epoch 24:   4%|▍         | 4/97 [00:01<00:42,  2.21it/s, loss=3.54, v_num=0]
Epoch 24:   4%|▍         | 4/97 [00:01<00:43,  2.15it/s, loss=3.55, v_num=0]
Epoch 24:   5%|▌         | 5/97 [00:01<00:35,  2.57it/s, loss=3.55, v_num=0]
Epoch 24:   5%|▌         | 5/97 [00:01<00:36,  2.50it/s, loss=3.54, v_num=0]
Epoch 24:   6%|▌         | 6/97 [00:02<00:31,  2.89it/s, loss=3.54, v_num=0]
Epoch 24:   6%|▌         | 6/97 [00:02<00:32,  2.81it/s, loss=3.54, v_num=0]
Epoch 24:   7%|▋         | 7/97 [00:02<00:28,  3.16it/s, loss=3.54, v_num=0]
Epoch 24:   7%|▋         | 7/97 [00:02<00:29,  3.08it/s, loss=3.54, v_num=0]
Epoch 24:   8%|▊         | 8/97 [00:02<00:26,  3.41it/s, loss=3.54, v_num=0]
Epoch 24:   8%|▊         | 8/97 [00:02<00:26,  3.32it/s, loss=3.54, v_num=0]
Epoch 24:   9%|▉         | 9/97 [00:02<00:24,  3.60it/s, loss=3.54, v_num=0]
Epoch 24:   9%|▉         | 9/97 [00:02<00:24,  3.53it/s, loss=3.54, v_num=0]
Epoch 24:  10%|█         | 10/97 [00:02<00:22,  3.80it/s, loss=3.54, v_num=0]
Epoch 24:  10%|█         | 10/97 [00:02<00:23,  3.72it/s, loss=3.54, v_num=0]
Epoch 24:  11%|█▏        | 11/97 [00:02<00:21,  3.97it/s, loss=3.54, v_num=0]
Epoch 24:  11%|█▏        | 11/97 [00:02<00:22,  3.90it/s, loss=3.54, v_num=0]
Epoch 24:  12%|█▏        | 12/97 [00:02<00:20,  4.13it/s, loss=3.54, v_num=0]
Epoch 24:  12%|█▏        | 12/97 [00:02<00:20,  4.05it/s, loss=3.55, v_num=0]
Epoch 24:  13%|█▎        | 13/97 [00:03<00:19,  4.27it/s, loss=3.55, v_num=0]
Epoch 24:  13%|█▎        | 13/97 [00:03<00:20,  4.20it/s, loss=3.55, v_num=0]
Epoch 24:  14%|█▍        | 14/97 [00:03<00:18,  4.41it/s, loss=3.55, v_num=0]
Epoch 24:  14%|█▍        | 14/97 [00:03<00:19,  4.33it/s, loss=3.56, v_num=0]
Epoch 24:  15%|█▌        | 15/97 [00:03<00:18,  4.53it/s, loss=3.56, v_num=0]
Epoch 24:  15%|█▌        | 15/97 [00:03<00:18,  4.45it/s, loss=3.56, v_num=0]
Epoch 24:  16%|█▋        | 16/97 [00:03<00:17,  4.65it/s, loss=3.56, v_num=0]
Epoch 24:  16%|█▋        | 16/97 [00:03<00:17,  4.57it/s, loss=3.57, v_num=0]
Epoch 24:  18%|█▊        | 17/97 [00:03<00:16,  4.74it/s, loss=3.57, v_num=0]
Epoch 24:  18%|█▊        | 17/97 [00:03<00:17,  4.67it/s, loss=3.56, v_num=0]
Epoch 24:  19%|█▊        | 18/97 [00:03<00:16,  4.84it/s, loss=3.56, v_num=0]
Epoch 24:  19%|█▊        | 18/97 [00:03<00:16,  4.76it/s, loss=3.57, v_num=0]
Epoch 24:  20%|█▉        | 19/97 [00:03<00:15,  4.92it/s, loss=3.57, v_num=0]
Epoch 24:  20%|█▉        | 19/97 [00:03<00:16,  4.85it/s, loss=3.56, v_num=0]
Epoch 24:  21%|██        | 20/97 [00:03<00:15,  5.01it/s, loss=3.56, v_num=0]
Epoch 24:  21%|██        | 20/97 [00:04<00:15,  4.94it/s, loss=3.57, v_num=0]
Epoch 24:  22%|██▏       | 21/97 [00:04<00:14,  5.08it/s, loss=3.57, v_num=0]
Epoch 24:  22%|██▏       | 21/97 [00:04<00:15,  5.02it/s, loss=3.56, v_num=0]
Epoch 24:  23%|██▎       | 22/97 [00:04<00:14,  5.16it/s, loss=3.56, v_num=0]
Epoch 24:  23%|██▎       | 22/97 [00:04<00:14,  5.09it/s, loss=3.57, v_num=0]
Epoch 24:  24%|██▎       | 23/97 [00:04<00:14,  5.23it/s, loss=3.57, v_num=0]
Epoch 24:  24%|██▎       | 23/97 [00:04<00:14,  5.16it/s, loss=3.56, v_num=0]
Epoch 24:  25%|██▍       | 24/97 [00:04<00:13,  5.28it/s, loss=3.56, v_num=0]
Epoch 24:  25%|██▍       | 24/97 [00:04<00:13,  5.22it/s, loss=3.56, v_num=0]
Epoch 24:  26%|██▌       | 25/97 [00:04<00:13,  5.34it/s, loss=3.56, v_num=0]
Epoch 24:  26%|██▌       | 25/97 [00:04<00:13,  5.28it/s, loss=3.56, v_num=0]
Epoch 24:  27%|██▋       | 26/97 [00:04<00:13,  5.40it/s, loss=3.56, v_num=0]
Epoch 24:  27%|██▋       | 26/97 [00:04<00:13,  5.33it/s, loss=3.55, v_num=0]
Epoch 24:  28%|██▊       | 27/97 [00:04<00:12,  5.45it/s, loss=3.55, v_num=0]
Epoch 24:  28%|██▊       | 27/97 [00:05<00:12,  5.39it/s, loss=3.55, v_num=0]
Epoch 24:  29%|██▉       | 28/97 [00:05<00:12,  5.50it/s, loss=3.55, v_num=0]
Epoch 24:  29%|██▉       | 28/97 [00:05<00:12,  5.44it/s, loss=3.55, v_num=0]
Epoch 24:  30%|██▉       | 29/97 [00:05<00:12,  5.55it/s, loss=3.55, v_num=0]
Epoch 24:  30%|██▉       | 29/97 [00:05<00:12,  5.49it/s, loss=3.55, v_num=0]
Epoch 24:  31%|███       | 30/97 [00:05<00:11,  5.60it/s, loss=3.55, v_num=0]
Epoch 24:  31%|███       | 30/97 [00:05<00:12,  5.53it/s, loss=3.53, v_num=0]
Epoch 24:  32%|███▏      | 31/97 [00:05<00:11,  5.64it/s, loss=3.53, v_num=0]
Epoch 24:  32%|███▏      | 31/97 [00:05<00:11,  5.58it/s, loss=3.53, v_num=0]
Epoch 24:  33%|███▎      | 32/97 [00:05<00:11,  5.68it/s, loss=3.53, v_num=0]
Epoch 24:  33%|███▎      | 32/97 [00:05<00:11,  5.62it/s, loss=3.52, v_num=0]
Epoch 24:  34%|███▍      | 33/97 [00:05<00:11,  5.71it/s, loss=3.52, v_num=0]
Epoch 24:  34%|███▍      | 33/97 [00:05<00:11,  5.66it/s, loss=3.53, v_num=0]
Epoch 24:  35%|███▌      | 34/97 [00:05<00:10,  5.75it/s, loss=3.53, v_num=0]
Epoch 24:  35%|███▌      | 34/97 [00:05<00:11,  5.70it/s, loss=3.52, v_num=0]
Epoch 24:  36%|███▌      | 35/97 [00:06<00:10,  5.79it/s, loss=3.52, v_num=0]
Epoch 24:  36%|███▌      | 35/97 [00:06<00:10,  5.73it/s, loss=3.51, v_num=0]
Epoch 24:  37%|███▋      | 36/97 [00:06<00:10,  5.82it/s, loss=3.51, v_num=0]
Epoch 24:  37%|███▋      | 36/97 [00:06<00:10,  5.77it/s, loss=3.5, v_num=0]
Epoch 24:  38%|███▊      | 37/97 [00:06<00:10,  5.85it/s, loss=3.5, v_num=0]
Epoch 24:  38%|███▊      | 37/97 [00:06<00:10,  5.80it/s, loss=3.51, v_num=0]
Epoch 24:  39%|███▉      | 38/97 [00:06<00:10,  5.89it/s, loss=3.51, v_num=0]
Epoch 24:  39%|███▉      | 38/97 [00:06<00:10,  5.83it/s, loss=3.51, v_num=0]
Epoch 24:  40%|████      | 39/97 [00:06<00:09,  5.91it/s, loss=3.51, v_num=0]
Epoch 24:  40%|████      | 39/97 [00:06<00:09,  5.86it/s, loss=3.51, v_num=0]
Epoch 24:  41%|████      | 40/97 [00:06<00:09,  5.94it/s, loss=3.51, v_num=0]
Epoch 24:  41%|████      | 40/97 [00:06<00:09,  5.89it/s, loss=3.5, v_num=0]
Epoch 24:  42%|████▏     | 41/97 [00:06<00:09,  5.97it/s, loss=3.5, v_num=0]
Epoch 24:  42%|████▏     | 41/97 [00:06<00:09,  5.92it/s, loss=3.49, v_num=0]
Epoch 24:  43%|████▎     | 42/97 [00:07<00:09,  6.00it/s, loss=3.49, v_num=0]
Epoch 24:  43%|████▎     | 42/97 [00:07<00:09,  5.95it/s, loss=3.5, v_num=0]
Epoch 24:  44%|████▍     | 43/97 [00:07<00:08,  6.02it/s, loss=3.5, v_num=0]
Epoch 24:  44%|████▍     | 43/97 [00:07<00:09,  5.97it/s, loss=3.5, v_num=0]
Epoch 24:  45%|████▌     | 44/97 [00:07<00:08,  6.04it/s, loss=3.5, v_num=0]
Epoch 24:  45%|████▌     | 44/97 [00:07<00:08,  6.00it/s, loss=3.5, v_num=0]
Epoch 24:  46%|████▋     | 45/97 [00:07<00:08,  6.06it/s, loss=3.5, v_num=0]
Epoch 24:  46%|████▋     | 45/97 [00:07<00:08,  6.02it/s, loss=3.5, v_num=0]
Epoch 24:  47%|████▋     | 46/97 [00:07<00:08,  6.09it/s, loss=3.5, v_num=0]
Epoch 24:  47%|████▋     | 46/97 [00:07<00:08,  6.04it/s, loss=3.52, v_num=0]
Epoch 24:  48%|████▊     | 47/97 [00:07<00:08,  6.11it/s, loss=3.52, v_num=0]
Epoch 24:  48%|████▊     | 47/97 [00:07<00:08,  6.06it/s, loss=3.52, v_num=0]
Epoch 24:  49%|████▉     | 48/97 [00:07<00:07,  6.13it/s, loss=3.52, v_num=0]
Epoch 24:  49%|████▉     | 48/97 [00:07<00:08,  6.09it/s, loss=3.51, v_num=0]
Epoch 24:  51%|█████     | 49/97 [00:07<00:07,  6.15it/s, loss=3.51, v_num=0]
Epoch 24:  51%|█████     | 49/97 [00:08<00:07,  6.10it/s, loss=3.52, v_num=0]
Epoch 24:  52%|█████▏    | 50/97 [00:08<00:07,  6.16it/s, loss=3.52, v_num=0]
Epoch 24:  52%|█████▏    | 50/97 [00:08<00:07,  6.12it/s, loss=3.52, v_num=0]
Epoch 24:  53%|█████▎    | 51/97 [00:08<00:07,  6.18it/s, loss=3.52, v_num=0]
Epoch 24:  53%|█████▎    | 51/97 [00:08<00:07,  6.14it/s, loss=3.52, v_num=0]
Epoch 24:  54%|█████▎    | 52/97 [00:08<00:07,  6.20it/s, loss=3.52, v_num=0]
Epoch 24:  54%|█████▎    | 52/97 [00:08<00:07,  6.16it/s, loss=3.52, v_num=0]
Epoch 24:  55%|█████▍    | 53/97 [00:08<00:07,  6.22it/s, loss=3.52, v_num=0]
Epoch 24:  55%|█████▍    | 53/97 [00:08<00:07,  6.18it/s, loss=3.51, v_num=0]
Epoch 24:  56%|█████▌    | 54/97 [00:08<00:06,  6.24it/s, loss=3.51, v_num=0]
Epoch 24:  56%|█████▌    | 54/97 [00:08<00:06,  6.19it/s, loss=3.51, v_num=0]
Epoch 24:  57%|█████▋    | 55/97 [00:08<00:06,  6.25it/s, loss=3.51, v_num=0]
Epoch 24:  57%|█████▋    | 55/97 [00:08<00:06,  6.21it/s, loss=3.51, v_num=0]
Epoch 24:  58%|█████▊    | 56/97 [00:08<00:06,  6.27it/s, loss=3.51, v_num=0]
Epoch 24:  58%|█████▊    | 56/97 [00:08<00:06,  6.23it/s, loss=3.51, v_num=0]
Epoch 24:  59%|█████▉    | 57/97 [00:09<00:06,  6.28it/s, loss=3.51, v_num=0]
Epoch 24:  59%|█████▉    | 57/97 [00:09<00:06,  6.24it/s, loss=3.51, v_num=0]
Epoch 24:  60%|█████▉    | 58/97 [00:09<00:06,  6.29it/s, loss=3.51, v_num=0]
Epoch 24:  60%|█████▉    | 58/97 [00:09<00:06,  6.26it/s, loss=3.51, v_num=0]
Epoch 24:  61%|██████    | 59/97 [00:09<00:06,  6.31it/s, loss=3.51, v_num=0]
Epoch 24:  61%|██████    | 59/97 [00:09<00:06,  6.27it/s, loss=3.51, v_num=0]
Epoch 24:  62%|██████▏   | 60/97 [00:09<00:05,  6.32it/s, loss=3.51, v_num=0]
Epoch 24:  62%|██████▏   | 60/97 [00:09<00:05,  6.29it/s, loss=3.51, v_num=0]
Epoch 24:  63%|██████▎   | 61/97 [00:09<00:05,  6.34it/s, loss=3.51, v_num=0]
Epoch 24:  63%|██████▎   | 61/97 [00:09<00:05,  6.30it/s, loss=3.52, v_num=0]
Epoch 24:  64%|██████▍   | 62/97 [00:09<00:05,  6.35it/s, loss=3.52, v_num=0]
Epoch 24:  64%|██████▍   | 62/97 [00:09<00:05,  6.31it/s, loss=3.51, v_num=0]
Epoch 24:  65%|██████▍   | 63/97 [00:09<00:05,  6.36it/s, loss=3.51, v_num=0]
Epoch 24:  65%|██████▍   | 63/97 [00:09<00:05,  6.33it/s, loss=3.5, v_num=0]
Epoch 24:  66%|██████▌   | 64/97 [00:10<00:05,  6.38it/s, loss=3.5, v_num=0]
Epoch 24:  66%|██████▌   | 64/97 [00:10<00:05,  6.34it/s, loss=3.5, v_num=0]
Epoch 24:  67%|██████▋   | 65/97 [00:10<00:05,  6.39it/s, loss=3.5, v_num=0]
Epoch 24:  67%|██████▋   | 65/97 [00:10<00:05,  6.35it/s, loss=3.49, v_num=0]
Epoch 24:  68%|██████▊   | 66/97 [00:10<00:04,  6.40it/s, loss=3.49, v_num=0]
Epoch 24:  68%|██████▊   | 66/97 [00:10<00:04,  6.37it/s, loss=3.48, v_num=0]
Epoch 24:  69%|██████▉   | 67/97 [00:10<00:04,  6.41it/s, loss=3.48, v_num=0]
Epoch 24:  69%|██████▉   | 67/97 [00:10<00:04,  6.38it/s, loss=3.48, v_num=0]
Epoch 24:  70%|███████   | 68/97 [00:10<00:04,  6.42it/s, loss=3.48, v_num=0]
Epoch 24:  70%|███████   | 68/97 [00:10<00:04,  6.39it/s, loss=3.49, v_num=0]
Epoch 24:  71%|███████   | 69/97 [00:10<00:04,  6.44it/s, loss=3.49, v_num=0]
Epoch 24:  71%|███████   | 69/97 [00:10<00:04,  6.40it/s, loss=3.49, v_num=0]
Epoch 24:  72%|███████▏  | 70/97 [00:10<00:04,  6.45it/s, loss=3.49, v_num=0]
Epoch 24:  72%|███████▏  | 70/97 [00:10<00:04,  6.41it/s, loss=3.49, v_num=0]
Epoch 24:  73%|███████▎  | 71/97 [00:10<00:04,  6.46it/s, loss=3.49, v_num=0]
Epoch 24:  73%|███████▎  | 71/97 [00:11<00:04,  6.43it/s, loss=3.49, v_num=0]
Epoch 24:  74%|███████▍  | 72/97 [00:11<00:03,  6.47it/s, loss=3.49, v_num=0]
Epoch 24:  74%|███████▍  | 72/97 [00:11<00:03,  6.44it/s, loss=3.5, v_num=0]
Epoch 24:  75%|███████▌  | 73/97 [00:11<00:03,  6.48it/s, loss=3.5, v_num=0]
Epoch 24:  75%|███████▌  | 73/97 [00:11<00:03,  6.45it/s, loss=3.5, v_num=0]
Epoch 24:  76%|███████▋  | 74/97 [00:11<00:03,  6.49it/s, loss=3.5, v_num=0]
Epoch 24:  76%|███████▋  | 74/97 [00:11<00:03,  6.46it/s, loss=3.5, v_num=0]
Epoch 24:  77%|███████▋  | 75/97 [00:11<00:03,  6.50it/s, loss=3.5, v_num=0]
Epoch 24:  77%|███████▋  | 75/97 [00:11<00:03,  6.47it/s, loss=3.5, v_num=0]
Epoch 24:  78%|███████▊  | 76/97 [00:11<00:03,  6.51it/s, loss=3.5, v_num=0]
Epoch 24:  78%|███████▊  | 76/97 [00:11<00:03,  6.48it/s, loss=3.5, v_num=0]
Epoch 24:  79%|███████▉  | 77/97 [00:11<00:03,  6.52it/s, loss=3.5, v_num=0]
Epoch 24:  79%|███████▉  | 77/97 [00:11<00:03,  6.49it/s, loss=3.49, v_num=0]
Epoch 24:  80%|████████  | 78/97 [00:11<00:02,  6.52it/s, loss=3.49, v_num=0]
Epoch 24:  80%|████████  | 78/97 [00:12<00:02,  6.49it/s, loss=3.48, v_num=0]
Epoch 24:  81%|████████▏ | 79/97 [00:12<00:02,  6.53it/s, loss=3.48, v_num=0]
Epoch 24:  81%|████████▏ | 79/97 [00:12<00:02,  6.50it/s, loss=3.48, v_num=0]
Epoch 24:  82%|████████▏ | 80/97 [00:12<00:02,  6.54it/s, loss=3.48, v_num=0]
Epoch 24:  82%|████████▏ | 80/97 [00:12<00:02,  6.51it/s, loss=3.48, v_num=0]
Epoch 24:  84%|████████▎ | 81/97 [00:12<00:02,  6.55it/s, loss=3.48, v_num=0]
Epoch 24:  84%|████████▎ | 81/97 [00:12<00:02,  6.52it/s, loss=3.49, v_num=0]
Epoch 24:  85%|████████▍ | 82/97 [00:12<00:02,  6.55it/s, loss=3.49, v_num=0]
Epoch 24:  85%|████████▍ | 82/97 [00:12<00:02,  6.53it/s, loss=3.49, v_num=0]
Epoch 24:  86%|████████▌ | 83/97 [00:12<00:02,  6.56it/s, loss=3.49, v_num=0]
Epoch 24:  86%|████████▌ | 83/97 [00:12<00:02,  6.53it/s, loss=3.48, v_num=0]
Epoch 24:  87%|████████▋ | 84/97 [00:12<00:01,  6.57it/s, loss=3.48, v_num=0]
Epoch 24:  87%|████████▋ | 84/97 [00:12<00:01,  6.54it/s, loss=3.49, v_num=0]
Epoch 24:  88%|████████▊ | 85/97 [00:12<00:01,  6.58it/s, loss=3.49, v_num=0]
Epoch 24:  88%|████████▊ | 85/97 [00:12<00:01,  6.55it/s, loss=3.49, v_num=0]
Epoch 24:  89%|████████▊ | 86/97 [00:13<00:01,  6.59it/s, loss=3.49, v_num=0]
Epoch 24:  89%|████████▊ | 86/97 [00:13<00:01,  6.56it/s, loss=3.49, v_num=0]
Epoch 24:  90%|████████▉ | 87/97 [00:13<00:01,  6.59it/s, loss=3.49, v_num=0]
Epoch 24:  90%|████████▉ | 87/97 [00:13<00:01,  6.57it/s, loss=3.48, v_num=0]
Epoch 24:  91%|█████████ | 88/97 [00:13<00:01,  6.60it/s, loss=3.48, v_num=0]
Epoch 24:  91%|█████████ | 88/97 [00:13<00:01,  6.57it/s, loss=3.48, v_num=0]
Epoch 24:  92%|█████████▏| 89/97 [00:13<00:01,  6.61it/s, loss=3.48, v_num=0]
Epoch 24:  92%|█████████▏| 89/97 [00:13<00:01,  6.58it/s, loss=3.48, v_num=0]
Epoch 24:  93%|█████████▎| 90/97 [00:13<00:01,  6.62it/s, loss=3.48, v_num=0]
Epoch 24:  93%|█████████▎| 90/97 [00:13<00:01,  6.59it/s, loss=3.48, v_num=0]
Epoch 24:  94%|█████████▍| 91/97 [00:13<00:00,  6.62it/s, loss=3.48, v_num=0]
Epoch 24:  94%|█████████▍| 91/97 [00:13<00:00,  6.60it/s, loss=3.48, v_num=0]
Epoch 24:  95%|█████████▍| 92/97 [00:13<00:00,  6.63it/s, loss=3.48, v_num=0]
Epoch 24:  95%|█████████▍| 92/97 [00:13<00:00,  6.60it/s, loss=3.48, v_num=0]
Epoch 24:  96%|█████████▌| 93/97 [00:14<00:00,  6.64it/s, loss=3.48, v_num=0]
Epoch 24:  96%|█████████▌| 93/97 [00:14<00:00,  6.61it/s, loss=3.47, v_num=0]
Epoch 24:  97%|█████████▋| 94/97 [00:14<00:00,  6.64it/s, loss=3.47, v_num=0]
Epoch 24:  97%|█████████▋| 94/97 [00:14<00:00,  6.62it/s, loss=3.47, v_num=0]
Epoch 24:  98%|█████████▊| 95/97 [00:14<00:00,  6.65it/s, loss=3.47, v_num=0]
Epoch 24:  98%|█████████▊| 95/97 [00:14<00:00,  6.62it/s, loss=3.47, v_num=0]
Epoch 24:  99%|█████████▉| 96/97 [00:14<00:00,  6.66it/s, loss=3.47, v_num=0]
Epoch 24:  99%|█████████▉| 96/97 [00:14<00:00,  6.63it/s, loss=3.48, v_num=0]
Epoch 24: 100%|██████████| 97/97 [00:14<00:00,  6.66it/s, loss=3.48, v_num=0]
Epoch 24: 100%|██████████| 97/97 [00:14<00:00,  6.64it/s, loss=3.48, v_num=0]
Epoch 24: 100%|██████████| 97/97 [00:14<00:00,  6.64it/s, loss=3.48, v_num=0]
Epoch 24:   0%|          | 0/97 [00:00<?, ?it/s, loss=3.48, v_num=0]
Epoch 25:   0%|          | 0/97 [00:00<?, ?it/s, loss=3.48, v_num=0]
Epoch 25:   1%|          | 1/97 [00:01<02:12,  1.38s/it, loss=3.48, v_num=0]
Epoch 25:   1%|          | 1/97 [00:01<02:17,  1.43s/it, loss=3.48, v_num=0]
Epoch 25:   2%|▏         | 2/97 [00:01<01:11,  1.33it/s, loss=3.48, v_num=0]
Epoch 25:   2%|▏         | 2/97 [00:01<01:14,  1.28it/s, loss=3.48, v_num=0]
Epoch 25:   3%|▎         | 3/97 [00:01<00:51,  1.82it/s, loss=3.48, v_num=0]
Epoch 25:   3%|▎         | 3/97 [00:01<00:53,  1.76it/s, loss=3.48, v_num=0]
Epoch 25:   4%|▍         | 4/97 [00:01<00:41,  2.24it/s, loss=3.48, v_num=0]
Epoch 25:   4%|▍         | 4/97 [00:01<00:42,  2.17it/s, loss=3.47, v_num=0]
Epoch 25:   5%|▌         | 5/97 [00:01<00:35,  2.60it/s, loss=3.47, v_num=0]
Epoch 25:   5%|▌         | 5/97 [00:01<00:36,  2.53it/s, loss=3.47, v_num=0]
Epoch 25:   6%|▌         | 6/97 [00:02<00:31,  2.91it/s, loss=3.47, v_num=0]
Epoch 25:   6%|▌         | 6/97 [00:02<00:32,  2.83it/s, loss=3.48, v_num=0]
Epoch 25:   7%|▋         | 7/97 [00:02<00:28,  3.18it/s, loss=3.48, v_num=0]
Epoch 25:   7%|▋         | 7/97 [00:02<00:28,  3.11it/s, loss=3.47, v_num=0]
Epoch 25:   8%|▊         | 8/97 [00:02<00:25,  3.43it/s, loss=3.47, v_num=0]
Epoch 25:   8%|▊         | 8/97 [00:02<00:26,  3.35it/s, loss=3.47, v_num=0]
Epoch 25:   9%|▉         | 9/97 [00:02<00:24,  3.63it/s, loss=3.47, v_num=0]
Epoch 25:   9%|▉         | 9/97 [00:02<00:24,  3.55it/s, loss=3.47, v_num=0]
Epoch 25:  10%|█         | 10/97 [00:02<00:22,  3.83it/s, loss=3.47, v_num=0]
Epoch 25:  10%|█         | 10/97 [00:02<00:23,  3.74it/s, loss=3.47, v_num=0]
Epoch 25:  11%|█▏        | 11/97 [00:02<00:21,  4.00it/s, loss=3.47, v_num=0]
Epoch 25:  11%|█▏        | 11/97 [00:02<00:21,  3.92it/s, loss=3.47, v_num=0]
Epoch 25:  12%|█▏        | 12/97 [00:02<00:20,  4.16it/s, loss=3.47, v_num=0]
Epoch 25:  12%|█▏        | 12/97 [00:02<00:20,  4.08it/s, loss=3.46, v_num=0]
Epoch 25:  13%|█▎        | 13/97 [00:03<00:19,  4.30it/s, loss=3.46, v_num=0]
Epoch 25:  13%|█▎        | 13/97 [00:03<00:19,  4.22it/s, loss=3.47, v_num=0]
Epoch 25:  14%|█▍        | 14/97 [00:03<00:18,  4.44it/s, loss=3.47, v_num=0]
Epoch 25:  14%|█▍        | 14/97 [00:03<00:19,  4.35it/s, loss=3.47, v_num=0]
Epoch 25:  15%|█▌        | 15/97 [00:03<00:18,  4.55it/s, loss=3.47, v_num=0]
Epoch 25:  15%|█▌        | 15/97 [00:03<00:18,  4.48it/s, loss=3.47, v_num=0]
Epoch 25:  16%|█▋        | 16/97 [00:03<00:17,  4.66it/s, loss=3.47, v_num=0]
Epoch 25:  16%|█▋        | 16/97 [00:03<00:17,  4.59it/s, loss=3.47, v_num=0]
Epoch 25:  18%|█▊        | 17/97 [00:03<00:16,  4.76it/s, loss=3.47, v_num=0]
Epoch 25:  18%|█▊        | 17/97 [00:03<00:17,  4.69it/s, loss=3.47, v_num=0]
Epoch 25:  19%|█▊        | 18/97 [00:03<00:16,  4.86it/s, loss=3.47, v_num=0]
Epoch 25:  19%|█▊        | 18/97 [00:03<00:16,  4.78it/s, loss=3.47, v_num=0]
Epoch 25:  20%|█▉        | 19/97 [00:03<00:15,  4.94it/s, loss=3.47, v_num=0]
Epoch 25:  20%|█▉        | 19/97 [00:03<00:16,  4.87it/s, loss=3.47, v_num=0]
Epoch 25:  21%|██        | 20/97 [00:03<00:15,  5.03it/s, loss=3.47, v_num=0]
Epoch 25:  21%|██        | 20/97 [00:04<00:15,  4.96it/s, loss=3.46, v_num=0]
Epoch 25:  22%|██▏       | 21/97 [00:04<00:14,  5.10it/s, loss=3.46, v_num=0]
Epoch 25:  22%|██▏       | 21/97 [00:04<00:15,  5.04it/s, loss=3.47, v_num=0]
Epoch 25:  23%|██▎       | 22/97 [00:04<00:14,  5.17it/s, loss=3.47, v_num=0]
Epoch 25:  23%|██▎       | 22/97 [00:04<00:14,  5.11it/s, loss=3.47, v_num=0]
Epoch 25:  24%|██▎       | 23/97 [00:04<00:14,  5.24it/s, loss=3.47, v_num=0]
Epoch 25:  24%|██▎       | 23/97 [00:04<00:14,  5.18it/s, loss=3.47, v_num=0]
Epoch 25:  25%|██▍       | 24/97 [00:04<00:13,  5.30it/s, loss=3.47, v_num=0]
Epoch 25:  25%|██▍       | 24/97 [00:04<00:13,  5.24it/s, loss=3.47, v_num=0]
Epoch 25:  26%|██▌       | 25/97 [00:04<00:13,  5.36it/s, loss=3.47, v_num=0]
Epoch 25:  26%|██▌       | 25/97 [00:04<00:13,  5.30it/s, loss=3.46, v_num=0]
Epoch 25:  27%|██▋       | 26/97 [00:04<00:13,  5.42it/s, loss=3.46, v_num=0]
Epoch 25:  27%|██▋       | 26/97 [00:04<00:13,  5.35it/s, loss=3.47, v_num=0]
Epoch 25:  28%|██▊       | 27/97 [00:04<00:12,  5.47it/s, loss=3.47, v_num=0]
Epoch 25:  28%|██▊       | 27/97 [00:04<00:12,  5.41it/s, loss=3.47, v_num=0]
Epoch 25:  29%|██▉       | 28/97 [00:05<00:12,  5.52it/s, loss=3.47, v_num=0]
Epoch 25:  29%|██▉       | 28/97 [00:05<00:12,  5.46it/s, loss=3.47, v_num=0]
Epoch 25:  30%|██▉       | 29/97 [00:05<00:12,  5.56it/s, loss=3.47, v_num=0]
Epoch 25:  30%|██▉       | 29/97 [00:05<00:12,  5.51it/s, loss=3.47, v_num=0]
Epoch 25:  31%|███       | 30/97 [00:05<00:11,  5.61it/s, loss=3.47, v_num=0]
Epoch 25:  31%|███       | 30/97 [00:05<00:12,  5.55it/s, loss=3.46, v_num=0]
Epoch 25:  32%|███▏      | 31/97 [00:05<00:11,  5.65it/s, loss=3.46, v_num=0]
Epoch 25:  32%|███▏      | 31/97 [00:05<00:11,  5.59it/s, loss=3.47, v_num=0]
Epoch 25:  33%|███▎      | 32/97 [00:05<00:11,  5.69it/s, loss=3.47, v_num=0]
Epoch 25:  33%|███▎      | 32/97 [00:05<00:11,  5.63it/s, loss=3.46, v_num=0]
Epoch 25:  34%|███▍      | 33/97 [00:05<00:11,  5.73it/s, loss=3.46, v_num=0]
Epoch 25:  34%|███▍      | 33/97 [00:05<00:11,  5.67it/s, loss=3.46, v_num=0]
Epoch 25:  35%|███▌      | 34/97 [00:05<00:10,  5.76it/s, loss=3.46, v_num=0]
Epoch 25:  35%|███▌      | 34/97 [00:05<00:11,  5.71it/s, loss=3.46, v_num=0]
Epoch 25:  36%|███▌      | 35/97 [00:06<00:10,  5.80it/s, loss=3.46, v_num=0]
Epoch 25:  36%|███▌      | 35/97 [00:06<00:10,  5.75it/s, loss=3.46, v_num=0]
Epoch 25:  37%|███▋      | 36/97 [00:06<00:10,  5.83it/s, loss=3.46, v_num=0]
Epoch 25:  37%|███▋      | 36/97 [00:06<00:10,  5.78it/s, loss=3.47, v_num=0]
Epoch 25:  38%|███▊      | 37/97 [00:06<00:10,  5.86it/s, loss=3.47, v_num=0]
Epoch 25:  38%|███▊      | 37/97 [00:06<00:10,  5.81it/s, loss=3.47, v_num=0]
Epoch 25:  39%|███▉      | 38/97 [00:06<00:10,  5.89it/s, loss=3.47, v_num=0]
Epoch 25:  39%|███▉      | 38/97 [00:06<00:10,  5.84it/s, loss=3.47, v_num=0]
Epoch 25:  40%|████      | 39/97 [00:06<00:09,  5.92it/s, loss=3.47, v_num=0]
Epoch 25:  40%|████      | 39/97 [00:06<00:09,  5.87it/s, loss=3.47, v_num=0]
Epoch 25:  41%|████      | 40/97 [00:06<00:09,  5.95it/s, loss=3.47, v_num=0]
Epoch 25:  41%|████      | 40/97 [00:06<00:09,  5.90it/s, loss=3.47, v_num=0]
Epoch 25:  42%|████▏     | 41/97 [00:06<00:09,  5.98it/s, loss=3.47, v_num=0]
Epoch 25:  42%|████▏     | 41/97 [00:06<00:09,  5.93it/s, loss=3.47, v_num=0]
Epoch 25:  43%|████▎     | 42/97 [00:06<00:09,  6.00it/s, loss=3.47, v_num=0]
Epoch 25:  43%|████▎     | 42/97 [00:07<00:09,  5.96it/s, loss=3.47, v_num=0]
Epoch 25:  44%|████▍     | 43/97 [00:07<00:08,  6.03it/s, loss=3.47, v_num=0]
Epoch 25:  44%|████▍     | 43/97 [00:07<00:09,  5.98it/s, loss=3.47, v_num=0]
Epoch 25:  45%|████▌     | 44/97 [00:07<00:08,  6.05it/s, loss=3.47, v_num=0]
Epoch 25:  45%|████▌     | 44/97 [00:07<00:08,  6.01it/s, loss=3.47, v_num=0]
Epoch 25:  46%|████▋     | 45/97 [00:07<00:08,  6.07it/s, loss=3.47, v_num=0]
Epoch 25:  46%|████▋     | 45/97 [00:07<00:08,  6.03it/s, loss=3.47, v_num=0]
Epoch 25:  47%|████▋     | 46/97 [00:07<00:08,  6.10it/s, loss=3.47, v_num=0]
Epoch 25:  47%|████▋     | 46/97 [00:07<00:08,  6.05it/s, loss=3.47, v_num=0]
Epoch 25:  48%|████▊     | 47/97 [00:07<00:08,  6.12it/s, loss=3.47, v_num=0]
Epoch 25:  48%|████▊     | 47/97 [00:07<00:08,  6.07it/s, loss=3.47, v_num=0]
Epoch 25:  49%|████▉     | 48/97 [00:07<00:07,  6.13it/s, loss=3.47, v_num=0]
Epoch 25:  49%|████▉     | 48/97 [00:07<00:08,  6.09it/s, loss=3.48, v_num=0]
Epoch 25:  51%|█████     | 49/97 [00:07<00:07,  6.15it/s, loss=3.48, v_num=0]
Epoch 25:  51%|█████     | 49/97 [00:08<00:07,  6.11it/s, loss=3.48, v_num=0]
Epoch 25:  52%|█████▏    | 50/97 [00:08<00:07,  6.17it/s, loss=3.48, v_num=0]
Epoch 25:  52%|█████▏    | 50/97 [00:08<00:07,  6.13it/s, loss=3.48, v_num=0]
Epoch 25:  53%|█████▎    | 51/97 [00:08<00:07,  6.19it/s, loss=3.48, v_num=0]
Epoch 25:  53%|█████▎    | 51/97 [00:08<00:07,  6.14it/s, loss=3.48, v_num=0]
Epoch 25:  54%|█████▎    | 52/97 [00:08<00:07,  6.20it/s, loss=3.48, v_num=0]
Epoch 25:  54%|█████▎    | 52/97 [00:08<00:07,  6.16it/s, loss=3.49, v_num=0]
Epoch 25:  55%|█████▍    | 53/97 [00:08<00:07,  6.22it/s, loss=3.49, v_num=0]
Epoch 25:  55%|█████▍    | 53/97 [00:08<00:07,  6.18it/s, loss=3.48, v_num=0]
Epoch 25:  56%|█████▌    | 54/97 [00:08<00:06,  6.24it/s, loss=3.48, v_num=0]
Epoch 25:  56%|█████▌    | 54/97 [00:08<00:06,  6.20it/s, loss=3.48, v_num=0]
Epoch 25:  57%|█████▋    | 55/97 [00:08<00:06,  6.25it/s, loss=3.48, v_num=0]
Epoch 25:  57%|█████▋    | 55/97 [00:08<00:06,  6.22it/s, loss=3.48, v_num=0]
Epoch 25:  58%|█████▊    | 56/97 [00:08<00:06,  6.27it/s, loss=3.48, v_num=0]
Epoch 25:  58%|█████▊    | 56/97 [00:08<00:06,  6.23it/s, loss=3.47, v_num=0]
Epoch 25:  59%|█████▉    | 57/97 [00:09<00:06,  6.28it/s, loss=3.47, v_num=0]
Epoch 25:  59%|█████▉    | 57/97 [00:09<00:06,  6.24it/s, loss=3.48, v_num=0]
Epoch 25:  60%|█████▉    | 58/97 [00:09<00:06,  6.30it/s, loss=3.48, v_num=0]
Epoch 25:  60%|█████▉    | 58/97 [00:09<00:06,  6.26it/s, loss=3.47, v_num=0]
Epoch 25:  61%|██████    | 59/97 [00:09<00:06,  6.31it/s, loss=3.47, v_num=0]
Epoch 25:  61%|██████    | 59/97 [00:09<00:06,  6.27it/s, loss=3.48, v_num=0]
Epoch 25:  62%|██████▏   | 60/97 [00:09<00:05,  6.32it/s, loss=3.48, v_num=0]
Epoch 25:  62%|██████▏   | 60/97 [00:09<00:05,  6.28it/s, loss=3.48, v_num=0]
Epoch 25:  63%|██████▎   | 61/97 [00:09<00:05,  6.33it/s, loss=3.48, v_num=0]
Epoch 25:  63%|██████▎   | 61/97 [00:09<00:05,  6.30it/s, loss=3.48, v_num=0]
Epoch 25:  64%|██████▍   | 62/97 [00:09<00:05,  6.34it/s, loss=3.48, v_num=0]
Epoch 25:  64%|██████▍   | 62/97 [00:09<00:05,  6.31it/s, loss=3.48, v_num=0]
Epoch 25:  65%|██████▍   | 63/97 [00:09<00:05,  6.36it/s, loss=3.48, v_num=0]
Epoch 25:  65%|██████▍   | 63/97 [00:09<00:05,  6.32it/s, loss=3.49, v_num=0]
Epoch 25:  66%|██████▌   | 64/97 [00:10<00:05,  6.37it/s, loss=3.49, v_num=0]
Epoch 25:  66%|██████▌   | 64/97 [00:10<00:05,  6.33it/s, loss=3.49, v_num=0]
Epoch 25:  67%|██████▋   | 65/97 [00:10<00:05,  6.38it/s, loss=3.49, v_num=0]
Epoch 25:  67%|██████▋   | 65/97 [00:10<00:05,  6.35it/s, loss=3.49, v_num=0]
Epoch 25:  68%|██████▊   | 66/97 [00:10<00:04,  6.39it/s, loss=3.49, v_num=0]
Epoch 25:  68%|██████▊   | 66/97 [00:10<00:04,  6.36it/s, loss=3.49, v_num=0]
Epoch 25:  69%|██████▉   | 67/97 [00:10<00:04,  6.41it/s, loss=3.49, v_num=0]
Epoch 25:  69%|██████▉   | 67/97 [00:10<00:04,  6.37it/s, loss=3.48, v_num=0]
Epoch 25:  70%|███████   | 68/97 [00:10<00:04,  6.42it/s, loss=3.48, v_num=0]
Epoch 25:  70%|███████   | 68/97 [00:10<00:04,  6.38it/s, loss=3.48, v_num=0]
Epoch 25:  71%|███████   | 69/97 [00:10<00:04,  6.43it/s, loss=3.48, v_num=0]
Epoch 25:  71%|███████   | 69/97 [00:10<00:04,  6.39it/s, loss=3.48, v_num=0]
Epoch 25:  72%|███████▏  | 70/97 [00:10<00:04,  6.44it/s, loss=3.48, v_num=0]
Epoch 25:  72%|███████▏  | 70/97 [00:10<00:04,  6.41it/s, loss=3.48, v_num=0]
Epoch 25:  73%|███████▎  | 71/97 [00:11<00:04,  6.45it/s, loss=3.48, v_num=0]
Epoch 25:  73%|███████▎  | 71/97 [00:11<00:04,  6.41it/s, loss=3.48, v_num=0]
Epoch 25:  74%|███████▍  | 72/97 [00:11<00:03,  6.46it/s, loss=3.48, v_num=0]
Epoch 25:  74%|███████▍  | 72/97 [00:11<00:03,  6.42it/s, loss=3.48, v_num=0]
Epoch 25:  75%|███████▌  | 73/97 [00:11<00:03,  6.47it/s, loss=3.48, v_num=0]
Epoch 25:  75%|███████▌  | 73/97 [00:11<00:03,  6.43it/s, loss=3.48, v_num=0]
Epoch 25:  76%|███████▋  | 74/97 [00:11<00:03,  6.48it/s, loss=3.48, v_num=0]
Epoch 25:  76%|███████▋  | 74/97 [00:11<00:03,  6.44it/s, loss=3.48, v_num=0]
Epoch 25:  77%|███████▋  | 75/97 [00:11<00:03,  6.48it/s, loss=3.48, v_num=0]
Epoch 25:  77%|███████▋  | 75/97 [00:11<00:03,  6.45it/s, loss=3.48, v_num=0]
Epoch 25:  78%|███████▊  | 76/97 [00:11<00:03,  6.50it/s, loss=3.48, v_num=0]
Epoch 25:  78%|███████▊  | 76/97 [00:11<00:03,  6.46it/s, loss=3.48, v_num=0]
Epoch 25:  79%|███████▉  | 77/97 [00:11<00:03,  6.50it/s, loss=3.48, v_num=0]
Epoch 25:  79%|███████▉  | 77/97 [00:11<00:03,  6.47it/s, loss=3.48, v_num=0]
Epoch 25:  80%|████████  | 78/97 [00:11<00:02,  6.51it/s, loss=3.48, v_num=0]
Epoch 25:  80%|████████  | 78/97 [00:12<00:02,  6.48it/s, loss=3.47, v_num=0]
Epoch 25:  81%|████████▏ | 79/97 [00:12<00:02,  6.52it/s, loss=3.47, v_num=0]
Epoch 25:  81%|████████▏ | 79/97 [00:12<00:02,  6.49it/s, loss=3.46, v_num=0]
Epoch 25:  82%|████████▏ | 80/97 [00:12<00:02,  6.53it/s, loss=3.46, v_num=0]
Epoch 25:  82%|████████▏ | 80/97 [00:12<00:02,  6.50it/s, loss=3.46, v_num=0]
Epoch 25:  84%|████████▎ | 81/97 [00:12<00:02,  6.54it/s, loss=3.46, v_num=0]
Epoch 25:  84%|████████▎ | 81/97 [00:12<00:02,  6.51it/s, loss=3.45, v_num=0]
Epoch 25:  85%|████████▍ | 82/97 [00:12<00:02,  6.54it/s, loss=3.45, v_num=0]
Epoch 25:  85%|████████▍ | 82/97 [00:12<00:02,  6.51it/s, loss=3.45, v_num=0]
Epoch 25:  86%|████████▌ | 83/97 [00:12<00:02,  6.55it/s, loss=3.45, v_num=0]
Epoch 25:  86%|████████▌ | 83/97 [00:12<00:02,  6.52it/s, loss=3.44, v_num=0]
Epoch 25:  87%|████████▋ | 84/97 [00:12<00:01,  6.56it/s, loss=3.44, v_num=0]
Epoch 25:  87%|████████▋ | 84/97 [00:12<00:01,  6.53it/s, loss=3.44, v_num=0]
Epoch 25:  88%|████████▊ | 85/97 [00:12<00:01,  6.56it/s, loss=3.44, v_num=0]
Epoch 25:  88%|████████▊ | 85/97 [00:13<00:01,  6.54it/s, loss=3.44, v_num=0]
Epoch 25:  89%|████████▊ | 86/97 [00:13<00:01,  6.57it/s, loss=3.44, v_num=0]
Epoch 25:  89%|████████▊ | 86/97 [00:13<00:01,  6.54it/s, loss=3.43, v_num=0]
Epoch 25:  90%|████████▉ | 87/97 [00:13<00:01,  6.58it/s, loss=3.43, v_num=0]
Epoch 25:  90%|████████▉ | 87/97 [00:13<00:01,  6.55it/s, loss=3.45, v_num=0]
Epoch 25:  91%|█████████ | 88/97 [00:13<00:01,  6.59it/s, loss=3.45, v_num=0]
Epoch 25:  91%|█████████ | 88/97 [00:13<00:01,  6.56it/s, loss=3.44, v_num=0]
Epoch 25:  92%|█████████▏| 89/97 [00:13<00:01,  6.60it/s, loss=3.44, v_num=0]
Epoch 25:  92%|█████████▏| 89/97 [00:13<00:01,  6.57it/s, loss=3.44, v_num=0]
Epoch 25:  93%|█████████▎| 90/97 [00:13<00:01,  6.60it/s, loss=3.44, v_num=0]
Epoch 25:  93%|█████████▎| 90/97 [00:13<00:01,  6.58it/s, loss=3.44, v_num=0]
Epoch 25:  94%|█████████▍| 91/97 [00:13<00:00,  6.61it/s, loss=3.44, v_num=0]
Epoch 25:  94%|█████████▍| 91/97 [00:13<00:00,  6.58it/s, loss=3.44, v_num=0]
Epoch 25:  95%|█████████▍| 92/97 [00:13<00:00,  6.62it/s, loss=3.44, v_num=0]
Epoch 25:  95%|█████████▍| 92/97 [00:13<00:00,  6.59it/s, loss=3.44, v_num=0]
Epoch 25:  96%|█████████▌| 93/97 [00:14<00:00,  6.63it/s, loss=3.44, v_num=0]
Epoch 25:  96%|█████████▌| 93/97 [00:14<00:00,  6.60it/s, loss=3.43, v_num=0]
Epoch 25:  97%|█████████▋| 94/97 [00:14<00:00,  6.63it/s, loss=3.43, v_num=0]
Epoch 25:  97%|█████████▋| 94/97 [00:14<00:00,  6.60it/s, loss=3.43, v_num=0]
Epoch 25:  98%|█████████▊| 95/97 [00:14<00:00,  6.64it/s, loss=3.43, v_num=0]
Epoch 25:  98%|█████████▊| 95/97 [00:14<00:00,  6.61it/s, loss=3.43, v_num=0]
Epoch 25:  99%|█████████▉| 96/97 [00:14<00:00,  6.64it/s, loss=3.43, v_num=0]
Epoch 25:  99%|█████████▉| 96/97 [00:14<00:00,  6.62it/s, loss=3.43, v_num=0]
Epoch 25: 100%|██████████| 97/97 [00:14<00:00,  6.65it/s, loss=3.43, v_num=0]
Epoch 25: 100%|██████████| 97/97 [00:14<00:00,  6.62it/s, loss=3.43, v_num=0]
Epoch 25: 100%|██████████| 97/97 [00:14<00:00,  6.62it/s, loss=3.43, v_num=0]
Epoch 25:   0%|          | 0/97 [00:00<?, ?it/s, loss=3.43, v_num=0]
Epoch 26:   0%|          | 0/97 [00:00<?, ?it/s, loss=3.43, v_num=0]
Epoch 26:   1%|          | 1/97 [00:01<02:09,  1.35s/it, loss=3.43, v_num=0]
Epoch 26:   1%|          | 1/97 [00:01<02:15,  1.41s/it, loss=3.44, v_num=0]
Epoch 26:   2%|▏         | 2/97 [00:01<01:11,  1.34it/s, loss=3.44, v_num=0]
Epoch 26:   2%|▏         | 2/97 [00:01<01:13,  1.29it/s, loss=3.44, v_num=0]
Epoch 26:   3%|▎         | 3/97 [00:01<00:51,  1.84it/s, loss=3.44, v_num=0]
Epoch 26:   3%|▎         | 3/97 [00:01<00:52,  1.78it/s, loss=3.44, v_num=0]
Epoch 26:   4%|▍         | 4/97 [00:01<00:41,  2.27it/s, loss=3.44, v_num=0]
Epoch 26:   4%|▍         | 4/97 [00:01<00:42,  2.19it/s, loss=3.46, v_num=0]
Epoch 26:   5%|▌         | 5/97 [00:01<00:35,  2.63it/s, loss=3.46, v_num=0]
Epoch 26:   5%|▌         | 5/97 [00:01<00:36,  2.55it/s, loss=3.46, v_num=0]
Epoch 26:   6%|▌         | 6/97 [00:02<00:30,  2.94it/s, loss=3.46, v_num=0]
Epoch 26:   6%|▌         | 6/97 [00:02<00:31,  2.86it/s, loss=3.46, v_num=0]
Epoch 26:   7%|▋         | 7/97 [00:02<00:28,  3.21it/s, loss=3.46, v_num=0]
Epoch 26:   7%|▋         | 7/97 [00:02<00:28,  3.13it/s, loss=3.46, v_num=0]
Epoch 26:   8%|▊         | 8/97 [00:02<00:25,  3.45it/s, loss=3.46, v_num=0]
Epoch 26:   8%|▊         | 8/97 [00:02<00:26,  3.37it/s, loss=3.46, v_num=0]
Epoch 26:   9%|▉         | 9/97 [00:02<00:24,  3.66it/s, loss=3.46, v_num=0]
Epoch 26:   9%|▉         | 9/97 [00:02<00:24,  3.58it/s, loss=3.46, v_num=0]
Epoch 26:  10%|█         | 10/97 [00:02<00:22,  3.85it/s, loss=3.46, v_num=0]
Epoch 26:  10%|█         | 10/97 [00:02<00:23,  3.77it/s, loss=3.45, v_num=0]
Epoch 26:  11%|█▏        | 11/97 [00:02<00:21,  4.03it/s, loss=3.45, v_num=0]
Epoch 26:  11%|█▏        | 11/97 [00:02<00:21,  3.95it/s, loss=3.46, v_num=0]
Epoch 26:  12%|█▏        | 12/97 [00:02<00:20,  4.18it/s, loss=3.46, v_num=0]
Epoch 26:  12%|█▏        | 12/97 [00:02<00:20,  4.10it/s, loss=3.45, v_num=0]
Epoch 26:  13%|█▎        | 13/97 [00:03<00:19,  4.33it/s, loss=3.45, v_num=0]
Epoch 26:  13%|█▎        | 13/97 [00:03<00:19,  4.25it/s, loss=3.45, v_num=0]
Epoch 26:  14%|█▍        | 14/97 [00:03<00:18,  4.46it/s, loss=3.45, v_num=0]
Epoch 26:  14%|█▍        | 14/97 [00:03<00:18,  4.38it/s, loss=3.45, v_num=0]
Epoch 26:  15%|█▌        | 15/97 [00:03<00:17,  4.58it/s, loss=3.45, v_num=0]
Epoch 26:  15%|█▌        | 15/97 [00:03<00:18,  4.50it/s, loss=3.45, v_num=0]
Epoch 26:  16%|█▋        | 16/97 [00:03<00:17,  4.69it/s, loss=3.45, v_num=0]
Epoch 26:  16%|█▋        | 16/97 [00:03<00:17,  4.61it/s, loss=3.45, v_num=0]
Epoch 26:  18%|█▊        | 17/97 [00:03<00:16,  4.79it/s, loss=3.45, v_num=0]
Epoch 26:  18%|█▊        | 17/97 [00:03<00:16,  4.72it/s, loss=3.44, v_num=0]
Epoch 26:  19%|█▊        | 18/97 [00:03<00:16,  4.88it/s, loss=3.44, v_num=0]
Epoch 26:  19%|█▊        | 18/97 [00:03<00:16,  4.80it/s, loss=3.44, v_num=0]
Epoch 26:  20%|█▉        | 19/97 [00:03<00:15,  4.96it/s, loss=3.44, v_num=0]
Epoch 26:  20%|█▉        | 19/97 [00:03<00:15,  4.89it/s, loss=3.44, v_num=0]
Epoch 26:  21%|██        | 20/97 [00:03<00:15,  5.04it/s, loss=3.44, v_num=0]
Epoch 26:  21%|██        | 20/97 [00:04<00:15,  4.97it/s, loss=3.44, v_num=0]
Epoch 26:  22%|██▏       | 21/97 [00:04<00:14,  5.11it/s, loss=3.44, v_num=0]
Epoch 26:  22%|██▏       | 21/97 [00:04<00:15,  5.04it/s, loss=3.44, v_num=0]
Epoch 26:  23%|██▎       | 22/97 [00:04<00:14,  5.18it/s, loss=3.44, v_num=0]
Epoch 26:  23%|██▎       | 22/97 [00:04<00:14,  5.11it/s, loss=3.44, v_num=0]
Epoch 26:  24%|██▎       | 23/97 [00:04<00:14,  5.24it/s, loss=3.44, v_num=0]
Epoch 26:  24%|██▎       | 23/97 [00:04<00:14,  5.18it/s, loss=3.43, v_num=0]
Epoch 26:  25%|██▍       | 24/97 [00:04<00:13,  5.31it/s, loss=3.43, v_num=0]
Epoch 26:  25%|██▍       | 24/97 [00:04<00:13,  5.25it/s, loss=3.43, v_num=0]
Epoch 26:  26%|██▌       | 25/97 [00:04<00:13,  5.37it/s, loss=3.43, v_num=0]
Epoch 26:  26%|██▌       | 25/97 [00:04<00:13,  5.31it/s, loss=3.43, v_num=0]
Epoch 26:  27%|██▋       | 26/97 [00:04<00:13,  5.42it/s, loss=3.43, v_num=0]
Epoch 26:  27%|██▋       | 26/97 [00:04<00:13,  5.36it/s, loss=3.43, v_num=0]
Epoch 26:  28%|██▊       | 27/97 [00:04<00:12,  5.48it/s, loss=3.43, v_num=0]
Epoch 26:  28%|██▊       | 27/97 [00:04<00:12,  5.42it/s, loss=3.42, v_num=0]
Epoch 26:  29%|██▉       | 28/97 [00:05<00:12,  5.53it/s, loss=3.42, v_num=0]
Epoch 26:  29%|██▉       | 28/97 [00:05<00:12,  5.47it/s, loss=3.42, v_num=0]
Epoch 26:  30%|██▉       | 29/97 [00:05<00:12,  5.57it/s, loss=3.42, v_num=0]
Epoch 26:  30%|██▉       | 29/97 [00:05<00:12,  5.51it/s, loss=3.42, v_num=0]
Epoch 26:  31%|███       | 30/97 [00:05<00:11,  5.62it/s, loss=3.42, v_num=0]
Epoch 26:  31%|███       | 30/97 [00:05<00:12,  5.56it/s, loss=3.42, v_num=0]
Epoch 26:  32%|███▏      | 31/97 [00:05<00:11,  5.66it/s, loss=3.42, v_num=0]
Epoch 26:  32%|███▏      | 31/97 [00:05<00:11,  5.60it/s, loss=3.41, v_num=0]
Epoch 26:  33%|███▎      | 32/97 [00:05<00:11,  5.70it/s, loss=3.41, v_num=0]
Epoch 26:  33%|███▎      | 32/97 [00:05<00:11,  5.64it/s, loss=3.41, v_num=0]
Epoch 26:  34%|███▍      | 33/97 [00:05<00:11,  5.74it/s, loss=3.41, v_num=0]
Epoch 26:  34%|███▍      | 33/97 [00:05<00:11,  5.68it/s, loss=3.41, v_num=0]
Epoch 26:  35%|███▌      | 34/97 [00:05<00:10,  5.77it/s, loss=3.41, v_num=0]
Epoch 26:  35%|███▌      | 34/97 [00:05<00:11,  5.72it/s, loss=3.41, v_num=0]
Epoch 26:  36%|███▌      | 35/97 [00:06<00:10,  5.81it/s, loss=3.41, v_num=0]
Epoch 26:  36%|███▌      | 35/97 [00:06<00:10,  5.76it/s, loss=3.42, v_num=0]
Epoch 26:  37%|███▋      | 36/97 [00:06<00:10,  5.85it/s, loss=3.42, v_num=0]
Epoch 26:  37%|███▋      | 36/97 [00:06<00:10,  5.79it/s, loss=3.42, v_num=0]
Epoch 26:  38%|███▊      | 37/97 [00:06<00:10,  5.87it/s, loss=3.42, v_num=0]
Epoch 26:  38%|███▊      | 37/97 [00:06<00:10,  5.82it/s, loss=3.42, v_num=0]
Epoch 26:  39%|███▉      | 38/97 [00:06<00:09,  5.91it/s, loss=3.42, v_num=0]
Epoch 26:  39%|███▉      | 38/97 [00:06<00:10,  5.86it/s, loss=3.41, v_num=0]
Epoch 26:  40%|████      | 39/97 [00:06<00:09,  5.94it/s, loss=3.41, v_num=0]
Epoch 26:  40%|████      | 39/97 [00:06<00:09,  5.89it/s, loss=3.41, v_num=0]
Epoch 26:  41%|████      | 40/97 [00:06<00:09,  5.97it/s, loss=3.41, v_num=0]
Epoch 26:  41%|████      | 40/97 [00:06<00:09,  5.91it/s, loss=3.41, v_num=0]
Epoch 26:  42%|████▏     | 41/97 [00:06<00:09,  5.99it/s, loss=3.41, v_num=0]
Epoch 26:  42%|████▏     | 41/97 [00:06<00:09,  5.94it/s, loss=3.42, v_num=0]
Epoch 26:  43%|████▎     | 42/97 [00:06<00:09,  6.02it/s, loss=3.42, v_num=0]
Epoch 26:  43%|████▎     | 42/97 [00:07<00:09,  5.97it/s, loss=3.42, v_num=0]
Epoch 26:  44%|████▍     | 43/97 [00:07<00:08,  6.04it/s, loss=3.42, v_num=0]
Epoch 26:  44%|████▍     | 43/97 [00:07<00:09,  5.99it/s, loss=3.42, v_num=0]
Epoch 26:  45%|████▌     | 44/97 [00:07<00:08,  6.07it/s, loss=3.42, v_num=0]
Epoch 26:  45%|████▌     | 44/97 [00:07<00:08,  6.02it/s, loss=3.42, v_num=0]
Epoch 26:  46%|████▋     | 45/97 [00:07<00:08,  6.09it/s, loss=3.42, v_num=0]
Epoch 26:  46%|████▋     | 45/97 [00:07<00:08,  6.04it/s, loss=3.42, v_num=0]
Epoch 26:  47%|████▋     | 46/97 [00:07<00:08,  6.11it/s, loss=3.42, v_num=0]
Epoch 26:  47%|████▋     | 46/97 [00:07<00:08,  6.07it/s, loss=3.41, v_num=0]
Epoch 26:  48%|████▊     | 47/97 [00:07<00:08,  6.13it/s, loss=3.41, v_num=0]
Epoch 26:  48%|████▊     | 47/97 [00:07<00:08,  6.09it/s, loss=3.41, v_num=0]
Epoch 26:  49%|████▉     | 48/97 [00:07<00:07,  6.16it/s, loss=3.41, v_num=0]
Epoch 26:  49%|████▉     | 48/97 [00:07<00:08,  6.11it/s, loss=3.41, v_num=0]
Epoch 26:  51%|█████     | 49/97 [00:07<00:07,  6.17it/s, loss=3.41, v_num=0]
Epoch 26:  51%|█████     | 49/97 [00:07<00:07,  6.13it/s, loss=3.42, v_num=0]
Epoch 26:  52%|█████▏    | 50/97 [00:08<00:07,  6.20it/s, loss=3.42, v_num=0]
Epoch 26:  52%|█████▏    | 50/97 [00:08<00:07,  6.15it/s, loss=3.42, v_num=0]
Epoch 26:  53%|█████▎    | 51/97 [00:08<00:07,  6.21it/s, loss=3.42, v_num=0]
Epoch 26:  53%|█████▎    | 51/97 [00:08<00:07,  6.17it/s, loss=3.43, v_num=0]
Epoch 26:  54%|█████▎    | 52/97 [00:08<00:07,  6.23it/s, loss=3.43, v_num=0]
Epoch 26:  54%|█████▎    | 52/97 [00:08<00:07,  6.19it/s, loss=3.43, v_num=0]
Epoch 26:  55%|█████▍    | 53/97 [00:08<00:07,  6.25it/s, loss=3.43, v_num=0]
Epoch 26:  55%|█████▍    | 53/97 [00:08<00:07,  6.21it/s, loss=3.43, v_num=0]
Epoch 26:  56%|█████▌    | 54/97 [00:08<00:06,  6.26it/s, loss=3.43, v_num=0]
Epoch 26:  56%|█████▌    | 54/97 [00:08<00:06,  6.22it/s, loss=3.43, v_num=0]
Epoch 26:  57%|█████▋    | 55/97 [00:08<00:06,  6.28it/s, loss=3.43, v_num=0]
Epoch 26:  57%|█████▋    | 55/97 [00:08<00:06,  6.24it/s, loss=3.43, v_num=0]
Epoch 26:  58%|█████▊    | 56/97 [00:08<00:06,  6.30it/s, loss=3.43, v_num=0]
Epoch 26:  58%|█████▊    | 56/97 [00:08<00:06,  6.26it/s, loss=3.42, v_num=0]
Epoch 26:  59%|█████▉    | 57/97 [00:09<00:06,  6.31it/s, loss=3.42, v_num=0]
Epoch 26:  59%|█████▉    | 57/97 [00:09<00:06,  6.27it/s, loss=3.41, v_num=0]
Epoch 26:  60%|█████▉    | 58/97 [00:09<00:06,  6.33it/s, loss=3.41, v_num=0]
Epoch 26:  60%|█████▉    | 58/97 [00:09<00:06,  6.29it/s, loss=3.42, v_num=0]
Epoch 26:  61%|██████    | 59/97 [00:09<00:05,  6.34it/s, loss=3.42, v_num=0]
Epoch 26:  61%|██████    | 59/97 [00:09<00:06,  6.30it/s, loss=3.42, v_num=0]
Epoch 26:  62%|██████▏   | 60/97 [00:09<00:05,  6.35it/s, loss=3.42, v_num=0]
Epoch 26:  62%|██████▏   | 60/97 [00:09<00:05,  6.31it/s, loss=3.42, v_num=0]
Epoch 26:  63%|██████▎   | 61/97 [00:09<00:05,  6.37it/s, loss=3.42, v_num=0]
Epoch 26:  63%|██████▎   | 61/97 [00:09<00:05,  6.33it/s, loss=3.41, v_num=0]
Epoch 26:  64%|██████▍   | 62/97 [00:09<00:05,  6.38it/s, loss=3.41, v_num=0]
Epoch 26:  64%|██████▍   | 62/97 [00:09<00:05,  6.34it/s, loss=3.4, v_num=0]
Epoch 26:  65%|██████▍   | 63/97 [00:09<00:05,  6.39it/s, loss=3.4, v_num=0]
Epoch 26:  65%|██████▍   | 63/97 [00:09<00:05,  6.36it/s, loss=3.41, v_num=0]
Epoch 26:  66%|██████▌   | 64/97 [00:09<00:05,  6.40it/s, loss=3.41, v_num=0]
Epoch 26:  66%|██████▌   | 64/97 [00:10<00:05,  6.37it/s, loss=3.41, v_num=0]
Epoch 26:  67%|██████▋   | 65/97 [00:10<00:04,  6.42it/s, loss=3.41, v_num=0]
Epoch 26:  67%|██████▋   | 65/97 [00:10<00:05,  6.38it/s, loss=3.42, v_num=0]
Epoch 26:  68%|██████▊   | 66/97 [00:10<00:04,  6.43it/s, loss=3.42, v_num=0]
Epoch 26:  68%|██████▊   | 66/97 [00:10<00:04,  6.39it/s, loss=3.42, v_num=0]
Epoch 26:  69%|██████▉   | 67/97 [00:10<00:04,  6.44it/s, loss=3.42, v_num=0]
Epoch 26:  69%|██████▉   | 67/97 [00:10<00:04,  6.40it/s, loss=3.41, v_num=0]
Epoch 26:  70%|███████   | 68/97 [00:10<00:04,  6.45it/s, loss=3.41, v_num=0]
Epoch 26:  70%|███████   | 68/97 [00:10<00:04,  6.42it/s, loss=3.42, v_num=0]
Epoch 26:  71%|███████   | 69/97 [00:10<00:04,  6.46it/s, loss=3.42, v_num=0]
Epoch 26:  71%|███████   | 69/97 [00:10<00:04,  6.43it/s, loss=3.41, v_num=0]
Epoch 26:  72%|███████▏  | 70/97 [00:10<00:04,  6.47it/s, loss=3.41, v_num=0]
Epoch 26:  72%|███████▏  | 70/97 [00:10<00:04,  6.44it/s, loss=3.41, v_num=0]
Epoch 26:  73%|███████▎  | 71/97 [00:10<00:04,  6.48it/s, loss=3.41, v_num=0]
Epoch 26:  73%|███████▎  | 71/97 [00:11<00:04,  6.45it/s, loss=3.41, v_num=0]
Epoch 26:  74%|███████▍  | 72/97 [00:11<00:03,  6.49it/s, loss=3.41, v_num=0]
Epoch 26:  74%|███████▍  | 72/97 [00:11<00:03,  6.46it/s, loss=3.41, v_num=0]
Epoch 26:  75%|███████▌  | 73/97 [00:11<00:03,  6.50it/s, loss=3.41, v_num=0]
Epoch 26:  75%|███████▌  | 73/97 [00:11<00:03,  6.47it/s, loss=3.41, v_num=0]
Epoch 26:  76%|███████▋  | 74/97 [00:11<00:03,  6.51it/s, loss=3.41, v_num=0]
Epoch 26:  76%|███████▋  | 74/97 [00:11<00:03,  6.48it/s, loss=3.41, v_num=0]
Epoch 26:  77%|███████▋  | 75/97 [00:11<00:03,  6.52it/s, loss=3.41, v_num=0]
Epoch 26:  77%|███████▋  | 75/97 [00:11<00:03,  6.49it/s, loss=3.41, v_num=0]
Epoch 26:  78%|███████▊  | 76/97 [00:11<00:03,  6.53it/s, loss=3.41, v_num=0]
Epoch 26:  78%|███████▊  | 76/97 [00:11<00:03,  6.50it/s, loss=3.42, v_num=0]
Epoch 26:  79%|███████▉  | 77/97 [00:11<00:03,  6.54it/s, loss=3.42, v_num=0]
Epoch 26:  79%|███████▉  | 77/97 [00:11<00:03,  6.51it/s, loss=3.42, v_num=0]
Epoch 26:  80%|████████  | 78/97 [00:11<00:02,  6.55it/s, loss=3.42, v_num=0]
Epoch 26:  80%|████████  | 78/97 [00:11<00:02,  6.52it/s, loss=3.41, v_num=0]
Epoch 26:  81%|████████▏ | 79/97 [00:12<00:02,  6.56it/s, loss=3.41, v_num=0]
Epoch 26:  81%|████████▏ | 79/97 [00:12<00:02,  6.52it/s, loss=3.41, v_num=0]
Epoch 26:  82%|████████▏ | 80/97 [00:12<00:02,  6.56it/s, loss=3.41, v_num=0]
Epoch 26:  82%|████████▏ | 80/97 [00:12<00:02,  6.53it/s, loss=3.41, v_num=0]
Epoch 26:  84%|████████▎ | 81/97 [00:12<00:02,  6.57it/s, loss=3.41, v_num=0]
Epoch 26:  84%|████████▎ | 81/97 [00:12<00:02,  6.54it/s, loss=3.41, v_num=0]
Epoch 26:  85%|████████▍ | 82/97 [00:12<00:02,  6.58it/s, loss=3.41, v_num=0]
Epoch 26:  85%|████████▍ | 82/97 [00:12<00:02,  6.55it/s, loss=3.41, v_num=0]
Epoch 26:  86%|████████▌ | 83/97 [00:12<00:02,  6.59it/s, loss=3.41, v_num=0]
Epoch 26:  86%|████████▌ | 83/97 [00:12<00:02,  6.56it/s, loss=3.4, v_num=0]
Epoch 26:  87%|████████▋ | 84/97 [00:12<00:01,  6.59it/s, loss=3.4, v_num=0]
Epoch 26:  87%|████████▋ | 84/97 [00:12<00:01,  6.57it/s, loss=3.4, v_num=0]
Epoch 26:  88%|████████▊ | 85/97 [00:12<00:01,  6.60it/s, loss=3.4, v_num=0]
Epoch 26:  88%|████████▊ | 85/97 [00:12<00:01,  6.57it/s, loss=3.39, v_num=0]
Epoch 26:  89%|████████▊ | 86/97 [00:13<00:01,  6.61it/s, loss=3.39, v_num=0]
Epoch 26:  89%|████████▊ | 86/97 [00:13<00:01,  6.58it/s, loss=3.39, v_num=0]
Epoch 26:  90%|████████▉ | 87/97 [00:13<00:01,  6.62it/s, loss=3.39, v_num=0]
Epoch 26:  90%|████████▉ | 87/97 [00:13<00:01,  6.59it/s, loss=3.39, v_num=0]
Epoch 26:  91%|█████████ | 88/97 [00:13<00:01,  6.62it/s, loss=3.39, v_num=0]
Epoch 26:  91%|█████████ | 88/97 [00:13<00:01,  6.60it/s, loss=3.39, v_num=0]
Epoch 26:  92%|█████████▏| 89/97 [00:13<00:01,  6.63it/s, loss=3.39, v_num=0]
Epoch 26:  92%|█████████▏| 89/97 [00:13<00:01,  6.60it/s, loss=3.39, v_num=0]
Epoch 26:  93%|█████████▎| 90/97 [00:13<00:01,  6.64it/s, loss=3.39, v_num=0]
Epoch 26:  93%|█████████▎| 90/97 [00:13<00:01,  6.61it/s, loss=3.39, v_num=0]
Epoch 26:  94%|█████████▍| 91/97 [00:13<00:00,  6.65it/s, loss=3.39, v_num=0]
Epoch 26:  94%|█████████▍| 91/97 [00:13<00:00,  6.62it/s, loss=3.38, v_num=0]
Epoch 26:  95%|█████████▍| 92/97 [00:13<00:00,  6.65it/s, loss=3.38, v_num=0]
Epoch 26:  95%|█████████▍| 92/97 [00:13<00:00,  6.62it/s, loss=3.38, v_num=0]
Epoch 26:  96%|█████████▌| 93/97 [00:13<00:00,  6.66it/s, loss=3.38, v_num=0]
Epoch 26:  96%|█████████▌| 93/97 [00:14<00:00,  6.63it/s, loss=3.38, v_num=0]
Epoch 26:  97%|█████████▋| 94/97 [00:14<00:00,  6.66it/s, loss=3.38, v_num=0]
Epoch 26:  97%|█████████▋| 94/97 [00:14<00:00,  6.64it/s, loss=3.38, v_num=0]
Epoch 26:  98%|█████████▊| 95/97 [00:14<00:00,  6.67it/s, loss=3.38, v_num=0]
Epoch 26:  98%|█████████▊| 95/97 [00:14<00:00,  6.64it/s, loss=3.37, v_num=0]
Epoch 26:  99%|█████████▉| 96/97 [00:14<00:00,  6.68it/s, loss=3.37, v_num=0]
Epoch 26:  99%|█████████▉| 96/97 [00:14<00:00,  6.65it/s, loss=3.36, v_num=0]
Epoch 26: 100%|██████████| 97/97 [00:14<00:00,  6.68it/s, loss=3.36, v_num=0]
Epoch 26: 100%|██████████| 97/97 [00:14<00:00,  6.66it/s, loss=3.36, v_num=0]
Epoch 26: 100%|██████████| 97/97 [00:14<00:00,  6.66it/s, loss=3.36, v_num=0]
Epoch 26:   0%|          | 0/97 [00:00<?, ?it/s, loss=3.36, v_num=0]
Epoch 27:   0%|          | 0/97 [00:00<?, ?it/s, loss=3.36, v_num=0]
Epoch 27:   1%|          | 1/97 [00:01<02:13,  1.39s/it, loss=3.36, v_num=0]
Epoch 27:   1%|          | 1/97 [00:01<02:18,  1.44s/it, loss=3.36, v_num=0]
Epoch 27:   2%|▏         | 2/97 [00:01<01:12,  1.32it/s, loss=3.36, v_num=0]
Epoch 27:   2%|▏         | 2/97 [00:01<01:14,  1.27it/s, loss=3.37, v_num=0]
Epoch 27:   3%|▎         | 3/97 [00:01<00:52,  1.81it/s, loss=3.37, v_num=0]
Epoch 27:   3%|▎         | 3/97 [00:01<00:53,  1.75it/s, loss=3.37, v_num=0]
Epoch 27:   4%|▍         | 4/97 [00:01<00:41,  2.22it/s, loss=3.37, v_num=0]
Epoch 27:   4%|▍         | 4/97 [00:01<00:43,  2.15it/s, loss=3.38, v_num=0]
Epoch 27:   5%|▌         | 5/97 [00:01<00:35,  2.58it/s, loss=3.38, v_num=0]
Epoch 27:   5%|▌         | 5/97 [00:01<00:36,  2.50it/s, loss=3.39, v_num=0]
Epoch 27:   6%|▌         | 6/97 [00:02<00:31,  2.89it/s, loss=3.39, v_num=0]
Epoch 27:   6%|▌         | 6/97 [00:02<00:32,  2.81it/s, loss=3.38, v_num=0]
Epoch 27:   7%|▋         | 7/97 [00:02<00:28,  3.16it/s, loss=3.38, v_num=0]
Epoch 27:   7%|▋         | 7/97 [00:02<00:29,  3.09it/s, loss=3.39, v_num=0]
Epoch 27:   8%|▊         | 8/97 [00:02<00:26,  3.41it/s, loss=3.39, v_num=0]
Epoch 27:   8%|▊         | 8/97 [00:02<00:26,  3.33it/s, loss=3.39, v_num=0]
Epoch 27:   9%|▉         | 9/97 [00:02<00:24,  3.62it/s, loss=3.39, v_num=0]
Epoch 27:   9%|▉         | 9/97 [00:02<00:24,  3.54it/s, loss=3.39, v_num=0]
Epoch 27:  10%|█         | 10/97 [00:02<00:22,  3.81it/s, loss=3.39, v_num=0]
Epoch 27:  10%|█         | 10/97 [00:02<00:23,  3.73it/s, loss=3.4, v_num=0]
Epoch 27:  11%|█▏        | 11/97 [00:02<00:21,  3.98it/s, loss=3.4, v_num=0]
Epoch 27:  11%|█▏        | 11/97 [00:02<00:22,  3.91it/s, loss=3.39, v_num=0]
Epoch 27:  12%|█▏        | 12/97 [00:02<00:20,  4.14it/s, loss=3.39, v_num=0]
Epoch 27:  12%|█▏        | 12/97 [00:02<00:20,  4.06it/s, loss=3.39, v_num=0]
Epoch 27:  13%|█▎        | 13/97 [00:03<00:19,  4.28it/s, loss=3.39, v_num=0]
Epoch 27:  13%|█▎        | 13/97 [00:03<00:19,  4.21it/s, loss=3.4, v_num=0]
Epoch 27:  14%|█▍        | 14/97 [00:03<00:18,  4.41it/s, loss=3.4, v_num=0]
Epoch 27:  14%|█▍        | 14/97 [00:03<00:19,  4.34it/s, loss=3.4, v_num=0]
Epoch 27:  15%|█▌        | 15/97 [00:03<00:18,  4.54it/s, loss=3.4, v_num=0]
Epoch 27:  15%|█▌        | 15/97 [00:03<00:18,  4.46it/s, loss=3.39, v_num=0]
Epoch 27:  16%|█▋        | 16/97 [00:03<00:17,  4.65it/s, loss=3.39, v_num=0]
Epoch 27:  16%|█▋        | 16/97 [00:03<00:17,  4.57it/s, loss=3.4, v_num=0]
Epoch 27:  18%|█▊        | 17/97 [00:03<00:16,  4.75it/s, loss=3.4, v_num=0]
Epoch 27:  18%|█▊        | 17/97 [00:03<00:17,  4.67it/s, loss=3.39, v_num=0]
Epoch 27:  19%|█▊        | 18/97 [00:03<00:16,  4.84it/s, loss=3.39, v_num=0]
Epoch 27:  19%|█▊        | 18/97 [00:03<00:16,  4.76it/s, loss=3.39, v_num=0]
Epoch 27:  20%|█▉        | 19/97 [00:03<00:15,  4.93it/s, loss=3.39, v_num=0]
Epoch 27:  20%|█▉        | 19/97 [00:03<00:16,  4.86it/s, loss=3.4, v_num=0]
Epoch 27:  21%|██        | 20/97 [00:03<00:15,  5.01it/s, loss=3.4, v_num=0]
Epoch 27:  21%|██        | 20/97 [00:04<00:15,  4.94it/s, loss=3.4, v_num=0]
Epoch 27:  22%|██▏       | 21/97 [00:04<00:14,  5.09it/s, loss=3.4, v_num=0]
Epoch 27:  22%|██▏       | 21/97 [00:04<00:15,  5.02it/s, loss=3.4, v_num=0]
Epoch 27:  23%|██▎       | 22/97 [00:04<00:14,  5.16it/s, loss=3.4, v_num=0]
Epoch 27:  23%|██▎       | 22/97 [00:04<00:14,  5.09it/s, loss=3.38, v_num=0]
Epoch 27:  24%|██▎       | 23/97 [00:04<00:14,  5.22it/s, loss=3.38, v_num=0]
Epoch 27:  24%|██▎       | 23/97 [00:04<00:14,  5.16it/s, loss=3.38, v_num=0]
Epoch 27:  25%|██▍       | 24/97 [00:04<00:13,  5.29it/s, loss=3.38, v_num=0]
Epoch 27:  25%|██▍       | 24/97 [00:04<00:13,  5.22it/s, loss=3.38, v_num=0]
Epoch 27:  26%|██▌       | 25/97 [00:04<00:13,  5.34it/s, loss=3.38, v_num=0]
Epoch 27:  26%|██▌       | 25/97 [00:04<00:13,  5.28it/s, loss=3.37, v_num=0]
Epoch 27:  27%|██▋       | 26/97 [00:04<00:13,  5.40it/s, loss=3.37, v_num=0]
Epoch 27:  27%|██▋       | 26/97 [00:04<00:13,  5.34it/s, loss=3.38, v_num=0]
Epoch 27:  28%|██▊       | 27/97 [00:04<00:12,  5.45it/s, loss=3.38, v_num=0]
Epoch 27:  28%|██▊       | 27/97 [00:05<00:12,  5.39it/s, loss=3.37, v_num=0]
Epoch 27:  29%|██▉       | 28/97 [00:05<00:12,  5.50it/s, loss=3.37, v_num=0]
Epoch 27:  29%|██▉       | 28/97 [00:05<00:12,  5.44it/s, loss=3.37, v_num=0]
Epoch 27:  30%|██▉       | 29/97 [00:05<00:12,  5.55it/s, loss=3.37, v_num=0]
Epoch 27:  30%|██▉       | 29/97 [00:05<00:12,  5.49it/s, loss=3.37, v_num=0]
Epoch 27:  31%|███       | 30/97 [00:05<00:11,  5.59it/s, loss=3.37, v_num=0]
Epoch 27:  31%|███       | 30/97 [00:05<00:12,  5.54it/s, loss=3.37, v_num=0]
Epoch 27:  32%|███▏      | 31/97 [00:05<00:11,  5.64it/s, loss=3.37, v_num=0]
Epoch 27:  32%|███▏      | 31/97 [00:05<00:11,  5.58it/s, loss=3.37, v_num=0]
Epoch 27:  33%|███▎      | 32/97 [00:05<00:11,  5.68it/s, loss=3.37, v_num=0]
Epoch 27:  33%|███▎      | 32/97 [00:05<00:11,  5.62it/s, loss=3.37, v_num=0]
Epoch 27:  34%|███▍      | 33/97 [00:05<00:11,  5.71it/s, loss=3.37, v_num=0]
Epoch 27:  34%|███▍      | 33/97 [00:05<00:11,  5.66it/s, loss=3.36, v_num=0]
Epoch 27:  35%|███▌      | 34/97 [00:05<00:10,  5.75it/s, loss=3.36, v_num=0]
Epoch 27:  35%|███▌      | 34/97 [00:05<00:11,  5.70it/s, loss=3.37, v_num=0]
Epoch 27:  36%|███▌      | 35/97 [00:06<00:10,  5.78it/s, loss=3.37, v_num=0]
Epoch 27:  36%|███▌      | 35/97 [00:06<00:10,  5.73it/s, loss=3.37, v_num=0]
Epoch 27:  37%|███▋      | 36/97 [00:06<00:10,  5.82it/s, loss=3.37, v_num=0]
Epoch 27:  37%|███▋      | 36/97 [00:06<00:10,  5.77it/s, loss=3.37, v_num=0]
Epoch 27:  38%|███▊      | 37/97 [00:06<00:10,  5.85it/s, loss=3.37, v_num=0]
Epoch 27:  38%|███▊      | 37/97 [00:06<00:10,  5.80it/s, loss=3.38, v_num=0]
Epoch 27:  39%|███▉      | 38/97 [00:06<00:10,  5.88it/s, loss=3.38, v_num=0]
Epoch 27:  39%|███▉      | 38/97 [00:06<00:10,  5.83it/s, loss=3.37, v_num=0]
Epoch 27:  40%|████      | 39/97 [00:06<00:09,  5.91it/s, loss=3.37, v_num=0]
Epoch 27:  40%|████      | 39/97 [00:06<00:09,  5.86it/s, loss=3.37, v_num=0]
Epoch 27:  41%|████      | 40/97 [00:06<00:09,  5.94it/s, loss=3.37, v_num=0]
Epoch 27:  41%|████      | 40/97 [00:06<00:09,  5.89it/s, loss=3.37, v_num=0]
Epoch 27:  42%|████▏     | 41/97 [00:06<00:09,  5.97it/s, loss=3.37, v_num=0]
Epoch 27:  42%|████▏     | 41/97 [00:06<00:09,  5.92it/s, loss=3.37, v_num=0]
Epoch 27:  43%|████▎     | 42/97 [00:07<00:09,  5.99it/s, loss=3.37, v_num=0]
Epoch 27:  43%|████▎     | 42/97 [00:07<00:09,  5.95it/s, loss=3.38, v_num=0]
Epoch 27:  44%|████▍     | 43/97 [00:07<00:08,  6.02it/s, loss=3.38, v_num=0]
Epoch 27:  44%|████▍     | 43/97 [00:07<00:09,  5.97it/s, loss=3.39, v_num=0]
Epoch 27:  45%|████▌     | 44/97 [00:07<00:08,  6.04it/s, loss=3.39, v_num=0]
Epoch 27:  45%|████▌     | 44/97 [00:07<00:08,  5.99it/s, loss=3.38, v_num=0]
Epoch 27:  46%|████▋     | 45/97 [00:07<00:08,  6.06it/s, loss=3.38, v_num=0]
Epoch 27:  46%|████▋     | 45/97 [00:07<00:08,  6.01it/s, loss=3.39, v_num=0]
Epoch 27:  47%|████▋     | 46/97 [00:07<00:08,  6.08it/s, loss=3.39, v_num=0]
Epoch 27:  47%|████▋     | 46/97 [00:07<00:08,  6.04it/s, loss=3.39, v_num=0]
Epoch 27:  48%|████▊     | 47/97 [00:07<00:08,  6.10it/s, loss=3.39, v_num=0]
Epoch 27:  48%|████▊     | 47/97 [00:07<00:08,  6.06it/s, loss=3.39, v_num=0]
Epoch 27:  49%|████▉     | 48/97 [00:07<00:07,  6.13it/s, loss=3.39, v_num=0]
Epoch 27:  49%|████▉     | 48/97 [00:07<00:08,  6.08it/s, loss=3.39, v_num=0]
Epoch 27:  51%|█████     | 49/97 [00:07<00:07,  6.14it/s, loss=3.39, v_num=0]
Epoch 27:  51%|█████     | 49/97 [00:08<00:07,  6.10it/s, loss=3.38, v_num=0]
Epoch 27:  52%|█████▏    | 50/97 [00:08<00:07,  6.17it/s, loss=3.38, v_num=0]
Epoch 27:  52%|█████▏    | 50/97 [00:08<00:07,  6.12it/s, loss=3.37, v_num=0]
Epoch 27:  53%|█████▎    | 51/97 [00:08<00:07,  6.18it/s, loss=3.37, v_num=0]
Epoch 27:  53%|█████▎    | 51/97 [00:08<00:07,  6.14it/s, loss=3.37, v_num=0]
Epoch 27:  54%|█████▎    | 52/97 [00:08<00:07,  6.20it/s, loss=3.37, v_num=0]
Epoch 27:  54%|█████▎    | 52/97 [00:08<00:07,  6.16it/s, loss=3.38, v_num=0]
Epoch 27:  55%|█████▍    | 53/97 [00:08<00:07,  6.22it/s, loss=3.38, v_num=0]
Epoch 27:  55%|█████▍    | 53/97 [00:08<00:07,  6.18it/s, loss=3.38, v_num=0]
Epoch 27:  56%|█████▌    | 54/97 [00:08<00:06,  6.23it/s, loss=3.38, v_num=0]
Epoch 27:  56%|█████▌    | 54/97 [00:08<00:06,  6.19it/s, loss=3.38, v_num=0]
Epoch 27:  57%|█████▋    | 55/97 [00:08<00:06,  6.25it/s, loss=3.38, v_num=0]
Epoch 27:  57%|█████▋    | 55/97 [00:08<00:06,  6.21it/s, loss=3.37, v_num=0]
Epoch 27:  58%|█████▊    | 56/97 [00:08<00:06,  6.26it/s, loss=3.37, v_num=0]
Epoch 27:  58%|█████▊    | 56/97 [00:08<00:06,  6.22it/s, loss=3.37, v_num=0]
Epoch 27:  59%|█████▉    | 57/97 [00:09<00:06,  6.28it/s, loss=3.37, v_num=0]
Epoch 27:  59%|█████▉    | 57/97 [00:09<00:06,  6.24it/s, loss=3.36, v_num=0]
Epoch 27:  60%|█████▉    | 58/97 [00:09<00:06,  6.30it/s, loss=3.36, v_num=0]
Epoch 27:  60%|█████▉    | 58/97 [00:09<00:06,  6.25it/s, loss=3.36, v_num=0]
Epoch 27:  61%|██████    | 59/97 [00:09<00:06,  6.31it/s, loss=3.36, v_num=0]
Epoch 27:  61%|██████    | 59/97 [00:09<00:06,  6.27it/s, loss=3.36, v_num=0]
Epoch 27:  62%|██████▏   | 60/97 [00:09<00:05,  6.32it/s, loss=3.36, v_num=0]
Epoch 27:  62%|██████▏   | 60/97 [00:09<00:05,  6.28it/s, loss=3.36, v_num=0]
Epoch 27:  63%|██████▎   | 61/97 [00:09<00:05,  6.33it/s, loss=3.36, v_num=0]
Epoch 27:  63%|██████▎   | 61/97 [00:09<00:05,  6.30it/s, loss=3.35, v_num=0]
Epoch 27:  64%|██████▍   | 62/97 [00:09<00:05,  6.35it/s, loss=3.35, v_num=0]
Epoch 27:  64%|██████▍   | 62/97 [00:09<00:05,  6.31it/s, loss=3.34, v_num=0]
Epoch 27:  65%|██████▍   | 63/97 [00:09<00:05,  6.36it/s, loss=3.34, v_num=0]
Epoch 27:  65%|██████▍   | 63/97 [00:09<00:05,  6.32it/s, loss=3.34, v_num=0]
Epoch 27:  66%|██████▌   | 64/97 [00:10<00:05,  6.37it/s, loss=3.34, v_num=0]
Epoch 27:  66%|██████▌   | 64/97 [00:10<00:05,  6.34it/s, loss=3.34, v_num=0]
Epoch 27:  67%|██████▋   | 65/97 [00:10<00:05,  6.38it/s, loss=3.34, v_num=0]
Epoch 27:  67%|██████▋   | 65/97 [00:10<00:05,  6.35it/s, loss=3.33, v_num=0]
Epoch 27:  68%|██████▊   | 66/97 [00:10<00:04,  6.40it/s, loss=3.33, v_num=0]
Epoch 27:  68%|██████▊   | 66/97 [00:10<00:04,  6.36it/s, loss=3.33, v_num=0]
Epoch 27:  69%|██████▉   | 67/97 [00:10<00:04,  6.41it/s, loss=3.33, v_num=0]
Epoch 27:  69%|██████▉   | 67/97 [00:10<00:04,  6.37it/s, loss=3.33, v_num=0]
Epoch 27:  70%|███████   | 68/97 [00:10<00:04,  6.42it/s, loss=3.33, v_num=0]
Epoch 27:  70%|███████   | 68/97 [00:10<00:04,  6.39it/s, loss=3.32, v_num=0]
Epoch 27:  71%|███████   | 69/97 [00:10<00:04,  6.43it/s, loss=3.32, v_num=0]
Epoch 27:  71%|███████   | 69/97 [00:10<00:04,  6.40it/s, loss=3.33, v_num=0]
Epoch 27:  72%|███████▏  | 70/97 [00:10<00:04,  6.44it/s, loss=3.33, v_num=0]
Epoch 27:  72%|███████▏  | 70/97 [00:10<00:04,  6.41it/s, loss=3.33, v_num=0]
Epoch 27:  73%|███████▎  | 71/97 [00:11<00:04,  6.45it/s, loss=3.33, v_num=0]
Epoch 27:  73%|███████▎  | 71/97 [00:11<00:04,  6.42it/s, loss=3.33, v_num=0]
Epoch 27:  74%|███████▍  | 72/97 [00:11<00:03,  6.46it/s, loss=3.33, v_num=0]
Epoch 27:  74%|███████▍  | 72/97 [00:11<00:03,  6.43it/s, loss=3.32, v_num=0]
Epoch 27:  75%|███████▌  | 73/97 [00:11<00:03,  6.47it/s, loss=3.32, v_num=0]
Epoch 27:  75%|███████▌  | 73/97 [00:11<00:03,  6.44it/s, loss=3.32, v_num=0]
Epoch 27:  76%|███████▋  | 74/97 [00:11<00:03,  6.48it/s, loss=3.32, v_num=0]
Epoch 27:  76%|███████▋  | 74/97 [00:11<00:03,  6.45it/s, loss=3.32, v_num=0]
Epoch 27:  77%|███████▋  | 75/97 [00:11<00:03,  6.49it/s, loss=3.32, v_num=0]
Epoch 27:  77%|███████▋  | 75/97 [00:11<00:03,  6.46it/s, loss=3.32, v_num=0]
Epoch 27:  78%|███████▊  | 76/97 [00:11<00:03,  6.50it/s, loss=3.32, v_num=0]
Epoch 27:  78%|███████▊  | 76/97 [00:11<00:03,  6.47it/s, loss=3.32, v_num=0]
Epoch 27:  79%|███████▉  | 77/97 [00:11<00:03,  6.51it/s, loss=3.32, v_num=0]
Epoch 27:  79%|███████▉  | 77/97 [00:11<00:03,  6.48it/s, loss=3.32, v_num=0]
Epoch 27:  80%|████████  | 78/97 [00:11<00:02,  6.52it/s, loss=3.32, v_num=0]
Epoch 27:  80%|████████  | 78/97 [00:12<00:02,  6.49it/s, loss=3.31, v_num=0]
Epoch 27:  81%|████████▏ | 79/97 [00:12<00:02,  6.53it/s, loss=3.31, v_num=0]
Epoch 27:  81%|████████▏ | 79/97 [00:12<00:02,  6.50it/s, loss=3.31, v_num=0]
Epoch 27:  82%|████████▏ | 80/97 [00:12<00:02,  6.53it/s, loss=3.31, v_num=0]
Epoch 27:  82%|████████▏ | 80/97 [00:12<00:02,  6.50it/s, loss=3.32, v_num=0]
Epoch 27:  84%|████████▎ | 81/97 [00:12<00:02,  6.54it/s, loss=3.32, v_num=0]
Epoch 27:  84%|████████▎ | 81/97 [00:12<00:02,  6.51it/s, loss=3.32, v_num=0]
Epoch 27:  85%|████████▍ | 82/97 [00:12<00:02,  6.55it/s, loss=3.32, v_num=0]
Epoch 27:  85%|████████▍ | 82/97 [00:12<00:02,  6.52it/s, loss=3.33, v_num=0]
Epoch 27:  86%|████████▌ | 83/97 [00:12<00:02,  6.56it/s, loss=3.33, v_num=0]
Epoch 27:  86%|████████▌ | 83/97 [00:12<00:02,  6.53it/s, loss=3.32, v_num=0]
Epoch 27:  87%|████████▋ | 84/97 [00:12<00:01,  6.56it/s, loss=3.32, v_num=0]
Epoch 27:  87%|████████▋ | 84/97 [00:12<00:01,  6.54it/s, loss=3.33, v_num=0]
Epoch 27:  88%|████████▊ | 85/97 [00:12<00:01,  6.57it/s, loss=3.33, v_num=0]
Epoch 27:  88%|████████▊ | 85/97 [00:12<00:01,  6.54it/s, loss=3.34, v_num=0]
Epoch 27:  89%|████████▊ | 86/97 [00:13<00:01,  6.58it/s, loss=3.34, v_num=0]
Epoch 27:  89%|████████▊ | 86/97 [00:13<00:01,  6.55it/s, loss=3.34, v_num=0]
Epoch 27:  90%|████████▉ | 87/97 [00:13<00:01,  6.59it/s, loss=3.34, v_num=0]
Epoch 27:  90%|████████▉ | 87/97 [00:13<00:01,  6.56it/s, loss=3.34, v_num=0]
Epoch 27:  91%|█████████ | 88/97 [00:13<00:01,  6.59it/s, loss=3.34, v_num=0]
Epoch 27:  91%|█████████ | 88/97 [00:13<00:01,  6.57it/s, loss=3.34, v_num=0]
Epoch 27:  92%|█████████▏| 89/97 [00:13<00:01,  6.60it/s, loss=3.34, v_num=0]
Epoch 27:  92%|█████████▏| 89/97 [00:13<00:01,  6.58it/s, loss=3.34, v_num=0]
Epoch 27:  93%|█████████▎| 90/97 [00:13<00:01,  6.61it/s, loss=3.34, v_num=0]
Epoch 27:  93%|█████████▎| 90/97 [00:13<00:01,  6.58it/s, loss=3.34, v_num=0]
Epoch 27:  94%|█████████▍| 91/97 [00:13<00:00,  6.62it/s, loss=3.34, v_num=0]
Epoch 27:  94%|█████████▍| 91/97 [00:13<00:00,  6.59it/s, loss=3.34, v_num=0]
Epoch 27:  95%|█████████▍| 92/97 [00:13<00:00,  6.62it/s, loss=3.34, v_num=0]
Epoch 27:  95%|█████████▍| 92/97 [00:13<00:00,  6.60it/s, loss=3.35, v_num=0]
Epoch 27:  96%|█████████▌| 93/97 [00:14<00:00,  6.63it/s, loss=3.35, v_num=0]
Epoch 27:  96%|█████████▌| 93/97 [00:14<00:00,  6.60it/s, loss=3.34, v_num=0]
Epoch 27:  97%|█████████▋| 94/97 [00:14<00:00,  6.64it/s, loss=3.34, v_num=0]
Epoch 27:  97%|█████████▋| 94/97 [00:14<00:00,  6.61it/s, loss=3.35, v_num=0]
Epoch 27:  98%|█████████▊| 95/97 [00:14<00:00,  6.65it/s, loss=3.35, v_num=0]
Epoch 27:  98%|█████████▊| 95/97 [00:14<00:00,  6.62it/s, loss=3.34, v_num=0]
Epoch 27:  99%|█████████▉| 96/97 [00:14<00:00,  6.65it/s, loss=3.34, v_num=0]
Epoch 27:  99%|█████████▉| 96/97 [00:14<00:00,  6.62it/s, loss=3.33, v_num=0]
Epoch 27: 100%|██████████| 97/97 [00:14<00:00,  6.66it/s, loss=3.33, v_num=0]
Epoch 27: 100%|██████████| 97/97 [00:14<00:00,  6.63it/s, loss=3.34, v_num=0]
Epoch 27: 100%|██████████| 97/97 [00:14<00:00,  6.63it/s, loss=3.34, v_num=0]
Epoch 27:   0%|          | 0/97 [00:00<?, ?it/s, loss=3.34, v_num=0]
Epoch 28:   0%|          | 0/97 [00:00<?, ?it/s, loss=3.34, v_num=0]
Epoch 28:   1%|          | 1/97 [00:01<02:12,  1.38s/it, loss=3.34, v_num=0]
Epoch 28:   1%|          | 1/97 [00:01<02:17,  1.44s/it, loss=3.35, v_num=0]
Epoch 28:   2%|▏         | 2/97 [00:01<01:12,  1.32it/s, loss=3.35, v_num=0]
Epoch 28:   2%|▏         | 2/97 [00:01<01:14,  1.27it/s, loss=3.35, v_num=0]
Epoch 28:   3%|▎         | 3/97 [00:01<00:51,  1.81it/s, loss=3.35, v_num=0]
Epoch 28:   3%|▎         | 3/97 [00:01<00:53,  1.75it/s, loss=3.35, v_num=0]
Epoch 28:   4%|▍         | 4/97 [00:01<00:41,  2.23it/s, loss=3.35, v_num=0]
Epoch 28:   4%|▍         | 4/97 [00:01<00:42,  2.16it/s, loss=3.34, v_num=0]
Epoch 28:   5%|▌         | 5/97 [00:01<00:35,  2.59it/s, loss=3.34, v_num=0]
Epoch 28:   5%|▌         | 5/97 [00:01<00:36,  2.51it/s, loss=3.33, v_num=0]
Epoch 28:   6%|▌         | 6/97 [00:02<00:31,  2.90it/s, loss=3.33, v_num=0]
Epoch 28:   6%|▌         | 6/97 [00:02<00:32,  2.82it/s, loss=3.34, v_num=0]
Epoch 28:   7%|▋         | 7/97 [00:02<00:28,  3.18it/s, loss=3.34, v_num=0]
Epoch 28:   7%|▋         | 7/97 [00:02<00:29,  3.10it/s, loss=3.33, v_num=0]
Epoch 28:   8%|▊         | 8/97 [00:02<00:26,  3.42it/s, loss=3.33, v_num=0]
Epoch 28:   8%|▊         | 8/97 [00:02<00:26,  3.34it/s, loss=3.33, v_num=0]
Epoch 28:   9%|▉         | 9/97 [00:02<00:24,  3.62it/s, loss=3.33, v_num=0]
Epoch 28:   9%|▉         | 9/97 [00:02<00:24,  3.54it/s, loss=3.32, v_num=0]
Epoch 28:  10%|█         | 10/97 [00:02<00:22,  3.82it/s, loss=3.32, v_num=0]
Epoch 28:  10%|█         | 10/97 [00:02<00:23,  3.73it/s, loss=3.31, v_num=0]
Epoch 28:  11%|█▏        | 11/97 [00:02<00:21,  3.99it/s, loss=3.31, v_num=0]
Epoch 28:  11%|█▏        | 11/97 [00:02<00:22,  3.91it/s, loss=3.32, v_num=0]
Epoch 28:  12%|█▏        | 12/97 [00:02<00:20,  4.15it/s, loss=3.32, v_num=0]
Epoch 28:  12%|█▏        | 12/97 [00:02<00:20,  4.07it/s, loss=3.31, v_num=0]
Epoch 28:  13%|█▎        | 13/97 [00:03<00:19,  4.29it/s, loss=3.31, v_num=0]
Epoch 28:  13%|█▎        | 13/97 [00:03<00:19,  4.21it/s, loss=3.31, v_num=0]
Epoch 28:  14%|█▍        | 14/97 [00:03<00:18,  4.42it/s, loss=3.31, v_num=0]
Epoch 28:  14%|█▍        | 14/97 [00:03<00:19,  4.34it/s, loss=3.31, v_num=0]
Epoch 28:  15%|█▌        | 15/97 [00:03<00:18,  4.54it/s, loss=3.31, v_num=0]
Epoch 28:  15%|█▌        | 15/97 [00:03<00:18,  4.47it/s, loss=3.3, v_num=0]
Epoch 28:  16%|█▋        | 16/97 [00:03<00:17,  4.65it/s, loss=3.3, v_num=0]
Epoch 28:  16%|█▋        | 16/97 [00:03<00:17,  4.58it/s, loss=3.31, v_num=0]
Epoch 28:  18%|█▊        | 17/97 [00:03<00:16,  4.75it/s, loss=3.31, v_num=0]
Epoch 28:  18%|█▊        | 17/97 [00:03<00:17,  4.68it/s, loss=3.3, v_num=0]
Epoch 28:  19%|█▊        | 18/97 [00:03<00:16,  4.85it/s, loss=3.3, v_num=0]
Epoch 28:  19%|█▊        | 18/97 [00:03<00:16,  4.77it/s, loss=3.31, v_num=0]
Epoch 28:  20%|█▉        | 19/97 [00:03<00:15,  4.93it/s, loss=3.31, v_num=0]
Epoch 28:  20%|█▉        | 19/97 [00:03<00:16,  4.86it/s, loss=3.32, v_num=0]
Epoch 28:  21%|██        | 20/97 [00:03<00:15,  5.02it/s, loss=3.32, v_num=0]
Epoch 28:  21%|██        | 20/97 [00:04<00:15,  4.95it/s, loss=3.31, v_num=0]
Epoch 28:  22%|██▏       | 21/97 [00:04<00:14,  5.09it/s, loss=3.31, v_num=0]
Epoch 28:  22%|██▏       | 21/97 [00:04<00:15,  5.02it/s, loss=3.3, v_num=0]
Epoch 28:  23%|██▎       | 22/97 [00:04<00:14,  5.17it/s, loss=3.3, v_num=0]
Epoch 28:  23%|██▎       | 22/97 [00:04<00:14,  5.10it/s, loss=3.3, v_num=0]
Epoch 28:  24%|██▎       | 23/97 [00:04<00:14,  5.23it/s, loss=3.3, v_num=0]
Epoch 28:  24%|██▎       | 23/97 [00:04<00:14,  5.16it/s, loss=3.29, v_num=0]
Epoch 28:  25%|██▍       | 24/97 [00:04<00:13,  5.29it/s, loss=3.29, v_num=0]
Epoch 28:  25%|██▍       | 24/97 [00:04<00:13,  5.22it/s, loss=3.29, v_num=0]
Epoch 28:  26%|██▌       | 25/97 [00:04<00:13,  5.35it/s, loss=3.29, v_num=0]
Epoch 28:  26%|██▌       | 25/97 [00:04<00:13,  5.28it/s, loss=3.3, v_num=0]
Epoch 28:  27%|██▋       | 26/97 [00:04<00:13,  5.41it/s, loss=3.3, v_num=0]
Epoch 28:  27%|██▋       | 26/97 [00:04<00:13,  5.34it/s, loss=3.29, v_num=0]
Epoch 28:  28%|██▊       | 27/97 [00:04<00:12,  5.45it/s, loss=3.29, v_num=0]
Epoch 28:  28%|██▊       | 27/97 [00:05<00:12,  5.39it/s, loss=3.29, v_num=0]
Epoch 28:  29%|██▉       | 28/97 [00:05<00:12,  5.50it/s, loss=3.29, v_num=0]
Epoch 28:  29%|██▉       | 28/97 [00:05<00:12,  5.44it/s, loss=3.29, v_num=0]
Epoch 28:  30%|██▉       | 29/97 [00:05<00:12,  5.55it/s, loss=3.29, v_num=0]
Epoch 28:  30%|██▉       | 29/97 [00:05<00:12,  5.49it/s, loss=3.3, v_num=0]
Epoch 28:  31%|███       | 30/97 [00:05<00:11,  5.59it/s, loss=3.3, v_num=0]
Epoch 28:  31%|███       | 30/97 [00:05<00:12,  5.53it/s, loss=3.29, v_num=0]
Epoch 28:  32%|███▏      | 31/97 [00:05<00:11,  5.63it/s, loss=3.29, v_num=0]
Epoch 28:  32%|███▏      | 31/97 [00:05<00:11,  5.58it/s, loss=3.29, v_num=0]
Epoch 28:  33%|███▎      | 32/97 [00:05<00:11,  5.67it/s, loss=3.29, v_num=0]
Epoch 28:  33%|███▎      | 32/97 [00:05<00:11,  5.62it/s, loss=3.28, v_num=0]
Epoch 28:  34%|███▍      | 33/97 [00:05<00:11,  5.72it/s, loss=3.28, v_num=0]
Epoch 28:  34%|███▍      | 33/97 [00:05<00:11,  5.66it/s, loss=3.3, v_num=0]
Epoch 28:  35%|███▌      | 34/97 [00:05<00:10,  5.75it/s, loss=3.3, v_num=0]
Epoch 28:  35%|███▌      | 34/97 [00:05<00:11,  5.70it/s, loss=3.29, v_num=0]
Epoch 28:  36%|███▌      | 35/97 [00:06<00:10,  5.79it/s, loss=3.29, v_num=0]
Epoch 28:  36%|███▌      | 35/97 [00:06<00:10,  5.73it/s, loss=3.3, v_num=0]
Epoch 28:  37%|███▋      | 36/97 [00:06<00:10,  5.81it/s, loss=3.3, v_num=0]
Epoch 28:  37%|███▋      | 36/97 [00:06<00:10,  5.76it/s, loss=3.3, v_num=0]
Epoch 28:  38%|███▊      | 37/97 [00:06<00:10,  5.84it/s, loss=3.3, v_num=0]
Epoch 28:  38%|███▊      | 37/97 [00:06<00:10,  5.79it/s, loss=3.29, v_num=0]
Epoch 28:  39%|███▉      | 38/97 [00:06<00:10,  5.88it/s, loss=3.29, v_num=0]
Epoch 28:  39%|███▉      | 38/97 [00:06<00:10,  5.83it/s, loss=3.29, v_num=0]
Epoch 28:  40%|████      | 39/97 [00:06<00:09,  5.91it/s, loss=3.29, v_num=0]
Epoch 28:  40%|████      | 39/97 [00:06<00:09,  5.86it/s, loss=3.3, v_num=0]
Epoch 28:  41%|████      | 40/97 [00:06<00:09,  5.93it/s, loss=3.3, v_num=0]
Epoch 28:  41%|████      | 40/97 [00:06<00:09,  5.89it/s, loss=3.31, v_num=0]
Epoch 28:  42%|████▏     | 41/97 [00:06<00:09,  5.97it/s, loss=3.31, v_num=0]
Epoch 28:  42%|████▏     | 41/97 [00:06<00:09,  5.91it/s, loss=3.31, v_num=0]
Epoch 28:  43%|████▎     | 42/97 [00:07<00:09,  5.99it/s, loss=3.31, v_num=0]
Epoch 28:  43%|████▎     | 42/97 [00:07<00:09,  5.94it/s, loss=3.31, v_num=0]
Epoch 28:  44%|████▍     | 43/97 [00:07<00:08,  6.02it/s, loss=3.31, v_num=0]
Epoch 28:  44%|████▍     | 43/97 [00:07<00:09,  5.97it/s, loss=3.32, v_num=0]
Epoch 28:  45%|████▌     | 44/97 [00:07<00:08,  6.04it/s, loss=3.32, v_num=0]
Epoch 28:  45%|████▌     | 44/97 [00:07<00:08,  5.99it/s, loss=3.32, v_num=0]
Epoch 28:  46%|████▋     | 45/97 [00:07<00:08,  6.06it/s, loss=3.32, v_num=0]
Epoch 28:  46%|████▋     | 45/97 [00:07<00:08,  6.02it/s, loss=3.31, v_num=0]
Epoch 28:  47%|████▋     | 46/97 [00:07<00:08,  6.08it/s, loss=3.31, v_num=0]
Epoch 28:  47%|████▋     | 46/97 [00:07<00:08,  6.04it/s, loss=3.32, v_num=0]
Epoch 28:  48%|████▊     | 47/97 [00:07<00:08,  6.11it/s, loss=3.32, v_num=0]
Epoch 28:  48%|████▊     | 47/97 [00:07<00:08,  6.06it/s, loss=3.32, v_num=0]
Epoch 28:  49%|████▉     | 48/97 [00:07<00:07,  6.13it/s, loss=3.32, v_num=0]
Epoch 28:  49%|████▉     | 48/97 [00:07<00:08,  6.08it/s, loss=3.33, v_num=0]
Epoch 28:  51%|█████     | 49/97 [00:07<00:07,  6.15it/s, loss=3.33, v_num=0]
Epoch 28:  51%|█████     | 49/97 [00:08<00:07,  6.10it/s, loss=3.32, v_num=0]
Epoch 28:  52%|█████▏    | 50/97 [00:08<00:07,  6.16it/s, loss=3.32, v_num=0]
Epoch 28:  52%|█████▏    | 50/97 [00:08<00:07,  6.12it/s, loss=3.32, v_num=0]
Epoch 28:  53%|█████▎    | 51/97 [00:08<00:07,  6.18it/s, loss=3.32, v_num=0]
Epoch 28:  53%|█████▎    | 51/97 [00:08<00:07,  6.14it/s, loss=3.33, v_num=0]
Epoch 28:  54%|█████▎    | 52/97 [00:08<00:07,  6.20it/s, loss=3.33, v_num=0]
Epoch 28:  54%|█████▎    | 52/97 [00:08<00:07,  6.16it/s, loss=3.33, v_num=0]
Epoch 28:  55%|█████▍    | 53/97 [00:08<00:07,  6.22it/s, loss=3.33, v_num=0]
Epoch 28:  55%|█████▍    | 53/97 [00:08<00:07,  6.18it/s, loss=3.32, v_num=0]
Epoch 28:  56%|█████▌    | 54/97 [00:08<00:06,  6.24it/s, loss=3.32, v_num=0]
Epoch 28:  56%|█████▌    | 54/97 [00:08<00:06,  6.20it/s, loss=3.31, v_num=0]
Epoch 28:  57%|█████▋    | 55/97 [00:08<00:06,  6.25it/s, loss=3.31, v_num=0]
Epoch 28:  57%|█████▋    | 55/97 [00:08<00:06,  6.21it/s, loss=3.31, v_num=0]
Epoch 28:  58%|█████▊    | 56/97 [00:08<00:06,  6.26it/s, loss=3.31, v_num=0]
Epoch 28:  58%|█████▊    | 56/97 [00:08<00:06,  6.22it/s, loss=3.3, v_num=0]
Epoch 28:  59%|█████▉    | 57/97 [00:09<00:06,  6.28it/s, loss=3.3, v_num=0]
Epoch 28:  59%|█████▉    | 57/97 [00:09<00:06,  6.24it/s, loss=3.31, v_num=0]
Epoch 28:  60%|█████▉    | 58/97 [00:09<00:06,  6.29it/s, loss=3.31, v_num=0]
Epoch 28:  60%|█████▉    | 58/97 [00:09<00:06,  6.25it/s, loss=3.3, v_num=0]
Epoch 28:  61%|██████    | 59/97 [00:09<00:06,  6.31it/s, loss=3.3, v_num=0]
Epoch 28:  61%|██████    | 59/97 [00:09<00:06,  6.27it/s, loss=3.29, v_num=0]
Epoch 28:  62%|██████▏   | 60/97 [00:09<00:05,  6.32it/s, loss=3.29, v_num=0]
Epoch 28:  62%|██████▏   | 60/97 [00:09<00:05,  6.28it/s, loss=3.29, v_num=0]
Epoch 28:  63%|██████▎   | 61/97 [00:09<00:05,  6.33it/s, loss=3.29, v_num=0]
Epoch 28:  63%|██████▎   | 61/97 [00:09<00:05,  6.29it/s, loss=3.29, v_num=0]
Epoch 28:  64%|██████▍   | 62/97 [00:09<00:05,  6.34it/s, loss=3.29, v_num=0]
Epoch 28:  64%|██████▍   | 62/97 [00:09<00:05,  6.31it/s, loss=3.29, v_num=0]
Epoch 28:  65%|██████▍   | 63/97 [00:09<00:05,  6.36it/s, loss=3.29, v_num=0]
Epoch 28:  65%|██████▍   | 63/97 [00:09<00:05,  6.32it/s, loss=3.29, v_num=0]
Epoch 28:  66%|██████▌   | 64/97 [00:10<00:05,  6.37it/s, loss=3.29, v_num=0]
Epoch 28:  66%|██████▌   | 64/97 [00:10<00:05,  6.34it/s, loss=3.29, v_num=0]
Epoch 28:  67%|██████▋   | 65/97 [00:10<00:05,  6.38it/s, loss=3.29, v_num=0]
Epoch 28:  67%|██████▋   | 65/97 [00:10<00:05,  6.35it/s, loss=3.29, v_num=0]
Epoch 28:  68%|██████▊   | 66/97 [00:10<00:04,  6.40it/s, loss=3.29, v_num=0]
Epoch 28:  68%|██████▊   | 66/97 [00:10<00:04,  6.36it/s, loss=3.29, v_num=0]
Epoch 28:  69%|██████▉   | 67/97 [00:10<00:04,  6.41it/s, loss=3.29, v_num=0]
Epoch 28:  69%|██████▉   | 67/97 [00:10<00:04,  6.37it/s, loss=3.29, v_num=0]
Epoch 28:  70%|███████   | 68/97 [00:10<00:04,  6.42it/s, loss=3.29, v_num=0]
Epoch 28:  70%|███████   | 68/97 [00:10<00:04,  6.39it/s, loss=3.28, v_num=0]
Epoch 28:  71%|███████   | 69/97 [00:10<00:04,  6.43it/s, loss=3.28, v_num=0]
Epoch 28:  71%|███████   | 69/97 [00:10<00:04,  6.40it/s, loss=3.28, v_num=0]
Epoch 28:  72%|███████▏  | 70/97 [00:10<00:04,  6.44it/s, loss=3.28, v_num=0]
Epoch 28:  72%|███████▏  | 70/97 [00:10<00:04,  6.41it/s, loss=3.28, v_num=0]
Epoch 28:  73%|███████▎  | 71/97 [00:11<00:04,  6.45it/s, loss=3.28, v_num=0]
Epoch 28:  73%|███████▎  | 71/97 [00:11<00:04,  6.42it/s, loss=3.28, v_num=0]
Epoch 28:  74%|███████▍  | 72/97 [00:11<00:03,  6.46it/s, loss=3.28, v_num=0]
Epoch 28:  74%|███████▍  | 72/97 [00:11<00:03,  6.43it/s, loss=3.28, v_num=0]
Epoch 28:  75%|███████▌  | 73/97 [00:11<00:03,  6.47it/s, loss=3.28, v_num=0]
Epoch 28:  75%|███████▌  | 73/97 [00:11<00:03,  6.44it/s, loss=3.28, v_num=0]
Epoch 28:  76%|███████▋  | 74/97 [00:11<00:03,  6.48it/s, loss=3.28, v_num=0]
Epoch 28:  76%|███████▋  | 74/97 [00:11<00:03,  6.45it/s, loss=3.28, v_num=0]
Epoch 28:  77%|███████▋  | 75/97 [00:11<00:03,  6.49it/s, loss=3.28, v_num=0]
Epoch 28:  77%|███████▋  | 75/97 [00:11<00:03,  6.46it/s, loss=3.28, v_num=0]
Epoch 28:  78%|███████▊  | 76/97 [00:11<00:03,  6.50it/s, loss=3.28, v_num=0]
Epoch 28:  78%|███████▊  | 76/97 [00:11<00:03,  6.47it/s, loss=3.28, v_num=0]
Epoch 28:  79%|███████▉  | 77/97 [00:11<00:03,  6.50it/s, loss=3.28, v_num=0]
Epoch 28:  79%|███████▉  | 77/97 [00:11<00:03,  6.47it/s, loss=3.28, v_num=0]
Epoch 28:  80%|████████  | 78/97 [00:11<00:02,  6.51it/s, loss=3.28, v_num=0]
Epoch 28:  80%|████████  | 78/97 [00:12<00:02,  6.48it/s, loss=3.28, v_num=0]
Epoch 28:  81%|████████▏ | 79/97 [00:12<00:02,  6.52it/s, loss=3.28, v_num=0]
Epoch 28:  81%|████████▏ | 79/97 [00:12<00:02,  6.49it/s, loss=3.29, v_num=0]
Epoch 28:  82%|████████▏ | 80/97 [00:12<00:02,  6.53it/s, loss=3.29, v_num=0]
Epoch 28:  82%|████████▏ | 80/97 [00:12<00:02,  6.50it/s, loss=3.28, v_num=0]
Epoch 28:  84%|████████▎ | 81/97 [00:12<00:02,  6.54it/s, loss=3.28, v_num=0]
Epoch 28:  84%|████████▎ | 81/97 [00:12<00:02,  6.51it/s, loss=3.28, v_num=0]
Epoch 28:  85%|████████▍ | 82/97 [00:12<00:02,  6.54it/s, loss=3.28, v_num=0]
Epoch 28:  85%|████████▍ | 82/97 [00:12<00:02,  6.52it/s, loss=3.29, v_num=0]
Epoch 28:  86%|████████▌ | 83/97 [00:12<00:02,  6.55it/s, loss=3.29, v_num=0]
Epoch 28:  86%|████████▌ | 83/97 [00:12<00:02,  6.52it/s, loss=3.29, v_num=0]
Epoch 28:  87%|████████▋ | 84/97 [00:12<00:01,  6.56it/s, loss=3.29, v_num=0]
Epoch 28:  87%|████████▋ | 84/97 [00:12<00:01,  6.53it/s, loss=3.29, v_num=0]
Epoch 28:  88%|████████▊ | 85/97 [00:12<00:01,  6.57it/s, loss=3.29, v_num=0]
Epoch 28:  88%|████████▊ | 85/97 [00:12<00:01,  6.54it/s, loss=3.29, v_num=0]
Epoch 28:  89%|████████▊ | 86/97 [00:13<00:01,  6.57it/s, loss=3.29, v_num=0]
Epoch 28:  89%|████████▊ | 86/97 [00:13<00:01,  6.55it/s, loss=3.29, v_num=0]
Epoch 28:  90%|████████▉ | 87/97 [00:13<00:01,  6.58it/s, loss=3.29, v_num=0]
Epoch 28:  90%|████████▉ | 87/97 [00:13<00:01,  6.55it/s, loss=3.29, v_num=0]
Epoch 28:  91%|█████████ | 88/97 [00:13<00:01,  6.59it/s, loss=3.29, v_num=0]
Epoch 28:  91%|█████████ | 88/97 [00:13<00:01,  6.56it/s, loss=3.28, v_num=0]
Epoch 28:  92%|█████████▏| 89/97 [00:13<00:01,  6.60it/s, loss=3.28, v_num=0]
Epoch 28:  92%|█████████▏| 89/97 [00:13<00:01,  6.57it/s, loss=3.28, v_num=0]
Epoch 28:  93%|█████████▎| 90/97 [00:13<00:01,  6.60it/s, loss=3.28, v_num=0]
Epoch 28:  93%|█████████▎| 90/97 [00:13<00:01,  6.58it/s, loss=3.29, v_num=0]
Epoch 28:  94%|█████████▍| 91/97 [00:13<00:00,  6.61it/s, loss=3.29, v_num=0]
Epoch 28:  94%|█████████▍| 91/97 [00:13<00:00,  6.59it/s, loss=3.29, v_num=0]
Epoch 28:  95%|█████████▍| 92/97 [00:13<00:00,  6.62it/s, loss=3.29, v_num=0]
Epoch 28:  95%|█████████▍| 92/97 [00:13<00:00,  6.59it/s, loss=3.29, v_num=0]
Epoch 28:  96%|█████████▌| 93/97 [00:14<00:00,  6.63it/s, loss=3.29, v_num=0]
Epoch 28:  96%|█████████▌| 93/97 [00:14<00:00,  6.60it/s, loss=3.29, v_num=0]
Epoch 28:  97%|█████████▋| 94/97 [00:14<00:00,  6.63it/s, loss=3.29, v_num=0]
Epoch 28:  97%|█████████▋| 94/97 [00:14<00:00,  6.61it/s, loss=3.29, v_num=0]
Epoch 28:  98%|█████████▊| 95/97 [00:14<00:00,  6.64it/s, loss=3.29, v_num=0]
Epoch 28:  98%|█████████▊| 95/97 [00:14<00:00,  6.61it/s, loss=3.3, v_num=0]
Epoch 28:  99%|█████████▉| 96/97 [00:14<00:00,  6.65it/s, loss=3.3, v_num=0]
Epoch 28:  99%|█████████▉| 96/97 [00:14<00:00,  6.62it/s, loss=3.3, v_num=0]
Epoch 28: 100%|██████████| 97/97 [00:14<00:00,  6.65it/s, loss=3.3, v_num=0]
Epoch 28: 100%|██████████| 97/97 [00:14<00:00,  6.63it/s, loss=3.29, v_num=0]
Epoch 28: 100%|██████████| 97/97 [00:14<00:00,  6.63it/s, loss=3.29, v_num=0]
Epoch 28:   0%|          | 0/97 [00:00<?, ?it/s, loss=3.29, v_num=0]
Epoch 29:   0%|          | 0/97 [00:00<?, ?it/s, loss=3.29, v_num=0]
Epoch 29:   1%|          | 1/97 [00:01<02:12,  1.38s/it, loss=3.29, v_num=0]
Epoch 29:   1%|          | 1/97 [00:01<02:17,  1.43s/it, loss=3.29, v_num=0]
Epoch 29:   2%|▏         | 2/97 [00:01<01:12,  1.31it/s, loss=3.29, v_num=0]
Epoch 29:   2%|▏         | 2/97 [00:01<01:14,  1.27it/s, loss=3.29, v_num=0]
Epoch 29:   3%|▎         | 3/97 [00:01<00:51,  1.81it/s, loss=3.29, v_num=0]
Epoch 29:   3%|▎         | 3/97 [00:01<00:53,  1.75it/s, loss=3.3, v_num=0]
Epoch 29:   4%|▍         | 4/97 [00:01<00:41,  2.23it/s, loss=3.3, v_num=0]
Epoch 29:   4%|▍         | 4/97 [00:01<00:42,  2.16it/s, loss=3.29, v_num=0]
Epoch 29:   5%|▌         | 5/97 [00:01<00:35,  2.60it/s, loss=3.29, v_num=0]
Epoch 29:   5%|▌         | 5/97 [00:01<00:36,  2.52it/s, loss=3.29, v_num=0]
Epoch 29:   6%|▌         | 6/97 [00:02<00:31,  2.90it/s, loss=3.29, v_num=0]
Epoch 29:   6%|▌         | 6/97 [00:02<00:32,  2.83it/s, loss=3.29, v_num=0]
Epoch 29:   7%|▋         | 7/97 [00:02<00:28,  3.18it/s, loss=3.29, v_num=0]
Epoch 29:   7%|▋         | 7/97 [00:02<00:29,  3.10it/s, loss=3.29, v_num=0]
Epoch 29:   8%|▊         | 8/97 [00:02<00:26,  3.42it/s, loss=3.29, v_num=0]
Epoch 29:   8%|▊         | 8/97 [00:02<00:26,  3.34it/s, loss=3.28, v_num=0]
Epoch 29:   9%|▉         | 9/97 [00:02<00:24,  3.64it/s, loss=3.28, v_num=0]
Epoch 29:   9%|▉         | 9/97 [00:02<00:24,  3.55it/s, loss=3.28, v_num=0]
Epoch 29:  10%|█         | 10/97 [00:02<00:22,  3.81it/s, loss=3.28, v_num=0]
Epoch 29:  10%|█         | 10/97 [00:02<00:23,  3.74it/s, loss=3.28, v_num=0]
Epoch 29:  11%|█▏        | 11/97 [00:02<00:21,  3.99it/s, loss=3.28, v_num=0]
Epoch 29:  11%|█▏        | 11/97 [00:02<00:21,  3.91it/s, loss=3.28, v_num=0]
Epoch 29:  12%|█▏        | 12/97 [00:02<00:20,  4.15it/s, loss=3.28, v_num=0]
Epoch 29:  12%|█▏        | 12/97 [00:02<00:20,  4.07it/s, loss=3.29, v_num=0]
Epoch 29:  13%|█▎        | 13/97 [00:03<00:19,  4.29it/s, loss=3.29, v_num=0]
Epoch 29:  13%|█▎        | 13/97 [00:03<00:19,  4.22it/s, loss=3.28, v_num=0]
Epoch 29:  14%|█▍        | 14/97 [00:03<00:18,  4.43it/s, loss=3.28, v_num=0]
Epoch 29:  14%|█▍        | 14/97 [00:03<00:19,  4.35it/s, loss=3.28, v_num=0]
Epoch 29:  15%|█▌        | 15/97 [00:03<00:18,  4.55it/s, loss=3.28, v_num=0]
Epoch 29:  15%|█▌        | 15/97 [00:03<00:18,  4.47it/s, loss=3.28, v_num=0]
Epoch 29:  16%|█▋        | 16/97 [00:03<00:17,  4.66it/s, loss=3.28, v_num=0]
Epoch 29:  16%|█▋        | 16/97 [00:03<00:17,  4.59it/s, loss=3.28, v_num=0]
Epoch 29:  18%|█▊        | 17/97 [00:03<00:16,  4.76it/s, loss=3.28, v_num=0]
Epoch 29:  18%|█▊        | 17/97 [00:03<00:17,  4.68it/s, loss=3.27, v_num=0]
Epoch 29:  19%|█▊        | 18/97 [00:03<00:16,  4.85it/s, loss=3.27, v_num=0]
Epoch 29:  19%|█▊        | 18/97 [00:03<00:16,  4.78it/s, loss=3.28, v_num=0]
Epoch 29:  20%|█▉        | 19/97 [00:03<00:15,  4.94it/s, loss=3.28, v_num=0]
Epoch 29:  20%|█▉        | 19/97 [00:03<00:16,  4.87it/s, loss=3.27, v_num=0]
Epoch 29:  21%|██        | 20/97 [00:03<00:15,  5.02it/s, loss=3.27, v_num=0]
Epoch 29:  21%|██        | 20/97 [00:04<00:15,  4.95it/s, loss=3.27, v_num=0]
Epoch 29:  22%|██▏       | 21/97 [00:04<00:14,  5.10it/s, loss=3.27, v_num=0]
Epoch 29:  22%|██▏       | 21/97 [00:04<00:15,  5.03it/s, loss=3.27, v_num=0]
Epoch 29:  23%|██▎       | 22/97 [00:04<00:14,  5.17it/s, loss=3.27, v_num=0]
Epoch 29:  23%|██▎       | 22/97 [00:04<00:14,  5.10it/s, loss=3.27, v_num=0]
Epoch 29:  24%|██▎       | 23/97 [00:04<00:14,  5.24it/s, loss=3.27, v_num=0]
Epoch 29:  24%|██▎       | 23/97 [00:04<00:14,  5.17it/s, loss=3.26, v_num=0]
Epoch 29:  25%|██▍       | 24/97 [00:04<00:13,  5.29it/s, loss=3.26, v_num=0]
Epoch 29:  25%|██▍       | 24/97 [00:04<00:13,  5.23it/s, loss=3.27, v_num=0]
Epoch 29:  26%|██▌       | 25/97 [00:04<00:13,  5.35it/s, loss=3.27, v_num=0]
Epoch 29:  26%|██▌       | 25/97 [00:04<00:13,  5.29it/s, loss=3.26, v_num=0]
Epoch 29:  27%|██▋       | 26/97 [00:04<00:13,  5.40it/s, loss=3.26, v_num=0]
Epoch 29:  27%|██▋       | 26/97 [00:04<00:13,  5.34it/s, loss=3.24, v_num=0]
Epoch 29:  28%|██▊       | 27/97 [00:04<00:12,  5.46it/s, loss=3.24, v_num=0]
Epoch 29:  28%|██▊       | 27/97 [00:05<00:12,  5.40it/s, loss=3.25, v_num=0]
Epoch 29:  29%|██▉       | 28/97 [00:05<00:12,  5.51it/s, loss=3.25, v_num=0]
Epoch 29:  29%|██▉       | 28/97 [00:05<00:12,  5.45it/s, loss=3.25, v_num=0]
Epoch 29:  30%|██▉       | 29/97 [00:05<00:12,  5.56it/s, loss=3.25, v_num=0]
Epoch 29:  30%|██▉       | 29/97 [00:05<00:12,  5.50it/s, loss=3.25, v_num=0]
Epoch 29:  31%|███       | 30/97 [00:05<00:11,  5.60it/s, loss=3.25, v_num=0]
Epoch 29:  31%|███       | 30/97 [00:05<00:12,  5.54it/s, loss=3.25, v_num=0]
Epoch 29:  32%|███▏      | 31/97 [00:05<00:11,  5.65it/s, loss=3.25, v_num=0]
Epoch 29:  32%|███▏      | 31/97 [00:05<00:11,  5.59it/s, loss=3.25, v_num=0]
Epoch 29:  33%|███▎      | 32/97 [00:05<00:11,  5.69it/s, loss=3.25, v_num=0]
Epoch 29:  33%|███▎      | 32/97 [00:05<00:11,  5.63it/s, loss=3.25, v_num=0]
Epoch 29:  34%|███▍      | 33/97 [00:05<00:11,  5.73it/s, loss=3.25, v_num=0]
Epoch 29:  34%|███▍      | 33/97 [00:05<00:11,  5.67it/s, loss=3.25, v_num=0]
Epoch 29:  35%|███▌      | 34/97 [00:05<00:10,  5.76it/s, loss=3.25, v_num=0]
Epoch 29:  35%|███▌      | 34/97 [00:05<00:11,  5.71it/s, loss=3.25, v_num=0]
Epoch 29:  36%|███▌      | 35/97 [00:06<00:10,  5.80it/s, loss=3.25, v_num=0]
Epoch 29:  36%|███▌      | 35/97 [00:06<00:10,  5.74it/s, loss=3.24, v_num=0]
Epoch 29:  37%|███▋      | 36/97 [00:06<00:10,  5.83it/s, loss=3.24, v_num=0]
Epoch 29:  37%|███▋      | 36/97 [00:06<00:10,  5.78it/s, loss=3.24, v_num=0]
Epoch 29:  38%|███▊      | 37/97 [00:06<00:10,  5.86it/s, loss=3.24, v_num=0]
Epoch 29:  38%|███▊      | 37/97 [00:06<00:10,  5.81it/s, loss=3.25, v_num=0]
Epoch 29:  39%|███▉      | 38/97 [00:06<00:10,  5.89it/s, loss=3.25, v_num=0]
Epoch 29:  39%|███▉      | 38/97 [00:06<00:10,  5.84it/s, loss=3.25, v_num=0]
Epoch 29:  40%|████      | 39/97 [00:06<00:09,  5.92it/s, loss=3.25, v_num=0]
Epoch 29:  40%|████      | 39/97 [00:06<00:09,  5.87it/s, loss=3.25, v_num=0]
Epoch 29:  41%|████      | 40/97 [00:06<00:09,  5.95it/s, loss=3.25, v_num=0]
Epoch 29:  41%|████      | 40/97 [00:06<00:09,  5.90it/s, loss=3.25, v_num=0]
Epoch 29:  42%|████▏     | 41/97 [00:06<00:09,  5.97it/s, loss=3.25, v_num=0]
Epoch 29:  42%|████▏     | 41/97 [00:06<00:09,  5.93it/s, loss=3.24, v_num=0]
Epoch 29:  43%|████▎     | 42/97 [00:06<00:09,  6.00it/s, loss=3.24, v_num=0]
Epoch 29:  43%|████▎     | 42/97 [00:07<00:09,  5.95it/s, loss=3.24, v_num=0]
Epoch 29:  44%|████▍     | 43/97 [00:07<00:08,  6.03it/s, loss=3.24, v_num=0]
Epoch 29:  44%|████▍     | 43/97 [00:07<00:09,  5.98it/s, loss=3.25, v_num=0]
Epoch 29:  45%|████▌     | 44/97 [00:07<00:08,  6.05it/s, loss=3.25, v_num=0]
Epoch 29:  45%|████▌     | 44/97 [00:07<00:08,  6.00it/s, loss=3.24, v_num=0]
Epoch 29:  46%|████▋     | 45/97 [00:07<00:08,  6.07it/s, loss=3.24, v_num=0]
Epoch 29:  46%|████▋     | 45/97 [00:07<00:08,  6.02it/s, loss=3.24, v_num=0]
Epoch 29:  47%|████▋     | 46/97 [00:07<00:08,  6.09it/s, loss=3.24, v_num=0]
Epoch 29:  47%|████▋     | 46/97 [00:07<00:08,  6.04it/s, loss=3.24, v_num=0]
Epoch 29:  48%|████▊     | 47/97 [00:07<00:08,  6.11it/s, loss=3.24, v_num=0]
Epoch 29:  48%|████▊     | 47/97 [00:07<00:08,  6.07it/s, loss=3.23, v_num=0]
Epoch 29:  49%|████▉     | 48/97 [00:07<00:07,  6.13it/s, loss=3.23, v_num=0]
Epoch 29:  49%|████▉     | 48/97 [00:07<00:08,  6.09it/s, loss=3.24, v_num=0]
Epoch 29:  51%|█████     | 49/97 [00:07<00:07,  6.15it/s, loss=3.24, v_num=0]
Epoch 29:  51%|█████     | 49/97 [00:08<00:07,  6.11it/s, loss=3.24, v_num=0]
Epoch 29:  52%|█████▏    | 50/97 [00:08<00:07,  6.17it/s, loss=3.24, v_num=0]
Epoch 29:  52%|█████▏    | 50/97 [00:08<00:07,  6.13it/s, loss=3.24, v_num=0]
Epoch 29:  53%|█████▎    | 51/97 [00:08<00:07,  6.19it/s, loss=3.24, v_num=0]
Epoch 29:  53%|█████▎    | 51/97 [00:08<00:07,  6.15it/s, loss=3.23, v_num=0]
Epoch 29:  54%|█████▎    | 52/97 [00:08<00:07,  6.21it/s, loss=3.23, v_num=0]
Epoch 29:  54%|█████▎    | 52/97 [00:08<00:07,  6.17it/s, loss=3.23, v_num=0]
Epoch 29:  55%|█████▍    | 53/97 [00:08<00:07,  6.22it/s, loss=3.23, v_num=0]
Epoch 29:  55%|█████▍    | 53/97 [00:08<00:07,  6.18it/s, loss=3.22, v_num=0]
Epoch 29:  56%|█████▌    | 54/97 [00:08<00:06,  6.24it/s, loss=3.22, v_num=0]
Epoch 29:  56%|█████▌    | 54/97 [00:08<00:06,  6.20it/s, loss=3.22, v_num=0]
Epoch 29:  57%|█████▋    | 55/97 [00:08<00:06,  6.25it/s, loss=3.22, v_num=0]
Epoch 29:  57%|█████▋    | 55/97 [00:08<00:06,  6.22it/s, loss=3.22, v_num=0]
Epoch 29:  58%|█████▊    | 56/97 [00:08<00:06,  6.27it/s, loss=3.22, v_num=0]
Epoch 29:  58%|█████▊    | 56/97 [00:08<00:06,  6.23it/s, loss=3.22, v_num=0]
Epoch 29:  59%|█████▉    | 57/97 [00:09<00:06,  6.28it/s, loss=3.22, v_num=0]
Epoch 29:  59%|█████▉    | 57/97 [00:09<00:06,  6.24it/s, loss=3.22, v_num=0]
Epoch 29:  60%|█████▉    | 58/97 [00:09<00:06,  6.30it/s, loss=3.22, v_num=0]
Epoch 29:  60%|█████▉    | 58/97 [00:09<00:06,  6.26it/s, loss=3.21, v_num=0]
Epoch 29:  61%|██████    | 59/97 [00:09<00:06,  6.31it/s, loss=3.21, v_num=0]
Epoch 29:  61%|██████    | 59/97 [00:09<00:06,  6.27it/s, loss=3.22, v_num=0]
Epoch 29:  62%|██████▏   | 60/97 [00:09<00:05,  6.32it/s, loss=3.22, v_num=0]
Epoch 29:  62%|██████▏   | 60/97 [00:09<00:05,  6.29it/s, loss=3.22, v_num=0]
Epoch 29:  63%|██████▎   | 61/97 [00:09<00:05,  6.34it/s, loss=3.22, v_num=0]
Epoch 29:  63%|██████▎   | 61/97 [00:09<00:05,  6.30it/s, loss=3.22, v_num=0]
Epoch 29:  64%|██████▍   | 62/97 [00:09<00:05,  6.35it/s, loss=3.22, v_num=0]
Epoch 29:  64%|██████▍   | 62/97 [00:09<00:05,  6.31it/s, loss=3.21, v_num=0]
Epoch 29:  65%|██████▍   | 63/97 [00:09<00:05,  6.36it/s, loss=3.21, v_num=0]
Epoch 29:  65%|██████▍   | 63/97 [00:09<00:05,  6.33it/s, loss=3.22, v_num=0]
Epoch 29:  66%|██████▌   | 64/97 [00:10<00:05,  6.37it/s, loss=3.22, v_num=0]
Epoch 29:  66%|██████▌   | 64/97 [00:10<00:05,  6.34it/s, loss=3.23, v_num=0]
Epoch 29:  67%|██████▋   | 65/97 [00:10<00:05,  6.39it/s, loss=3.23, v_num=0]
Epoch 29:  67%|██████▋   | 65/97 [00:10<00:05,  6.35it/s, loss=3.23, v_num=0]
Epoch 29:  68%|██████▊   | 66/97 [00:10<00:04,  6.40it/s, loss=3.23, v_num=0]
Epoch 29:  68%|██████▊   | 66/97 [00:10<00:04,  6.36it/s, loss=3.23, v_num=0]
Epoch 29:  69%|██████▉   | 67/97 [00:10<00:04,  6.41it/s, loss=3.23, v_num=0]
Epoch 29:  69%|██████▉   | 67/97 [00:10<00:04,  6.38it/s, loss=3.22, v_num=0]
Epoch 29:  70%|███████   | 68/97 [00:10<00:04,  6.42it/s, loss=3.22, v_num=0]
Epoch 29:  70%|███████   | 68/97 [00:10<00:04,  6.39it/s, loss=3.22, v_num=0]
Epoch 29:  71%|███████   | 69/97 [00:10<00:04,  6.44it/s, loss=3.22, v_num=0]
Epoch 29:  71%|███████   | 69/97 [00:10<00:04,  6.40it/s, loss=3.23, v_num=0]
Epoch 29:  72%|███████▏  | 70/97 [00:10<00:04,  6.44it/s, loss=3.23, v_num=0]
Epoch 29:  72%|███████▏  | 70/97 [00:10<00:04,  6.41it/s, loss=3.24, v_num=0]
Epoch 29:  73%|███████▎  | 71/97 [00:10<00:04,  6.46it/s, loss=3.24, v_num=0]
Epoch 29:  73%|███████▎  | 71/97 [00:11<00:04,  6.42it/s, loss=3.25, v_num=0]
Epoch 29:  74%|███████▍  | 72/97 [00:11<00:03,  6.46it/s, loss=3.25, v_num=0]
Epoch 29:  74%|███████▍  | 72/97 [00:11<00:03,  6.43it/s, loss=3.24, v_num=0]
Epoch 29:  75%|███████▌  | 73/97 [00:11<00:03,  6.48it/s, loss=3.24, v_num=0]
Epoch 29:  75%|███████▌  | 73/97 [00:11<00:03,  6.44it/s, loss=3.25, v_num=0]
Epoch 29:  76%|███████▋  | 74/97 [00:11<00:03,  6.48it/s, loss=3.25, v_num=0]
Epoch 29:  76%|███████▋  | 74/97 [00:11<00:03,  6.45it/s, loss=3.25, v_num=0]
Epoch 29:  77%|███████▋  | 75/97 [00:11<00:03,  6.49it/s, loss=3.25, v_num=0]
Epoch 29:  77%|███████▋  | 75/97 [00:11<00:03,  6.46it/s, loss=3.25, v_num=0]
Epoch 29:  78%|███████▊  | 76/97 [00:11<00:03,  6.50it/s, loss=3.25, v_num=0]
Epoch 29:  78%|███████▊  | 76/97 [00:11<00:03,  6.47it/s, loss=3.25, v_num=0]
Epoch 29:  79%|███████▉  | 77/97 [00:11<00:03,  6.51it/s, loss=3.25, v_num=0]
Epoch 29:  79%|███████▉  | 77/97 [00:11<00:03,  6.48it/s, loss=3.26, v_num=0]
Epoch 29:  80%|████████  | 78/97 [00:11<00:02,  6.52it/s, loss=3.26, v_num=0]
Epoch 29:  80%|████████  | 78/97 [00:12<00:02,  6.49it/s, loss=3.25, v_num=0]
Epoch 29:  81%|████████▏ | 79/97 [00:12<00:02,  6.53it/s, loss=3.25, v_num=0]
Epoch 29:  81%|████████▏ | 79/97 [00:12<00:02,  6.50it/s, loss=3.24, v_num=0]
Epoch 29:  82%|████████▏ | 80/97 [00:12<00:02,  6.54it/s, loss=3.24, v_num=0]
Epoch 29:  82%|████████▏ | 80/97 [00:12<00:02,  6.51it/s, loss=3.24, v_num=0]
Epoch 29:  84%|████████▎ | 81/97 [00:12<00:02,  6.54it/s, loss=3.24, v_num=0]
Epoch 29:  84%|████████▎ | 81/97 [00:12<00:02,  6.51it/s, loss=3.25, v_num=0]
Epoch 29:  85%|████████▍ | 82/97 [00:12<00:02,  6.55it/s, loss=3.25, v_num=0]
Epoch 29:  85%|████████▍ | 82/97 [00:12<00:02,  6.52it/s, loss=3.25, v_num=0]
Epoch 29:  86%|████████▌ | 83/97 [00:12<00:02,  6.56it/s, loss=3.25, v_num=0]
Epoch 29:  86%|████████▌ | 83/97 [00:12<00:02,  6.53it/s, loss=3.25, v_num=0]
Epoch 29:  87%|████████▋ | 84/97 [00:12<00:01,  6.57it/s, loss=3.25, v_num=0]
Epoch 29:  87%|████████▋ | 84/97 [00:12<00:01,  6.54it/s, loss=3.25, v_num=0]
Epoch 29:  88%|████████▊ | 85/97 [00:12<00:01,  6.57it/s, loss=3.25, v_num=0]
Epoch 29:  88%|████████▊ | 85/97 [00:12<00:01,  6.54it/s, loss=3.25, v_num=0]
Epoch 29:  89%|████████▊ | 86/97 [00:13<00:01,  6.58it/s, loss=3.25, v_num=0]
Epoch 29:  89%|████████▊ | 86/97 [00:13<00:01,  6.55it/s, loss=3.25, v_num=0]
Epoch 29:  90%|████████▉ | 87/97 [00:13<00:01,  6.59it/s, loss=3.25, v_num=0]
Epoch 29:  90%|████████▉ | 87/97 [00:13<00:01,  6.56it/s, loss=3.25, v_num=0]
Epoch 29:  91%|█████████ | 88/97 [00:13<00:01,  6.60it/s, loss=3.25, v_num=0]
Epoch 29:  91%|█████████ | 88/97 [00:13<00:01,  6.57it/s, loss=3.26, v_num=0]
Epoch 29:  92%|█████████▏| 89/97 [00:13<00:01,  6.60it/s, loss=3.26, v_num=0]
Epoch 29:  92%|█████████▏| 89/97 [00:13<00:01,  6.58it/s, loss=3.25, v_num=0]
Epoch 29:  93%|█████████▎| 90/97 [00:13<00:01,  6.61it/s, loss=3.25, v_num=0]
Epoch 29:  93%|█████████▎| 90/97 [00:13<00:01,  6.58it/s, loss=3.24, v_num=0]
Epoch 29:  94%|█████████▍| 91/97 [00:13<00:00,  6.62it/s, loss=3.24, v_num=0]
Epoch 29:  94%|█████████▍| 91/97 [00:13<00:00,  6.59it/s, loss=3.24, v_num=0]
Epoch 29:  95%|█████████▍| 92/97 [00:13<00:00,  6.63it/s, loss=3.24, v_num=0]
Epoch 29:  95%|█████████▍| 92/97 [00:13<00:00,  6.60it/s, loss=3.25, v_num=0]
Epoch 29:  96%|█████████▌| 93/97 [00:14<00:00,  6.63it/s, loss=3.25, v_num=0]
Epoch 29:  96%|█████████▌| 93/97 [00:14<00:00,  6.60it/s, loss=3.24, v_num=0]
Epoch 29:  97%|█████████▋| 94/97 [00:14<00:00,  6.64it/s, loss=3.24, v_num=0]
Epoch 29:  97%|█████████▋| 94/97 [00:14<00:00,  6.61it/s, loss=3.24, v_num=0]
Epoch 29:  98%|█████████▊| 95/97 [00:14<00:00,  6.64it/s, loss=3.24, v_num=0]
Epoch 29:  98%|█████████▊| 95/97 [00:14<00:00,  6.62it/s, loss=3.24, v_num=0]
Epoch 29:  99%|█████████▉| 96/97 [00:14<00:00,  6.65it/s, loss=3.24, v_num=0]
Epoch 29:  99%|█████████▉| 96/97 [00:14<00:00,  6.62it/s, loss=3.24, v_num=0]
Epoch 29: 100%|██████████| 97/97 [00:14<00:00,  6.66it/s, loss=3.24, v_num=0]
Epoch 29: 100%|██████████| 97/97 [00:14<00:00,  6.63it/s, loss=3.23, v_num=0]
Epoch 29: 100%|██████████| 97/97 [00:14<00:00,  6.63it/s, loss=3.23, v_num=0]
Epoch 29:   0%|          | 0/97 [00:00<?, ?it/s, loss=3.23, v_num=0]
Epoch 30:   0%|          | 0/97 [00:00<?, ?it/s, loss=3.23, v_num=0]
Epoch 30:   1%|          | 1/97 [00:01<02:14,  1.40s/it, loss=3.23, v_num=0]
Epoch 30:   1%|          | 1/97 [00:01<02:19,  1.45s/it, loss=3.24, v_num=0]
Epoch 30:   2%|▏         | 2/97 [00:01<01:12,  1.31it/s, loss=3.24, v_num=0]
Epoch 30:   2%|▏         | 2/97 [00:01<01:15,  1.26it/s, loss=3.24, v_num=0]
Epoch 30:   3%|▎         | 3/97 [00:01<00:52,  1.79it/s, loss=3.24, v_num=0]
Epoch 30:   3%|▎         | 3/97 [00:01<00:54,  1.74it/s, loss=3.24, v_num=0]
Epoch 30:   4%|▍         | 4/97 [00:01<00:41,  2.22it/s, loss=3.24, v_num=0]
Epoch 30:   4%|▍         | 4/97 [00:01<00:43,  2.15it/s, loss=3.23, v_num=0]
Epoch 30:   5%|▌         | 5/97 [00:01<00:35,  2.57it/s, loss=3.23, v_num=0]
Epoch 30:   5%|▌         | 5/97 [00:01<00:36,  2.50it/s, loss=3.23, v_num=0]
Epoch 30:   6%|▌         | 6/97 [00:02<00:31,  2.89it/s, loss=3.23, v_num=0]
Epoch 30:   6%|▌         | 6/97 [00:02<00:32,  2.81it/s, loss=3.23, v_num=0]
Epoch 30:   7%|▋         | 7/97 [00:02<00:28,  3.16it/s, loss=3.23, v_num=0]
Epoch 30:   7%|▋         | 7/97 [00:02<00:29,  3.08it/s, loss=3.22, v_num=0]
Epoch 30:   8%|▊         | 8/97 [00:02<00:26,  3.41it/s, loss=3.22, v_num=0]
Epoch 30:   8%|▊         | 8/97 [00:02<00:26,  3.32it/s, loss=3.22, v_num=0]
Epoch 30:   9%|▉         | 9/97 [00:02<00:24,  3.60it/s, loss=3.22, v_num=0]
Epoch 30:   9%|▉         | 9/97 [00:02<00:24,  3.52it/s, loss=3.22, v_num=0]
Epoch 30:  10%|█         | 10/97 [00:02<00:22,  3.80it/s, loss=3.22, v_num=0]
Epoch 30:  10%|█         | 10/97 [00:02<00:23,  3.71it/s, loss=3.22, v_num=0]
Epoch 30:  11%|█▏        | 11/97 [00:02<00:21,  3.97it/s, loss=3.22, v_num=0]
Epoch 30:  11%|█▏        | 11/97 [00:02<00:22,  3.89it/s, loss=3.21, v_num=0]
Epoch 30:  12%|█▏        | 12/97 [00:02<00:20,  4.13it/s, loss=3.21, v_num=0]
Epoch 30:  12%|█▏        | 12/97 [00:02<00:20,  4.05it/s, loss=3.2, v_num=0]
Epoch 30:  13%|█▎        | 13/97 [00:03<00:19,  4.27it/s, loss=3.2, v_num=0]
Epoch 30:  13%|█▎        | 13/97 [00:03<00:20,  4.20it/s, loss=3.2, v_num=0]
Epoch 30:  14%|█▍        | 14/97 [00:03<00:18,  4.41it/s, loss=3.2, v_num=0]
Epoch 30:  14%|█▍        | 14/97 [00:03<00:19,  4.33it/s, loss=3.2, v_num=0]
Epoch 30:  15%|█▌        | 15/97 [00:03<00:18,  4.52it/s, loss=3.2, v_num=0]
Epoch 30:  15%|█▌        | 15/97 [00:03<00:18,  4.45it/s, loss=3.2, v_num=0]
Epoch 30:  16%|█▋        | 16/97 [00:03<00:17,  4.64it/s, loss=3.2, v_num=0]
Epoch 30:  16%|█▋        | 16/97 [00:03<00:17,  4.56it/s, loss=3.2, v_num=0]
Epoch 30:  18%|█▊        | 17/97 [00:03<00:16,  4.74it/s, loss=3.2, v_num=0]
Epoch 30:  18%|█▊        | 17/97 [00:03<00:17,  4.66it/s, loss=3.2, v_num=0]
Epoch 30:  19%|█▊        | 18/97 [00:03<00:16,  4.83it/s, loss=3.2, v_num=0]
Epoch 30:  19%|█▊        | 18/97 [00:03<00:16,  4.76it/s, loss=3.2, v_num=0]
Epoch 30:  20%|█▉        | 19/97 [00:03<00:15,  4.92it/s, loss=3.2, v_num=0]
Epoch 30:  20%|█▉        | 19/97 [00:03<00:16,  4.85it/s, loss=3.19, v_num=0]
Epoch 30:  21%|██        | 20/97 [00:03<00:15,  5.01it/s, loss=3.19, v_num=0]
Epoch 30:  21%|██        | 20/97 [00:04<00:15,  4.94it/s, loss=3.18, v_num=0]
Epoch 30:  22%|██▏       | 21/97 [00:04<00:14,  5.08it/s, loss=3.18, v_num=0]
Epoch 30:  22%|██▏       | 21/97 [00:04<00:15,  5.02it/s, loss=3.18, v_num=0]
Epoch 30:  23%|██▎       | 22/97 [00:04<00:14,  5.15it/s, loss=3.18, v_num=0]
Epoch 30:  23%|██▎       | 22/97 [00:04<00:14,  5.08it/s, loss=3.17, v_num=0]
Epoch 30:  24%|██▎       | 23/97 [00:04<00:14,  5.22it/s, loss=3.17, v_num=0]
Epoch 30:  24%|██▎       | 23/97 [00:04<00:14,  5.15it/s, loss=3.17, v_num=0]
Epoch 30:  25%|██▍       | 24/97 [00:04<00:13,  5.28it/s, loss=3.17, v_num=0]
Epoch 30:  25%|██▍       | 24/97 [00:04<00:13,  5.22it/s, loss=3.17, v_num=0]
Epoch 30:  26%|██▌       | 25/97 [00:04<00:13,  5.34it/s, loss=3.17, v_num=0]
Epoch 30:  26%|██▌       | 25/97 [00:04<00:13,  5.28it/s, loss=3.17, v_num=0]
Epoch 30:  27%|██▋       | 26/97 [00:04<00:13,  5.40it/s, loss=3.17, v_num=0]
Epoch 30:  27%|██▋       | 26/97 [00:04<00:13,  5.33it/s, loss=3.16, v_num=0]
Epoch 30:  28%|██▊       | 27/97 [00:04<00:12,  5.45it/s, loss=3.16, v_num=0]
Epoch 30:  28%|██▊       | 27/97 [00:05<00:12,  5.39it/s, loss=3.17, v_num=0]
Epoch 30:  29%|██▉       | 28/97 [00:05<00:12,  5.50it/s, loss=3.17, v_num=0]
Epoch 30:  29%|██▉       | 28/97 [00:05<00:12,  5.44it/s, loss=3.16, v_num=0]
Epoch 30:  30%|██▉       | 29/97 [00:05<00:12,  5.55it/s, loss=3.16, v_num=0]
Epoch 30:  30%|██▉       | 29/97 [00:05<00:12,  5.49it/s, loss=3.17, v_num=0]
Epoch 30:  31%|███       | 30/97 [00:05<00:11,  5.59it/s, loss=3.17, v_num=0]
Epoch 30:  31%|███       | 30/97 [00:05<00:12,  5.54it/s, loss=3.17, v_num=0]
Epoch 30:  32%|███▏      | 31/97 [00:05<00:11,  5.64it/s, loss=3.17, v_num=0]
Epoch 30:  32%|███▏      | 31/97 [00:05<00:11,  5.58it/s, loss=3.17, v_num=0]
Epoch 30:  33%|███▎      | 32/97 [00:05<00:11,  5.68it/s, loss=3.17, v_num=0]
Epoch 30:  33%|███▎      | 32/97 [00:05<00:11,  5.62it/s, loss=3.17, v_num=0]
Epoch 30:  34%|███▍      | 33/97 [00:05<00:11,  5.71it/s, loss=3.17, v_num=0]
Epoch 30:  34%|███▍      | 33/97 [00:05<00:11,  5.66it/s, loss=3.18, v_num=0]
Epoch 30:  35%|███▌      | 34/97 [00:05<00:10,  5.75it/s, loss=3.18, v_num=0]
Epoch 30:  35%|███▌      | 34/97 [00:05<00:11,  5.70it/s, loss=3.17, v_num=0]
Epoch 30:  36%|███▌      | 35/97 [00:06<00:10,  5.79it/s, loss=3.17, v_num=0]
Epoch 30:  36%|███▌      | 35/97 [00:06<00:10,  5.74it/s, loss=3.18, v_num=0]
Epoch 30:  37%|███▋      | 36/97 [00:06<00:10,  5.82it/s, loss=3.18, v_num=0]
Epoch 30:  37%|███▋      | 36/97 [00:06<00:10,  5.77it/s, loss=3.18, v_num=0]
Epoch 30:  38%|███▊      | 37/97 [00:06<00:10,  5.85it/s, loss=3.18, v_num=0]
Epoch 30:  38%|███▊      | 37/97 [00:06<00:10,  5.80it/s, loss=3.18, v_num=0]
Epoch 30:  39%|███▉      | 38/97 [00:06<00:10,  5.89it/s, loss=3.18, v_num=0]
Epoch 30:  39%|███▉      | 38/97 [00:06<00:10,  5.84it/s, loss=3.17, v_num=0]
Epoch 30:  40%|████      | 39/97 [00:06<00:09,  5.92it/s, loss=3.17, v_num=0]
Epoch 30:  40%|████      | 39/97 [00:06<00:09,  5.87it/s, loss=3.18, v_num=0]
Epoch 30:  41%|████      | 40/97 [00:06<00:09,  5.94it/s, loss=3.18, v_num=0]
Epoch 30:  41%|████      | 40/97 [00:06<00:09,  5.90it/s, loss=3.19, v_num=0]
Epoch 30:  42%|████▏     | 41/97 [00:06<00:09,  5.97it/s, loss=3.19, v_num=0]
Epoch 30:  42%|████▏     | 41/97 [00:06<00:09,  5.92it/s, loss=3.2, v_num=0]
Epoch 30:  43%|████▎     | 42/97 [00:07<00:09,  6.00it/s, loss=3.2, v_num=0]
Epoch 30:  43%|████▎     | 42/97 [00:07<00:09,  5.95it/s, loss=3.2, v_num=0]
Epoch 30:  44%|████▍     | 43/97 [00:07<00:08,  6.02it/s, loss=3.2, v_num=0]
Epoch 30:  44%|████▍     | 43/97 [00:07<00:09,  5.98it/s, loss=3.2, v_num=0]
Epoch 30:  45%|████▌     | 44/97 [00:07<00:08,  6.05it/s, loss=3.2, v_num=0]
Epoch 30:  45%|████▌     | 44/97 [00:07<00:08,  6.00it/s, loss=3.2, v_num=0]
Epoch 30:  46%|████▋     | 45/97 [00:07<00:08,  6.07it/s, loss=3.2, v_num=0]
Epoch 30:  46%|████▋     | 45/97 [00:07<00:08,  6.02it/s, loss=3.21, v_num=0]
Epoch 30:  47%|████▋     | 46/97 [00:07<00:08,  6.09it/s, loss=3.21, v_num=0]
Epoch 30:  47%|████▋     | 46/97 [00:07<00:08,  6.05it/s, loss=3.21, v_num=0]
Epoch 30:  48%|████▊     | 47/97 [00:07<00:08,  6.11it/s, loss=3.21, v_num=0]
Epoch 30:  48%|████▊     | 47/97 [00:07<00:08,  6.07it/s, loss=3.22, v_num=0]
Epoch 30:  49%|████▉     | 48/97 [00:07<00:07,  6.14it/s, loss=3.22, v_num=0]
Epoch 30:  49%|████▉     | 48/97 [00:07<00:08,  6.09it/s, loss=3.21, v_num=0]
Epoch 30:  51%|█████     | 49/97 [00:07<00:07,  6.16it/s, loss=3.21, v_num=0]
Epoch 30:  51%|█████     | 49/97 [00:08<00:07,  6.11it/s, loss=3.2, v_num=0]
Epoch 30:  52%|█████▏    | 50/97 [00:08<00:07,  6.18it/s, loss=3.2, v_num=0]
Epoch 30:  52%|█████▏    | 50/97 [00:08<00:07,  6.13it/s, loss=3.21, v_num=0]
Epoch 30:  53%|█████▎    | 51/97 [00:08<00:07,  6.19it/s, loss=3.21, v_num=0]
Epoch 30:  53%|█████▎    | 51/97 [00:08<00:07,  6.15it/s, loss=3.21, v_num=0]
Epoch 30:  54%|█████▎    | 52/97 [00:08<00:07,  6.21it/s, loss=3.21, v_num=0]
Epoch 30:  54%|█████▎    | 52/97 [00:08<00:07,  6.17it/s, loss=3.21, v_num=0]
Epoch 30:  55%|█████▍    | 53/97 [00:08<00:07,  6.23it/s, loss=3.21, v_num=0]
Epoch 30:  55%|█████▍    | 53/97 [00:08<00:07,  6.19it/s, loss=3.2, v_num=0]
Epoch 30:  56%|█████▌    | 54/97 [00:08<00:06,  6.25it/s, loss=3.2, v_num=0]
Epoch 30:  56%|█████▌    | 54/97 [00:08<00:06,  6.21it/s, loss=3.21, v_num=0]
Epoch 30:  57%|█████▋    | 55/97 [00:08<00:06,  6.26it/s, loss=3.21, v_num=0]
Epoch 30:  57%|█████▋    | 55/97 [00:08<00:06,  6.22it/s, loss=3.2, v_num=0]
Epoch 30:  58%|█████▊    | 56/97 [00:08<00:06,  6.28it/s, loss=3.2, v_num=0]
Epoch 30:  58%|█████▊    | 56/97 [00:08<00:06,  6.24it/s, loss=3.21, v_num=0]
Epoch 30:  59%|█████▉    | 57/97 [00:09<00:06,  6.29it/s, loss=3.21, v_num=0]
Epoch 30:  59%|█████▉    | 57/97 [00:09<00:06,  6.25it/s, loss=3.21, v_num=0]
Epoch 30:  60%|█████▉    | 58/97 [00:09<00:06,  6.31it/s, loss=3.21, v_num=0]
Epoch 30:  60%|█████▉    | 58/97 [00:09<00:06,  6.27it/s, loss=3.21, v_num=0]
Epoch 30:  61%|██████    | 59/97 [00:09<00:06,  6.32it/s, loss=3.21, v_num=0]
Epoch 30:  61%|██████    | 59/97 [00:09<00:06,  6.28it/s, loss=3.21, v_num=0]
Epoch 30:  62%|██████▏   | 60/97 [00:09<00:05,  6.33it/s, loss=3.21, v_num=0]
Epoch 30:  62%|██████▏   | 60/97 [00:09<00:05,  6.30it/s, loss=3.2, v_num=0]
Epoch 30:  63%|██████▎   | 61/97 [00:09<00:05,  6.35it/s, loss=3.2, v_num=0]
Epoch 30:  63%|██████▎   | 61/97 [00:09<00:05,  6.31it/s, loss=3.2, v_num=0]
Epoch 30:  64%|██████▍   | 62/97 [00:09<00:05,  6.36it/s, loss=3.2, v_num=0]
Epoch 30:  64%|██████▍   | 62/97 [00:09<00:05,  6.33it/s, loss=3.21, v_num=0]
Epoch 30:  65%|██████▍   | 63/97 [00:09<00:05,  6.37it/s, loss=3.21, v_num=0]
Epoch 30:  65%|██████▍   | 63/97 [00:09<00:05,  6.34it/s, loss=3.21, v_num=0]
Epoch 30:  66%|██████▌   | 64/97 [00:10<00:05,  6.38it/s, loss=3.21, v_num=0]
Epoch 30:  66%|██████▌   | 64/97 [00:10<00:05,  6.35it/s, loss=3.22, v_num=0]
Epoch 30:  67%|██████▋   | 65/97 [00:10<00:05,  6.40it/s, loss=3.22, v_num=0]
Epoch 30:  67%|██████▋   | 65/97 [00:10<00:05,  6.36it/s, loss=3.22, v_num=0]
Epoch 30:  68%|██████▊   | 66/97 [00:10<00:04,  6.41it/s, loss=3.22, v_num=0]
Epoch 30:  68%|██████▊   | 66/97 [00:10<00:04,  6.37it/s, loss=3.22, v_num=0]
Epoch 30:  69%|██████▉   | 67/97 [00:10<00:04,  6.42it/s, loss=3.22, v_num=0]
Epoch 30:  69%|██████▉   | 67/97 [00:10<00:04,  6.39it/s, loss=3.21, v_num=0]
Epoch 30:  70%|███████   | 68/97 [00:10<00:04,  6.43it/s, loss=3.21, v_num=0]
Epoch 30:  70%|███████   | 68/97 [00:10<00:04,  6.40it/s, loss=3.22, v_num=0]
Epoch 30:  71%|███████   | 69/97 [00:10<00:04,  6.44it/s, loss=3.22, v_num=0]
Epoch 30:  71%|███████   | 69/97 [00:10<00:04,  6.41it/s, loss=3.22, v_num=0]
Epoch 30:  72%|███████▏  | 70/97 [00:10<00:04,  6.45it/s, loss=3.22, v_num=0]
Epoch 30:  72%|███████▏  | 70/97 [00:10<00:04,  6.42it/s, loss=3.22, v_num=0]
Epoch 30:  73%|███████▎  | 71/97 [00:10<00:04,  6.46it/s, loss=3.22, v_num=0]
Epoch 30:  73%|███████▎  | 71/97 [00:11<00:04,  6.43it/s, loss=3.23, v_num=0]
Epoch 30:  74%|███████▍  | 72/97 [00:11<00:03,  6.47it/s, loss=3.23, v_num=0]
Epoch 30:  74%|███████▍  | 72/97 [00:11<00:03,  6.44it/s, loss=3.22, v_num=0]
Epoch 30:  75%|███████▌  | 73/97 [00:11<00:03,  6.49it/s, loss=3.22, v_num=0]
Epoch 30:  75%|███████▌  | 73/97 [00:11<00:03,  6.45it/s, loss=3.23, v_num=0]
Epoch 30:  76%|███████▋  | 74/97 [00:11<00:03,  6.49it/s, loss=3.23, v_num=0]
Epoch 30:  76%|███████▋  | 74/97 [00:11<00:03,  6.46it/s, loss=3.23, v_num=0]
Epoch 30:  77%|███████▋  | 75/97 [00:11<00:03,  6.50it/s, loss=3.23, v_num=0]
Epoch 30:  77%|███████▋  | 75/97 [00:11<00:03,  6.47it/s, loss=3.23, v_num=0]
Epoch 30:  78%|███████▊  | 76/97 [00:11<00:03,  6.51it/s, loss=3.23, v_num=0]
Epoch 30:  78%|███████▊  | 76/97 [00:11<00:03,  6.48it/s, loss=3.23, v_num=0]
Epoch 30:  79%|███████▉  | 77/97 [00:11<00:03,  6.52it/s, loss=3.23, v_num=0]
Epoch 30:  79%|███████▉  | 77/97 [00:11<00:03,  6.49it/s, loss=3.22, v_num=0]
Epoch 30:  80%|████████  | 78/97 [00:11<00:02,  6.53it/s, loss=3.22, v_num=0]
Epoch 30:  80%|████████  | 78/97 [00:12<00:02,  6.50it/s, loss=3.23, v_num=0]
Epoch 30:  81%|████████▏ | 79/97 [00:12<00:02,  6.53it/s, loss=3.23, v_num=0]
Epoch 30:  81%|████████▏ | 79/97 [00:12<00:02,  6.51it/s, loss=3.23, v_num=0]
Epoch 30:  82%|████████▏ | 80/97 [00:12<00:02,  6.55it/s, loss=3.23, v_num=0]
Epoch 30:  82%|████████▏ | 80/97 [00:12<00:02,  6.51it/s, loss=3.22, v_num=0]
Epoch 30:  84%|████████▎ | 81/97 [00:12<00:02,  6.55it/s, loss=3.22, v_num=0]
Epoch 30:  84%|████████▎ | 81/97 [00:12<00:02,  6.52it/s, loss=3.22, v_num=0]
Epoch 30:  85%|████████▍ | 82/97 [00:12<00:02,  6.56it/s, loss=3.22, v_num=0]
Epoch 30:  85%|████████▍ | 82/97 [00:12<00:02,  6.53it/s, loss=3.22, v_num=0]
Epoch 30:  86%|████████▌ | 83/97 [00:12<00:02,  6.57it/s, loss=3.22, v_num=0]
Epoch 30:  86%|████████▌ | 83/97 [00:12<00:02,  6.54it/s, loss=3.21, v_num=0]
Epoch 30:  87%|████████▋ | 84/97 [00:12<00:01,  6.57it/s, loss=3.21, v_num=0]
Epoch 30:  87%|████████▋ | 84/97 [00:12<00:01,  6.55it/s, loss=3.21, v_num=0]
Epoch 30:  88%|████████▊ | 85/97 [00:12<00:01,  6.58it/s, loss=3.21, v_num=0]
Epoch 30:  88%|████████▊ | 85/97 [00:12<00:01,  6.55it/s, loss=3.2, v_num=0]
Epoch 30:  89%|████████▊ | 86/97 [00:13<00:01,  6.59it/s, loss=3.2, v_num=0]
Epoch 30:  89%|████████▊ | 86/97 [00:13<00:01,  6.56it/s, loss=3.2, v_num=0]
Epoch 30:  90%|████████▉ | 87/97 [00:13<00:01,  6.60it/s, loss=3.2, v_num=0]
Epoch 30:  90%|████████▉ | 87/97 [00:13<00:01,  6.57it/s, loss=3.2, v_num=0]
Epoch 30:  91%|█████████ | 88/97 [00:13<00:01,  6.60it/s, loss=3.2, v_num=0]
Epoch 30:  91%|█████████ | 88/97 [00:13<00:01,  6.58it/s, loss=3.2, v_num=0]
Epoch 30:  92%|█████████▏| 89/97 [00:13<00:01,  6.61it/s, loss=3.2, v_num=0]
Epoch 30:  92%|█████████▏| 89/97 [00:13<00:01,  6.58it/s, loss=3.2, v_num=0]
Epoch 30:  93%|█████████▎| 90/97 [00:13<00:01,  6.62it/s, loss=3.2, v_num=0]
Epoch 30:  93%|█████████▎| 90/97 [00:13<00:01,  6.59it/s, loss=3.2, v_num=0]
Epoch 30:  94%|█████████▍| 91/97 [00:13<00:00,  6.62it/s, loss=3.2, v_num=0]
Epoch 30:  94%|█████████▍| 91/97 [00:13<00:00,  6.60it/s, loss=3.19, v_num=0]
Epoch 30:  95%|█████████▍| 92/97 [00:13<00:00,  6.63it/s, loss=3.19, v_num=0]
Epoch 30:  95%|█████████▍| 92/97 [00:13<00:00,  6.60it/s, loss=3.19, v_num=0]
Epoch 30:  96%|█████████▌| 93/97 [00:14<00:00,  6.64it/s, loss=3.19, v_num=0]
Epoch 30:  96%|█████████▌| 93/97 [00:14<00:00,  6.61it/s, loss=3.19, v_num=0]
Epoch 30:  97%|█████████▋| 94/97 [00:14<00:00,  6.64it/s, loss=3.19, v_num=0]
Epoch 30:  97%|█████████▋| 94/97 [00:14<00:00,  6.62it/s, loss=3.18, v_num=0]
Epoch 30:  98%|█████████▊| 95/97 [00:14<00:00,  6.65it/s, loss=3.18, v_num=0]
Epoch 30:  98%|█████████▊| 95/97 [00:14<00:00,  6.62it/s, loss=3.18, v_num=0]
Epoch 30:  99%|█████████▉| 96/97 [00:14<00:00,  6.66it/s, loss=3.18, v_num=0]
Epoch 30:  99%|█████████▉| 96/97 [00:14<00:00,  6.63it/s, loss=3.18, v_num=0]
Epoch 30: 100%|██████████| 97/97 [00:14<00:00,  6.66it/s, loss=3.18, v_num=0]
Epoch 30: 100%|██████████| 97/97 [00:14<00:00,  6.64it/s, loss=3.18, v_num=0]
Epoch 30: 100%|██████████| 97/97 [00:14<00:00,  6.64it/s, loss=3.18, v_num=0]
Epoch 30:   0%|          | 0/97 [00:00<?, ?it/s, loss=3.18, v_num=0]
Epoch 31:   0%|          | 0/97 [00:00<?, ?it/s, loss=3.18, v_num=0]
Epoch 31:   1%|          | 1/97 [00:01<02:36,  1.63s/it, loss=3.18, v_num=0]
Epoch 31:   1%|          | 1/97 [00:01<02:41,  1.68s/it, loss=3.17, v_num=0]
Epoch 31:   2%|▏         | 2/97 [00:01<01:24,  1.13it/s, loss=3.17, v_num=0]
Epoch 31:   2%|▏         | 2/97 [00:01<01:26,  1.09it/s, loss=3.18, v_num=0]
Epoch 31:   3%|▎         | 3/97 [00:01<01:00,  1.55it/s, loss=3.18, v_num=0]
Epoch 31:   3%|▎         | 3/97 [00:01<01:02,  1.51it/s, loss=3.18, v_num=0]
Epoch 31:   4%|▍         | 4/97 [00:02<00:48,  1.92it/s, loss=3.18, v_num=0]
Epoch 31:   4%|▍         | 4/97 [00:02<00:49,  1.87it/s, loss=3.18, v_num=0]
Epoch 31:   5%|▌         | 5/97 [00:02<00:40,  2.25it/s, loss=3.18, v_num=0]
Epoch 31:   5%|▌         | 5/97 [00:02<00:41,  2.20it/s, loss=3.18, v_num=0]
Epoch 31:   6%|▌         | 6/97 [00:02<00:35,  2.54it/s, loss=3.18, v_num=0]
Epoch 31:   6%|▌         | 6/97 [00:02<00:36,  2.48it/s, loss=3.19, v_num=0]
Epoch 31:   7%|▋         | 7/97 [00:02<00:32,  2.79it/s, loss=3.19, v_num=0]
Epoch 31:   7%|▋         | 7/97 [00:02<00:32,  2.74it/s, loss=3.19, v_num=0]
Epoch 31:   8%|▊         | 8/97 [00:02<00:29,  3.02it/s, loss=3.19, v_num=0]
Epoch 31:   8%|▊         | 8/97 [00:02<00:30,  2.96it/s, loss=3.19, v_num=0]
Epoch 31:   9%|▉         | 9/97 [00:02<00:27,  3.22it/s, loss=3.19, v_num=0]
Epoch 31:   9%|▉         | 9/97 [00:02<00:27,  3.16it/s, loss=3.19, v_num=0]
Epoch 31:  10%|█         | 10/97 [00:02<00:25,  3.41it/s, loss=3.19, v_num=0]
Epoch 31:  10%|█         | 10/97 [00:02<00:26,  3.34it/s, loss=3.2, v_num=0]
Epoch 31:  11%|█▏        | 11/97 [00:03<00:24,  3.57it/s, loss=3.2, v_num=0]
Epoch 31:  11%|█▏        | 11/97 [00:03<00:24,  3.51it/s, loss=3.2, v_num=0]
Epoch 31:  12%|█▏        | 12/97 [00:03<00:22,  3.72it/s, loss=3.2, v_num=0]
Epoch 31:  12%|█▏        | 12/97 [00:03<00:23,  3.66it/s, loss=3.2, v_num=0]
Epoch 31:  13%|█▎        | 13/97 [00:03<00:21,  3.86it/s, loss=3.2, v_num=0]
Epoch 31:  13%|█▎        | 13/97 [00:03<00:22,  3.80it/s, loss=3.21, v_num=0]
Epoch 31:  14%|█▍        | 14/97 [00:03<00:20,  3.99it/s, loss=3.21, v_num=0]
Epoch 31:  14%|█▍        | 14/97 [00:03<00:21,  3.93it/s, loss=3.22, v_num=0]
Epoch 31:  15%|█▌        | 15/97 [00:03<00:19,  4.12it/s, loss=3.22, v_num=0]
Epoch 31:  15%|█▌        | 15/97 [00:03<00:20,  4.05it/s, loss=3.21, v_num=0]
Epoch 31:  16%|█▋        | 16/97 [00:03<00:19,  4.23it/s, loss=3.21, v_num=0]
Epoch 31:  16%|█▋        | 16/97 [00:03<00:19,  4.17it/s, loss=3.21, v_num=0]
Epoch 31:  18%|█▊        | 17/97 [00:03<00:18,  4.34it/s, loss=3.21, v_num=0]
Epoch 31:  18%|█▊        | 17/97 [00:03<00:18,  4.28it/s, loss=3.22, v_num=0]
Epoch 31:  19%|█▊        | 18/97 [00:04<00:17,  4.43it/s, loss=3.22, v_num=0]
Epoch 31:  19%|█▊        | 18/97 [00:04<00:18,  4.37it/s, loss=3.22, v_num=0]
Epoch 31:  20%|█▉        | 19/97 [00:04<00:17,  4.50it/s, loss=3.22, v_num=0]
Epoch 31:  20%|█▉        | 19/97 [00:04<00:17,  4.45it/s, loss=3.22, v_num=0]
Epoch 31:  21%|██        | 20/97 [00:04<00:16,  4.59it/s, loss=3.22, v_num=0]
Epoch 31:  21%|██        | 20/97 [00:04<00:17,  4.53it/s, loss=3.22, v_num=0]
Epoch 31:  22%|██▏       | 21/97 [00:04<00:16,  4.66it/s, loss=3.22, v_num=0]
Epoch 31:  22%|██▏       | 21/97 [00:04<00:16,  4.61it/s, loss=3.22, v_num=0]
Epoch 31:  23%|██▎       | 22/97 [00:04<00:15,  4.74it/s, loss=3.22, v_num=0]
Epoch 31:  23%|██▎       | 22/97 [00:04<00:16,  4.68it/s, loss=3.22, v_num=0]
Epoch 31:  24%|██▎       | 23/97 [00:04<00:15,  4.81it/s, loss=3.22, v_num=0]
Epoch 31:  24%|██▎       | 23/97 [00:04<00:15,  4.75it/s, loss=3.22, v_num=0]
Epoch 31:  25%|██▍       | 24/97 [00:04<00:14,  4.88it/s, loss=3.22, v_num=0]
Epoch 31:  25%|██▍       | 24/97 [00:04<00:15,  4.82it/s, loss=3.22, v_num=0]
Epoch 31:  26%|██▌       | 25/97 [00:05<00:14,  4.94it/s, loss=3.22, v_num=0]
Epoch 31:  26%|██▌       | 25/97 [00:05<00:14,  4.89it/s, loss=3.23, v_num=0]
Epoch 31:  27%|██▋       | 26/97 [00:05<00:14,  5.00it/s, loss=3.23, v_num=0]
Epoch 31:  27%|██▋       | 26/97 [00:05<00:14,  4.95it/s, loss=3.23, v_num=0]
Epoch 31:  28%|██▊       | 27/97 [00:05<00:13,  5.05it/s, loss=3.23, v_num=0]
Epoch 31:  28%|██▊       | 27/97 [00:05<00:13,  5.01it/s, loss=3.24, v_num=0]
Epoch 31:  29%|██▉       | 28/97 [00:05<00:13,  5.12it/s, loss=3.24, v_num=0]
Epoch 31:  29%|██▉       | 28/97 [00:05<00:13,  5.06it/s, loss=3.23, v_num=0]
Epoch 31:  30%|██▉       | 29/97 [00:05<00:13,  5.17it/s, loss=3.23, v_num=0]
Epoch 31:  30%|██▉       | 29/97 [00:05<00:13,  5.12it/s, loss=3.24, v_num=0]
Epoch 31:  31%|███       | 30/97 [00:05<00:12,  5.21it/s, loss=3.24, v_num=0]
Epoch 31:  31%|███       | 30/97 [00:05<00:12,  5.16it/s, loss=3.23, v_num=0]
Epoch 31:  32%|███▏      | 31/97 [00:05<00:12,  5.26it/s, loss=3.23, v_num=0]
Epoch 31:  32%|███▏      | 31/97 [00:05<00:12,  5.21it/s, loss=3.22, v_num=0]
Epoch 31:  33%|███▎      | 32/97 [00:06<00:12,  5.31it/s, loss=3.22, v_num=0]
Epoch 31:  33%|███▎      | 32/97 [00:06<00:12,  5.26it/s, loss=3.22, v_num=0]
Epoch 31:  34%|███▍      | 33/97 [00:06<00:11,  5.35it/s, loss=3.22, v_num=0]
Epoch 31:  34%|███▍      | 33/97 [00:06<00:12,  5.30it/s, loss=3.21, v_num=0]
Epoch 31:  35%|███▌      | 34/97 [00:06<00:11,  5.39it/s, loss=3.21, v_num=0]
Epoch 31:  35%|███▌      | 34/97 [00:06<00:11,  5.34it/s, loss=3.2, v_num=0]
Epoch 31:  36%|███▌      | 35/97 [00:06<00:11,  5.43it/s, loss=3.2, v_num=0]
Epoch 31:  36%|███▌      | 35/97 [00:06<00:11,  5.38it/s, loss=3.21, v_num=0]
Epoch 31:  37%|███▋      | 36/97 [00:06<00:11,  5.47it/s, loss=3.21, v_num=0]
Epoch 31:  37%|███▋      | 36/97 [00:06<00:11,  5.42it/s, loss=3.21, v_num=0]
Epoch 31:  38%|███▊      | 37/97 [00:06<00:10,  5.50it/s, loss=3.21, v_num=0]
Epoch 31:  38%|███▊      | 37/97 [00:06<00:10,  5.46it/s, loss=3.2, v_num=0]
Epoch 31:  39%|███▉      | 38/97 [00:06<00:10,  5.54it/s, loss=3.2, v_num=0]
Epoch 31:  39%|███▉      | 38/97 [00:06<00:10,  5.49it/s, loss=3.2, v_num=0]
Epoch 31:  40%|████      | 39/97 [00:06<00:10,  5.57it/s, loss=3.2, v_num=0]
Epoch 31:  40%|████      | 39/97 [00:07<00:10,  5.53it/s, loss=3.18, v_num=0]
Epoch 31:  41%|████      | 40/97 [00:07<00:10,  5.60it/s, loss=3.18, v_num=0]
Epoch 31:  41%|████      | 40/97 [00:07<00:10,  5.56it/s, loss=3.2, v_num=0]
Epoch 31:  42%|████▏     | 41/97 [00:07<00:09,  5.63it/s, loss=3.2, v_num=0]
Epoch 31:  42%|████▏     | 41/97 [00:07<00:10,  5.59it/s, loss=3.2, v_num=0]
Epoch 31:  43%|████▎     | 42/97 [00:07<00:09,  5.66it/s, loss=3.2, v_num=0]
Epoch 31:  43%|████▎     | 42/97 [00:07<00:09,  5.62it/s, loss=3.19, v_num=0]
Epoch 31:  44%|████▍     | 43/97 [00:07<00:09,  5.69it/s, loss=3.19, v_num=0]
Epoch 31:  44%|████▍     | 43/97 [00:07<00:09,  5.65it/s, loss=3.18, v_num=0]
Epoch 31:  45%|████▌     | 44/97 [00:07<00:09,  5.72it/s, loss=3.18, v_num=0]
Epoch 31:  45%|████▌     | 44/97 [00:07<00:09,  5.67it/s, loss=3.18, v_num=0]
Epoch 31:  46%|████▋     | 45/97 [00:07<00:09,  5.74it/s, loss=3.18, v_num=0]
Epoch 31:  46%|████▋     | 45/97 [00:07<00:09,  5.70it/s, loss=3.18, v_num=0]
Epoch 31:  47%|████▋     | 46/97 [00:07<00:08,  5.77it/s, loss=3.18, v_num=0]
Epoch 31:  47%|████▋     | 46/97 [00:08<00:08,  5.73it/s, loss=3.18, v_num=0]
Epoch 31:  48%|████▊     | 47/97 [00:08<00:08,  5.79it/s, loss=3.18, v_num=0]
Epoch 31:  48%|████▊     | 47/97 [00:08<00:08,  5.75it/s, loss=3.17, v_num=0]
Epoch 31:  49%|████▉     | 48/97 [00:08<00:08,  5.82it/s, loss=3.17, v_num=0]
Epoch 31:  49%|████▉     | 48/97 [00:08<00:08,  5.78it/s, loss=3.16, v_num=0]
Epoch 31:  51%|█████     | 49/97 [00:08<00:08,  5.84it/s, loss=3.16, v_num=0]
Epoch 31:  51%|█████     | 49/97 [00:08<00:08,  5.80it/s, loss=3.15, v_num=0]
Epoch 31:  52%|█████▏    | 50/97 [00:08<00:08,  5.86it/s, loss=3.15, v_num=0]
Epoch 31:  52%|█████▏    | 50/97 [00:08<00:08,  5.82it/s, loss=3.16, v_num=0]
Epoch 31:  53%|█████▎    | 51/97 [00:08<00:07,  5.88it/s, loss=3.16, v_num=0]
Epoch 31:  53%|█████▎    | 51/97 [00:08<00:07,  5.84it/s, loss=3.17, v_num=0]
Epoch 31:  54%|█████▎    | 52/97 [00:08<00:07,  5.90it/s, loss=3.17, v_num=0]
Epoch 31:  54%|█████▎    | 52/97 [00:08<00:07,  5.87it/s, loss=3.16, v_num=0]
Epoch 31:  55%|█████▍    | 53/97 [00:08<00:07,  5.92it/s, loss=3.16, v_num=0]
Epoch 31:  55%|█████▍    | 53/97 [00:09<00:07,  5.89it/s, loss=3.16, v_num=0]
Epoch 31:  56%|█████▌    | 54/97 [00:09<00:07,  5.94it/s, loss=3.16, v_num=0]
Epoch 31:  56%|█████▌    | 54/97 [00:09<00:07,  5.91it/s, loss=3.16, v_num=0]
Epoch 31:  57%|█████▋    | 55/97 [00:09<00:07,  5.96it/s, loss=3.16, v_num=0]
Epoch 31:  57%|█████▋    | 55/97 [00:09<00:07,  5.92it/s, loss=3.16, v_num=0]
Epoch 31:  58%|█████▊    | 56/97 [00:09<00:06,  5.98it/s, loss=3.16, v_num=0]
Epoch 31:  58%|█████▊    | 56/97 [00:09<00:06,  5.94it/s, loss=3.16, v_num=0]
Epoch 31:  59%|█████▉    | 57/97 [00:09<00:06,  6.00it/s, loss=3.16, v_num=0]
Epoch 31:  59%|█████▉    | 57/97 [00:09<00:06,  5.96it/s, loss=3.16, v_num=0]
Epoch 31:  60%|█████▉    | 58/97 [00:09<00:06,  6.02it/s, loss=3.16, v_num=0]
Epoch 31:  60%|█████▉    | 58/97 [00:09<00:06,  5.98it/s, loss=3.16, v_num=0]
Epoch 31:  61%|██████    | 59/97 [00:09<00:06,  6.03it/s, loss=3.16, v_num=0]
Epoch 31:  61%|██████    | 59/97 [00:09<00:06,  6.00it/s, loss=3.16, v_num=0]
Epoch 31:  62%|██████▏   | 60/97 [00:09<00:06,  6.05it/s, loss=3.16, v_num=0]
Epoch 31:  62%|██████▏   | 60/97 [00:09<00:06,  6.01it/s, loss=3.15, v_num=0]
Epoch 31:  63%|██████▎   | 61/97 [00:10<00:05,  6.06it/s, loss=3.15, v_num=0]
Epoch 31:  63%|██████▎   | 61/97 [00:10<00:05,  6.03it/s, loss=3.16, v_num=0]
Epoch 31:  64%|██████▍   | 62/97 [00:10<00:05,  6.08it/s, loss=3.16, v_num=0]
Epoch 31:  64%|██████▍   | 62/97 [00:10<00:05,  6.04it/s, loss=3.15, v_num=0]
Epoch 31:  65%|██████▍   | 63/97 [00:10<00:05,  6.09it/s, loss=3.15, v_num=0]
Epoch 31:  65%|██████▍   | 63/97 [00:10<00:05,  6.06it/s, loss=3.16, v_num=0]
Epoch 31:  66%|██████▌   | 64/97 [00:10<00:05,  6.11it/s, loss=3.16, v_num=0]
Epoch 31:  66%|██████▌   | 64/97 [00:10<00:05,  6.07it/s, loss=3.15, v_num=0]
Epoch 31:  67%|██████▋   | 65/97 [00:10<00:05,  6.12it/s, loss=3.15, v_num=0]
Epoch 31:  67%|██████▋   | 65/97 [00:10<00:05,  6.09it/s, loss=3.15, v_num=0]
Epoch 31:  68%|██████▊   | 66/97 [00:10<00:05,  6.14it/s, loss=3.15, v_num=0]
Epoch 31:  68%|██████▊   | 66/97 [00:10<00:05,  6.10it/s, loss=3.14, v_num=0]
Epoch 31:  69%|██████▉   | 67/97 [00:10<00:04,  6.15it/s, loss=3.14, v_num=0]
Epoch 31:  69%|██████▉   | 67/97 [00:10<00:04,  6.12it/s, loss=3.14, v_num=0]
Epoch 31:  70%|███████   | 68/97 [00:11<00:04,  6.16it/s, loss=3.14, v_num=0]
Epoch 31:  70%|███████   | 68/97 [00:11<00:04,  6.13it/s, loss=3.15, v_num=0]
Epoch 31:  71%|███████   | 69/97 [00:11<00:04,  6.18it/s, loss=3.15, v_num=0]
Epoch 31:  71%|███████   | 69/97 [00:11<00:04,  6.15it/s, loss=3.15, v_num=0]
Epoch 31:  72%|███████▏  | 70/97 [00:11<00:04,  6.19it/s, loss=3.15, v_num=0]
Epoch 31:  72%|███████▏  | 70/97 [00:11<00:04,  6.16it/s, loss=3.14, v_num=0]
Epoch 31:  73%|███████▎  | 71/97 [00:11<00:04,  6.20it/s, loss=3.14, v_num=0]
Epoch 31:  73%|███████▎  | 71/97 [00:11<00:04,  6.17it/s, loss=3.14, v_num=0]
Epoch 31:  74%|███████▍  | 72/97 [00:11<00:04,  6.22it/s, loss=3.14, v_num=0]
Epoch 31:  74%|███████▍  | 72/97 [00:11<00:04,  6.19it/s, loss=3.14, v_num=0]
Epoch 31:  75%|███████▌  | 73/97 [00:11<00:03,  6.23it/s, loss=3.14, v_num=0]
Epoch 31:  75%|███████▌  | 73/97 [00:11<00:03,  6.20it/s, loss=3.14, v_num=0]
Epoch 31:  76%|███████▋  | 74/97 [00:11<00:03,  6.24it/s, loss=3.14, v_num=0]
Epoch 31:  76%|███████▋  | 74/97 [00:11<00:03,  6.21it/s, loss=3.14, v_num=0]
Epoch 31:  77%|███████▋  | 75/97 [00:11<00:03,  6.25it/s, loss=3.14, v_num=0]
Epoch 31:  77%|███████▋  | 75/97 [00:12<00:03,  6.22it/s, loss=3.14, v_num=0]
Epoch 31:  78%|███████▊  | 76/97 [00:12<00:03,  6.27it/s, loss=3.14, v_num=0]
Epoch 31:  78%|███████▊  | 76/97 [00:12<00:03,  6.24it/s, loss=3.13, v_num=0]
Epoch 31:  79%|███████▉  | 77/97 [00:12<00:03,  6.28it/s, loss=3.13, v_num=0]
Epoch 31:  79%|███████▉  | 77/97 [00:12<00:03,  6.25it/s, loss=3.13, v_num=0]
Epoch 31:  80%|████████  | 78/97 [00:12<00:03,  6.29it/s, loss=3.13, v_num=0]
Epoch 31:  80%|████████  | 78/97 [00:12<00:03,  6.26it/s, loss=3.13, v_num=0]
Epoch 31:  81%|████████▏ | 79/97 [00:12<00:02,  6.30it/s, loss=3.13, v_num=0]
Epoch 31:  81%|████████▏ | 79/97 [00:12<00:02,  6.27it/s, loss=3.14, v_num=0]
Epoch 31:  82%|████████▏ | 80/97 [00:12<00:02,  6.31it/s, loss=3.14, v_num=0]
Epoch 31:  82%|████████▏ | 80/97 [00:12<00:02,  6.28it/s, loss=3.14, v_num=0]
Epoch 31:  84%|████████▎ | 81/97 [00:12<00:02,  6.32it/s, loss=3.14, v_num=0]
Epoch 31:  84%|████████▎ | 81/97 [00:12<00:02,  6.29it/s, loss=3.13, v_num=0]
Epoch 31:  85%|████████▍ | 82/97 [00:12<00:02,  6.32it/s, loss=3.13, v_num=0]
Epoch 31:  85%|████████▍ | 82/97 [00:13<00:02,  6.29it/s, loss=3.13, v_num=0]
Epoch 31:  86%|████████▌ | 83/97 [00:13<00:02,  6.33it/s, loss=3.13, v_num=0]
Epoch 31:  86%|████████▌ | 83/97 [00:13<00:02,  6.30it/s, loss=3.14, v_num=0]
Epoch 31:  87%|████████▋ | 84/97 [00:13<00:02,  6.34it/s, loss=3.14, v_num=0]
Epoch 31:  87%|████████▋ | 84/97 [00:13<00:02,  6.31it/s, loss=3.14, v_num=0]
Epoch 31:  88%|████████▊ | 85/97 [00:13<00:01,  6.35it/s, loss=3.14, v_num=0]
Epoch 31:  88%|████████▊ | 85/97 [00:13<00:01,  6.32it/s, loss=3.14, v_num=0]
Epoch 31:  89%|████████▊ | 86/97 [00:13<00:01,  6.36it/s, loss=3.14, v_num=0]
Epoch 31:  89%|████████▊ | 86/97 [00:13<00:01,  6.33it/s, loss=3.15, v_num=0]
Epoch 31:  90%|████████▉ | 87/97 [00:13<00:01,  6.37it/s, loss=3.15, v_num=0]
Epoch 31:  90%|████████▉ | 87/97 [00:13<00:01,  6.34it/s, loss=3.16, v_num=0]
Epoch 31:  91%|█████████ | 88/97 [00:13<00:01,  6.38it/s, loss=3.16, v_num=0]
Epoch 31:  91%|█████████ | 88/97 [00:13<00:01,  6.35it/s, loss=3.16, v_num=0]
Epoch 31:  92%|█████████▏| 89/97 [00:13<00:01,  6.39it/s, loss=3.16, v_num=0]
Epoch 31:  92%|█████████▏| 89/97 [00:13<00:01,  6.36it/s, loss=3.15, v_num=0]
Epoch 31:  93%|█████████▎| 90/97 [00:14<00:01,  6.40it/s, loss=3.15, v_num=0]
Epoch 31:  93%|█████████▎| 90/97 [00:14<00:01,  6.37it/s, loss=3.16, v_num=0]
Epoch 31:  94%|█████████▍| 91/97 [00:14<00:00,  6.41it/s, loss=3.16, v_num=0]
Epoch 31:  94%|█████████▍| 91/97 [00:14<00:00,  6.38it/s, loss=3.15, v_num=0]
Epoch 31:  95%|█████████▍| 92/97 [00:14<00:00,  6.41it/s, loss=3.15, v_num=0]
Epoch 31:  95%|█████████▍| 92/97 [00:14<00:00,  6.39it/s, loss=3.15, v_num=0]
Epoch 31:  96%|█████████▌| 93/97 [00:14<00:00,  6.42it/s, loss=3.15, v_num=0]
Epoch 31:  96%|█████████▌| 93/97 [00:14<00:00,  6.40it/s, loss=3.15, v_num=0]
Epoch 31:  97%|█████████▋| 94/97 [00:14<00:00,  6.43it/s, loss=3.15, v_num=0]
Epoch 31:  97%|█████████▋| 94/97 [00:14<00:00,  6.41it/s, loss=3.14, v_num=0]
Epoch 31:  98%|█████████▊| 95/97 [00:14<00:00,  6.44it/s, loss=3.14, v_num=0]
Epoch 31:  98%|█████████▊| 95/97 [00:14<00:00,  6.41it/s, loss=3.14, v_num=0]
Epoch 31:  99%|█████████▉| 96/97 [00:14<00:00,  6.45it/s, loss=3.14, v_num=0]
Epoch 31:  99%|█████████▉| 96/97 [00:14<00:00,  6.42it/s, loss=3.14, v_num=0]
Epoch 31: 100%|██████████| 97/97 [00:15<00:00,  6.46it/s, loss=3.14, v_num=0]
Epoch 31: 100%|██████████| 97/97 [00:15<00:00,  6.43it/s, loss=3.14, v_num=0]
Epoch 31: 100%|██████████| 97/97 [00:15<00:00,  6.43it/s, loss=3.14, v_num=0]
Epoch 31:   0%|          | 0/97 [00:00<?, ?it/s, loss=3.14, v_num=0]
Epoch 32:   0%|          | 0/97 [00:00<?, ?it/s, loss=3.14, v_num=0]
Epoch 32:   1%|          | 1/97 [00:01<02:21,  1.47s/it, loss=3.14, v_num=0]
Epoch 32:   1%|          | 1/97 [00:01<02:26,  1.53s/it, loss=3.15, v_num=0]
Epoch 32:   2%|▏         | 2/97 [00:01<01:16,  1.24it/s, loss=3.15, v_num=0]
Epoch 32:   2%|▏         | 2/97 [00:01<01:19,  1.20it/s, loss=3.14, v_num=0]
Epoch 32:   3%|▎         | 3/97 [00:01<00:55,  1.71it/s, loss=3.14, v_num=0]
Epoch 32:   3%|▎         | 3/97 [00:01<00:56,  1.66it/s, loss=3.14, v_num=0]
Epoch 32:   4%|▍         | 4/97 [00:01<00:43,  2.11it/s, loss=3.14, v_num=0]
Epoch 32:   4%|▍         | 4/97 [00:01<00:45,  2.05it/s, loss=3.13, v_num=0]
Epoch 32:   5%|▌         | 5/97 [00:02<00:37,  2.46it/s, loss=3.13, v_num=0]
Epoch 32:   5%|▌         | 5/97 [00:02<00:38,  2.40it/s, loss=3.13, v_num=0]
Epoch 32:   6%|▌         | 6/97 [00:02<00:32,  2.77it/s, loss=3.13, v_num=0]
Epoch 32:   6%|▌         | 6/97 [00:02<00:33,  2.70it/s, loss=3.12, v_num=0]
Epoch 32:   7%|▋         | 7/97 [00:02<00:29,  3.03it/s, loss=3.12, v_num=0]
Epoch 32:   7%|▋         | 7/97 [00:02<00:30,  2.96it/s, loss=3.12, v_num=0]
Epoch 32:   8%|▊         | 8/97 [00:02<00:27,  3.27it/s, loss=3.12, v_num=0]
Epoch 32:   8%|▊         | 8/97 [00:02<00:27,  3.20it/s, loss=3.13, v_num=0]
Epoch 32:   9%|▉         | 9/97 [00:02<00:25,  3.48it/s, loss=3.13, v_num=0]
Epoch 32:   9%|▉         | 9/97 [00:02<00:25,  3.41it/s, loss=3.12, v_num=0]
Epoch 32:  10%|█         | 10/97 [00:02<00:23,  3.66it/s, loss=3.12, v_num=0]
Epoch 32:  10%|█         | 10/97 [00:02<00:24,  3.59it/s, loss=3.11, v_num=0]
Epoch 32:  11%|█▏        | 11/97 [00:02<00:22,  3.82it/s, loss=3.11, v_num=0]
Epoch 32:  11%|█▏        | 11/97 [00:02<00:22,  3.75it/s, loss=3.11, v_num=0]
Epoch 32:  12%|█▏        | 12/97 [00:03<00:21,  3.96it/s, loss=3.11, v_num=0]
Epoch 32:  12%|█▏        | 12/97 [00:03<00:21,  3.89it/s, loss=3.1, v_num=0]
Epoch 32:  13%|█▎        | 13/97 [00:03<00:20,  4.08it/s, loss=3.1, v_num=0]
Epoch 32:  13%|█▎        | 13/97 [00:03<00:20,  4.02it/s, loss=3.11, v_num=0]
Epoch 32:  14%|█▍        | 14/97 [00:03<00:19,  4.20it/s, loss=3.11, v_num=0]
Epoch 32:  14%|█▍        | 14/97 [00:03<00:20,  4.14it/s, loss=3.11, v_num=0]
Epoch 32:  15%|█▌        | 15/97 [00:03<00:19,  4.31it/s, loss=3.11, v_num=0]
Epoch 32:  15%|█▌        | 15/97 [00:03<00:19,  4.25it/s, loss=3.11, v_num=0]
Epoch 32:  16%|█▋        | 16/97 [00:03<00:18,  4.42it/s, loss=3.11, v_num=0]
Epoch 32:  16%|█▋        | 16/97 [00:03<00:18,  4.35it/s, loss=3.11, v_num=0]
Epoch 32:  18%|█▊        | 17/97 [00:03<00:17,  4.51it/s, loss=3.11, v_num=0]
Epoch 32:  18%|█▊        | 17/97 [00:03<00:17,  4.45it/s, loss=3.12, v_num=0]
Epoch 32:  19%|█▊        | 18/97 [00:03<00:17,  4.59it/s, loss=3.12, v_num=0]
Epoch 32:  19%|█▊        | 18/97 [00:03<00:17,  4.53it/s, loss=3.12, v_num=0]
Epoch 32:  20%|█▉        | 19/97 [00:04<00:16,  4.67it/s, loss=3.12, v_num=0]
Epoch 32:  20%|█▉        | 19/97 [00:04<00:16,  4.62it/s, loss=3.11, v_num=0]
Epoch 32:  21%|██        | 20/97 [00:04<00:16,  4.75it/s, loss=3.11, v_num=0]
Epoch 32:  21%|██        | 20/97 [00:04<00:16,  4.70it/s, loss=3.11, v_num=0]
Epoch 32:  22%|██▏       | 21/97 [00:04<00:15,  4.84it/s, loss=3.11, v_num=0]
Epoch 32:  22%|██▏       | 21/97 [00:04<00:15,  4.78it/s, loss=3.1, v_num=0]
Epoch 32:  23%|██▎       | 22/97 [00:04<00:15,  4.91it/s, loss=3.1, v_num=0]
Epoch 32:  23%|██▎       | 22/97 [00:04<00:15,  4.85it/s, loss=3.11, v_num=0]
Epoch 32:  24%|██▎       | 23/97 [00:04<00:14,  4.97it/s, loss=3.11, v_num=0]
Epoch 32:  24%|██▎       | 23/97 [00:04<00:15,  4.91it/s, loss=3.1, v_num=0]
Epoch 32:  25%|██▍       | 24/97 [00:04<00:14,  5.03it/s, loss=3.1, v_num=0]
Epoch 32:  25%|██▍       | 24/97 [00:04<00:14,  4.97it/s, loss=3.11, v_num=0]
Epoch 32:  26%|██▌       | 25/97 [00:04<00:14,  5.09it/s, loss=3.11, v_num=0]
Epoch 32:  26%|██▌       | 25/97 [00:04<00:14,  5.03it/s, loss=3.11, v_num=0]
Epoch 32:  27%|██▋       | 26/97 [00:05<00:13,  5.14it/s, loss=3.11, v_num=0]
Epoch 32:  27%|██▋       | 26/97 [00:05<00:13,  5.08it/s, loss=3.12, v_num=0]
Epoch 32:  28%|██▊       | 27/97 [00:05<00:13,  5.19it/s, loss=3.12, v_num=0]
Epoch 32:  28%|██▊       | 27/97 [00:05<00:13,  5.14it/s, loss=3.12, v_num=0]
Epoch 32:  29%|██▉       | 28/97 [00:05<00:13,  5.25it/s, loss=3.12, v_num=0]
Epoch 32:  29%|██▉       | 28/97 [00:05<00:13,  5.19it/s, loss=3.11, v_num=0]
Epoch 32:  30%|██▉       | 29/97 [00:05<00:12,  5.30it/s, loss=3.11, v_num=0]
Epoch 32:  30%|██▉       | 29/97 [00:05<00:12,  5.24it/s, loss=3.11, v_num=0]
Epoch 32:  31%|███       | 30/97 [00:05<00:12,  5.34it/s, loss=3.11, v_num=0]
Epoch 32:  31%|███       | 30/97 [00:05<00:12,  5.29it/s, loss=3.11, v_num=0]
Epoch 32:  32%|███▏      | 31/97 [00:05<00:12,  5.39it/s, loss=3.11, v_num=0]
Epoch 32:  32%|███▏      | 31/97 [00:05<00:12,  5.34it/s, loss=3.11, v_num=0]
Epoch 32:  33%|███▎      | 32/97 [00:05<00:11,  5.43it/s, loss=3.11, v_num=0]
Epoch 32:  33%|███▎      | 32/97 [00:05<00:12,  5.38it/s, loss=3.11, v_num=0]
Epoch 32:  34%|███▍      | 33/97 [00:06<00:11,  5.47it/s, loss=3.11, v_num=0]
Epoch 32:  34%|███▍      | 33/97 [00:06<00:11,  5.42it/s, loss=3.11, v_num=0]
Epoch 32:  35%|███▌      | 34/97 [00:06<00:11,  5.51it/s, loss=3.11, v_num=0]
Epoch 32:  35%|███▌      | 34/97 [00:06<00:11,  5.46it/s, loss=3.1, v_num=0]
Epoch 32:  36%|███▌      | 35/97 [00:06<00:11,  5.54it/s, loss=3.1, v_num=0]
Epoch 32:  36%|███▌      | 35/97 [00:06<00:11,  5.50it/s, loss=3.1, v_num=0]
Epoch 32:  37%|███▋      | 36/97 [00:06<00:10,  5.57it/s, loss=3.1, v_num=0]
Epoch 32:  37%|███▋      | 36/97 [00:06<00:11,  5.53it/s, loss=3.1, v_num=0]
Epoch 32:  38%|███▊      | 37/97 [00:06<00:10,  5.61it/s, loss=3.1, v_num=0]
Epoch 32:  38%|███▊      | 37/97 [00:06<00:10,  5.56it/s, loss=3.1, v_num=0]
Epoch 32:  39%|███▉      | 38/97 [00:06<00:10,  5.64it/s, loss=3.1, v_num=0]
Epoch 32:  39%|███▉      | 38/97 [00:06<00:10,  5.59it/s, loss=3.1, v_num=0]
Epoch 32:  40%|████      | 39/97 [00:06<00:10,  5.67it/s, loss=3.1, v_num=0]
Epoch 32:  40%|████      | 39/97 [00:06<00:10,  5.62it/s, loss=3.11, v_num=0]
Epoch 32:  41%|████      | 40/97 [00:07<00:09,  5.70it/s, loss=3.11, v_num=0]
Epoch 32:  41%|████      | 40/97 [00:07<00:10,  5.66it/s, loss=3.11, v_num=0]
Epoch 32:  42%|████▏     | 41/97 [00:07<00:09,  5.73it/s, loss=3.11, v_num=0]
Epoch 32:  42%|████▏     | 41/97 [00:07<00:09,  5.69it/s, loss=3.1, v_num=0]
Epoch 32:  43%|████▎     | 42/97 [00:07<00:09,  5.76it/s, loss=3.1, v_num=0]
Epoch 32:  43%|████▎     | 42/97 [00:07<00:09,  5.72it/s, loss=3.1, v_num=0]
Epoch 32:  44%|████▍     | 43/97 [00:07<00:09,  5.79it/s, loss=3.1, v_num=0]
Epoch 32:  44%|████▍     | 43/97 [00:07<00:09,  5.74it/s, loss=3.1, v_num=0]
Epoch 32:  45%|████▌     | 44/97 [00:07<00:09,  5.81it/s, loss=3.1, v_num=0]
Epoch 32:  45%|████▌     | 44/97 [00:07<00:09,  5.77it/s, loss=3.1, v_num=0]
Epoch 32:  46%|████▋     | 45/97 [00:07<00:08,  5.84it/s, loss=3.1, v_num=0]
Epoch 32:  46%|████▋     | 45/97 [00:07<00:08,  5.79it/s, loss=3.11, v_num=0]
Epoch 32:  47%|████▋     | 46/97 [00:07<00:08,  5.86it/s, loss=3.11, v_num=0]
Epoch 32:  47%|████▋     | 46/97 [00:07<00:08,  5.82it/s, loss=3.11, v_num=0]
Epoch 32:  48%|████▊     | 47/97 [00:07<00:08,  5.89it/s, loss=3.11, v_num=0]
Epoch 32:  48%|████▊     | 47/97 [00:08<00:08,  5.84it/s, loss=3.11, v_num=0]
Epoch 32:  49%|████▉     | 48/97 [00:08<00:08,  5.91it/s, loss=3.11, v_num=0]
Epoch 32:  49%|████▉     | 48/97 [00:08<00:08,  5.87it/s, loss=3.12, v_num=0]
Epoch 32:  51%|█████     | 49/97 [00:08<00:08,  5.93it/s, loss=3.12, v_num=0]
Epoch 32:  51%|█████     | 49/97 [00:08<00:08,  5.89it/s, loss=3.12, v_num=0]
Epoch 32:  52%|█████▏    | 50/97 [00:08<00:07,  5.96it/s, loss=3.12, v_num=0]
Epoch 32:  52%|█████▏    | 50/97 [00:08<00:07,  5.91it/s, loss=3.12, v_num=0]
Epoch 32:  53%|█████▎    | 51/97 [00:08<00:07,  5.98it/s, loss=3.12, v_num=0]
Epoch 32:  53%|█████▎    | 51/97 [00:08<00:07,  5.94it/s, loss=3.12, v_num=0]
Epoch 32:  54%|█████▎    | 52/97 [00:08<00:07,  6.00it/s, loss=3.12, v_num=0]
Epoch 32:  54%|█████▎    | 52/97 [00:08<00:07,  5.96it/s, loss=3.12, v_num=0]
Epoch 32:  55%|█████▍    | 53/97 [00:08<00:07,  6.02it/s, loss=3.12, v_num=0]
Epoch 32:  55%|█████▍    | 53/97 [00:08<00:07,  5.98it/s, loss=3.12, v_num=0]
Epoch 32:  56%|█████▌    | 54/97 [00:08<00:07,  6.04it/s, loss=3.12, v_num=0]
Epoch 32:  56%|█████▌    | 54/97 [00:09<00:07,  6.00it/s, loss=3.12, v_num=0]
Epoch 32:  57%|█████▋    | 55/97 [00:09<00:06,  6.06it/s, loss=3.12, v_num=0]
Epoch 32:  57%|█████▋    | 55/97 [00:09<00:06,  6.02it/s, loss=3.12, v_num=0]
Epoch 32:  58%|█████▊    | 56/97 [00:09<00:06,  6.07it/s, loss=3.12, v_num=0]
Epoch 32:  58%|█████▊    | 56/97 [00:09<00:06,  6.04it/s, loss=3.12, v_num=0]
Epoch 32:  59%|█████▉    | 57/97 [00:09<00:06,  6.09it/s, loss=3.12, v_num=0]
Epoch 32:  59%|█████▉    | 57/97 [00:09<00:06,  6.05it/s, loss=3.12, v_num=0]
Epoch 32:  60%|█████▉    | 58/97 [00:09<00:06,  6.10it/s, loss=3.12, v_num=0]
Epoch 32:  60%|█████▉    | 58/97 [00:09<00:06,  6.07it/s, loss=3.12, v_num=0]
Epoch 32:  61%|██████    | 59/97 [00:09<00:06,  6.12it/s, loss=3.12, v_num=0]
Epoch 32:  61%|██████    | 59/97 [00:09<00:06,  6.09it/s, loss=3.12, v_num=0]
Epoch 32:  62%|██████▏   | 60/97 [00:09<00:06,  6.14it/s, loss=3.12, v_num=0]
Epoch 32:  62%|██████▏   | 60/97 [00:09<00:06,  6.10it/s, loss=3.13, v_num=0]
Epoch 32:  63%|██████▎   | 61/97 [00:09<00:05,  6.15it/s, loss=3.13, v_num=0]
Epoch 32:  63%|██████▎   | 61/97 [00:09<00:05,  6.12it/s, loss=3.13, v_num=0]
Epoch 32:  64%|██████▍   | 62/97 [00:10<00:05,  6.17it/s, loss=3.13, v_num=0]
Epoch 32:  64%|██████▍   | 62/97 [00:10<00:05,  6.13it/s, loss=3.13, v_num=0]
Epoch 32:  65%|██████▍   | 63/97 [00:10<00:05,  6.18it/s, loss=3.13, v_num=0]
Epoch 32:  65%|██████▍   | 63/97 [00:10<00:05,  6.15it/s, loss=3.13, v_num=0]
Epoch 32:  66%|██████▌   | 64/97 [00:10<00:05,  6.20it/s, loss=3.13, v_num=0]
Epoch 32:  66%|██████▌   | 64/97 [00:10<00:05,  6.16it/s, loss=3.13, v_num=0]
Epoch 32:  67%|██████▋   | 65/97 [00:10<00:05,  6.21it/s, loss=3.13, v_num=0]
Epoch 32:  67%|██████▋   | 65/97 [00:10<00:05,  6.18it/s, loss=3.12, v_num=0]
Epoch 32:  68%|██████▊   | 66/97 [00:10<00:04,  6.23it/s, loss=3.12, v_num=0]
Epoch 32:  68%|██████▊   | 66/97 [00:10<00:05,  6.19it/s, loss=3.12, v_num=0]
Epoch 32:  69%|██████▉   | 67/97 [00:10<00:04,  6.24it/s, loss=3.12, v_num=0]
Epoch 32:  69%|██████▉   | 67/97 [00:10<00:04,  6.21it/s, loss=3.11, v_num=0]
Epoch 32:  70%|███████   | 68/97 [00:10<00:04,  6.25it/s, loss=3.11, v_num=0]
Epoch 32:  70%|███████   | 68/97 [00:10<00:04,  6.22it/s, loss=3.12, v_num=0]
Epoch 32:  71%|███████   | 69/97 [00:11<00:04,  6.27it/s, loss=3.12, v_num=0]
Epoch 32:  71%|███████   | 69/97 [00:11<00:04,  6.23it/s, loss=3.12, v_num=0]
Epoch 32:  72%|███████▏  | 70/97 [00:11<00:04,  6.28it/s, loss=3.12, v_num=0]
Epoch 32:  72%|███████▏  | 70/97 [00:11<00:04,  6.24it/s, loss=3.12, v_num=0]
Epoch 32:  73%|███████▎  | 71/97 [00:11<00:04,  6.29it/s, loss=3.12, v_num=0]
Epoch 32:  73%|███████▎  | 71/97 [00:11<00:04,  6.26it/s, loss=3.12, v_num=0]
Epoch 32:  74%|███████▍  | 72/97 [00:11<00:03,  6.30it/s, loss=3.12, v_num=0]
Epoch 32:  74%|███████▍  | 72/97 [00:11<00:03,  6.27it/s, loss=3.13, v_num=0]
Epoch 32:  75%|███████▌  | 73/97 [00:11<00:03,  6.31it/s, loss=3.13, v_num=0]
Epoch 32:  75%|███████▌  | 73/97 [00:11<00:03,  6.28it/s, loss=3.15, v_num=0]
Epoch 32:  76%|███████▋  | 74/97 [00:11<00:03,  6.32it/s, loss=3.15, v_num=0]
Epoch 32:  76%|███████▋  | 74/97 [00:11<00:03,  6.29it/s, loss=3.15, v_num=0]
Epoch 32:  77%|███████▋  | 75/97 [00:11<00:03,  6.33it/s, loss=3.15, v_num=0]
Epoch 32:  77%|███████▋  | 75/97 [00:11<00:03,  6.30it/s, loss=3.15, v_num=0]
Epoch 32:  78%|███████▊  | 76/97 [00:11<00:03,  6.34it/s, loss=3.15, v_num=0]
Epoch 32:  78%|███████▊  | 76/97 [00:12<00:03,  6.31it/s, loss=3.15, v_num=0]
Epoch 32:  79%|███████▉  | 77/97 [00:12<00:03,  6.35it/s, loss=3.15, v_num=0]
Epoch 32:  79%|███████▉  | 77/97 [00:12<00:03,  6.32it/s, loss=3.15, v_num=0]
Epoch 32:  80%|████████  | 78/97 [00:12<00:02,  6.36it/s, loss=3.15, v_num=0]
Epoch 32:  80%|████████  | 78/97 [00:12<00:02,  6.34it/s, loss=3.15, v_num=0]
Epoch 32:  81%|████████▏ | 79/97 [00:12<00:02,  6.37it/s, loss=3.15, v_num=0]
Epoch 32:  81%|████████▏ | 79/97 [00:12<00:02,  6.34it/s, loss=3.15, v_num=0]
Epoch 32:  82%|████████▏ | 80/97 [00:12<00:02,  6.38it/s, loss=3.15, v_num=0]
Epoch 32:  82%|████████▏ | 80/97 [00:12<00:02,  6.35it/s, loss=3.14, v_num=0]
Epoch 32:  84%|████████▎ | 81/97 [00:12<00:02,  6.39it/s, loss=3.14, v_num=0]
Epoch 32:  84%|████████▎ | 81/97 [00:12<00:02,  6.36it/s, loss=3.14, v_num=0]
Epoch 32:  85%|████████▍ | 82/97 [00:12<00:02,  6.40it/s, loss=3.14, v_num=0]
Epoch 32:  85%|████████▍ | 82/97 [00:12<00:02,  6.37it/s, loss=3.15, v_num=0]
Epoch 32:  86%|████████▌ | 83/97 [00:12<00:02,  6.41it/s, loss=3.15, v_num=0]
Epoch 32:  86%|████████▌ | 83/97 [00:13<00:02,  6.38it/s, loss=3.15, v_num=0]
Epoch 32:  87%|████████▋ | 84/97 [00:13<00:02,  6.41it/s, loss=3.15, v_num=0]
Epoch 32:  87%|████████▋ | 84/97 [00:13<00:02,  6.39it/s, loss=3.14, v_num=0]
Epoch 32:  88%|████████▊ | 85/97 [00:13<00:01,  6.42it/s, loss=3.14, v_num=0]
Epoch 32:  88%|████████▊ | 85/97 [00:13<00:01,  6.39it/s, loss=3.15, v_num=0]
Epoch 32:  89%|████████▊ | 86/97 [00:13<00:01,  6.43it/s, loss=3.15, v_num=0]
Epoch 32:  89%|████████▊ | 86/97 [00:13<00:01,  6.40it/s, loss=3.15, v_num=0]
Epoch 32:  90%|████████▉ | 87/97 [00:13<00:01,  6.44it/s, loss=3.15, v_num=0]
Epoch 32:  90%|████████▉ | 87/97 [00:13<00:01,  6.41it/s, loss=3.15, v_num=0]
Epoch 32:  91%|█████████ | 88/97 [00:13<00:01,  6.44it/s, loss=3.15, v_num=0]
Epoch 32:  91%|█████████ | 88/97 [00:13<00:01,  6.42it/s, loss=3.15, v_num=0]
Epoch 32:  92%|█████████▏| 89/97 [00:13<00:01,  6.45it/s, loss=3.15, v_num=0]
Epoch 32:  92%|█████████▏| 89/97 [00:13<00:01,  6.42it/s, loss=3.15, v_num=0]
Epoch 32:  93%|█████████▎| 90/97 [00:13<00:01,  6.46it/s, loss=3.15, v_num=0]
Epoch 32:  93%|█████████▎| 90/97 [00:13<00:01,  6.43it/s, loss=3.14, v_num=0]
Epoch 32:  94%|█████████▍| 91/97 [00:14<00:00,  6.47it/s, loss=3.14, v_num=0]
Epoch 32:  94%|█████████▍| 91/97 [00:14<00:00,  6.44it/s, loss=3.15, v_num=0]
Epoch 32:  95%|█████████▍| 92/97 [00:14<00:00,  6.47it/s, loss=3.15, v_num=0]
Epoch 32:  95%|█████████▍| 92/97 [00:14<00:00,  6.45it/s, loss=3.14, v_num=0]
Epoch 32:  96%|█████████▌| 93/97 [00:14<00:00,  6.48it/s, loss=3.14, v_num=0]
Epoch 32:  96%|█████████▌| 93/97 [00:14<00:00,  6.45it/s, loss=3.13, v_num=0]
Epoch 32:  97%|█████████▋| 94/97 [00:14<00:00,  6.49it/s, loss=3.13, v_num=0]
Epoch 32:  97%|█████████▋| 94/97 [00:14<00:00,  6.46it/s, loss=3.12, v_num=0]
Epoch 32:  98%|█████████▊| 95/97 [00:14<00:00,  6.49it/s, loss=3.12, v_num=0]
Epoch 32:  98%|█████████▊| 95/97 [00:14<00:00,  6.47it/s, loss=3.12, v_num=0]
Epoch 32:  99%|█████████▉| 96/97 [00:14<00:00,  6.50it/s, loss=3.12, v_num=0]
Epoch 32:  99%|█████████▉| 96/97 [00:14<00:00,  6.48it/s, loss=3.12, v_num=0]
Epoch 32: 100%|██████████| 97/97 [00:14<00:00,  6.51it/s, loss=3.12, v_num=0]
Epoch 32: 100%|██████████| 97/97 [00:14<00:00,  6.48it/s, loss=3.12, v_num=0]
Epoch 32: 100%|██████████| 97/97 [00:14<00:00,  6.48it/s, loss=3.12, v_num=0]
Epoch 32:   0%|          | 0/97 [00:00<?, ?it/s, loss=3.12, v_num=0]
Epoch 33:   0%|          | 0/97 [00:00<?, ?it/s, loss=3.12, v_num=0]
Epoch 33:   1%|          | 1/97 [00:01<02:27,  1.54s/it, loss=3.12, v_num=0]
Epoch 33:   1%|          | 1/97 [00:01<02:32,  1.59s/it, loss=3.12, v_num=0]
Epoch 33:   2%|▏         | 2/97 [00:01<01:19,  1.19it/s, loss=3.12, v_num=0]
Epoch 33:   2%|▏         | 2/97 [00:01<01:22,  1.15it/s, loss=3.12, v_num=0]
Epoch 33:   3%|▎         | 3/97 [00:01<00:57,  1.65it/s, loss=3.12, v_num=0]
Epoch 33:   3%|▎         | 3/97 [00:01<00:58,  1.60it/s, loss=3.12, v_num=0]
Epoch 33:   4%|▍         | 4/97 [00:01<00:45,  2.04it/s, loss=3.12, v_num=0]
Epoch 33:   4%|▍         | 4/97 [00:02<00:46,  1.98it/s, loss=3.12, v_num=0]
Epoch 33:   5%|▌         | 5/97 [00:02<00:38,  2.38it/s, loss=3.12, v_num=0]
Epoch 33:   5%|▌         | 5/97 [00:02<00:39,  2.32it/s, loss=3.12, v_num=0]
Epoch 33:   6%|▌         | 6/97 [00:02<00:33,  2.68it/s, loss=3.12, v_num=0]
Epoch 33:   6%|▌         | 6/97 [00:02<00:34,  2.61it/s, loss=3.12, v_num=0]
Epoch 33:   7%|▋         | 7/97 [00:02<00:30,  2.93it/s, loss=3.12, v_num=0]
Epoch 33:   7%|▋         | 7/97 [00:02<00:31,  2.86it/s, loss=3.11, v_num=0]
Epoch 33:   8%|▊         | 8/97 [00:02<00:28,  3.15it/s, loss=3.11, v_num=0]
Epoch 33:   8%|▊         | 8/97 [00:02<00:28,  3.09it/s, loss=3.12, v_num=0]
Epoch 33:   9%|▉         | 9/97 [00:02<00:26,  3.35it/s, loss=3.12, v_num=0]
Epoch 33:   9%|▉         | 9/97 [00:02<00:26,  3.28it/s, loss=3.13, v_num=0]
Epoch 33:  10%|█         | 10/97 [00:02<00:24,  3.52it/s, loss=3.13, v_num=0]
Epoch 33:  10%|█         | 10/97 [00:02<00:25,  3.45it/s, loss=3.12, v_num=0]
Epoch 33:  11%|█▏        | 11/97 [00:02<00:23,  3.68it/s, loss=3.12, v_num=0]
Epoch 33:  11%|█▏        | 11/97 [00:03<00:23,  3.61it/s, loss=3.12, v_num=0]
Epoch 33:  12%|█▏        | 12/97 [00:03<00:22,  3.83it/s, loss=3.12, v_num=0]
Epoch 33:  12%|█▏        | 12/97 [00:03<00:22,  3.77it/s, loss=3.12, v_num=0]
Epoch 33:  13%|█▎        | 13/97 [00:03<00:21,  3.97it/s, loss=3.12, v_num=0]
Epoch 33:  13%|█▎        | 13/97 [00:03<00:21,  3.91it/s, loss=3.12, v_num=0]
Epoch 33:  14%|█▍        | 14/97 [00:03<00:20,  4.10it/s, loss=3.12, v_num=0]
Epoch 33:  14%|█▍        | 14/97 [00:03<00:20,  4.03it/s, loss=3.12, v_num=0]
Epoch 33:  15%|█▌        | 15/97 [00:03<00:19,  4.21it/s, loss=3.12, v_num=0]
Epoch 33:  15%|█▌        | 15/97 [00:03<00:19,  4.15it/s, loss=3.12, v_num=0]
Epoch 33:  16%|█▋        | 16/97 [00:03<00:18,  4.32it/s, loss=3.12, v_num=0]
Epoch 33:  16%|█▋        | 16/97 [00:03<00:19,  4.25it/s, loss=3.12, v_num=0]
Epoch 33:  18%|█▊        | 17/97 [00:03<00:18,  4.41it/s, loss=3.12, v_num=0]
Epoch 33:  18%|█▊        | 17/97 [00:03<00:18,  4.35it/s, loss=3.12, v_num=0]
Epoch 33:  19%|█▊        | 18/97 [00:04<00:17,  4.49it/s, loss=3.12, v_num=0]
Epoch 33:  19%|█▊        | 18/97 [00:04<00:17,  4.44it/s, loss=3.12, v_num=0]
Epoch 33:  20%|█▉        | 19/97 [00:04<00:17,  4.59it/s, loss=3.12, v_num=0]
Epoch 33:  20%|█▉        | 19/97 [00:04<00:17,  4.53it/s, loss=3.12, v_num=0]
Epoch 33:  21%|██        | 20/97 [00:04<00:16,  4.66it/s, loss=3.12, v_num=0]
Epoch 33:  21%|██        | 20/97 [00:04<00:16,  4.60it/s, loss=3.12, v_num=0]
Epoch 33:  22%|██▏       | 21/97 [00:04<00:16,  4.73it/s, loss=3.12, v_num=0]
Epoch 33:  22%|██▏       | 21/97 [00:04<00:16,  4.68it/s, loss=3.12, v_num=0]
Epoch 33:  23%|██▎       | 22/97 [00:04<00:15,  4.80it/s, loss=3.12, v_num=0]
Epoch 33:  23%|██▎       | 22/97 [00:04<00:15,  4.75it/s, loss=3.13, v_num=0]
Epoch 33:  24%|██▎       | 23/97 [00:04<00:15,  4.87it/s, loss=3.13, v_num=0]
Epoch 33:  24%|██▎       | 23/97 [00:04<00:15,  4.81it/s, loss=3.11, v_num=0]
Epoch 33:  25%|██▍       | 24/97 [00:04<00:14,  4.93it/s, loss=3.11, v_num=0]
Epoch 33:  25%|██▍       | 24/97 [00:04<00:14,  4.88it/s, loss=3.11, v_num=0]
Epoch 33:  26%|██▌       | 25/97 [00:05<00:14,  4.99it/s, loss=3.11, v_num=0]
Epoch 33:  26%|██▌       | 25/97 [00:05<00:14,  4.94it/s, loss=3.12, v_num=0]
Epoch 33:  27%|██▋       | 26/97 [00:05<00:14,  5.05it/s, loss=3.12, v_num=0]
Epoch 33:  27%|██▋       | 26/97 [00:05<00:14,  5.00it/s, loss=3.11, v_num=0]
Epoch 33:  28%|██▊       | 27/97 [00:05<00:13,  5.10it/s, loss=3.11, v_num=0]
Epoch 33:  28%|██▊       | 27/97 [00:05<00:13,  5.05it/s, loss=3.11, v_num=0]
Epoch 33:  29%|██▉       | 28/97 [00:05<00:13,  5.15it/s, loss=3.11, v_num=0]
Epoch 33:  29%|██▉       | 28/97 [00:05<00:13,  5.10it/s, loss=3.11, v_num=0]
Epoch 33:  30%|██▉       | 29/97 [00:05<00:13,  5.20it/s, loss=3.11, v_num=0]
Epoch 33:  30%|██▉       | 29/97 [00:05<00:13,  5.15it/s, loss=3.11, v_num=0]
Epoch 33:  31%|███       | 30/97 [00:05<00:12,  5.25it/s, loss=3.11, v_num=0]
Epoch 33:  31%|███       | 30/97 [00:05<00:12,  5.20it/s, loss=3.1, v_num=0]
Epoch 33:  32%|███▏      | 31/97 [00:05<00:12,  5.29it/s, loss=3.1, v_num=0]
Epoch 33:  32%|███▏      | 31/97 [00:05<00:12,  5.24it/s, loss=3.1, v_num=0]
Epoch 33:  33%|███▎      | 32/97 [00:05<00:12,  5.33it/s, loss=3.1, v_num=0]
Epoch 33:  33%|███▎      | 32/97 [00:06<00:12,  5.28it/s, loss=3.1, v_num=0]
Epoch 33:  34%|███▍      | 33/97 [00:06<00:11,  5.37it/s, loss=3.1, v_num=0]
Epoch 33:  34%|███▍      | 33/97 [00:06<00:12,  5.33it/s, loss=3.11, v_num=0]
Epoch 33:  35%|███▌      | 34/97 [00:06<00:11,  5.41it/s, loss=3.11, v_num=0]
Epoch 33:  35%|███▌      | 34/97 [00:06<00:11,  5.36it/s, loss=3.1, v_num=0]
Epoch 33:  36%|███▌      | 35/97 [00:06<00:11,  5.44it/s, loss=3.1, v_num=0]
Epoch 33:  36%|███▌      | 35/97 [00:06<00:11,  5.40it/s, loss=3.1, v_num=0]
Epoch 33:  37%|███▋      | 36/97 [00:06<00:11,  5.48it/s, loss=3.1, v_num=0]
Epoch 33:  37%|███▋      | 36/97 [00:06<00:11,  5.44it/s, loss=3.1, v_num=0]
Epoch 33:  38%|███▊      | 37/97 [00:06<00:10,  5.52it/s, loss=3.1, v_num=0]
Epoch 33:  38%|███▊      | 37/97 [00:06<00:10,  5.47it/s, loss=3.1, v_num=0]
Epoch 33:  39%|███▉      | 38/97 [00:06<00:10,  5.55it/s, loss=3.1, v_num=0]
Epoch 33:  39%|███▉      | 38/97 [00:06<00:10,  5.51it/s, loss=3.1, v_num=0]
Epoch 33:  40%|████      | 39/97 [00:06<00:10,  5.58it/s, loss=3.1, v_num=0]
Epoch 33:  40%|████      | 39/97 [00:07<00:10,  5.54it/s, loss=3.1, v_num=0]
Epoch 33:  41%|████      | 40/97 [00:07<00:10,  5.62it/s, loss=3.1, v_num=0]
Epoch 33:  41%|████      | 40/97 [00:07<00:10,  5.57it/s, loss=3.11, v_num=0]
Epoch 33:  42%|████▏     | 41/97 [00:07<00:09,  5.65it/s, loss=3.11, v_num=0]
Epoch 33:  42%|████▏     | 41/97 [00:07<00:09,  5.60it/s, loss=3.1, v_num=0]
Epoch 33:  43%|████▎     | 42/97 [00:07<00:09,  5.67it/s, loss=3.1, v_num=0]
Epoch 33:  43%|████▎     | 42/97 [00:07<00:09,  5.63it/s, loss=3.1, v_num=0]
Epoch 33:  44%|████▍     | 43/97 [00:07<00:09,  5.70it/s, loss=3.1, v_num=0]
Epoch 33:  44%|████▍     | 43/97 [00:07<00:09,  5.65it/s, loss=3.11, v_num=0]
Epoch 33:  45%|████▌     | 44/97 [00:07<00:09,  5.72it/s, loss=3.11, v_num=0]
Epoch 33:  45%|████▌     | 44/97 [00:07<00:09,  5.68it/s, loss=3.11, v_num=0]
Epoch 33:  46%|████▋     | 45/97 [00:07<00:09,  5.75it/s, loss=3.11, v_num=0]
Epoch 33:  46%|████▋     | 45/97 [00:07<00:09,  5.70it/s, loss=3.1, v_num=0]
Epoch 33:  47%|████▋     | 46/97 [00:07<00:08,  5.77it/s, loss=3.1, v_num=0]
Epoch 33:  47%|████▋     | 46/97 [00:08<00:08,  5.73it/s, loss=3.11, v_num=0]
Epoch 33:  48%|████▊     | 47/97 [00:08<00:08,  5.79it/s, loss=3.11, v_num=0]
Epoch 33:  48%|████▊     | 47/97 [00:08<00:08,  5.75it/s, loss=3.11, v_num=0]
Epoch 33:  49%|████▉     | 48/97 [00:08<00:08,  5.81it/s, loss=3.11, v_num=0]
Epoch 33:  49%|████▉     | 48/97 [00:08<00:08,  5.77it/s, loss=3.1, v_num=0]
Epoch 33:  51%|█████     | 49/97 [00:08<00:08,  5.83it/s, loss=3.1, v_num=0]
Epoch 33:  51%|█████     | 49/97 [00:08<00:08,  5.79it/s, loss=3.1, v_num=0]
Epoch 33:  52%|█████▏    | 50/97 [00:08<00:08,  5.85it/s, loss=3.1, v_num=0]
Epoch 33:  52%|█████▏    | 50/97 [00:08<00:08,  5.81it/s, loss=3.09, v_num=0]
Epoch 33:  53%|█████▎    | 51/97 [00:08<00:07,  5.87it/s, loss=3.09, v_num=0]
Epoch 33:  53%|█████▎    | 51/97 [00:08<00:07,  5.83it/s, loss=3.1, v_num=0]
Epoch 33:  54%|█████▎    | 52/97 [00:08<00:07,  5.89it/s, loss=3.1, v_num=0]
Epoch 33:  54%|█████▎    | 52/97 [00:08<00:07,  5.85it/s, loss=3.1, v_num=0]
Epoch 33:  55%|█████▍    | 53/97 [00:08<00:07,  5.91it/s, loss=3.1, v_num=0]
Epoch 33:  55%|█████▍    | 53/97 [00:09<00:07,  5.87it/s, loss=3.09, v_num=0]
Epoch 33:  56%|█████▌    | 54/97 [00:09<00:07,  5.93it/s, loss=3.09, v_num=0]
Epoch 33:  56%|█████▌    | 54/97 [00:09<00:07,  5.89it/s, loss=3.09, v_num=0]
Epoch 33:  57%|█████▋    | 55/97 [00:09<00:07,  5.94it/s, loss=3.09, v_num=0]
Epoch 33:  57%|█████▋    | 55/97 [00:09<00:07,  5.91it/s, loss=3.09, v_num=0]
Epoch 33:  58%|█████▊    | 56/97 [00:09<00:06,  5.96it/s, loss=3.09, v_num=0]
Epoch 33:  58%|█████▊    | 56/97 [00:09<00:06,  5.93it/s, loss=3.1, v_num=0]
Epoch 33:  59%|█████▉    | 57/97 [00:09<00:06,  5.98it/s, loss=3.1, v_num=0]
Epoch 33:  59%|█████▉    | 57/97 [00:09<00:06,  5.95it/s, loss=3.1, v_num=0]
Epoch 33:  60%|█████▉    | 58/97 [00:09<00:06,  6.00it/s, loss=3.1, v_num=0]
Epoch 33:  60%|█████▉    | 58/97 [00:09<00:06,  5.97it/s, loss=3.09, v_num=0]
Epoch 33:  61%|██████    | 59/97 [00:09<00:06,  6.01it/s, loss=3.09, v_num=0]
Epoch 33:  61%|██████    | 59/97 [00:09<00:06,  5.98it/s, loss=3.1, v_num=0]
Epoch 33:  62%|██████▏   | 60/97 [00:09<00:06,  6.03it/s, loss=3.1, v_num=0]
Epoch 33:  62%|██████▏   | 60/97 [00:10<00:06,  6.00it/s, loss=3.1, v_num=0]
Epoch 33:  63%|██████▎   | 61/97 [00:10<00:05,  6.04it/s, loss=3.1, v_num=0]
Epoch 33:  63%|██████▎   | 61/97 [00:10<00:05,  6.01it/s, loss=3.1, v_num=0]
Epoch 33:  64%|██████▍   | 62/97 [00:10<00:05,  6.06it/s, loss=3.1, v_num=0]
Epoch 33:  64%|██████▍   | 62/97 [00:10<00:05,  6.03it/s, loss=3.1, v_num=0]
Epoch 33:  65%|██████▍   | 63/97 [00:10<00:05,  6.08it/s, loss=3.1, v_num=0]
Epoch 33:  65%|██████▍   | 63/97 [00:10<00:05,  6.04it/s, loss=3.1, v_num=0]
Epoch 33:  66%|██████▌   | 64/97 [00:10<00:05,  6.09it/s, loss=3.1, v_num=0]
Epoch 33:  66%|██████▌   | 64/97 [00:10<00:05,  6.06it/s, loss=3.11, v_num=0]
Epoch 33:  67%|██████▋   | 65/97 [00:10<00:05,  6.11it/s, loss=3.11, v_num=0]
Epoch 33:  67%|██████▋   | 65/97 [00:10<00:05,  6.07it/s, loss=3.11, v_num=0]
Epoch 33:  68%|██████▊   | 66/97 [00:10<00:05,  6.12it/s, loss=3.11, v_num=0]
Epoch 33:  68%|██████▊   | 66/97 [00:10<00:05,  6.09it/s, loss=3.11, v_num=0]
Epoch 33:  69%|██████▉   | 67/97 [00:10<00:04,  6.13it/s, loss=3.11, v_num=0]
Epoch 33:  69%|██████▉   | 67/97 [00:10<00:04,  6.10it/s, loss=3.12, v_num=0]
Epoch 33:  70%|███████   | 68/97 [00:11<00:04,  6.15it/s, loss=3.12, v_num=0]
Epoch 33:  70%|███████   | 68/97 [00:11<00:04,  6.12it/s, loss=3.12, v_num=0]
Epoch 33:  71%|███████   | 69/97 [00:11<00:04,  6.16it/s, loss=3.12, v_num=0]
Epoch 33:  71%|███████   | 69/97 [00:11<00:04,  6.13it/s, loss=3.12, v_num=0]
Epoch 33:  72%|███████▏  | 70/97 [00:11<00:04,  6.17it/s, loss=3.12, v_num=0]
Epoch 33:  72%|███████▏  | 70/97 [00:11<00:04,  6.14it/s, loss=3.12, v_num=0]
Epoch 33:  73%|███████▎  | 71/97 [00:11<00:04,  6.19it/s, loss=3.12, v_num=0]
Epoch 33:  73%|███████▎  | 71/97 [00:11<00:04,  6.16it/s, loss=3.12, v_num=0]
Epoch 33:  74%|███████▍  | 72/97 [00:11<00:04,  6.20it/s, loss=3.12, v_num=0]
Epoch 33:  74%|███████▍  | 72/97 [00:11<00:04,  6.17it/s, loss=3.11, v_num=0]
Epoch 33:  75%|███████▌  | 73/97 [00:11<00:03,  6.21it/s, loss=3.11, v_num=0]
Epoch 33:  75%|███████▌  | 73/97 [00:11<00:03,  6.18it/s, loss=3.11, v_num=0]
Epoch 33:  76%|███████▋  | 74/97 [00:11<00:03,  6.22it/s, loss=3.11, v_num=0]
Epoch 33:  76%|███████▋  | 74/97 [00:11<00:03,  6.19it/s, loss=3.11, v_num=0]
Epoch 33:  77%|███████▋  | 75/97 [00:12<00:03,  6.23it/s, loss=3.11, v_num=0]
Epoch 33:  77%|███████▋  | 75/97 [00:12<00:03,  6.20it/s, loss=3.1, v_num=0]
Epoch 33:  78%|███████▊  | 76/97 [00:12<00:03,  6.24it/s, loss=3.1, v_num=0]
Epoch 33:  78%|███████▊  | 76/97 [00:12<00:03,  6.22it/s, loss=3.09, v_num=0]
Epoch 33:  79%|███████▉  | 77/97 [00:12<00:03,  6.26it/s, loss=3.09, v_num=0]
Epoch 33:  79%|███████▉  | 77/97 [00:12<00:03,  6.23it/s, loss=3.1, v_num=0]
Epoch 33:  80%|████████  | 78/97 [00:12<00:03,  6.27it/s, loss=3.1, v_num=0]
Epoch 33:  80%|████████  | 78/97 [00:12<00:03,  6.24it/s, loss=3.11, v_num=0]
Epoch 33:  81%|████████▏ | 79/97 [00:12<00:02,  6.28it/s, loss=3.11, v_num=0]
Epoch 33:  81%|████████▏ | 79/97 [00:12<00:02,  6.25it/s, loss=3.1, v_num=0]
Epoch 33:  82%|████████▏ | 80/97 [00:12<00:02,  6.29it/s, loss=3.1, v_num=0]
Epoch 33:  82%|████████▏ | 80/97 [00:12<00:02,  6.26it/s, loss=3.1, v_num=0]
Epoch 33:  84%|████████▎ | 81/97 [00:12<00:02,  6.30it/s, loss=3.1, v_num=0]
Epoch 33:  84%|████████▎ | 81/97 [00:12<00:02,  6.27it/s, loss=3.09, v_num=0]
Epoch 33:  85%|████████▍ | 82/97 [00:13<00:02,  6.31it/s, loss=3.09, v_num=0]
Epoch 33:  85%|████████▍ | 82/97 [00:13<00:02,  6.28it/s, loss=3.08, v_num=0]
Epoch 33:  86%|████████▌ | 83/97 [00:13<00:02,  6.32it/s, loss=3.08, v_num=0]
Epoch 33:  86%|████████▌ | 83/97 [00:13<00:02,  6.29it/s, loss=3.07, v_num=0]
Epoch 33:  87%|████████▋ | 84/97 [00:13<00:02,  6.32it/s, loss=3.07, v_num=0]
Epoch 33:  87%|████████▋ | 84/97 [00:13<00:02,  6.30it/s, loss=3.07, v_num=0]
Epoch 33:  88%|████████▊ | 85/97 [00:13<00:01,  6.33it/s, loss=3.07, v_num=0]
Epoch 33:  88%|████████▊ | 85/97 [00:13<00:01,  6.31it/s, loss=3.06, v_num=0]
Epoch 33:  89%|████████▊ | 86/97 [00:13<00:01,  6.34it/s, loss=3.06, v_num=0]
Epoch 33:  89%|████████▊ | 86/97 [00:13<00:01,  6.32it/s, loss=3.06, v_num=0]
Epoch 33:  90%|████████▉ | 87/97 [00:13<00:01,  6.35it/s, loss=3.06, v_num=0]
Epoch 33:  90%|████████▉ | 87/97 [00:13<00:01,  6.33it/s, loss=3.05, v_num=0]
Epoch 33:  91%|█████████ | 88/97 [00:13<00:01,  6.36it/s, loss=3.05, v_num=0]
Epoch 33:  91%|█████████ | 88/97 [00:13<00:01,  6.34it/s, loss=3.05, v_num=0]
Epoch 33:  92%|█████████▏| 89/97 [00:13<00:01,  6.37it/s, loss=3.05, v_num=0]
Epoch 33:  92%|█████████▏| 89/97 [00:14<00:01,  6.35it/s, loss=3.05, v_num=0]
Epoch 33:  93%|█████████▎| 90/97 [00:14<00:01,  6.38it/s, loss=3.05, v_num=0]
Epoch 33:  93%|█████████▎| 90/97 [00:14<00:01,  6.36it/s, loss=3.06, v_num=0]
Epoch 33:  94%|█████████▍| 91/97 [00:14<00:00,  6.39it/s, loss=3.06, v_num=0]
Epoch 33:  94%|█████████▍| 91/97 [00:14<00:00,  6.37it/s, loss=3.05, v_num=0]
Epoch 33:  95%|█████████▍| 92/97 [00:14<00:00,  6.40it/s, loss=3.05, v_num=0]
Epoch 33:  95%|█████████▍| 92/97 [00:14<00:00,  6.37it/s, loss=3.05, v_num=0]
Epoch 33:  96%|█████████▌| 93/97 [00:14<00:00,  6.41it/s, loss=3.05, v_num=0]
Epoch 33:  96%|█████████▌| 93/97 [00:14<00:00,  6.38it/s, loss=3.05, v_num=0]
Epoch 33:  97%|█████████▋| 94/97 [00:14<00:00,  6.42it/s, loss=3.05, v_num=0]
Epoch 33:  97%|█████████▋| 94/97 [00:14<00:00,  6.39it/s, loss=3.06, v_num=0]
Epoch 33:  98%|█████████▊| 95/97 [00:14<00:00,  6.43it/s, loss=3.06, v_num=0]
Epoch 33:  98%|█████████▊| 95/97 [00:14<00:00,  6.40it/s, loss=3.06, v_num=0]
Epoch 33:  99%|█████████▉| 96/97 [00:14<00:00,  6.43it/s, loss=3.06, v_num=0]
Epoch 33:  99%|█████████▉| 96/97 [00:14<00:00,  6.41it/s, loss=3.07, v_num=0]
Epoch 33: 100%|██████████| 97/97 [00:15<00:00,  6.44it/s, loss=3.07, v_num=0]
Epoch 33: 100%|██████████| 97/97 [00:15<00:00,  6.42it/s, loss=3.06, v_num=0]
Epoch 33: 100%|██████████| 97/97 [00:15<00:00,  6.42it/s, loss=3.06, v_num=0]
Epoch 33:   0%|          | 0/97 [00:00<?, ?it/s, loss=3.06, v_num=0]
Epoch 34:   0%|          | 0/97 [00:00<?, ?it/s, loss=3.06, v_num=0]
Epoch 34:   1%|          | 1/97 [00:01<02:58,  1.86s/it, loss=3.06, v_num=0]
Epoch 34:   1%|          | 1/97 [00:01<03:03,  1.91s/it, loss=3.06, v_num=0]
Epoch 34:   2%|▏         | 2/97 [00:01<01:34,  1.00it/s, loss=3.06, v_num=0]
Epoch 34:   2%|▏         | 2/97 [00:02<01:37,  1.03s/it, loss=3.06, v_num=0]
Epoch 34:   3%|▎         | 3/97 [00:02<01:07,  1.40it/s, loss=3.06, v_num=0]
Epoch 34:   3%|▎         | 3/97 [00:02<01:08,  1.37it/s, loss=3.06, v_num=0]
Epoch 34:   4%|▍         | 4/97 [00:02<00:53,  1.75it/s, loss=3.06, v_num=0]
Epoch 34:   4%|▍         | 4/97 [00:02<00:54,  1.71it/s, loss=3.06, v_num=0]
Epoch 34:   5%|▌         | 5/97 [00:02<00:44,  2.06it/s, loss=3.06, v_num=0]
Epoch 34:   5%|▌         | 5/97 [00:02<00:45,  2.02it/s, loss=3.06, v_num=0]
Epoch 34:   6%|▌         | 6/97 [00:02<00:38,  2.34it/s, loss=3.06, v_num=0]
Epoch 34:   6%|▌         | 6/97 [00:02<00:39,  2.29it/s, loss=3.06, v_num=0]
Epoch 34:   7%|▋         | 7/97 [00:02<00:34,  2.59it/s, loss=3.06, v_num=0]
Epoch 34:   7%|▋         | 7/97 [00:02<00:35,  2.53it/s, loss=3.06, v_num=0]
Epoch 34:   8%|▊         | 8/97 [00:02<00:31,  2.81it/s, loss=3.06, v_num=0]
Epoch 34:   8%|▊         | 8/97 [00:02<00:32,  2.76it/s, loss=3.07, v_num=0]
Epoch 34:   9%|▉         | 9/97 [00:02<00:29,  3.00it/s, loss=3.07, v_num=0]
Epoch 34:   9%|▉         | 9/97 [00:03<00:29,  2.95it/s, loss=3.07, v_num=0]
Epoch 34:  10%|█         | 10/97 [00:03<00:27,  3.19it/s, loss=3.07, v_num=0]
Epoch 34:  10%|█         | 10/97 [00:03<00:27,  3.13it/s, loss=3.06, v_num=0]
Epoch 34:  11%|█▏        | 11/97 [00:03<00:25,  3.36it/s, loss=3.06, v_num=0]
Epoch 34:  11%|█▏        | 11/97 [00:03<00:26,  3.30it/s, loss=3.07, v_num=0]
Epoch 34:  12%|█▏        | 12/97 [00:03<00:24,  3.51it/s, loss=3.07, v_num=0]
Epoch 34:  12%|█▏        | 12/97 [00:03<00:24,  3.46it/s, loss=3.06, v_num=0]
Epoch 34:  13%|█▎        | 13/97 [00:03<00:22,  3.66it/s, loss=3.06, v_num=0]
Epoch 34:  13%|█▎        | 13/97 [00:03<00:23,  3.60it/s, loss=3.06, v_num=0]
Epoch 34:  14%|█▍        | 14/97 [00:03<00:21,  3.79it/s, loss=3.06, v_num=0]
Epoch 34:  14%|█▍        | 14/97 [00:03<00:22,  3.74it/s, loss=3.06, v_num=0]
Epoch 34:  15%|█▌        | 15/97 [00:03<00:20,  3.92it/s, loss=3.06, v_num=0]
Epoch 34:  15%|█▌        | 15/97 [00:03<00:21,  3.86it/s, loss=3.06, v_num=0]
Epoch 34:  16%|█▋        | 16/97 [00:03<00:20,  4.04it/s, loss=3.06, v_num=0]
Epoch 34:  16%|█▋        | 16/97 [00:04<00:20,  3.98it/s, loss=3.06, v_num=0]
Epoch 34:  18%|█▊        | 17/97 [00:04<00:19,  4.14it/s, loss=3.06, v_num=0]
Epoch 34:  18%|█▊        | 17/97 [00:04<00:19,  4.08it/s, loss=3.06, v_num=0]
Epoch 34:  19%|█▊        | 18/97 [00:04<00:18,  4.23it/s, loss=3.06, v_num=0]
Epoch 34:  19%|█▊        | 18/97 [00:04<00:18,  4.18it/s, loss=3.06, v_num=0]
Epoch 34:  20%|█▉        | 19/97 [00:04<00:18,  4.33it/s, loss=3.06, v_num=0]
Epoch 34:  20%|█▉        | 19/97 [00:04<00:18,  4.27it/s, loss=3.05, v_num=0]
Epoch 34:  21%|██        | 20/97 [00:04<00:17,  4.42it/s, loss=3.05, v_num=0]
Epoch 34:  21%|██        | 20/97 [00:04<00:17,  4.36it/s, loss=3.05, v_num=0]
Epoch 34:  22%|██▏       | 21/97 [00:04<00:16,  4.50it/s, loss=3.05, v_num=0]
Epoch 34:  22%|██▏       | 21/97 [00:04<00:17,  4.45it/s, loss=3.04, v_num=0]
Epoch 34:  23%|██▎       | 22/97 [00:04<00:16,  4.58it/s, loss=3.04, v_num=0]
Epoch 34:  23%|██▎       | 22/97 [00:04<00:16,  4.52it/s, loss=3.04, v_num=0]
Epoch 34:  24%|██▎       | 23/97 [00:04<00:15,  4.65it/s, loss=3.04, v_num=0]
Epoch 34:  24%|██▎       | 23/97 [00:05<00:16,  4.60it/s, loss=3.04, v_num=0]
Epoch 34:  25%|██▍       | 24/97 [00:05<00:15,  4.72it/s, loss=3.04, v_num=0]
Epoch 34:  25%|██▍       | 24/97 [00:05<00:15,  4.67it/s, loss=3.04, v_num=0]
Epoch 34:  26%|██▌       | 25/97 [00:05<00:15,  4.79it/s, loss=3.04, v_num=0]
Epoch 34:  26%|██▌       | 25/97 [00:05<00:15,  4.74it/s, loss=3.04, v_num=0]
Epoch 34:  27%|██▋       | 26/97 [00:05<00:14,  4.85it/s, loss=3.04, v_num=0]
Epoch 34:  27%|██▋       | 26/97 [00:05<00:14,  4.80it/s, loss=3.05, v_num=0]
Epoch 34:  28%|██▊       | 27/97 [00:05<00:14,  4.91it/s, loss=3.05, v_num=0]
Epoch 34:  28%|██▊       | 27/97 [00:05<00:14,  4.86it/s, loss=3.05, v_num=0]
Epoch 34:  29%|██▉       | 28/97 [00:05<00:13,  4.97it/s, loss=3.05, v_num=0]
Epoch 34:  29%|██▉       | 28/97 [00:05<00:14,  4.92it/s, loss=3.05, v_num=0]
Epoch 34:  30%|██▉       | 29/97 [00:05<00:13,  5.02it/s, loss=3.05, v_num=0]
Epoch 34:  30%|██▉       | 29/97 [00:05<00:13,  4.98it/s, loss=3.05, v_num=0]
Epoch 34:  31%|███       | 30/97 [00:05<00:13,  5.07it/s, loss=3.05, v_num=0]
Epoch 34:  31%|███       | 30/97 [00:05<00:13,  5.03it/s, loss=3.05, v_num=0]
Epoch 34:  32%|███▏      | 31/97 [00:06<00:12,  5.13it/s, loss=3.05, v_num=0]
Epoch 34:  32%|███▏      | 31/97 [00:06<00:12,  5.08it/s, loss=3.05, v_num=0]
Epoch 34:  33%|███▎      | 32/97 [00:06<00:12,  5.17it/s, loss=3.05, v_num=0]
Epoch 34:  33%|███▎      | 32/97 [00:06<00:12,  5.13it/s, loss=3.05, v_num=0]
Epoch 34:  34%|███▍      | 33/97 [00:06<00:12,  5.22it/s, loss=3.05, v_num=0]
Epoch 34:  34%|███▍      | 33/97 [00:06<00:12,  5.17it/s, loss=3.06, v_num=0]
Epoch 34:  35%|███▌      | 34/97 [00:06<00:11,  5.26it/s, loss=3.06, v_num=0]
Epoch 34:  35%|███▌      | 34/97 [00:06<00:12,  5.22it/s, loss=3.06, v_num=0]
Epoch 34:  36%|███▌      | 35/97 [00:06<00:11,  5.31it/s, loss=3.06, v_num=0]
Epoch 34:  36%|███▌      | 35/97 [00:06<00:11,  5.26it/s, loss=3.06, v_num=0]
Epoch 34:  37%|███▋      | 36/97 [00:06<00:11,  5.35it/s, loss=3.06, v_num=0]
Epoch 34:  37%|███▋      | 36/97 [00:06<00:11,  5.30it/s, loss=3.06, v_num=0]
Epoch 34:  38%|███▊      | 37/97 [00:06<00:11,  5.38it/s, loss=3.06, v_num=0]
Epoch 34:  38%|███▊      | 37/97 [00:06<00:11,  5.34it/s, loss=3.07, v_num=0]
Epoch 34:  39%|███▉      | 38/97 [00:07<00:10,  5.42it/s, loss=3.07, v_num=0]
Epoch 34:  39%|███▉      | 38/97 [00:07<00:10,  5.38it/s, loss=3.07, v_num=0]
Epoch 34:  40%|████      | 39/97 [00:07<00:10,  5.46it/s, loss=3.07, v_num=0]
Epoch 34:  40%|████      | 39/97 [00:07<00:10,  5.42it/s, loss=3.07, v_num=0]
Epoch 34:  41%|████      | 40/97 [00:07<00:10,  5.49it/s, loss=3.07, v_num=0]
Epoch 34:  41%|████      | 40/97 [00:07<00:10,  5.45it/s, loss=3.07, v_num=0]
Epoch 34:  42%|████▏     | 41/97 [00:07<00:10,  5.52it/s, loss=3.07, v_num=0]
Epoch 34:  42%|████▏     | 41/97 [00:07<00:10,  5.48it/s, loss=3.08, v_num=0]
Epoch 34:  43%|████▎     | 42/97 [00:07<00:09,  5.55it/s, loss=3.08, v_num=0]
Epoch 34:  43%|████▎     | 42/97 [00:07<00:09,  5.51it/s, loss=3.07, v_num=0]
Epoch 34:  44%|████▍     | 43/97 [00:07<00:09,  5.58it/s, loss=3.07, v_num=0]
Epoch 34:  44%|████▍     | 43/97 [00:07<00:09,  5.54it/s, loss=3.07, v_num=0]
Epoch 34:  45%|████▌     | 44/97 [00:07<00:09,  5.62it/s, loss=3.07, v_num=0]
Epoch 34:  45%|████▌     | 44/97 [00:07<00:09,  5.57it/s, loss=3.07, v_num=0]
Epoch 34:  46%|████▋     | 45/97 [00:07<00:09,  5.64it/s, loss=3.07, v_num=0]
Epoch 34:  46%|████▋     | 45/97 [00:08<00:09,  5.60it/s, loss=3.07, v_num=0]
Epoch 34:  47%|████▋     | 46/97 [00:08<00:08,  5.67it/s, loss=3.07, v_num=0]
Epoch 34:  47%|████▋     | 46/97 [00:08<00:09,  5.63it/s, loss=3.07, v_num=0]
Epoch 34:  48%|████▊     | 47/97 [00:08<00:08,  5.70it/s, loss=3.07, v_num=0]
Epoch 34:  48%|████▊     | 47/97 [00:08<00:08,  5.66it/s, loss=3.07, v_num=0]
Epoch 34:  49%|████▉     | 48/97 [00:08<00:08,  5.72it/s, loss=3.07, v_num=0]
Epoch 34:  49%|████▉     | 48/97 [00:08<00:08,  5.68it/s, loss=3.07, v_num=0]
Epoch 34:  51%|█████     | 49/97 [00:08<00:08,  5.74it/s, loss=3.07, v_num=0]
Epoch 34:  51%|█████     | 49/97 [00:08<00:08,  5.71it/s, loss=3.07, v_num=0]
Epoch 34:  52%|█████▏    | 50/97 [00:08<00:08,  5.77it/s, loss=3.07, v_num=0]
Epoch 34:  52%|█████▏    | 50/97 [00:08<00:08,  5.73it/s, loss=3.07, v_num=0]
Epoch 34:  53%|█████▎    | 51/97 [00:08<00:07,  5.79it/s, loss=3.07, v_num=0]
Epoch 34:  53%|█████▎    | 51/97 [00:08<00:07,  5.76it/s, loss=3.08, v_num=0]
Epoch 34:  54%|█████▎    | 52/97 [00:08<00:07,  5.82it/s, loss=3.08, v_num=0]
Epoch 34:  54%|█████▎    | 52/97 [00:08<00:07,  5.78it/s, loss=3.08, v_num=0]
Epoch 34:  55%|█████▍    | 53/97 [00:09<00:07,  5.84it/s, loss=3.08, v_num=0]
Epoch 34:  55%|█████▍    | 53/97 [00:09<00:07,  5.80it/s, loss=3.08, v_num=0]
Epoch 34:  56%|█████▌    | 54/97 [00:09<00:07,  5.86it/s, loss=3.08, v_num=0]
Epoch 34:  56%|█████▌    | 54/97 [00:09<00:07,  5.82it/s, loss=3.09, v_num=0]
Epoch 34:  57%|█████▋    | 55/97 [00:09<00:07,  5.88it/s, loss=3.09, v_num=0]
Epoch 34:  57%|█████▋    | 55/97 [00:09<00:07,  5.85it/s, loss=3.09, v_num=0]
Epoch 34:  58%|█████▊    | 56/97 [00:09<00:06,  5.90it/s, loss=3.09, v_num=0]
Epoch 34:  58%|█████▊    | 56/97 [00:09<00:06,  5.87it/s, loss=3.08, v_num=0]
Epoch 34:  59%|█████▉    | 57/97 [00:09<00:06,  5.92it/s, loss=3.08, v_num=0]
Epoch 34:  59%|█████▉    | 57/97 [00:09<00:06,  5.88it/s, loss=3.08, v_num=0]
Epoch 34:  60%|█████▉    | 58/97 [00:09<00:06,  5.94it/s, loss=3.08, v_num=0]
Epoch 34:  60%|█████▉    | 58/97 [00:09<00:06,  5.90it/s, loss=3.07, v_num=0]
Epoch 34:  61%|██████    | 59/97 [00:09<00:06,  5.95it/s, loss=3.07, v_num=0]
Epoch 34:  61%|██████    | 59/97 [00:09<00:06,  5.92it/s, loss=3.07, v_num=0]
Epoch 34:  62%|██████▏   | 60/97 [00:10<00:06,  5.97it/s, loss=3.07, v_num=0]
Epoch 34:  62%|██████▏   | 60/97 [00:10<00:06,  5.94it/s, loss=3.08, v_num=0]
Epoch 34:  63%|██████▎   | 61/97 [00:10<00:06,  5.99it/s, loss=3.08, v_num=0]
Epoch 34:  63%|██████▎   | 61/97 [00:10<00:06,  5.96it/s, loss=3.07, v_num=0]
Epoch 34:  64%|██████▍   | 62/97 [00:10<00:05,  6.01it/s, loss=3.07, v_num=0]
Epoch 34:  64%|██████▍   | 62/97 [00:10<00:05,  5.98it/s, loss=3.07, v_num=0]
Epoch 34:  65%|██████▍   | 63/97 [00:10<00:05,  6.02it/s, loss=3.07, v_num=0]
Epoch 34:  65%|██████▍   | 63/97 [00:10<00:05,  5.99it/s, loss=3.07, v_num=0]
Epoch 34:  66%|██████▌   | 64/97 [00:10<00:05,  6.04it/s, loss=3.07, v_num=0]
Epoch 34:  66%|██████▌   | 64/97 [00:10<00:05,  6.01it/s, loss=3.07, v_num=0]
Epoch 34:  67%|██████▋   | 65/97 [00:10<00:05,  6.06it/s, loss=3.07, v_num=0]
Epoch 34:  67%|██████▋   | 65/97 [00:10<00:05,  6.03it/s, loss=3.07, v_num=0]
Epoch 34:  68%|██████▊   | 66/97 [00:10<00:05,  6.07it/s, loss=3.07, v_num=0]
Epoch 34:  68%|██████▊   | 66/97 [00:10<00:05,  6.04it/s, loss=3.08, v_num=0]
Epoch 34:  69%|██████▉   | 67/97 [00:11<00:04,  6.09it/s, loss=3.08, v_num=0]
Epoch 34:  69%|██████▉   | 67/97 [00:11<00:04,  6.06it/s, loss=3.08, v_num=0]
Epoch 34:  70%|███████   | 68/97 [00:11<00:04,  6.10it/s, loss=3.08, v_num=0]
Epoch 34:  70%|███████   | 68/97 [00:11<00:04,  6.07it/s, loss=3.07, v_num=0]
Epoch 34:  71%|███████   | 69/97 [00:11<00:04,  6.12it/s, loss=3.07, v_num=0]
Epoch 34:  71%|███████   | 69/97 [00:11<00:04,  6.09it/s, loss=3.07, v_num=0]
Epoch 34:  72%|███████▏  | 70/97 [00:11<00:04,  6.13it/s, loss=3.07, v_num=0]
Epoch 34:  72%|███████▏  | 70/97 [00:11<00:04,  6.10it/s, loss=3.07, v_num=0]
Epoch 34:  73%|███████▎  | 71/97 [00:11<00:04,  6.15it/s, loss=3.07, v_num=0]
Epoch 34:  73%|███████▎  | 71/97 [00:11<00:04,  6.11it/s, loss=3.05, v_num=0]
Epoch 34:  74%|███████▍  | 72/97 [00:11<00:04,  6.16it/s, loss=3.05, v_num=0]
Epoch 34:  74%|███████▍  | 72/97 [00:11<00:04,  6.13it/s, loss=3.04, v_num=0]
Epoch 34:  75%|███████▌  | 73/97 [00:11<00:03,  6.17it/s, loss=3.04, v_num=0]
Epoch 34:  75%|███████▌  | 73/97 [00:11<00:03,  6.14it/s, loss=3.04, v_num=0]
Epoch 34:  76%|███████▋  | 74/97 [00:11<00:03,  6.19it/s, loss=3.04, v_num=0]
Epoch 34:  76%|███████▋  | 74/97 [00:12<00:03,  6.15it/s, loss=3.03, v_num=0]
Epoch 34:  77%|███████▋  | 75/97 [00:12<00:03,  6.20it/s, loss=3.03, v_num=0]
Epoch 34:  77%|███████▋  | 75/97 [00:12<00:03,  6.17it/s, loss=3.03, v_num=0]
Epoch 34:  78%|███████▊  | 76/97 [00:12<00:03,  6.21it/s, loss=3.03, v_num=0]
Epoch 34:  78%|███████▊  | 76/97 [00:12<00:03,  6.18it/s, loss=3.04, v_num=0]
Epoch 34:  79%|███████▉  | 77/97 [00:12<00:03,  6.22it/s, loss=3.04, v_num=0]
Epoch 34:  79%|███████▉  | 77/97 [00:12<00:03,  6.19it/s, loss=3.02, v_num=0]
Epoch 34:  80%|████████  | 78/97 [00:12<00:03,  6.23it/s, loss=3.02, v_num=0]
Epoch 34:  80%|████████  | 78/97 [00:12<00:03,  6.20it/s, loss=3.02, v_num=0]
Epoch 34:  81%|████████▏ | 79/97 [00:12<00:02,  6.24it/s, loss=3.02, v_num=0]
Epoch 34:  81%|████████▏ | 79/97 [00:12<00:02,  6.21it/s, loss=3.03, v_num=0]
Epoch 34:  82%|████████▏ | 80/97 [00:12<00:02,  6.25it/s, loss=3.03, v_num=0]
Epoch 34:  82%|████████▏ | 80/97 [00:12<00:02,  6.23it/s, loss=3.02, v_num=0]
Epoch 34:  84%|████████▎ | 81/97 [00:12<00:02,  6.26it/s, loss=3.02, v_num=0]
Epoch 34:  84%|████████▎ | 81/97 [00:12<00:02,  6.24it/s, loss=3.02, v_num=0]
Epoch 34:  85%|████████▍ | 82/97 [00:13<00:02,  6.27it/s, loss=3.02, v_num=0]
Epoch 34:  85%|████████▍ | 82/97 [00:13<00:02,  6.25it/s, loss=3.03, v_num=0]
Epoch 34:  86%|████████▌ | 83/97 [00:13<00:02,  6.28it/s, loss=3.03, v_num=0]
Epoch 34:  86%|████████▌ | 83/97 [00:13<00:02,  6.26it/s, loss=3.03, v_num=0]
Epoch 34:  87%|████████▋ | 84/97 [00:13<00:02,  6.29it/s, loss=3.03, v_num=0]
Epoch 34:  87%|████████▋ | 84/97 [00:13<00:02,  6.27it/s, loss=3.02, v_num=0]
Epoch 34:  88%|████████▊ | 85/97 [00:13<00:01,  6.31it/s, loss=3.02, v_num=0]
Epoch 34:  88%|████████▊ | 85/97 [00:13<00:01,  6.28it/s, loss=3.01, v_num=0]
Epoch 34:  89%|████████▊ | 86/97 [00:13<00:01,  6.31it/s, loss=3.01, v_num=0]
Epoch 34:  89%|████████▊ | 86/97 [00:13<00:01,  6.29it/s, loss=3, v_num=0]
Epoch 34:  90%|████████▉ | 87/97 [00:13<00:01,  6.32it/s, loss=3, v_num=0]
Epoch 34:  90%|████████▉ | 87/97 [00:13<00:01,  6.30it/s, loss=2.99, v_num=0]
Epoch 34:  91%|█████████ | 88/97 [00:13<00:01,  6.33it/s, loss=2.99, v_num=0]
Epoch 34:  91%|█████████ | 88/97 [00:13<00:01,  6.31it/s, loss=2.99, v_num=0]
Epoch 34:  92%|█████████▏| 89/97 [00:14<00:01,  6.34it/s, loss=2.99, v_num=0]
Epoch 34:  92%|█████████▏| 89/97 [00:14<00:01,  6.32it/s, loss=3, v_num=0]
Epoch 34:  93%|█████████▎| 90/97 [00:14<00:01,  6.35it/s, loss=3, v_num=0]
Epoch 34:  93%|█████████▎| 90/97 [00:14<00:01,  6.33it/s, loss=3, v_num=0]
Epoch 34:  94%|█████████▍| 91/97 [00:14<00:00,  6.36it/s, loss=3, v_num=0]
Epoch 34:  94%|█████████▍| 91/97 [00:14<00:00,  6.34it/s, loss=3, v_num=0]
Epoch 34:  95%|█████████▍| 92/97 [00:14<00:00,  6.37it/s, loss=3, v_num=0]
Epoch 34:  95%|█████████▍| 92/97 [00:14<00:00,  6.35it/s, loss=3.01, v_num=0]
Epoch 34:  96%|█████████▌| 93/97 [00:14<00:00,  6.38it/s, loss=3.01, v_num=0]
Epoch 34:  96%|█████████▌| 93/97 [00:14<00:00,  6.36it/s, loss=3.01, v_num=0]
Epoch 34:  97%|█████████▋| 94/97 [00:14<00:00,  6.39it/s, loss=3.01, v_num=0]
Epoch 34:  97%|█████████▋| 94/97 [00:14<00:00,  6.36it/s, loss=3, v_num=0]
Epoch 34:  98%|█████████▊| 95/97 [00:14<00:00,  6.40it/s, loss=3, v_num=0]
Epoch 34:  98%|█████████▊| 95/97 [00:14<00:00,  6.37it/s, loss=3, v_num=0]
Epoch 34:  99%|█████████▉| 96/97 [00:14<00:00,  6.40it/s, loss=3, v_num=0]
Epoch 34:  99%|█████████▉| 96/97 [00:15<00:00,  6.38it/s, loss=2.99, v_num=0]
Epoch 34: 100%|██████████| 97/97 [00:15<00:00,  6.41it/s, loss=2.99, v_num=0]
Epoch 34: 100%|██████████| 97/97 [00:15<00:00,  6.39it/s, loss=3, v_num=0]
Epoch 34: 100%|██████████| 97/97 [00:15<00:00,  6.39it/s, loss=3, v_num=0]
Epoch 34:   0%|          | 0/97 [00:00<?, ?it/s, loss=3, v_num=0]
Epoch 35:   0%|          | 0/97 [00:00<?, ?it/s, loss=3, v_num=0]
Epoch 35:   1%|          | 1/97 [00:01<02:28,  1.55s/it, loss=3, v_num=0]
Epoch 35:   1%|          | 1/97 [00:01<02:33,  1.60s/it, loss=3, v_num=0]
Epoch 35:   2%|▏         | 2/97 [00:01<01:20,  1.18it/s, loss=3, v_num=0]
Epoch 35:   2%|▏         | 2/97 [00:01<01:22,  1.15it/s, loss=3, v_num=0]
Epoch 35:   3%|▎         | 3/97 [00:01<00:57,  1.64it/s, loss=3, v_num=0]
Epoch 35:   3%|▎         | 3/97 [00:01<00:58,  1.59it/s, loss=3.01, v_num=0]
Epoch 35:   4%|▍         | 4/97 [00:01<00:45,  2.04it/s, loss=3.01, v_num=0]
Epoch 35:   4%|▍         | 4/97 [00:02<00:46,  1.98it/s, loss=3.01, v_num=0]
Epoch 35:   5%|▌         | 5/97 [00:02<00:38,  2.38it/s, loss=3.01, v_num=0]
Epoch 35:   5%|▌         | 5/97 [00:02<00:39,  2.32it/s, loss=3.01, v_num=0]
Epoch 35:   6%|▌         | 6/97 [00:02<00:33,  2.68it/s, loss=3.01, v_num=0]
Epoch 35:   6%|▌         | 6/97 [00:02<00:34,  2.62it/s, loss=3.01, v_num=0]
Epoch 35:   7%|▋         | 7/97 [00:02<00:30,  2.95it/s, loss=3.01, v_num=0]
Epoch 35:   7%|▋         | 7/97 [00:02<00:31,  2.88it/s, loss=3.01, v_num=0]
Epoch 35:   8%|▊         | 8/97 [00:02<00:27,  3.18it/s, loss=3.01, v_num=0]
Epoch 35:   8%|▊         | 8/97 [00:02<00:28,  3.12it/s, loss=3.02, v_num=0]
Epoch 35:   9%|▉         | 9/97 [00:02<00:25,  3.39it/s, loss=3.02, v_num=0]
Epoch 35:   9%|▉         | 9/97 [00:02<00:26,  3.32it/s, loss=3.02, v_num=0]
Epoch 35:  10%|█         | 10/97 [00:02<00:24,  3.57it/s, loss=3.02, v_num=0]
Epoch 35:  10%|█         | 10/97 [00:02<00:24,  3.50it/s, loss=3.03, v_num=0]
Epoch 35:  11%|█▏        | 11/97 [00:02<00:22,  3.75it/s, loss=3.03, v_num=0]
Epoch 35:  11%|█▏        | 11/97 [00:02<00:23,  3.68it/s, loss=3.03, v_num=0]
Epoch 35:  12%|█▏        | 12/97 [00:03<00:21,  3.90it/s, loss=3.03, v_num=0]
Epoch 35:  12%|█▏        | 12/97 [00:03<00:22,  3.84it/s, loss=3.03, v_num=0]
Epoch 35:  13%|█▎        | 13/97 [00:03<00:20,  4.06it/s, loss=3.03, v_num=0]
Epoch 35:  13%|█▎        | 13/97 [00:03<00:21,  3.98it/s, loss=3.02, v_num=0]
Epoch 35:  14%|█▍        | 14/97 [00:03<00:19,  4.18it/s, loss=3.02, v_num=0]
Epoch 35:  14%|█▍        | 14/97 [00:03<00:20,  4.12it/s, loss=3.03, v_num=0]
Epoch 35:  15%|█▌        | 15/97 [00:03<00:19,  4.31it/s, loss=3.03, v_num=0]
Epoch 35:  15%|█▌        | 15/97 [00:03<00:19,  4.24it/s, loss=3.03, v_num=0]
Epoch 35:  16%|█▋        | 16/97 [00:03<00:18,  4.42it/s, loss=3.03, v_num=0]
Epoch 35:  16%|█▋        | 16/97 [00:03<00:18,  4.35it/s, loss=3.03, v_num=0]
Epoch 35:  18%|█▊        | 17/97 [00:03<00:17,  4.52it/s, loss=3.03, v_num=0]
Epoch 35:  18%|█▊        | 17/97 [00:03<00:17,  4.45it/s, loss=3.02, v_num=0]
Epoch 35:  19%|█▊        | 18/97 [00:03<00:17,  4.62it/s, loss=3.02, v_num=0]
Epoch 35:  19%|█▊        | 18/97 [00:03<00:17,  4.55it/s, loss=3.03, v_num=0]
Epoch 35:  20%|█▉        | 19/97 [00:04<00:16,  4.71it/s, loss=3.03, v_num=0]
Epoch 35:  20%|█▉        | 19/97 [00:04<00:16,  4.64it/s, loss=3.02, v_num=0]
Epoch 35:  21%|██        | 20/97 [00:04<00:16,  4.79it/s, loss=3.02, v_num=0]
Epoch 35:  21%|██        | 20/97 [00:04<00:16,  4.72it/s, loss=3.02, v_num=0]
Epoch 35:  22%|██▏       | 21/97 [00:04<00:15,  4.87it/s, loss=3.02, v_num=0]
Epoch 35:  22%|██▏       | 21/97 [00:04<00:15,  4.80it/s, loss=3.03, v_num=0]
Epoch 35:  23%|██▎       | 22/97 [00:04<00:15,  4.93it/s, loss=3.03, v_num=0]
Epoch 35:  23%|██▎       | 22/97 [00:04<00:15,  4.87it/s, loss=3.02, v_num=0]
Epoch 35:  24%|██▎       | 23/97 [00:04<00:14,  5.00it/s, loss=3.02, v_num=0]
Epoch 35:  24%|██▎       | 23/97 [00:04<00:14,  4.94it/s, loss=3.02, v_num=0]
Epoch 35:  25%|██▍       | 24/97 [00:04<00:14,  5.06it/s, loss=3.02, v_num=0]
Epoch 35:  25%|██▍       | 24/97 [00:04<00:14,  5.00it/s, loss=3.02, v_num=0]
Epoch 35:  26%|██▌       | 25/97 [00:04<00:14,  5.12it/s, loss=3.02, v_num=0]
Epoch 35:  26%|██▌       | 25/97 [00:04<00:14,  5.07it/s, loss=3.02, v_num=0]
Epoch 35:  27%|██▋       | 26/97 [00:05<00:13,  5.18it/s, loss=3.02, v_num=0]
Epoch 35:  27%|██▋       | 26/97 [00:05<00:13,  5.12it/s, loss=3.02, v_num=0]
Epoch 35:  28%|██▊       | 27/97 [00:05<00:13,  5.23it/s, loss=3.02, v_num=0]
Epoch 35:  28%|██▊       | 27/97 [00:05<00:13,  5.18it/s, loss=3.03, v_num=0]
Epoch 35:  29%|██▉       | 28/97 [00:05<00:13,  5.29it/s, loss=3.03, v_num=0]
Epoch 35:  29%|██▉       | 28/97 [00:05<00:13,  5.23it/s, loss=3.02, v_num=0]
Epoch 35:  30%|██▉       | 29/97 [00:05<00:12,  5.34it/s, loss=3.02, v_num=0]
Epoch 35:  30%|██▉       | 29/97 [00:05<00:12,  5.28it/s, loss=3.02, v_num=0]
Epoch 35:  31%|███       | 30/97 [00:05<00:12,  5.39it/s, loss=3.02, v_num=0]
Epoch 35:  31%|███       | 30/97 [00:05<00:12,  5.33it/s, loss=3.01, v_num=0]
Epoch 35:  32%|███▏      | 31/97 [00:05<00:12,  5.43it/s, loss=3.01, v_num=0]
Epoch 35:  32%|███▏      | 31/97 [00:05<00:12,  5.38it/s, loss=3.01, v_num=0]
Epoch 35:  33%|███▎      | 32/97 [00:05<00:11,  5.48it/s, loss=3.01, v_num=0]
Epoch 35:  33%|███▎      | 32/97 [00:05<00:11,  5.42it/s, loss=3, v_num=0]
Epoch 35:  34%|███▍      | 33/97 [00:05<00:11,  5.51it/s, loss=3, v_num=0]
Epoch 35:  34%|███▍      | 33/97 [00:06<00:11,  5.46it/s, loss=3.01, v_num=0]
Epoch 35:  35%|███▌      | 34/97 [00:06<00:11,  5.55it/s, loss=3.01, v_num=0]
Epoch 35:  35%|███▌      | 34/97 [00:06<00:11,  5.50it/s, loss=3, v_num=0]
Epoch 35:  36%|███▌      | 35/97 [00:06<00:11,  5.59it/s, loss=3, v_num=0]
Epoch 35:  36%|███▌      | 35/97 [00:06<00:11,  5.54it/s, loss=3, v_num=0]
Epoch 35:  37%|███▋      | 36/97 [00:06<00:10,  5.62it/s, loss=3, v_num=0]
Epoch 35:  37%|███▋      | 36/97 [00:06<00:10,  5.58it/s, loss=3.01, v_num=0]
Epoch 35:  38%|███▊      | 37/97 [00:06<00:10,  5.66it/s, loss=3.01, v_num=0]
Epoch 35:  38%|███▊      | 37/97 [00:06<00:10,  5.61it/s, loss=3.01, v_num=0]
Epoch 35:  39%|███▉      | 38/97 [00:06<00:10,  5.69it/s, loss=3.01, v_num=0]
Epoch 35:  39%|███▉      | 38/97 [00:06<00:10,  5.65it/s, loss=3.01, v_num=0]
Epoch 35:  40%|████      | 39/97 [00:06<00:10,  5.72it/s, loss=3.01, v_num=0]
Epoch 35:  40%|████      | 39/97 [00:06<00:10,  5.68it/s, loss=3.02, v_num=0]
Epoch 35:  41%|████      | 40/97 [00:06<00:09,  5.75it/s, loss=3.02, v_num=0]
Epoch 35:  41%|████      | 40/97 [00:07<00:09,  5.70it/s, loss=3.01, v_num=0]
Epoch 35:  42%|████▏     | 41/97 [00:07<00:09,  5.78it/s, loss=3.01, v_num=0]
Epoch 35:  42%|████▏     | 41/97 [00:07<00:09,  5.73it/s, loss=3.01, v_num=0]
Epoch 35:  43%|████▎     | 42/97 [00:07<00:09,  5.80it/s, loss=3.01, v_num=0]
Epoch 35:  43%|████▎     | 42/97 [00:07<00:09,  5.76it/s, loss=3.02, v_num=0]
Epoch 35:  44%|████▍     | 43/97 [00:07<00:09,  5.83it/s, loss=3.02, v_num=0]
Epoch 35:  44%|████▍     | 43/97 [00:07<00:09,  5.79it/s, loss=3.02, v_num=0]
Epoch 35:  45%|████▌     | 44/97 [00:07<00:09,  5.86it/s, loss=3.02, v_num=0]
Epoch 35:  45%|████▌     | 44/97 [00:07<00:09,  5.82it/s, loss=3.01, v_num=0]
Epoch 35:  46%|████▋     | 45/97 [00:07<00:08,  5.89it/s, loss=3.01, v_num=0]
Epoch 35:  46%|████▋     | 45/97 [00:07<00:08,  5.84it/s, loss=3.01, v_num=0]
Epoch 35:  47%|████▋     | 46/97 [00:07<00:08,  5.91it/s, loss=3.01, v_num=0]
Epoch 35:  47%|████▋     | 46/97 [00:07<00:08,  5.86it/s, loss=3, v_num=0]
Epoch 35:  48%|████▊     | 47/97 [00:07<00:08,  5.93it/s, loss=3, v_num=0]
Epoch 35:  48%|████▊     | 47/97 [00:07<00:08,  5.89it/s, loss=3, v_num=0]
Epoch 35:  49%|████▉     | 48/97 [00:08<00:08,  5.95it/s, loss=3, v_num=0]
Epoch 35:  49%|████▉     | 48/97 [00:08<00:08,  5.91it/s, loss=3, v_num=0]
Epoch 35:  51%|█████     | 49/97 [00:08<00:08,  5.98it/s, loss=3, v_num=0]
Epoch 35:  51%|█████     | 49/97 [00:08<00:08,  5.93it/s, loss=3.01, v_num=0]
Epoch 35:  52%|█████▏    | 50/97 [00:08<00:07,  6.00it/s, loss=3.01, v_num=0]
Epoch 35:  52%|█████▏    | 50/97 [00:08<00:07,  5.96it/s, loss=3.01, v_num=0]
Epoch 35:  53%|█████▎    | 51/97 [00:08<00:07,  6.02it/s, loss=3.01, v_num=0]
Epoch 35:  53%|█████▎    | 51/97 [00:08<00:07,  5.98it/s, loss=3.02, v_num=0]
Epoch 35:  54%|█████▎    | 52/97 [00:08<00:07,  6.04it/s, loss=3.02, v_num=0]
Epoch 35:  54%|█████▎    | 52/97 [00:08<00:07,  6.00it/s, loss=3.03, v_num=0]
Epoch 35:  55%|█████▍    | 53/97 [00:08<00:07,  6.06it/s, loss=3.03, v_num=0]
Epoch 35:  55%|█████▍    | 53/97 [00:08<00:07,  6.02it/s, loss=3.02, v_num=0]
Epoch 35:  56%|█████▌    | 54/97 [00:08<00:07,  6.08it/s, loss=3.02, v_num=0]
Epoch 35:  56%|█████▌    | 54/97 [00:08<00:07,  6.04it/s, loss=3.03, v_num=0]
Epoch 35:  57%|█████▋    | 55/97 [00:09<00:06,  6.10it/s, loss=3.03, v_num=0]
Epoch 35:  57%|█████▋    | 55/97 [00:09<00:06,  6.06it/s, loss=3.02, v_num=0]
Epoch 35:  58%|█████▊    | 56/97 [00:09<00:06,  6.11it/s, loss=3.02, v_num=0]
Epoch 35:  58%|█████▊    | 56/97 [00:09<00:06,  6.07it/s, loss=3.02, v_num=0]
Epoch 35:  59%|█████▉    | 57/97 [00:09<00:06,  6.13it/s, loss=3.02, v_num=0]
Epoch 35:  59%|█████▉    | 57/97 [00:09<00:06,  6.09it/s, loss=3.02, v_num=0]
Epoch 35:  60%|█████▉    | 58/97 [00:09<00:06,  6.15it/s, loss=3.02, v_num=0]
Epoch 35:  60%|█████▉    | 58/97 [00:09<00:06,  6.11it/s, loss=3.02, v_num=0]
Epoch 35:  61%|██████    | 59/97 [00:09<00:06,  6.16it/s, loss=3.02, v_num=0]
Epoch 35:  61%|██████    | 59/97 [00:09<00:06,  6.13it/s, loss=3.02, v_num=0]
Epoch 35:  62%|██████▏   | 60/97 [00:09<00:05,  6.18it/s, loss=3.02, v_num=0]
Epoch 35:  62%|██████▏   | 60/97 [00:09<00:06,  6.14it/s, loss=3.02, v_num=0]
Epoch 35:  63%|██████▎   | 61/97 [00:09<00:05,  6.19it/s, loss=3.02, v_num=0]
Epoch 35:  63%|██████▎   | 61/97 [00:09<00:05,  6.16it/s, loss=3.02, v_num=0]
Epoch 35:  64%|██████▍   | 62/97 [00:09<00:05,  6.21it/s, loss=3.02, v_num=0]
Epoch 35:  64%|██████▍   | 62/97 [00:10<00:05,  6.17it/s, loss=3.02, v_num=0]
Epoch 35:  65%|██████▍   | 63/97 [00:10<00:05,  6.22it/s, loss=3.02, v_num=0]
Epoch 35:  65%|██████▍   | 63/97 [00:10<00:05,  6.19it/s, loss=3.02, v_num=0]
Epoch 35:  66%|██████▌   | 64/97 [00:10<00:05,  6.24it/s, loss=3.02, v_num=0]
Epoch 35:  66%|██████▌   | 64/97 [00:10<00:05,  6.20it/s, loss=3.02, v_num=0]
Epoch 35:  67%|██████▋   | 65/97 [00:10<00:05,  6.25it/s, loss=3.02, v_num=0]
Epoch 35:  67%|██████▋   | 65/97 [00:10<00:05,  6.22it/s, loss=3.02, v_num=0]
Epoch 35:  68%|██████▊   | 66/97 [00:10<00:04,  6.26it/s, loss=3.02, v_num=0]
Epoch 35:  68%|██████▊   | 66/97 [00:10<00:04,  6.23it/s, loss=3.02, v_num=0]
Epoch 35:  69%|██████▉   | 67/97 [00:10<00:04,  6.27it/s, loss=3.02, v_num=0]
Epoch 35:  69%|██████▉   | 67/97 [00:10<00:04,  6.24it/s, loss=3.02, v_num=0]
Epoch 35:  70%|███████   | 68/97 [00:10<00:04,  6.29it/s, loss=3.02, v_num=0]
Epoch 35:  70%|███████   | 68/97 [00:10<00:04,  6.26it/s, loss=3.02, v_num=0]
Epoch 35:  71%|███████   | 69/97 [00:10<00:04,  6.30it/s, loss=3.02, v_num=0]
Epoch 35:  71%|███████   | 69/97 [00:11<00:04,  6.27it/s, loss=3.01, v_num=0]
Epoch 35:  72%|███████▏  | 70/97 [00:11<00:04,  6.31it/s, loss=3.01, v_num=0]
Epoch 35:  72%|███████▏  | 70/97 [00:11<00:04,  6.28it/s, loss=3, v_num=0]
Epoch 35:  73%|███████▎  | 71/97 [00:11<00:04,  6.32it/s, loss=3, v_num=0]
Epoch 35:  73%|███████▎  | 71/97 [00:11<00:04,  6.29it/s, loss=3, v_num=0]
Epoch 35:  74%|███████▍  | 72/97 [00:11<00:03,  6.34it/s, loss=3, v_num=0]
Epoch 35:  74%|███████▍  | 72/97 [00:11<00:03,  6.31it/s, loss=2.99, v_num=0]
Epoch 35:  75%|███████▌  | 73/97 [00:11<00:03,  6.35it/s, loss=2.99, v_num=0]
Epoch 35:  75%|███████▌  | 73/97 [00:11<00:03,  6.32it/s, loss=2.99, v_num=0]
Epoch 35:  76%|███████▋  | 74/97 [00:11<00:03,  6.36it/s, loss=2.99, v_num=0]
Epoch 35:  76%|███████▋  | 74/97 [00:11<00:03,  6.33it/s, loss=2.99, v_num=0]
Epoch 35:  77%|███████▋  | 75/97 [00:11<00:03,  6.37it/s, loss=2.99, v_num=0]
Epoch 35:  77%|███████▋  | 75/97 [00:11<00:03,  6.34it/s, loss=2.99, v_num=0]
Epoch 35:  78%|███████▊  | 76/97 [00:11<00:03,  6.38it/s, loss=2.99, v_num=0]
Epoch 35:  78%|███████▊  | 76/97 [00:11<00:03,  6.35it/s, loss=2.97, v_num=0]
Epoch 35:  79%|███████▉  | 77/97 [00:12<00:03,  6.39it/s, loss=2.97, v_num=0]
Epoch 35:  79%|███████▉  | 77/97 [00:12<00:03,  6.36it/s, loss=2.97, v_num=0]
Epoch 35:  80%|████████  | 78/97 [00:12<00:02,  6.40it/s, loss=2.97, v_num=0]
Epoch 35:  80%|████████  | 78/97 [00:12<00:02,  6.37it/s, loss=2.97, v_num=0]
Epoch 35:  81%|████████▏ | 79/97 [00:12<00:02,  6.41it/s, loss=2.97, v_num=0]
Epoch 35:  81%|████████▏ | 79/97 [00:12<00:02,  6.38it/s, loss=2.98, v_num=0]
Epoch 35:  82%|████████▏ | 80/97 [00:12<00:02,  6.42it/s, loss=2.98, v_num=0]
Epoch 35:  82%|████████▏ | 80/97 [00:12<00:02,  6.39it/s, loss=2.98, v_num=0]
Epoch 35:  84%|████████▎ | 81/97 [00:12<00:02,  6.43it/s, loss=2.98, v_num=0]
Epoch 35:  84%|████████▎ | 81/97 [00:12<00:02,  6.40it/s, loss=2.98, v_num=0]
Epoch 35:  85%|████████▍ | 82/97 [00:12<00:02,  6.44it/s, loss=2.98, v_num=0]
Epoch 35:  85%|████████▍ | 82/97 [00:12<00:02,  6.41it/s, loss=2.97, v_num=0]
Epoch 35:  86%|████████▌ | 83/97 [00:12<00:02,  6.44it/s, loss=2.97, v_num=0]
Epoch 35:  86%|████████▌ | 83/97 [00:12<00:02,  6.41it/s, loss=2.97, v_num=0]
Epoch 35:  87%|████████▋ | 84/97 [00:13<00:02,  6.45it/s, loss=2.97, v_num=0]
Epoch 35:  87%|████████▋ | 84/97 [00:13<00:02,  6.42it/s, loss=2.98, v_num=0]
Epoch 35:  88%|████████▊ | 85/97 [00:13<00:01,  6.46it/s, loss=2.98, v_num=0]
Epoch 35:  88%|████████▊ | 85/97 [00:13<00:01,  6.43it/s, loss=2.98, v_num=0]
Epoch 35:  89%|████████▊ | 86/97 [00:13<00:01,  6.47it/s, loss=2.98, v_num=0]
Epoch 35:  89%|████████▊ | 86/97 [00:13<00:01,  6.44it/s, loss=2.98, v_num=0]
Epoch 35:  90%|████████▉ | 87/97 [00:13<00:01,  6.47it/s, loss=2.98, v_num=0]
Epoch 35:  90%|████████▉ | 87/97 [00:13<00:01,  6.45it/s, loss=2.98, v_num=0]
Epoch 35:  91%|█████████ | 88/97 [00:13<00:01,  6.48it/s, loss=2.98, v_num=0]
Epoch 35:  91%|█████████ | 88/97 [00:13<00:01,  6.46it/s, loss=2.97, v_num=0]
Epoch 35:  92%|█████████▏| 89/97 [00:13<00:01,  6.49it/s, loss=2.97, v_num=0]
Epoch 35:  92%|█████████▏| 89/97 [00:13<00:01,  6.46it/s, loss=2.97, v_num=0]
Epoch 35:  93%|█████████▎| 90/97 [00:13<00:01,  6.50it/s, loss=2.97, v_num=0]
Epoch 35:  93%|█████████▎| 90/97 [00:13<00:01,  6.47it/s, loss=2.97, v_num=0]
Epoch 35:  94%|█████████▍| 91/97 [00:13<00:00,  6.50it/s, loss=2.97, v_num=0]
Epoch 35:  94%|█████████▍| 91/97 [00:14<00:00,  6.48it/s, loss=2.97, v_num=0]
Epoch 35:  95%|█████████▍| 92/97 [00:14<00:00,  6.51it/s, loss=2.97, v_num=0]
Epoch 35:  95%|█████████▍| 92/97 [00:14<00:00,  6.48it/s, loss=2.97, v_num=0]
Epoch 35:  96%|█████████▌| 93/97 [00:14<00:00,  6.52it/s, loss=2.97, v_num=0]
Epoch 35:  96%|█████████▌| 93/97 [00:14<00:00,  6.49it/s, loss=2.99, v_num=0]
Epoch 35:  97%|█████████▋| 94/97 [00:14<00:00,  6.52it/s, loss=2.99, v_num=0]
Epoch 35:  97%|█████████▋| 94/97 [00:14<00:00,  6.50it/s, loss=2.98, v_num=0]
Epoch 35:  98%|█████████▊| 95/97 [00:14<00:00,  6.53it/s, loss=2.98, v_num=0]
Epoch 35:  98%|█████████▊| 95/97 [00:14<00:00,  6.51it/s, loss=2.98, v_num=0]
Epoch 35:  99%|█████████▉| 96/97 [00:14<00:00,  6.54it/s, loss=2.98, v_num=0]
Epoch 35:  99%|█████████▉| 96/97 [00:14<00:00,  6.51it/s, loss=2.99, v_num=0]
Epoch 35: 100%|██████████| 97/97 [00:14<00:00,  6.54it/s, loss=2.99, v_num=0]
Epoch 35: 100%|██████████| 97/97 [00:14<00:00,  6.52it/s, loss=2.99, v_num=0]
Epoch 35: 100%|██████████| 97/97 [00:14<00:00,  6.52it/s, loss=2.99, v_num=0]
Epoch 35:   0%|          | 0/97 [00:00<?, ?it/s, loss=2.99, v_num=0]
Epoch 36:   0%|          | 0/97 [00:00<?, ?it/s, loss=2.99, v_num=0]
Epoch 36:   1%|          | 1/97 [00:01<02:13,  1.39s/it, loss=2.99, v_num=0]
Epoch 36:   1%|          | 1/97 [00:01<02:18,  1.45s/it, loss=2.99, v_num=0]
Epoch 36:   2%|▏         | 2/97 [00:01<01:12,  1.31it/s, loss=2.99, v_num=0]
Epoch 36:   2%|▏         | 2/97 [00:01<01:15,  1.26it/s, loss=3, v_num=0]
Epoch 36:   3%|▎         | 3/97 [00:01<00:52,  1.79it/s, loss=3, v_num=0]
Epoch 36:   3%|▎         | 3/97 [00:01<00:54,  1.74it/s, loss=2.99, v_num=0]
Epoch 36:   4%|▍         | 4/97 [00:01<00:42,  2.21it/s, loss=2.99, v_num=0]
Epoch 36:   4%|▍         | 4/97 [00:01<00:43,  2.14it/s, loss=2.99, v_num=0]
Epoch 36:   5%|▌         | 5/97 [00:01<00:35,  2.57it/s, loss=2.99, v_num=0]
Epoch 36:   5%|▌         | 5/97 [00:02<00:36,  2.50it/s, loss=2.99, v_num=0]
Epoch 36:   6%|▌         | 6/97 [00:02<00:31,  2.88it/s, loss=2.99, v_num=0]
Epoch 36:   6%|▌         | 6/97 [00:02<00:32,  2.81it/s, loss=2.99, v_num=0]
Epoch 36:   7%|▋         | 7/97 [00:02<00:28,  3.15it/s, loss=2.99, v_num=0]
Epoch 36:   7%|▋         | 7/97 [00:02<00:29,  3.08it/s, loss=2.98, v_num=0]
Epoch 36:   8%|▊         | 8/97 [00:02<00:26,  3.40it/s, loss=2.98, v_num=0]
Epoch 36:   8%|▊         | 8/97 [00:02<00:26,  3.32it/s, loss=2.98, v_num=0]
Epoch 36:   9%|▉         | 9/97 [00:02<00:24,  3.61it/s, loss=2.98, v_num=0]
Epoch 36:   9%|▉         | 9/97 [00:02<00:24,  3.53it/s, loss=2.98, v_num=0]
Epoch 36:  10%|█         | 10/97 [00:02<00:22,  3.79it/s, loss=2.98, v_num=0]
Epoch 36:  10%|█         | 10/97 [00:02<00:23,  3.72it/s, loss=2.99, v_num=0]
Epoch 36:  11%|█▏        | 11/97 [00:02<00:21,  3.97it/s, loss=2.99, v_num=0]
Epoch 36:  11%|█▏        | 11/97 [00:02<00:22,  3.89it/s, loss=2.99, v_num=0]
Epoch 36:  12%|█▏        | 12/97 [00:02<00:20,  4.12it/s, loss=2.99, v_num=0]
Epoch 36:  12%|█▏        | 12/97 [00:02<00:21,  4.05it/s, loss=2.99, v_num=0]
Epoch 36:  13%|█▎        | 13/97 [00:03<00:19,  4.27it/s, loss=2.99, v_num=0]
Epoch 36:  13%|█▎        | 13/97 [00:03<00:20,  4.19it/s, loss=2.99, v_num=0]
Epoch 36:  14%|█▍        | 14/97 [00:03<00:18,  4.40it/s, loss=2.99, v_num=0]
Epoch 36:  14%|█▍        | 14/97 [00:03<00:19,  4.33it/s, loss=2.99, v_num=0]
Epoch 36:  15%|█▌        | 15/97 [00:03<00:18,  4.53it/s, loss=2.99, v_num=0]
Epoch 36:  15%|█▌        | 15/97 [00:03<00:18,  4.45it/s, loss=2.99, v_num=0]
Epoch 36:  16%|█▋        | 16/97 [00:03<00:17,  4.64it/s, loss=2.99, v_num=0]
Epoch 36:  16%|█▋        | 16/97 [00:03<00:17,  4.56it/s, loss=2.98, v_num=0]
Epoch 36:  18%|█▊        | 17/97 [00:03<00:16,  4.74it/s, loss=2.98, v_num=0]
Epoch 36:  18%|█▊        | 17/97 [00:03<00:17,  4.66it/s, loss=2.99, v_num=0]
Epoch 36:  19%|█▊        | 18/97 [00:03<00:16,  4.83it/s, loss=2.99, v_num=0]
Epoch 36:  19%|█▊        | 18/97 [00:03<00:16,  4.76it/s, loss=2.98, v_num=0]
Epoch 36:  20%|█▉        | 19/97 [00:03<00:15,  4.93it/s, loss=2.98, v_num=0]
Epoch 36:  20%|█▉        | 19/97 [00:03<00:16,  4.85it/s, loss=2.98, v_num=0]
Epoch 36:  21%|██        | 20/97 [00:04<00:15,  4.99it/s, loss=2.98, v_num=0]
Epoch 36:  21%|██        | 20/97 [00:04<00:15,  4.93it/s, loss=2.98, v_num=0]
Epoch 36:  22%|██▏       | 21/97 [00:04<00:14,  5.07it/s, loss=2.98, v_num=0]
Epoch 36:  22%|██▏       | 21/97 [00:04<00:15,  5.01it/s, loss=2.98, v_num=0]
Epoch 36:  23%|██▎       | 22/97 [00:04<00:14,  5.15it/s, loss=2.98, v_num=0]
Epoch 36:  23%|██▎       | 22/97 [00:04<00:14,  5.08it/s, loss=2.97, v_num=0]
Epoch 36:  24%|██▎       | 23/97 [00:04<00:14,  5.21it/s, loss=2.97, v_num=0]
Epoch 36:  24%|██▎       | 23/97 [00:04<00:14,  5.14it/s, loss=2.98, v_num=0]
Epoch 36:  25%|██▍       | 24/97 [00:04<00:13,  5.28it/s, loss=2.98, v_num=0]
Epoch 36:  25%|██▍       | 24/97 [00:04<00:14,  5.21it/s, loss=2.98, v_num=0]
Epoch 36:  26%|██▌       | 25/97 [00:04<00:13,  5.33it/s, loss=2.98, v_num=0]
Epoch 36:  26%|██▌       | 25/97 [00:04<00:13,  5.27it/s, loss=2.98, v_num=0]
Epoch 36:  27%|██▋       | 26/97 [00:04<00:13,  5.38it/s, loss=2.98, v_num=0]
Epoch 36:  27%|██▋       | 26/97 [00:04<00:13,  5.33it/s, loss=2.97, v_num=0]
Epoch 36:  28%|██▊       | 27/97 [00:04<00:12,  5.44it/s, loss=2.97, v_num=0]
Epoch 36:  28%|██▊       | 27/97 [00:05<00:13,  5.38it/s, loss=2.98, v_num=0]
Epoch 36:  29%|██▉       | 28/97 [00:05<00:12,  5.49it/s, loss=2.98, v_num=0]
Epoch 36:  29%|██▉       | 28/97 [00:05<00:12,  5.43it/s, loss=2.98, v_num=0]
Epoch 36:  30%|██▉       | 29/97 [00:05<00:12,  5.54it/s, loss=2.98, v_num=0]
Epoch 36:  30%|██▉       | 29/97 [00:05<00:12,  5.48it/s, loss=2.98, v_num=0]
Epoch 36:  31%|███       | 30/97 [00:05<00:12,  5.58it/s, loss=2.98, v_num=0]
Epoch 36:  31%|███       | 30/97 [00:05<00:12,  5.52it/s, loss=2.99, v_num=0]
Epoch 36:  32%|███▏      | 31/97 [00:05<00:11,  5.62it/s, loss=2.99, v_num=0]
Epoch 36:  32%|███▏      | 31/97 [00:05<00:11,  5.57it/s, loss=2.99, v_num=0]
Epoch 36:  33%|███▎      | 32/97 [00:05<00:11,  5.66it/s, loss=2.99, v_num=0]
Epoch 36:  33%|███▎      | 32/97 [00:05<00:11,  5.61it/s, loss=2.99, v_num=0]
Epoch 36:  34%|███▍      | 33/97 [00:05<00:11,  5.70it/s, loss=2.99, v_num=0]
Epoch 36:  34%|███▍      | 33/97 [00:05<00:11,  5.65it/s, loss=2.99, v_num=0]
Epoch 36:  35%|███▌      | 34/97 [00:05<00:10,  5.74it/s, loss=2.99, v_num=0]
Epoch 36:  35%|███▌      | 34/97 [00:05<00:11,  5.69it/s, loss=3, v_num=0]
Epoch 36:  36%|███▌      | 35/97 [00:06<00:10,  5.78it/s, loss=3, v_num=0]
Epoch 36:  36%|███▌      | 35/97 [00:06<00:10,  5.72it/s, loss=3.01, v_num=0]
Epoch 36:  37%|███▋      | 36/97 [00:06<00:10,  5.81it/s, loss=3.01, v_num=0]
Epoch 36:  37%|███▋      | 36/97 [00:06<00:10,  5.76it/s, loss=3, v_num=0]
Epoch 36:  38%|███▊      | 37/97 [00:06<00:10,  5.84it/s, loss=3, v_num=0]
Epoch 36:  38%|███▊      | 37/97 [00:06<00:10,  5.79it/s, loss=3, v_num=0]
Epoch 36:  39%|███▉      | 38/97 [00:06<00:10,  5.87it/s, loss=3, v_num=0]
Epoch 36:  39%|███▉      | 38/97 [00:06<00:10,  5.82it/s, loss=3.01, v_num=0]
Epoch 36:  40%|████      | 39/97 [00:06<00:09,  5.90it/s, loss=3.01, v_num=0]
Epoch 36:  40%|████      | 39/97 [00:06<00:09,  5.85it/s, loss=3.01, v_num=0]
Epoch 36:  41%|████      | 40/97 [00:06<00:09,  5.93it/s, loss=3.01, v_num=0]
Epoch 36:  41%|████      | 40/97 [00:06<00:09,  5.88it/s, loss=3.01, v_num=0]
Epoch 36:  42%|████▏     | 41/97 [00:06<00:09,  5.95it/s, loss=3.01, v_num=0]
Epoch 36:  42%|████▏     | 41/97 [00:06<00:09,  5.91it/s, loss=3.01, v_num=0]
Epoch 36:  43%|████▎     | 42/97 [00:07<00:09,  5.98it/s, loss=3.01, v_num=0]
Epoch 36:  43%|████▎     | 42/97 [00:07<00:09,  5.93it/s, loss=3.01, v_num=0]
Epoch 36:  44%|████▍     | 43/97 [00:07<00:08,  6.01it/s, loss=3.01, v_num=0]
Epoch 36:  44%|████▍     | 43/97 [00:07<00:09,  5.96it/s, loss=3, v_num=0]
Epoch 36:  45%|████▌     | 44/97 [00:07<00:08,  6.03it/s, loss=3, v_num=0]
Epoch 36:  45%|████▌     | 44/97 [00:07<00:08,  5.99it/s, loss=3, v_num=0]
Epoch 36:  46%|████▋     | 45/97 [00:07<00:08,  6.05it/s, loss=3, v_num=0]
Epoch 36:  46%|████▋     | 45/97 [00:07<00:08,  6.01it/s, loss=3, v_num=0]
Epoch 36:  47%|████▋     | 46/97 [00:07<00:08,  6.08it/s, loss=3, v_num=0]
Epoch 36:  47%|████▋     | 46/97 [00:07<00:08,  6.03it/s, loss=3.01, v_num=0]
Epoch 36:  48%|████▊     | 47/97 [00:07<00:08,  6.10it/s, loss=3.01, v_num=0]
Epoch 36:  48%|████▊     | 47/97 [00:07<00:08,  6.06it/s, loss=3.01, v_num=0]
Epoch 36:  49%|████▉     | 48/97 [00:07<00:08,  6.12it/s, loss=3.01, v_num=0]
Epoch 36:  49%|████▉     | 48/97 [00:07<00:08,  6.08it/s, loss=3.01, v_num=0]
Epoch 36:  51%|█████     | 49/97 [00:07<00:07,  6.14it/s, loss=3.01, v_num=0]
Epoch 36:  51%|█████     | 49/97 [00:08<00:07,  6.10it/s, loss=3.01, v_num=0]
Epoch 36:  52%|█████▏    | 50/97 [00:08<00:07,  6.16it/s, loss=3.01, v_num=0]
Epoch 36:  52%|█████▏    | 50/97 [00:08<00:07,  6.12it/s, loss=3, v_num=0]
Epoch 36:  53%|█████▎    | 51/97 [00:08<00:07,  6.18it/s, loss=3, v_num=0]
Epoch 36:  53%|█████▎    | 51/97 [00:08<00:07,  6.14it/s, loss=3, v_num=0]
Epoch 36:  54%|█████▎    | 52/97 [00:08<00:07,  6.20it/s, loss=3, v_num=0]
Epoch 36:  54%|█████▎    | 52/97 [00:08<00:07,  6.16it/s, loss=3.01, v_num=0]
Epoch 36:  55%|█████▍    | 53/97 [00:08<00:07,  6.22it/s, loss=3.01, v_num=0]
Epoch 36:  55%|█████▍    | 53/97 [00:08<00:07,  6.18it/s, loss=3, v_num=0]
Epoch 36:  56%|█████▌    | 54/97 [00:08<00:06,  6.23it/s, loss=3, v_num=0]
Epoch 36:  56%|█████▌    | 54/97 [00:08<00:06,  6.19it/s, loss=3, v_num=0]
Epoch 36:  57%|█████▋    | 55/97 [00:08<00:06,  6.25it/s, loss=3, v_num=0]
Epoch 36:  57%|█████▋    | 55/97 [00:08<00:06,  6.21it/s, loss=3, v_num=0]
Epoch 36:  58%|█████▊    | 56/97 [00:08<00:06,  6.27it/s, loss=3, v_num=0]
Epoch 36:  58%|█████▊    | 56/97 [00:08<00:06,  6.23it/s, loss=3, v_num=0]
Epoch 36:  59%|█████▉    | 57/97 [00:09<00:06,  6.28it/s, loss=3, v_num=0]
Epoch 36:  59%|█████▉    | 57/97 [00:09<00:06,  6.24it/s, loss=3, v_num=0]
Epoch 36:  60%|█████▉    | 58/97 [00:09<00:06,  6.30it/s, loss=3, v_num=0]
Epoch 36:  60%|█████▉    | 58/97 [00:09<00:06,  6.26it/s, loss=2.99, v_num=0]
Epoch 36:  61%|██████    | 59/97 [00:09<00:06,  6.31it/s, loss=2.99, v_num=0]
Epoch 36:  61%|██████    | 59/97 [00:09<00:06,  6.28it/s, loss=3, v_num=0]
Epoch 36:  62%|██████▏   | 60/97 [00:09<00:05,  6.33it/s, loss=3, v_num=0]
Epoch 36:  62%|██████▏   | 60/97 [00:09<00:05,  6.29it/s, loss=3, v_num=0]
Epoch 36:  63%|██████▎   | 61/97 [00:09<00:05,  6.34it/s, loss=3, v_num=0]
Epoch 36:  63%|██████▎   | 61/97 [00:09<00:05,  6.31it/s, loss=2.99, v_num=0]
Epoch 36:  64%|██████▍   | 62/97 [00:09<00:05,  6.36it/s, loss=2.99, v_num=0]
Epoch 36:  64%|██████▍   | 62/97 [00:09<00:05,  6.32it/s, loss=2.99, v_num=0]
Epoch 36:  65%|██████▍   | 63/97 [00:09<00:05,  6.37it/s, loss=2.99, v_num=0]
Epoch 36:  65%|██████▍   | 63/97 [00:09<00:05,  6.33it/s, loss=2.99, v_num=0]
Epoch 36:  66%|██████▌   | 64/97 [00:10<00:05,  6.38it/s, loss=2.99, v_num=0]
Epoch 36:  66%|██████▌   | 64/97 [00:10<00:05,  6.35it/s, loss=2.99, v_num=0]
Epoch 36:  67%|██████▋   | 65/97 [00:10<00:05,  6.40it/s, loss=2.99, v_num=0]
Epoch 36:  67%|██████▋   | 65/97 [00:10<00:05,  6.36it/s, loss=2.98, v_num=0]
Epoch 36:  68%|██████▊   | 66/97 [00:10<00:04,  6.41it/s, loss=2.98, v_num=0]
Epoch 36:  68%|██████▊   | 66/97 [00:10<00:04,  6.37it/s, loss=2.98, v_num=0]
Epoch 36:  69%|██████▉   | 67/97 [00:10<00:04,  6.42it/s, loss=2.98, v_num=0]
Epoch 36:  69%|██████▉   | 67/97 [00:10<00:04,  6.39it/s, loss=2.98, v_num=0]
Epoch 36:  70%|███████   | 68/97 [00:10<00:04,  6.43it/s, loss=2.98, v_num=0]
Epoch 36:  70%|███████   | 68/97 [00:10<00:04,  6.40it/s, loss=2.97, v_num=0]
Epoch 36:  71%|███████   | 69/97 [00:10<00:04,  6.44it/s, loss=2.97, v_num=0]
Epoch 36:  71%|███████   | 69/97 [00:10<00:04,  6.41it/s, loss=2.97, v_num=0]
Epoch 36:  72%|███████▏  | 70/97 [00:10<00:04,  6.45it/s, loss=2.97, v_num=0]
Epoch 36:  72%|███████▏  | 70/97 [00:10<00:04,  6.42it/s, loss=2.97, v_num=0]
Epoch 36:  73%|███████▎  | 71/97 [00:10<00:04,  6.47it/s, loss=2.97, v_num=0]
Epoch 36:  73%|███████▎  | 71/97 [00:11<00:04,  6.43it/s, loss=2.97, v_num=0]
Epoch 36:  74%|███████▍  | 72/97 [00:11<00:03,  6.47it/s, loss=2.97, v_num=0]
Epoch 36:  74%|███████▍  | 72/97 [00:11<00:03,  6.44it/s, loss=2.96, v_num=0]
Epoch 36:  75%|███████▌  | 73/97 [00:11<00:03,  6.49it/s, loss=2.96, v_num=0]
Epoch 36:  75%|███████▌  | 73/97 [00:11<00:03,  6.45it/s, loss=2.96, v_num=0]
Epoch 36:  76%|███████▋  | 74/97 [00:11<00:03,  6.49it/s, loss=2.96, v_num=0]
Epoch 36:  76%|███████▋  | 74/97 [00:11<00:03,  6.46it/s, loss=2.96, v_num=0]
Epoch 36:  77%|███████▋  | 75/97 [00:11<00:03,  6.50it/s, loss=2.96, v_num=0]
Epoch 36:  77%|███████▋  | 75/97 [00:11<00:03,  6.47it/s, loss=2.95, v_num=0]
Epoch 36:  78%|███████▊  | 76/97 [00:11<00:03,  6.51it/s, loss=2.95, v_num=0]
Epoch 36:  78%|███████▊  | 76/97 [00:11<00:03,  6.48it/s, loss=2.95, v_num=0]
Epoch 36:  79%|███████▉  | 77/97 [00:11<00:03,  6.52it/s, loss=2.95, v_num=0]
Epoch 36:  79%|███████▉  | 77/97 [00:11<00:03,  6.49it/s, loss=2.96, v_num=0]
Epoch 36:  80%|████████  | 78/97 [00:11<00:02,  6.53it/s, loss=2.96, v_num=0]
Epoch 36:  80%|████████  | 78/97 [00:11<00:02,  6.50it/s, loss=2.97, v_num=0]
Epoch 36:  81%|████████▏ | 79/97 [00:12<00:02,  6.54it/s, loss=2.97, v_num=0]
Epoch 36:  81%|████████▏ | 79/97 [00:12<00:02,  6.51it/s, loss=2.96, v_num=0]
Epoch 36:  82%|████████▏ | 80/97 [00:12<00:02,  6.55it/s, loss=2.96, v_num=0]
Epoch 36:  82%|████████▏ | 80/97 [00:12<00:02,  6.52it/s, loss=2.95, v_num=0]
Epoch 36:  84%|████████▎ | 81/97 [00:12<00:02,  6.56it/s, loss=2.95, v_num=0]
Epoch 36:  84%|████████▎ | 81/97 [00:12<00:02,  6.53it/s, loss=2.96, v_num=0]
Epoch 36:  85%|████████▍ | 82/97 [00:12<00:02,  6.57it/s, loss=2.96, v_num=0]
Epoch 36:  85%|████████▍ | 82/97 [00:12<00:02,  6.54it/s, loss=2.96, v_num=0]
Epoch 36:  86%|████████▌ | 83/97 [00:12<00:02,  6.57it/s, loss=2.96, v_num=0]
Epoch 36:  86%|████████▌ | 83/97 [00:12<00:02,  6.54it/s, loss=2.96, v_num=0]
Epoch 36:  87%|████████▋ | 84/97 [00:12<00:01,  6.58it/s, loss=2.96, v_num=0]
Epoch 36:  87%|████████▋ | 84/97 [00:12<00:01,  6.55it/s, loss=2.95, v_num=0]
Epoch 36:  88%|████████▊ | 85/97 [00:12<00:01,  6.59it/s, loss=2.95, v_num=0]
Epoch 36:  88%|████████▊ | 85/97 [00:12<00:01,  6.56it/s, loss=2.95, v_num=0]
Epoch 36:  89%|████████▊ | 86/97 [00:13<00:01,  6.60it/s, loss=2.95, v_num=0]
Epoch 36:  89%|████████▊ | 86/97 [00:13<00:01,  6.57it/s, loss=2.95, v_num=0]
Epoch 36:  90%|████████▉ | 87/97 [00:13<00:01,  6.61it/s, loss=2.95, v_num=0]
Epoch 36:  90%|████████▉ | 87/97 [00:13<00:01,  6.58it/s, loss=2.95, v_num=0]
Epoch 36:  91%|█████████ | 88/97 [00:13<00:01,  6.61it/s, loss=2.95, v_num=0]
Epoch 36:  91%|█████████ | 88/97 [00:13<00:01,  6.59it/s, loss=2.94, v_num=0]
Epoch 36:  92%|█████████▏| 89/97 [00:13<00:01,  6.62it/s, loss=2.94, v_num=0]
Epoch 36:  92%|█████████▏| 89/97 [00:13<00:01,  6.59it/s, loss=2.95, v_num=0]
Epoch 36:  93%|█████████▎| 90/97 [00:13<00:01,  6.63it/s, loss=2.95, v_num=0]
Epoch 36:  93%|█████████▎| 90/97 [00:13<00:01,  6.60it/s, loss=2.95, v_num=0]
Epoch 36:  94%|█████████▍| 91/97 [00:13<00:00,  6.64it/s, loss=2.95, v_num=0]
Epoch 36:  94%|█████████▍| 91/97 [00:13<00:00,  6.61it/s, loss=2.95, v_num=0]
Epoch 36:  95%|█████████▍| 92/97 [00:13<00:00,  6.64it/s, loss=2.95, v_num=0]
Epoch 36:  95%|█████████▍| 92/97 [00:13<00:00,  6.62it/s, loss=2.95, v_num=0]
Epoch 36:  96%|█████████▌| 93/97 [00:13<00:00,  6.65it/s, loss=2.95, v_num=0]
Epoch 36:  96%|█████████▌| 93/97 [00:14<00:00,  6.62it/s, loss=2.95, v_num=0]
Epoch 36:  97%|█████████▋| 94/97 [00:14<00:00,  6.65it/s, loss=2.95, v_num=0]
Epoch 36:  97%|█████████▋| 94/97 [00:14<00:00,  6.63it/s, loss=2.95, v_num=0]
Epoch 36:  98%|█████████▊| 95/97 [00:14<00:00,  6.66it/s, loss=2.95, v_num=0]
Epoch 36:  98%|█████████▊| 95/97 [00:14<00:00,  6.63it/s, loss=2.95, v_num=0]
Epoch 36:  99%|█████████▉| 96/97 [00:14<00:00,  6.67it/s, loss=2.95, v_num=0]
Epoch 36:  99%|█████████▉| 96/97 [00:14<00:00,  6.64it/s, loss=2.95, v_num=0]
Epoch 36: 100%|██████████| 97/97 [00:14<00:00,  6.67it/s, loss=2.95, v_num=0]
Epoch 36: 100%|██████████| 97/97 [00:14<00:00,  6.65it/s, loss=2.95, v_num=0]
Epoch 36: 100%|██████████| 97/97 [00:14<00:00,  6.65it/s, loss=2.95, v_num=0]
Epoch 36:   0%|          | 0/97 [00:00<?, ?it/s, loss=2.95, v_num=0]
Epoch 37:   0%|          | 0/97 [00:00<?, ?it/s, loss=2.95, v_num=0]
Epoch 37:   1%|          | 1/97 [00:01<02:15,  1.41s/it, loss=2.95, v_num=0]
Epoch 37:   1%|          | 1/97 [00:01<02:20,  1.47s/it, loss=2.94, v_num=0]
Epoch 37:   2%|▏         | 2/97 [00:01<01:13,  1.29it/s, loss=2.94, v_num=0]
Epoch 37:   2%|▏         | 2/97 [00:01<01:16,  1.25it/s, loss=2.95, v_num=0]
Epoch 37:   3%|▎         | 3/97 [00:01<00:52,  1.78it/s, loss=2.95, v_num=0]
Epoch 37:   3%|▎         | 3/97 [00:01<00:54,  1.73it/s, loss=2.95, v_num=0]
Epoch 37:   4%|▍         | 4/97 [00:01<00:42,  2.20it/s, loss=2.95, v_num=0]
Epoch 37:   4%|▍         | 4/97 [00:01<00:43,  2.13it/s, loss=2.94, v_num=0]
Epoch 37:   5%|▌         | 5/97 [00:01<00:36,  2.55it/s, loss=2.94, v_num=0]
Epoch 37:   5%|▌         | 5/97 [00:02<00:37,  2.49it/s, loss=2.95, v_num=0]
Epoch 37:   6%|▌         | 6/97 [00:02<00:31,  2.86it/s, loss=2.95, v_num=0]
Epoch 37:   6%|▌         | 6/97 [00:02<00:32,  2.79it/s, loss=2.96, v_num=0]
Epoch 37:   7%|▋         | 7/97 [00:02<00:28,  3.14it/s, loss=2.96, v_num=0]
Epoch 37:   7%|▋         | 7/97 [00:02<00:29,  3.06it/s, loss=2.96, v_num=0]
Epoch 37:   8%|▊         | 8/97 [00:02<00:26,  3.38it/s, loss=2.96, v_num=0]
Epoch 37:   8%|▊         | 8/97 [00:02<00:26,  3.30it/s, loss=2.96, v_num=0]
Epoch 37:   9%|▉         | 9/97 [00:02<00:24,  3.58it/s, loss=2.96, v_num=0]
Epoch 37:   9%|▉         | 9/97 [00:02<00:25,  3.50it/s, loss=2.96, v_num=0]
Epoch 37:  10%|█         | 10/97 [00:02<00:23,  3.77it/s, loss=2.96, v_num=0]
Epoch 37:  10%|█         | 10/97 [00:02<00:23,  3.69it/s, loss=2.97, v_num=0]
Epoch 37:  11%|█▏        | 11/97 [00:02<00:21,  3.94it/s, loss=2.97, v_num=0]
Epoch 37:  11%|█▏        | 11/97 [00:02<00:22,  3.87it/s, loss=2.97, v_num=0]
Epoch 37:  12%|█▏        | 12/97 [00:02<00:20,  4.10it/s, loss=2.97, v_num=0]
Epoch 37:  12%|█▏        | 12/97 [00:02<00:21,  4.02it/s, loss=2.97, v_num=0]
Epoch 37:  13%|█▎        | 13/97 [00:03<00:19,  4.25it/s, loss=2.97, v_num=0]
Epoch 37:  13%|█▎        | 13/97 [00:03<00:20,  4.17it/s, loss=2.97, v_num=0]
Epoch 37:  14%|█▍        | 14/97 [00:03<00:18,  4.38it/s, loss=2.97, v_num=0]
Epoch 37:  14%|█▍        | 14/97 [00:03<00:19,  4.30it/s, loss=2.97, v_num=0]
Epoch 37:  15%|█▌        | 15/97 [00:03<00:18,  4.50it/s, loss=2.97, v_num=0]
Epoch 37:  15%|█▌        | 15/97 [00:03<00:18,  4.42it/s, loss=2.97, v_num=0]
Epoch 37:  16%|█▋        | 16/97 [00:03<00:17,  4.62it/s, loss=2.97, v_num=0]
Epoch 37:  16%|█▋        | 16/97 [00:03<00:17,  4.54it/s, loss=2.97, v_num=0]
Epoch 37:  18%|█▊        | 17/97 [00:03<00:16,  4.71it/s, loss=2.97, v_num=0]
Epoch 37:  18%|█▊        | 17/97 [00:03<00:17,  4.64it/s, loss=2.96, v_num=0]
Epoch 37:  19%|█▊        | 18/97 [00:03<00:16,  4.80it/s, loss=2.96, v_num=0]
Epoch 37:  19%|█▊        | 18/97 [00:03<00:16,  4.73it/s, loss=2.96, v_num=0]
Epoch 37:  20%|█▉        | 19/97 [00:03<00:15,  4.90it/s, loss=2.96, v_num=0]
Epoch 37:  20%|█▉        | 19/97 [00:03<00:16,  4.83it/s, loss=2.96, v_num=0]
Epoch 37:  21%|██        | 20/97 [00:04<00:15,  4.98it/s, loss=2.96, v_num=0]
Epoch 37:  21%|██        | 20/97 [00:04<00:15,  4.91it/s, loss=2.95, v_num=0]
Epoch 37:  22%|██▏       | 21/97 [00:04<00:15,  5.06it/s, loss=2.95, v_num=0]
Epoch 37:  22%|██▏       | 21/97 [00:04<00:15,  4.99it/s, loss=2.95, v_num=0]
Epoch 37:  23%|██▎       | 22/97 [00:04<00:14,  5.13it/s, loss=2.95, v_num=0]
Epoch 37:  23%|██▎       | 22/97 [00:04<00:14,  5.06it/s, loss=2.96, v_num=0]
Epoch 37:  24%|██▎       | 23/97 [00:04<00:14,  5.20it/s, loss=2.96, v_num=0]
Epoch 37:  24%|██▎       | 23/97 [00:04<00:14,  5.13it/s, loss=2.96, v_num=0]
Epoch 37:  25%|██▍       | 24/97 [00:04<00:13,  5.26it/s, loss=2.96, v_num=0]
Epoch 37:  25%|██▍       | 24/97 [00:04<00:14,  5.19it/s, loss=2.96, v_num=0]
Epoch 37:  26%|██▌       | 25/97 [00:04<00:13,  5.31it/s, loss=2.96, v_num=0]
Epoch 37:  26%|██▌       | 25/97 [00:04<00:13,  5.25it/s, loss=2.95, v_num=0]
Epoch 37:  27%|██▋       | 26/97 [00:04<00:13,  5.37it/s, loss=2.95, v_num=0]
Epoch 37:  27%|██▋       | 26/97 [00:04<00:13,  5.31it/s, loss=2.95, v_num=0]
Epoch 37:  28%|██▊       | 27/97 [00:04<00:12,  5.43it/s, loss=2.95, v_num=0]
Epoch 37:  28%|██▊       | 27/97 [00:05<00:13,  5.37it/s, loss=2.95, v_num=0]
Epoch 37:  29%|██▉       | 28/97 [00:05<00:12,  5.48it/s, loss=2.95, v_num=0]
Epoch 37:  29%|██▉       | 28/97 [00:05<00:12,  5.42it/s, loss=2.95, v_num=0]
Epoch 37:  30%|██▉       | 29/97 [00:05<00:12,  5.52it/s, loss=2.95, v_num=0]
Epoch 37:  30%|██▉       | 29/97 [00:05<00:12,  5.47it/s, loss=2.94, v_num=0]
Epoch 37:  31%|███       | 30/97 [00:05<00:12,  5.57it/s, loss=2.94, v_num=0]
Epoch 37:  31%|███       | 30/97 [00:05<00:12,  5.51it/s, loss=2.94, v_num=0]
Epoch 37:  32%|███▏      | 31/97 [00:05<00:11,  5.61it/s, loss=2.94, v_num=0]
Epoch 37:  32%|███▏      | 31/97 [00:05<00:11,  5.56it/s, loss=2.93, v_num=0]
Epoch 37:  33%|███▎      | 32/97 [00:05<00:11,  5.65it/s, loss=2.93, v_num=0]
Epoch 37:  33%|███▎      | 32/97 [00:05<00:11,  5.60it/s, loss=2.92, v_num=0]
Epoch 37:  34%|███▍      | 33/97 [00:05<00:11,  5.69it/s, loss=2.92, v_num=0]
Epoch 37:  34%|███▍      | 33/97 [00:05<00:11,  5.64it/s, loss=2.92, v_num=0]
Epoch 37:  35%|███▌      | 34/97 [00:05<00:10,  5.73it/s, loss=2.92, v_num=0]
Epoch 37:  35%|███▌      | 34/97 [00:05<00:11,  5.68it/s, loss=2.91, v_num=0]
Epoch 37:  36%|███▌      | 35/97 [00:06<00:10,  5.77it/s, loss=2.91, v_num=0]
Epoch 37:  36%|███▌      | 35/97 [00:06<00:10,  5.72it/s, loss=2.92, v_num=0]
Epoch 37:  37%|███▋      | 36/97 [00:06<00:10,  5.80it/s, loss=2.92, v_num=0]
Epoch 37:  37%|███▋      | 36/97 [00:06<00:10,  5.75it/s, loss=2.92, v_num=0]
Epoch 37:  38%|███▊      | 37/97 [00:06<00:10,  5.83it/s, loss=2.92, v_num=0]
Epoch 37:  38%|███▊      | 37/97 [00:06<00:10,  5.78it/s, loss=2.93, v_num=0]
Epoch 37:  39%|███▉      | 38/97 [00:06<00:10,  5.86it/s, loss=2.93, v_num=0]
Epoch 37:  39%|███▉      | 38/97 [00:06<00:10,  5.82it/s, loss=2.93, v_num=0]
Epoch 37:  40%|████      | 39/97 [00:06<00:09,  5.89it/s, loss=2.93, v_num=0]
Epoch 37:  40%|████      | 39/97 [00:06<00:09,  5.85it/s, loss=2.93, v_num=0]
Epoch 37:  41%|████      | 40/97 [00:06<00:09,  5.92it/s, loss=2.93, v_num=0]
Epoch 37:  41%|████      | 40/97 [00:06<00:09,  5.87it/s, loss=2.93, v_num=0]
Epoch 37:  42%|████▏     | 41/97 [00:06<00:09,  5.95it/s, loss=2.93, v_num=0]
Epoch 37:  42%|████▏     | 41/97 [00:06<00:09,  5.90it/s, loss=2.93, v_num=0]
Epoch 37:  43%|████▎     | 42/97 [00:07<00:09,  5.98it/s, loss=2.93, v_num=0]
Epoch 37:  43%|████▎     | 42/97 [00:07<00:09,  5.93it/s, loss=2.93, v_num=0]
Epoch 37:  44%|████▍     | 43/97 [00:07<00:08,  6.00it/s, loss=2.93, v_num=0]
Epoch 37:  44%|████▍     | 43/97 [00:07<00:09,  5.95it/s, loss=2.93, v_num=0]
Epoch 37:  45%|████▌     | 44/97 [00:07<00:08,  6.02it/s, loss=2.93, v_num=0]
Epoch 37:  45%|████▌     | 44/97 [00:07<00:08,  5.98it/s, loss=2.93, v_num=0]
Epoch 37:  46%|████▋     | 45/97 [00:07<00:08,  6.05it/s, loss=2.93, v_num=0]
Epoch 37:  46%|████▋     | 45/97 [00:07<00:08,  6.00it/s, loss=2.94, v_num=0]
Epoch 37:  47%|████▋     | 46/97 [00:07<00:08,  6.07it/s, loss=2.94, v_num=0]
Epoch 37:  47%|████▋     | 46/97 [00:07<00:08,  6.03it/s, loss=2.94, v_num=0]
Epoch 37:  48%|████▊     | 47/97 [00:07<00:08,  6.09it/s, loss=2.94, v_num=0]
Epoch 37:  48%|████▊     | 47/97 [00:07<00:08,  6.05it/s, loss=2.93, v_num=0]
Epoch 37:  49%|████▉     | 48/97 [00:07<00:08,  6.11it/s, loss=2.93, v_num=0]
Epoch 37:  49%|████▉     | 48/97 [00:07<00:08,  6.07it/s, loss=2.93, v_num=0]
Epoch 37:  51%|█████     | 49/97 [00:07<00:07,  6.13it/s, loss=2.93, v_num=0]
Epoch 37:  51%|█████     | 49/97 [00:08<00:07,  6.09it/s, loss=2.94, v_num=0]
Epoch 37:  52%|█████▏    | 50/97 [00:08<00:07,  6.15it/s, loss=2.94, v_num=0]
Epoch 37:  52%|█████▏    | 50/97 [00:08<00:07,  6.11it/s, loss=2.93, v_num=0]
Epoch 37:  53%|█████▎    | 51/97 [00:08<00:07,  6.17it/s, loss=2.93, v_num=0]
Epoch 37:  53%|█████▎    | 51/97 [00:08<00:07,  6.13it/s, loss=2.94, v_num=0]
Epoch 37:  54%|█████▎    | 52/97 [00:08<00:07,  6.19it/s, loss=2.94, v_num=0]
Epoch 37:  54%|█████▎    | 52/97 [00:08<00:07,  6.15it/s, loss=2.94, v_num=0]
Epoch 37:  55%|█████▍    | 53/97 [00:08<00:07,  6.20it/s, loss=2.94, v_num=0]
Epoch 37:  55%|█████▍    | 53/97 [00:08<00:07,  6.16it/s, loss=2.94, v_num=0]
Epoch 37:  56%|█████▌    | 54/97 [00:08<00:06,  6.22it/s, loss=2.94, v_num=0]
Epoch 37:  56%|█████▌    | 54/97 [00:08<00:06,  6.18it/s, loss=2.94, v_num=0]
Epoch 37:  57%|█████▋    | 55/97 [00:08<00:06,  6.23it/s, loss=2.94, v_num=0]
Epoch 37:  57%|█████▋    | 55/97 [00:08<00:06,  6.19it/s, loss=2.94, v_num=0]
Epoch 37:  58%|█████▊    | 56/97 [00:08<00:06,  6.25it/s, loss=2.94, v_num=0]
Epoch 37:  58%|█████▊    | 56/97 [00:09<00:06,  6.21it/s, loss=2.94, v_num=0]
Epoch 37:  59%|█████▉    | 57/97 [00:09<00:06,  6.26it/s, loss=2.94, v_num=0]
Epoch 37:  59%|█████▉    | 57/97 [00:09<00:06,  6.22it/s, loss=2.94, v_num=0]
Epoch 37:  60%|█████▉    | 58/97 [00:09<00:06,  6.28it/s, loss=2.94, v_num=0]
Epoch 37:  60%|█████▉    | 58/97 [00:09<00:06,  6.24it/s, loss=2.93, v_num=0]
Epoch 37:  61%|██████    | 59/97 [00:09<00:06,  6.29it/s, loss=2.93, v_num=0]
Epoch 37:  61%|██████    | 59/97 [00:09<00:06,  6.26it/s, loss=2.93, v_num=0]
Epoch 37:  62%|██████▏   | 60/97 [00:09<00:05,  6.31it/s, loss=2.93, v_num=0]
Epoch 37:  62%|██████▏   | 60/97 [00:09<00:05,  6.27it/s, loss=2.93, v_num=0]
Epoch 37:  63%|██████▎   | 61/97 [00:09<00:05,  6.32it/s, loss=2.93, v_num=0]
Epoch 37:  63%|██████▎   | 61/97 [00:09<00:05,  6.28it/s, loss=2.93, v_num=0]
Epoch 37:  64%|██████▍   | 62/97 [00:09<00:05,  6.33it/s, loss=2.93, v_num=0]
Epoch 37:  64%|██████▍   | 62/97 [00:09<00:05,  6.30it/s, loss=2.92, v_num=0]
Epoch 37:  65%|██████▍   | 63/97 [00:09<00:05,  6.35it/s, loss=2.92, v_num=0]
Epoch 37:  65%|██████▍   | 63/97 [00:09<00:05,  6.31it/s, loss=2.92, v_num=0]
Epoch 37:  66%|██████▌   | 64/97 [00:10<00:05,  6.36it/s, loss=2.92, v_num=0]
Epoch 37:  66%|██████▌   | 64/97 [00:10<00:05,  6.32it/s, loss=2.91, v_num=0]
Epoch 37:  67%|██████▋   | 65/97 [00:10<00:05,  6.37it/s, loss=2.91, v_num=0]
Epoch 37:  67%|██████▋   | 65/97 [00:10<00:05,  6.34it/s, loss=2.91, v_num=0]
Epoch 37:  68%|██████▊   | 66/97 [00:10<00:04,  6.38it/s, loss=2.91, v_num=0]
Epoch 37:  68%|██████▊   | 66/97 [00:10<00:04,  6.35it/s, loss=2.91, v_num=0]
Epoch 37:  69%|██████▉   | 67/97 [00:10<00:04,  6.40it/s, loss=2.91, v_num=0]
Epoch 37:  69%|██████▉   | 67/97 [00:10<00:04,  6.36it/s, loss=2.91, v_num=0]
Epoch 37:  70%|███████   | 68/97 [00:10<00:04,  6.41it/s, loss=2.91, v_num=0]
Epoch 37:  70%|███████   | 68/97 [00:10<00:04,  6.37it/s, loss=2.91, v_num=0]
Epoch 37:  71%|███████   | 69/97 [00:10<00:04,  6.42it/s, loss=2.91, v_num=0]
Epoch 37:  71%|███████   | 69/97 [00:10<00:04,  6.39it/s, loss=2.9, v_num=0]
Epoch 37:  72%|███████▏  | 70/97 [00:10<00:04,  6.43it/s, loss=2.9, v_num=0]
Epoch 37:  72%|███████▏  | 70/97 [00:10<00:04,  6.40it/s, loss=2.91, v_num=0]
Epoch 37:  73%|███████▎  | 71/97 [00:11<00:04,  6.44it/s, loss=2.91, v_num=0]
Epoch 37:  73%|███████▎  | 71/97 [00:11<00:04,  6.41it/s, loss=2.91, v_num=0]
Epoch 37:  74%|███████▍  | 72/97 [00:11<00:03,  6.45it/s, loss=2.91, v_num=0]
Epoch 37:  74%|███████▍  | 72/97 [00:11<00:03,  6.42it/s, loss=2.9, v_num=0]
Epoch 37:  75%|███████▌  | 73/97 [00:11<00:03,  6.46it/s, loss=2.9, v_num=0]
Epoch 37:  75%|███████▌  | 73/97 [00:11<00:03,  6.43it/s, loss=2.9, v_num=0]
Epoch 37:  76%|███████▋  | 74/97 [00:11<00:03,  6.47it/s, loss=2.9, v_num=0]
Epoch 37:  76%|███████▋  | 74/97 [00:11<00:03,  6.44it/s, loss=2.9, v_num=0]
Epoch 37:  77%|███████▋  | 75/97 [00:11<00:03,  6.48it/s, loss=2.9, v_num=0]
Epoch 37:  77%|███████▋  | 75/97 [00:11<00:03,  6.45it/s, loss=2.9, v_num=0]
Epoch 37:  78%|███████▊  | 76/97 [00:11<00:03,  6.49it/s, loss=2.9, v_num=0]
Epoch 37:  78%|███████▊  | 76/97 [00:11<00:03,  6.46it/s, loss=2.9, v_num=0]
Epoch 37:  79%|███████▉  | 77/97 [00:11<00:03,  6.50it/s, loss=2.9, v_num=0]
Epoch 37:  79%|███████▉  | 77/97 [00:11<00:03,  6.47it/s, loss=2.89, v_num=0]
Epoch 37:  80%|████████  | 78/97 [00:11<00:02,  6.51it/s, loss=2.89, v_num=0]
Epoch 37:  80%|████████  | 78/97 [00:12<00:02,  6.48it/s, loss=2.89, v_num=0]
Epoch 37:  81%|████████▏ | 79/97 [00:12<00:02,  6.52it/s, loss=2.89, v_num=0]
Epoch 37:  81%|████████▏ | 79/97 [00:12<00:02,  6.49it/s, loss=2.9, v_num=0]
Epoch 37:  82%|████████▏ | 80/97 [00:12<00:02,  6.53it/s, loss=2.9, v_num=0]
Epoch 37:  82%|████████▏ | 80/97 [00:12<00:02,  6.50it/s, loss=2.9, v_num=0]
Epoch 37:  84%|████████▎ | 81/97 [00:12<00:02,  6.54it/s, loss=2.9, v_num=0]
Epoch 37:  84%|████████▎ | 81/97 [00:12<00:02,  6.51it/s, loss=2.9, v_num=0]
Epoch 37:  85%|████████▍ | 82/97 [00:12<00:02,  6.54it/s, loss=2.9, v_num=0]
Epoch 37:  85%|████████▍ | 82/97 [00:12<00:02,  6.51it/s, loss=2.9, v_num=0]
Epoch 37:  86%|████████▌ | 83/97 [00:12<00:02,  6.55it/s, loss=2.9, v_num=0]
Epoch 37:  86%|████████▌ | 83/97 [00:12<00:02,  6.52it/s, loss=2.89, v_num=0]
Epoch 37:  87%|████████▋ | 84/97 [00:12<00:01,  6.56it/s, loss=2.89, v_num=0]
Epoch 37:  87%|████████▋ | 84/97 [00:12<00:01,  6.53it/s, loss=2.91, v_num=0]
Epoch 37:  88%|████████▊ | 85/97 [00:12<00:01,  6.57it/s, loss=2.91, v_num=0]
Epoch 37:  88%|████████▊ | 85/97 [00:12<00:01,  6.54it/s, loss=2.91, v_num=0]
Epoch 37:  89%|████████▊ | 86/97 [00:13<00:01,  6.57it/s, loss=2.91, v_num=0]
Epoch 37:  89%|████████▊ | 86/97 [00:13<00:01,  6.55it/s, loss=2.91, v_num=0]
Epoch 37:  90%|████████▉ | 87/97 [00:13<00:01,  6.59it/s, loss=2.91, v_num=0]
Epoch 37:  90%|████████▉ | 87/97 [00:13<00:01,  6.56it/s, loss=2.91, v_num=0]
Epoch 37:  91%|█████████ | 88/97 [00:13<00:01,  6.59it/s, loss=2.91, v_num=0]
Epoch 37:  91%|█████████ | 88/97 [00:13<00:01,  6.56it/s, loss=2.91, v_num=0]
Epoch 37:  92%|█████████▏| 89/97 [00:13<00:01,  6.60it/s, loss=2.91, v_num=0]
Epoch 37:  92%|█████████▏| 89/97 [00:13<00:01,  6.57it/s, loss=2.91, v_num=0]
Epoch 37:  93%|█████████▎| 90/97 [00:13<00:01,  6.61it/s, loss=2.91, v_num=0]
Epoch 37:  93%|█████████▎| 90/97 [00:13<00:01,  6.58it/s, loss=2.9, v_num=0]
Epoch 37:  94%|█████████▍| 91/97 [00:13<00:00,  6.61it/s, loss=2.9, v_num=0]
Epoch 37:  94%|█████████▍| 91/97 [00:13<00:00,  6.59it/s, loss=2.9, v_num=0]
Epoch 37:  95%|█████████▍| 92/97 [00:13<00:00,  6.62it/s, loss=2.9, v_num=0]
Epoch 37:  95%|█████████▍| 92/97 [00:13<00:00,  6.59it/s, loss=2.91, v_num=0]
Epoch 37:  96%|█████████▌| 93/97 [00:14<00:00,  6.63it/s, loss=2.91, v_num=0]
Epoch 37:  96%|█████████▌| 93/97 [00:14<00:00,  6.60it/s, loss=2.92, v_num=0]
Epoch 37:  97%|█████████▋| 94/97 [00:14<00:00,  6.63it/s, loss=2.92, v_num=0]
Epoch 37:  97%|█████████▋| 94/97 [00:14<00:00,  6.61it/s, loss=2.92, v_num=0]
Epoch 37:  98%|█████████▊| 95/97 [00:14<00:00,  6.64it/s, loss=2.92, v_num=0]
Epoch 37:  98%|█████████▊| 95/97 [00:14<00:00,  6.61it/s, loss=2.93, v_num=0]
Epoch 37:  99%|█████████▉| 96/97 [00:14<00:00,  6.64it/s, loss=2.93, v_num=0]
Epoch 37:  99%|█████████▉| 96/97 [00:14<00:00,  6.62it/s, loss=2.93, v_num=0]
Epoch 37: 100%|██████████| 97/97 [00:14<00:00,  6.65it/s, loss=2.93, v_num=0]
Epoch 37: 100%|██████████| 97/97 [00:14<00:00,  6.63it/s, loss=2.93, v_num=0]
Epoch 37: 100%|██████████| 97/97 [00:14<00:00,  6.63it/s, loss=2.93, v_num=0]
Epoch 37:   0%|          | 0/97 [00:00<?, ?it/s, loss=2.93, v_num=0]
Epoch 38:   0%|          | 0/97 [00:00<?, ?it/s, loss=2.93, v_num=0]
Epoch 38:   1%|          | 1/97 [00:01<02:14,  1.41s/it, loss=2.93, v_num=0]
Epoch 38:   1%|          | 1/97 [00:01<02:20,  1.46s/it, loss=2.93, v_num=0]
Epoch 38:   2%|▏         | 2/97 [00:01<01:13,  1.30it/s, loss=2.93, v_num=0]
Epoch 38:   2%|▏         | 2/97 [00:01<01:16,  1.25it/s, loss=2.93, v_num=0]
Epoch 38:   3%|▎         | 3/97 [00:01<00:52,  1.78it/s, loss=2.93, v_num=0]
Epoch 38:   3%|▎         | 3/97 [00:01<00:54,  1.73it/s, loss=2.93, v_num=0]
Epoch 38:   4%|▍         | 4/97 [00:01<00:42,  2.20it/s, loss=2.93, v_num=0]
Epoch 38:   4%|▍         | 4/97 [00:01<00:43,  2.14it/s, loss=2.93, v_num=0]
Epoch 38:   5%|▌         | 5/97 [00:01<00:35,  2.57it/s, loss=2.93, v_num=0]
Epoch 38:   5%|▌         | 5/97 [00:02<00:36,  2.49it/s, loss=2.93, v_num=0]
Epoch 38:   6%|▌         | 6/97 [00:02<00:31,  2.87it/s, loss=2.93, v_num=0]
Epoch 38:   6%|▌         | 6/97 [00:02<00:32,  2.80it/s, loss=2.93, v_num=0]
Epoch 38:   7%|▋         | 7/97 [00:02<00:28,  3.15it/s, loss=2.93, v_num=0]
Epoch 38:   7%|▋         | 7/97 [00:02<00:29,  3.07it/s, loss=2.92, v_num=0]
Epoch 38:   8%|▊         | 8/97 [00:02<00:26,  3.40it/s, loss=2.92, v_num=0]
Epoch 38:   8%|▊         | 8/97 [00:02<00:26,  3.31it/s, loss=2.93, v_num=0]
Epoch 38:   9%|▉         | 9/97 [00:02<00:24,  3.59it/s, loss=2.93, v_num=0]
Epoch 38:   9%|▉         | 9/97 [00:02<00:25,  3.51it/s, loss=2.92, v_num=0]
Epoch 38:  10%|█         | 10/97 [00:02<00:23,  3.78it/s, loss=2.92, v_num=0]
Epoch 38:  10%|█         | 10/97 [00:02<00:23,  3.70it/s, loss=2.92, v_num=0]
Epoch 38:  11%|█▏        | 11/97 [00:02<00:21,  3.96it/s, loss=2.92, v_num=0]
Epoch 38:  11%|█▏        | 11/97 [00:02<00:22,  3.88it/s, loss=2.93, v_num=0]
Epoch 38:  12%|█▏        | 12/97 [00:02<00:20,  4.12it/s, loss=2.93, v_num=0]
Epoch 38:  12%|█▏        | 12/97 [00:02<00:21,  4.04it/s, loss=2.93, v_num=0]
Epoch 38:  13%|█▎        | 13/97 [00:03<00:19,  4.26it/s, loss=2.93, v_num=0]
Epoch 38:  13%|█▎        | 13/97 [00:03<00:20,  4.19it/s, loss=2.93, v_num=0]
Epoch 38:  14%|█▍        | 14/97 [00:03<00:18,  4.40it/s, loss=2.93, v_num=0]
Epoch 38:  14%|█▍        | 14/97 [00:03<00:19,  4.32it/s, loss=2.93, v_num=0]
Epoch 38:  15%|█▌        | 15/97 [00:03<00:18,  4.52it/s, loss=2.93, v_num=0]
Epoch 38:  15%|█▌        | 15/97 [00:03<00:18,  4.44it/s, loss=2.93, v_num=0]
Epoch 38:  16%|█▋        | 16/97 [00:03<00:17,  4.63it/s, loss=2.93, v_num=0]
Epoch 38:  16%|█▋        | 16/97 [00:03<00:17,  4.55it/s, loss=2.92, v_num=0]
Epoch 38:  18%|█▊        | 17/97 [00:03<00:16,  4.72it/s, loss=2.92, v_num=0]
Epoch 38:  18%|█▊        | 17/97 [00:03<00:17,  4.65it/s, loss=2.92, v_num=0]
Epoch 38:  19%|█▊        | 18/97 [00:03<00:16,  4.82it/s, loss=2.92, v_num=0]
Epoch 38:  19%|█▊        | 18/97 [00:03<00:16,  4.75it/s, loss=2.92, v_num=0]
Epoch 38:  20%|█▉        | 19/97 [00:03<00:15,  4.91it/s, loss=2.92, v_num=0]
Epoch 38:  20%|█▉        | 19/97 [00:03<00:16,  4.84it/s, loss=2.91, v_num=0]
Epoch 38:  21%|██        | 20/97 [00:04<00:15,  4.99it/s, loss=2.91, v_num=0]
Epoch 38:  21%|██        | 20/97 [00:04<00:15,  4.92it/s, loss=2.91, v_num=0]
Epoch 38:  22%|██▏       | 21/97 [00:04<00:14,  5.07it/s, loss=2.91, v_num=0]
Epoch 38:  22%|██▏       | 21/97 [00:04<00:15,  5.00it/s, loss=2.91, v_num=0]
Epoch 38:  23%|██▎       | 22/97 [00:04<00:14,  5.13it/s, loss=2.91, v_num=0]
Epoch 38:  23%|██▎       | 22/97 [00:04<00:14,  5.07it/s, loss=2.91, v_num=0]
Epoch 38:  24%|██▎       | 23/97 [00:04<00:14,  5.20it/s, loss=2.91, v_num=0]
Epoch 38:  24%|██▎       | 23/97 [00:04<00:14,  5.14it/s, loss=2.91, v_num=0]
Epoch 38:  25%|██▍       | 24/97 [00:04<00:13,  5.26it/s, loss=2.91, v_num=0]
Epoch 38:  25%|██▍       | 24/97 [00:04<00:14,  5.20it/s, loss=2.91, v_num=0]
Epoch 38:  26%|██▌       | 25/97 [00:04<00:13,  5.32it/s, loss=2.91, v_num=0]
Epoch 38:  26%|██▌       | 25/97 [00:04<00:13,  5.26it/s, loss=2.91, v_num=0]
Epoch 38:  27%|██▋       | 26/97 [00:04<00:13,  5.37it/s, loss=2.91, v_num=0]
Epoch 38:  27%|██▋       | 26/97 [00:04<00:13,  5.31it/s, loss=2.9, v_num=0]
Epoch 38:  28%|██▊       | 27/97 [00:04<00:12,  5.43it/s, loss=2.9, v_num=0]
Epoch 38:  28%|██▊       | 27/97 [00:05<00:13,  5.37it/s, loss=2.9, v_num=0]
Epoch 38:  29%|██▉       | 28/97 [00:05<00:12,  5.48it/s, loss=2.9, v_num=0]
Epoch 38:  29%|██▉       | 28/97 [00:05<00:12,  5.42it/s, loss=2.89, v_num=0]
Epoch 38:  30%|██▉       | 29/97 [00:05<00:12,  5.53it/s, loss=2.89, v_num=0]
Epoch 38:  30%|██▉       | 29/97 [00:05<00:12,  5.47it/s, loss=2.9, v_num=0]
Epoch 38:  31%|███       | 30/97 [00:05<00:12,  5.57it/s, loss=2.9, v_num=0]
Epoch 38:  31%|███       | 30/97 [00:05<00:12,  5.51it/s, loss=2.9, v_num=0]
Epoch 38:  32%|███▏      | 31/97 [00:05<00:11,  5.61it/s, loss=2.9, v_num=0]
Epoch 38:  32%|███▏      | 31/97 [00:05<00:11,  5.56it/s, loss=2.9, v_num=0]
Epoch 38:  33%|███▎      | 32/97 [00:05<00:11,  5.66it/s, loss=2.9, v_num=0]
Epoch 38:  33%|███▎      | 32/97 [00:05<00:11,  5.60it/s, loss=2.9, v_num=0]
Epoch 38:  34%|███▍      | 33/97 [00:05<00:11,  5.69it/s, loss=2.9, v_num=0]
Epoch 38:  34%|███▍      | 33/97 [00:05<00:11,  5.64it/s, loss=2.9, v_num=0]
Epoch 38:  35%|███▌      | 34/97 [00:05<00:10,  5.73it/s, loss=2.9, v_num=0]
Epoch 38:  35%|███▌      | 34/97 [00:05<00:11,  5.68it/s, loss=2.9, v_num=0]
Epoch 38:  36%|███▌      | 35/97 [00:06<00:10,  5.76it/s, loss=2.9, v_num=0]
Epoch 38:  36%|███▌      | 35/97 [00:06<00:10,  5.71it/s, loss=2.9, v_num=0]
Epoch 38:  37%|███▋      | 36/97 [00:06<00:10,  5.80it/s, loss=2.9, v_num=0]
Epoch 38:  37%|███▋      | 36/97 [00:06<00:10,  5.74it/s, loss=2.9, v_num=0]
Epoch 38:  38%|███▊      | 37/97 [00:06<00:10,  5.82it/s, loss=2.9, v_num=0]
Epoch 38:  38%|███▊      | 37/97 [00:06<00:10,  5.77it/s, loss=2.89, v_num=0]
Epoch 38:  39%|███▉      | 38/97 [00:06<00:10,  5.86it/s, loss=2.89, v_num=0]
Epoch 38:  39%|███▉      | 38/97 [00:06<00:10,  5.80it/s, loss=2.9, v_num=0]
Epoch 38:  40%|████      | 39/97 [00:06<00:09,  5.88it/s, loss=2.9, v_num=0]
Epoch 38:  40%|████      | 39/97 [00:06<00:09,  5.84it/s, loss=2.9, v_num=0]
Epoch 38:  41%|████      | 40/97 [00:06<00:09,  5.91it/s, loss=2.9, v_num=0]
Epoch 38:  41%|████      | 40/97 [00:06<00:09,  5.87it/s, loss=2.9, v_num=0]
Epoch 38:  42%|████▏     | 41/97 [00:06<00:09,  5.94it/s, loss=2.9, v_num=0]
Epoch 38:  42%|████▏     | 41/97 [00:06<00:09,  5.89it/s, loss=2.9, v_num=0]
Epoch 38:  43%|████▎     | 42/97 [00:07<00:09,  5.97it/s, loss=2.9, v_num=0]
Epoch 38:  43%|████▎     | 42/97 [00:07<00:09,  5.92it/s, loss=2.9, v_num=0]
Epoch 38:  44%|████▍     | 43/97 [00:07<00:09,  5.99it/s, loss=2.9, v_num=0]
Epoch 38:  44%|████▍     | 43/97 [00:07<00:09,  5.95it/s, loss=2.89, v_num=0]
Epoch 38:  45%|████▌     | 44/97 [00:07<00:08,  6.02it/s, loss=2.89, v_num=0]
Epoch 38:  45%|████▌     | 44/97 [00:07<00:08,  5.97it/s, loss=2.89, v_num=0]
Epoch 38:  46%|████▋     | 45/97 [00:07<00:08,  6.04it/s, loss=2.89, v_num=0]
Epoch 38:  46%|████▋     | 45/97 [00:07<00:08,  6.00it/s, loss=2.9, v_num=0]
Epoch 38:  47%|████▋     | 46/97 [00:07<00:08,  6.06it/s, loss=2.9, v_num=0]
Epoch 38:  47%|████▋     | 46/97 [00:07<00:08,  6.02it/s, loss=2.9, v_num=0]
Epoch 38:  48%|████▊     | 47/97 [00:07<00:08,  6.09it/s, loss=2.9, v_num=0]
Epoch 38:  48%|████▊     | 47/97 [00:07<00:08,  6.04it/s, loss=2.89, v_num=0]
Epoch 38:  49%|████▉     | 48/97 [00:07<00:08,  6.11it/s, loss=2.89, v_num=0]
Epoch 38:  49%|████▉     | 48/97 [00:07<00:08,  6.06it/s, loss=2.88, v_num=0]
Epoch 38:  51%|█████     | 49/97 [00:08<00:07,  6.12it/s, loss=2.88, v_num=0]
Epoch 38:  51%|█████     | 49/97 [00:08<00:07,  6.08it/s, loss=2.88, v_num=0]
Epoch 38:  52%|█████▏    | 50/97 [00:08<00:07,  6.15it/s, loss=2.88, v_num=0]
Epoch 38:  52%|█████▏    | 50/97 [00:08<00:07,  6.10it/s, loss=2.87, v_num=0]
Epoch 38:  53%|█████▎    | 51/97 [00:08<00:07,  6.16it/s, loss=2.87, v_num=0]
Epoch 38:  53%|█████▎    | 51/97 [00:08<00:07,  6.12it/s, loss=2.87, v_num=0]
Epoch 38:  54%|█████▎    | 52/97 [00:08<00:07,  6.18it/s, loss=2.87, v_num=0]
Epoch 38:  54%|█████▎    | 52/97 [00:08<00:07,  6.14it/s, loss=2.87, v_num=0]
Epoch 38:  55%|█████▍    | 53/97 [00:08<00:07,  6.20it/s, loss=2.87, v_num=0]
Epoch 38:  55%|█████▍    | 53/97 [00:08<00:07,  6.16it/s, loss=2.87, v_num=0]
Epoch 38:  56%|█████▌    | 54/97 [00:08<00:06,  6.21it/s, loss=2.87, v_num=0]
Epoch 38:  56%|█████▌    | 54/97 [00:08<00:06,  6.17it/s, loss=2.88, v_num=0]
Epoch 38:  57%|█████▋    | 55/97 [00:08<00:06,  6.23it/s, loss=2.88, v_num=0]
Epoch 38:  57%|█████▋    | 55/97 [00:08<00:06,  6.19it/s, loss=2.88, v_num=0]
Epoch 38:  58%|█████▊    | 56/97 [00:08<00:06,  6.24it/s, loss=2.88, v_num=0]
Epoch 38:  58%|█████▊    | 56/97 [00:09<00:06,  6.20it/s, loss=2.88, v_num=0]
Epoch 38:  59%|█████▉    | 57/97 [00:09<00:06,  6.26it/s, loss=2.88, v_num=0]
Epoch 38:  59%|█████▉    | 57/97 [00:09<00:06,  6.22it/s, loss=2.88, v_num=0]
Epoch 38:  60%|█████▉    | 58/97 [00:09<00:06,  6.27it/s, loss=2.88, v_num=0]
Epoch 38:  60%|█████▉    | 58/97 [00:09<00:06,  6.23it/s, loss=2.88, v_num=0]
Epoch 38:  61%|██████    | 59/97 [00:09<00:06,  6.29it/s, loss=2.88, v_num=0]
Epoch 38:  61%|██████    | 59/97 [00:09<00:06,  6.25it/s, loss=2.88, v_num=0]
Epoch 38:  62%|██████▏   | 60/97 [00:09<00:05,  6.30it/s, loss=2.88, v_num=0]
Epoch 38:  62%|██████▏   | 60/97 [00:09<00:05,  6.26it/s, loss=2.88, v_num=0]
Epoch 38:  63%|██████▎   | 61/97 [00:09<00:05,  6.31it/s, loss=2.88, v_num=0]
Epoch 38:  63%|██████▎   | 61/97 [00:09<00:05,  6.27it/s, loss=2.88, v_num=0]
Epoch 38:  64%|██████▍   | 62/97 [00:09<00:05,  6.32it/s, loss=2.88, v_num=0]
Epoch 38:  64%|██████▍   | 62/97 [00:09<00:05,  6.29it/s, loss=2.87, v_num=0]
Epoch 38:  65%|██████▍   | 63/97 [00:09<00:05,  6.33it/s, loss=2.87, v_num=0]
Epoch 38:  65%|██████▍   | 63/97 [00:10<00:05,  6.30it/s, loss=2.88, v_num=0]
Epoch 38:  66%|██████▌   | 64/97 [00:10<00:05,  6.35it/s, loss=2.88, v_num=0]
Epoch 38:  66%|██████▌   | 64/97 [00:10<00:05,  6.31it/s, loss=2.89, v_num=0]
Epoch 38:  67%|██████▋   | 65/97 [00:10<00:05,  6.36it/s, loss=2.89, v_num=0]
Epoch 38:  67%|██████▋   | 65/97 [00:10<00:05,  6.32it/s, loss=2.88, v_num=0]
Epoch 38:  68%|██████▊   | 66/97 [00:10<00:04,  6.37it/s, loss=2.88, v_num=0]
Epoch 38:  68%|██████▊   | 66/97 [00:10<00:04,  6.34it/s, loss=2.88, v_num=0]
Epoch 38:  69%|██████▉   | 67/97 [00:10<00:04,  6.39it/s, loss=2.88, v_num=0]
Epoch 38:  69%|██████▉   | 67/97 [00:10<00:04,  6.35it/s, loss=2.89, v_num=0]
Epoch 38:  70%|███████   | 68/97 [00:10<00:04,  6.40it/s, loss=2.89, v_num=0]
Epoch 38:  70%|███████   | 68/97 [00:10<00:04,  6.36it/s, loss=2.89, v_num=0]
Epoch 38:  71%|███████   | 69/97 [00:10<00:04,  6.41it/s, loss=2.89, v_num=0]
Epoch 38:  71%|███████   | 69/97 [00:10<00:04,  6.37it/s, loss=2.9, v_num=0]
Epoch 38:  72%|███████▏  | 70/97 [00:10<00:04,  6.42it/s, loss=2.9, v_num=0]
Epoch 38:  72%|███████▏  | 70/97 [00:10<00:04,  6.39it/s, loss=2.89, v_num=0]
Epoch 38:  73%|███████▎  | 71/97 [00:11<00:04,  6.43it/s, loss=2.89, v_num=0]
Epoch 38:  73%|███████▎  | 71/97 [00:11<00:04,  6.40it/s, loss=2.89, v_num=0]
Epoch 38:  74%|███████▍  | 72/97 [00:11<00:03,  6.44it/s, loss=2.89, v_num=0]
Epoch 38:  74%|███████▍  | 72/97 [00:11<00:03,  6.41it/s, loss=2.89, v_num=0]
Epoch 38:  75%|███████▌  | 73/97 [00:11<00:03,  6.45it/s, loss=2.89, v_num=0]
Epoch 38:  75%|███████▌  | 73/97 [00:11<00:03,  6.42it/s, loss=2.89, v_num=0]
Epoch 38:  76%|███████▋  | 74/97 [00:11<00:03,  6.46it/s, loss=2.89, v_num=0]
Epoch 38:  76%|███████▋  | 74/97 [00:11<00:03,  6.43it/s, loss=2.89, v_num=0]
Epoch 38:  77%|███████▋  | 75/97 [00:11<00:03,  6.47it/s, loss=2.89, v_num=0]
Epoch 38:  77%|███████▋  | 75/97 [00:11<00:03,  6.44it/s, loss=2.89, v_num=0]
Epoch 38:  78%|███████▊  | 76/97 [00:11<00:03,  6.48it/s, loss=2.89, v_num=0]
Epoch 38:  78%|███████▊  | 76/97 [00:11<00:03,  6.45it/s, loss=2.89, v_num=0]
Epoch 38:  79%|███████▉  | 77/97 [00:11<00:03,  6.49it/s, loss=2.89, v_num=0]
Epoch 38:  79%|███████▉  | 77/97 [00:11<00:03,  6.46it/s, loss=2.89, v_num=0]
Epoch 38:  80%|████████  | 78/97 [00:12<00:02,  6.50it/s, loss=2.89, v_num=0]
Epoch 38:  80%|████████  | 78/97 [00:12<00:02,  6.47it/s, loss=2.89, v_num=0]
Epoch 38:  81%|████████▏ | 79/97 [00:12<00:02,  6.51it/s, loss=2.89, v_num=0]
Epoch 38:  81%|████████▏ | 79/97 [00:12<00:02,  6.48it/s, loss=2.89, v_num=0]
Epoch 38:  82%|████████▏ | 80/97 [00:12<00:02,  6.52it/s, loss=2.89, v_num=0]
Epoch 38:  82%|████████▏ | 80/97 [00:12<00:02,  6.49it/s, loss=2.89, v_num=0]
Epoch 38:  84%|████████▎ | 81/97 [00:12<00:02,  6.52it/s, loss=2.89, v_num=0]
Epoch 38:  84%|████████▎ | 81/97 [00:12<00:02,  6.50it/s, loss=2.9, v_num=0]
Epoch 38:  85%|████████▍ | 82/97 [00:12<00:02,  6.53it/s, loss=2.9, v_num=0]
Epoch 38:  85%|████████▍ | 82/97 [00:12<00:02,  6.50it/s, loss=2.9, v_num=0]
Epoch 38:  86%|████████▌ | 83/97 [00:12<00:02,  6.54it/s, loss=2.9, v_num=0]
Epoch 38:  86%|████████▌ | 83/97 [00:12<00:02,  6.51it/s, loss=2.9, v_num=0]
Epoch 38:  87%|████████▋ | 84/97 [00:12<00:01,  6.55it/s, loss=2.9, v_num=0]
Epoch 38:  87%|████████▋ | 84/97 [00:12<00:01,  6.52it/s, loss=2.89, v_num=0]
Epoch 38:  88%|████████▊ | 85/97 [00:12<00:01,  6.56it/s, loss=2.89, v_num=0]
Epoch 38:  88%|████████▊ | 85/97 [00:13<00:01,  6.53it/s, loss=2.89, v_num=0]
Epoch 38:  89%|████████▊ | 86/97 [00:13<00:01,  6.56it/s, loss=2.89, v_num=0]
Epoch 38:  89%|████████▊ | 86/97 [00:13<00:01,  6.53it/s, loss=2.9, v_num=0]
Epoch 38:  90%|████████▉ | 87/97 [00:13<00:01,  6.57it/s, loss=2.9, v_num=0]
Epoch 38:  90%|████████▉ | 87/97 [00:13<00:01,  6.54it/s, loss=2.9, v_num=0]
Epoch 38:  91%|█████████ | 88/97 [00:13<00:01,  6.58it/s, loss=2.9, v_num=0]
Epoch 38:  91%|█████████ | 88/97 [00:13<00:01,  6.55it/s, loss=2.89, v_num=0]
Epoch 38:  92%|█████████▏| 89/97 [00:13<00:01,  6.58it/s, loss=2.89, v_num=0]
Epoch 38:  92%|█████████▏| 89/97 [00:13<00:01,  6.56it/s, loss=2.89, v_num=0]
Epoch 38:  93%|█████████▎| 90/97 [00:13<00:01,  6.59it/s, loss=2.89, v_num=0]
Epoch 38:  93%|█████████▎| 90/97 [00:13<00:01,  6.56it/s, loss=2.89, v_num=0]
Epoch 38:  94%|█████████▍| 91/97 [00:13<00:00,  6.60it/s, loss=2.89, v_num=0]
Epoch 38:  94%|█████████▍| 91/97 [00:13<00:00,  6.57it/s, loss=2.9, v_num=0]
Epoch 38:  95%|█████████▍| 92/97 [00:13<00:00,  6.60it/s, loss=2.9, v_num=0]
Epoch 38:  95%|█████████▍| 92/97 [00:13<00:00,  6.58it/s, loss=2.89, v_num=0]
Epoch 38:  96%|█████████▌| 93/97 [00:14<00:00,  6.61it/s, loss=2.89, v_num=0]
Epoch 38:  96%|█████████▌| 93/97 [00:14<00:00,  6.59it/s, loss=2.89, v_num=0]
Epoch 38:  97%|█████████▋| 94/97 [00:14<00:00,  6.62it/s, loss=2.89, v_num=0]
Epoch 38:  97%|█████████▋| 94/97 [00:14<00:00,  6.59it/s, loss=2.89, v_num=0]
Epoch 38:  98%|█████████▊| 95/97 [00:14<00:00,  6.62it/s, loss=2.89, v_num=0]
Epoch 38:  98%|█████████▊| 95/97 [00:14<00:00,  6.60it/s, loss=2.89, v_num=0]
Epoch 38:  99%|█████████▉| 96/97 [00:14<00:00,  6.63it/s, loss=2.89, v_num=0]
Epoch 38:  99%|█████████▉| 96/97 [00:14<00:00,  6.61it/s, loss=2.89, v_num=0]
Epoch 38: 100%|██████████| 97/97 [00:14<00:00,  6.64it/s, loss=2.89, v_num=0]
Epoch 38: 100%|██████████| 97/97 [00:14<00:00,  6.61it/s, loss=2.89, v_num=0]
Epoch 38: 100%|██████████| 97/97 [00:14<00:00,  6.61it/s, loss=2.89, v_num=0]
Epoch 38:   0%|          | 0/97 [00:00<?, ?it/s, loss=2.89, v_num=0]
Epoch 39:   0%|          | 0/97 [00:00<?, ?it/s, loss=2.89, v_num=0]
Epoch 39:   1%|          | 1/97 [00:01<02:13,  1.39s/it, loss=2.89, v_num=0]
Epoch 39:   1%|          | 1/97 [00:01<02:18,  1.44s/it, loss=2.88, v_num=0]
Epoch 39:   2%|▏         | 2/97 [00:01<01:12,  1.31it/s, loss=2.88, v_num=0]
Epoch 39:   2%|▏         | 2/97 [00:01<01:15,  1.26it/s, loss=2.88, v_num=0]
Epoch 39:   3%|▎         | 3/97 [00:01<00:52,  1.80it/s, loss=2.88, v_num=0]
Epoch 39:   3%|▎         | 3/97 [00:01<00:54,  1.74it/s, loss=2.87, v_num=0]
Epoch 39:   4%|▍         | 4/97 [00:01<00:42,  2.21it/s, loss=2.87, v_num=0]
Epoch 39:   4%|▍         | 4/97 [00:01<00:43,  2.15it/s, loss=2.87, v_num=0]
Epoch 39:   5%|▌         | 5/97 [00:01<00:35,  2.57it/s, loss=2.87, v_num=0]
Epoch 39:   5%|▌         | 5/97 [00:01<00:36,  2.50it/s, loss=2.87, v_num=0]
Epoch 39:   6%|▌         | 6/97 [00:02<00:31,  2.88it/s, loss=2.87, v_num=0]
Epoch 39:   6%|▌         | 6/97 [00:02<00:32,  2.81it/s, loss=2.86, v_num=0]
Epoch 39:   7%|▋         | 7/97 [00:02<00:28,  3.16it/s, loss=2.86, v_num=0]
Epoch 39:   7%|▋         | 7/97 [00:02<00:29,  3.08it/s, loss=2.86, v_num=0]
Epoch 39:   8%|▊         | 8/97 [00:02<00:26,  3.41it/s, loss=2.86, v_num=0]
Epoch 39:   8%|▊         | 8/97 [00:02<00:26,  3.32it/s, loss=2.87, v_num=0]
Epoch 39:   9%|▉         | 9/97 [00:02<00:24,  3.61it/s, loss=2.87, v_num=0]
Epoch 39:   9%|▉         | 9/97 [00:02<00:24,  3.53it/s, loss=2.87, v_num=0]
Epoch 39:  10%|█         | 10/97 [00:02<00:22,  3.80it/s, loss=2.87, v_num=0]
Epoch 39:  10%|█         | 10/97 [00:02<00:23,  3.73it/s, loss=2.87, v_num=0]
Epoch 39:  11%|█▏        | 11/97 [00:02<00:21,  3.98it/s, loss=2.87, v_num=0]
Epoch 39:  11%|█▏        | 11/97 [00:02<00:22,  3.90it/s, loss=2.88, v_num=0]
Epoch 39:  12%|█▏        | 12/97 [00:02<00:20,  4.14it/s, loss=2.88, v_num=0]
Epoch 39:  12%|█▏        | 12/97 [00:02<00:20,  4.06it/s, loss=2.88, v_num=0]
Epoch 39:  13%|█▎        | 13/97 [00:03<00:19,  4.29it/s, loss=2.88, v_num=0]
Epoch 39:  13%|█▎        | 13/97 [00:03<00:19,  4.20it/s, loss=2.88, v_num=0]
Epoch 39:  14%|█▍        | 14/97 [00:03<00:18,  4.42it/s, loss=2.88, v_num=0]
Epoch 39:  14%|█▍        | 14/97 [00:03<00:19,  4.34it/s, loss=2.88, v_num=0]
Epoch 39:  15%|█▌        | 15/97 [00:03<00:18,  4.54it/s, loss=2.88, v_num=0]
Epoch 39:  15%|█▌        | 15/97 [00:03<00:18,  4.46it/s, loss=2.88, v_num=0]
Epoch 39:  16%|█▋        | 16/97 [00:03<00:17,  4.64it/s, loss=2.88, v_num=0]
Epoch 39:  16%|█▋        | 16/97 [00:03<00:17,  4.57it/s, loss=2.87, v_num=0]
Epoch 39:  18%|█▊        | 17/97 [00:03<00:16,  4.74it/s, loss=2.87, v_num=0]
Epoch 39:  18%|█▊        | 17/97 [00:03<00:17,  4.67it/s, loss=2.87, v_num=0]
Epoch 39:  19%|█▊        | 18/97 [00:03<00:16,  4.83it/s, loss=2.87, v_num=0]
Epoch 39:  19%|█▊        | 18/97 [00:03<00:16,  4.77it/s, loss=2.87, v_num=0]
Epoch 39:  20%|█▉        | 19/97 [00:03<00:15,  4.92it/s, loss=2.87, v_num=0]
Epoch 39:  20%|█▉        | 19/97 [00:03<00:16,  4.85it/s, loss=2.86, v_num=0]
Epoch 39:  21%|██        | 20/97 [00:03<00:15,  5.01it/s, loss=2.86, v_num=0]
Epoch 39:  21%|██        | 20/97 [00:04<00:15,  4.94it/s, loss=2.86, v_num=0]
Epoch 39:  22%|██▏       | 21/97 [00:04<00:14,  5.08it/s, loss=2.86, v_num=0]
Epoch 39:  22%|██▏       | 21/97 [00:04<00:15,  5.02it/s, loss=2.86, v_num=0]
Epoch 39:  23%|██▎       | 22/97 [00:04<00:14,  5.15it/s, loss=2.86, v_num=0]
Epoch 39:  23%|██▎       | 22/97 [00:04<00:14,  5.09it/s, loss=2.86, v_num=0]
Epoch 39:  24%|██▎       | 23/97 [00:04<00:14,  5.23it/s, loss=2.86, v_num=0]
Epoch 39:  24%|██▎       | 23/97 [00:04<00:14,  5.16it/s, loss=2.87, v_num=0]
Epoch 39:  25%|██▍       | 24/97 [00:04<00:13,  5.28it/s, loss=2.87, v_num=0]
Epoch 39:  25%|██▍       | 24/97 [00:04<00:13,  5.22it/s, loss=2.87, v_num=0]
Epoch 39:  26%|██▌       | 25/97 [00:04<00:13,  5.34it/s, loss=2.87, v_num=0]
Epoch 39:  26%|██▌       | 25/97 [00:04<00:13,  5.28it/s, loss=2.87, v_num=0]
Epoch 39:  27%|██▋       | 26/97 [00:04<00:13,  5.40it/s, loss=2.87, v_num=0]
Epoch 39:  27%|██▋       | 26/97 [00:04<00:13,  5.34it/s, loss=2.88, v_num=0]
Epoch 39:  28%|██▊       | 27/97 [00:04<00:12,  5.45it/s, loss=2.88, v_num=0]
Epoch 39:  28%|██▊       | 27/97 [00:05<00:12,  5.39it/s, loss=2.87, v_num=0]
Epoch 39:  29%|██▉       | 28/97 [00:05<00:12,  5.50it/s, loss=2.87, v_num=0]
Epoch 39:  29%|██▉       | 28/97 [00:05<00:12,  5.44it/s, loss=2.86, v_num=0]
Epoch 39:  30%|██▉       | 29/97 [00:05<00:12,  5.55it/s, loss=2.86, v_num=0]
Epoch 39:  30%|██▉       | 29/97 [00:05<00:12,  5.49it/s, loss=2.86, v_num=0]
Epoch 39:  31%|███       | 30/97 [00:05<00:11,  5.60it/s, loss=2.86, v_num=0]
Epoch 39:  31%|███       | 30/97 [00:05<00:12,  5.54it/s, loss=2.87, v_num=0]
Epoch 39:  32%|███▏      | 31/97 [00:05<00:11,  5.64it/s, loss=2.87, v_num=0]
Epoch 39:  32%|███▏      | 31/97 [00:05<00:11,  5.58it/s, loss=2.87, v_num=0]
Epoch 39:  33%|███▎      | 32/97 [00:05<00:11,  5.68it/s, loss=2.87, v_num=0]
Epoch 39:  33%|███▎      | 32/97 [00:05<00:11,  5.62it/s, loss=2.87, v_num=0]
Epoch 39:  34%|███▍      | 33/97 [00:05<00:11,  5.72it/s, loss=2.87, v_num=0]
Epoch 39:  34%|███▍      | 33/97 [00:05<00:11,  5.66it/s, loss=2.88, v_num=0]
Epoch 39:  35%|███▌      | 34/97 [00:05<00:10,  5.75it/s, loss=2.88, v_num=0]
Epoch 39:  35%|███▌      | 34/97 [00:05<00:11,  5.70it/s, loss=2.88, v_num=0]
Epoch 39:  36%|███▌      | 35/97 [00:06<00:10,  5.79it/s, loss=2.88, v_num=0]
Epoch 39:  36%|███▌      | 35/97 [00:06<00:10,  5.74it/s, loss=2.88, v_num=0]
Epoch 39:  37%|███▋      | 36/97 [00:06<00:10,  5.82it/s, loss=2.88, v_num=0]
Epoch 39:  37%|███▋      | 36/97 [00:06<00:10,  5.77it/s, loss=2.88, v_num=0]
Epoch 39:  38%|███▊      | 37/97 [00:06<00:10,  5.85it/s, loss=2.88, v_num=0]
Epoch 39:  38%|███▊      | 37/97 [00:06<00:10,  5.80it/s, loss=2.87, v_num=0]
Epoch 39:  39%|███▉      | 38/97 [00:06<00:10,  5.88it/s, loss=2.87, v_num=0]
Epoch 39:  39%|███▉      | 38/97 [00:06<00:10,  5.83it/s, loss=2.87, v_num=0]
Epoch 39:  40%|████      | 39/97 [00:06<00:09,  5.91it/s, loss=2.87, v_num=0]
Epoch 39:  40%|████      | 39/97 [00:06<00:09,  5.86it/s, loss=2.88, v_num=0]
Epoch 39:  41%|████      | 40/97 [00:06<00:09,  5.94it/s, loss=2.88, v_num=0]
Epoch 39:  41%|████      | 40/97 [00:06<00:09,  5.89it/s, loss=2.88, v_num=0]
Epoch 39:  42%|████▏     | 41/97 [00:06<00:09,  5.96it/s, loss=2.88, v_num=0]
Epoch 39:  42%|████▏     | 41/97 [00:06<00:09,  5.92it/s, loss=2.88, v_num=0]
Epoch 39:  43%|████▎     | 42/97 [00:07<00:09,  5.99it/s, loss=2.88, v_num=0]
Epoch 39:  43%|████▎     | 42/97 [00:07<00:09,  5.94it/s, loss=2.88, v_num=0]
Epoch 39:  44%|████▍     | 43/97 [00:07<00:08,  6.01it/s, loss=2.88, v_num=0]
Epoch 39:  44%|████▍     | 43/97 [00:07<00:09,  5.97it/s, loss=2.88, v_num=0]
Epoch 39:  45%|████▌     | 44/97 [00:07<00:08,  6.04it/s, loss=2.88, v_num=0]
Epoch 39:  45%|████▌     | 44/97 [00:07<00:08,  5.99it/s, loss=2.88, v_num=0]
Epoch 39:  46%|████▋     | 45/97 [00:07<00:08,  6.06it/s, loss=2.88, v_num=0]
Epoch 39:  46%|████▋     | 45/97 [00:07<00:08,  6.02it/s, loss=2.87, v_num=0]
Epoch 39:  47%|████▋     | 46/97 [00:07<00:08,  6.08it/s, loss=2.87, v_num=0]
Epoch 39:  47%|████▋     | 46/97 [00:07<00:08,  6.04it/s, loss=2.87, v_num=0]
Epoch 39:  48%|████▊     | 47/97 [00:07<00:08,  6.10it/s, loss=2.87, v_num=0]
Epoch 39:  48%|████▊     | 47/97 [00:07<00:08,  6.06it/s, loss=2.88, v_num=0]
Epoch 39:  49%|████▉     | 48/97 [00:07<00:08,  6.12it/s, loss=2.88, v_num=0]
Epoch 39:  49%|████▉     | 48/97 [00:07<00:08,  6.08it/s, loss=2.88, v_num=0]
Epoch 39:  51%|█████     | 49/97 [00:07<00:07,  6.14it/s, loss=2.88, v_num=0]
Epoch 39:  51%|█████     | 49/97 [00:08<00:07,  6.10it/s, loss=2.87, v_num=0]
Epoch 39:  52%|█████▏    | 50/97 [00:08<00:07,  6.16it/s, loss=2.87, v_num=0]
Epoch 39:  52%|█████▏    | 50/97 [00:08<00:07,  6.12it/s, loss=2.87, v_num=0]
Epoch 39:  53%|█████▎    | 51/97 [00:08<00:07,  6.18it/s, loss=2.87, v_num=0]
Epoch 39:  53%|█████▎    | 51/97 [00:08<00:07,  6.14it/s, loss=2.86, v_num=0]
Epoch 39:  54%|█████▎    | 52/97 [00:08<00:07,  6.19it/s, loss=2.86, v_num=0]
Epoch 39:  54%|█████▎    | 52/97 [00:08<00:07,  6.15it/s, loss=2.86, v_num=0]
Epoch 39:  55%|█████▍    | 53/97 [00:08<00:07,  6.21it/s, loss=2.86, v_num=0]
Epoch 39:  55%|█████▍    | 53/97 [00:08<00:07,  6.17it/s, loss=2.86, v_num=0]
Epoch 39:  56%|█████▌    | 54/97 [00:08<00:06,  6.22it/s, loss=2.86, v_num=0]
Epoch 39:  56%|█████▌    | 54/97 [00:08<00:06,  6.19it/s, loss=2.86, v_num=0]
Epoch 39:  57%|█████▋    | 55/97 [00:08<00:06,  6.24it/s, loss=2.86, v_num=0]
Epoch 39:  57%|█████▋    | 55/97 [00:08<00:06,  6.20it/s, loss=2.86, v_num=0]
Epoch 39:  58%|█████▊    | 56/97 [00:08<00:06,  6.26it/s, loss=2.86, v_num=0]
Epoch 39:  58%|█████▊    | 56/97 [00:09<00:06,  6.22it/s, loss=2.86, v_num=0]
Epoch 39:  59%|█████▉    | 57/97 [00:09<00:06,  6.27it/s, loss=2.86, v_num=0]
Epoch 39:  59%|█████▉    | 57/97 [00:09<00:06,  6.23it/s, loss=2.86, v_num=0]
Epoch 39:  60%|█████▉    | 58/97 [00:09<00:06,  6.29it/s, loss=2.86, v_num=0]
Epoch 39:  60%|█████▉    | 58/97 [00:09<00:06,  6.25it/s, loss=2.86, v_num=0]
Epoch 39:  61%|██████    | 59/97 [00:09<00:06,  6.30it/s, loss=2.86, v_num=0]
Epoch 39:  61%|██████    | 59/97 [00:09<00:06,  6.26it/s, loss=2.86, v_num=0]
Epoch 39:  62%|██████▏   | 60/97 [00:09<00:05,  6.31it/s, loss=2.86, v_num=0]
Epoch 39:  62%|██████▏   | 60/97 [00:09<00:05,  6.28it/s, loss=2.86, v_num=0]
Epoch 39:  63%|██████▎   | 61/97 [00:09<00:05,  6.32it/s, loss=2.86, v_num=0]
Epoch 39:  63%|██████▎   | 61/97 [00:09<00:05,  6.29it/s, loss=2.86, v_num=0]
Epoch 39:  64%|██████▍   | 62/97 [00:09<00:05,  6.34it/s, loss=2.86, v_num=0]
Epoch 39:  64%|██████▍   | 62/97 [00:09<00:05,  6.30it/s, loss=2.86, v_num=0]
Epoch 39:  65%|██████▍   | 63/97 [00:09<00:05,  6.35it/s, loss=2.86, v_num=0]
Epoch 39:  65%|██████▍   | 63/97 [00:09<00:05,  6.31it/s, loss=2.85, v_num=0]
Epoch 39:  66%|██████▌   | 64/97 [00:10<00:05,  6.36it/s, loss=2.85, v_num=0]
Epoch 39:  66%|██████▌   | 64/97 [00:10<00:05,  6.33it/s, loss=2.85, v_num=0]
Epoch 39:  67%|██████▋   | 65/97 [00:10<00:05,  6.37it/s, loss=2.85, v_num=0]
Epoch 39:  67%|██████▋   | 65/97 [00:10<00:05,  6.34it/s, loss=2.86, v_num=0]
Epoch 39:  68%|██████▊   | 66/97 [00:10<00:04,  6.38it/s, loss=2.86, v_num=0]
Epoch 39:  68%|██████▊   | 66/97 [00:10<00:04,  6.35it/s, loss=2.86, v_num=0]
Epoch 39:  69%|██████▉   | 67/97 [00:10<00:04,  6.39it/s, loss=2.86, v_num=0]
Epoch 39:  69%|██████▉   | 67/97 [00:10<00:04,  6.36it/s, loss=2.86, v_num=0]
Epoch 39:  70%|███████   | 68/97 [00:10<00:04,  6.40it/s, loss=2.86, v_num=0]
Epoch 39:  70%|███████   | 68/97 [00:10<00:04,  6.37it/s, loss=2.86, v_num=0]
Epoch 39:  71%|███████   | 69/97 [00:10<00:04,  6.41it/s, loss=2.86, v_num=0]
Epoch 39:  71%|███████   | 69/97 [00:10<00:04,  6.38it/s, loss=2.86, v_num=0]
Epoch 39:  72%|███████▏  | 70/97 [00:10<00:04,  6.42it/s, loss=2.86, v_num=0]
Epoch 39:  72%|███████▏  | 70/97 [00:10<00:04,  6.39it/s, loss=2.85, v_num=0]
Epoch 39:  73%|███████▎  | 71/97 [00:11<00:04,  6.44it/s, loss=2.85, v_num=0]
Epoch 39:  73%|███████▎  | 71/97 [00:11<00:04,  6.40it/s, loss=2.86, v_num=0]
Epoch 39:  74%|███████▍  | 72/97 [00:11<00:03,  6.45it/s, loss=2.86, v_num=0]
Epoch 39:  74%|███████▍  | 72/97 [00:11<00:03,  6.41it/s, loss=2.86, v_num=0]
Epoch 39:  75%|███████▌  | 73/97 [00:11<00:03,  6.46it/s, loss=2.86, v_num=0]
Epoch 39:  75%|███████▌  | 73/97 [00:11<00:03,  6.42it/s, loss=2.85, v_num=0]
Epoch 39:  76%|███████▋  | 74/97 [00:11<00:03,  6.47it/s, loss=2.85, v_num=0]
Epoch 39:  76%|███████▋  | 74/97 [00:11<00:03,  6.43it/s, loss=2.86, v_num=0]
Epoch 39:  77%|███████▋  | 75/97 [00:11<00:03,  6.47it/s, loss=2.86, v_num=0]
Epoch 39:  77%|███████▋  | 75/97 [00:11<00:03,  6.44it/s, loss=2.86, v_num=0]
Epoch 39:  78%|███████▊  | 76/97 [00:11<00:03,  6.48it/s, loss=2.86, v_num=0]
Epoch 39:  78%|███████▊  | 76/97 [00:11<00:03,  6.45it/s, loss=2.86, v_num=0]
Epoch 39:  79%|███████▉  | 77/97 [00:11<00:03,  6.49it/s, loss=2.86, v_num=0]
Epoch 39:  79%|███████▉  | 77/97 [00:11<00:03,  6.46it/s, loss=2.86, v_num=0]
Epoch 39:  80%|████████  | 78/97 [00:11<00:02,  6.50it/s, loss=2.86, v_num=0]
Epoch 39:  80%|████████  | 78/97 [00:12<00:02,  6.47it/s, loss=2.86, v_num=0]
Epoch 39:  81%|████████▏ | 79/97 [00:12<00:02,  6.51it/s, loss=2.86, v_num=0]
Epoch 39:  81%|████████▏ | 79/97 [00:12<00:02,  6.48it/s, loss=2.86, v_num=0]
Epoch 39:  82%|████████▏ | 80/97 [00:12<00:02,  6.52it/s, loss=2.86, v_num=0]
Epoch 39:  82%|████████▏ | 80/97 [00:12<00:02,  6.49it/s, loss=2.87, v_num=0]
Epoch 39:  84%|████████▎ | 81/97 [00:12<00:02,  6.53it/s, loss=2.87, v_num=0]
Epoch 39:  84%|████████▎ | 81/97 [00:12<00:02,  6.50it/s, loss=2.87, v_num=0]
Epoch 39:  85%|████████▍ | 82/97 [00:12<00:02,  6.53it/s, loss=2.87, v_num=0]
Epoch 39:  85%|████████▍ | 82/97 [00:12<00:02,  6.51it/s, loss=2.87, v_num=0]
Epoch 39:  86%|████████▌ | 83/97 [00:12<00:02,  6.55it/s, loss=2.87, v_num=0]
Epoch 39:  86%|████████▌ | 83/97 [00:12<00:02,  6.52it/s, loss=2.87, v_num=0]
Epoch 39:  87%|████████▋ | 84/97 [00:12<00:01,  6.55it/s, loss=2.87, v_num=0]
Epoch 39:  87%|████████▋ | 84/97 [00:12<00:01,  6.52it/s, loss=2.87, v_num=0]
Epoch 39:  88%|████████▊ | 85/97 [00:12<00:01,  6.56it/s, loss=2.87, v_num=0]
Epoch 39:  88%|████████▊ | 85/97 [00:13<00:01,  6.53it/s, loss=2.87, v_num=0]
Epoch 39:  89%|████████▊ | 86/97 [00:13<00:01,  6.57it/s, loss=2.87, v_num=0]
Epoch 39:  89%|████████▊ | 86/97 [00:13<00:01,  6.54it/s, loss=2.86, v_num=0]
Epoch 39:  90%|████████▉ | 87/97 [00:13<00:01,  6.58it/s, loss=2.86, v_num=0]
Epoch 39:  90%|████████▉ | 87/97 [00:13<00:01,  6.55it/s, loss=2.86, v_num=0]
Epoch 39:  91%|█████████ | 88/97 [00:13<00:01,  6.58it/s, loss=2.86, v_num=0]
Epoch 39:  91%|█████████ | 88/97 [00:13<00:01,  6.56it/s, loss=2.86, v_num=0]
Epoch 39:  92%|█████████▏| 89/97 [00:13<00:01,  6.59it/s, loss=2.86, v_num=0]
Epoch 39:  92%|█████████▏| 89/97 [00:13<00:01,  6.56it/s, loss=2.85, v_num=0]
Epoch 39:  93%|█████████▎| 90/97 [00:13<00:01,  6.60it/s, loss=2.85, v_num=0]
Epoch 39:  93%|█████████▎| 90/97 [00:13<00:01,  6.57it/s, loss=2.85, v_num=0]
Epoch 39:  94%|█████████▍| 91/97 [00:13<00:00,  6.60it/s, loss=2.85, v_num=0]
Epoch 39:  94%|█████████▍| 91/97 [00:13<00:00,  6.58it/s, loss=2.85, v_num=0]
Epoch 39:  95%|█████████▍| 92/97 [00:13<00:00,  6.61it/s, loss=2.85, v_num=0]
Epoch 39:  95%|█████████▍| 92/97 [00:13<00:00,  6.58it/s, loss=2.84, v_num=0]
Epoch 39:  96%|█████████▌| 93/97 [00:14<00:00,  6.62it/s, loss=2.84, v_num=0]
Epoch 39:  96%|█████████▌| 93/97 [00:14<00:00,  6.59it/s, loss=2.85, v_num=0]
Epoch 39:  97%|█████████▋| 94/97 [00:14<00:00,  6.63it/s, loss=2.85, v_num=0]
Epoch 39:  97%|█████████▋| 94/97 [00:14<00:00,  6.60it/s, loss=2.85, v_num=0]
Epoch 39:  98%|█████████▊| 95/97 [00:14<00:00,  6.63it/s, loss=2.85, v_num=0]
Epoch 39:  98%|█████████▊| 95/97 [00:14<00:00,  6.61it/s, loss=2.85, v_num=0]
Epoch 39:  99%|█████████▉| 96/97 [00:14<00:00,  6.64it/s, loss=2.85, v_num=0]
Epoch 39:  99%|█████████▉| 96/97 [00:14<00:00,  6.61it/s, loss=2.84, v_num=0]
Epoch 39: 100%|██████████| 97/97 [00:14<00:00,  6.64it/s, loss=2.84, v_num=0]
Epoch 39: 100%|██████████| 97/97 [00:14<00:00,  6.62it/s, loss=2.84, v_num=0]
Epoch 39: 100%|██████████| 97/97 [00:14<00:00,  6.62it/s, loss=2.84, v_num=0]
Epoch 39:   0%|          | 0/97 [00:00<?, ?it/s, loss=2.84, v_num=0]
Epoch 40:   0%|          | 0/97 [00:00<?, ?it/s, loss=2.84, v_num=0]
Epoch 40:   1%|          | 1/97 [00:01<02:14,  1.40s/it, loss=2.84, v_num=0]
Epoch 40:   1%|          | 1/97 [00:01<02:19,  1.45s/it, loss=2.84, v_num=0]
Epoch 40:   2%|▏         | 2/97 [00:01<01:13,  1.30it/s, loss=2.84, v_num=0]
Epoch 40:   2%|▏         | 2/97 [00:01<01:15,  1.25it/s, loss=2.84, v_num=0]
Epoch 40:   3%|▎         | 3/97 [00:01<00:52,  1.79it/s, loss=2.84, v_num=0]
Epoch 40:   3%|▎         | 3/97 [00:01<00:54,  1.73it/s, loss=2.83, v_num=0]
Epoch 40:   4%|▍         | 4/97 [00:01<00:42,  2.20it/s, loss=2.83, v_num=0]
Epoch 40:   4%|▍         | 4/97 [00:01<00:43,  2.14it/s, loss=2.82, v_num=0]
Epoch 40:   5%|▌         | 5/97 [00:01<00:35,  2.56it/s, loss=2.82, v_num=0]
Epoch 40:   5%|▌         | 5/97 [00:02<00:36,  2.49it/s, loss=2.83, v_num=0]
Epoch 40:   6%|▌         | 6/97 [00:02<00:31,  2.88it/s, loss=2.83, v_num=0]
Epoch 40:   6%|▌         | 6/97 [00:02<00:32,  2.80it/s, loss=2.82, v_num=0]
Epoch 40:   7%|▋         | 7/97 [00:02<00:28,  3.14it/s, loss=2.82, v_num=0]
Epoch 40:   7%|▋         | 7/97 [00:02<00:29,  3.07it/s, loss=2.83, v_num=0]
Epoch 40:   8%|▊         | 8/97 [00:02<00:26,  3.39it/s, loss=2.83, v_num=0]
Epoch 40:   8%|▊         | 8/97 [00:02<00:26,  3.31it/s, loss=2.84, v_num=0]
Epoch 40:   9%|▉         | 9/97 [00:02<00:24,  3.59it/s, loss=2.84, v_num=0]
Epoch 40:   9%|▉         | 9/97 [00:02<00:25,  3.52it/s, loss=2.82, v_num=0]
Epoch 40:  10%|█         | 10/97 [00:02<00:22,  3.79it/s, loss=2.82, v_num=0]
Epoch 40:  10%|█         | 10/97 [00:02<00:23,  3.71it/s, loss=2.82, v_num=0]
Epoch 40:  11%|█▏        | 11/97 [00:02<00:21,  3.96it/s, loss=2.82, v_num=0]
Epoch 40:  11%|█▏        | 11/97 [00:02<00:22,  3.88it/s, loss=2.83, v_num=0]
Epoch 40:  12%|█▏        | 12/97 [00:02<00:20,  4.12it/s, loss=2.83, v_num=0]
Epoch 40:  12%|█▏        | 12/97 [00:02<00:21,  4.04it/s, loss=2.83, v_num=0]
Epoch 40:  13%|█▎        | 13/97 [00:03<00:19,  4.26it/s, loss=2.83, v_num=0]
Epoch 40:  13%|█▎        | 13/97 [00:03<00:20,  4.19it/s, loss=2.82, v_num=0]
Epoch 40:  14%|█▍        | 14/97 [00:03<00:18,  4.40it/s, loss=2.82, v_num=0]
Epoch 40:  14%|█▍        | 14/97 [00:03<00:19,  4.32it/s, loss=2.83, v_num=0]
Epoch 40:  15%|█▌        | 15/97 [00:03<00:18,  4.51it/s, loss=2.83, v_num=0]
Epoch 40:  15%|█▌        | 15/97 [00:03<00:18,  4.44it/s, loss=2.83, v_num=0]
Epoch 40:  16%|█▋        | 16/97 [00:03<00:17,  4.63it/s, loss=2.83, v_num=0]
Epoch 40:  16%|█▋        | 16/97 [00:03<00:17,  4.55it/s, loss=2.83, v_num=0]
Epoch 40:  18%|█▊        | 17/97 [00:03<00:16,  4.72it/s, loss=2.83, v_num=0]
Epoch 40:  18%|█▊        | 17/97 [00:03<00:17,  4.65it/s, loss=2.83, v_num=0]
Epoch 40:  19%|█▊        | 18/97 [00:03<00:16,  4.82it/s, loss=2.83, v_num=0]
Epoch 40:  19%|█▊        | 18/97 [00:03<00:16,  4.75it/s, loss=2.83, v_num=0]
Epoch 40:  20%|█▉        | 19/97 [00:03<00:15,  4.91it/s, loss=2.83, v_num=0]
Epoch 40:  20%|█▉        | 19/97 [00:03<00:16,  4.84it/s, loss=2.84, v_num=0]
Epoch 40:  21%|██        | 20/97 [00:04<00:15,  4.99it/s, loss=2.84, v_num=0]
Epoch 40:  21%|██        | 20/97 [00:04<00:15,  4.92it/s, loss=2.84, v_num=0]
Epoch 40:  22%|██▏       | 21/97 [00:04<00:14,  5.07it/s, loss=2.84, v_num=0]
Epoch 40:  22%|██▏       | 21/97 [00:04<00:15,  5.00it/s, loss=2.84, v_num=0]
Epoch 40:  23%|██▎       | 22/97 [00:04<00:14,  5.14it/s, loss=2.84, v_num=0]
Epoch 40:  23%|██▎       | 22/97 [00:04<00:14,  5.07it/s, loss=2.84, v_num=0]
Epoch 40:  24%|██▎       | 23/97 [00:04<00:14,  5.20it/s, loss=2.84, v_num=0]
Epoch 40:  24%|██▎       | 23/97 [00:04<00:14,  5.14it/s, loss=2.85, v_num=0]
Epoch 40:  25%|██▍       | 24/97 [00:04<00:13,  5.27it/s, loss=2.85, v_num=0]
Epoch 40:  25%|██▍       | 24/97 [00:04<00:14,  5.20it/s, loss=2.85, v_num=0]
Epoch 40:  26%|██▌       | 25/97 [00:04<00:13,  5.32it/s, loss=2.85, v_num=0]
Epoch 40:  26%|██▌       | 25/97 [00:04<00:13,  5.26it/s, loss=2.85, v_num=0]
Epoch 40:  27%|██▋       | 26/97 [00:04<00:13,  5.38it/s, loss=2.85, v_num=0]
Epoch 40:  27%|██▋       | 26/97 [00:04<00:13,  5.32it/s, loss=2.86, v_num=0]
Epoch 40:  28%|██▊       | 27/97 [00:04<00:12,  5.43it/s, loss=2.86, v_num=0]
Epoch 40:  28%|██▊       | 27/97 [00:05<00:13,  5.37it/s, loss=2.85, v_num=0]
Epoch 40:  29%|██▉       | 28/97 [00:05<00:12,  5.48it/s, loss=2.85, v_num=0]
Epoch 40:  29%|██▉       | 28/97 [00:05<00:12,  5.42it/s, loss=2.84, v_num=0]
Epoch 40:  30%|██▉       | 29/97 [00:05<00:12,  5.53it/s, loss=2.84, v_num=0]
Epoch 40:  30%|██▉       | 29/97 [00:05<00:12,  5.47it/s, loss=2.85, v_num=0]
Epoch 40:  31%|███       | 30/97 [00:05<00:12,  5.58it/s, loss=2.85, v_num=0]
Epoch 40:  31%|███       | 30/97 [00:05<00:12,  5.52it/s, loss=2.85, v_num=0]
Epoch 40:  32%|███▏      | 31/97 [00:05<00:11,  5.62it/s, loss=2.85, v_num=0]
Epoch 40:  32%|███▏      | 31/97 [00:05<00:11,  5.56it/s, loss=2.84, v_num=0]
Epoch 40:  33%|███▎      | 32/97 [00:05<00:11,  5.66it/s, loss=2.84, v_num=0]
Epoch 40:  33%|███▎      | 32/97 [00:05<00:11,  5.61it/s, loss=2.84, v_num=0]
Epoch 40:  34%|███▍      | 33/97 [00:05<00:11,  5.70it/s, loss=2.84, v_num=0]
Epoch 40:  34%|███▍      | 33/97 [00:05<00:11,  5.65it/s, loss=2.84, v_num=0]
Epoch 40:  35%|███▌      | 34/97 [00:05<00:10,  5.74it/s, loss=2.84, v_num=0]
Epoch 40:  35%|███▌      | 34/97 [00:05<00:11,  5.68it/s, loss=2.84, v_num=0]
Epoch 40:  36%|███▌      | 35/97 [00:06<00:10,  5.78it/s, loss=2.84, v_num=0]
Epoch 40:  36%|███▌      | 35/97 [00:06<00:10,  5.72it/s, loss=2.84, v_num=0]
Epoch 40:  37%|███▋      | 36/97 [00:06<00:10,  5.81it/s, loss=2.84, v_num=0]
Epoch 40:  37%|███▋      | 36/97 [00:06<00:10,  5.76it/s, loss=2.83, v_num=0]
Epoch 40:  38%|███▊      | 37/97 [00:06<00:10,  5.84it/s, loss=2.83, v_num=0]
Epoch 40:  38%|███▊      | 37/97 [00:06<00:10,  5.79it/s, loss=2.82, v_num=0]
Epoch 40:  39%|███▉      | 38/97 [00:06<00:10,  5.87it/s, loss=2.82, v_num=0]
Epoch 40:  39%|███▉      | 38/97 [00:06<00:10,  5.82it/s, loss=2.81, v_num=0]
Epoch 40:  40%|████      | 39/97 [00:06<00:09,  5.90it/s, loss=2.81, v_num=0]
Epoch 40:  40%|████      | 39/97 [00:06<00:09,  5.85it/s, loss=2.81, v_num=0]
Epoch 40:  41%|████      | 40/97 [00:06<00:09,  5.93it/s, loss=2.81, v_num=0]
Epoch 40:  41%|████      | 40/97 [00:06<00:09,  5.88it/s, loss=2.8, v_num=0]
Epoch 40:  42%|████▏     | 41/97 [00:06<00:09,  5.96it/s, loss=2.8, v_num=0]
Epoch 40:  42%|████▏     | 41/97 [00:06<00:09,  5.91it/s, loss=2.79, v_num=0]
Epoch 40:  43%|████▎     | 42/97 [00:07<00:09,  5.99it/s, loss=2.79, v_num=0]
Epoch 40:  43%|████▎     | 42/97 [00:07<00:09,  5.94it/s, loss=2.78, v_num=0]
Epoch 40:  44%|████▍     | 43/97 [00:07<00:08,  6.01it/s, loss=2.78, v_num=0]
Epoch 40:  44%|████▍     | 43/97 [00:07<00:09,  5.96it/s, loss=2.77, v_num=0]
Epoch 40:  45%|████▌     | 44/97 [00:07<00:08,  6.03it/s, loss=2.77, v_num=0]
Epoch 40:  45%|████▌     | 44/97 [00:07<00:08,  5.99it/s, loss=2.77, v_num=0]
Epoch 40:  46%|████▋     | 45/97 [00:07<00:08,  6.06it/s, loss=2.77, v_num=0]
Epoch 40:  46%|████▋     | 45/97 [00:07<00:08,  6.01it/s, loss=2.78, v_num=0]
Epoch 40:  47%|████▋     | 46/97 [00:07<00:08,  6.08it/s, loss=2.78, v_num=0]
Epoch 40:  47%|████▋     | 46/97 [00:07<00:08,  6.03it/s, loss=2.77, v_num=0]
Epoch 40:  48%|████▊     | 47/97 [00:07<00:08,  6.10it/s, loss=2.77, v_num=0]
Epoch 40:  48%|████▊     | 47/97 [00:07<00:08,  6.06it/s, loss=2.78, v_num=0]
Epoch 40:  49%|████▉     | 48/97 [00:07<00:08,  6.12it/s, loss=2.78, v_num=0]
Epoch 40:  49%|████▉     | 48/97 [00:07<00:08,  6.08it/s, loss=2.78, v_num=0]
Epoch 40:  51%|█████     | 49/97 [00:07<00:07,  6.15it/s, loss=2.78, v_num=0]
Epoch 40:  51%|█████     | 49/97 [00:08<00:07,  6.10it/s, loss=2.78, v_num=0]
Epoch 40:  52%|█████▏    | 50/97 [00:08<00:07,  6.16it/s, loss=2.78, v_num=0]
Epoch 40:  52%|█████▏    | 50/97 [00:08<00:07,  6.12it/s, loss=2.79, v_num=0]
Epoch 40:  53%|█████▎    | 51/97 [00:08<00:07,  6.18it/s, loss=2.79, v_num=0]
Epoch 40:  53%|█████▎    | 51/97 [00:08<00:07,  6.14it/s, loss=2.79, v_num=0]
Epoch 40:  54%|█████▎    | 52/97 [00:08<00:07,  6.20it/s, loss=2.79, v_num=0]
Epoch 40:  54%|█████▎    | 52/97 [00:08<00:07,  6.16it/s, loss=2.8, v_num=0]
Epoch 40:  55%|█████▍    | 53/97 [00:08<00:07,  6.22it/s, loss=2.8, v_num=0]
Epoch 40:  55%|█████▍    | 53/97 [00:08<00:07,  6.18it/s, loss=2.8, v_num=0]
Epoch 40:  56%|█████▌    | 54/97 [00:08<00:06,  6.23it/s, loss=2.8, v_num=0]
Epoch 40:  56%|█████▌    | 54/97 [00:08<00:06,  6.19it/s, loss=2.8, v_num=0]
Epoch 40:  57%|█████▋    | 55/97 [00:08<00:06,  6.25it/s, loss=2.8, v_num=0]
Epoch 40:  57%|█████▋    | 55/97 [00:08<00:06,  6.21it/s, loss=2.8, v_num=0]
Epoch 40:  58%|█████▊    | 56/97 [00:08<00:06,  6.26it/s, loss=2.8, v_num=0]
Epoch 40:  58%|█████▊    | 56/97 [00:09<00:06,  6.22it/s, loss=2.8, v_num=0]
Epoch 40:  59%|█████▉    | 57/97 [00:09<00:06,  6.27it/s, loss=2.8, v_num=0]
Epoch 40:  59%|█████▉    | 57/97 [00:09<00:06,  6.24it/s, loss=2.8, v_num=0]
Epoch 40:  60%|█████▉    | 58/97 [00:09<00:06,  6.29it/s, loss=2.8, v_num=0]
Epoch 40:  60%|█████▉    | 58/97 [00:09<00:06,  6.25it/s, loss=2.8, v_num=0]
Epoch 40:  61%|██████    | 59/97 [00:09<00:06,  6.30it/s, loss=2.8, v_num=0]
Epoch 40:  61%|██████    | 59/97 [00:09<00:06,  6.27it/s, loss=2.81, v_num=0]
Epoch 40:  62%|██████▏   | 60/97 [00:09<00:05,  6.31it/s, loss=2.81, v_num=0]
Epoch 40:  62%|██████▏   | 60/97 [00:09<00:05,  6.28it/s, loss=2.81, v_num=0]
Epoch 40:  63%|██████▎   | 61/97 [00:09<00:05,  6.33it/s, loss=2.81, v_num=0]
Epoch 40:  63%|██████▎   | 61/97 [00:09<00:05,  6.29it/s, loss=2.82, v_num=0]
Epoch 40:  64%|██████▍   | 62/97 [00:09<00:05,  6.34it/s, loss=2.82, v_num=0]
Epoch 40:  64%|██████▍   | 62/97 [00:09<00:05,  6.31it/s, loss=2.83, v_num=0]
Epoch 40:  65%|██████▍   | 63/97 [00:09<00:05,  6.36it/s, loss=2.83, v_num=0]
Epoch 40:  65%|██████▍   | 63/97 [00:09<00:05,  6.32it/s, loss=2.83, v_num=0]
Epoch 40:  66%|██████▌   | 64/97 [00:10<00:05,  6.37it/s, loss=2.83, v_num=0]
Epoch 40:  66%|██████▌   | 64/97 [00:10<00:05,  6.33it/s, loss=2.83, v_num=0]
Epoch 40:  67%|██████▋   | 65/97 [00:10<00:05,  6.38it/s, loss=2.83, v_num=0]
Epoch 40:  67%|██████▋   | 65/97 [00:10<00:05,  6.35it/s, loss=2.82, v_num=0]
Epoch 40:  68%|██████▊   | 66/97 [00:10<00:04,  6.39it/s, loss=2.82, v_num=0]
Epoch 40:  68%|██████▊   | 66/97 [00:10<00:04,  6.36it/s, loss=2.82, v_num=0]
Epoch 40:  69%|██████▉   | 67/97 [00:10<00:04,  6.40it/s, loss=2.82, v_num=0]
Epoch 40:  69%|██████▉   | 67/97 [00:10<00:04,  6.37it/s, loss=2.83, v_num=0]
Epoch 40:  70%|███████   | 68/97 [00:10<00:04,  6.42it/s, loss=2.83, v_num=0]
Epoch 40:  70%|███████   | 68/97 [00:10<00:04,  6.38it/s, loss=2.83, v_num=0]
Epoch 40:  71%|███████   | 69/97 [00:10<00:04,  6.42it/s, loss=2.83, v_num=0]
Epoch 40:  71%|███████   | 69/97 [00:10<00:04,  6.39it/s, loss=2.82, v_num=0]
Epoch 40:  72%|███████▏  | 70/97 [00:10<00:04,  6.44it/s, loss=2.82, v_num=0]
Epoch 40:  72%|███████▏  | 70/97 [00:10<00:04,  6.40it/s, loss=2.83, v_num=0]
Epoch 40:  73%|███████▎  | 71/97 [00:11<00:04,  6.44it/s, loss=2.83, v_num=0]
Epoch 40:  73%|███████▎  | 71/97 [00:11<00:04,  6.41it/s, loss=2.83, v_num=0]
Epoch 40:  74%|███████▍  | 72/97 [00:11<00:03,  6.45it/s, loss=2.83, v_num=0]
Epoch 40:  74%|███████▍  | 72/97 [00:11<00:03,  6.42it/s, loss=2.82, v_num=0]
Epoch 40:  75%|███████▌  | 73/97 [00:11<00:03,  6.46it/s, loss=2.82, v_num=0]
Epoch 40:  75%|███████▌  | 73/97 [00:11<00:03,  6.43it/s, loss=2.82, v_num=0]
Epoch 40:  76%|███████▋  | 74/97 [00:11<00:03,  6.47it/s, loss=2.82, v_num=0]
Epoch 40:  76%|███████▋  | 74/97 [00:11<00:03,  6.44it/s, loss=2.82, v_num=0]
Epoch 40:  77%|███████▋  | 75/97 [00:11<00:03,  6.48it/s, loss=2.82, v_num=0]
Epoch 40:  77%|███████▋  | 75/97 [00:11<00:03,  6.45it/s, loss=2.83, v_num=0]
Epoch 40:  78%|███████▊  | 76/97 [00:11<00:03,  6.49it/s, loss=2.83, v_num=0]
Epoch 40:  78%|███████▊  | 76/97 [00:11<00:03,  6.46it/s, loss=2.83, v_num=0]
Epoch 40:  79%|███████▉  | 77/97 [00:11<00:03,  6.50it/s, loss=2.83, v_num=0]
Epoch 40:  79%|███████▉  | 77/97 [00:11<00:03,  6.47it/s, loss=2.83, v_num=0]
Epoch 40:  80%|████████  | 78/97 [00:11<00:02,  6.51it/s, loss=2.83, v_num=0]
Epoch 40:  80%|████████  | 78/97 [00:12<00:02,  6.48it/s, loss=2.83, v_num=0]
Epoch 40:  81%|████████▏ | 79/97 [00:12<00:02,  6.52it/s, loss=2.83, v_num=0]
Epoch 40:  81%|████████▏ | 79/97 [00:12<00:02,  6.49it/s, loss=2.83, v_num=0]
Epoch 40:  82%|████████▏ | 80/97 [00:12<00:02,  6.53it/s, loss=2.83, v_num=0]
Epoch 40:  82%|████████▏ | 80/97 [00:12<00:02,  6.50it/s, loss=2.84, v_num=0]
Epoch 40:  84%|████████▎ | 81/97 [00:12<00:02,  6.53it/s, loss=2.84, v_num=0]
Epoch 40:  84%|████████▎ | 81/97 [00:12<00:02,  6.51it/s, loss=2.83, v_num=0]
Epoch 40:  85%|████████▍ | 82/97 [00:12<00:02,  6.54it/s, loss=2.83, v_num=0]
Epoch 40:  85%|████████▍ | 82/97 [00:12<00:02,  6.51it/s, loss=2.83, v_num=0]
Epoch 40:  86%|████████▌ | 83/97 [00:12<00:02,  6.55it/s, loss=2.83, v_num=0]
Epoch 40:  86%|████████▌ | 83/97 [00:12<00:02,  6.52it/s, loss=2.84, v_num=0]
Epoch 40:  87%|████████▋ | 84/97 [00:12<00:01,  6.56it/s, loss=2.84, v_num=0]
Epoch 40:  87%|████████▋ | 84/97 [00:12<00:01,  6.53it/s, loss=2.84, v_num=0]
Epoch 40:  88%|████████▊ | 85/97 [00:12<00:01,  6.56it/s, loss=2.84, v_num=0]
Epoch 40:  88%|████████▊ | 85/97 [00:13<00:01,  6.54it/s, loss=2.84, v_num=0]
Epoch 40:  89%|████████▊ | 86/97 [00:13<00:01,  6.57it/s, loss=2.84, v_num=0]
Epoch 40:  89%|████████▊ | 86/97 [00:13<00:01,  6.54it/s, loss=2.83, v_num=0]
Epoch 40:  90%|████████▉ | 87/97 [00:13<00:01,  6.58it/s, loss=2.83, v_num=0]
Epoch 40:  90%|████████▉ | 87/97 [00:13<00:01,  6.55it/s, loss=2.83, v_num=0]
Epoch 40:  91%|█████████ | 88/97 [00:13<00:01,  6.59it/s, loss=2.83, v_num=0]
Epoch 40:  91%|█████████ | 88/97 [00:13<00:01,  6.56it/s, loss=2.82, v_num=0]
Epoch 40:  92%|█████████▏| 89/97 [00:13<00:01,  6.60it/s, loss=2.82, v_num=0]
Epoch 40:  92%|█████████▏| 89/97 [00:13<00:01,  6.57it/s, loss=2.82, v_num=0]
Epoch 40:  93%|█████████▎| 90/97 [00:13<00:01,  6.60it/s, loss=2.82, v_num=0]
Epoch 40:  93%|█████████▎| 90/97 [00:13<00:01,  6.57it/s, loss=2.81, v_num=0]
Epoch 40:  94%|█████████▍| 91/97 [00:13<00:00,  6.61it/s, loss=2.81, v_num=0]
Epoch 40:  94%|█████████▍| 91/97 [00:13<00:00,  6.58it/s, loss=2.81, v_num=0]
Epoch 40:  95%|█████████▍| 92/97 [00:13<00:00,  6.61it/s, loss=2.81, v_num=0]
Epoch 40:  95%|█████████▍| 92/97 [00:13<00:00,  6.59it/s, loss=2.82, v_num=0]
Epoch 40:  96%|█████████▌| 93/97 [00:14<00:00,  6.62it/s, loss=2.82, v_num=0]
Epoch 40:  96%|█████████▌| 93/97 [00:14<00:00,  6.60it/s, loss=2.82, v_num=0]
Epoch 40:  97%|█████████▋| 94/97 [00:14<00:00,  6.63it/s, loss=2.82, v_num=0]
Epoch 40:  97%|█████████▋| 94/97 [00:14<00:00,  6.60it/s, loss=2.81, v_num=0]
Epoch 40:  98%|█████████▊| 95/97 [00:14<00:00,  6.64it/s, loss=2.81, v_num=0]
Epoch 40:  98%|█████████▊| 95/97 [00:14<00:00,  6.61it/s, loss=2.8, v_num=0]
Epoch 40:  99%|█████████▉| 96/97 [00:14<00:00,  6.64it/s, loss=2.8, v_num=0]
Epoch 40:  99%|█████████▉| 96/97 [00:14<00:00,  6.62it/s, loss=2.8, v_num=0]
Epoch 40: 100%|██████████| 97/97 [00:14<00:00,  6.65it/s, loss=2.8, v_num=0]
Epoch 40: 100%|██████████| 97/97 [00:14<00:00,  6.62it/s, loss=2.81, v_num=0]
Epoch 40: 100%|██████████| 97/97 [00:14<00:00,  6.62it/s, loss=2.81, v_num=0]
Epoch 40:   0%|          | 0/97 [00:00<?, ?it/s, loss=2.81, v_num=0]
Epoch 41:   0%|          | 0/97 [00:00<?, ?it/s, loss=2.81, v_num=0]
Epoch 41:   1%|          | 1/97 [00:01<02:12,  1.38s/it, loss=2.81, v_num=0]
Epoch 41:   1%|          | 1/97 [00:01<02:17,  1.44s/it, loss=2.8, v_num=0]
Epoch 41:   2%|▏         | 2/97 [00:01<01:12,  1.31it/s, loss=2.8, v_num=0]
Epoch 41:   2%|▏         | 2/97 [00:01<01:14,  1.27it/s, loss=2.81, v_num=0]
Epoch 41:   3%|▎         | 3/97 [00:01<00:51,  1.81it/s, loss=2.81, v_num=0]
Epoch 41:   3%|▎         | 3/97 [00:01<00:53,  1.75it/s, loss=2.8, v_num=0]
Epoch 41:   4%|▍         | 4/97 [00:01<00:41,  2.23it/s, loss=2.8, v_num=0]
Epoch 41:   4%|▍         | 4/97 [00:01<00:43,  2.16it/s, loss=2.81, v_num=0]
Epoch 41:   5%|▌         | 5/97 [00:01<00:35,  2.59it/s, loss=2.81, v_num=0]
Epoch 41:   5%|▌         | 5/97 [00:01<00:36,  2.52it/s, loss=2.81, v_num=0]
Epoch 41:   6%|▌         | 6/97 [00:02<00:31,  2.90it/s, loss=2.81, v_num=0]
Epoch 41:   6%|▌         | 6/97 [00:02<00:32,  2.83it/s, loss=2.81, v_num=0]
Epoch 41:   7%|▋         | 7/97 [00:02<00:28,  3.17it/s, loss=2.81, v_num=0]
Epoch 41:   7%|▋         | 7/97 [00:02<00:29,  3.10it/s, loss=2.8, v_num=0]
Epoch 41:   8%|▊         | 8/97 [00:02<00:26,  3.42it/s, loss=2.8, v_num=0]
Epoch 41:   8%|▊         | 8/97 [00:02<00:26,  3.34it/s, loss=2.81, v_num=0]
Epoch 41:   9%|▉         | 9/97 [00:02<00:24,  3.62it/s, loss=2.81, v_num=0]
Epoch 41:   9%|▉         | 9/97 [00:02<00:24,  3.55it/s, loss=2.81, v_num=0]
Epoch 41:  10%|█         | 10/97 [00:02<00:22,  3.81it/s, loss=2.81, v_num=0]
Epoch 41:  10%|█         | 10/97 [00:02<00:23,  3.73it/s, loss=2.81, v_num=0]
Epoch 41:  11%|█▏        | 11/97 [00:02<00:21,  3.99it/s, loss=2.81, v_num=0]
Epoch 41:  11%|█▏        | 11/97 [00:02<00:21,  3.91it/s, loss=2.81, v_num=0]
Epoch 41:  12%|█▏        | 12/97 [00:02<00:20,  4.15it/s, loss=2.81, v_num=0]
Epoch 41:  12%|█▏        | 12/97 [00:02<00:20,  4.07it/s, loss=2.81, v_num=0]
Epoch 41:  13%|█▎        | 13/97 [00:03<00:19,  4.29it/s, loss=2.81, v_num=0]
Epoch 41:  13%|█▎        | 13/97 [00:03<00:19,  4.21it/s, loss=2.81, v_num=0]
Epoch 41:  14%|█▍        | 14/97 [00:03<00:18,  4.42it/s, loss=2.81, v_num=0]
Epoch 41:  14%|█▍        | 14/97 [00:03<00:19,  4.34it/s, loss=2.81, v_num=0]
Epoch 41:  15%|█▌        | 15/97 [00:03<00:18,  4.55it/s, loss=2.81, v_num=0]
Epoch 41:  15%|█▌        | 15/97 [00:03<00:18,  4.47it/s, loss=2.8, v_num=0]
Epoch 41:  16%|█▋        | 16/97 [00:03<00:17,  4.65it/s, loss=2.8, v_num=0]
Epoch 41:  16%|█▋        | 16/97 [00:03<00:17,  4.58it/s, loss=2.81, v_num=0]
Epoch 41:  18%|█▊        | 17/97 [00:03<00:16,  4.75it/s, loss=2.81, v_num=0]
Epoch 41:  18%|█▊        | 17/97 [00:03<00:17,  4.67it/s, loss=2.81, v_num=0]
Epoch 41:  19%|█▊        | 18/97 [00:03<00:16,  4.84it/s, loss=2.81, v_num=0]
Epoch 41:  19%|█▊        | 18/97 [00:03<00:16,  4.77it/s, loss=2.81, v_num=0]
Epoch 41:  20%|█▉        | 19/97 [00:03<00:15,  4.93it/s, loss=2.81, v_num=0]
Epoch 41:  20%|█▉        | 19/97 [00:03<00:16,  4.86it/s, loss=2.81, v_num=0]
Epoch 41:  21%|██        | 20/97 [00:03<00:15,  5.01it/s, loss=2.81, v_num=0]
Epoch 41:  21%|██        | 20/97 [00:04<00:15,  4.94it/s, loss=2.81, v_num=0]
Epoch 41:  22%|██▏       | 21/97 [00:04<00:14,  5.09it/s, loss=2.81, v_num=0]
Epoch 41:  22%|██▏       | 21/97 [00:04<00:15,  5.02it/s, loss=2.81, v_num=0]
Epoch 41:  23%|██▎       | 22/97 [00:04<00:14,  5.16it/s, loss=2.81, v_num=0]
Epoch 41:  23%|██▎       | 22/97 [00:04<00:14,  5.09it/s, loss=2.8, v_num=0]
Epoch 41:  24%|██▎       | 23/97 [00:04<00:14,  5.23it/s, loss=2.8, v_num=0]
Epoch 41:  24%|██▎       | 23/97 [00:04<00:14,  5.16it/s, loss=2.8, v_num=0]
Epoch 41:  25%|██▍       | 24/97 [00:04<00:13,  5.28it/s, loss=2.8, v_num=0]
Epoch 41:  25%|██▍       | 24/97 [00:04<00:14,  5.21it/s, loss=2.79, v_num=0]
Epoch 41:  26%|██▌       | 25/97 [00:04<00:13,  5.33it/s, loss=2.79, v_num=0]
Epoch 41:  26%|██▌       | 25/97 [00:04<00:13,  5.27it/s, loss=2.79, v_num=0]
Epoch 41:  27%|██▋       | 26/97 [00:04<00:13,  5.39it/s, loss=2.79, v_num=0]
Epoch 41:  27%|██▋       | 26/97 [00:04<00:13,  5.33it/s, loss=2.79, v_num=0]
Epoch 41:  28%|██▊       | 27/97 [00:04<00:12,  5.44it/s, loss=2.79, v_num=0]
Epoch 41:  28%|██▊       | 27/97 [00:05<00:13,  5.38it/s, loss=2.8, v_num=0]
Epoch 41:  29%|██▉       | 28/97 [00:05<00:12,  5.49it/s, loss=2.8, v_num=0]
Epoch 41:  29%|██▉       | 28/97 [00:05<00:12,  5.43it/s, loss=2.79, v_num=0]
Epoch 41:  30%|██▉       | 29/97 [00:05<00:12,  5.54it/s, loss=2.79, v_num=0]
Epoch 41:  30%|██▉       | 29/97 [00:05<00:12,  5.48it/s, loss=2.79, v_num=0]
Epoch 41:  31%|███       | 30/97 [00:05<00:11,  5.58it/s, loss=2.79, v_num=0]
Epoch 41:  31%|███       | 30/97 [00:05<00:12,  5.53it/s, loss=2.79, v_num=0]
Epoch 41:  32%|███▏      | 31/97 [00:05<00:11,  5.63it/s, loss=2.79, v_num=0]
Epoch 41:  32%|███▏      | 31/97 [00:05<00:11,  5.57it/s, loss=2.79, v_num=0]
Epoch 41:  33%|███▎      | 32/97 [00:05<00:11,  5.66it/s, loss=2.79, v_num=0]
Epoch 41:  33%|███▎      | 32/97 [00:05<00:11,  5.61it/s, loss=2.79, v_num=0]
Epoch 41:  34%|███▍      | 33/97 [00:05<00:11,  5.70it/s, loss=2.79, v_num=0]
Epoch 41:  34%|███▍      | 33/97 [00:05<00:11,  5.65it/s, loss=2.79, v_num=0]
Epoch 41:  35%|███▌      | 34/97 [00:05<00:10,  5.74it/s, loss=2.79, v_num=0]
Epoch 41:  35%|███▌      | 34/97 [00:05<00:11,  5.69it/s, loss=2.79, v_num=0]
Epoch 41:  36%|███▌      | 35/97 [00:06<00:10,  5.78it/s, loss=2.79, v_num=0]
Epoch 41:  36%|███▌      | 35/97 [00:06<00:10,  5.72it/s, loss=2.79, v_num=0]
Epoch 41:  37%|███▋      | 36/97 [00:06<00:10,  5.81it/s, loss=2.79, v_num=0]
Epoch 41:  37%|███▋      | 36/97 [00:06<00:10,  5.76it/s, loss=2.79, v_num=0]
Epoch 41:  38%|███▊      | 37/97 [00:06<00:10,  5.84it/s, loss=2.79, v_num=0]
Epoch 41:  38%|███▊      | 37/97 [00:06<00:10,  5.79it/s, loss=2.79, v_num=0]
Epoch 41:  39%|███▉      | 38/97 [00:06<00:10,  5.87it/s, loss=2.79, v_num=0]
Epoch 41:  39%|███▉      | 38/97 [00:06<00:10,  5.82it/s, loss=2.79, v_num=0]
Epoch 41:  40%|████      | 39/97 [00:06<00:09,  5.90it/s, loss=2.79, v_num=0]
Epoch 41:  40%|████      | 39/97 [00:06<00:09,  5.85it/s, loss=2.8, v_num=0]
Epoch 41:  41%|████      | 40/97 [00:06<00:09,  5.93it/s, loss=2.8, v_num=0]
Epoch 41:  41%|████      | 40/97 [00:06<00:09,  5.88it/s, loss=2.8, v_num=0]
Epoch 41:  42%|████▏     | 41/97 [00:06<00:09,  5.96it/s, loss=2.8, v_num=0]
Epoch 41:  42%|████▏     | 41/97 [00:06<00:09,  5.91it/s, loss=2.81, v_num=0]
Epoch 41:  43%|████▎     | 42/97 [00:07<00:09,  5.99it/s, loss=2.81, v_num=0]
Epoch 41:  43%|████▎     | 42/97 [00:07<00:09,  5.94it/s, loss=2.81, v_num=0]
Epoch 41:  44%|████▍     | 43/97 [00:07<00:08,  6.01it/s, loss=2.81, v_num=0]
Epoch 41:  44%|████▍     | 43/97 [00:07<00:09,  5.96it/s, loss=2.82, v_num=0]
Epoch 41:  45%|████▌     | 44/97 [00:07<00:08,  6.03it/s, loss=2.82, v_num=0]
Epoch 41:  45%|████▌     | 44/97 [00:07<00:08,  5.99it/s, loss=2.83, v_num=0]
Epoch 41:  46%|████▋     | 45/97 [00:07<00:08,  6.06it/s, loss=2.83, v_num=0]
Epoch 41:  46%|████▋     | 45/97 [00:07<00:08,  6.01it/s, loss=2.82, v_num=0]
Epoch 41:  47%|████▋     | 46/97 [00:07<00:08,  6.08it/s, loss=2.82, v_num=0]
Epoch 41:  47%|████▋     | 46/97 [00:07<00:08,  6.03it/s, loss=2.82, v_num=0]
Epoch 41:  48%|████▊     | 47/97 [00:07<00:08,  6.10it/s, loss=2.82, v_num=0]
Epoch 41:  48%|████▊     | 47/97 [00:07<00:08,  6.05it/s, loss=2.82, v_num=0]
Epoch 41:  49%|████▉     | 48/97 [00:07<00:08,  6.12it/s, loss=2.82, v_num=0]
Epoch 41:  49%|████▉     | 48/97 [00:07<00:08,  6.07it/s, loss=2.82, v_num=0]
Epoch 41:  51%|█████     | 49/97 [00:07<00:07,  6.14it/s, loss=2.82, v_num=0]
Epoch 41:  51%|█████     | 49/97 [00:08<00:07,  6.09it/s, loss=2.82, v_num=0]
Epoch 41:  52%|█████▏    | 50/97 [00:08<00:07,  6.16it/s, loss=2.82, v_num=0]
Epoch 41:  52%|█████▏    | 50/97 [00:08<00:07,  6.12it/s, loss=2.82, v_num=0]
Epoch 41:  53%|█████▎    | 51/97 [00:08<00:07,  6.18it/s, loss=2.82, v_num=0]
Epoch 41:  53%|█████▎    | 51/97 [00:08<00:07,  6.13it/s, loss=2.83, v_num=0]
Epoch 41:  54%|█████▎    | 52/97 [00:08<00:07,  6.20it/s, loss=2.83, v_num=0]
Epoch 41:  54%|█████▎    | 52/97 [00:08<00:07,  6.15it/s, loss=2.83, v_num=0]
Epoch 41:  55%|█████▍    | 53/97 [00:08<00:07,  6.21it/s, loss=2.83, v_num=0]
Epoch 41:  55%|█████▍    | 53/97 [00:08<00:07,  6.17it/s, loss=2.83, v_num=0]
Epoch 41:  56%|█████▌    | 54/97 [00:08<00:06,  6.23it/s, loss=2.83, v_num=0]
Epoch 41:  56%|█████▌    | 54/97 [00:08<00:06,  6.18it/s, loss=2.83, v_num=0]
Epoch 41:  57%|█████▋    | 55/97 [00:08<00:06,  6.24it/s, loss=2.83, v_num=0]
Epoch 41:  57%|█████▋    | 55/97 [00:08<00:06,  6.20it/s, loss=2.83, v_num=0]
Epoch 41:  58%|█████▊    | 56/97 [00:08<00:06,  6.26it/s, loss=2.83, v_num=0]
Epoch 41:  58%|█████▊    | 56/97 [00:09<00:06,  6.22it/s, loss=2.82, v_num=0]
Epoch 41:  59%|█████▉    | 57/97 [00:09<00:06,  6.28it/s, loss=2.82, v_num=0]
Epoch 41:  59%|█████▉    | 57/97 [00:09<00:06,  6.24it/s, loss=2.82, v_num=0]
Epoch 41:  60%|█████▉    | 58/97 [00:09<00:06,  6.29it/s, loss=2.82, v_num=0]
Epoch 41:  60%|█████▉    | 58/97 [00:09<00:06,  6.25it/s, loss=2.82, v_num=0]
Epoch 41:  61%|██████    | 59/97 [00:09<00:06,  6.31it/s, loss=2.82, v_num=0]
Epoch 41:  61%|██████    | 59/97 [00:09<00:06,  6.27it/s, loss=2.81, v_num=0]
Epoch 41:  62%|██████▏   | 60/97 [00:09<00:05,  6.32it/s, loss=2.81, v_num=0]
Epoch 41:  62%|██████▏   | 60/97 [00:09<00:05,  6.28it/s, loss=2.81, v_num=0]
Epoch 41:  63%|██████▎   | 61/97 [00:09<00:05,  6.33it/s, loss=2.81, v_num=0]
Epoch 41:  63%|██████▎   | 61/97 [00:09<00:05,  6.29it/s, loss=2.81, v_num=0]
Epoch 41:  64%|██████▍   | 62/97 [00:09<00:05,  6.34it/s, loss=2.81, v_num=0]
Epoch 41:  64%|██████▍   | 62/97 [00:09<00:05,  6.31it/s, loss=2.8, v_num=0]
Epoch 41:  65%|██████▍   | 63/97 [00:09<00:05,  6.35it/s, loss=2.8, v_num=0]
Epoch 41:  65%|██████▍   | 63/97 [00:09<00:05,  6.32it/s, loss=2.79, v_num=0]
Epoch 41:  66%|██████▌   | 64/97 [00:10<00:05,  6.37it/s, loss=2.79, v_num=0]
Epoch 41:  66%|██████▌   | 64/97 [00:10<00:05,  6.33it/s, loss=2.79, v_num=0]
Epoch 41:  67%|██████▋   | 65/97 [00:10<00:05,  6.38it/s, loss=2.79, v_num=0]
Epoch 41:  67%|██████▋   | 65/97 [00:10<00:05,  6.35it/s, loss=2.8, v_num=0]
Epoch 41:  68%|██████▊   | 66/97 [00:10<00:04,  6.39it/s, loss=2.8, v_num=0]
Epoch 41:  68%|██████▊   | 66/97 [00:10<00:04,  6.36it/s, loss=2.79, v_num=0]
Epoch 41:  69%|██████▉   | 67/97 [00:10<00:04,  6.41it/s, loss=2.79, v_num=0]
Epoch 41:  69%|██████▉   | 67/97 [00:10<00:04,  6.37it/s, loss=2.79, v_num=0]
Epoch 41:  70%|███████   | 68/97 [00:10<00:04,  6.41it/s, loss=2.79, v_num=0]
Epoch 41:  70%|███████   | 68/97 [00:10<00:04,  6.38it/s, loss=2.79, v_num=0]
Epoch 41:  71%|███████   | 69/97 [00:10<00:04,  6.43it/s, loss=2.79, v_num=0]
Epoch 41:  71%|███████   | 69/97 [00:10<00:04,  6.39it/s, loss=2.79, v_num=0]
Epoch 41:  72%|███████▏  | 70/97 [00:10<00:04,  6.44it/s, loss=2.79, v_num=0]
Epoch 41:  72%|███████▏  | 70/97 [00:10<00:04,  6.40it/s, loss=2.79, v_num=0]
Epoch 41:  73%|███████▎  | 71/97 [00:11<00:04,  6.45it/s, loss=2.79, v_num=0]
Epoch 41:  73%|███████▎  | 71/97 [00:11<00:04,  6.41it/s, loss=2.79, v_num=0]
Epoch 41:  74%|███████▍  | 72/97 [00:11<00:03,  6.46it/s, loss=2.79, v_num=0]
Epoch 41:  74%|███████▍  | 72/97 [00:11<00:03,  6.42it/s, loss=2.78, v_num=0]
Epoch 41:  75%|███████▌  | 73/97 [00:11<00:03,  6.47it/s, loss=2.78, v_num=0]
Epoch 41:  75%|███████▌  | 73/97 [00:11<00:03,  6.43it/s, loss=2.77, v_num=0]
Epoch 41:  76%|███████▋  | 74/97 [00:11<00:03,  6.48it/s, loss=2.77, v_num=0]
Epoch 41:  76%|███████▋  | 74/97 [00:11<00:03,  6.44it/s, loss=2.78, v_num=0]
Epoch 41:  77%|███████▋  | 75/97 [00:11<00:03,  6.49it/s, loss=2.78, v_num=0]
Epoch 41:  77%|███████▋  | 75/97 [00:11<00:03,  6.45it/s, loss=2.78, v_num=0]
Epoch 41:  78%|███████▊  | 76/97 [00:11<00:03,  6.50it/s, loss=2.78, v_num=0]
Epoch 41:  78%|███████▊  | 76/97 [00:11<00:03,  6.46it/s, loss=2.78, v_num=0]
Epoch 41:  79%|███████▉  | 77/97 [00:11<00:03,  6.51it/s, loss=2.78, v_num=0]
Epoch 41:  79%|███████▉  | 77/97 [00:11<00:03,  6.47it/s, loss=2.77, v_num=0]
Epoch 41:  80%|████████  | 78/97 [00:11<00:02,  6.51it/s, loss=2.77, v_num=0]
Epoch 41:  80%|████████  | 78/97 [00:12<00:02,  6.48it/s, loss=2.78, v_num=0]
Epoch 41:  81%|████████▏ | 79/97 [00:12<00:02,  6.52it/s, loss=2.78, v_num=0]
Epoch 41:  81%|████████▏ | 79/97 [00:12<00:02,  6.49it/s, loss=2.78, v_num=0]
Epoch 41:  82%|████████▏ | 80/97 [00:12<00:02,  6.53it/s, loss=2.78, v_num=0]
Epoch 41:  82%|████████▏ | 80/97 [00:12<00:02,  6.50it/s, loss=2.77, v_num=0]
Epoch 41:  84%|████████▎ | 81/97 [00:12<00:02,  6.54it/s, loss=2.77, v_num=0]
Epoch 41:  84%|████████▎ | 81/97 [00:12<00:02,  6.51it/s, loss=2.77, v_num=0]
Epoch 41:  85%|████████▍ | 82/97 [00:12<00:02,  6.54it/s, loss=2.77, v_num=0]
Epoch 41:  85%|████████▍ | 82/97 [00:12<00:02,  6.52it/s, loss=2.77, v_num=0]
Epoch 41:  86%|████████▌ | 83/97 [00:12<00:02,  6.55it/s, loss=2.77, v_num=0]
Epoch 41:  86%|████████▌ | 83/97 [00:12<00:02,  6.52it/s, loss=2.77, v_num=0]
Epoch 41:  87%|████████▋ | 84/97 [00:12<00:01,  6.56it/s, loss=2.77, v_num=0]
Epoch 41:  87%|████████▋ | 84/97 [00:12<00:01,  6.53it/s, loss=2.77, v_num=0]
Epoch 41:  88%|████████▊ | 85/97 [00:12<00:01,  6.57it/s, loss=2.77, v_num=0]
Epoch 41:  88%|████████▊ | 85/97 [00:12<00:01,  6.54it/s, loss=2.76, v_num=0]
Epoch 41:  89%|████████▊ | 86/97 [00:13<00:01,  6.58it/s, loss=2.76, v_num=0]
Epoch 41:  89%|████████▊ | 86/97 [00:13<00:01,  6.55it/s, loss=2.78, v_num=0]
Epoch 41:  90%|████████▉ | 87/97 [00:13<00:01,  6.58it/s, loss=2.78, v_num=0]
Epoch 41:  90%|████████▉ | 87/97 [00:13<00:01,  6.56it/s, loss=2.78, v_num=0]
Epoch 41:  91%|█████████ | 88/97 [00:13<00:01,  6.59it/s, loss=2.78, v_num=0]
Epoch 41:  91%|█████████ | 88/97 [00:13<00:01,  6.56it/s, loss=2.78, v_num=0]
Epoch 41:  92%|█████████▏| 89/97 [00:13<00:01,  6.60it/s, loss=2.78, v_num=0]
Epoch 41:  92%|█████████▏| 89/97 [00:13<00:01,  6.57it/s, loss=2.77, v_num=0]
Epoch 41:  93%|█████████▎| 90/97 [00:13<00:01,  6.61it/s, loss=2.77, v_num=0]
Epoch 41:  93%|█████████▎| 90/97 [00:13<00:01,  6.58it/s, loss=2.77, v_num=0]
Epoch 41:  94%|█████████▍| 91/97 [00:13<00:00,  6.61it/s, loss=2.77, v_num=0]
Epoch 41:  94%|█████████▍| 91/97 [00:13<00:00,  6.58it/s, loss=2.78, v_num=0]
Epoch 41:  95%|█████████▍| 92/97 [00:13<00:00,  6.62it/s, loss=2.78, v_num=0]
Epoch 41:  95%|█████████▍| 92/97 [00:13<00:00,  6.59it/s, loss=2.78, v_num=0]
Epoch 41:  96%|█████████▌| 93/97 [00:14<00:00,  6.62it/s, loss=2.78, v_num=0]
Epoch 41:  96%|█████████▌| 93/97 [00:14<00:00,  6.60it/s, loss=2.78, v_num=0]
Epoch 41:  97%|█████████▋| 94/97 [00:14<00:00,  6.63it/s, loss=2.78, v_num=0]
Epoch 41:  97%|█████████▋| 94/97 [00:14<00:00,  6.60it/s, loss=2.78, v_num=0]
Epoch 41:  98%|█████████▊| 95/97 [00:14<00:00,  6.64it/s, loss=2.78, v_num=0]
Epoch 41:  98%|█████████▊| 95/97 [00:14<00:00,  6.61it/s, loss=2.78, v_num=0]
Epoch 41:  99%|█████████▉| 96/97 [00:14<00:00,  6.64it/s, loss=2.78, v_num=0]
Epoch 41:  99%|█████████▉| 96/97 [00:14<00:00,  6.62it/s, loss=2.78, v_num=0]
Epoch 41: 100%|██████████| 97/97 [00:14<00:00,  6.65it/s, loss=2.78, v_num=0]
Epoch 41: 100%|██████████| 97/97 [00:14<00:00,  6.62it/s, loss=2.79, v_num=0]
Epoch 41: 100%|██████████| 97/97 [00:14<00:00,  6.62it/s, loss=2.79, v_num=0]
Epoch 41:   0%|          | 0/97 [00:00<?, ?it/s, loss=2.79, v_num=0]
Epoch 42:   0%|          | 0/97 [00:00<?, ?it/s, loss=2.79, v_num=0]
Epoch 42:   1%|          | 1/97 [00:01<02:15,  1.41s/it, loss=2.79, v_num=0]
Epoch 42:   1%|          | 1/97 [00:01<02:20,  1.46s/it, loss=2.79, v_num=0]
Epoch 42:   2%|▏         | 2/97 [00:01<01:13,  1.30it/s, loss=2.79, v_num=0]
Epoch 42:   2%|▏         | 2/97 [00:01<01:15,  1.25it/s, loss=2.79, v_num=0]
Epoch 42:   3%|▎         | 3/97 [00:01<00:52,  1.79it/s, loss=2.79, v_num=0]
Epoch 42:   3%|▎         | 3/97 [00:01<00:54,  1.73it/s, loss=2.79, v_num=0]
Epoch 42:   4%|▍         | 4/97 [00:01<00:42,  2.21it/s, loss=2.79, v_num=0]
Epoch 42:   4%|▍         | 4/97 [00:01<00:43,  2.14it/s, loss=2.79, v_num=0]
Epoch 42:   5%|▌         | 5/97 [00:01<00:35,  2.57it/s, loss=2.79, v_num=0]
Epoch 42:   5%|▌         | 5/97 [00:02<00:36,  2.49it/s, loss=2.79, v_num=0]
Epoch 42:   6%|▌         | 6/97 [00:02<00:31,  2.88it/s, loss=2.79, v_num=0]
Epoch 42:   6%|▌         | 6/97 [00:02<00:32,  2.80it/s, loss=2.79, v_num=0]
Epoch 42:   7%|▋         | 7/97 [00:02<00:28,  3.15it/s, loss=2.79, v_num=0]
Epoch 42:   7%|▋         | 7/97 [00:02<00:29,  3.07it/s, loss=2.8, v_num=0]
Epoch 42:   8%|▊         | 8/97 [00:02<00:26,  3.40it/s, loss=2.8, v_num=0]
Epoch 42:   8%|▊         | 8/97 [00:02<00:26,  3.31it/s, loss=2.8, v_num=0]
Epoch 42:   9%|▉         | 9/97 [00:02<00:24,  3.61it/s, loss=2.8, v_num=0]
Epoch 42:   9%|▉         | 9/97 [00:02<00:24,  3.52it/s, loss=2.78, v_num=0]
Epoch 42:  10%|█         | 10/97 [00:02<00:22,  3.80it/s, loss=2.78, v_num=0]
Epoch 42:  10%|█         | 10/97 [00:02<00:23,  3.72it/s, loss=2.78, v_num=0]
Epoch 42:  11%|█▏        | 11/97 [00:02<00:21,  3.97it/s, loss=2.78, v_num=0]
Epoch 42:  11%|█▏        | 11/97 [00:02<00:22,  3.88it/s, loss=2.78, v_num=0]
Epoch 42:  12%|█▏        | 12/97 [00:02<00:20,  4.12it/s, loss=2.78, v_num=0]
Epoch 42:  12%|█▏        | 12/97 [00:02<00:21,  4.04it/s, loss=2.79, v_num=0]
Epoch 42:  13%|█▎        | 13/97 [00:03<00:19,  4.27it/s, loss=2.79, v_num=0]
Epoch 42:  13%|█▎        | 13/97 [00:03<00:20,  4.19it/s, loss=2.78, v_num=0]
Epoch 42:  14%|█▍        | 14/97 [00:03<00:18,  4.39it/s, loss=2.78, v_num=0]
Epoch 42:  14%|█▍        | 14/97 [00:03<00:19,  4.32it/s, loss=2.77, v_num=0]
Epoch 42:  15%|█▌        | 15/97 [00:03<00:18,  4.51it/s, loss=2.77, v_num=0]
Epoch 42:  15%|█▌        | 15/97 [00:03<00:18,  4.44it/s, loss=2.78, v_num=0]
Epoch 42:  16%|█▋        | 16/97 [00:03<00:17,  4.63it/s, loss=2.78, v_num=0]
Epoch 42:  16%|█▋        | 16/97 [00:03<00:17,  4.55it/s, loss=2.78, v_num=0]
Epoch 42:  18%|█▊        | 17/97 [00:03<00:16,  4.73it/s, loss=2.78, v_num=0]
Epoch 42:  18%|█▊        | 17/97 [00:03<00:17,  4.66it/s, loss=2.77, v_num=0]
Epoch 42:  19%|█▊        | 18/97 [00:03<00:16,  4.82it/s, loss=2.77, v_num=0]
Epoch 42:  19%|█▊        | 18/97 [00:03<00:16,  4.75it/s, loss=2.77, v_num=0]
Epoch 42:  20%|█▉        | 19/97 [00:03<00:15,  4.91it/s, loss=2.77, v_num=0]
Epoch 42:  20%|█▉        | 19/97 [00:03<00:16,  4.84it/s, loss=2.77, v_num=0]
Epoch 42:  21%|██        | 20/97 [00:04<00:15,  4.99it/s, loss=2.77, v_num=0]
Epoch 42:  21%|██        | 20/97 [00:04<00:15,  4.92it/s, loss=2.77, v_num=0]
Epoch 42:  22%|██▏       | 21/97 [00:04<00:14,  5.07it/s, loss=2.77, v_num=0]
Epoch 42:  22%|██▏       | 21/97 [00:04<00:15,  5.00it/s, loss=2.76, v_num=0]
Epoch 42:  23%|██▎       | 22/97 [00:04<00:14,  5.14it/s, loss=2.76, v_num=0]
Epoch 42:  23%|██▎       | 22/97 [00:04<00:14,  5.08it/s, loss=2.76, v_num=0]
Epoch 42:  24%|██▎       | 23/97 [00:04<00:14,  5.21it/s, loss=2.76, v_num=0]
Epoch 42:  24%|██▎       | 23/97 [00:04<00:14,  5.14it/s, loss=2.76, v_num=0]
Epoch 42:  25%|██▍       | 24/97 [00:04<00:13,  5.27it/s, loss=2.76, v_num=0]
Epoch 42:  25%|██▍       | 24/97 [00:04<00:14,  5.21it/s, loss=2.77, v_num=0]
Epoch 42:  26%|██▌       | 25/97 [00:04<00:13,  5.33it/s, loss=2.77, v_num=0]
Epoch 42:  26%|██▌       | 25/97 [00:04<00:13,  5.27it/s, loss=2.76, v_num=0]
Epoch 42:  27%|██▋       | 26/97 [00:04<00:13,  5.39it/s, loss=2.76, v_num=0]
Epoch 42:  27%|██▋       | 26/97 [00:04<00:13,  5.33it/s, loss=2.77, v_num=0]
Epoch 42:  28%|██▊       | 27/97 [00:04<00:12,  5.44it/s, loss=2.77, v_num=0]
Epoch 42:  28%|██▊       | 27/97 [00:05<00:13,  5.38it/s, loss=2.77, v_num=0]
Epoch 42:  29%|██▉       | 28/97 [00:05<00:12,  5.49it/s, loss=2.77, v_num=0]
Epoch 42:  29%|██▉       | 28/97 [00:05<00:12,  5.43it/s, loss=2.77, v_num=0]
Epoch 42:  30%|██▉       | 29/97 [00:05<00:12,  5.54it/s, loss=2.77, v_num=0]
Epoch 42:  30%|██▉       | 29/97 [00:05<00:12,  5.48it/s, loss=2.76, v_num=0]
Epoch 42:  31%|███       | 30/97 [00:05<00:12,  5.58it/s, loss=2.76, v_num=0]
Epoch 42:  31%|███       | 30/97 [00:05<00:12,  5.53it/s, loss=2.76, v_num=0]
Epoch 42:  32%|███▏      | 31/97 [00:05<00:11,  5.62it/s, loss=2.76, v_num=0]
Epoch 42:  32%|███▏      | 31/97 [00:05<00:11,  5.57it/s, loss=2.76, v_num=0]
Epoch 42:  33%|███▎      | 32/97 [00:05<00:11,  5.67it/s, loss=2.76, v_num=0]
Epoch 42:  33%|███▎      | 32/97 [00:05<00:11,  5.61it/s, loss=2.75, v_num=0]
Epoch 42:  34%|███▍      | 33/97 [00:05<00:11,  5.70it/s, loss=2.75, v_num=0]
Epoch 42:  34%|███▍      | 33/97 [00:05<00:11,  5.65it/s, loss=2.74, v_num=0]
Epoch 42:  35%|███▌      | 34/97 [00:05<00:10,  5.74it/s, loss=2.74, v_num=0]
Epoch 42:  35%|███▌      | 34/97 [00:05<00:11,  5.69it/s, loss=2.75, v_num=0]
Epoch 42:  36%|███▌      | 35/97 [00:06<00:10,  5.78it/s, loss=2.75, v_num=0]
Epoch 42:  36%|███▌      | 35/97 [00:06<00:10,  5.72it/s, loss=2.75, v_num=0]
Epoch 42:  37%|███▋      | 36/97 [00:06<00:10,  5.81it/s, loss=2.75, v_num=0]
Epoch 42:  37%|███▋      | 36/97 [00:06<00:10,  5.76it/s, loss=2.76, v_num=0]
Epoch 42:  38%|███▊      | 37/97 [00:06<00:10,  5.84it/s, loss=2.76, v_num=0]
Epoch 42:  38%|███▊      | 37/97 [00:06<00:10,  5.79it/s, loss=2.77, v_num=0]
Epoch 42:  39%|███▉      | 38/97 [00:06<00:10,  5.87it/s, loss=2.77, v_num=0]
Epoch 42:  39%|███▉      | 38/97 [00:06<00:10,  5.82it/s, loss=2.76, v_num=0]
Epoch 42:  40%|████      | 39/97 [00:06<00:09,  5.90it/s, loss=2.76, v_num=0]
Epoch 42:  40%|████      | 39/97 [00:06<00:09,  5.85it/s, loss=2.77, v_num=0]
Epoch 42:  41%|████      | 40/97 [00:06<00:09,  5.93it/s, loss=2.77, v_num=0]
Epoch 42:  41%|████      | 40/97 [00:06<00:09,  5.88it/s, loss=2.77, v_num=0]
Epoch 42:  42%|████▏     | 41/97 [00:06<00:09,  5.96it/s, loss=2.77, v_num=0]
Epoch 42:  42%|████▏     | 41/97 [00:06<00:09,  5.91it/s, loss=2.77, v_num=0]
Epoch 42:  43%|████▎     | 42/97 [00:07<00:09,  5.98it/s, loss=2.77, v_num=0]
Epoch 42:  43%|████▎     | 42/97 [00:07<00:09,  5.94it/s, loss=2.76, v_num=0]
Epoch 42:  44%|████▍     | 43/97 [00:07<00:08,  6.01it/s, loss=2.76, v_num=0]
Epoch 42:  44%|████▍     | 43/97 [00:07<00:09,  5.96it/s, loss=2.76, v_num=0]
Epoch 42:  45%|████▌     | 44/97 [00:07<00:08,  6.03it/s, loss=2.76, v_num=0]
Epoch 42:  45%|████▌     | 44/97 [00:07<00:08,  5.98it/s, loss=2.75, v_num=0]
Epoch 42:  46%|████▋     | 45/97 [00:07<00:08,  6.05it/s, loss=2.75, v_num=0]
Epoch 42:  46%|████▋     | 45/97 [00:07<00:08,  6.01it/s, loss=2.75, v_num=0]
Epoch 42:  47%|████▋     | 46/97 [00:07<00:08,  6.07it/s, loss=2.75, v_num=0]
Epoch 42:  47%|████▋     | 46/97 [00:07<00:08,  6.03it/s, loss=2.75, v_num=0]
Epoch 42:  48%|████▊     | 47/97 [00:07<00:08,  6.10it/s, loss=2.75, v_num=0]
Epoch 42:  48%|████▊     | 47/97 [00:07<00:08,  6.05it/s, loss=2.75, v_num=0]
Epoch 42:  49%|████▉     | 48/97 [00:07<00:08,  6.12it/s, loss=2.75, v_num=0]
Epoch 42:  49%|████▉     | 48/97 [00:07<00:08,  6.07it/s, loss=2.75, v_num=0]
Epoch 42:  51%|█████     | 49/97 [00:07<00:07,  6.14it/s, loss=2.75, v_num=0]
Epoch 42:  51%|█████     | 49/97 [00:08<00:07,  6.09it/s, loss=2.75, v_num=0]
Epoch 42:  52%|█████▏    | 50/97 [00:08<00:07,  6.15it/s, loss=2.75, v_num=0]
Epoch 42:  52%|█████▏    | 50/97 [00:08<00:07,  6.11it/s, loss=2.75, v_num=0]
Epoch 42:  53%|█████▎    | 51/97 [00:08<00:07,  6.17it/s, loss=2.75, v_num=0]
Epoch 42:  53%|█████▎    | 51/97 [00:08<00:07,  6.13it/s, loss=2.75, v_num=0]
Epoch 42:  54%|█████▎    | 52/97 [00:08<00:07,  6.19it/s, loss=2.75, v_num=0]
Epoch 42:  54%|█████▎    | 52/97 [00:08<00:07,  6.15it/s, loss=2.76, v_num=0]
Epoch 42:  55%|█████▍    | 53/97 [00:08<00:07,  6.20it/s, loss=2.76, v_num=0]
Epoch 42:  55%|█████▍    | 53/97 [00:08<00:07,  6.16it/s, loss=2.76, v_num=0]
Epoch 42:  56%|█████▌    | 54/97 [00:08<00:06,  6.22it/s, loss=2.76, v_num=0]
Epoch 42:  56%|█████▌    | 54/97 [00:08<00:06,  6.18it/s, loss=2.76, v_num=0]
Epoch 42:  57%|█████▋    | 55/97 [00:08<00:06,  6.23it/s, loss=2.76, v_num=0]
Epoch 42:  57%|█████▋    | 55/97 [00:08<00:06,  6.20it/s, loss=2.75, v_num=0]
Epoch 42:  58%|█████▊    | 56/97 [00:08<00:06,  6.25it/s, loss=2.75, v_num=0]
Epoch 42:  58%|█████▊    | 56/97 [00:09<00:06,  6.21it/s, loss=2.75, v_num=0]
Epoch 42:  59%|█████▉    | 57/97 [00:09<00:06,  6.27it/s, loss=2.75, v_num=0]
Epoch 42:  59%|█████▉    | 57/97 [00:09<00:06,  6.23it/s, loss=2.75, v_num=0]
Epoch 42:  60%|█████▉    | 58/97 [00:09<00:06,  6.28it/s, loss=2.75, v_num=0]
Epoch 42:  60%|█████▉    | 58/97 [00:09<00:06,  6.24it/s, loss=2.74, v_num=0]
Epoch 42:  61%|██████    | 59/97 [00:09<00:06,  6.30it/s, loss=2.74, v_num=0]
Epoch 42:  61%|██████    | 59/97 [00:09<00:06,  6.26it/s, loss=2.75, v_num=0]
Epoch 42:  62%|██████▏   | 60/97 [00:09<00:05,  6.31it/s, loss=2.75, v_num=0]
Epoch 42:  62%|██████▏   | 60/97 [00:09<00:05,  6.27it/s, loss=2.74, v_num=0]
Epoch 42:  63%|██████▎   | 61/97 [00:09<00:05,  6.33it/s, loss=2.74, v_num=0]
Epoch 42:  63%|██████▎   | 61/97 [00:09<00:05,  6.29it/s, loss=2.74, v_num=0]
Epoch 42:  64%|██████▍   | 62/97 [00:09<00:05,  6.34it/s, loss=2.74, v_num=0]
Epoch 42:  64%|██████▍   | 62/97 [00:09<00:05,  6.30it/s, loss=2.75, v_num=0]
Epoch 42:  65%|██████▍   | 63/97 [00:09<00:05,  6.35it/s, loss=2.75, v_num=0]
Epoch 42:  65%|██████▍   | 63/97 [00:09<00:05,  6.31it/s, loss=2.74, v_num=0]
Epoch 42:  66%|██████▌   | 64/97 [00:10<00:05,  6.36it/s, loss=2.74, v_num=0]
Epoch 42:  66%|██████▌   | 64/97 [00:10<00:05,  6.33it/s, loss=2.75, v_num=0]
Epoch 42:  67%|██████▋   | 65/97 [00:10<00:05,  6.37it/s, loss=2.75, v_num=0]
Epoch 42:  67%|██████▋   | 65/97 [00:10<00:05,  6.34it/s, loss=2.75, v_num=0]
Epoch 42:  68%|██████▊   | 66/97 [00:10<00:04,  6.39it/s, loss=2.75, v_num=0]
Epoch 42:  68%|██████▊   | 66/97 [00:10<00:04,  6.35it/s, loss=2.76, v_num=0]
Epoch 42:  69%|██████▉   | 67/97 [00:10<00:04,  6.40it/s, loss=2.76, v_num=0]
Epoch 42:  69%|██████▉   | 67/97 [00:10<00:04,  6.37it/s, loss=2.76, v_num=0]
Epoch 42:  70%|███████   | 68/97 [00:10<00:04,  6.41it/s, loss=2.76, v_num=0]
Epoch 42:  70%|███████   | 68/97 [00:10<00:04,  6.38it/s, loss=2.76, v_num=0]
Epoch 42:  71%|███████   | 69/97 [00:10<00:04,  6.42it/s, loss=2.76, v_num=0]
Epoch 42:  71%|███████   | 69/97 [00:10<00:04,  6.39it/s, loss=2.76, v_num=0]
Epoch 42:  72%|███████▏  | 70/97 [00:10<00:04,  6.43it/s, loss=2.76, v_num=0]
Epoch 42:  72%|███████▏  | 70/97 [00:10<00:04,  6.40it/s, loss=2.76, v_num=0]
Epoch 42:  73%|███████▎  | 71/97 [00:11<00:04,  6.44it/s, loss=2.76, v_num=0]
Epoch 42:  73%|███████▎  | 71/97 [00:11<00:04,  6.41it/s, loss=2.76, v_num=0]
Epoch 42:  74%|███████▍  | 72/97 [00:11<00:03,  6.46it/s, loss=2.76, v_num=0]
Epoch 42:  74%|███████▍  | 72/97 [00:11<00:03,  6.42it/s, loss=2.76, v_num=0]
Epoch 42:  75%|███████▌  | 73/97 [00:11<00:03,  6.46it/s, loss=2.76, v_num=0]
Epoch 42:  75%|███████▌  | 73/97 [00:11<00:03,  6.43it/s, loss=2.77, v_num=0]
Epoch 42:  76%|███████▋  | 74/97 [00:11<00:03,  6.47it/s, loss=2.77, v_num=0]
Epoch 42:  76%|███████▋  | 74/97 [00:11<00:03,  6.44it/s, loss=2.77, v_num=0]
Epoch 42:  77%|███████▋  | 75/97 [00:11<00:03,  6.48it/s, loss=2.77, v_num=0]
Epoch 42:  77%|███████▋  | 75/97 [00:11<00:03,  6.45it/s, loss=2.77, v_num=0]
Epoch 42:  78%|███████▊  | 76/97 [00:11<00:03,  6.49it/s, loss=2.77, v_num=0]
Epoch 42:  78%|███████▊  | 76/97 [00:11<00:03,  6.46it/s, loss=2.77, v_num=0]
Epoch 42:  79%|███████▉  | 77/97 [00:11<00:03,  6.50it/s, loss=2.77, v_num=0]
Epoch 42:  79%|███████▉  | 77/97 [00:11<00:03,  6.47it/s, loss=2.77, v_num=0]
Epoch 42:  80%|████████  | 78/97 [00:11<00:02,  6.51it/s, loss=2.77, v_num=0]
Epoch 42:  80%|████████  | 78/97 [00:12<00:02,  6.48it/s, loss=2.77, v_num=0]
Epoch 42:  81%|████████▏ | 79/97 [00:12<00:02,  6.52it/s, loss=2.77, v_num=0]
Epoch 42:  81%|████████▏ | 79/97 [00:12<00:02,  6.49it/s, loss=2.78, v_num=0]
Epoch 42:  82%|████████▏ | 80/97 [00:12<00:02,  6.53it/s, loss=2.78, v_num=0]
Epoch 42:  82%|████████▏ | 80/97 [00:12<00:02,  6.50it/s, loss=2.78, v_num=0]
Epoch 42:  84%|████████▎ | 81/97 [00:12<00:02,  6.53it/s, loss=2.78, v_num=0]
Epoch 42:  84%|████████▎ | 81/97 [00:12<00:02,  6.50it/s, loss=2.78, v_num=0]
Epoch 42:  85%|████████▍ | 82/97 [00:12<00:02,  6.54it/s, loss=2.78, v_num=0]
Epoch 42:  85%|████████▍ | 82/97 [00:12<00:02,  6.51it/s, loss=2.78, v_num=0]
Epoch 42:  86%|████████▌ | 83/97 [00:12<00:02,  6.55it/s, loss=2.78, v_num=0]
Epoch 42:  86%|████████▌ | 83/97 [00:12<00:02,  6.52it/s, loss=2.78, v_num=0]
Epoch 42:  87%|████████▋ | 84/97 [00:12<00:01,  6.56it/s, loss=2.78, v_num=0]
Epoch 42:  87%|████████▋ | 84/97 [00:12<00:01,  6.53it/s, loss=2.78, v_num=0]
Epoch 42:  88%|████████▊ | 85/97 [00:12<00:01,  6.57it/s, loss=2.78, v_num=0]
Epoch 42:  88%|████████▊ | 85/97 [00:13<00:01,  6.54it/s, loss=2.78, v_num=0]
Epoch 42:  89%|████████▊ | 86/97 [00:13<00:01,  6.57it/s, loss=2.78, v_num=0]
Epoch 42:  89%|████████▊ | 86/97 [00:13<00:01,  6.55it/s, loss=2.77, v_num=0]
Epoch 42:  90%|████████▉ | 87/97 [00:13<00:01,  6.58it/s, loss=2.77, v_num=0]
Epoch 42:  90%|████████▉ | 87/97 [00:13<00:01,  6.55it/s, loss=2.77, v_num=0]
Epoch 42:  91%|█████████ | 88/97 [00:13<00:01,  6.58it/s, loss=2.77, v_num=0]
Epoch 42:  91%|█████████ | 88/97 [00:13<00:01,  6.56it/s, loss=2.77, v_num=0]
Epoch 42:  92%|█████████▏| 89/97 [00:13<00:01,  6.59it/s, loss=2.77, v_num=0]
Epoch 42:  92%|█████████▏| 89/97 [00:13<00:01,  6.56it/s, loss=2.77, v_num=0]
Epoch 42:  93%|█████████▎| 90/97 [00:13<00:01,  6.60it/s, loss=2.77, v_num=0]
Epoch 42:  93%|█████████▎| 90/97 [00:13<00:01,  6.57it/s, loss=2.77, v_num=0]
Epoch 42:  94%|█████████▍| 91/97 [00:13<00:00,  6.61it/s, loss=2.77, v_num=0]
Epoch 42:  94%|█████████▍| 91/97 [00:13<00:00,  6.58it/s, loss=2.77, v_num=0]
Epoch 42:  95%|█████████▍| 92/97 [00:13<00:00,  6.61it/s, loss=2.77, v_num=0]
Epoch 42:  95%|█████████▍| 92/97 [00:13<00:00,  6.59it/s, loss=2.76, v_num=0]
Epoch 42:  96%|█████████▌| 93/97 [00:14<00:00,  6.62it/s, loss=2.76, v_num=0]
Epoch 42:  96%|█████████▌| 93/97 [00:14<00:00,  6.59it/s, loss=2.76, v_num=0]
Epoch 42:  97%|█████████▋| 94/97 [00:14<00:00,  6.63it/s, loss=2.76, v_num=0]
Epoch 42:  97%|█████████▋| 94/97 [00:14<00:00,  6.60it/s, loss=2.76, v_num=0]
Epoch 42:  98%|█████████▊| 95/97 [00:14<00:00,  6.63it/s, loss=2.76, v_num=0]
Epoch 42:  98%|█████████▊| 95/97 [00:14<00:00,  6.61it/s, loss=2.75, v_num=0]
Epoch 42:  99%|█████████▉| 96/97 [00:14<00:00,  6.64it/s, loss=2.75, v_num=0]
Epoch 42:  99%|█████████▉| 96/97 [00:14<00:00,  6.61it/s, loss=2.75, v_num=0]
Epoch 42: 100%|██████████| 97/97 [00:14<00:00,  6.65it/s, loss=2.75, v_num=0]
Epoch 42: 100%|██████████| 97/97 [00:14<00:00,  6.62it/s, loss=2.75, v_num=0]
Epoch 42: 100%|██████████| 97/97 [00:14<00:00,  6.62it/s, loss=2.75, v_num=0]
Epoch 42:   0%|          | 0/97 [00:00<?, ?it/s, loss=2.75, v_num=0]
Epoch 43:   0%|          | 0/97 [00:00<?, ?it/s, loss=2.75, v_num=0]
Epoch 43:   1%|          | 1/97 [00:01<02:13,  1.39s/it, loss=2.75, v_num=0]
Epoch 43:   1%|          | 1/97 [00:01<02:18,  1.44s/it, loss=2.75, v_num=0]
Epoch 43:   2%|▏         | 2/97 [00:01<01:12,  1.32it/s, loss=2.75, v_num=0]
Epoch 43:   2%|▏         | 2/97 [00:01<01:14,  1.27it/s, loss=2.75, v_num=0]
Epoch 43:   3%|▎         | 3/97 [00:01<00:51,  1.81it/s, loss=2.75, v_num=0]
Epoch 43:   3%|▎         | 3/97 [00:01<00:53,  1.75it/s, loss=2.74, v_num=0]
Epoch 43:   4%|▍         | 4/97 [00:01<00:41,  2.23it/s, loss=2.74, v_num=0]
Epoch 43:   4%|▍         | 4/97 [00:01<00:43,  2.16it/s, loss=2.75, v_num=0]
Epoch 43:   5%|▌         | 5/97 [00:01<00:35,  2.59it/s, loss=2.75, v_num=0]
Epoch 43:   5%|▌         | 5/97 [00:01<00:36,  2.51it/s, loss=2.75, v_num=0]
Epoch 43:   6%|▌         | 6/97 [00:02<00:31,  2.90it/s, loss=2.75, v_num=0]
Epoch 43:   6%|▌         | 6/97 [00:02<00:32,  2.82it/s, loss=2.75, v_num=0]
Epoch 43:   7%|▋         | 7/97 [00:02<00:28,  3.18it/s, loss=2.75, v_num=0]
Epoch 43:   7%|▋         | 7/97 [00:02<00:29,  3.10it/s, loss=2.74, v_num=0]
Epoch 43:   8%|▊         | 8/97 [00:02<00:26,  3.42it/s, loss=2.74, v_num=0]
Epoch 43:   8%|▊         | 8/97 [00:02<00:26,  3.34it/s, loss=2.75, v_num=0]
Epoch 43:   9%|▉         | 9/97 [00:02<00:24,  3.63it/s, loss=2.75, v_num=0]
Epoch 43:   9%|▉         | 9/97 [00:02<00:24,  3.54it/s, loss=2.75, v_num=0]
Epoch 43:  10%|█         | 10/97 [00:02<00:22,  3.81it/s, loss=2.75, v_num=0]
Epoch 43:  10%|█         | 10/97 [00:02<00:23,  3.74it/s, loss=2.74, v_num=0]
Epoch 43:  11%|█▏        | 11/97 [00:02<00:21,  3.99it/s, loss=2.74, v_num=0]
Epoch 43:  11%|█▏        | 11/97 [00:02<00:21,  3.91it/s, loss=2.74, v_num=0]
Epoch 43:  12%|█▏        | 12/97 [00:02<00:20,  4.15it/s, loss=2.74, v_num=0]
Epoch 43:  12%|█▏        | 12/97 [00:02<00:20,  4.07it/s, loss=2.75, v_num=0]
Epoch 43:  13%|█▎        | 13/97 [00:03<00:19,  4.30it/s, loss=2.75, v_num=0]
Epoch 43:  13%|█▎        | 13/97 [00:03<00:19,  4.21it/s, loss=2.74, v_num=0]
Epoch 43:  14%|█▍        | 14/97 [00:03<00:18,  4.42it/s, loss=2.74, v_num=0]
Epoch 43:  14%|█▍        | 14/97 [00:03<00:19,  4.35it/s, loss=2.73, v_num=0]
Epoch 43:  15%|█▌        | 15/97 [00:03<00:18,  4.54it/s, loss=2.73, v_num=0]
Epoch 43:  15%|█▌        | 15/97 [00:03<00:18,  4.47it/s, loss=2.73, v_num=0]
Epoch 43:  16%|█▋        | 16/97 [00:03<00:17,  4.66it/s, loss=2.73, v_num=0]
Epoch 43:  16%|█▋        | 16/97 [00:03<00:17,  4.58it/s, loss=2.73, v_num=0]
Epoch 43:  18%|█▊        | 17/97 [00:03<00:16,  4.76it/s, loss=2.73, v_num=0]
Epoch 43:  18%|█▊        | 17/97 [00:03<00:17,  4.68it/s, loss=2.73, v_num=0]
Epoch 43:  19%|█▊        | 18/97 [00:03<00:16,  4.85it/s, loss=2.73, v_num=0]
Epoch 43:  19%|█▊        | 18/97 [00:03<00:16,  4.78it/s, loss=2.74, v_num=0]
Epoch 43:  20%|█▉        | 19/97 [00:03<00:15,  4.94it/s, loss=2.74, v_num=0]
Epoch 43:  20%|█▉        | 19/97 [00:03<00:16,  4.87it/s, loss=2.73, v_num=0]
Epoch 43:  21%|██        | 20/97 [00:03<00:15,  5.02it/s, loss=2.73, v_num=0]
Epoch 43:  21%|██        | 20/97 [00:04<00:15,  4.95it/s, loss=2.73, v_num=0]
Epoch 43:  22%|██▏       | 21/97 [00:04<00:14,  5.10it/s, loss=2.73, v_num=0]
Epoch 43:  22%|██▏       | 21/97 [00:04<00:15,  5.03it/s, loss=2.72, v_num=0]
Epoch 43:  23%|██▎       | 22/97 [00:04<00:14,  5.17it/s, loss=2.72, v_num=0]
Epoch 43:  23%|██▎       | 22/97 [00:04<00:14,  5.10it/s, loss=2.73, v_num=0]
Epoch 43:  24%|██▎       | 23/97 [00:04<00:14,  5.24it/s, loss=2.73, v_num=0]
Epoch 43:  24%|██▎       | 23/97 [00:04<00:14,  5.17it/s, loss=2.73, v_num=0]
Epoch 43:  25%|██▍       | 24/97 [00:04<00:13,  5.30it/s, loss=2.73, v_num=0]
Epoch 43:  25%|██▍       | 24/97 [00:04<00:13,  5.24it/s, loss=2.72, v_num=0]
Epoch 43:  26%|██▌       | 25/97 [00:04<00:13,  5.36it/s, loss=2.72, v_num=0]
Epoch 43:  26%|██▌       | 25/97 [00:04<00:13,  5.30it/s, loss=2.72, v_num=0]
Epoch 43:  27%|██▋       | 26/97 [00:04<00:13,  5.41it/s, loss=2.72, v_num=0]
Epoch 43:  27%|██▋       | 26/97 [00:04<00:13,  5.35it/s, loss=2.72, v_num=0]
Epoch 43:  28%|██▊       | 27/97 [00:04<00:12,  5.47it/s, loss=2.72, v_num=0]
Epoch 43:  28%|██▊       | 27/97 [00:04<00:12,  5.41it/s, loss=2.72, v_num=0]
Epoch 43:  29%|██▉       | 28/97 [00:05<00:12,  5.52it/s, loss=2.72, v_num=0]
Epoch 43:  29%|██▉       | 28/97 [00:05<00:12,  5.46it/s, loss=2.73, v_num=0]
Epoch 43:  30%|██▉       | 29/97 [00:05<00:12,  5.56it/s, loss=2.73, v_num=0]
Epoch 43:  30%|██▉       | 29/97 [00:05<00:12,  5.50it/s, loss=2.72, v_num=0]
Epoch 43:  31%|███       | 30/97 [00:05<00:11,  5.61it/s, loss=2.72, v_num=0]
Epoch 43:  31%|███       | 30/97 [00:05<00:12,  5.55it/s, loss=2.72, v_num=0]
Epoch 43:  32%|███▏      | 31/97 [00:05<00:11,  5.65it/s, loss=2.72, v_num=0]
Epoch 43:  32%|███▏      | 31/97 [00:05<00:11,  5.59it/s, loss=2.71, v_num=0]
Epoch 43:  33%|███▎      | 32/97 [00:05<00:11,  5.69it/s, loss=2.71, v_num=0]
Epoch 43:  33%|███▎      | 32/97 [00:05<00:11,  5.63it/s, loss=2.71, v_num=0]
Epoch 43:  34%|███▍      | 33/97 [00:05<00:11,  5.73it/s, loss=2.71, v_num=0]
Epoch 43:  34%|███▍      | 33/97 [00:05<00:11,  5.67it/s, loss=2.71, v_num=0]
Epoch 43:  35%|███▌      | 34/97 [00:05<00:10,  5.77it/s, loss=2.71, v_num=0]
Epoch 43:  35%|███▌      | 34/97 [00:05<00:11,  5.71it/s, loss=2.71, v_num=0]
Epoch 43:  36%|███▌      | 35/97 [00:06<00:10,  5.80it/s, loss=2.71, v_num=0]
Epoch 43:  36%|███▌      | 35/97 [00:06<00:10,  5.75it/s, loss=2.71, v_num=0]
Epoch 43:  37%|███▋      | 36/97 [00:06<00:10,  5.84it/s, loss=2.71, v_num=0]
Epoch 43:  37%|███▋      | 36/97 [00:06<00:10,  5.78it/s, loss=2.71, v_num=0]
Epoch 43:  38%|███▊      | 37/97 [00:06<00:10,  5.86it/s, loss=2.71, v_num=0]
Epoch 43:  38%|███▊      | 37/97 [00:06<00:10,  5.81it/s, loss=2.71, v_num=0]
Epoch 43:  39%|███▉      | 38/97 [00:06<00:10,  5.90it/s, loss=2.71, v_num=0]
Epoch 43:  39%|███▉      | 38/97 [00:06<00:10,  5.84it/s, loss=2.7, v_num=0]
Epoch 43:  40%|████      | 39/97 [00:06<00:09,  5.92it/s, loss=2.7, v_num=0]
Epoch 43:  40%|████      | 39/97 [00:06<00:09,  5.88it/s, loss=2.71, v_num=0]
Epoch 43:  41%|████      | 40/97 [00:06<00:09,  5.96it/s, loss=2.71, v_num=0]
Epoch 43:  41%|████      | 40/97 [00:06<00:09,  5.90it/s, loss=2.71, v_num=0]
Epoch 43:  42%|████▏     | 41/97 [00:06<00:09,  5.98it/s, loss=2.71, v_num=0]
Epoch 43:  42%|████▏     | 41/97 [00:06<00:09,  5.93it/s, loss=2.7, v_num=0]
Epoch 43:  43%|████▎     | 42/97 [00:06<00:09,  6.01it/s, loss=2.7, v_num=0]
Epoch 43:  43%|████▎     | 42/97 [00:07<00:09,  5.96it/s, loss=2.7, v_num=0]
Epoch 43:  44%|████▍     | 43/97 [00:07<00:08,  6.03it/s, loss=2.7, v_num=0]
Epoch 43:  44%|████▍     | 43/97 [00:07<00:09,  5.98it/s, loss=2.7, v_num=0]
Epoch 43:  45%|████▌     | 44/97 [00:07<00:08,  6.05it/s, loss=2.7, v_num=0]
Epoch 43:  45%|████▌     | 44/97 [00:07<00:08,  6.01it/s, loss=2.7, v_num=0]
Epoch 43:  46%|████▋     | 45/97 [00:07<00:08,  6.07it/s, loss=2.7, v_num=0]
Epoch 43:  46%|████▋     | 45/97 [00:07<00:08,  6.03it/s, loss=2.71, v_num=0]
Epoch 43:  47%|████▋     | 46/97 [00:07<00:08,  6.09it/s, loss=2.71, v_num=0]
Epoch 43:  47%|████▋     | 46/97 [00:07<00:08,  6.05it/s, loss=2.71, v_num=0]
Epoch 43:  48%|████▊     | 47/97 [00:07<00:08,  6.12it/s, loss=2.71, v_num=0]
Epoch 43:  48%|████▊     | 47/97 [00:07<00:08,  6.07it/s, loss=2.71, v_num=0]
Epoch 43:  49%|████▉     | 48/97 [00:07<00:07,  6.14it/s, loss=2.71, v_num=0]
Epoch 43:  49%|████▉     | 48/97 [00:07<00:08,  6.09it/s, loss=2.71, v_num=0]
Epoch 43:  51%|█████     | 49/97 [00:07<00:07,  6.16it/s, loss=2.71, v_num=0]
Epoch 43:  51%|█████     | 49/97 [00:08<00:07,  6.11it/s, loss=2.7, v_num=0]
Epoch 43:  52%|█████▏    | 50/97 [00:08<00:07,  6.17it/s, loss=2.7, v_num=0]
Epoch 43:  52%|█████▏    | 50/97 [00:08<00:07,  6.13it/s, loss=2.71, v_num=0]
Epoch 43:  53%|█████▎    | 51/97 [00:08<00:07,  6.19it/s, loss=2.71, v_num=0]
Epoch 43:  53%|█████▎    | 51/97 [00:08<00:07,  6.15it/s, loss=2.71, v_num=0]
Epoch 43:  54%|█████▎    | 52/97 [00:08<00:07,  6.21it/s, loss=2.71, v_num=0]
Epoch 43:  54%|█████▎    | 52/97 [00:08<00:07,  6.17it/s, loss=2.71, v_num=0]
Epoch 43:  55%|█████▍    | 53/97 [00:08<00:07,  6.23it/s, loss=2.71, v_num=0]
Epoch 43:  55%|█████▍    | 53/97 [00:08<00:07,  6.19it/s, loss=2.71, v_num=0]
Epoch 43:  56%|█████▌    | 54/97 [00:08<00:06,  6.24it/s, loss=2.71, v_num=0]
Epoch 43:  56%|█████▌    | 54/97 [00:08<00:06,  6.20it/s, loss=2.71, v_num=0]
Epoch 43:  57%|█████▋    | 55/97 [00:08<00:06,  6.26it/s, loss=2.71, v_num=0]
Epoch 43:  57%|█████▋    | 55/97 [00:08<00:06,  6.22it/s, loss=2.71, v_num=0]
Epoch 43:  58%|█████▊    | 56/97 [00:08<00:06,  6.27it/s, loss=2.71, v_num=0]
Epoch 43:  58%|█████▊    | 56/97 [00:08<00:06,  6.23it/s, loss=2.71, v_num=0]
Epoch 43:  59%|█████▉    | 57/97 [00:09<00:06,  6.29it/s, loss=2.71, v_num=0]
Epoch 43:  59%|█████▉    | 57/97 [00:09<00:06,  6.25it/s, loss=2.71, v_num=0]
Epoch 43:  60%|█████▉    | 58/97 [00:09<00:06,  6.30it/s, loss=2.71, v_num=0]
Epoch 43:  60%|█████▉    | 58/97 [00:09<00:06,  6.26it/s, loss=2.71, v_num=0]
Epoch 43:  61%|██████    | 59/97 [00:09<00:06,  6.32it/s, loss=2.71, v_num=0]
Epoch 43:  61%|██████    | 59/97 [00:09<00:06,  6.28it/s, loss=2.71, v_num=0]
Epoch 43:  62%|██████▏   | 60/97 [00:09<00:05,  6.33it/s, loss=2.71, v_num=0]
Epoch 43:  62%|██████▏   | 60/97 [00:09<00:05,  6.29it/s, loss=2.71, v_num=0]
Epoch 43:  63%|██████▎   | 61/97 [00:09<00:05,  6.34it/s, loss=2.71, v_num=0]
Epoch 43:  63%|██████▎   | 61/97 [00:09<00:05,  6.31it/s, loss=2.71, v_num=0]
Epoch 43:  64%|██████▍   | 62/97 [00:09<00:05,  6.36it/s, loss=2.71, v_num=0]
Epoch 43:  64%|██████▍   | 62/97 [00:09<00:05,  6.32it/s, loss=2.71, v_num=0]
Epoch 43:  65%|██████▍   | 63/97 [00:09<00:05,  6.37it/s, loss=2.71, v_num=0]
Epoch 43:  65%|██████▍   | 63/97 [00:09<00:05,  6.33it/s, loss=2.71, v_num=0]
Epoch 43:  66%|██████▌   | 64/97 [00:10<00:05,  6.38it/s, loss=2.71, v_num=0]
Epoch 43:  66%|██████▌   | 64/97 [00:10<00:05,  6.35it/s, loss=2.71, v_num=0]
Epoch 43:  67%|██████▋   | 65/97 [00:10<00:05,  6.39it/s, loss=2.71, v_num=0]
Epoch 43:  67%|██████▋   | 65/97 [00:10<00:05,  6.36it/s, loss=2.7, v_num=0]
Epoch 43:  68%|██████▊   | 66/97 [00:10<00:04,  6.41it/s, loss=2.7, v_num=0]
Epoch 43:  68%|██████▊   | 66/97 [00:10<00:04,  6.37it/s, loss=2.71, v_num=0]
Epoch 43:  69%|██████▉   | 67/97 [00:10<00:04,  6.42it/s, loss=2.71, v_num=0]
Epoch 43:  69%|██████▉   | 67/97 [00:10<00:04,  6.38it/s, loss=2.72, v_num=0]
Epoch 43:  70%|███████   | 68/97 [00:10<00:04,  6.43it/s, loss=2.72, v_num=0]
Epoch 43:  70%|███████   | 68/97 [00:10<00:04,  6.40it/s, loss=2.71, v_num=0]
Epoch 43:  71%|███████   | 69/97 [00:10<00:04,  6.44it/s, loss=2.71, v_num=0]
Epoch 43:  71%|███████   | 69/97 [00:10<00:04,  6.41it/s, loss=2.72, v_num=0]
Epoch 43:  72%|███████▏  | 70/97 [00:10<00:04,  6.45it/s, loss=2.72, v_num=0]
Epoch 43:  72%|███████▏  | 70/97 [00:10<00:04,  6.42it/s, loss=2.72, v_num=0]
Epoch 43:  73%|███████▎  | 71/97 [00:10<00:04,  6.46it/s, loss=2.72, v_num=0]
Epoch 43:  73%|███████▎  | 71/97 [00:11<00:04,  6.43it/s, loss=2.73, v_num=0]
Epoch 43:  74%|███████▍  | 72/97 [00:11<00:03,  6.47it/s, loss=2.73, v_num=0]
Epoch 43:  74%|███████▍  | 72/97 [00:11<00:03,  6.44it/s, loss=2.73, v_num=0]
Epoch 43:  75%|███████▌  | 73/97 [00:11<00:03,  6.48it/s, loss=2.73, v_num=0]
Epoch 43:  75%|███████▌  | 73/97 [00:11<00:03,  6.45it/s, loss=2.74, v_num=0]
Epoch 43:  76%|███████▋  | 74/97 [00:11<00:03,  6.49it/s, loss=2.74, v_num=0]
Epoch 43:  76%|███████▋  | 74/97 [00:11<00:03,  6.46it/s, loss=2.74, v_num=0]
Epoch 43:  77%|███████▋  | 75/97 [00:11<00:03,  6.50it/s, loss=2.74, v_num=0]
Epoch 43:  77%|███████▋  | 75/97 [00:11<00:03,  6.47it/s, loss=2.73, v_num=0]
Epoch 43:  78%|███████▊  | 76/97 [00:11<00:03,  6.51it/s, loss=2.73, v_num=0]
Epoch 43:  78%|███████▊  | 76/97 [00:11<00:03,  6.48it/s, loss=2.73, v_num=0]
Epoch 43:  79%|███████▉  | 77/97 [00:11<00:03,  6.52it/s, loss=2.73, v_num=0]
Epoch 43:  79%|███████▉  | 77/97 [00:11<00:03,  6.49it/s, loss=2.74, v_num=0]
Epoch 43:  80%|████████  | 78/97 [00:11<00:02,  6.52it/s, loss=2.74, v_num=0]
Epoch 43:  80%|████████  | 78/97 [00:12<00:02,  6.49it/s, loss=2.74, v_num=0]
Epoch 43:  81%|████████▏ | 79/97 [00:12<00:02,  6.53it/s, loss=2.74, v_num=0]
Epoch 43:  81%|████████▏ | 79/97 [00:12<00:02,  6.50it/s, loss=2.74, v_num=0]
Epoch 43:  82%|████████▏ | 80/97 [00:12<00:02,  6.54it/s, loss=2.74, v_num=0]
Epoch 43:  82%|████████▏ | 80/97 [00:12<00:02,  6.51it/s, loss=2.74, v_num=0]
Epoch 43:  84%|████████▎ | 81/97 [00:12<00:02,  6.55it/s, loss=2.74, v_num=0]
Epoch 43:  84%|████████▎ | 81/97 [00:12<00:02,  6.51it/s, loss=2.74, v_num=0]
Epoch 43:  85%|████████▍ | 82/97 [00:12<00:02,  6.55it/s, loss=2.74, v_num=0]
Epoch 43:  85%|████████▍ | 82/97 [00:12<00:02,  6.52it/s, loss=2.74, v_num=0]
Epoch 43:  86%|████████▌ | 83/97 [00:12<00:02,  6.56it/s, loss=2.74, v_num=0]
Epoch 43:  86%|████████▌ | 83/97 [00:12<00:02,  6.53it/s, loss=2.74, v_num=0]
Epoch 43:  87%|████████▋ | 84/97 [00:12<00:01,  6.57it/s, loss=2.74, v_num=0]
Epoch 43:  87%|████████▋ | 84/97 [00:12<00:01,  6.54it/s, loss=2.73, v_num=0]
Epoch 43:  88%|████████▊ | 85/97 [00:12<00:01,  6.57it/s, loss=2.73, v_num=0]
Epoch 43:  88%|████████▊ | 85/97 [00:12<00:01,  6.54it/s, loss=2.73, v_num=0]
Epoch 43:  89%|████████▊ | 86/97 [00:13<00:01,  6.58it/s, loss=2.73, v_num=0]
Epoch 43:  89%|████████▊ | 86/97 [00:13<00:01,  6.55it/s, loss=2.72, v_num=0]
Epoch 43:  90%|████████▉ | 87/97 [00:13<00:01,  6.59it/s, loss=2.72, v_num=0]
Epoch 43:  90%|████████▉ | 87/97 [00:13<00:01,  6.56it/s, loss=2.72, v_num=0]
Epoch 43:  91%|█████████ | 88/97 [00:13<00:01,  6.60it/s, loss=2.72, v_num=0]
Epoch 43:  91%|█████████ | 88/97 [00:13<00:01,  6.57it/s, loss=2.72, v_num=0]
Epoch 43:  92%|█████████▏| 89/97 [00:13<00:01,  6.60it/s, loss=2.72, v_num=0]
Epoch 43:  92%|█████████▏| 89/97 [00:13<00:01,  6.58it/s, loss=2.71, v_num=0]
Epoch 43:  93%|█████████▎| 90/97 [00:13<00:01,  6.61it/s, loss=2.71, v_num=0]
Epoch 43:  93%|█████████▎| 90/97 [00:13<00:01,  6.58it/s, loss=2.71, v_num=0]
Epoch 43:  94%|█████████▍| 91/97 [00:13<00:00,  6.62it/s, loss=2.71, v_num=0]
Epoch 43:  94%|█████████▍| 91/97 [00:13<00:00,  6.59it/s, loss=2.71, v_num=0]
Epoch 43:  95%|█████████▍| 92/97 [00:13<00:00,  6.63it/s, loss=2.71, v_num=0]
Epoch 43:  95%|█████████▍| 92/97 [00:13<00:00,  6.60it/s, loss=2.7, v_num=0]
Epoch 43:  96%|█████████▌| 93/97 [00:14<00:00,  6.63it/s, loss=2.7, v_num=0]
Epoch 43:  96%|█████████▌| 93/97 [00:14<00:00,  6.60it/s, loss=2.7, v_num=0]
Epoch 43:  97%|█████████▋| 94/97 [00:14<00:00,  6.64it/s, loss=2.7, v_num=0]
Epoch 43:  97%|█████████▋| 94/97 [00:14<00:00,  6.61it/s, loss=2.69, v_num=0]
Epoch 43:  98%|█████████▊| 95/97 [00:14<00:00,  6.64it/s, loss=2.69, v_num=0]
Epoch 43:  98%|█████████▊| 95/97 [00:14<00:00,  6.62it/s, loss=2.7, v_num=0]
Epoch 43:  99%|█████████▉| 96/97 [00:14<00:00,  6.65it/s, loss=2.7, v_num=0]
Epoch 43:  99%|█████████▉| 96/97 [00:14<00:00,  6.62it/s, loss=2.69, v_num=0]
Epoch 43: 100%|██████████| 97/97 [00:14<00:00,  6.66it/s, loss=2.69, v_num=0]
Epoch 43: 100%|██████████| 97/97 [00:14<00:00,  6.63it/s, loss=2.69, v_num=0]
Epoch 43: 100%|██████████| 97/97 [00:14<00:00,  6.63it/s, loss=2.69, v_num=0]
Epoch 43:   0%|          | 0/97 [00:00<?, ?it/s, loss=2.69, v_num=0]
Epoch 44:   0%|          | 0/97 [00:00<?, ?it/s, loss=2.69, v_num=0]
Epoch 44:   1%|          | 1/97 [00:01<02:16,  1.42s/it, loss=2.69, v_num=0]
Epoch 44:   1%|          | 1/97 [00:01<02:22,  1.48s/it, loss=2.7, v_num=0]
Epoch 44:   2%|▏         | 2/97 [00:01<01:14,  1.28it/s, loss=2.7, v_num=0]
Epoch 44:   2%|▏         | 2/97 [00:01<01:16,  1.24it/s, loss=2.7, v_num=0]
Epoch 44:   3%|▎         | 3/97 [00:01<00:53,  1.76it/s, loss=2.7, v_num=0]
Epoch 44:   3%|▎         | 3/97 [00:01<00:55,  1.71it/s, loss=2.7, v_num=0]
Epoch 44:   4%|▍         | 4/97 [00:01<00:42,  2.18it/s, loss=2.7, v_num=0]
Epoch 44:   4%|▍         | 4/97 [00:01<00:43,  2.11it/s, loss=2.7, v_num=0]
Epoch 44:   5%|▌         | 5/97 [00:01<00:36,  2.53it/s, loss=2.7, v_num=0]
Epoch 44:   5%|▌         | 5/97 [00:02<00:37,  2.47it/s, loss=2.7, v_num=0]
Epoch 44:   6%|▌         | 6/97 [00:02<00:32,  2.84it/s, loss=2.7, v_num=0]
Epoch 44:   6%|▌         | 6/97 [00:02<00:32,  2.77it/s, loss=2.71, v_num=0]
Epoch 44:   7%|▋         | 7/97 [00:02<00:28,  3.12it/s, loss=2.71, v_num=0]
Epoch 44:   7%|▋         | 7/97 [00:02<00:29,  3.04it/s, loss=2.71, v_num=0]
Epoch 44:   8%|▊         | 8/97 [00:02<00:26,  3.36it/s, loss=2.71, v_num=0]
Epoch 44:   8%|▊         | 8/97 [00:02<00:27,  3.28it/s, loss=2.7, v_num=0]
Epoch 44:   9%|▉         | 9/97 [00:02<00:24,  3.56it/s, loss=2.7, v_num=0]
Epoch 44:   9%|▉         | 9/97 [00:02<00:25,  3.48it/s, loss=2.71, v_num=0]
Epoch 44:  10%|█         | 10/97 [00:02<00:23,  3.75it/s, loss=2.71, v_num=0]
Epoch 44:  10%|█         | 10/97 [00:02<00:23,  3.67it/s, loss=2.71, v_num=0]
Epoch 44:  11%|█▏        | 11/97 [00:02<00:21,  3.92it/s, loss=2.71, v_num=0]
Epoch 44:  11%|█▏        | 11/97 [00:02<00:22,  3.85it/s, loss=2.7, v_num=0]
Epoch 44:  12%|█▏        | 12/97 [00:02<00:20,  4.09it/s, loss=2.7, v_num=0]
Epoch 44:  12%|█▏        | 12/97 [00:02<00:21,  4.01it/s, loss=2.7, v_num=0]
Epoch 44:  13%|█▎        | 13/97 [00:03<00:19,  4.22it/s, loss=2.7, v_num=0]
Epoch 44:  13%|█▎        | 13/97 [00:03<00:20,  4.15it/s, loss=2.69, v_num=0]
Epoch 44:  14%|█▍        | 14/97 [00:03<00:19,  4.36it/s, loss=2.69, v_num=0]
Epoch 44:  14%|█▍        | 14/97 [00:03<00:19,  4.28it/s, loss=2.69, v_num=0]
Epoch 44:  15%|█▌        | 15/97 [00:03<00:18,  4.48it/s, loss=2.69, v_num=0]
Epoch 44:  15%|█▌        | 15/97 [00:03<00:18,  4.41it/s, loss=2.69, v_num=0]
Epoch 44:  16%|█▋        | 16/97 [00:03<00:17,  4.59it/s, loss=2.69, v_num=0]
Epoch 44:  16%|█▋        | 16/97 [00:03<00:17,  4.52it/s, loss=2.7, v_num=0]
Epoch 44:  18%|█▊        | 17/97 [00:03<00:17,  4.69it/s, loss=2.7, v_num=0]
Epoch 44:  18%|█▊        | 17/97 [00:03<00:17,  4.62it/s, loss=2.7, v_num=0]
Epoch 44:  19%|█▊        | 18/97 [00:03<00:16,  4.79it/s, loss=2.7, v_num=0]
Epoch 44:  19%|█▊        | 18/97 [00:03<00:16,  4.72it/s, loss=2.7, v_num=0]
Epoch 44:  20%|█▉        | 19/97 [00:03<00:16,  4.87it/s, loss=2.7, v_num=0]
Epoch 44:  20%|█▉        | 19/97 [00:03<00:16,  4.81it/s, loss=2.71, v_num=0]
Epoch 44:  21%|██        | 20/97 [00:04<00:15,  4.96it/s, loss=2.71, v_num=0]
Epoch 44:  21%|██        | 20/97 [00:04<00:15,  4.89it/s, loss=2.7, v_num=0]
Epoch 44:  22%|██▏       | 21/97 [00:04<00:15,  5.03it/s, loss=2.7, v_num=0]
Epoch 44:  22%|██▏       | 21/97 [00:04<00:15,  4.97it/s, loss=2.7, v_num=0]
Epoch 44:  23%|██▎       | 22/97 [00:04<00:14,  5.11it/s, loss=2.7, v_num=0]
Epoch 44:  23%|██▎       | 22/97 [00:04<00:14,  5.04it/s, loss=2.7, v_num=0]
Epoch 44:  24%|██▎       | 23/97 [00:04<00:14,  5.17it/s, loss=2.7, v_num=0]
Epoch 44:  24%|██▎       | 23/97 [00:04<00:14,  5.11it/s, loss=2.69, v_num=0]
Epoch 44:  25%|██▍       | 24/97 [00:04<00:13,  5.23it/s, loss=2.69, v_num=0]
Epoch 44:  25%|██▍       | 24/97 [00:04<00:14,  5.17it/s, loss=2.69, v_num=0]
Epoch 44:  26%|██▌       | 25/97 [00:04<00:13,  5.29it/s, loss=2.69, v_num=0]
Epoch 44:  26%|██▌       | 25/97 [00:04<00:13,  5.23it/s, loss=2.7, v_num=0]
Epoch 44:  27%|██▋       | 26/97 [00:04<00:13,  5.35it/s, loss=2.7, v_num=0]
Epoch 44:  27%|██▋       | 26/97 [00:04<00:13,  5.29it/s, loss=2.69, v_num=0]
Epoch 44:  28%|██▊       | 27/97 [00:04<00:12,  5.40it/s, loss=2.69, v_num=0]
Epoch 44:  28%|██▊       | 27/97 [00:05<00:13,  5.34it/s, loss=2.69, v_num=0]
Epoch 44:  29%|██▉       | 28/97 [00:05<00:12,  5.45it/s, loss=2.69, v_num=0]
Epoch 44:  29%|██▉       | 28/97 [00:05<00:12,  5.39it/s, loss=2.68, v_num=0]
Epoch 44:  30%|██▉       | 29/97 [00:05<00:12,  5.50it/s, loss=2.68, v_num=0]
Epoch 44:  30%|██▉       | 29/97 [00:05<00:12,  5.44it/s, loss=2.68, v_num=0]
Epoch 44:  31%|███       | 30/97 [00:05<00:12,  5.54it/s, loss=2.68, v_num=0]
Epoch 44:  31%|███       | 30/97 [00:05<00:12,  5.48it/s, loss=2.68, v_num=0]
Epoch 44:  32%|███▏      | 31/97 [00:05<00:11,  5.58it/s, loss=2.68, v_num=0]
Epoch 44:  32%|███▏      | 31/97 [00:05<00:11,  5.53it/s, loss=2.68, v_num=0]
Epoch 44:  33%|███▎      | 32/97 [00:05<00:11,  5.62it/s, loss=2.68, v_num=0]
Epoch 44:  33%|███▎      | 32/97 [00:05<00:11,  5.57it/s, loss=2.68, v_num=0]
Epoch 44:  34%|███▍      | 33/97 [00:05<00:11,  5.66it/s, loss=2.68, v_num=0]
Epoch 44:  34%|███▍      | 33/97 [00:05<00:11,  5.61it/s, loss=2.7, v_num=0]
Epoch 44:  35%|███▌      | 34/97 [00:05<00:11,  5.69it/s, loss=2.7, v_num=0]
Epoch 44:  35%|███▌      | 34/97 [00:06<00:11,  5.64it/s, loss=2.71, v_num=0]
Epoch 44:  36%|███▌      | 35/97 [00:06<00:10,  5.73it/s, loss=2.71, v_num=0]
Epoch 44:  36%|███▌      | 35/97 [00:06<00:10,  5.68it/s, loss=2.71, v_num=0]
Epoch 44:  37%|███▋      | 36/97 [00:06<00:10,  5.76it/s, loss=2.71, v_num=0]
Epoch 44:  37%|███▋      | 36/97 [00:06<00:10,  5.71it/s, loss=2.7, v_num=0]
Epoch 44:  38%|███▊      | 37/97 [00:06<00:10,  5.79it/s, loss=2.7, v_num=0]
Epoch 44:  38%|███▊      | 37/97 [00:06<00:10,  5.74it/s, loss=2.7, v_num=0]
Epoch 44:  39%|███▉      | 38/97 [00:06<00:10,  5.83it/s, loss=2.7, v_num=0]
Epoch 44:  39%|███▉      | 38/97 [00:06<00:10,  5.78it/s, loss=2.7, v_num=0]
Epoch 44:  40%|████      | 39/97 [00:06<00:09,  5.85it/s, loss=2.7, v_num=0]
Epoch 44:  40%|████      | 39/97 [00:06<00:09,  5.80it/s, loss=2.69, v_num=0]
Epoch 44:  41%|████      | 40/97 [00:06<00:09,  5.88it/s, loss=2.69, v_num=0]
Epoch 44:  41%|████      | 40/97 [00:06<00:09,  5.83it/s, loss=2.69, v_num=0]
Epoch 44:  42%|████▏     | 41/97 [00:06<00:09,  5.91it/s, loss=2.69, v_num=0]
Epoch 44:  42%|████▏     | 41/97 [00:06<00:09,  5.86it/s, loss=2.69, v_num=0]
Epoch 44:  43%|████▎     | 42/97 [00:07<00:09,  5.93it/s, loss=2.69, v_num=0]
Epoch 44:  43%|████▎     | 42/97 [00:07<00:09,  5.89it/s, loss=2.69, v_num=0]
Epoch 44:  44%|████▍     | 43/97 [00:07<00:09,  5.96it/s, loss=2.69, v_num=0]
Epoch 44:  44%|████▍     | 43/97 [00:07<00:09,  5.91it/s, loss=2.69, v_num=0]
Epoch 44:  45%|████▌     | 44/97 [00:07<00:08,  5.99it/s, loss=2.69, v_num=0]
Epoch 44:  45%|████▌     | 44/97 [00:07<00:08,  5.94it/s, loss=2.7, v_num=0]
Epoch 44:  46%|████▋     | 45/97 [00:07<00:08,  6.01it/s, loss=2.7, v_num=0]
Epoch 44:  46%|████▋     | 45/97 [00:07<00:08,  5.96it/s, loss=2.69, v_num=0]
Epoch 44:  47%|████▋     | 46/97 [00:07<00:08,  6.03it/s, loss=2.69, v_num=0]
Epoch 44:  47%|████▋     | 46/97 [00:07<00:08,  5.99it/s, loss=2.69, v_num=0]
Epoch 44:  48%|████▊     | 47/97 [00:07<00:08,  6.05it/s, loss=2.69, v_num=0]
Epoch 44:  48%|████▊     | 47/97 [00:07<00:08,  6.01it/s, loss=2.7, v_num=0]
Epoch 44:  49%|████▉     | 48/97 [00:07<00:08,  6.07it/s, loss=2.7, v_num=0]
Epoch 44:  49%|████▉     | 48/97 [00:07<00:08,  6.03it/s, loss=2.69, v_num=0]
Epoch 44:  51%|█████     | 49/97 [00:08<00:07,  6.09it/s, loss=2.69, v_num=0]
Epoch 44:  51%|█████     | 49/97 [00:08<00:07,  6.05it/s, loss=2.69, v_num=0]
Epoch 44:  52%|█████▏    | 50/97 [00:08<00:07,  6.11it/s, loss=2.69, v_num=0]
Epoch 44:  52%|█████▏    | 50/97 [00:08<00:07,  6.07it/s, loss=2.69, v_num=0]
Epoch 44:  53%|█████▎    | 51/97 [00:08<00:07,  6.13it/s, loss=2.69, v_num=0]
Epoch 44:  53%|█████▎    | 51/97 [00:08<00:07,  6.09it/s, loss=2.7, v_num=0]
Epoch 44:  54%|█████▎    | 52/97 [00:08<00:07,  6.15it/s, loss=2.7, v_num=0]
Epoch 44:  54%|█████▎    | 52/97 [00:08<00:07,  6.11it/s, loss=2.7, v_num=0]
Epoch 44:  55%|█████▍    | 53/97 [00:08<00:07,  6.16it/s, loss=2.7, v_num=0]
Epoch 44:  55%|█████▍    | 53/97 [00:08<00:07,  6.13it/s, loss=2.69, v_num=0]
Epoch 44:  56%|█████▌    | 54/97 [00:08<00:06,  6.18it/s, loss=2.69, v_num=0]
Epoch 44:  56%|█████▌    | 54/97 [00:08<00:06,  6.14it/s, loss=2.68, v_num=0]
Epoch 44:  57%|█████▋    | 55/97 [00:08<00:06,  6.20it/s, loss=2.68, v_num=0]
Epoch 44:  57%|█████▋    | 55/97 [00:08<00:06,  6.16it/s, loss=2.69, v_num=0]
Epoch 44:  58%|█████▊    | 56/97 [00:09<00:06,  6.22it/s, loss=2.69, v_num=0]
Epoch 44:  58%|█████▊    | 56/97 [00:09<00:06,  6.18it/s, loss=2.69, v_num=0]
Epoch 44:  59%|█████▉    | 57/97 [00:09<00:06,  6.23it/s, loss=2.69, v_num=0]
Epoch 44:  59%|█████▉    | 57/97 [00:09<00:06,  6.19it/s, loss=2.69, v_num=0]
Epoch 44:  60%|█████▉    | 58/97 [00:09<00:06,  6.24it/s, loss=2.69, v_num=0]
Epoch 44:  60%|█████▉    | 58/97 [00:09<00:06,  6.21it/s, loss=2.69, v_num=0]
Epoch 44:  61%|██████    | 59/97 [00:09<00:06,  6.26it/s, loss=2.69, v_num=0]
Epoch 44:  61%|██████    | 59/97 [00:09<00:06,  6.22it/s, loss=2.69, v_num=0]
Epoch 44:  62%|██████▏   | 60/97 [00:09<00:05,  6.27it/s, loss=2.69, v_num=0]
Epoch 44:  62%|██████▏   | 60/97 [00:09<00:05,  6.24it/s, loss=2.69, v_num=0]
Epoch 44:  63%|██████▎   | 61/97 [00:09<00:05,  6.29it/s, loss=2.69, v_num=0]
Epoch 44:  63%|██████▎   | 61/97 [00:09<00:05,  6.25it/s, loss=2.68, v_num=0]
Epoch 44:  64%|██████▍   | 62/97 [00:09<00:05,  6.30it/s, loss=2.68, v_num=0]
Epoch 44:  64%|██████▍   | 62/97 [00:09<00:05,  6.27it/s, loss=2.69, v_num=0]
Epoch 44:  65%|██████▍   | 63/97 [00:09<00:05,  6.32it/s, loss=2.69, v_num=0]
Epoch 44:  65%|██████▍   | 63/97 [00:10<00:05,  6.28it/s, loss=2.68, v_num=0]
Epoch 44:  66%|██████▌   | 64/97 [00:10<00:05,  6.33it/s, loss=2.68, v_num=0]
Epoch 44:  66%|██████▌   | 64/97 [00:10<00:05,  6.29it/s, loss=2.68, v_num=0]
Epoch 44:  67%|██████▋   | 65/97 [00:10<00:05,  6.34it/s, loss=2.68, v_num=0]
Epoch 44:  67%|██████▋   | 65/97 [00:10<00:05,  6.30it/s, loss=2.67, v_num=0]
Epoch 44:  68%|██████▊   | 66/97 [00:10<00:04,  6.35it/s, loss=2.67, v_num=0]
Epoch 44:  68%|██████▊   | 66/97 [00:10<00:04,  6.31it/s, loss=2.67, v_num=0]
Epoch 44:  69%|██████▉   | 67/97 [00:10<00:04,  6.36it/s, loss=2.67, v_num=0]
Epoch 44:  69%|██████▉   | 67/97 [00:10<00:04,  6.33it/s, loss=2.67, v_num=0]
Epoch 44:  70%|███████   | 68/97 [00:10<00:04,  6.37it/s, loss=2.67, v_num=0]
Epoch 44:  70%|███████   | 68/97 [00:10<00:04,  6.34it/s, loss=2.68, v_num=0]
Epoch 44:  71%|███████   | 69/97 [00:10<00:04,  6.38it/s, loss=2.68, v_num=0]
Epoch 44:  71%|███████   | 69/97 [00:10<00:04,  6.35it/s, loss=2.67, v_num=0]
Epoch 44:  72%|███████▏  | 70/97 [00:10<00:04,  6.40it/s, loss=2.67, v_num=0]
Epoch 44:  72%|███████▏  | 70/97 [00:11<00:04,  6.36it/s, loss=2.67, v_num=0]
Epoch 44:  73%|███████▎  | 71/97 [00:11<00:04,  6.40it/s, loss=2.67, v_num=0]
Epoch 44:  73%|███████▎  | 71/97 [00:11<00:04,  6.37it/s, loss=2.67, v_num=0]
Epoch 44:  74%|███████▍  | 72/97 [00:11<00:03,  6.42it/s, loss=2.67, v_num=0]
Epoch 44:  74%|███████▍  | 72/97 [00:11<00:03,  6.38it/s, loss=2.67, v_num=0]
Epoch 44:  75%|███████▌  | 73/97 [00:11<00:03,  6.42it/s, loss=2.67, v_num=0]
Epoch 44:  75%|███████▌  | 73/97 [00:11<00:03,  6.39it/s, loss=2.67, v_num=0]
Epoch 44:  76%|███████▋  | 74/97 [00:11<00:03,  6.44it/s, loss=2.67, v_num=0]
Epoch 44:  76%|███████▋  | 74/97 [00:11<00:03,  6.40it/s, loss=2.67, v_num=0]
Epoch 44:  77%|███████▋  | 75/97 [00:11<00:03,  6.44it/s, loss=2.67, v_num=0]
Epoch 44:  77%|███████▋  | 75/97 [00:11<00:03,  6.41it/s, loss=2.67, v_num=0]
Epoch 44:  78%|███████▊  | 76/97 [00:11<00:03,  6.46it/s, loss=2.67, v_num=0]
Epoch 44:  78%|███████▊  | 76/97 [00:11<00:03,  6.42it/s, loss=2.67, v_num=0]
Epoch 44:  79%|███████▉  | 77/97 [00:11<00:03,  6.46it/s, loss=2.67, v_num=0]
Epoch 44:  79%|███████▉  | 77/97 [00:11<00:03,  6.43it/s, loss=2.66, v_num=0]
Epoch 44:  80%|████████  | 78/97 [00:12<00:02,  6.47it/s, loss=2.66, v_num=0]
Epoch 44:  80%|████████  | 78/97 [00:12<00:02,  6.44it/s, loss=2.66, v_num=0]
Epoch 44:  81%|████████▏ | 79/97 [00:12<00:02,  6.48it/s, loss=2.66, v_num=0]
Epoch 44:  81%|████████▏ | 79/97 [00:12<00:02,  6.45it/s, loss=2.66, v_num=0]
Epoch 44:  82%|████████▏ | 80/97 [00:12<00:02,  6.49it/s, loss=2.66, v_num=0]
Epoch 44:  82%|████████▏ | 80/97 [00:12<00:02,  6.46it/s, loss=2.66, v_num=0]
Epoch 44:  84%|████████▎ | 81/97 [00:12<00:02,  6.50it/s, loss=2.66, v_num=0]
Epoch 44:  84%|████████▎ | 81/97 [00:12<00:02,  6.47it/s, loss=2.67, v_num=0]
Epoch 44:  85%|████████▍ | 82/97 [00:12<00:02,  6.51it/s, loss=2.67, v_num=0]
Epoch 44:  85%|████████▍ | 82/97 [00:12<00:02,  6.48it/s, loss=2.67, v_num=0]
Epoch 44:  86%|████████▌ | 83/97 [00:12<00:02,  6.52it/s, loss=2.67, v_num=0]
Epoch 44:  86%|████████▌ | 83/97 [00:12<00:02,  6.49it/s, loss=2.67, v_num=0]
Epoch 44:  87%|████████▋ | 84/97 [00:12<00:01,  6.52it/s, loss=2.67, v_num=0]
Epoch 44:  87%|████████▋ | 84/97 [00:12<00:02,  6.50it/s, loss=2.68, v_num=0]
Epoch 44:  88%|████████▊ | 85/97 [00:13<00:01,  6.53it/s, loss=2.68, v_num=0]
Epoch 44:  88%|████████▊ | 85/97 [00:13<00:01,  6.50it/s, loss=2.68, v_num=0]
Epoch 44:  89%|████████▊ | 86/97 [00:13<00:01,  6.54it/s, loss=2.68, v_num=0]
Epoch 44:  89%|████████▊ | 86/97 [00:13<00:01,  6.51it/s, loss=2.68, v_num=0]
Epoch 44:  90%|████████▉ | 87/97 [00:13<00:01,  6.55it/s, loss=2.68, v_num=0]
Epoch 44:  90%|████████▉ | 87/97 [00:13<00:01,  6.52it/s, loss=2.69, v_num=0]
Epoch 44:  91%|█████████ | 88/97 [00:13<00:01,  6.56it/s, loss=2.69, v_num=0]
Epoch 44:  91%|█████████ | 88/97 [00:13<00:01,  6.53it/s, loss=2.69, v_num=0]
Epoch 44:  92%|█████████▏| 89/97 [00:13<00:01,  6.56it/s, loss=2.69, v_num=0]
Epoch 44:  92%|█████████▏| 89/97 [00:13<00:01,  6.54it/s, loss=2.7, v_num=0]
Epoch 44:  93%|█████████▎| 90/97 [00:13<00:01,  6.57it/s, loss=2.7, v_num=0]
Epoch 44:  93%|█████████▎| 90/97 [00:13<00:01,  6.54it/s, loss=2.7, v_num=0]
Epoch 44:  94%|█████████▍| 91/97 [00:13<00:00,  6.58it/s, loss=2.7, v_num=0]
Epoch 44:  94%|█████████▍| 91/97 [00:13<00:00,  6.55it/s, loss=2.69, v_num=0]
Epoch 44:  95%|█████████▍| 92/97 [00:13<00:00,  6.59it/s, loss=2.69, v_num=0]
Epoch 44:  95%|█████████▍| 92/97 [00:14<00:00,  6.56it/s, loss=2.69, v_num=0]
Epoch 44:  96%|█████████▌| 93/97 [00:14<00:00,  6.59it/s, loss=2.69, v_num=0]
Epoch 44:  96%|█████████▌| 93/97 [00:14<00:00,  6.56it/s, loss=2.68, v_num=0]
Epoch 44:  97%|█████████▋| 94/97 [00:14<00:00,  6.60it/s, loss=2.68, v_num=0]
Epoch 44:  97%|█████████▋| 94/97 [00:14<00:00,  6.57it/s, loss=2.69, v_num=0]
Epoch 44:  98%|█████████▊| 95/97 [00:14<00:00,  6.60it/s, loss=2.69, v_num=0]
Epoch 44:  98%|█████████▊| 95/97 [00:14<00:00,  6.58it/s, loss=2.69, v_num=0]
Epoch 44:  99%|█████████▉| 96/97 [00:14<00:00,  6.61it/s, loss=2.69, v_num=0]
Epoch 44:  99%|█████████▉| 96/97 [00:14<00:00,  6.59it/s, loss=2.69, v_num=0]
Epoch 44: 100%|██████████| 97/97 [00:14<00:00,  6.62it/s, loss=2.69, v_num=0]
Epoch 44: 100%|██████████| 97/97 [00:14<00:00,  6.59it/s, loss=2.7, v_num=0]
Epoch 44: 100%|██████████| 97/97 [00:14<00:00,  6.59it/s, loss=2.7, v_num=0]
Epoch 44:   0%|          | 0/97 [00:00<?, ?it/s, loss=2.7, v_num=0]
Epoch 45:   0%|          | 0/97 [00:00<?, ?it/s, loss=2.7, v_num=0]
Epoch 45:   1%|          | 1/97 [00:01<02:18,  1.44s/it, loss=2.7, v_num=0]
Epoch 45:   1%|          | 1/97 [00:01<02:23,  1.49s/it, loss=2.7, v_num=0]
Epoch 45:   2%|▏         | 2/97 [00:01<01:14,  1.27it/s, loss=2.7, v_num=0]
Epoch 45:   2%|▏         | 2/97 [00:01<01:17,  1.23it/s, loss=2.7, v_num=0]
Epoch 45:   3%|▎         | 3/97 [00:01<00:53,  1.75it/s, loss=2.7, v_num=0]
Epoch 45:   3%|▎         | 3/97 [00:01<00:55,  1.70it/s, loss=2.7, v_num=0]
Epoch 45:   4%|▍         | 4/97 [00:01<00:42,  2.16it/s, loss=2.7, v_num=0]
Epoch 45:   4%|▍         | 4/97 [00:01<00:44,  2.10it/s, loss=2.69, v_num=0]
Epoch 45:   5%|▌         | 5/97 [00:01<00:36,  2.52it/s, loss=2.69, v_num=0]
Epoch 45:   5%|▌         | 5/97 [00:02<00:37,  2.45it/s, loss=2.68, v_num=0]
Epoch 45:   6%|▌         | 6/97 [00:02<00:32,  2.83it/s, loss=2.68, v_num=0]
Epoch 45:   6%|▌         | 6/97 [00:02<00:32,  2.76it/s, loss=2.68, v_num=0]
Epoch 45:   7%|▋         | 7/97 [00:02<00:29,  3.10it/s, loss=2.68, v_num=0]
Epoch 45:   7%|▋         | 7/97 [00:02<00:29,  3.03it/s, loss=2.68, v_num=0]
Epoch 45:   8%|▊         | 8/97 [00:02<00:26,  3.35it/s, loss=2.68, v_num=0]
Epoch 45:   8%|▊         | 8/97 [00:02<00:27,  3.27it/s, loss=2.68, v_num=0]
Epoch 45:   9%|▉         | 9/97 [00:02<00:24,  3.55it/s, loss=2.68, v_num=0]
Epoch 45:   9%|▉         | 9/97 [00:02<00:25,  3.47it/s, loss=2.68, v_num=0]
Epoch 45:  10%|█         | 10/97 [00:02<00:23,  3.74it/s, loss=2.68, v_num=0]
Epoch 45:  10%|█         | 10/97 [00:02<00:23,  3.66it/s, loss=2.67, v_num=0]
Epoch 45:  11%|█▏        | 11/97 [00:02<00:21,  3.91it/s, loss=2.67, v_num=0]
Epoch 45:  11%|█▏        | 11/97 [00:02<00:22,  3.84it/s, loss=2.67, v_num=0]
Epoch 45:  12%|█▏        | 12/97 [00:02<00:20,  4.08it/s, loss=2.67, v_num=0]
Epoch 45:  12%|█▏        | 12/97 [00:03<00:21,  4.00it/s, loss=2.67, v_num=0]
Epoch 45:  13%|█▎        | 13/97 [00:03<00:19,  4.22it/s, loss=2.67, v_num=0]
Epoch 45:  13%|█▎        | 13/97 [00:03<00:20,  4.14it/s, loss=2.66, v_num=0]
Epoch 45:  14%|█▍        | 14/97 [00:03<00:19,  4.36it/s, loss=2.66, v_num=0]
Epoch 45:  14%|█▍        | 14/97 [00:03<00:19,  4.28it/s, loss=2.67, v_num=0]
Epoch 45:  15%|█▌        | 15/97 [00:03<00:18,  4.47it/s, loss=2.67, v_num=0]
Epoch 45:  15%|█▌        | 15/97 [00:03<00:18,  4.40it/s, loss=2.67, v_num=0]
Epoch 45:  16%|█▋        | 16/97 [00:03<00:17,  4.59it/s, loss=2.67, v_num=0]
Epoch 45:  16%|█▋        | 16/97 [00:03<00:17,  4.51it/s, loss=2.67, v_num=0]
Epoch 45:  18%|█▊        | 17/97 [00:03<00:17,  4.68it/s, loss=2.67, v_num=0]
Epoch 45:  18%|█▊        | 17/97 [00:03<00:17,  4.61it/s, loss=2.67, v_num=0]
Epoch 45:  19%|█▊        | 18/97 [00:03<00:16,  4.78it/s, loss=2.67, v_num=0]
Epoch 45:  19%|█▊        | 18/97 [00:03<00:16,  4.71it/s, loss=2.66, v_num=0]
Epoch 45:  20%|█▉        | 19/97 [00:03<00:16,  4.87it/s, loss=2.66, v_num=0]
Epoch 45:  20%|█▉        | 19/97 [00:03<00:16,  4.80it/s, loss=2.66, v_num=0]
Epoch 45:  21%|██        | 20/97 [00:04<00:15,  4.95it/s, loss=2.66, v_num=0]
Epoch 45:  21%|██        | 20/97 [00:04<00:15,  4.89it/s, loss=2.65, v_num=0]
Epoch 45:  22%|██▏       | 21/97 [00:04<00:15,  5.04it/s, loss=2.65, v_num=0]
Epoch 45:  22%|██▏       | 21/97 [00:04<00:15,  4.97it/s, loss=2.65, v_num=0]
Epoch 45:  23%|██▎       | 22/97 [00:04<00:14,  5.10it/s, loss=2.65, v_num=0]
Epoch 45:  23%|██▎       | 22/97 [00:04<00:14,  5.04it/s, loss=2.65, v_num=0]
Epoch 45:  24%|██▎       | 23/97 [00:04<00:14,  5.17it/s, loss=2.65, v_num=0]
Epoch 45:  24%|██▎       | 23/97 [00:04<00:14,  5.10it/s, loss=2.66, v_num=0]
Epoch 45:  25%|██▍       | 24/97 [00:04<00:13,  5.24it/s, loss=2.66, v_num=0]
Epoch 45:  25%|██▍       | 24/97 [00:04<00:14,  5.17it/s, loss=2.66, v_num=0]
Epoch 45:  26%|██▌       | 25/97 [00:04<00:13,  5.29it/s, loss=2.66, v_num=0]
Epoch 45:  26%|██▌       | 25/97 [00:04<00:13,  5.23it/s, loss=2.67, v_num=0]
Epoch 45:  27%|██▋       | 26/97 [00:04<00:13,  5.35it/s, loss=2.67, v_num=0]
Epoch 45:  27%|██▋       | 26/97 [00:04<00:13,  5.29it/s, loss=2.67, v_num=0]
Epoch 45:  28%|██▊       | 27/97 [00:04<00:12,  5.41it/s, loss=2.67, v_num=0]
Epoch 45:  28%|██▊       | 27/97 [00:05<00:13,  5.34it/s, loss=2.67, v_num=0]
Epoch 45:  29%|██▉       | 28/97 [00:05<00:12,  5.45it/s, loss=2.67, v_num=0]
Epoch 45:  29%|██▉       | 28/97 [00:05<00:12,  5.40it/s, loss=2.67, v_num=0]
Epoch 45:  30%|██▉       | 29/97 [00:05<00:12,  5.50it/s, loss=2.67, v_num=0]
Epoch 45:  30%|██▉       | 29/97 [00:05<00:12,  5.44it/s, loss=2.66, v_num=0]
Epoch 45:  31%|███       | 30/97 [00:05<00:12,  5.55it/s, loss=2.66, v_num=0]
Epoch 45:  31%|███       | 30/97 [00:05<00:12,  5.49it/s, loss=2.67, v_num=0]
Epoch 45:  32%|███▏      | 31/97 [00:05<00:11,  5.59it/s, loss=2.67, v_num=0]
Epoch 45:  32%|███▏      | 31/97 [00:05<00:11,  5.53it/s, loss=2.67, v_num=0]
Epoch 45:  33%|███▎      | 32/97 [00:05<00:11,  5.63it/s, loss=2.67, v_num=0]
Epoch 45:  33%|███▎      | 32/97 [00:05<00:11,  5.58it/s, loss=2.67, v_num=0]
Epoch 45:  34%|███▍      | 33/97 [00:05<00:11,  5.67it/s, loss=2.67, v_num=0]
Epoch 45:  34%|███▍      | 33/97 [00:05<00:11,  5.62it/s, loss=2.67, v_num=0]
Epoch 45:  35%|███▌      | 34/97 [00:05<00:11,  5.70it/s, loss=2.67, v_num=0]
Epoch 45:  35%|███▌      | 34/97 [00:06<00:11,  5.65it/s, loss=2.67, v_num=0]
Epoch 45:  36%|███▌      | 35/97 [00:06<00:10,  5.74it/s, loss=2.67, v_num=0]
Epoch 45:  36%|███▌      | 35/97 [00:06<00:10,  5.69it/s, loss=2.67, v_num=0]
Epoch 45:  37%|███▋      | 36/97 [00:06<00:10,  5.78it/s, loss=2.67, v_num=0]
Epoch 45:  37%|███▋      | 36/97 [00:06<00:10,  5.73it/s, loss=2.67, v_num=0]
Epoch 45:  38%|███▊      | 37/97 [00:06<00:10,  5.81it/s, loss=2.67, v_num=0]
Epoch 45:  38%|███▊      | 37/97 [00:06<00:10,  5.76it/s, loss=2.67, v_num=0]
Epoch 45:  39%|███▉      | 38/97 [00:06<00:10,  5.84it/s, loss=2.67, v_num=0]
Epoch 45:  39%|███▉      | 38/97 [00:06<00:10,  5.79it/s, loss=2.67, v_num=0]
Epoch 45:  40%|████      | 39/97 [00:06<00:09,  5.87it/s, loss=2.67, v_num=0]
Epoch 45:  40%|████      | 39/97 [00:06<00:09,  5.82it/s, loss=2.66, v_num=0]
Epoch 45:  41%|████      | 40/97 [00:06<00:09,  5.90it/s, loss=2.66, v_num=0]
Epoch 45:  41%|████      | 40/97 [00:06<00:09,  5.85it/s, loss=2.66, v_num=0]
Epoch 45:  42%|████▏     | 41/97 [00:06<00:09,  5.92it/s, loss=2.66, v_num=0]
Epoch 45:  42%|████▏     | 41/97 [00:06<00:09,  5.87it/s, loss=2.67, v_num=0]
Epoch 45:  43%|████▎     | 42/97 [00:07<00:09,  5.95it/s, loss=2.67, v_num=0]
Epoch 45:  43%|████▎     | 42/97 [00:07<00:09,  5.90it/s, loss=2.66, v_num=0]
Epoch 45:  44%|████▍     | 43/97 [00:07<00:09,  5.98it/s, loss=2.66, v_num=0]
Epoch 45:  44%|████▍     | 43/97 [00:07<00:09,  5.93it/s, loss=2.66, v_num=0]
Epoch 45:  45%|████▌     | 44/97 [00:07<00:08,  6.00it/s, loss=2.66, v_num=0]
Epoch 45:  45%|████▌     | 44/97 [00:07<00:08,  5.96it/s, loss=2.66, v_num=0]
Epoch 45:  46%|████▋     | 45/97 [00:07<00:08,  6.02it/s, loss=2.66, v_num=0]
Epoch 45:  46%|████▋     | 45/97 [00:07<00:08,  5.98it/s, loss=2.67, v_num=0]
Epoch 45:  47%|████▋     | 46/97 [00:07<00:08,  6.05it/s, loss=2.67, v_num=0]
Epoch 45:  47%|████▋     | 46/97 [00:07<00:08,  6.00it/s, loss=2.67, v_num=0]
Epoch 45:  48%|████▊     | 47/97 [00:07<00:08,  6.07it/s, loss=2.67, v_num=0]
Epoch 45:  48%|████▊     | 47/97 [00:07<00:08,  6.02it/s, loss=2.66, v_num=0]
Epoch 45:  49%|████▉     | 48/97 [00:07<00:08,  6.09it/s, loss=2.66, v_num=0]
Epoch 45:  49%|████▉     | 48/97 [00:07<00:08,  6.05it/s, loss=2.66, v_num=0]
Epoch 45:  51%|█████     | 49/97 [00:08<00:07,  6.11it/s, loss=2.66, v_num=0]
Epoch 45:  51%|█████     | 49/97 [00:08<00:07,  6.07it/s, loss=2.66, v_num=0]
Epoch 45:  52%|█████▏    | 50/97 [00:08<00:07,  6.13it/s, loss=2.66, v_num=0]
Epoch 45:  52%|█████▏    | 50/97 [00:08<00:07,  6.09it/s, loss=2.66, v_num=0]
Epoch 45:  53%|█████▎    | 51/97 [00:08<00:07,  6.15it/s, loss=2.66, v_num=0]
Epoch 45:  53%|█████▎    | 51/97 [00:08<00:07,  6.11it/s, loss=2.66, v_num=0]
Epoch 45:  54%|█████▎    | 52/97 [00:08<00:07,  6.17it/s, loss=2.66, v_num=0]
Epoch 45:  54%|█████▎    | 52/97 [00:08<00:07,  6.13it/s, loss=2.66, v_num=0]
Epoch 45:  55%|█████▍    | 53/97 [00:08<00:07,  6.19it/s, loss=2.66, v_num=0]
Epoch 45:  55%|█████▍    | 53/97 [00:08<00:07,  6.15it/s, loss=2.66, v_num=0]
Epoch 45:  56%|█████▌    | 54/97 [00:08<00:06,  6.21it/s, loss=2.66, v_num=0]
Epoch 45:  56%|█████▌    | 54/97 [00:08<00:06,  6.17it/s, loss=2.66, v_num=0]
Epoch 45:  57%|█████▋    | 55/97 [00:08<00:06,  6.22it/s, loss=2.66, v_num=0]
Epoch 45:  57%|█████▋    | 55/97 [00:08<00:06,  6.18it/s, loss=2.66, v_num=0]
Epoch 45:  58%|█████▊    | 56/97 [00:08<00:06,  6.24it/s, loss=2.66, v_num=0]
Epoch 45:  58%|█████▊    | 56/97 [00:09<00:06,  6.20it/s, loss=2.67, v_num=0]
Epoch 45:  59%|█████▉    | 57/97 [00:09<00:06,  6.25it/s, loss=2.67, v_num=0]
Epoch 45:  59%|█████▉    | 57/97 [00:09<00:06,  6.21it/s, loss=2.67, v_num=0]
Epoch 45:  60%|█████▉    | 58/97 [00:09<00:06,  6.27it/s, loss=2.67, v_num=0]
Epoch 45:  60%|█████▉    | 58/97 [00:09<00:06,  6.23it/s, loss=2.67, v_num=0]
Epoch 45:  61%|██████    | 59/97 [00:09<00:06,  6.28it/s, loss=2.67, v_num=0]
Epoch 45:  61%|██████    | 59/97 [00:09<00:06,  6.25it/s, loss=2.68, v_num=0]
Epoch 45:  62%|██████▏   | 60/97 [00:09<00:05,  6.30it/s, loss=2.68, v_num=0]
Epoch 45:  62%|██████▏   | 60/97 [00:09<00:05,  6.26it/s, loss=2.68, v_num=0]
Epoch 45:  63%|██████▎   | 61/97 [00:09<00:05,  6.31it/s, loss=2.68, v_num=0]
Epoch 45:  63%|██████▎   | 61/97 [00:09<00:05,  6.28it/s, loss=2.68, v_num=0]
Epoch 45:  64%|██████▍   | 62/97 [00:09<00:05,  6.33it/s, loss=2.68, v_num=0]
Epoch 45:  64%|██████▍   | 62/97 [00:09<00:05,  6.29it/s, loss=2.69, v_num=0]
Epoch 45:  65%|██████▍   | 63/97 [00:09<00:05,  6.34it/s, loss=2.69, v_num=0]
Epoch 45:  65%|██████▍   | 63/97 [00:09<00:05,  6.30it/s, loss=2.68, v_num=0]
Epoch 45:  66%|██████▌   | 64/97 [00:10<00:05,  6.35it/s, loss=2.68, v_num=0]
Epoch 45:  66%|██████▌   | 64/97 [00:10<00:05,  6.32it/s, loss=2.68, v_num=0]
Epoch 45:  67%|██████▋   | 65/97 [00:10<00:05,  6.36it/s, loss=2.68, v_num=0]
Epoch 45:  67%|██████▋   | 65/97 [00:10<00:05,  6.33it/s, loss=2.68, v_num=0]
Epoch 45:  68%|██████▊   | 66/97 [00:10<00:04,  6.38it/s, loss=2.68, v_num=0]
Epoch 45:  68%|██████▊   | 66/97 [00:10<00:04,  6.34it/s, loss=2.68, v_num=0]
Epoch 45:  69%|██████▉   | 67/97 [00:10<00:04,  6.39it/s, loss=2.68, v_num=0]
Epoch 45:  69%|██████▉   | 67/97 [00:10<00:04,  6.35it/s, loss=2.68, v_num=0]
Epoch 45:  70%|███████   | 68/97 [00:10<00:04,  6.40it/s, loss=2.68, v_num=0]
Epoch 45:  70%|███████   | 68/97 [00:10<00:04,  6.36it/s, loss=2.68, v_num=0]
Epoch 45:  71%|███████   | 69/97 [00:10<00:04,  6.41it/s, loss=2.68, v_num=0]
Epoch 45:  71%|███████   | 69/97 [00:10<00:04,  6.38it/s, loss=2.69, v_num=0]
Epoch 45:  72%|███████▏  | 70/97 [00:10<00:04,  6.42it/s, loss=2.69, v_num=0]
Epoch 45:  72%|███████▏  | 70/97 [00:10<00:04,  6.39it/s, loss=2.68, v_num=0]
Epoch 45:  73%|███████▎  | 71/97 [00:11<00:04,  6.43it/s, loss=2.68, v_num=0]
Epoch 45:  73%|███████▎  | 71/97 [00:11<00:04,  6.40it/s, loss=2.68, v_num=0]
Epoch 45:  74%|███████▍  | 72/97 [00:11<00:03,  6.44it/s, loss=2.68, v_num=0]
Epoch 45:  74%|███████▍  | 72/97 [00:11<00:03,  6.41it/s, loss=2.68, v_num=0]
Epoch 45:  75%|███████▌  | 73/97 [00:11<00:03,  6.45it/s, loss=2.68, v_num=0]
Epoch 45:  75%|███████▌  | 73/97 [00:11<00:03,  6.42it/s, loss=2.67, v_num=0]
Epoch 45:  76%|███████▋  | 74/97 [00:11<00:03,  6.46it/s, loss=2.67, v_num=0]
Epoch 45:  76%|███████▋  | 74/97 [00:11<00:03,  6.43it/s, loss=2.68, v_num=0]
Epoch 45:  77%|███████▋  | 75/97 [00:11<00:03,  6.47it/s, loss=2.68, v_num=0]
Epoch 45:  77%|███████▋  | 75/97 [00:11<00:03,  6.44it/s, loss=2.67, v_num=0]
Epoch 45:  78%|███████▊  | 76/97 [00:11<00:03,  6.48it/s, loss=2.67, v_num=0]
Epoch 45:  78%|███████▊  | 76/97 [00:11<00:03,  6.45it/s, loss=2.67, v_num=0]
Epoch 45:  79%|███████▉  | 77/97 [00:11<00:03,  6.49it/s, loss=2.67, v_num=0]
Epoch 45:  79%|███████▉  | 77/97 [00:11<00:03,  6.46it/s, loss=2.67, v_num=0]
Epoch 45:  80%|████████  | 78/97 [00:11<00:02,  6.50it/s, loss=2.67, v_num=0]
Epoch 45:  80%|████████  | 78/97 [00:12<00:02,  6.47it/s, loss=2.67, v_num=0]
Epoch 45:  81%|████████▏ | 79/97 [00:12<00:02,  6.51it/s, loss=2.67, v_num=0]
Epoch 45:  81%|████████▏ | 79/97 [00:12<00:02,  6.48it/s, loss=2.67, v_num=0]
Epoch 45:  82%|████████▏ | 80/97 [00:12<00:02,  6.52it/s, loss=2.67, v_num=0]
Epoch 45:  82%|████████▏ | 80/97 [00:12<00:02,  6.49it/s, loss=2.67, v_num=0]
Epoch 45:  84%|████████▎ | 81/97 [00:12<00:02,  6.53it/s, loss=2.67, v_num=0]
Epoch 45:  84%|████████▎ | 81/97 [00:12<00:02,  6.50it/s, loss=2.67, v_num=0]
Epoch 45:  85%|████████▍ | 82/97 [00:12<00:02,  6.53it/s, loss=2.67, v_num=0]
Epoch 45:  85%|████████▍ | 82/97 [00:12<00:02,  6.51it/s, loss=2.66, v_num=0]
Epoch 45:  86%|████████▌ | 83/97 [00:12<00:02,  6.54it/s, loss=2.66, v_num=0]
Epoch 45:  86%|████████▌ | 83/97 [00:12<00:02,  6.51it/s, loss=2.67, v_num=0]
Epoch 45:  87%|████████▋ | 84/97 [00:12<00:01,  6.55it/s, loss=2.67, v_num=0]
Epoch 45:  87%|████████▋ | 84/97 [00:12<00:01,  6.52it/s, loss=2.66, v_num=0]
Epoch 45:  88%|████████▊ | 85/97 [00:12<00:01,  6.56it/s, loss=2.66, v_num=0]
Epoch 45:  88%|████████▊ | 85/97 [00:13<00:01,  6.53it/s, loss=2.67, v_num=0]
Epoch 45:  89%|████████▊ | 86/97 [00:13<00:01,  6.57it/s, loss=2.67, v_num=0]
Epoch 45:  89%|████████▊ | 86/97 [00:13<00:01,  6.54it/s, loss=2.66, v_num=0]
Epoch 45:  90%|████████▉ | 87/97 [00:13<00:01,  6.57it/s, loss=2.66, v_num=0]
Epoch 45:  90%|████████▉ | 87/97 [00:13<00:01,  6.55it/s, loss=2.67, v_num=0]
Epoch 45:  91%|█████████ | 88/97 [00:13<00:01,  6.58it/s, loss=2.67, v_num=0]
Epoch 45:  91%|█████████ | 88/97 [00:13<00:01,  6.55it/s, loss=2.67, v_num=0]
Epoch 45:  92%|█████████▏| 89/97 [00:13<00:01,  6.59it/s, loss=2.67, v_num=0]
Epoch 45:  92%|█████████▏| 89/97 [00:13<00:01,  6.56it/s, loss=2.67, v_num=0]
Epoch 45:  93%|█████████▎| 90/97 [00:13<00:01,  6.60it/s, loss=2.67, v_num=0]
Epoch 45:  93%|█████████▎| 90/97 [00:13<00:01,  6.57it/s, loss=2.68, v_num=0]
Epoch 45:  94%|█████████▍| 91/97 [00:13<00:00,  6.60it/s, loss=2.68, v_num=0]
Epoch 45:  94%|█████████▍| 91/97 [00:13<00:00,  6.58it/s, loss=2.68, v_num=0]
Epoch 45:  95%|█████████▍| 92/97 [00:13<00:00,  6.61it/s, loss=2.68, v_num=0]
Epoch 45:  95%|█████████▍| 92/97 [00:13<00:00,  6.58it/s, loss=2.68, v_num=0]
Epoch 45:  96%|█████████▌| 93/97 [00:14<00:00,  6.62it/s, loss=2.68, v_num=0]
Epoch 45:  96%|█████████▌| 93/97 [00:14<00:00,  6.59it/s, loss=2.68, v_num=0]
Epoch 45:  97%|█████████▋| 94/97 [00:14<00:00,  6.62it/s, loss=2.68, v_num=0]
Epoch 45:  97%|█████████▋| 94/97 [00:14<00:00,  6.60it/s, loss=2.68, v_num=0]
Epoch 45:  98%|█████████▊| 95/97 [00:14<00:00,  6.63it/s, loss=2.68, v_num=0]
Epoch 45:  98%|█████████▊| 95/97 [00:14<00:00,  6.60it/s, loss=2.68, v_num=0]
Epoch 45:  99%|█████████▉| 96/97 [00:14<00:00,  6.64it/s, loss=2.68, v_num=0]
Epoch 45:  99%|█████████▉| 96/97 [00:14<00:00,  6.61it/s, loss=2.67, v_num=0]
Epoch 45: 100%|██████████| 97/97 [00:14<00:00,  6.64it/s, loss=2.67, v_num=0]
Epoch 45: 100%|██████████| 97/97 [00:14<00:00,  6.62it/s, loss=2.67, v_num=0]
Epoch 45: 100%|██████████| 97/97 [00:14<00:00,  6.62it/s, loss=2.67, v_num=0]
Epoch 45:   0%|          | 0/97 [00:00<?, ?it/s, loss=2.67, v_num=0]
Epoch 46:   0%|          | 0/97 [00:00<?, ?it/s, loss=2.67, v_num=0]
Epoch 46:   1%|          | 1/97 [00:01<02:16,  1.42s/it, loss=2.67, v_num=0]
Epoch 46:   1%|          | 1/97 [00:01<02:21,  1.48s/it, loss=2.67, v_num=0]
Epoch 46:   2%|▏         | 2/97 [00:01<01:14,  1.28it/s, loss=2.67, v_num=0]
Epoch 46:   2%|▏         | 2/97 [00:01<01:16,  1.24it/s, loss=2.67, v_num=0]
Epoch 46:   3%|▎         | 3/97 [00:01<00:53,  1.77it/s, loss=2.67, v_num=0]
Epoch 46:   3%|▎         | 3/97 [00:01<00:54,  1.71it/s, loss=2.67, v_num=0]
Epoch 46:   4%|▍         | 4/97 [00:01<00:42,  2.18it/s, loss=2.67, v_num=0]
Epoch 46:   4%|▍         | 4/97 [00:01<00:43,  2.12it/s, loss=2.67, v_num=0]
Epoch 46:   5%|▌         | 5/97 [00:01<00:36,  2.54it/s, loss=2.67, v_num=0]
Epoch 46:   5%|▌         | 5/97 [00:02<00:37,  2.47it/s, loss=2.67, v_num=0]
Epoch 46:   6%|▌         | 6/97 [00:02<00:31,  2.85it/s, loss=2.67, v_num=0]
Epoch 46:   6%|▌         | 6/97 [00:02<00:32,  2.78it/s, loss=2.67, v_num=0]
Epoch 46:   7%|▋         | 7/97 [00:02<00:28,  3.13it/s, loss=2.67, v_num=0]
Epoch 46:   7%|▋         | 7/97 [00:02<00:29,  3.05it/s, loss=2.67, v_num=0]
Epoch 46:   8%|▊         | 8/97 [00:02<00:26,  3.37it/s, loss=2.67, v_num=0]
Epoch 46:   8%|▊         | 8/97 [00:02<00:27,  3.29it/s, loss=2.67, v_num=0]
Epoch 46:   9%|▉         | 9/97 [00:02<00:24,  3.57it/s, loss=2.67, v_num=0]
Epoch 46:   9%|▉         | 9/97 [00:02<00:25,  3.50it/s, loss=2.68, v_num=0]
Epoch 46:  10%|█         | 10/97 [00:02<00:23,  3.76it/s, loss=2.68, v_num=0]
Epoch 46:  10%|█         | 10/97 [00:02<00:23,  3.69it/s, loss=2.66, v_num=0]
Epoch 46:  11%|█▏        | 11/97 [00:02<00:21,  3.94it/s, loss=2.66, v_num=0]
Epoch 46:  11%|█▏        | 11/97 [00:02<00:22,  3.86it/s, loss=2.66, v_num=0]
Epoch 46:  12%|█▏        | 12/97 [00:02<00:20,  4.10it/s, loss=2.66, v_num=0]
Epoch 46:  12%|█▏        | 12/97 [00:02<00:21,  4.02it/s, loss=2.66, v_num=0]
Epoch 46:  13%|█▎        | 13/97 [00:03<00:19,  4.25it/s, loss=2.66, v_num=0]
Epoch 46:  13%|█▎        | 13/97 [00:03<00:20,  4.17it/s, loss=2.67, v_num=0]
Epoch 46:  14%|█▍        | 14/97 [00:03<00:18,  4.38it/s, loss=2.67, v_num=0]
Epoch 46:  14%|█▍        | 14/97 [00:03<00:19,  4.30it/s, loss=2.66, v_num=0]
Epoch 46:  15%|█▌        | 15/97 [00:03<00:18,  4.50it/s, loss=2.66, v_num=0]
Epoch 46:  15%|█▌        | 15/97 [00:03<00:18,  4.42it/s, loss=2.66, v_num=0]
Epoch 46:  16%|█▋        | 16/97 [00:03<00:17,  4.61it/s, loss=2.66, v_num=0]
Epoch 46:  16%|█▋        | 16/97 [00:03<00:17,  4.54it/s, loss=2.66, v_num=0]
Epoch 46:  18%|█▊        | 17/97 [00:03<00:16,  4.71it/s, loss=2.66, v_num=0]
Epoch 46:  18%|█▊        | 17/97 [00:03<00:17,  4.64it/s, loss=2.65, v_num=0]
Epoch 46:  19%|█▊        | 18/97 [00:03<00:16,  4.80it/s, loss=2.65, v_num=0]
Epoch 46:  19%|█▊        | 18/97 [00:03<00:16,  4.73it/s, loss=2.65, v_num=0]
Epoch 46:  20%|█▉        | 19/97 [00:03<00:15,  4.89it/s, loss=2.65, v_num=0]
Epoch 46:  20%|█▉        | 19/97 [00:03<00:16,  4.83it/s, loss=2.65, v_num=0]
Epoch 46:  21%|██        | 20/97 [00:04<00:15,  4.98it/s, loss=2.65, v_num=0]
Epoch 46:  21%|██        | 20/97 [00:04<00:15,  4.91it/s, loss=2.66, v_num=0]
Epoch 46:  22%|██▏       | 21/97 [00:04<00:15,  5.06it/s, loss=2.66, v_num=0]
Epoch 46:  22%|██▏       | 21/97 [00:04<00:15,  4.99it/s, loss=2.65, v_num=0]
Epoch 46:  23%|██▎       | 22/97 [00:04<00:14,  5.13it/s, loss=2.65, v_num=0]
Epoch 46:  23%|██▎       | 22/97 [00:04<00:14,  5.06it/s, loss=2.64, v_num=0]
Epoch 46:  24%|██▎       | 23/97 [00:04<00:14,  5.20it/s, loss=2.64, v_num=0]
Epoch 46:  24%|██▎       | 23/97 [00:04<00:14,  5.13it/s, loss=2.64, v_num=0]
Epoch 46:  25%|██▍       | 24/97 [00:04<00:13,  5.26it/s, loss=2.64, v_num=0]
Epoch 46:  25%|██▍       | 24/97 [00:04<00:14,  5.20it/s, loss=2.64, v_num=0]
Epoch 46:  26%|██▌       | 25/97 [00:04<00:13,  5.31it/s, loss=2.64, v_num=0]
Epoch 46:  26%|██▌       | 25/97 [00:04<00:13,  5.25it/s, loss=2.64, v_num=0]
Epoch 46:  27%|██▋       | 26/97 [00:04<00:13,  5.37it/s, loss=2.64, v_num=0]
Epoch 46:  27%|██▋       | 26/97 [00:04<00:13,  5.31it/s, loss=2.63, v_num=0]
Epoch 46:  28%|██▊       | 27/97 [00:04<00:12,  5.43it/s, loss=2.63, v_num=0]
Epoch 46:  28%|██▊       | 27/97 [00:05<00:13,  5.37it/s, loss=2.64, v_num=0]
Epoch 46:  29%|██▉       | 28/97 [00:05<00:12,  5.48it/s, loss=2.64, v_num=0]
Epoch 46:  29%|██▉       | 28/97 [00:05<00:12,  5.42it/s, loss=2.63, v_num=0]
Epoch 46:  30%|██▉       | 29/97 [00:05<00:12,  5.53it/s, loss=2.63, v_num=0]
Epoch 46:  30%|██▉       | 29/97 [00:05<00:12,  5.47it/s, loss=2.63, v_num=0]
Epoch 46:  31%|███       | 30/97 [00:05<00:12,  5.57it/s, loss=2.63, v_num=0]
Epoch 46:  31%|███       | 30/97 [00:05<00:12,  5.51it/s, loss=2.64, v_num=0]
Epoch 46:  32%|███▏      | 31/97 [00:05<00:11,  5.61it/s, loss=2.64, v_num=0]
Epoch 46:  32%|███▏      | 31/97 [00:05<00:11,  5.56it/s, loss=2.63, v_num=0]
Epoch 46:  33%|███▎      | 32/97 [00:05<00:11,  5.65it/s, loss=2.63, v_num=0]
Epoch 46:  33%|███▎      | 32/97 [00:05<00:11,  5.60it/s, loss=2.62, v_num=0]
Epoch 46:  34%|███▍      | 33/97 [00:05<00:11,  5.69it/s, loss=2.62, v_num=0]
Epoch 46:  34%|███▍      | 33/97 [00:05<00:11,  5.64it/s, loss=2.62, v_num=0]
Epoch 46:  35%|███▌      | 34/97 [00:05<00:10,  5.73it/s, loss=2.62, v_num=0]
Epoch 46:  35%|███▌      | 34/97 [00:05<00:11,  5.67it/s, loss=2.62, v_num=0]
Epoch 46:  36%|███▌      | 35/97 [00:06<00:10,  5.77it/s, loss=2.62, v_num=0]
Epoch 46:  36%|███▌      | 35/97 [00:06<00:10,  5.71it/s, loss=2.62, v_num=0]
Epoch 46:  37%|███▋      | 36/97 [00:06<00:10,  5.80it/s, loss=2.62, v_num=0]
Epoch 46:  37%|███▋      | 36/97 [00:06<00:10,  5.75it/s, loss=2.63, v_num=0]
Epoch 46:  38%|███▊      | 37/97 [00:06<00:10,  5.83it/s, loss=2.63, v_num=0]
Epoch 46:  38%|███▊      | 37/97 [00:06<00:10,  5.78it/s, loss=2.63, v_num=0]
Epoch 46:  39%|███▉      | 38/97 [00:06<00:10,  5.86it/s, loss=2.63, v_num=0]
Epoch 46:  39%|███▉      | 38/97 [00:06<00:10,  5.81it/s, loss=2.64, v_num=0]
Epoch 46:  40%|████      | 39/97 [00:06<00:09,  5.89it/s, loss=2.64, v_num=0]
Epoch 46:  40%|████      | 39/97 [00:06<00:09,  5.84it/s, loss=2.64, v_num=0]
Epoch 46:  41%|████      | 40/97 [00:06<00:09,  5.92it/s, loss=2.64, v_num=0]
Epoch 46:  41%|████      | 40/97 [00:06<00:09,  5.87it/s, loss=2.63, v_num=0]
Epoch 46:  42%|████▏     | 41/97 [00:06<00:09,  5.95it/s, loss=2.63, v_num=0]
Epoch 46:  42%|████▏     | 41/97 [00:06<00:09,  5.90it/s, loss=2.63, v_num=0]
Epoch 46:  43%|████▎     | 42/97 [00:07<00:09,  5.98it/s, loss=2.63, v_num=0]
Epoch 46:  43%|████▎     | 42/97 [00:07<00:09,  5.93it/s, loss=2.63, v_num=0]
Epoch 46:  44%|████▍     | 43/97 [00:07<00:09,  6.00it/s, loss=2.63, v_num=0]
Epoch 46:  44%|████▍     | 43/97 [00:07<00:09,  5.95it/s, loss=2.64, v_num=0]
Epoch 46:  45%|████▌     | 44/97 [00:07<00:08,  6.03it/s, loss=2.64, v_num=0]
Epoch 46:  45%|████▌     | 44/97 [00:07<00:08,  5.98it/s, loss=2.64, v_num=0]
Epoch 46:  46%|████▋     | 45/97 [00:07<00:08,  6.05it/s, loss=2.64, v_num=0]
Epoch 46:  46%|████▋     | 45/97 [00:07<00:08,  6.00it/s, loss=2.63, v_num=0]
Epoch 46:  47%|████▋     | 46/97 [00:07<00:08,  6.07it/s, loss=2.63, v_num=0]
Epoch 46:  47%|████▋     | 46/97 [00:07<00:08,  6.03it/s, loss=2.64, v_num=0]
Epoch 46:  48%|████▊     | 47/97 [00:07<00:08,  6.09it/s, loss=2.64, v_num=0]
Epoch 46:  48%|████▊     | 47/97 [00:07<00:08,  6.05it/s, loss=2.63, v_num=0]
Epoch 46:  49%|████▉     | 48/97 [00:07<00:08,  6.11it/s, loss=2.63, v_num=0]
Epoch 46:  49%|████▉     | 48/97 [00:07<00:08,  6.07it/s, loss=2.63, v_num=0]
Epoch 46:  51%|█████     | 49/97 [00:07<00:07,  6.13it/s, loss=2.63, v_num=0]
Epoch 46:  51%|█████     | 49/97 [00:08<00:07,  6.09it/s, loss=2.63, v_num=0]
Epoch 46:  52%|█████▏    | 50/97 [00:08<00:07,  6.15it/s, loss=2.63, v_num=0]
Epoch 46:  52%|█████▏    | 50/97 [00:08<00:07,  6.11it/s, loss=2.63, v_num=0]
Epoch 46:  53%|█████▎    | 51/97 [00:08<00:07,  6.17it/s, loss=2.63, v_num=0]
Epoch 46:  53%|█████▎    | 51/97 [00:08<00:07,  6.13it/s, loss=2.64, v_num=0]
Epoch 46:  54%|█████▎    | 52/97 [00:08<00:07,  6.18it/s, loss=2.64, v_num=0]
Epoch 46:  54%|█████▎    | 52/97 [00:08<00:07,  6.14it/s, loss=2.65, v_num=0]
Epoch 46:  55%|█████▍    | 53/97 [00:08<00:07,  6.20it/s, loss=2.65, v_num=0]
Epoch 46:  55%|█████▍    | 53/97 [00:08<00:07,  6.16it/s, loss=2.64, v_num=0]
Epoch 46:  56%|█████▌    | 54/97 [00:08<00:06,  6.22it/s, loss=2.64, v_num=0]
Epoch 46:  56%|█████▌    | 54/97 [00:08<00:06,  6.18it/s, loss=2.65, v_num=0]
Epoch 46:  57%|█████▋    | 55/97 [00:08<00:06,  6.23it/s, loss=2.65, v_num=0]
Epoch 46:  57%|█████▋    | 55/97 [00:08<00:06,  6.20it/s, loss=2.65, v_num=0]
Epoch 46:  58%|█████▊    | 56/97 [00:08<00:06,  6.25it/s, loss=2.65, v_num=0]
Epoch 46:  58%|█████▊    | 56/97 [00:09<00:06,  6.21it/s, loss=2.64, v_num=0]
Epoch 46:  59%|█████▉    | 57/97 [00:09<00:06,  6.27it/s, loss=2.64, v_num=0]
Epoch 46:  59%|█████▉    | 57/97 [00:09<00:06,  6.23it/s, loss=2.64, v_num=0]
Epoch 46:  60%|█████▉    | 58/97 [00:09<00:06,  6.28it/s, loss=2.64, v_num=0]
Epoch 46:  60%|█████▉    | 58/97 [00:09<00:06,  6.24it/s, loss=2.63, v_num=0]
Epoch 46:  61%|██████    | 59/97 [00:09<00:06,  6.30it/s, loss=2.63, v_num=0]
Epoch 46:  61%|██████    | 59/97 [00:09<00:06,  6.26it/s, loss=2.63, v_num=0]
Epoch 46:  62%|██████▏   | 60/97 [00:09<00:05,  6.31it/s, loss=2.63, v_num=0]
Epoch 46:  62%|██████▏   | 60/97 [00:09<00:05,  6.27it/s, loss=2.62, v_num=0]
Epoch 46:  63%|██████▎   | 61/97 [00:09<00:05,  6.33it/s, loss=2.62, v_num=0]
Epoch 46:  63%|██████▎   | 61/97 [00:09<00:05,  6.29it/s, loss=2.63, v_num=0]
Epoch 46:  64%|██████▍   | 62/97 [00:09<00:05,  6.34it/s, loss=2.63, v_num=0]
Epoch 46:  64%|██████▍   | 62/97 [00:09<00:05,  6.30it/s, loss=2.63, v_num=0]
Epoch 46:  65%|██████▍   | 63/97 [00:09<00:05,  6.35it/s, loss=2.63, v_num=0]
Epoch 46:  65%|██████▍   | 63/97 [00:09<00:05,  6.32it/s, loss=2.63, v_num=0]
Epoch 46:  66%|██████▌   | 64/97 [00:10<00:05,  6.37it/s, loss=2.63, v_num=0]
Epoch 46:  66%|██████▌   | 64/97 [00:10<00:05,  6.33it/s, loss=2.63, v_num=0]
Epoch 46:  67%|██████▋   | 65/97 [00:10<00:05,  6.38it/s, loss=2.63, v_num=0]
Epoch 46:  67%|██████▋   | 65/97 [00:10<00:05,  6.34it/s, loss=2.63, v_num=0]
Epoch 46:  68%|██████▊   | 66/97 [00:10<00:04,  6.39it/s, loss=2.63, v_num=0]
Epoch 46:  68%|██████▊   | 66/97 [00:10<00:04,  6.36it/s, loss=2.64, v_num=0]
Epoch 46:  69%|██████▉   | 67/97 [00:10<00:04,  6.40it/s, loss=2.64, v_num=0]
Epoch 46:  69%|██████▉   | 67/97 [00:10<00:04,  6.37it/s, loss=2.64, v_num=0]
Epoch 46:  70%|███████   | 68/97 [00:10<00:04,  6.42it/s, loss=2.64, v_num=0]
Epoch 46:  70%|███████   | 68/97 [00:10<00:04,  6.38it/s, loss=2.64, v_num=0]
Epoch 46:  71%|███████   | 69/97 [00:10<00:04,  6.42it/s, loss=2.64, v_num=0]
Epoch 46:  71%|███████   | 69/97 [00:10<00:04,  6.39it/s, loss=2.63, v_num=0]
Epoch 46:  72%|███████▏  | 70/97 [00:10<00:04,  6.43it/s, loss=2.63, v_num=0]
Epoch 46:  72%|███████▏  | 70/97 [00:10<00:04,  6.40it/s, loss=2.63, v_num=0]
Epoch 46:  73%|███████▎  | 71/97 [00:11<00:04,  6.45it/s, loss=2.63, v_num=0]
Epoch 46:  73%|███████▎  | 71/97 [00:11<00:04,  6.41it/s, loss=2.62, v_num=0]
Epoch 46:  74%|███████▍  | 72/97 [00:11<00:03,  6.46it/s, loss=2.62, v_num=0]
Epoch 46:  74%|███████▍  | 72/97 [00:11<00:03,  6.42it/s, loss=2.62, v_num=0]
Epoch 46:  75%|███████▌  | 73/97 [00:11<00:03,  6.47it/s, loss=2.62, v_num=0]
Epoch 46:  75%|███████▌  | 73/97 [00:11<00:03,  6.43it/s, loss=2.61, v_num=0]
Epoch 46:  76%|███████▋  | 74/97 [00:11<00:03,  6.48it/s, loss=2.61, v_num=0]
Epoch 46:  76%|███████▋  | 74/97 [00:11<00:03,  6.44it/s, loss=2.61, v_num=0]
Epoch 46:  77%|███████▋  | 75/97 [00:11<00:03,  6.49it/s, loss=2.61, v_num=0]
Epoch 46:  77%|███████▋  | 75/97 [00:11<00:03,  6.45it/s, loss=2.61, v_num=0]
Epoch 46:  78%|███████▊  | 76/97 [00:11<00:03,  6.50it/s, loss=2.61, v_num=0]
Epoch 46:  78%|███████▊  | 76/97 [00:11<00:03,  6.46it/s, loss=2.62, v_num=0]
Epoch 46:  79%|███████▉  | 77/97 [00:11<00:03,  6.50it/s, loss=2.62, v_num=0]
Epoch 46:  79%|███████▉  | 77/97 [00:11<00:03,  6.47it/s, loss=2.62, v_num=0]
Epoch 46:  80%|████████  | 78/97 [00:11<00:02,  6.51it/s, loss=2.62, v_num=0]
Epoch 46:  80%|████████  | 78/97 [00:12<00:02,  6.48it/s, loss=2.62, v_num=0]
Epoch 46:  81%|████████▏ | 79/97 [00:12<00:02,  6.52it/s, loss=2.62, v_num=0]
Epoch 46:  81%|████████▏ | 79/97 [00:12<00:02,  6.49it/s, loss=2.61, v_num=0]
Epoch 46:  82%|████████▏ | 80/97 [00:12<00:02,  6.53it/s, loss=2.61, v_num=0]
Epoch 46:  82%|████████▏ | 80/97 [00:12<00:02,  6.50it/s, loss=2.62, v_num=0]
Epoch 46:  84%|████████▎ | 81/97 [00:12<00:02,  6.54it/s, loss=2.62, v_num=0]
Epoch 46:  84%|████████▎ | 81/97 [00:12<00:02,  6.51it/s, loss=2.61, v_num=0]
Epoch 46:  85%|████████▍ | 82/97 [00:12<00:02,  6.55it/s, loss=2.61, v_num=0]
Epoch 46:  85%|████████▍ | 82/97 [00:12<00:02,  6.52it/s, loss=2.61, v_num=0]
Epoch 46:  86%|████████▌ | 83/97 [00:12<00:02,  6.55it/s, loss=2.61, v_num=0]
Epoch 46:  86%|████████▌ | 83/97 [00:12<00:02,  6.53it/s, loss=2.61, v_num=0]
Epoch 46:  87%|████████▋ | 84/97 [00:12<00:01,  6.56it/s, loss=2.61, v_num=0]
Epoch 46:  87%|████████▋ | 84/97 [00:12<00:01,  6.53it/s, loss=2.61, v_num=0]
Epoch 46:  88%|████████▊ | 85/97 [00:12<00:01,  6.57it/s, loss=2.61, v_num=0]
Epoch 46:  88%|████████▊ | 85/97 [00:12<00:01,  6.54it/s, loss=2.6, v_num=0]
Epoch 46:  89%|████████▊ | 86/97 [00:13<00:01,  6.58it/s, loss=2.6, v_num=0]
Epoch 46:  89%|████████▊ | 86/97 [00:13<00:01,  6.55it/s, loss=2.6, v_num=0]
Epoch 46:  90%|████████▉ | 87/97 [00:13<00:01,  6.59it/s, loss=2.6, v_num=0]
Epoch 46:  90%|████████▉ | 87/97 [00:13<00:01,  6.56it/s, loss=2.59, v_num=0]
Epoch 46:  91%|█████████ | 88/97 [00:13<00:01,  6.59it/s, loss=2.59, v_num=0]
Epoch 46:  91%|█████████ | 88/97 [00:13<00:01,  6.57it/s, loss=2.59, v_num=0]
Epoch 46:  92%|█████████▏| 89/97 [00:13<00:01,  6.60it/s, loss=2.59, v_num=0]
Epoch 46:  92%|█████████▏| 89/97 [00:13<00:01,  6.57it/s, loss=2.6, v_num=0]
Epoch 46:  93%|█████████▎| 90/97 [00:13<00:01,  6.61it/s, loss=2.6, v_num=0]
Epoch 46:  93%|█████████▎| 90/97 [00:13<00:01,  6.58it/s, loss=2.59, v_num=0]
Epoch 46:  94%|█████████▍| 91/97 [00:13<00:00,  6.61it/s, loss=2.59, v_num=0]
Epoch 46:  94%|█████████▍| 91/97 [00:13<00:00,  6.59it/s, loss=2.6, v_num=0]
Epoch 46:  95%|█████████▍| 92/97 [00:13<00:00,  6.62it/s, loss=2.6, v_num=0]
Epoch 46:  95%|█████████▍| 92/97 [00:13<00:00,  6.59it/s, loss=2.6, v_num=0]
Epoch 46:  96%|█████████▌| 93/97 [00:14<00:00,  6.63it/s, loss=2.6, v_num=0]
Epoch 46:  96%|█████████▌| 93/97 [00:14<00:00,  6.60it/s, loss=2.6, v_num=0]
Epoch 46:  97%|█████████▋| 94/97 [00:14<00:00,  6.63it/s, loss=2.6, v_num=0]
Epoch 46:  97%|█████████▋| 94/97 [00:14<00:00,  6.61it/s, loss=2.6, v_num=0]
Epoch 46:  98%|█████████▊| 95/97 [00:14<00:00,  6.64it/s, loss=2.6, v_num=0]
Epoch 46:  98%|█████████▊| 95/97 [00:14<00:00,  6.61it/s, loss=2.6, v_num=0]
Epoch 46:  99%|█████████▉| 96/97 [00:14<00:00,  6.65it/s, loss=2.6, v_num=0]
Epoch 46:  99%|█████████▉| 96/97 [00:14<00:00,  6.62it/s, loss=2.59, v_num=0]
Epoch 46: 100%|██████████| 97/97 [00:14<00:00,  6.65it/s, loss=2.59, v_num=0]
Epoch 46: 100%|██████████| 97/97 [00:14<00:00,  6.63it/s, loss=2.58, v_num=0]
Epoch 46: 100%|██████████| 97/97 [00:14<00:00,  6.63it/s, loss=2.58, v_num=0]
Epoch 46:   0%|          | 0/97 [00:00<?, ?it/s, loss=2.58, v_num=0]
Epoch 47:   0%|          | 0/97 [00:00<?, ?it/s, loss=2.58, v_num=0]
Epoch 47:   1%|          | 1/97 [00:01<02:12,  1.38s/it, loss=2.58, v_num=0]
Epoch 47:   1%|          | 1/97 [00:01<02:17,  1.43s/it, loss=2.58, v_num=0]
Epoch 47:   2%|▏         | 2/97 [00:01<01:11,  1.32it/s, loss=2.58, v_num=0]
Epoch 47:   2%|▏         | 2/97 [00:01<01:14,  1.27it/s, loss=2.59, v_num=0]
Epoch 47:   3%|▎         | 3/97 [00:01<00:51,  1.81it/s, loss=2.59, v_num=0]
Epoch 47:   3%|▎         | 3/97 [00:01<00:53,  1.76it/s, loss=2.59, v_num=0]
Epoch 47:   4%|▍         | 4/97 [00:01<00:41,  2.24it/s, loss=2.59, v_num=0]
Epoch 47:   4%|▍         | 4/97 [00:01<00:42,  2.17it/s, loss=2.61, v_num=0]
Epoch 47:   5%|▌         | 5/97 [00:01<00:35,  2.60it/s, loss=2.61, v_num=0]
Epoch 47:   5%|▌         | 5/97 [00:01<00:36,  2.52it/s, loss=2.61, v_num=0]
Epoch 47:   6%|▌         | 6/97 [00:02<00:31,  2.91it/s, loss=2.61, v_num=0]
Epoch 47:   6%|▌         | 6/97 [00:02<00:32,  2.83it/s, loss=2.62, v_num=0]
Epoch 47:   7%|▋         | 7/97 [00:02<00:28,  3.18it/s, loss=2.62, v_num=0]
Epoch 47:   7%|▋         | 7/97 [00:02<00:28,  3.10it/s, loss=2.61, v_num=0]
Epoch 47:   8%|▊         | 8/97 [00:02<00:25,  3.43it/s, loss=2.61, v_num=0]
Epoch 47:   8%|▊         | 8/97 [00:02<00:26,  3.35it/s, loss=2.62, v_num=0]
Epoch 47:   9%|▉         | 9/97 [00:02<00:24,  3.64it/s, loss=2.62, v_num=0]
Epoch 47:   9%|▉         | 9/97 [00:02<00:24,  3.56it/s, loss=2.62, v_num=0]
Epoch 47:  10%|█         | 10/97 [00:02<00:22,  3.84it/s, loss=2.62, v_num=0]
Epoch 47:  10%|█         | 10/97 [00:02<00:23,  3.75it/s, loss=2.62, v_num=0]
Epoch 47:  11%|█▏        | 11/97 [00:02<00:21,  4.00it/s, loss=2.62, v_num=0]
Epoch 47:  11%|█▏        | 11/97 [00:02<00:21,  3.92it/s, loss=2.62, v_num=0]
Epoch 47:  12%|█▏        | 12/97 [00:02<00:20,  4.16it/s, loss=2.62, v_num=0]
Epoch 47:  12%|█▏        | 12/97 [00:02<00:20,  4.07it/s, loss=2.62, v_num=0]
Epoch 47:  13%|█▎        | 13/97 [00:03<00:19,  4.30it/s, loss=2.62, v_num=0]
Epoch 47:  13%|█▎        | 13/97 [00:03<00:19,  4.22it/s, loss=2.62, v_num=0]
Epoch 47:  14%|█▍        | 14/97 [00:03<00:18,  4.42it/s, loss=2.62, v_num=0]
Epoch 47:  14%|█▍        | 14/97 [00:03<00:19,  4.35it/s, loss=2.62, v_num=0]
Epoch 47:  15%|█▌        | 15/97 [00:03<00:18,  4.55it/s, loss=2.62, v_num=0]
Epoch 47:  15%|█▌        | 15/97 [00:03<00:18,  4.47it/s, loss=2.62, v_num=0]
Epoch 47:  16%|█▋        | 16/97 [00:03<00:17,  4.65it/s, loss=2.62, v_num=0]
Epoch 47:  16%|█▋        | 16/97 [00:03<00:17,  4.58it/s, loss=2.64, v_num=0]
Epoch 47:  18%|█▊        | 17/97 [00:03<00:16,  4.76it/s, loss=2.64, v_num=0]
Epoch 47:  18%|█▊        | 17/97 [00:03<00:17,  4.68it/s, loss=2.63, v_num=0]
Epoch 47:  19%|█▊        | 18/97 [00:03<00:16,  4.85it/s, loss=2.63, v_num=0]
Epoch 47:  19%|█▊        | 18/97 [00:03<00:16,  4.78it/s, loss=2.63, v_num=0]
Epoch 47:  20%|█▉        | 19/97 [00:03<00:15,  4.94it/s, loss=2.63, v_num=0]
Epoch 47:  20%|█▉        | 19/97 [00:03<00:16,  4.86it/s, loss=2.64, v_num=0]
Epoch 47:  21%|██        | 20/97 [00:03<00:15,  5.02it/s, loss=2.64, v_num=0]
Epoch 47:  21%|██        | 20/97 [00:04<00:15,  4.95it/s, loss=2.64, v_num=0]
Epoch 47:  22%|██▏       | 21/97 [00:04<00:14,  5.10it/s, loss=2.64, v_num=0]
Epoch 47:  22%|██▏       | 21/97 [00:04<00:15,  5.03it/s, loss=2.64, v_num=0]
Epoch 47:  23%|██▎       | 22/97 [00:04<00:14,  5.16it/s, loss=2.64, v_num=0]
Epoch 47:  23%|██▎       | 22/97 [00:04<00:14,  5.10it/s, loss=2.64, v_num=0]
Epoch 47:  24%|██▎       | 23/97 [00:04<00:14,  5.23it/s, loss=2.64, v_num=0]
Epoch 47:  24%|██▎       | 23/97 [00:04<00:14,  5.17it/s, loss=2.64, v_num=0]
Epoch 47:  25%|██▍       | 24/97 [00:04<00:13,  5.29it/s, loss=2.64, v_num=0]
Epoch 47:  25%|██▍       | 24/97 [00:04<00:13,  5.23it/s, loss=2.63, v_num=0]
Epoch 47:  26%|██▌       | 25/97 [00:04<00:13,  5.35it/s, loss=2.63, v_num=0]
Epoch 47:  26%|██▌       | 25/97 [00:04<00:13,  5.28it/s, loss=2.63, v_num=0]
Epoch 47:  27%|██▋       | 26/97 [00:04<00:13,  5.40it/s, loss=2.63, v_num=0]
Epoch 47:  27%|██▋       | 26/97 [00:04<00:13,  5.34it/s, loss=2.62, v_num=0]
Epoch 47:  28%|██▊       | 27/97 [00:04<00:12,  5.46it/s, loss=2.62, v_num=0]
Epoch 47:  28%|██▊       | 27/97 [00:05<00:12,  5.39it/s, loss=2.62, v_num=0]
Epoch 47:  29%|██▉       | 28/97 [00:05<00:12,  5.51it/s, loss=2.62, v_num=0]
Epoch 47:  29%|██▉       | 28/97 [00:05<00:12,  5.44it/s, loss=2.62, v_num=0]
Epoch 47:  30%|██▉       | 29/97 [00:05<00:12,  5.55it/s, loss=2.62, v_num=0]
Epoch 47:  30%|██▉       | 29/97 [00:05<00:12,  5.49it/s, loss=2.62, v_num=0]
Epoch 47:  31%|███       | 30/97 [00:05<00:11,  5.60it/s, loss=2.62, v_num=0]
Epoch 47:  31%|███       | 30/97 [00:05<00:12,  5.54it/s, loss=2.62, v_num=0]
Epoch 47:  32%|███▏      | 31/97 [00:05<00:11,  5.64it/s, loss=2.62, v_num=0]
Epoch 47:  32%|███▏      | 31/97 [00:05<00:11,  5.58it/s, loss=2.62, v_num=0]
Epoch 47:  33%|███▎      | 32/97 [00:05<00:11,  5.68it/s, loss=2.62, v_num=0]
Epoch 47:  33%|███▎      | 32/97 [00:05<00:11,  5.62it/s, loss=2.62, v_num=0]
Epoch 47:  34%|███▍      | 33/97 [00:05<00:11,  5.72it/s, loss=2.62, v_num=0]
Epoch 47:  34%|███▍      | 33/97 [00:05<00:11,  5.66it/s, loss=2.62, v_num=0]
Epoch 47:  35%|███▌      | 34/97 [00:05<00:10,  5.75it/s, loss=2.62, v_num=0]
Epoch 47:  35%|███▌      | 34/97 [00:05<00:11,  5.70it/s, loss=2.61, v_num=0]
Epoch 47:  36%|███▌      | 35/97 [00:06<00:10,  5.79it/s, loss=2.61, v_num=0]
Epoch 47:  36%|███▌      | 35/97 [00:06<00:10,  5.74it/s, loss=2.6, v_num=0]
Epoch 47:  37%|███▋      | 36/97 [00:06<00:10,  5.82it/s, loss=2.6, v_num=0]
Epoch 47:  37%|███▋      | 36/97 [00:06<00:10,  5.77it/s, loss=2.59, v_num=0]
Epoch 47:  38%|███▊      | 37/97 [00:06<00:10,  5.86it/s, loss=2.59, v_num=0]
Epoch 47:  38%|███▊      | 37/97 [00:06<00:10,  5.81it/s, loss=2.6, v_num=0]
Epoch 47:  39%|███▉      | 38/97 [00:06<00:10,  5.89it/s, loss=2.6, v_num=0]
Epoch 47:  39%|███▉      | 38/97 [00:06<00:10,  5.84it/s, loss=2.6, v_num=0]
Epoch 47:  40%|████      | 39/97 [00:06<00:09,  5.92it/s, loss=2.6, v_num=0]
Epoch 47:  40%|████      | 39/97 [00:06<00:09,  5.87it/s, loss=2.6, v_num=0]
Epoch 47:  41%|████      | 40/97 [00:06<00:09,  5.95it/s, loss=2.6, v_num=0]
Epoch 47:  41%|████      | 40/97 [00:06<00:09,  5.90it/s, loss=2.6, v_num=0]
Epoch 47:  42%|████▏     | 41/97 [00:06<00:09,  5.97it/s, loss=2.6, v_num=0]
Epoch 47:  42%|████▏     | 41/97 [00:06<00:09,  5.92it/s, loss=2.59, v_num=0]
Epoch 47:  43%|████▎     | 42/97 [00:07<00:09,  6.00it/s, loss=2.59, v_num=0]
Epoch 47:  43%|████▎     | 42/97 [00:07<00:09,  5.95it/s, loss=2.59, v_num=0]
Epoch 47:  44%|████▍     | 43/97 [00:07<00:08,  6.01it/s, loss=2.59, v_num=0]
Epoch 47:  44%|████▍     | 43/97 [00:07<00:09,  5.97it/s, loss=2.59, v_num=0]
Epoch 47:  45%|████▌     | 44/97 [00:07<00:08,  6.04it/s, loss=2.59, v_num=0]
Epoch 47:  45%|████▌     | 44/97 [00:07<00:08,  5.99it/s, loss=2.59, v_num=0]
Epoch 47:  46%|████▋     | 45/97 [00:07<00:08,  6.06it/s, loss=2.59, v_num=0]
Epoch 47:  46%|████▋     | 45/97 [00:07<00:08,  6.02it/s, loss=2.59, v_num=0]
Epoch 47:  47%|████▋     | 46/97 [00:07<00:08,  6.08it/s, loss=2.59, v_num=0]
Epoch 47:  47%|████▋     | 46/97 [00:07<00:08,  6.04it/s, loss=2.59, v_num=0]
Epoch 47:  48%|████▊     | 47/97 [00:07<00:08,  6.10it/s, loss=2.59, v_num=0]
Epoch 47:  48%|████▊     | 47/97 [00:07<00:08,  6.06it/s, loss=2.59, v_num=0]
Epoch 47:  49%|████▉     | 48/97 [00:07<00:08,  6.12it/s, loss=2.59, v_num=0]
Epoch 47:  49%|████▉     | 48/97 [00:07<00:08,  6.08it/s, loss=2.59, v_num=0]
Epoch 47:  51%|█████     | 49/97 [00:07<00:07,  6.14it/s, loss=2.59, v_num=0]
Epoch 47:  51%|█████     | 49/97 [00:08<00:07,  6.10it/s, loss=2.59, v_num=0]
Epoch 47:  52%|█████▏    | 50/97 [00:08<00:07,  6.16it/s, loss=2.59, v_num=0]
Epoch 47:  52%|█████▏    | 50/97 [00:08<00:07,  6.12it/s, loss=2.59, v_num=0]
Epoch 47:  53%|█████▎    | 51/97 [00:08<00:07,  6.18it/s, loss=2.59, v_num=0]
Epoch 47:  53%|█████▎    | 51/97 [00:08<00:07,  6.14it/s, loss=2.59, v_num=0]
Epoch 47:  54%|█████▎    | 52/97 [00:08<00:07,  6.20it/s, loss=2.59, v_num=0]
Epoch 47:  54%|█████▎    | 52/97 [00:08<00:07,  6.15it/s, loss=2.59, v_num=0]
Epoch 47:  55%|█████▍    | 53/97 [00:08<00:07,  6.21it/s, loss=2.59, v_num=0]
Epoch 47:  55%|█████▍    | 53/97 [00:08<00:07,  6.17it/s, loss=2.59, v_num=0]
Epoch 47:  56%|█████▌    | 54/97 [00:08<00:06,  6.23it/s, loss=2.59, v_num=0]
Epoch 47:  56%|█████▌    | 54/97 [00:08<00:06,  6.19it/s, loss=2.59, v_num=0]
Epoch 47:  57%|█████▋    | 55/97 [00:08<00:06,  6.24it/s, loss=2.59, v_num=0]
Epoch 47:  57%|█████▋    | 55/97 [00:08<00:06,  6.21it/s, loss=2.6, v_num=0]
Epoch 47:  58%|█████▊    | 56/97 [00:08<00:06,  6.26it/s, loss=2.6, v_num=0]
Epoch 47:  58%|█████▊    | 56/97 [00:09<00:06,  6.22it/s, loss=2.6, v_num=0]
Epoch 47:  59%|█████▉    | 57/97 [00:09<00:06,  6.28it/s, loss=2.6, v_num=0]
Epoch 47:  59%|█████▉    | 57/97 [00:09<00:06,  6.24it/s, loss=2.59, v_num=0]
Epoch 47:  60%|█████▉    | 58/97 [00:09<00:06,  6.29it/s, loss=2.59, v_num=0]
Epoch 47:  60%|█████▉    | 58/97 [00:09<00:06,  6.25it/s, loss=2.6, v_num=0]
Epoch 47:  61%|██████    | 59/97 [00:09<00:06,  6.30it/s, loss=2.6, v_num=0]
Epoch 47:  61%|██████    | 59/97 [00:09<00:06,  6.27it/s, loss=2.6, v_num=0]
Epoch 47:  62%|██████▏   | 60/97 [00:09<00:05,  6.32it/s, loss=2.6, v_num=0]
Epoch 47:  62%|██████▏   | 60/97 [00:09<00:05,  6.28it/s, loss=2.59, v_num=0]
Epoch 47:  63%|██████▎   | 61/97 [00:09<00:05,  6.33it/s, loss=2.59, v_num=0]
Epoch 47:  63%|██████▎   | 61/97 [00:09<00:05,  6.29it/s, loss=2.59, v_num=0]
Epoch 47:  64%|██████▍   | 62/97 [00:09<00:05,  6.34it/s, loss=2.59, v_num=0]
Epoch 47:  64%|██████▍   | 62/97 [00:09<00:05,  6.31it/s, loss=2.6, v_num=0]
Epoch 47:  65%|██████▍   | 63/97 [00:09<00:05,  6.36it/s, loss=2.6, v_num=0]
Epoch 47:  65%|██████▍   | 63/97 [00:09<00:05,  6.32it/s, loss=2.6, v_num=0]
Epoch 47:  66%|██████▌   | 64/97 [00:10<00:05,  6.37it/s, loss=2.6, v_num=0]
Epoch 47:  66%|██████▌   | 64/97 [00:10<00:05,  6.33it/s, loss=2.6, v_num=0]
Epoch 47:  67%|██████▋   | 65/97 [00:10<00:05,  6.38it/s, loss=2.6, v_num=0]
Epoch 47:  67%|██████▋   | 65/97 [00:10<00:05,  6.35it/s, loss=2.6, v_num=0]
Epoch 47:  68%|██████▊   | 66/97 [00:10<00:04,  6.39it/s, loss=2.6, v_num=0]
Epoch 47:  68%|██████▊   | 66/97 [00:10<00:04,  6.36it/s, loss=2.6, v_num=0]
Epoch 47:  69%|██████▉   | 67/97 [00:10<00:04,  6.41it/s, loss=2.6, v_num=0]
Epoch 47:  69%|██████▉   | 67/97 [00:10<00:04,  6.37it/s, loss=2.6, v_num=0]
Epoch 47:  70%|███████   | 68/97 [00:10<00:04,  6.42it/s, loss=2.6, v_num=0]
Epoch 47:  70%|███████   | 68/97 [00:10<00:04,  6.38it/s, loss=2.6, v_num=0]
Epoch 47:  71%|███████   | 69/97 [00:10<00:04,  6.43it/s, loss=2.6, v_num=0]
Epoch 47:  71%|███████   | 69/97 [00:10<00:04,  6.40it/s, loss=2.59, v_num=0]
Epoch 47:  72%|███████▏  | 70/97 [00:10<00:04,  6.44it/s, loss=2.59, v_num=0]
Epoch 47:  72%|███████▏  | 70/97 [00:10<00:04,  6.41it/s, loss=2.59, v_num=0]
Epoch 47:  73%|███████▎  | 71/97 [00:11<00:04,  6.45it/s, loss=2.59, v_num=0]
Epoch 47:  73%|███████▎  | 71/97 [00:11<00:04,  6.42it/s, loss=2.6, v_num=0]
Epoch 47:  74%|███████▍  | 72/97 [00:11<00:03,  6.46it/s, loss=2.6, v_num=0]
Epoch 47:  74%|███████▍  | 72/97 [00:11<00:03,  6.43it/s, loss=2.6, v_num=0]
Epoch 47:  75%|███████▌  | 73/97 [00:11<00:03,  6.47it/s, loss=2.6, v_num=0]
Epoch 47:  75%|███████▌  | 73/97 [00:11<00:03,  6.43it/s, loss=2.6, v_num=0]
Epoch 47:  76%|███████▋  | 74/97 [00:11<00:03,  6.48it/s, loss=2.6, v_num=0]
Epoch 47:  76%|███████▋  | 74/97 [00:11<00:03,  6.44it/s, loss=2.6, v_num=0]
Epoch 47:  77%|███████▋  | 75/97 [00:11<00:03,  6.48it/s, loss=2.6, v_num=0]
Epoch 47:  77%|███████▋  | 75/97 [00:11<00:03,  6.45it/s, loss=2.61, v_num=0]
Epoch 47:  78%|███████▊  | 76/97 [00:11<00:03,  6.49it/s, loss=2.61, v_num=0]
Epoch 47:  78%|███████▊  | 76/97 [00:11<00:03,  6.46it/s, loss=2.6, v_num=0]
Epoch 47:  79%|███████▉  | 77/97 [00:11<00:03,  6.50it/s, loss=2.6, v_num=0]
Epoch 47:  79%|███████▉  | 77/97 [00:11<00:03,  6.47it/s, loss=2.6, v_num=0]
Epoch 47:  80%|████████  | 78/97 [00:11<00:02,  6.51it/s, loss=2.6, v_num=0]
Epoch 47:  80%|████████  | 78/97 [00:12<00:02,  6.48it/s, loss=2.59, v_num=0]
Epoch 47:  81%|████████▏ | 79/97 [00:12<00:02,  6.52it/s, loss=2.59, v_num=0]
Epoch 47:  81%|████████▏ | 79/97 [00:12<00:02,  6.49it/s, loss=2.6, v_num=0]
Epoch 47:  82%|████████▏ | 80/97 [00:12<00:02,  6.52it/s, loss=2.6, v_num=0]
Epoch 47:  82%|████████▏ | 80/97 [00:12<00:02,  6.49it/s, loss=2.6, v_num=0]
Epoch 47:  84%|████████▎ | 81/97 [00:12<00:02,  6.53it/s, loss=2.6, v_num=0]
Epoch 47:  84%|████████▎ | 81/97 [00:12<00:02,  6.50it/s, loss=2.6, v_num=0]
Epoch 47:  85%|████████▍ | 82/97 [00:12<00:02,  6.54it/s, loss=2.6, v_num=0]
Epoch 47:  85%|████████▍ | 82/97 [00:12<00:02,  6.51it/s, loss=2.6, v_num=0]
Epoch 47:  86%|████████▌ | 83/97 [00:12<00:02,  6.55it/s, loss=2.6, v_num=0]
Epoch 47:  86%|████████▌ | 83/97 [00:12<00:02,  6.52it/s, loss=2.59, v_num=0]
Epoch 47:  87%|████████▋ | 84/97 [00:12<00:01,  6.56it/s, loss=2.59, v_num=0]
Epoch 47:  87%|████████▋ | 84/97 [00:12<00:01,  6.53it/s, loss=2.6, v_num=0]
Epoch 47:  88%|████████▊ | 85/97 [00:12<00:01,  6.56it/s, loss=2.6, v_num=0]
Epoch 47:  88%|████████▊ | 85/97 [00:13<00:01,  6.54it/s, loss=2.6, v_num=0]
Epoch 47:  89%|████████▊ | 86/97 [00:13<00:01,  6.57it/s, loss=2.6, v_num=0]
Epoch 47:  89%|████████▊ | 86/97 [00:13<00:01,  6.54it/s, loss=2.6, v_num=0]
Epoch 47:  90%|████████▉ | 87/97 [00:13<00:01,  6.58it/s, loss=2.6, v_num=0]
Epoch 47:  90%|████████▉ | 87/97 [00:13<00:01,  6.55it/s, loss=2.6, v_num=0]
Epoch 47:  91%|█████████ | 88/97 [00:13<00:01,  6.59it/s, loss=2.6, v_num=0]
Epoch 47:  91%|█████████ | 88/97 [00:13<00:01,  6.56it/s, loss=2.6, v_num=0]
Epoch 47:  92%|█████████▏| 89/97 [00:13<00:01,  6.60it/s, loss=2.6, v_num=0]
Epoch 47:  92%|█████████▏| 89/97 [00:13<00:01,  6.57it/s, loss=2.61, v_num=0]
Epoch 47:  93%|█████████▎| 90/97 [00:13<00:01,  6.60it/s, loss=2.61, v_num=0]
Epoch 47:  93%|█████████▎| 90/97 [00:13<00:01,  6.57it/s, loss=2.61, v_num=0]
Epoch 47:  94%|█████████▍| 91/97 [00:13<00:00,  6.61it/s, loss=2.61, v_num=0]
Epoch 47:  94%|█████████▍| 91/97 [00:13<00:00,  6.58it/s, loss=2.6, v_num=0]
Epoch 47:  95%|█████████▍| 92/97 [00:13<00:00,  6.61it/s, loss=2.6, v_num=0]
Epoch 47:  95%|█████████▍| 92/97 [00:13<00:00,  6.59it/s, loss=2.6, v_num=0]
Epoch 47:  96%|█████████▌| 93/97 [00:14<00:00,  6.62it/s, loss=2.6, v_num=0]
Epoch 47:  96%|█████████▌| 93/97 [00:14<00:00,  6.59it/s, loss=2.6, v_num=0]
Epoch 47:  97%|█████████▋| 94/97 [00:14<00:00,  6.63it/s, loss=2.6, v_num=0]
Epoch 47:  97%|█████████▋| 94/97 [00:14<00:00,  6.60it/s, loss=2.59, v_num=0]
Epoch 47:  98%|█████████▊| 95/97 [00:14<00:00,  6.64it/s, loss=2.59, v_num=0]
Epoch 47:  98%|█████████▊| 95/97 [00:14<00:00,  6.61it/s, loss=2.59, v_num=0]
Epoch 47:  99%|█████████▉| 96/97 [00:14<00:00,  6.64it/s, loss=2.59, v_num=0]
Epoch 47:  99%|█████████▉| 96/97 [00:14<00:00,  6.61it/s, loss=2.59, v_num=0]
Epoch 47: 100%|██████████| 97/97 [00:14<00:00,  6.65it/s, loss=2.59, v_num=0]
Epoch 47: 100%|██████████| 97/97 [00:14<00:00,  6.62it/s, loss=2.59, v_num=0]
Epoch 47: 100%|██████████| 97/97 [00:14<00:00,  6.62it/s, loss=2.59, v_num=0]
Epoch 47:   0%|          | 0/97 [00:00<?, ?it/s, loss=2.59, v_num=0]
Epoch 48:   0%|          | 0/97 [00:00<?, ?it/s, loss=2.59, v_num=0]
Epoch 48:   1%|          | 1/97 [00:01<02:12,  1.38s/it, loss=2.59, v_num=0]
Epoch 48:   1%|          | 1/97 [00:01<02:17,  1.43s/it, loss=2.6, v_num=0]
Epoch 48:   2%|▏         | 2/97 [00:01<01:11,  1.32it/s, loss=2.6, v_num=0]
Epoch 48:   2%|▏         | 2/97 [00:01<01:14,  1.27it/s, loss=2.6, v_num=0]
Epoch 48:   3%|▎         | 3/97 [00:01<00:51,  1.82it/s, loss=2.6, v_num=0]
Epoch 48:   3%|▎         | 3/97 [00:01<00:53,  1.76it/s, loss=2.6, v_num=0]
Epoch 48:   4%|▍         | 4/97 [00:01<00:41,  2.24it/s, loss=2.6, v_num=0]
Epoch 48:   4%|▍         | 4/97 [00:01<00:42,  2.17it/s, loss=2.59, v_num=0]
Epoch 48:   5%|▌         | 5/97 [00:01<00:35,  2.60it/s, loss=2.59, v_num=0]
Epoch 48:   5%|▌         | 5/97 [00:01<00:36,  2.52it/s, loss=2.6, v_num=0]
Epoch 48:   6%|▌         | 6/97 [00:02<00:31,  2.91it/s, loss=2.6, v_num=0]
Epoch 48:   6%|▌         | 6/97 [00:02<00:32,  2.84it/s, loss=2.61, v_num=0]
Epoch 48:   7%|▋         | 7/97 [00:02<00:28,  3.18it/s, loss=2.61, v_num=0]
Epoch 48:   7%|▋         | 7/97 [00:02<00:28,  3.10it/s, loss=2.61, v_num=0]
Epoch 48:   8%|▊         | 8/97 [00:02<00:25,  3.43it/s, loss=2.61, v_num=0]
Epoch 48:   8%|▊         | 8/97 [00:02<00:26,  3.35it/s, loss=2.6, v_num=0]
Epoch 48:   9%|▉         | 9/97 [00:02<00:24,  3.64it/s, loss=2.6, v_num=0]
Epoch 48:   9%|▉         | 9/97 [00:02<00:24,  3.56it/s, loss=2.6, v_num=0]
Epoch 48:  10%|█         | 10/97 [00:02<00:22,  3.83it/s, loss=2.6, v_num=0]
Epoch 48:  10%|█         | 10/97 [00:02<00:23,  3.75it/s, loss=2.6, v_num=0]
Epoch 48:  11%|█▏        | 11/97 [00:02<00:21,  4.00it/s, loss=2.6, v_num=0]
Epoch 48:  11%|█▏        | 11/97 [00:02<00:21,  3.92it/s, loss=2.61, v_num=0]
Epoch 48:  12%|█▏        | 12/97 [00:02<00:20,  4.16it/s, loss=2.61, v_num=0]
Epoch 48:  12%|█▏        | 12/97 [00:02<00:20,  4.08it/s, loss=2.61, v_num=0]
Epoch 48:  13%|█▎        | 13/97 [00:03<00:19,  4.30it/s, loss=2.61, v_num=0]
Epoch 48:  13%|█▎        | 13/97 [00:03<00:19,  4.22it/s, loss=2.62, v_num=0]
Epoch 48:  14%|█▍        | 14/97 [00:03<00:18,  4.43it/s, loss=2.62, v_num=0]
Epoch 48:  14%|█▍        | 14/97 [00:03<00:19,  4.36it/s, loss=2.62, v_num=0]
Epoch 48:  15%|█▌        | 15/97 [00:03<00:18,  4.55it/s, loss=2.62, v_num=0]
Epoch 48:  15%|█▌        | 15/97 [00:03<00:18,  4.48it/s, loss=2.61, v_num=0]
Epoch 48:  16%|█▋        | 16/97 [00:03<00:17,  4.67it/s, loss=2.61, v_num=0]
Epoch 48:  16%|█▋        | 16/97 [00:03<00:17,  4.59it/s, loss=2.61, v_num=0]
Epoch 48:  18%|█▊        | 17/97 [00:03<00:16,  4.76it/s, loss=2.61, v_num=0]
Epoch 48:  18%|█▊        | 17/97 [00:03<00:17,  4.69it/s, loss=2.61, v_num=0]
Epoch 48:  19%|█▊        | 18/97 [00:03<00:16,  4.87it/s, loss=2.61, v_num=0]
Epoch 48:  19%|█▊        | 18/97 [00:03<00:16,  4.79it/s, loss=2.61, v_num=0]
Epoch 48:  20%|█▉        | 19/97 [00:03<00:15,  4.95it/s, loss=2.61, v_num=0]
Epoch 48:  20%|█▉        | 19/97 [00:03<00:15,  4.88it/s, loss=2.61, v_num=0]
Epoch 48:  21%|██        | 20/97 [00:03<00:15,  5.04it/s, loss=2.61, v_num=0]
Epoch 48:  21%|██        | 20/97 [00:04<00:15,  4.96it/s, loss=2.61, v_num=0]
Epoch 48:  22%|██▏       | 21/97 [00:04<00:14,  5.11it/s, loss=2.61, v_num=0]
Epoch 48:  22%|██▏       | 21/97 [00:04<00:15,  5.04it/s, loss=2.61, v_num=0]
Epoch 48:  23%|██▎       | 22/97 [00:04<00:14,  5.18it/s, loss=2.61, v_num=0]
Epoch 48:  23%|██▎       | 22/97 [00:04<00:14,  5.11it/s, loss=2.61, v_num=0]
Epoch 48:  24%|██▎       | 23/97 [00:04<00:14,  5.24it/s, loss=2.61, v_num=0]
Epoch 48:  24%|██▎       | 23/97 [00:04<00:14,  5.18it/s, loss=2.61, v_num=0]
Epoch 48:  25%|██▍       | 24/97 [00:04<00:13,  5.31it/s, loss=2.61, v_num=0]
Epoch 48:  25%|██▍       | 24/97 [00:04<00:13,  5.24it/s, loss=2.61, v_num=0]
Epoch 48:  26%|██▌       | 25/97 [00:04<00:13,  5.37it/s, loss=2.61, v_num=0]
Epoch 48:  26%|██▌       | 25/97 [00:04<00:13,  5.30it/s, loss=2.6, v_num=0]
Epoch 48:  27%|██▋       | 26/97 [00:04<00:13,  5.42it/s, loss=2.6, v_num=0]
Epoch 48:  27%|██▋       | 26/97 [00:04<00:13,  5.36it/s, loss=2.6, v_num=0]
Epoch 48:  28%|██▊       | 27/97 [00:04<00:12,  5.47it/s, loss=2.6, v_num=0]
Epoch 48:  28%|██▊       | 27/97 [00:04<00:12,  5.41it/s, loss=2.6, v_num=0]
Epoch 48:  29%|██▉       | 28/97 [00:05<00:12,  5.52it/s, loss=2.6, v_num=0]
Epoch 48:  29%|██▉       | 28/97 [00:05<00:12,  5.47it/s, loss=2.6, v_num=0]
Epoch 48:  30%|██▉       | 29/97 [00:05<00:12,  5.57it/s, loss=2.6, v_num=0]
Epoch 48:  30%|██▉       | 29/97 [00:05<00:12,  5.51it/s, loss=2.59, v_num=0]
Epoch 48:  31%|███       | 30/97 [00:05<00:11,  5.62it/s, loss=2.59, v_num=0]
Epoch 48:  31%|███       | 30/97 [00:05<00:12,  5.56it/s, loss=2.59, v_num=0]
Epoch 48:  32%|███▏      | 31/97 [00:05<00:11,  5.66it/s, loss=2.59, v_num=0]
Epoch 48:  32%|███▏      | 31/97 [00:05<00:11,  5.60it/s, loss=2.59, v_num=0]
Epoch 48:  33%|███▎      | 32/97 [00:05<00:11,  5.70it/s, loss=2.59, v_num=0]
Epoch 48:  33%|███▎      | 32/97 [00:05<00:11,  5.64it/s, loss=2.59, v_num=0]
Epoch 48:  34%|███▍      | 33/97 [00:05<00:11,  5.74it/s, loss=2.59, v_num=0]
Epoch 48:  34%|███▍      | 33/97 [00:05<00:11,  5.68it/s, loss=2.58, v_num=0]
Epoch 48:  35%|███▌      | 34/97 [00:05<00:10,  5.77it/s, loss=2.58, v_num=0]
Epoch 48:  35%|███▌      | 34/97 [00:05<00:11,  5.72it/s, loss=2.58, v_num=0]
Epoch 48:  36%|███▌      | 35/97 [00:06<00:10,  5.81it/s, loss=2.58, v_num=0]
Epoch 48:  36%|███▌      | 35/97 [00:06<00:10,  5.76it/s, loss=2.59, v_num=0]
Epoch 48:  37%|███▋      | 36/97 [00:06<00:10,  5.84it/s, loss=2.59, v_num=0]
Epoch 48:  37%|███▋      | 36/97 [00:06<00:10,  5.79it/s, loss=2.59, v_num=0]
Epoch 48:  38%|███▊      | 37/97 [00:06<00:10,  5.87it/s, loss=2.59, v_num=0]
Epoch 48:  38%|███▊      | 37/97 [00:06<00:10,  5.82it/s, loss=2.6, v_num=0]
Epoch 48:  39%|███▉      | 38/97 [00:06<00:09,  5.91it/s, loss=2.6, v_num=0]
Epoch 48:  39%|███▉      | 38/97 [00:06<00:10,  5.86it/s, loss=2.6, v_num=0]
Epoch 48:  40%|████      | 39/97 [00:06<00:09,  5.93it/s, loss=2.6, v_num=0]
Epoch 48:  40%|████      | 39/97 [00:06<00:09,  5.89it/s, loss=2.6, v_num=0]
Epoch 48:  41%|████      | 40/97 [00:06<00:09,  5.96it/s, loss=2.6, v_num=0]
Epoch 48:  41%|████      | 40/97 [00:06<00:09,  5.91it/s, loss=2.6, v_num=0]
Epoch 48:  42%|████▏     | 41/97 [00:06<00:09,  5.99it/s, loss=2.6, v_num=0]
Epoch 48:  42%|████▏     | 41/97 [00:06<00:09,  5.94it/s, loss=2.6, v_num=0]
Epoch 48:  43%|████▎     | 42/97 [00:06<00:09,  6.01it/s, loss=2.6, v_num=0]
Epoch 48:  43%|████▎     | 42/97 [00:07<00:09,  5.97it/s, loss=2.6, v_num=0]
Epoch 48:  44%|████▍     | 43/97 [00:07<00:08,  6.04it/s, loss=2.6, v_num=0]
Epoch 48:  44%|████▍     | 43/97 [00:07<00:09,  5.99it/s, loss=2.58, v_num=0]
Epoch 48:  45%|████▌     | 44/97 [00:07<00:08,  6.06it/s, loss=2.58, v_num=0]
Epoch 48:  45%|████▌     | 44/97 [00:07<00:08,  6.02it/s, loss=2.58, v_num=0]
Epoch 48:  46%|████▋     | 45/97 [00:07<00:08,  6.09it/s, loss=2.58, v_num=0]
Epoch 48:  46%|████▋     | 45/97 [00:07<00:08,  6.04it/s, loss=2.59, v_num=0]
Epoch 48:  47%|████▋     | 46/97 [00:07<00:08,  6.11it/s, loss=2.59, v_num=0]
Epoch 48:  47%|████▋     | 46/97 [00:07<00:08,  6.06it/s, loss=2.59, v_num=0]
Epoch 48:  48%|████▊     | 47/97 [00:07<00:08,  6.13it/s, loss=2.59, v_num=0]
Epoch 48:  48%|████▊     | 47/97 [00:07<00:08,  6.08it/s, loss=2.59, v_num=0]
Epoch 48:  49%|████▉     | 48/97 [00:07<00:07,  6.15it/s, loss=2.59, v_num=0]
Epoch 48:  49%|████▉     | 48/97 [00:07<00:08,  6.10it/s, loss=2.59, v_num=0]
Epoch 48:  51%|█████     | 49/97 [00:07<00:07,  6.17it/s, loss=2.59, v_num=0]
Epoch 48:  51%|█████     | 49/97 [00:08<00:07,  6.12it/s, loss=2.6, v_num=0]
Epoch 48:  52%|█████▏    | 50/97 [00:08<00:07,  6.19it/s, loss=2.6, v_num=0]
Epoch 48:  52%|█████▏    | 50/97 [00:08<00:07,  6.14it/s, loss=2.6, v_num=0]
Epoch 48:  53%|█████▎    | 51/97 [00:08<00:07,  6.21it/s, loss=2.6, v_num=0]
Epoch 48:  53%|█████▎    | 51/97 [00:08<00:07,  6.16it/s, loss=2.6, v_num=0]
Epoch 48:  54%|█████▎    | 52/97 [00:08<00:07,  6.22it/s, loss=2.6, v_num=0]
Epoch 48:  54%|█████▎    | 52/97 [00:08<00:07,  6.18it/s, loss=2.59, v_num=0]
Epoch 48:  55%|█████▍    | 53/97 [00:08<00:07,  6.24it/s, loss=2.59, v_num=0]
Epoch 48:  55%|█████▍    | 53/97 [00:08<00:07,  6.20it/s, loss=2.6, v_num=0]
Epoch 48:  56%|█████▌    | 54/97 [00:08<00:06,  6.26it/s, loss=2.6, v_num=0]
Epoch 48:  56%|█████▌    | 54/97 [00:08<00:06,  6.22it/s, loss=2.6, v_num=0]
Epoch 48:  57%|█████▋    | 55/97 [00:08<00:06,  6.27it/s, loss=2.6, v_num=0]
Epoch 48:  57%|█████▋    | 55/97 [00:08<00:06,  6.23it/s, loss=2.6, v_num=0]
Epoch 48:  58%|█████▊    | 56/97 [00:08<00:06,  6.29it/s, loss=2.6, v_num=0]
Epoch 48:  58%|█████▊    | 56/97 [00:08<00:06,  6.25it/s, loss=2.6, v_num=0]
Epoch 48:  59%|█████▉    | 57/97 [00:09<00:06,  6.30it/s, loss=2.6, v_num=0]
Epoch 48:  59%|█████▉    | 57/97 [00:09<00:06,  6.27it/s, loss=2.59, v_num=0]
Epoch 48:  60%|█████▉    | 58/97 [00:09<00:06,  6.32it/s, loss=2.59, v_num=0]
Epoch 48:  60%|█████▉    | 58/97 [00:09<00:06,  6.28it/s, loss=2.59, v_num=0]
Epoch 48:  61%|██████    | 59/97 [00:09<00:05,  6.33it/s, loss=2.59, v_num=0]
Epoch 48:  61%|██████    | 59/97 [00:09<00:06,  6.30it/s, loss=2.59, v_num=0]
Epoch 48:  62%|██████▏   | 60/97 [00:09<00:05,  6.35it/s, loss=2.59, v_num=0]
Epoch 48:  62%|██████▏   | 60/97 [00:09<00:05,  6.31it/s, loss=2.59, v_num=0]
Epoch 48:  63%|██████▎   | 61/97 [00:09<00:05,  6.36it/s, loss=2.59, v_num=0]
Epoch 48:  63%|██████▎   | 61/97 [00:09<00:05,  6.33it/s, loss=2.59, v_num=0]
Epoch 48:  64%|██████▍   | 62/97 [00:09<00:05,  6.38it/s, loss=2.59, v_num=0]
Epoch 48:  64%|██████▍   | 62/97 [00:09<00:05,  6.34it/s, loss=2.6, v_num=0]
Epoch 48:  65%|██████▍   | 63/97 [00:09<00:05,  6.39it/s, loss=2.6, v_num=0]
Epoch 48:  65%|██████▍   | 63/97 [00:09<00:05,  6.35it/s, loss=2.6, v_num=0]
Epoch 48:  66%|██████▌   | 64/97 [00:10<00:05,  6.40it/s, loss=2.6, v_num=0]
Epoch 48:  66%|██████▌   | 64/97 [00:10<00:05,  6.37it/s, loss=2.6, v_num=0]
Epoch 48:  67%|██████▋   | 65/97 [00:10<00:04,  6.41it/s, loss=2.6, v_num=0]
Epoch 48:  67%|██████▋   | 65/97 [00:10<00:05,  6.38it/s, loss=2.59, v_num=0]
Epoch 48:  68%|██████▊   | 66/97 [00:10<00:04,  6.42it/s, loss=2.59, v_num=0]
Epoch 48:  68%|██████▊   | 66/97 [00:10<00:04,  6.39it/s, loss=2.59, v_num=0]
Epoch 48:  69%|██████▉   | 67/97 [00:10<00:04,  6.44it/s, loss=2.59, v_num=0]
Epoch 48:  69%|██████▉   | 67/97 [00:10<00:04,  6.40it/s, loss=2.6, v_num=0]
Epoch 48:  70%|███████   | 68/97 [00:10<00:04,  6.45it/s, loss=2.6, v_num=0]
Epoch 48:  70%|███████   | 68/97 [00:10<00:04,  6.41it/s, loss=2.6, v_num=0]
Epoch 48:  71%|███████   | 69/97 [00:10<00:04,  6.46it/s, loss=2.6, v_num=0]
Epoch 48:  71%|███████   | 69/97 [00:10<00:04,  6.42it/s, loss=2.59, v_num=0]
Epoch 48:  72%|███████▏  | 70/97 [00:10<00:04,  6.47it/s, loss=2.59, v_num=0]
Epoch 48:  72%|███████▏  | 70/97 [00:10<00:04,  6.43it/s, loss=2.59, v_num=0]
Epoch 48:  73%|███████▎  | 71/97 [00:10<00:04,  6.48it/s, loss=2.59, v_num=0]
Epoch 48:  73%|███████▎  | 71/97 [00:11<00:04,  6.45it/s, loss=2.59, v_num=0]
Epoch 48:  74%|███████▍  | 72/97 [00:11<00:03,  6.49it/s, loss=2.59, v_num=0]
Epoch 48:  74%|███████▍  | 72/97 [00:11<00:03,  6.46it/s, loss=2.59, v_num=0]
Epoch 48:  75%|███████▌  | 73/97 [00:11<00:03,  6.50it/s, loss=2.59, v_num=0]
Epoch 48:  75%|███████▌  | 73/97 [00:11<00:03,  6.47it/s, loss=2.58, v_num=0]
Epoch 48:  76%|███████▋  | 74/97 [00:11<00:03,  6.51it/s, loss=2.58, v_num=0]
Epoch 48:  76%|███████▋  | 74/97 [00:11<00:03,  6.48it/s, loss=2.58, v_num=0]
Epoch 48:  77%|███████▋  | 75/97 [00:11<00:03,  6.52it/s, loss=2.58, v_num=0]
Epoch 48:  77%|███████▋  | 75/97 [00:11<00:03,  6.49it/s, loss=2.59, v_num=0]
Epoch 48:  78%|███████▊  | 76/97 [00:11<00:03,  6.53it/s, loss=2.59, v_num=0]
Epoch 48:  78%|███████▊  | 76/97 [00:11<00:03,  6.49it/s, loss=2.58, v_num=0]
Epoch 48:  79%|███████▉  | 77/97 [00:11<00:03,  6.53it/s, loss=2.58, v_num=0]
Epoch 48:  79%|███████▉  | 77/97 [00:11<00:03,  6.50it/s, loss=2.59, v_num=0]
Epoch 48:  80%|████████  | 78/97 [00:11<00:02,  6.54it/s, loss=2.59, v_num=0]
Epoch 48:  80%|████████  | 78/97 [00:11<00:02,  6.51it/s, loss=2.6, v_num=0]
Epoch 48:  81%|████████▏ | 79/97 [00:12<00:02,  6.55it/s, loss=2.6, v_num=0]
Epoch 48:  81%|████████▏ | 79/97 [00:12<00:02,  6.52it/s, loss=2.6, v_num=0]
Epoch 48:  82%|████████▏ | 80/97 [00:12<00:02,  6.56it/s, loss=2.6, v_num=0]
Epoch 48:  82%|████████▏ | 80/97 [00:12<00:02,  6.53it/s, loss=2.59, v_num=0]
Epoch 48:  84%|████████▎ | 81/97 [00:12<00:02,  6.57it/s, loss=2.59, v_num=0]
Epoch 48:  84%|████████▎ | 81/97 [00:12<00:02,  6.54it/s, loss=2.59, v_num=0]
Epoch 48:  85%|████████▍ | 82/97 [00:12<00:02,  6.58it/s, loss=2.59, v_num=0]
Epoch 48:  85%|████████▍ | 82/97 [00:12<00:02,  6.55it/s, loss=2.59, v_num=0]
Epoch 48:  86%|████████▌ | 83/97 [00:12<00:02,  6.58it/s, loss=2.59, v_num=0]
Epoch 48:  86%|████████▌ | 83/97 [00:12<00:02,  6.55it/s, loss=2.6, v_num=0]
Epoch 48:  87%|████████▋ | 84/97 [00:12<00:01,  6.59it/s, loss=2.6, v_num=0]
Epoch 48:  87%|████████▋ | 84/97 [00:12<00:01,  6.56it/s, loss=2.6, v_num=0]
Epoch 48:  88%|████████▊ | 85/97 [00:12<00:01,  6.60it/s, loss=2.6, v_num=0]
Epoch 48:  88%|████████▊ | 85/97 [00:12<00:01,  6.57it/s, loss=2.59, v_num=0]
Epoch 48:  89%|████████▊ | 86/97 [00:13<00:01,  6.61it/s, loss=2.59, v_num=0]
Epoch 48:  89%|████████▊ | 86/97 [00:13<00:01,  6.58it/s, loss=2.59, v_num=0]
Epoch 48:  90%|████████▉ | 87/97 [00:13<00:01,  6.61it/s, loss=2.59, v_num=0]
Epoch 48:  90%|████████▉ | 87/97 [00:13<00:01,  6.59it/s, loss=2.59, v_num=0]
Epoch 48:  91%|█████████ | 88/97 [00:13<00:01,  6.62it/s, loss=2.59, v_num=0]
Epoch 48:  91%|█████████ | 88/97 [00:13<00:01,  6.59it/s, loss=2.58, v_num=0]
Epoch 48:  92%|█████████▏| 89/97 [00:13<00:01,  6.63it/s, loss=2.58, v_num=0]
Epoch 48:  92%|█████████▏| 89/97 [00:13<00:01,  6.60it/s, loss=2.59, v_num=0]
Epoch 48:  93%|█████████▎| 90/97 [00:13<00:01,  6.63it/s, loss=2.59, v_num=0]
Epoch 48:  93%|█████████▎| 90/97 [00:13<00:01,  6.61it/s, loss=2.59, v_num=0]
Epoch 48:  94%|█████████▍| 91/97 [00:13<00:00,  6.64it/s, loss=2.59, v_num=0]
Epoch 48:  94%|█████████▍| 91/97 [00:13<00:00,  6.61it/s, loss=2.59, v_num=0]
Epoch 48:  95%|█████████▍| 92/97 [00:13<00:00,  6.65it/s, loss=2.59, v_num=0]
Epoch 48:  95%|█████████▍| 92/97 [00:13<00:00,  6.62it/s, loss=2.59, v_num=0]
Epoch 48:  96%|█████████▌| 93/97 [00:13<00:00,  6.65it/s, loss=2.59, v_num=0]
Epoch 48:  96%|█████████▌| 93/97 [00:14<00:00,  6.63it/s, loss=2.59, v_num=0]
Epoch 48:  97%|█████████▋| 94/97 [00:14<00:00,  6.66it/s, loss=2.59, v_num=0]
Epoch 48:  97%|█████████▋| 94/97 [00:14<00:00,  6.63it/s, loss=2.59, v_num=0]
Epoch 48:  98%|█████████▊| 95/97 [00:14<00:00,  6.67it/s, loss=2.59, v_num=0]
Epoch 48:  98%|█████████▊| 95/97 [00:14<00:00,  6.64it/s, loss=2.58, v_num=0]
Epoch 48:  99%|█████████▉| 96/97 [00:14<00:00,  6.67it/s, loss=2.58, v_num=0]
Epoch 48:  99%|█████████▉| 96/97 [00:14<00:00,  6.65it/s, loss=2.58, v_num=0]
Epoch 48: 100%|██████████| 97/97 [00:14<00:00,  6.68it/s, loss=2.58, v_num=0]
Epoch 48: 100%|██████████| 97/97 [00:14<00:00,  6.65it/s, loss=2.58, v_num=0]
Epoch 48: 100%|██████████| 97/97 [00:14<00:00,  6.65it/s, loss=2.58, v_num=0]
Epoch 48:   0%|          | 0/97 [00:00<?, ?it/s, loss=2.58, v_num=0]
Epoch 49:   0%|          | 0/97 [00:00<?, ?it/s, loss=2.58, v_num=0]
Epoch 49:   1%|          | 1/97 [00:01<02:12,  1.38s/it, loss=2.58, v_num=0]
Epoch 49:   1%|          | 1/97 [00:01<02:17,  1.44s/it, loss=2.58, v_num=0]
Epoch 49:   2%|▏         | 2/97 [00:01<01:12,  1.31it/s, loss=2.58, v_num=0]
Epoch 49:   2%|▏         | 2/97 [00:01<01:15,  1.26it/s, loss=2.58, v_num=0]
Epoch 49:   3%|▎         | 3/97 [00:01<00:51,  1.81it/s, loss=2.58, v_num=0]
Epoch 49:   3%|▎         | 3/97 [00:01<00:53,  1.75it/s, loss=2.58, v_num=0]
Epoch 49:   4%|▍         | 4/97 [00:01<00:41,  2.22it/s, loss=2.58, v_num=0]
Epoch 49:   4%|▍         | 4/97 [00:01<00:43,  2.16it/s, loss=2.59, v_num=0]
Epoch 49:   5%|▌         | 5/97 [00:01<00:35,  2.59it/s, loss=2.59, v_num=0]
Epoch 49:   5%|▌         | 5/97 [00:01<00:36,  2.51it/s, loss=2.59, v_num=0]
Epoch 49:   6%|▌         | 6/97 [00:02<00:31,  2.90it/s, loss=2.59, v_num=0]
Epoch 49:   6%|▌         | 6/97 [00:02<00:32,  2.82it/s, loss=2.58, v_num=0]
Epoch 49:   7%|▋         | 7/97 [00:02<00:28,  3.18it/s, loss=2.58, v_num=0]
Epoch 49:   7%|▋         | 7/97 [00:02<00:29,  3.10it/s, loss=2.59, v_num=0]
Epoch 49:   8%|▊         | 8/97 [00:02<00:26,  3.42it/s, loss=2.59, v_num=0]
Epoch 49:   8%|▊         | 8/97 [00:02<00:26,  3.34it/s, loss=2.6, v_num=0]
Epoch 49:   9%|▉         | 9/97 [00:02<00:24,  3.63it/s, loss=2.6, v_num=0]
Epoch 49:   9%|▉         | 9/97 [00:02<00:24,  3.55it/s, loss=2.59, v_num=0]
Epoch 49:  10%|█         | 10/97 [00:02<00:22,  3.82it/s, loss=2.59, v_num=0]
Epoch 49:  10%|█         | 10/97 [00:02<00:23,  3.74it/s, loss=2.59, v_num=0]
Epoch 49:  11%|█▏        | 11/97 [00:02<00:21,  4.00it/s, loss=2.59, v_num=0]
Epoch 49:  11%|█▏        | 11/97 [00:02<00:21,  3.91it/s, loss=2.59, v_num=0]
Epoch 49:  12%|█▏        | 12/97 [00:02<00:20,  4.15it/s, loss=2.59, v_num=0]
Epoch 49:  12%|█▏        | 12/97 [00:02<00:20,  4.07it/s, loss=2.59, v_num=0]
Epoch 49:  13%|█▎        | 13/97 [00:03<00:19,  4.30it/s, loss=2.59, v_num=0]
Epoch 49:  13%|█▎        | 13/97 [00:03<00:19,  4.22it/s, loss=2.58, v_num=0]
Epoch 49:  14%|█▍        | 14/97 [00:03<00:18,  4.43it/s, loss=2.58, v_num=0]
Epoch 49:  14%|█▍        | 14/97 [00:03<00:19,  4.35it/s, loss=2.59, v_num=0]
Epoch 49:  15%|█▌        | 15/97 [00:03<00:18,  4.55it/s, loss=2.59, v_num=0]
Epoch 49:  15%|█▌        | 15/97 [00:03<00:18,  4.47it/s, loss=2.58, v_num=0]
Epoch 49:  16%|█▋        | 16/97 [00:03<00:17,  4.66it/s, loss=2.58, v_num=0]
Epoch 49:  16%|█▋        | 16/97 [00:03<00:17,  4.58it/s, loss=2.58, v_num=0]
Epoch 49:  18%|█▊        | 17/97 [00:03<00:16,  4.76it/s, loss=2.58, v_num=0]
Epoch 49:  18%|█▊        | 17/97 [00:03<00:17,  4.69it/s, loss=2.57, v_num=0]
Epoch 49:  19%|█▊        | 18/97 [00:03<00:16,  4.85it/s, loss=2.57, v_num=0]
Epoch 49:  19%|█▊        | 18/97 [00:03<00:16,  4.78it/s, loss=2.57, v_num=0]
Epoch 49:  20%|█▉        | 19/97 [00:03<00:15,  4.94it/s, loss=2.57, v_num=0]
Epoch 49:  20%|█▉        | 19/97 [00:03<00:16,  4.87it/s, loss=2.57, v_num=0]
Epoch 49:  21%|██        | 20/97 [00:03<00:15,  5.02it/s, loss=2.57, v_num=0]
Epoch 49:  21%|██        | 20/97 [00:04<00:15,  4.95it/s, loss=2.57, v_num=0]
Epoch 49:  22%|██▏       | 21/97 [00:04<00:14,  5.10it/s, loss=2.57, v_num=0]
Epoch 49:  22%|██▏       | 21/97 [00:04<00:15,  5.03it/s, loss=2.56, v_num=0]
Epoch 49:  23%|██▎       | 22/97 [00:04<00:14,  5.17it/s, loss=2.56, v_num=0]
Epoch 49:  23%|██▎       | 22/97 [00:04<00:14,  5.10it/s, loss=2.56, v_num=0]
Epoch 49:  24%|██▎       | 23/97 [00:04<00:14,  5.24it/s, loss=2.56, v_num=0]
Epoch 49:  24%|██▎       | 23/97 [00:04<00:14,  5.17it/s, loss=2.56, v_num=0]
Epoch 49:  25%|██▍       | 24/97 [00:04<00:13,  5.30it/s, loss=2.56, v_num=0]
Epoch 49:  25%|██▍       | 24/97 [00:04<00:13,  5.24it/s, loss=2.56, v_num=0]
Epoch 49:  26%|██▌       | 25/97 [00:04<00:13,  5.36it/s, loss=2.56, v_num=0]
Epoch 49:  26%|██▌       | 25/97 [00:04<00:13,  5.30it/s, loss=2.56, v_num=0]
Epoch 49:  27%|██▋       | 26/97 [00:04<00:13,  5.41it/s, loss=2.56, v_num=0]
Epoch 49:  27%|██▋       | 26/97 [00:04<00:13,  5.35it/s, loss=2.56, v_num=0]
Epoch 49:  28%|██▊       | 27/97 [00:04<00:12,  5.47it/s, loss=2.56, v_num=0]
Epoch 49:  28%|██▊       | 27/97 [00:04<00:12,  5.41it/s, loss=2.56, v_num=0]
Epoch 49:  29%|██▉       | 28/97 [00:05<00:12,  5.52it/s, loss=2.56, v_num=0]
Epoch 49:  29%|██▉       | 28/97 [00:05<00:12,  5.46it/s, loss=2.55, v_num=0]
Epoch 49:  30%|██▉       | 29/97 [00:05<00:12,  5.56it/s, loss=2.55, v_num=0]
Epoch 49:  30%|██▉       | 29/97 [00:05<00:12,  5.50it/s, loss=2.56, v_num=0]
Epoch 49:  31%|███       | 30/97 [00:05<00:11,  5.61it/s, loss=2.56, v_num=0]
Epoch 49:  31%|███       | 30/97 [00:05<00:12,  5.55it/s, loss=2.55, v_num=0]
Epoch 49:  32%|███▏      | 31/97 [00:05<00:11,  5.65it/s, loss=2.55, v_num=0]
Epoch 49:  32%|███▏      | 31/97 [00:05<00:11,  5.59it/s, loss=2.55, v_num=0]
Epoch 49:  33%|███▎      | 32/97 [00:05<00:11,  5.69it/s, loss=2.55, v_num=0]
Epoch 49:  33%|███▎      | 32/97 [00:05<00:11,  5.63it/s, loss=2.55, v_num=0]
Epoch 49:  34%|███▍      | 33/97 [00:05<00:11,  5.73it/s, loss=2.55, v_num=0]
Epoch 49:  34%|███▍      | 33/97 [00:05<00:11,  5.67it/s, loss=2.55, v_num=0]
Epoch 49:  35%|███▌      | 34/97 [00:05<00:10,  5.77it/s, loss=2.55, v_num=0]
Epoch 49:  35%|███▌      | 34/97 [00:05<00:11,  5.71it/s, loss=2.55, v_num=0]
Epoch 49:  36%|███▌      | 35/97 [00:06<00:10,  5.80it/s, loss=2.55, v_num=0]
Epoch 49:  36%|███▌      | 35/97 [00:06<00:10,  5.75it/s, loss=2.55, v_num=0]
Epoch 49:  37%|███▋      | 36/97 [00:06<00:10,  5.84it/s, loss=2.55, v_num=0]
Epoch 49:  37%|███▋      | 36/97 [00:06<00:10,  5.78it/s, loss=2.55, v_num=0]
Epoch 49:  38%|███▊      | 37/97 [00:06<00:10,  5.87it/s, loss=2.55, v_num=0]
Epoch 49:  38%|███▊      | 37/97 [00:06<00:10,  5.81it/s, loss=2.55, v_num=0]
Epoch 49:  39%|███▉      | 38/97 [00:06<00:10,  5.90it/s, loss=2.55, v_num=0]
Epoch 49:  39%|███▉      | 38/97 [00:06<00:10,  5.85it/s, loss=2.56, v_num=0]
Epoch 49:  40%|████      | 39/97 [00:06<00:09,  5.93it/s, loss=2.56, v_num=0]
Epoch 49:  40%|████      | 39/97 [00:06<00:09,  5.88it/s, loss=2.56, v_num=0]
Epoch 49:  41%|████      | 40/97 [00:06<00:09,  5.95it/s, loss=2.56, v_num=0]
Epoch 49:  41%|████      | 40/97 [00:06<00:09,  5.90it/s, loss=2.56, v_num=0]
Epoch 49:  42%|████▏     | 41/97 [00:06<00:09,  5.98it/s, loss=2.56, v_num=0]
Epoch 49:  42%|████▏     | 41/97 [00:06<00:09,  5.93it/s, loss=2.56, v_num=0]
Epoch 49:  43%|████▎     | 42/97 [00:06<00:09,  6.00it/s, loss=2.56, v_num=0]
Epoch 49:  43%|████▎     | 42/97 [00:07<00:09,  5.95it/s, loss=2.57, v_num=0]
Epoch 49:  44%|████▍     | 43/97 [00:07<00:08,  6.02it/s, loss=2.57, v_num=0]
Epoch 49:  44%|████▍     | 43/97 [00:07<00:09,  5.98it/s, loss=2.56, v_num=0]
Epoch 49:  45%|████▌     | 44/97 [00:07<00:08,  6.05it/s, loss=2.56, v_num=0]
Epoch 49:  45%|████▌     | 44/97 [00:07<00:08,  6.00it/s, loss=2.55, v_num=0]
Epoch 49:  46%|████▋     | 45/97 [00:07<00:08,  6.07it/s, loss=2.55, v_num=0]
Epoch 49:  46%|████▋     | 45/97 [00:07<00:08,  6.02it/s, loss=2.55, v_num=0]
Epoch 49:  47%|████▋     | 46/97 [00:07<00:08,  6.09it/s, loss=2.55, v_num=0]
Epoch 49:  47%|████▋     | 46/97 [00:07<00:08,  6.04it/s, loss=2.55, v_num=0]
Epoch 49:  48%|████▊     | 47/97 [00:07<00:08,  6.11it/s, loss=2.55, v_num=0]
Epoch 49:  48%|████▊     | 47/97 [00:07<00:08,  6.07it/s, loss=2.55, v_num=0]
Epoch 49:  49%|████▉     | 48/97 [00:07<00:07,  6.13it/s, loss=2.55, v_num=0]
Epoch 49:  49%|████▉     | 48/97 [00:07<00:08,  6.09it/s, loss=2.56, v_num=0]
Epoch 49:  51%|█████     | 49/97 [00:07<00:07,  6.15it/s, loss=2.56, v_num=0]
Epoch 49:  51%|█████     | 49/97 [00:08<00:07,  6.11it/s, loss=2.56, v_num=0]
Epoch 49:  52%|█████▏    | 50/97 [00:08<00:07,  6.17it/s, loss=2.56, v_num=0]
Epoch 49:  52%|█████▏    | 50/97 [00:08<00:07,  6.13it/s, loss=2.56, v_num=0]
Epoch 49:  53%|█████▎    | 51/97 [00:08<00:07,  6.18it/s, loss=2.56, v_num=0]
Epoch 49:  53%|█████▎    | 51/97 [00:08<00:07,  6.14it/s, loss=2.56, v_num=0]
Epoch 49:  54%|█████▎    | 52/97 [00:08<00:07,  6.20it/s, loss=2.56, v_num=0]
Epoch 49:  54%|█████▎    | 52/97 [00:08<00:07,  6.16it/s, loss=2.56, v_num=0]
Epoch 49:  55%|█████▍    | 53/97 [00:08<00:07,  6.22it/s, loss=2.56, v_num=0]
Epoch 49:  55%|█████▍    | 53/97 [00:08<00:07,  6.18it/s, loss=2.56, v_num=0]
Epoch 49:  56%|█████▌    | 54/97 [00:08<00:06,  6.23it/s, loss=2.56, v_num=0]
Epoch 49:  56%|█████▌    | 54/97 [00:08<00:06,  6.19it/s, loss=2.56, v_num=0]
Epoch 49:  57%|█████▋    | 55/97 [00:08<00:06,  6.25it/s, loss=2.56, v_num=0]
Epoch 49:  57%|█████▋    | 55/97 [00:08<00:06,  6.21it/s, loss=2.57, v_num=0]
Epoch 49:  58%|█████▊    | 56/97 [00:08<00:06,  6.27it/s, loss=2.57, v_num=0]
Epoch 49:  58%|█████▊    | 56/97 [00:08<00:06,  6.22it/s, loss=2.57, v_num=0]
Epoch 49:  59%|█████▉    | 57/97 [00:09<00:06,  6.28it/s, loss=2.57, v_num=0]
Epoch 49:  59%|█████▉    | 57/97 [00:09<00:06,  6.24it/s, loss=2.58, v_num=0]
Epoch 49:  60%|█████▉    | 58/97 [00:09<00:06,  6.30it/s, loss=2.58, v_num=0]
Epoch 49:  60%|█████▉    | 58/97 [00:09<00:06,  6.26it/s, loss=2.57, v_num=0]
Epoch 49:  61%|██████    | 59/97 [00:09<00:06,  6.31it/s, loss=2.57, v_num=0]
Epoch 49:  61%|██████    | 59/97 [00:09<00:06,  6.27it/s, loss=2.58, v_num=0]
Epoch 49:  62%|██████▏   | 60/97 [00:09<00:05,  6.33it/s, loss=2.58, v_num=0]
Epoch 49:  62%|██████▏   | 60/97 [00:09<00:05,  6.29it/s, loss=2.57, v_num=0]
Epoch 49:  63%|██████▎   | 61/97 [00:09<00:05,  6.34it/s, loss=2.57, v_num=0]
Epoch 49:  63%|██████▎   | 61/97 [00:09<00:05,  6.30it/s, loss=2.57, v_num=0]
Epoch 49:  64%|██████▍   | 62/97 [00:09<00:05,  6.35it/s, loss=2.57, v_num=0]
Epoch 49:  64%|██████▍   | 62/97 [00:09<00:05,  6.31it/s, loss=2.57, v_num=0]
Epoch 49:  65%|██████▍   | 63/97 [00:09<00:05,  6.37it/s, loss=2.57, v_num=0]
Epoch 49:  65%|██████▍   | 63/97 [00:09<00:05,  6.33it/s, loss=2.57, v_num=0]
Epoch 49:  66%|██████▌   | 64/97 [00:10<00:05,  6.38it/s, loss=2.57, v_num=0]
Epoch 49:  66%|██████▌   | 64/97 [00:10<00:05,  6.34it/s, loss=2.58, v_num=0]
Epoch 49:  67%|██████▋   | 65/97 [00:10<00:05,  6.39it/s, loss=2.58, v_num=0]
Epoch 49:  67%|██████▋   | 65/97 [00:10<00:05,  6.35it/s, loss=2.58, v_num=0]
Epoch 49:  68%|██████▊   | 66/97 [00:10<00:04,  6.40it/s, loss=2.58, v_num=0]
Epoch 49:  68%|██████▊   | 66/97 [00:10<00:04,  6.36it/s, loss=2.57, v_num=0]
Epoch 49:  69%|██████▉   | 67/97 [00:10<00:04,  6.41it/s, loss=2.57, v_num=0]
Epoch 49:  69%|██████▉   | 67/97 [00:10<00:04,  6.38it/s, loss=2.57, v_num=0]
Epoch 49:  70%|███████   | 68/97 [00:10<00:04,  6.42it/s, loss=2.57, v_num=0]
Epoch 49:  70%|███████   | 68/97 [00:10<00:04,  6.39it/s, loss=2.57, v_num=0]
Epoch 49:  71%|███████   | 69/97 [00:10<00:04,  6.43it/s, loss=2.57, v_num=0]
Epoch 49:  71%|███████   | 69/97 [00:10<00:04,  6.40it/s, loss=2.58, v_num=0]
Epoch 49:  72%|███████▏  | 70/97 [00:10<00:04,  6.45it/s, loss=2.58, v_num=0]
Epoch 49:  72%|███████▏  | 70/97 [00:10<00:04,  6.41it/s, loss=2.58, v_num=0]
Epoch 49:  73%|███████▎  | 71/97 [00:11<00:04,  6.45it/s, loss=2.58, v_num=0]
Epoch 49:  73%|███████▎  | 71/97 [00:11<00:04,  6.42it/s, loss=2.58, v_num=0]
Epoch 49:  74%|███████▍  | 72/97 [00:11<00:03,  6.47it/s, loss=2.58, v_num=0]
Epoch 49:  74%|███████▍  | 72/97 [00:11<00:03,  6.43it/s, loss=2.58, v_num=0]
Epoch 49:  75%|███████▌  | 73/97 [00:11<00:03,  6.48it/s, loss=2.58, v_num=0]
Epoch 49:  75%|███████▌  | 73/97 [00:11<00:03,  6.44it/s, loss=2.58, v_num=0]
Epoch 49:  76%|███████▋  | 74/97 [00:11<00:03,  6.49it/s, loss=2.58, v_num=0]
Epoch 49:  76%|███████▋  | 74/97 [00:11<00:03,  6.45it/s, loss=2.58, v_num=0]
Epoch 49:  77%|███████▋  | 75/97 [00:11<00:03,  6.49it/s, loss=2.58, v_num=0]
Epoch 49:  77%|███████▋  | 75/97 [00:11<00:03,  6.46it/s, loss=2.57, v_num=0]
Epoch 49:  78%|███████▊  | 76/97 [00:11<00:03,  6.50it/s, loss=2.57, v_num=0]
Epoch 49:  78%|███████▊  | 76/97 [00:11<00:03,  6.47it/s, loss=2.58, v_num=0]
Epoch 49:  79%|███████▉  | 77/97 [00:11<00:03,  6.51it/s, loss=2.58, v_num=0]
Epoch 49:  79%|███████▉  | 77/97 [00:11<00:03,  6.48it/s, loss=2.57, v_num=0]
Epoch 49:  80%|████████  | 78/97 [00:11<00:02,  6.52it/s, loss=2.57, v_num=0]
Epoch 49:  80%|████████  | 78/97 [00:12<00:02,  6.49it/s, loss=2.57, v_num=0]
Epoch 49:  81%|████████▏ | 79/97 [00:12<00:02,  6.53it/s, loss=2.57, v_num=0]
Epoch 49:  81%|████████▏ | 79/97 [00:12<00:02,  6.50it/s, loss=2.57, v_num=0]
Epoch 49:  82%|████████▏ | 80/97 [00:12<00:02,  6.54it/s, loss=2.57, v_num=0]
Epoch 49:  82%|████████▏ | 80/97 [00:12<00:02,  6.51it/s, loss=2.57, v_num=0]
Epoch 49:  84%|████████▎ | 81/97 [00:12<00:02,  6.55it/s, loss=2.57, v_num=0]
Epoch 49:  84%|████████▎ | 81/97 [00:12<00:02,  6.52it/s, loss=2.57, v_num=0]
Epoch 49:  85%|████████▍ | 82/97 [00:12<00:02,  6.55it/s, loss=2.57, v_num=0]
Epoch 49:  85%|████████▍ | 82/97 [00:12<00:02,  6.52it/s, loss=2.57, v_num=0]
Epoch 49:  86%|████████▌ | 83/97 [00:12<00:02,  6.56it/s, loss=2.57, v_num=0]
Epoch 49:  86%|████████▌ | 83/97 [00:12<00:02,  6.53it/s, loss=2.57, v_num=0]
Epoch 49:  87%|████████▋ | 84/97 [00:12<00:01,  6.57it/s, loss=2.57, v_num=0]
Epoch 49:  87%|████████▋ | 84/97 [00:12<00:01,  6.54it/s, loss=2.57, v_num=0]
Epoch 49:  88%|████████▊ | 85/97 [00:12<00:01,  6.58it/s, loss=2.57, v_num=0]
Epoch 49:  88%|████████▊ | 85/97 [00:12<00:01,  6.55it/s, loss=2.57, v_num=0]
Epoch 49:  89%|████████▊ | 86/97 [00:13<00:01,  6.58it/s, loss=2.57, v_num=0]
Epoch 49:  89%|████████▊ | 86/97 [00:13<00:01,  6.56it/s, loss=2.58, v_num=0]
Epoch 49:  90%|████████▉ | 87/97 [00:13<00:01,  6.59it/s, loss=2.58, v_num=0]
Epoch 49:  90%|████████▉ | 87/97 [00:13<00:01,  6.57it/s, loss=2.57, v_num=0]
Epoch 49:  91%|█████████ | 88/97 [00:13<00:01,  6.60it/s, loss=2.57, v_num=0]
Epoch 49:  91%|█████████ | 88/97 [00:13<00:01,  6.57it/s, loss=2.56, v_num=0]
Epoch 49:  92%|█████████▏| 89/97 [00:13<00:01,  6.61it/s, loss=2.56, v_num=0]
Epoch 49:  92%|█████████▏| 89/97 [00:13<00:01,  6.58it/s, loss=2.56, v_num=0]
Epoch 49:  93%|█████████▎| 90/97 [00:13<00:01,  6.61it/s, loss=2.56, v_num=0]
Epoch 49:  93%|█████████▎| 90/97 [00:13<00:01,  6.59it/s, loss=2.56, v_num=0]
Epoch 49:  94%|█████████▍| 91/97 [00:13<00:00,  6.62it/s, loss=2.56, v_num=0]
Epoch 49:  94%|█████████▍| 91/97 [00:13<00:00,  6.59it/s, loss=2.56, v_num=0]
Epoch 49:  95%|█████████▍| 92/97 [00:13<00:00,  6.63it/s, loss=2.56, v_num=0]
Epoch 49:  95%|█████████▍| 92/97 [00:13<00:00,  6.60it/s, loss=2.56, v_num=0]
Epoch 49:  96%|█████████▌| 93/97 [00:14<00:00,  6.64it/s, loss=2.56, v_num=0]
Epoch 49:  96%|█████████▌| 93/97 [00:14<00:00,  6.61it/s, loss=2.56, v_num=0]
Epoch 49:  97%|█████████▋| 94/97 [00:14<00:00,  6.64it/s, loss=2.56, v_num=0]
Epoch 49:  97%|█████████▋| 94/97 [00:14<00:00,  6.62it/s, loss=2.55, v_num=0]
Epoch 49:  98%|█████████▊| 95/97 [00:14<00:00,  6.65it/s, loss=2.55, v_num=0]
Epoch 49:  98%|█████████▊| 95/97 [00:14<00:00,  6.62it/s, loss=2.56, v_num=0]
Epoch 49:  99%|█████████▉| 96/97 [00:14<00:00,  6.65it/s, loss=2.56, v_num=0]
Epoch 49:  99%|█████████▉| 96/97 [00:14<00:00,  6.63it/s, loss=2.54, v_num=0]
Epoch 49: 100%|██████████| 97/97 [00:14<00:00,  6.66it/s, loss=2.54, v_num=0]
Epoch 49: 100%|██████████| 97/97 [00:14<00:00,  6.63it/s, loss=2.54, v_num=0]
Epoch 49: 100%|██████████| 97/97 [00:14<00:00,  6.63it/s, loss=2.54, v_num=0]
Epoch 49:   0%|          | 0/97 [00:00<?, ?it/s, loss=2.54, v_num=0]
Epoch 50:   0%|          | 0/97 [00:00<?, ?it/s, loss=2.54, v_num=0]
Epoch 50:   1%|          | 1/97 [00:01<02:11,  1.37s/it, loss=2.54, v_num=0]
Epoch 50:   1%|          | 1/97 [00:01<02:17,  1.43s/it, loss=2.54, v_num=0]
Epoch 50:   2%|▏         | 2/97 [00:01<01:11,  1.32it/s, loss=2.54, v_num=0]
Epoch 50:   2%|▏         | 2/97 [00:01<01:14,  1.28it/s, loss=2.55, v_num=0]
Epoch 50:   3%|▎         | 3/97 [00:01<00:51,  1.82it/s, loss=2.55, v_num=0]
Epoch 50:   3%|▎         | 3/97 [00:01<00:53,  1.76it/s, loss=2.53, v_num=0]
Epoch 50:   4%|▍         | 4/97 [00:01<00:41,  2.24it/s, loss=2.53, v_num=0]
Epoch 50:   4%|▍         | 4/97 [00:01<00:42,  2.17it/s, loss=2.54, v_num=0]
Epoch 50:   5%|▌         | 5/97 [00:01<00:35,  2.60it/s, loss=2.54, v_num=0]
Epoch 50:   5%|▌         | 5/97 [00:01<00:36,  2.52it/s, loss=2.53, v_num=0]
Epoch 50:   6%|▌         | 6/97 [00:02<00:31,  2.91it/s, loss=2.53, v_num=0]
Epoch 50:   6%|▌         | 6/97 [00:02<00:32,  2.83it/s, loss=2.53, v_num=0]
Epoch 50:   7%|▋         | 7/97 [00:02<00:28,  3.18it/s, loss=2.53, v_num=0]
Epoch 50:   7%|▋         | 7/97 [00:02<00:29,  3.10it/s, loss=2.53, v_num=0]
Epoch 50:   8%|▊         | 8/97 [00:02<00:25,  3.43it/s, loss=2.53, v_num=0]
Epoch 50:   8%|▊         | 8/97 [00:02<00:26,  3.34it/s, loss=2.53, v_num=0]
Epoch 50:   9%|▉         | 9/97 [00:02<00:24,  3.64it/s, loss=2.53, v_num=0]
Epoch 50:   9%|▉         | 9/97 [00:02<00:24,  3.56it/s, loss=2.52, v_num=0]
Epoch 50:  10%|█         | 10/97 [00:02<00:22,  3.83it/s, loss=2.52, v_num=0]
Epoch 50:  10%|█         | 10/97 [00:02<00:23,  3.75it/s, loss=2.52, v_num=0]
Epoch 50:  11%|█▏        | 11/97 [00:02<00:21,  4.00it/s, loss=2.52, v_num=0]
Epoch 50:  11%|█▏        | 11/97 [00:02<00:21,  3.92it/s, loss=2.53, v_num=0]
Epoch 50:  12%|█▏        | 12/97 [00:02<00:20,  4.16it/s, loss=2.53, v_num=0]
Epoch 50:  12%|█▏        | 12/97 [00:02<00:20,  4.08it/s, loss=2.52, v_num=0]
Epoch 50:  13%|█▎        | 13/97 [00:03<00:19,  4.30it/s, loss=2.52, v_num=0]
Epoch 50:  13%|█▎        | 13/97 [00:03<00:19,  4.22it/s, loss=2.52, v_num=0]
Epoch 50:  14%|█▍        | 14/97 [00:03<00:18,  4.43it/s, loss=2.52, v_num=0]
Epoch 50:  14%|█▍        | 14/97 [00:03<00:19,  4.36it/s, loss=2.53, v_num=0]
Epoch 50:  15%|█▌        | 15/97 [00:03<00:18,  4.55it/s, loss=2.53, v_num=0]
Epoch 50:  15%|█▌        | 15/97 [00:03<00:18,  4.47it/s, loss=2.52, v_num=0]
Epoch 50:  16%|█▋        | 16/97 [00:03<00:17,  4.66it/s, loss=2.52, v_num=0]
Epoch 50:  16%|█▋        | 16/97 [00:03<00:17,  4.59it/s, loss=2.53, v_num=0]
Epoch 50:  18%|█▊        | 17/97 [00:03<00:16,  4.76it/s, loss=2.53, v_num=0]
Epoch 50:  18%|█▊        | 17/97 [00:03<00:17,  4.69it/s, loss=2.52, v_num=0]
Epoch 50:  19%|█▊        | 18/97 [00:03<00:16,  4.85it/s, loss=2.52, v_num=0]
Epoch 50:  19%|█▊        | 18/97 [00:03<00:16,  4.78it/s, loss=2.52, v_num=0]
Epoch 50:  20%|█▉        | 19/97 [00:03<00:15,  4.94it/s, loss=2.52, v_num=0]
Epoch 50:  20%|█▉        | 19/97 [00:03<00:16,  4.87it/s, loss=2.53, v_num=0]
Epoch 50:  21%|██        | 20/97 [00:03<00:15,  5.02it/s, loss=2.53, v_num=0]
Epoch 50:  21%|██        | 20/97 [00:04<00:15,  4.95it/s, loss=2.53, v_num=0]
Epoch 50:  22%|██▏       | 21/97 [00:04<00:14,  5.10it/s, loss=2.53, v_num=0]
Epoch 50:  22%|██▏       | 21/97 [00:04<00:15,  5.03it/s, loss=2.53, v_num=0]
Epoch 50:  23%|██▎       | 22/97 [00:04<00:14,  5.17it/s, loss=2.53, v_num=0]
Epoch 50:  23%|██▎       | 22/97 [00:04<00:14,  5.10it/s, loss=2.53, v_num=0]
Epoch 50:  24%|██▎       | 23/97 [00:04<00:14,  5.23it/s, loss=2.53, v_num=0]
Epoch 50:  24%|██▎       | 23/97 [00:04<00:14,  5.17it/s, loss=2.53, v_num=0]
Epoch 50:  25%|██▍       | 24/97 [00:04<00:13,  5.30it/s, loss=2.53, v_num=0]
Epoch 50:  25%|██▍       | 24/97 [00:04<00:13,  5.23it/s, loss=2.52, v_num=0]
Epoch 50:  26%|██▌       | 25/97 [00:04<00:13,  5.35it/s, loss=2.52, v_num=0]
Epoch 50:  26%|██▌       | 25/97 [00:04<00:13,  5.29it/s, loss=2.53, v_num=0]
Epoch 50:  27%|██▋       | 26/97 [00:04<00:13,  5.41it/s, loss=2.53, v_num=0]
Epoch 50:  27%|██▋       | 26/97 [00:04<00:13,  5.35it/s, loss=2.53, v_num=0]
Epoch 50:  28%|██▊       | 27/97 [00:04<00:12,  5.46it/s, loss=2.53, v_num=0]
Epoch 50:  28%|██▊       | 27/97 [00:04<00:12,  5.40it/s, loss=2.53, v_num=0]
Epoch 50:  29%|██▉       | 28/97 [00:05<00:12,  5.52it/s, loss=2.53, v_num=0]
Epoch 50:  29%|██▉       | 28/97 [00:05<00:12,  5.45it/s, loss=2.52, v_num=0]
Epoch 50:  30%|██▉       | 29/97 [00:05<00:12,  5.56it/s, loss=2.52, v_num=0]
Epoch 50:  30%|██▉       | 29/97 [00:05<00:12,  5.50it/s, loss=2.52, v_num=0]
Epoch 50:  31%|███       | 30/97 [00:05<00:11,  5.60it/s, loss=2.52, v_num=0]
Epoch 50:  31%|███       | 30/97 [00:05<00:12,  5.55it/s, loss=2.51, v_num=0]
Epoch 50:  32%|███▏      | 31/97 [00:05<00:11,  5.65it/s, loss=2.51, v_num=0]
Epoch 50:  32%|███▏      | 31/97 [00:05<00:11,  5.59it/s, loss=2.51, v_num=0]
Epoch 50:  33%|███▎      | 32/97 [00:05<00:11,  5.68it/s, loss=2.51, v_num=0]
Epoch 50:  33%|███▎      | 32/97 [00:05<00:11,  5.63it/s, loss=2.52, v_num=0]
Epoch 50:  34%|███▍      | 33/97 [00:05<00:11,  5.73it/s, loss=2.52, v_num=0]
Epoch 50:  34%|███▍      | 33/97 [00:05<00:11,  5.67it/s, loss=2.52, v_num=0]
Epoch 50:  35%|███▌      | 34/97 [00:05<00:10,  5.76it/s, loss=2.52, v_num=0]
Epoch 50:  35%|███▌      | 34/97 [00:05<00:11,  5.71it/s, loss=2.51, v_num=0]
Epoch 50:  36%|███▌      | 35/97 [00:06<00:10,  5.80it/s, loss=2.51, v_num=0]
Epoch 50:  36%|███▌      | 35/97 [00:06<00:10,  5.74it/s, loss=2.51, v_num=0]
Epoch 50:  37%|███▋      | 36/97 [00:06<00:10,  5.83it/s, loss=2.51, v_num=0]
Epoch 50:  37%|███▋      | 36/97 [00:06<00:10,  5.78it/s, loss=2.52, v_num=0]
Epoch 50:  38%|███▊      | 37/97 [00:06<00:10,  5.86it/s, loss=2.52, v_num=0]
Epoch 50:  38%|███▊      | 37/97 [00:06<00:10,  5.81it/s, loss=2.52, v_num=0]
Epoch 50:  39%|███▉      | 38/97 [00:06<00:10,  5.89it/s, loss=2.52, v_num=0]
Epoch 50:  39%|███▉      | 38/97 [00:06<00:10,  5.84it/s, loss=2.52, v_num=0]
Epoch 50:  40%|████      | 39/97 [00:06<00:09,  5.92it/s, loss=2.52, v_num=0]
Epoch 50:  40%|████      | 39/97 [00:06<00:09,  5.87it/s, loss=2.52, v_num=0]
Epoch 50:  41%|████      | 40/97 [00:06<00:09,  5.95it/s, loss=2.52, v_num=0]
Epoch 50:  41%|████      | 40/97 [00:06<00:09,  5.90it/s, loss=2.52, v_num=0]
Epoch 50:  42%|████▏     | 41/97 [00:06<00:09,  5.97it/s, loss=2.52, v_num=0]
Epoch 50:  42%|████▏     | 41/97 [00:06<00:09,  5.92it/s, loss=2.51, v_num=0]
Epoch 50:  43%|████▎     | 42/97 [00:07<00:09,  5.99it/s, loss=2.51, v_num=0]
Epoch 50:  43%|████▎     | 42/97 [00:07<00:09,  5.95it/s, loss=2.52, v_num=0]
Epoch 50:  44%|████▍     | 43/97 [00:07<00:08,  6.02it/s, loss=2.52, v_num=0]
Epoch 50:  44%|████▍     | 43/97 [00:07<00:09,  5.97it/s, loss=2.51, v_num=0]
Epoch 50:  45%|████▌     | 44/97 [00:07<00:08,  6.04it/s, loss=2.51, v_num=0]
Epoch 50:  45%|████▌     | 44/97 [00:07<00:08,  5.99it/s, loss=2.52, v_num=0]
Epoch 50:  46%|████▋     | 45/97 [00:07<00:08,  6.06it/s, loss=2.52, v_num=0]
Epoch 50:  46%|████▋     | 45/97 [00:07<00:08,  6.01it/s, loss=2.52, v_num=0]
Epoch 50:  47%|████▋     | 46/97 [00:07<00:08,  6.08it/s, loss=2.52, v_num=0]
Epoch 50:  47%|████▋     | 46/97 [00:07<00:08,  6.03it/s, loss=2.52, v_num=0]
Epoch 50:  48%|████▊     | 47/97 [00:07<00:08,  6.10it/s, loss=2.52, v_num=0]
Epoch 50:  48%|████▊     | 47/97 [00:07<00:08,  6.05it/s, loss=2.52, v_num=0]
Epoch 50:  49%|████▉     | 48/97 [00:07<00:08,  6.12it/s, loss=2.52, v_num=0]
Epoch 50:  49%|████▉     | 48/97 [00:07<00:08,  6.07it/s, loss=2.53, v_num=0]
Epoch 50:  51%|█████     | 49/97 [00:07<00:07,  6.14it/s, loss=2.53, v_num=0]
Epoch 50:  51%|█████     | 49/97 [00:08<00:07,  6.09it/s, loss=2.53, v_num=0]
Epoch 50:  52%|█████▏    | 50/97 [00:08<00:07,  6.16it/s, loss=2.53, v_num=0]
Epoch 50:  52%|█████▏    | 50/97 [00:08<00:07,  6.12it/s, loss=2.53, v_num=0]
Epoch 50:  53%|█████▎    | 51/97 [00:08<00:07,  6.18it/s, loss=2.53, v_num=0]
Epoch 50:  53%|█████▎    | 51/97 [00:08<00:07,  6.13it/s, loss=2.53, v_num=0]
Epoch 50:  54%|█████▎    | 52/97 [00:08<00:07,  6.19it/s, loss=2.53, v_num=0]
Epoch 50:  54%|█████▎    | 52/97 [00:08<00:07,  6.15it/s, loss=2.53, v_num=0]
Epoch 50:  55%|█████▍    | 53/97 [00:08<00:07,  6.21it/s, loss=2.53, v_num=0]
Epoch 50:  55%|█████▍    | 53/97 [00:08<00:07,  6.17it/s, loss=2.53, v_num=0]
Epoch 50:  56%|█████▌    | 54/97 [00:08<00:06,  6.23it/s, loss=2.53, v_num=0]
Epoch 50:  56%|█████▌    | 54/97 [00:08<00:06,  6.18it/s, loss=2.52, v_num=0]
Epoch 50:  57%|█████▋    | 55/97 [00:08<00:06,  6.24it/s, loss=2.52, v_num=0]
Epoch 50:  57%|█████▋    | 55/97 [00:08<00:06,  6.20it/s, loss=2.52, v_num=0]
Epoch 50:  58%|█████▊    | 56/97 [00:08<00:06,  6.26it/s, loss=2.52, v_num=0]
Epoch 50:  58%|█████▊    | 56/97 [00:09<00:06,  6.22it/s, loss=2.52, v_num=0]
Epoch 50:  59%|█████▉    | 57/97 [00:09<00:06,  6.27it/s, loss=2.52, v_num=0]
Epoch 50:  59%|█████▉    | 57/97 [00:09<00:06,  6.23it/s, loss=2.52, v_num=0]
Epoch 50:  60%|█████▉    | 58/97 [00:09<00:06,  6.29it/s, loss=2.52, v_num=0]
Epoch 50:  60%|█████▉    | 58/97 [00:09<00:06,  6.25it/s, loss=2.52, v_num=0]
Epoch 50:  61%|██████    | 59/97 [00:09<00:06,  6.30it/s, loss=2.52, v_num=0]
Epoch 50:  61%|██████    | 59/97 [00:09<00:06,  6.27it/s, loss=2.52, v_num=0]
Epoch 50:  62%|██████▏   | 60/97 [00:09<00:05,  6.32it/s, loss=2.52, v_num=0]
Epoch 50:  62%|██████▏   | 60/97 [00:09<00:05,  6.28it/s, loss=2.51, v_num=0]
Epoch 50:  63%|██████▎   | 61/97 [00:09<00:05,  6.33it/s, loss=2.51, v_num=0]
Epoch 50:  63%|██████▎   | 61/97 [00:09<00:05,  6.29it/s, loss=2.51, v_num=0]
Epoch 50:  64%|██████▍   | 62/97 [00:09<00:05,  6.34it/s, loss=2.51, v_num=0]
Epoch 50:  64%|██████▍   | 62/97 [00:09<00:05,  6.31it/s, loss=2.51, v_num=0]
Epoch 50:  65%|██████▍   | 63/97 [00:09<00:05,  6.35it/s, loss=2.51, v_num=0]
Epoch 50:  65%|██████▍   | 63/97 [00:09<00:05,  6.32it/s, loss=2.52, v_num=0]
Epoch 50:  66%|██████▌   | 64/97 [00:10<00:05,  6.37it/s, loss=2.52, v_num=0]
Epoch 50:  66%|██████▌   | 64/97 [00:10<00:05,  6.33it/s, loss=2.51, v_num=0]
Epoch 50:  67%|██████▋   | 65/97 [00:10<00:05,  6.38it/s, loss=2.51, v_num=0]
Epoch 50:  67%|██████▋   | 65/97 [00:10<00:05,  6.35it/s, loss=2.51, v_num=0]
Epoch 50:  68%|██████▊   | 66/97 [00:10<00:04,  6.39it/s, loss=2.51, v_num=0]
Epoch 50:  68%|██████▊   | 66/97 [00:10<00:04,  6.36it/s, loss=2.51, v_num=0]
Epoch 50:  69%|██████▉   | 67/97 [00:10<00:04,  6.41it/s, loss=2.51, v_num=0]
Epoch 50:  69%|██████▉   | 67/97 [00:10<00:04,  6.37it/s, loss=2.51, v_num=0]
Epoch 50:  70%|███████   | 68/97 [00:10<00:04,  6.42it/s, loss=2.51, v_num=0]
Epoch 50:  70%|███████   | 68/97 [00:10<00:04,  6.38it/s, loss=2.52, v_num=0]
Epoch 50:  71%|███████   | 69/97 [00:10<00:04,  6.43it/s, loss=2.52, v_num=0]
Epoch 50:  71%|███████   | 69/97 [00:10<00:04,  6.39it/s, loss=2.51, v_num=0]
Epoch 50:  72%|███████▏  | 70/97 [00:10<00:04,  6.44it/s, loss=2.51, v_num=0]
Epoch 50:  72%|███████▏  | 70/97 [00:10<00:04,  6.41it/s, loss=2.51, v_num=0]
Epoch 50:  73%|███████▎  | 71/97 [00:11<00:04,  6.45it/s, loss=2.51, v_num=0]
Epoch 50:  73%|███████▎  | 71/97 [00:11<00:04,  6.42it/s, loss=2.51, v_num=0]
Epoch 50:  74%|███████▍  | 72/97 [00:11<00:03,  6.46it/s, loss=2.51, v_num=0]
Epoch 50:  74%|███████▍  | 72/97 [00:11<00:03,  6.43it/s, loss=2.51, v_num=0]
Epoch 50:  75%|███████▌  | 73/97 [00:11<00:03,  6.47it/s, loss=2.51, v_num=0]
Epoch 50:  75%|███████▌  | 73/97 [00:11<00:03,  6.44it/s, loss=2.52, v_num=0]
Epoch 50:  76%|███████▋  | 74/97 [00:11<00:03,  6.48it/s, loss=2.52, v_num=0]
Epoch 50:  76%|███████▋  | 74/97 [00:11<00:03,  6.45it/s, loss=2.51, v_num=0]
Epoch 50:  77%|███████▋  | 75/97 [00:11<00:03,  6.49it/s, loss=2.51, v_num=0]
Epoch 50:  77%|███████▋  | 75/97 [00:11<00:03,  6.46it/s, loss=2.51, v_num=0]
Epoch 50:  78%|███████▊  | 76/97 [00:11<00:03,  6.50it/s, loss=2.51, v_num=0]
Epoch 50:  78%|███████▊  | 76/97 [00:11<00:03,  6.47it/s, loss=2.51, v_num=0]
Epoch 50:  79%|███████▉  | 77/97 [00:11<00:03,  6.51it/s, loss=2.51, v_num=0]
Epoch 50:  79%|███████▉  | 77/97 [00:11<00:03,  6.48it/s, loss=2.51, v_num=0]
Epoch 50:  80%|████████  | 78/97 [00:11<00:02,  6.52it/s, loss=2.51, v_num=0]
Epoch 50:  80%|████████  | 78/97 [00:12<00:02,  6.49it/s, loss=2.51, v_num=0]
Epoch 50:  81%|████████▏ | 79/97 [00:12<00:02,  6.53it/s, loss=2.51, v_num=0]
Epoch 50:  81%|████████▏ | 79/97 [00:12<00:02,  6.50it/s, loss=2.52, v_num=0]
Epoch 50:  82%|████████▏ | 80/97 [00:12<00:02,  6.54it/s, loss=2.52, v_num=0]
Epoch 50:  82%|████████▏ | 80/97 [00:12<00:02,  6.51it/s, loss=2.52, v_num=0]
Epoch 50:  84%|████████▎ | 81/97 [00:12<00:02,  6.54it/s, loss=2.52, v_num=0]
Epoch 50:  84%|████████▎ | 81/97 [00:12<00:02,  6.51it/s, loss=2.53, v_num=0]
Epoch 50:  85%|████████▍ | 82/97 [00:12<00:02,  6.55it/s, loss=2.53, v_num=0]
Epoch 50:  85%|████████▍ | 82/97 [00:12<00:02,  6.52it/s, loss=2.54, v_num=0]
Epoch 50:  86%|████████▌ | 83/97 [00:12<00:02,  6.56it/s, loss=2.54, v_num=0]
Epoch 50:  86%|████████▌ | 83/97 [00:12<00:02,  6.53it/s, loss=2.53, v_num=0]
Epoch 50:  87%|████████▋ | 84/97 [00:12<00:01,  6.57it/s, loss=2.53, v_num=0]
Epoch 50:  87%|████████▋ | 84/97 [00:12<00:01,  6.54it/s, loss=2.53, v_num=0]
Epoch 50:  88%|████████▊ | 85/97 [00:12<00:01,  6.57it/s, loss=2.53, v_num=0]
Epoch 50:  88%|████████▊ | 85/97 [00:12<00:01,  6.55it/s, loss=2.54, v_num=0]
Epoch 50:  89%|████████▊ | 86/97 [00:13<00:01,  6.58it/s, loss=2.54, v_num=0]
Epoch 50:  89%|████████▊ | 86/97 [00:13<00:01,  6.55it/s, loss=2.53, v_num=0]
Epoch 50:  90%|████████▉ | 87/97 [00:13<00:01,  6.59it/s, loss=2.53, v_num=0]
Epoch 50:  90%|████████▉ | 87/97 [00:13<00:01,  6.56it/s, loss=2.53, v_num=0]
Epoch 50:  91%|█████████ | 88/97 [00:13<00:01,  6.60it/s, loss=2.53, v_num=0]
Epoch 50:  91%|█████████ | 88/97 [00:13<00:01,  6.57it/s, loss=2.52, v_num=0]
Epoch 50:  92%|█████████▏| 89/97 [00:13<00:01,  6.60it/s, loss=2.52, v_num=0]
Epoch 50:  92%|█████████▏| 89/97 [00:13<00:01,  6.58it/s, loss=2.53, v_num=0]
Epoch 50:  93%|█████████▎| 90/97 [00:13<00:01,  6.61it/s, loss=2.53, v_num=0]
Epoch 50:  93%|█████████▎| 90/97 [00:13<00:01,  6.58it/s, loss=2.53, v_num=0]
Epoch 50:  94%|█████████▍| 91/97 [00:13<00:00,  6.62it/s, loss=2.53, v_num=0]
Epoch 50:  94%|█████████▍| 91/97 [00:13<00:00,  6.59it/s, loss=2.54, v_num=0]
Epoch 50:  95%|█████████▍| 92/97 [00:13<00:00,  6.63it/s, loss=2.54, v_num=0]
Epoch 50:  95%|█████████▍| 92/97 [00:13<00:00,  6.60it/s, loss=2.54, v_num=0]
Epoch 50:  96%|█████████▌| 93/97 [00:14<00:00,  6.63it/s, loss=2.54, v_num=0]
Epoch 50:  96%|█████████▌| 93/97 [00:14<00:00,  6.61it/s, loss=2.54, v_num=0]
Epoch 50:  97%|█████████▋| 94/97 [00:14<00:00,  6.64it/s, loss=2.54, v_num=0]
Epoch 50:  97%|█████████▋| 94/97 [00:14<00:00,  6.61it/s, loss=2.54, v_num=0]
Epoch 50:  98%|█████████▊| 95/97 [00:14<00:00,  6.65it/s, loss=2.54, v_num=0]
Epoch 50:  98%|█████████▊| 95/97 [00:14<00:00,  6.62it/s, loss=2.55, v_num=0]
Epoch 50:  99%|█████████▉| 96/97 [00:14<00:00,  6.65it/s, loss=2.55, v_num=0]
Epoch 50:  99%|█████████▉| 96/97 [00:14<00:00,  6.63it/s, loss=2.55, v_num=0]
Epoch 50: 100%|██████████| 97/97 [00:14<00:00,  6.66it/s, loss=2.55, v_num=0]
Epoch 50: 100%|██████████| 97/97 [00:14<00:00,  6.63it/s, loss=2.55, v_num=0]
Epoch 50: 100%|██████████| 97/97 [00:14<00:00,  6.63it/s, loss=2.55, v_num=0]
Epoch 50:   0%|          | 0/97 [00:00<?, ?it/s, loss=2.55, v_num=0]
Epoch 51:   0%|          | 0/97 [00:00<?, ?it/s, loss=2.55, v_num=0]
Epoch 51:   1%|          | 1/97 [00:01<02:13,  1.39s/it, loss=2.55, v_num=0]
Epoch 51:   1%|          | 1/97 [00:01<02:18,  1.45s/it, loss=2.54, v_num=0]
Epoch 51:   2%|▏         | 2/97 [00:01<01:12,  1.30it/s, loss=2.54, v_num=0]
Epoch 51:   2%|▏         | 2/97 [00:01<01:15,  1.26it/s, loss=2.55, v_num=0]
Epoch 51:   3%|▎         | 3/97 [00:01<00:52,  1.80it/s, loss=2.55, v_num=0]
Epoch 51:   3%|▎         | 3/97 [00:01<00:54,  1.74it/s, loss=2.55, v_num=0]
Epoch 51:   4%|▍         | 4/97 [00:01<00:42,  2.21it/s, loss=2.55, v_num=0]
Epoch 51:   4%|▍         | 4/97 [00:01<00:43,  2.15it/s, loss=2.55, v_num=0]
Epoch 51:   5%|▌         | 5/97 [00:01<00:35,  2.57it/s, loss=2.55, v_num=0]
Epoch 51:   5%|▌         | 5/97 [00:01<00:36,  2.50it/s, loss=2.54, v_num=0]
Epoch 51:   6%|▌         | 6/97 [00:02<00:31,  2.89it/s, loss=2.54, v_num=0]
Epoch 51:   6%|▌         | 6/97 [00:02<00:32,  2.81it/s, loss=2.54, v_num=0]
Epoch 51:   7%|▋         | 7/97 [00:02<00:28,  3.16it/s, loss=2.54, v_num=0]
Epoch 51:   7%|▋         | 7/97 [00:02<00:29,  3.08it/s, loss=2.54, v_num=0]
Epoch 51:   8%|▊         | 8/97 [00:02<00:26,  3.41it/s, loss=2.54, v_num=0]
Epoch 51:   8%|▊         | 8/97 [00:02<00:26,  3.33it/s, loss=2.54, v_num=0]
Epoch 51:   9%|▉         | 9/97 [00:02<00:24,  3.61it/s, loss=2.54, v_num=0]
Epoch 51:   9%|▉         | 9/97 [00:02<00:24,  3.53it/s, loss=2.54, v_num=0]
Epoch 51:  10%|█         | 10/97 [00:02<00:22,  3.80it/s, loss=2.54, v_num=0]
Epoch 51:  10%|█         | 10/97 [00:02<00:23,  3.72it/s, loss=2.55, v_num=0]
Epoch 51:  11%|█▏        | 11/97 [00:02<00:21,  3.97it/s, loss=2.55, v_num=0]
Epoch 51:  11%|█▏        | 11/97 [00:02<00:22,  3.89it/s, loss=2.55, v_num=0]
Epoch 51:  12%|█▏        | 12/97 [00:02<00:20,  4.13it/s, loss=2.55, v_num=0]
Epoch 51:  12%|█▏        | 12/97 [00:02<00:20,  4.05it/s, loss=2.55, v_num=0]
Epoch 51:  13%|█▎        | 13/97 [00:03<00:19,  4.27it/s, loss=2.55, v_num=0]
Epoch 51:  13%|█▎        | 13/97 [00:03<00:20,  4.20it/s, loss=2.55, v_num=0]
Epoch 51:  14%|█▍        | 14/97 [00:03<00:18,  4.41it/s, loss=2.55, v_num=0]
Epoch 51:  14%|█▍        | 14/97 [00:03<00:19,  4.33it/s, loss=2.54, v_num=0]
Epoch 51:  15%|█▌        | 15/97 [00:03<00:18,  4.53it/s, loss=2.54, v_num=0]
Epoch 51:  15%|█▌        | 15/97 [00:03<00:18,  4.45it/s, loss=2.53, v_num=0]
Epoch 51:  16%|█▋        | 16/97 [00:03<00:17,  4.65it/s, loss=2.53, v_num=0]
Epoch 51:  16%|█▋        | 16/97 [00:03<00:17,  4.57it/s, loss=2.53, v_num=0]
Epoch 51:  18%|█▊        | 17/97 [00:03<00:16,  4.74it/s, loss=2.53, v_num=0]
Epoch 51:  18%|█▊        | 17/97 [00:03<00:17,  4.67it/s, loss=2.53, v_num=0]
Epoch 51:  19%|█▊        | 18/97 [00:03<00:16,  4.84it/s, loss=2.53, v_num=0]
Epoch 51:  19%|█▊        | 18/97 [00:03<00:16,  4.76it/s, loss=2.52, v_num=0]
Epoch 51:  20%|█▉        | 19/97 [00:03<00:15,  4.92it/s, loss=2.52, v_num=0]
Epoch 51:  20%|█▉        | 19/97 [00:03<00:16,  4.85it/s, loss=2.51, v_num=0]
Epoch 51:  21%|██        | 20/97 [00:03<00:15,  5.00it/s, loss=2.51, v_num=0]
Epoch 51:  21%|██        | 20/97 [00:04<00:15,  4.94it/s, loss=2.52, v_num=0]
Epoch 51:  22%|██▏       | 21/97 [00:04<00:14,  5.09it/s, loss=2.52, v_num=0]
Epoch 51:  22%|██▏       | 21/97 [00:04<00:15,  5.01it/s, loss=2.52, v_num=0]
Epoch 51:  23%|██▎       | 22/97 [00:04<00:14,  5.15it/s, loss=2.52, v_num=0]
Epoch 51:  23%|██▎       | 22/97 [00:04<00:14,  5.09it/s, loss=2.51, v_num=0]
Epoch 51:  24%|██▎       | 23/97 [00:04<00:14,  5.22it/s, loss=2.51, v_num=0]
Epoch 51:  24%|██▎       | 23/97 [00:04<00:14,  5.16it/s, loss=2.5, v_num=0]
Epoch 51:  25%|██▍       | 24/97 [00:04<00:13,  5.28it/s, loss=2.5, v_num=0]
Epoch 51:  25%|██▍       | 24/97 [00:04<00:13,  5.22it/s, loss=2.5, v_num=0]
Epoch 51:  26%|██▌       | 25/97 [00:04<00:13,  5.34it/s, loss=2.5, v_num=0]
Epoch 51:  26%|██▌       | 25/97 [00:04<00:13,  5.28it/s, loss=2.51, v_num=0]
Epoch 51:  27%|██▋       | 26/97 [00:04<00:13,  5.39it/s, loss=2.51, v_num=0]
Epoch 51:  27%|██▋       | 26/97 [00:04<00:13,  5.33it/s, loss=2.51, v_num=0]
Epoch 51:  28%|██▊       | 27/97 [00:04<00:12,  5.45it/s, loss=2.51, v_num=0]
Epoch 51:  28%|██▊       | 27/97 [00:05<00:12,  5.39it/s, loss=2.51, v_num=0]
Epoch 51:  29%|██▉       | 28/97 [00:05<00:12,  5.50it/s, loss=2.51, v_num=0]
Epoch 51:  29%|██▉       | 28/97 [00:05<00:12,  5.44it/s, loss=2.51, v_num=0]
Epoch 51:  30%|██▉       | 29/97 [00:05<00:12,  5.55it/s, loss=2.51, v_num=0]
Epoch 51:  30%|██▉       | 29/97 [00:05<00:12,  5.49it/s, loss=2.51, v_num=0]
Epoch 51:  31%|███       | 30/97 [00:05<00:11,  5.59it/s, loss=2.51, v_num=0]
Epoch 51:  31%|███       | 30/97 [00:05<00:12,  5.53it/s, loss=2.51, v_num=0]
Epoch 51:  32%|███▏      | 31/97 [00:05<00:11,  5.63it/s, loss=2.51, v_num=0]
Epoch 51:  32%|███▏      | 31/97 [00:05<00:11,  5.58it/s, loss=2.5, v_num=0]
Epoch 51:  33%|███▎      | 32/97 [00:05<00:11,  5.68it/s, loss=2.5, v_num=0]
Epoch 51:  33%|███▎      | 32/97 [00:05<00:11,  5.62it/s, loss=2.5, v_num=0]
Epoch 51:  34%|███▍      | 33/97 [00:05<00:11,  5.71it/s, loss=2.5, v_num=0]
Epoch 51:  34%|███▍      | 33/97 [00:05<00:11,  5.66it/s, loss=2.5, v_num=0]
Epoch 51:  35%|███▌      | 34/97 [00:05<00:10,  5.75it/s, loss=2.5, v_num=0]
Epoch 51:  35%|███▌      | 34/97 [00:05<00:11,  5.70it/s, loss=2.49, v_num=0]
Epoch 51:  36%|███▌      | 35/97 [00:06<00:10,  5.79it/s, loss=2.49, v_num=0]
Epoch 51:  36%|███▌      | 35/97 [00:06<00:10,  5.73it/s, loss=2.49, v_num=0]
Epoch 51:  37%|███▋      | 36/97 [00:06<00:10,  5.82it/s, loss=2.49, v_num=0]
Epoch 51:  37%|███▋      | 36/97 [00:06<00:10,  5.77it/s, loss=2.49, v_num=0]
Epoch 51:  38%|███▊      | 37/97 [00:06<00:10,  5.85it/s, loss=2.49, v_num=0]
Epoch 51:  38%|███▊      | 37/97 [00:06<00:10,  5.80it/s, loss=2.49, v_num=0]
Epoch 51:  39%|███▉      | 38/97 [00:06<00:10,  5.88it/s, loss=2.49, v_num=0]
Epoch 51:  39%|███▉      | 38/97 [00:06<00:10,  5.83it/s, loss=2.49, v_num=0]
Epoch 51:  40%|████      | 39/97 [00:06<00:09,  5.91it/s, loss=2.49, v_num=0]
Epoch 51:  40%|████      | 39/97 [00:06<00:09,  5.86it/s, loss=2.49, v_num=0]
Epoch 51:  41%|████      | 40/97 [00:06<00:09,  5.94it/s, loss=2.49, v_num=0]
Epoch 51:  41%|████      | 40/97 [00:06<00:09,  5.89it/s, loss=2.49, v_num=0]
Epoch 51:  42%|████▏     | 41/97 [00:06<00:09,  5.96it/s, loss=2.49, v_num=0]
Epoch 51:  42%|████▏     | 41/97 [00:06<00:09,  5.92it/s, loss=2.49, v_num=0]
Epoch 51:  43%|████▎     | 42/97 [00:07<00:09,  5.99it/s, loss=2.49, v_num=0]
Epoch 51:  43%|████▎     | 42/97 [00:07<00:09,  5.94it/s, loss=2.49, v_num=0]
Epoch 51:  44%|████▍     | 43/97 [00:07<00:08,  6.02it/s, loss=2.49, v_num=0]
Epoch 51:  44%|████▍     | 43/97 [00:07<00:09,  5.97it/s, loss=2.49, v_num=0]
Epoch 51:  45%|████▌     | 44/97 [00:07<00:08,  6.04it/s, loss=2.49, v_num=0]
Epoch 51:  45%|████▌     | 44/97 [00:07<00:08,  5.99it/s, loss=2.49, v_num=0]
Epoch 51:  46%|████▋     | 45/97 [00:07<00:08,  6.07it/s, loss=2.49, v_num=0]
Epoch 51:  46%|████▋     | 45/97 [00:07<00:08,  6.02it/s, loss=2.49, v_num=0]
Epoch 51:  47%|████▋     | 46/97 [00:07<00:08,  6.08it/s, loss=2.49, v_num=0]
Epoch 51:  47%|████▋     | 46/97 [00:07<00:08,  6.04it/s, loss=2.49, v_num=0]
Epoch 51:  48%|████▊     | 47/97 [00:07<00:08,  6.11it/s, loss=2.49, v_num=0]
Epoch 51:  48%|████▊     | 47/97 [00:07<00:08,  6.06it/s, loss=2.5, v_num=0]
Epoch 51:  49%|████▉     | 48/97 [00:07<00:08,  6.12it/s, loss=2.5, v_num=0]
Epoch 51:  49%|████▉     | 48/97 [00:07<00:08,  6.08it/s, loss=2.49, v_num=0]
Epoch 51:  51%|█████     | 49/97 [00:07<00:07,  6.15it/s, loss=2.49, v_num=0]
Epoch 51:  51%|█████     | 49/97 [00:08<00:07,  6.10it/s, loss=2.49, v_num=0]
Epoch 51:  52%|█████▏    | 50/97 [00:08<00:07,  6.16it/s, loss=2.49, v_num=0]
Epoch 51:  52%|█████▏    | 50/97 [00:08<00:07,  6.12it/s, loss=2.49, v_num=0]
Epoch 51:  53%|█████▎    | 51/97 [00:08<00:07,  6.19it/s, loss=2.49, v_num=0]
Epoch 51:  53%|█████▎    | 51/97 [00:08<00:07,  6.14it/s, loss=2.5, v_num=0]
Epoch 51:  54%|█████▎    | 52/97 [00:08<00:07,  6.20it/s, loss=2.5, v_num=0]
Epoch 51:  54%|█████▎    | 52/97 [00:08<00:07,  6.16it/s, loss=2.49, v_num=0]
Epoch 51:  55%|█████▍    | 53/97 [00:08<00:07,  6.22it/s, loss=2.49, v_num=0]
Epoch 51:  55%|█████▍    | 53/97 [00:08<00:07,  6.18it/s, loss=2.49, v_num=0]
Epoch 51:  56%|█████▌    | 54/97 [00:08<00:06,  6.24it/s, loss=2.49, v_num=0]
Epoch 51:  56%|█████▌    | 54/97 [00:08<00:06,  6.20it/s, loss=2.5, v_num=0]
Epoch 51:  57%|█████▋    | 55/97 [00:08<00:06,  6.26it/s, loss=2.5, v_num=0]
Epoch 51:  57%|█████▋    | 55/97 [00:08<00:06,  6.21it/s, loss=2.49, v_num=0]
Epoch 51:  58%|█████▊    | 56/97 [00:08<00:06,  6.27it/s, loss=2.49, v_num=0]
Epoch 51:  58%|█████▊    | 56/97 [00:08<00:06,  6.23it/s, loss=2.5, v_num=0]
Epoch 51:  59%|█████▉    | 57/97 [00:09<00:06,  6.28it/s, loss=2.5, v_num=0]
Epoch 51:  59%|█████▉    | 57/97 [00:09<00:06,  6.25it/s, loss=2.49, v_num=0]
Epoch 51:  60%|█████▉    | 58/97 [00:09<00:06,  6.30it/s, loss=2.49, v_num=0]
Epoch 51:  60%|█████▉    | 58/97 [00:09<00:06,  6.26it/s, loss=2.5, v_num=0]
Epoch 51:  61%|██████    | 59/97 [00:09<00:06,  6.31it/s, loss=2.5, v_num=0]
Epoch 51:  61%|██████    | 59/97 [00:09<00:06,  6.27it/s, loss=2.5, v_num=0]
Epoch 51:  62%|██████▏   | 60/97 [00:09<00:05,  6.33it/s, loss=2.5, v_num=0]
Epoch 51:  62%|██████▏   | 60/97 [00:09<00:05,  6.29it/s, loss=2.49, v_num=0]
Epoch 51:  63%|██████▎   | 61/97 [00:09<00:05,  6.34it/s, loss=2.49, v_num=0]
Epoch 51:  63%|██████▎   | 61/97 [00:09<00:05,  6.30it/s, loss=2.49, v_num=0]
Epoch 51:  64%|██████▍   | 62/97 [00:09<00:05,  6.36it/s, loss=2.49, v_num=0]
Epoch 51:  64%|██████▍   | 62/97 [00:09<00:05,  6.32it/s, loss=2.49, v_num=0]
Epoch 51:  65%|██████▍   | 63/97 [00:09<00:05,  6.37it/s, loss=2.49, v_num=0]
Epoch 51:  65%|██████▍   | 63/97 [00:09<00:05,  6.33it/s, loss=2.49, v_num=0]
Epoch 51:  66%|██████▌   | 64/97 [00:10<00:05,  6.38it/s, loss=2.49, v_num=0]
Epoch 51:  66%|██████▌   | 64/97 [00:10<00:05,  6.34it/s, loss=2.49, v_num=0]
Epoch 51:  67%|██████▋   | 65/97 [00:10<00:05,  6.39it/s, loss=2.49, v_num=0]
Epoch 51:  67%|██████▋   | 65/97 [00:10<00:05,  6.36it/s, loss=2.49, v_num=0]
Epoch 51:  68%|██████▊   | 66/97 [00:10<00:04,  6.40it/s, loss=2.49, v_num=0]
Epoch 51:  68%|██████▊   | 66/97 [00:10<00:04,  6.37it/s, loss=2.49, v_num=0]
Epoch 51:  69%|██████▉   | 67/97 [00:10<00:04,  6.42it/s, loss=2.49, v_num=0]
Epoch 51:  69%|██████▉   | 67/97 [00:10<00:04,  6.38it/s, loss=2.48, v_num=0]
Epoch 51:  70%|███████   | 68/97 [00:10<00:04,  6.43it/s, loss=2.48, v_num=0]
Epoch 51:  70%|███████   | 68/97 [00:10<00:04,  6.39it/s, loss=2.49, v_num=0]
Epoch 51:  71%|███████   | 69/97 [00:10<00:04,  6.44it/s, loss=2.49, v_num=0]
Epoch 51:  71%|███████   | 69/97 [00:10<00:04,  6.40it/s, loss=2.49, v_num=0]
Epoch 51:  72%|███████▏  | 70/97 [00:10<00:04,  6.45it/s, loss=2.49, v_num=0]
Epoch 51:  72%|███████▏  | 70/97 [00:10<00:04,  6.42it/s, loss=2.49, v_num=0]
Epoch 51:  73%|███████▎  | 71/97 [00:10<00:04,  6.46it/s, loss=2.49, v_num=0]
Epoch 51:  73%|███████▎  | 71/97 [00:11<00:04,  6.43it/s, loss=2.48, v_num=0]
Epoch 51:  74%|███████▍  | 72/97 [00:11<00:03,  6.47it/s, loss=2.48, v_num=0]
Epoch 51:  74%|███████▍  | 72/97 [00:11<00:03,  6.44it/s, loss=2.49, v_num=0]
Epoch 51:  75%|███████▌  | 73/97 [00:11<00:03,  6.48it/s, loss=2.49, v_num=0]
Epoch 51:  75%|███████▌  | 73/97 [00:11<00:03,  6.45it/s, loss=2.49, v_num=0]
Epoch 51:  76%|███████▋  | 74/97 [00:11<00:03,  6.49it/s, loss=2.49, v_num=0]
Epoch 51:  76%|███████▋  | 74/97 [00:11<00:03,  6.46it/s, loss=2.49, v_num=0]
Epoch 51:  77%|███████▋  | 75/97 [00:11<00:03,  6.50it/s, loss=2.49, v_num=0]
Epoch 51:  77%|███████▋  | 75/97 [00:11<00:03,  6.47it/s, loss=2.5, v_num=0]
Epoch 51:  78%|███████▊  | 76/97 [00:11<00:03,  6.51it/s, loss=2.5, v_num=0]
Epoch 51:  78%|███████▊  | 76/97 [00:11<00:03,  6.48it/s, loss=2.5, v_num=0]
Epoch 51:  79%|███████▉  | 77/97 [00:11<00:03,  6.52it/s, loss=2.5, v_num=0]
Epoch 51:  79%|███████▉  | 77/97 [00:11<00:03,  6.49it/s, loss=2.5, v_num=0]
Epoch 51:  80%|████████  | 78/97 [00:11<00:02,  6.53it/s, loss=2.5, v_num=0]
Epoch 51:  80%|████████  | 78/97 [00:12<00:02,  6.50it/s, loss=2.5, v_num=0]
Epoch 51:  81%|████████▏ | 79/97 [00:12<00:02,  6.54it/s, loss=2.5, v_num=0]
Epoch 51:  81%|████████▏ | 79/97 [00:12<00:02,  6.51it/s, loss=2.5, v_num=0]
Epoch 51:  82%|████████▏ | 80/97 [00:12<00:02,  6.55it/s, loss=2.5, v_num=0]
Epoch 51:  82%|████████▏ | 80/97 [00:12<00:02,  6.51it/s, loss=2.5, v_num=0]
Epoch 51:  84%|████████▎ | 81/97 [00:12<00:02,  6.55it/s, loss=2.5, v_num=0]
Epoch 51:  84%|████████▎ | 81/97 [00:12<00:02,  6.52it/s, loss=2.51, v_num=0]
Epoch 51:  85%|████████▍ | 82/97 [00:12<00:02,  6.56it/s, loss=2.51, v_num=0]
Epoch 51:  85%|████████▍ | 82/97 [00:12<00:02,  6.53it/s, loss=2.51, v_num=0]
Epoch 51:  86%|████████▌ | 83/97 [00:12<00:02,  6.57it/s, loss=2.51, v_num=0]
Epoch 51:  86%|████████▌ | 83/97 [00:12<00:02,  6.54it/s, loss=2.51, v_num=0]
Epoch 51:  87%|████████▋ | 84/97 [00:12<00:01,  6.57it/s, loss=2.51, v_num=0]
Epoch 51:  87%|████████▋ | 84/97 [00:12<00:01,  6.55it/s, loss=2.51, v_num=0]
Epoch 51:  88%|████████▊ | 85/97 [00:12<00:01,  6.58it/s, loss=2.51, v_num=0]
Epoch 51:  88%|████████▊ | 85/97 [00:12<00:01,  6.55it/s, loss=2.51, v_num=0]
Epoch 51:  89%|████████▊ | 86/97 [00:13<00:01,  6.59it/s, loss=2.51, v_num=0]
Epoch 51:  89%|████████▊ | 86/97 [00:13<00:01,  6.56it/s, loss=2.52, v_num=0]
Epoch 51:  90%|████████▉ | 87/97 [00:13<00:01,  6.60it/s, loss=2.52, v_num=0]
Epoch 51:  90%|████████▉ | 87/97 [00:13<00:01,  6.57it/s, loss=2.51, v_num=0]
Epoch 51:  91%|█████████ | 88/97 [00:13<00:01,  6.60it/s, loss=2.51, v_num=0]
Epoch 51:  91%|█████████ | 88/97 [00:13<00:01,  6.58it/s, loss=2.51, v_num=0]
Epoch 51:  92%|█████████▏| 89/97 [00:13<00:01,  6.61it/s, loss=2.51, v_num=0]
Epoch 51:  92%|█████████▏| 89/97 [00:13<00:01,  6.58it/s, loss=2.51, v_num=0]
Epoch 51:  93%|█████████▎| 90/97 [00:13<00:01,  6.62it/s, loss=2.51, v_num=0]
Epoch 51:  93%|█████████▎| 90/97 [00:13<00:01,  6.59it/s, loss=2.51, v_num=0]
Epoch 51:  94%|█████████▍| 91/97 [00:13<00:00,  6.63it/s, loss=2.51, v_num=0]
Epoch 51:  94%|█████████▍| 91/97 [00:13<00:00,  6.60it/s, loss=2.52, v_num=0]
Epoch 51:  95%|█████████▍| 92/97 [00:13<00:00,  6.63it/s, loss=2.52, v_num=0]
Epoch 51:  95%|█████████▍| 92/97 [00:13<00:00,  6.61it/s, loss=2.51, v_num=0]
Epoch 51:  96%|█████████▌| 93/97 [00:14<00:00,  6.64it/s, loss=2.51, v_num=0]
Epoch 51:  96%|█████████▌| 93/97 [00:14<00:00,  6.61it/s, loss=2.51, v_num=0]
Epoch 51:  97%|█████████▋| 94/97 [00:14<00:00,  6.65it/s, loss=2.51, v_num=0]
Epoch 51:  97%|█████████▋| 94/97 [00:14<00:00,  6.62it/s, loss=2.5, v_num=0]
Epoch 51:  98%|█████████▊| 95/97 [00:14<00:00,  6.65it/s, loss=2.5, v_num=0]
Epoch 51:  98%|█████████▊| 95/97 [00:14<00:00,  6.63it/s, loss=2.51, v_num=0]
Epoch 51:  99%|█████████▉| 96/97 [00:14<00:00,  6.66it/s, loss=2.51, v_num=0]
Epoch 51:  99%|█████████▉| 96/97 [00:14<00:00,  6.63it/s, loss=2.51, v_num=0]
Epoch 51: 100%|██████████| 97/97 [00:14<00:00,  6.66it/s, loss=2.51, v_num=0]
Epoch 51: 100%|██████████| 97/97 [00:14<00:00,  6.64it/s, loss=2.51, v_num=0]
Epoch 51: 100%|██████████| 97/97 [00:14<00:00,  6.64it/s, loss=2.51, v_num=0]
Epoch 51:   0%|          | 0/97 [00:00<?, ?it/s, loss=2.51, v_num=0]
Epoch 52:   0%|          | 0/97 [00:00<?, ?it/s, loss=2.51, v_num=0]
Epoch 52:   1%|          | 1/97 [00:01<02:14,  1.41s/it, loss=2.51, v_num=0]
Epoch 52:   1%|          | 1/97 [00:01<02:20,  1.46s/it, loss=2.51, v_num=0]
Epoch 52:   2%|▏         | 2/97 [00:01<01:13,  1.30it/s, loss=2.51, v_num=0]
Epoch 52:   2%|▏         | 2/97 [00:01<01:15,  1.25it/s, loss=2.51, v_num=0]
Epoch 52:   3%|▎         | 3/97 [00:01<00:52,  1.79it/s, loss=2.51, v_num=0]
Epoch 52:   3%|▎         | 3/97 [00:01<00:54,  1.73it/s, loss=2.51, v_num=0]
Epoch 52:   4%|▍         | 4/97 [00:01<00:42,  2.21it/s, loss=2.51, v_num=0]
Epoch 52:   4%|▍         | 4/97 [00:01<00:43,  2.14it/s, loss=2.51, v_num=0]
Epoch 52:   5%|▌         | 5/97 [00:01<00:35,  2.56it/s, loss=2.51, v_num=0]
Epoch 52:   5%|▌         | 5/97 [00:02<00:36,  2.49it/s, loss=2.51, v_num=0]
Epoch 52:   6%|▌         | 6/97 [00:02<00:31,  2.87it/s, loss=2.51, v_num=0]
Epoch 52:   6%|▌         | 6/97 [00:02<00:32,  2.80it/s, loss=2.51, v_num=0]
Epoch 52:   7%|▋         | 7/97 [00:02<00:28,  3.15it/s, loss=2.51, v_num=0]
Epoch 52:   7%|▋         | 7/97 [00:02<00:29,  3.07it/s, loss=2.52, v_num=0]
Epoch 52:   8%|▊         | 8/97 [00:02<00:26,  3.39it/s, loss=2.52, v_num=0]
Epoch 52:   8%|▊         | 8/97 [00:02<00:26,  3.31it/s, loss=2.51, v_num=0]
Epoch 52:   9%|▉         | 9/97 [00:02<00:24,  3.59it/s, loss=2.51, v_num=0]
Epoch 52:   9%|▉         | 9/97 [00:02<00:25,  3.51it/s, loss=2.5, v_num=0]
Epoch 52:  10%|█         | 10/97 [00:02<00:22,  3.79it/s, loss=2.5, v_num=0]
Epoch 52:  10%|█         | 10/97 [00:02<00:23,  3.71it/s, loss=2.5, v_num=0]
Epoch 52:  11%|█▏        | 11/97 [00:02<00:21,  3.96it/s, loss=2.5, v_num=0]
Epoch 52:  11%|█▏        | 11/97 [00:02<00:22,  3.88it/s, loss=2.5, v_num=0]
Epoch 52:  12%|█▏        | 12/97 [00:02<00:20,  4.12it/s, loss=2.5, v_num=0]
Epoch 52:  12%|█▏        | 12/97 [00:02<00:21,  4.04it/s, loss=2.49, v_num=0]
Epoch 52:  13%|█▎        | 13/97 [00:03<00:19,  4.27it/s, loss=2.49, v_num=0]
Epoch 52:  13%|█▎        | 13/97 [00:03<00:20,  4.19it/s, loss=2.5, v_num=0]
Epoch 52:  14%|█▍        | 14/97 [00:03<00:18,  4.40it/s, loss=2.5, v_num=0]
Epoch 52:  14%|█▍        | 14/97 [00:03<00:19,  4.32it/s, loss=2.49, v_num=0]
Epoch 52:  15%|█▌        | 15/97 [00:03<00:18,  4.52it/s, loss=2.49, v_num=0]
Epoch 52:  15%|█▌        | 15/97 [00:03<00:18,  4.44it/s, loss=2.49, v_num=0]
Epoch 52:  16%|█▋        | 16/97 [00:03<00:17,  4.63it/s, loss=2.49, v_num=0]
Epoch 52:  16%|█▋        | 16/97 [00:03<00:17,  4.56it/s, loss=2.49, v_num=0]
Epoch 52:  18%|█▊        | 17/97 [00:03<00:16,  4.73it/s, loss=2.49, v_num=0]
Epoch 52:  18%|█▊        | 17/97 [00:03<00:17,  4.66it/s, loss=2.49, v_num=0]
Epoch 52:  19%|█▊        | 18/97 [00:03<00:16,  4.83it/s, loss=2.49, v_num=0]
Epoch 52:  19%|█▊        | 18/97 [00:03<00:16,  4.76it/s, loss=2.47, v_num=0]
Epoch 52:  20%|█▉        | 19/97 [00:03<00:15,  4.91it/s, loss=2.47, v_num=0]
Epoch 52:  20%|█▉        | 19/97 [00:03<00:16,  4.84it/s, loss=2.48, v_num=0]
Epoch 52:  21%|██        | 20/97 [00:03<00:15,  5.00it/s, loss=2.48, v_num=0]
Epoch 52:  21%|██        | 20/97 [00:04<00:15,  4.93it/s, loss=2.47, v_num=0]
Epoch 52:  22%|██▏       | 21/97 [00:04<00:14,  5.07it/s, loss=2.47, v_num=0]
Epoch 52:  22%|██▏       | 21/97 [00:04<00:15,  5.01it/s, loss=2.47, v_num=0]
Epoch 52:  23%|██▎       | 22/97 [00:04<00:14,  5.15it/s, loss=2.47, v_num=0]
Epoch 52:  23%|██▎       | 22/97 [00:04<00:14,  5.08it/s, loss=2.48, v_num=0]
Epoch 52:  24%|██▎       | 23/97 [00:04<00:14,  5.21it/s, loss=2.48, v_num=0]
Epoch 52:  24%|██▎       | 23/97 [00:04<00:14,  5.15it/s, loss=2.47, v_num=0]
Epoch 52:  25%|██▍       | 24/97 [00:04<00:13,  5.28it/s, loss=2.47, v_num=0]
Epoch 52:  25%|██▍       | 24/97 [00:04<00:14,  5.21it/s, loss=2.47, v_num=0]
Epoch 52:  26%|██▌       | 25/97 [00:04<00:13,  5.33it/s, loss=2.47, v_num=0]
Epoch 52:  26%|██▌       | 25/97 [00:04<00:13,  5.27it/s, loss=2.47, v_num=0]
Epoch 52:  27%|██▋       | 26/97 [00:04<00:13,  5.39it/s, loss=2.47, v_num=0]
Epoch 52:  27%|██▋       | 26/97 [00:04<00:13,  5.32it/s, loss=2.48, v_num=0]
Epoch 52:  28%|██▊       | 27/97 [00:04<00:12,  5.44it/s, loss=2.48, v_num=0]
Epoch 52:  28%|██▊       | 27/97 [00:05<00:13,  5.38it/s, loss=2.48, v_num=0]
Epoch 52:  29%|██▉       | 28/97 [00:05<00:12,  5.49it/s, loss=2.48, v_num=0]
Epoch 52:  29%|██▉       | 28/97 [00:05<00:12,  5.43it/s, loss=2.49, v_num=0]
Epoch 52:  30%|██▉       | 29/97 [00:05<00:12,  5.54it/s, loss=2.49, v_num=0]
Epoch 52:  30%|██▉       | 29/97 [00:05<00:12,  5.48it/s, loss=2.49, v_num=0]
Epoch 52:  31%|███       | 30/97 [00:05<00:12,  5.58it/s, loss=2.49, v_num=0]
Epoch 52:  31%|███       | 30/97 [00:05<00:12,  5.52it/s, loss=2.49, v_num=0]
Epoch 52:  32%|███▏      | 31/97 [00:05<00:11,  5.62it/s, loss=2.49, v_num=0]
Epoch 52:  32%|███▏      | 31/97 [00:05<00:11,  5.56it/s, loss=2.49, v_num=0]
Epoch 52:  33%|███▎      | 32/97 [00:05<00:11,  5.66it/s, loss=2.49, v_num=0]
Epoch 52:  33%|███▎      | 32/97 [00:05<00:11,  5.60it/s, loss=2.5, v_num=0]
Epoch 52:  34%|███▍      | 33/97 [00:05<00:11,  5.70it/s, loss=2.5, v_num=0]
Epoch 52:  34%|███▍      | 33/97 [00:05<00:11,  5.64it/s, loss=2.5, v_num=0]
Epoch 52:  35%|███▌      | 34/97 [00:05<00:10,  5.73it/s, loss=2.5, v_num=0]
Epoch 52:  35%|███▌      | 34/97 [00:05<00:11,  5.68it/s, loss=2.5, v_num=0]
Epoch 52:  36%|███▌      | 35/97 [00:06<00:10,  5.77it/s, loss=2.5, v_num=0]
Epoch 52:  36%|███▌      | 35/97 [00:06<00:10,  5.72it/s, loss=2.5, v_num=0]
Epoch 52:  37%|███▋      | 36/97 [00:06<00:10,  5.80it/s, loss=2.5, v_num=0]
Epoch 52:  37%|███▋      | 36/97 [00:06<00:10,  5.75it/s, loss=2.5, v_num=0]
Epoch 52:  38%|███▊      | 37/97 [00:06<00:10,  5.84it/s, loss=2.5, v_num=0]
Epoch 52:  38%|███▊      | 37/97 [00:06<00:10,  5.79it/s, loss=2.52, v_num=0]
Epoch 52:  39%|███▉      | 38/97 [00:06<00:10,  5.87it/s, loss=2.52, v_num=0]
Epoch 52:  39%|███▉      | 38/97 [00:06<00:10,  5.82it/s, loss=2.52, v_num=0]
Epoch 52:  40%|████      | 39/97 [00:06<00:09,  5.90it/s, loss=2.52, v_num=0]
Epoch 52:  40%|████      | 39/97 [00:06<00:09,  5.85it/s, loss=2.52, v_num=0]
Epoch 52:  41%|████      | 40/97 [00:06<00:09,  5.92it/s, loss=2.52, v_num=0]
Epoch 52:  41%|████      | 40/97 [00:06<00:09,  5.88it/s, loss=2.52, v_num=0]
Epoch 52:  42%|████▏     | 41/97 [00:06<00:09,  5.95it/s, loss=2.52, v_num=0]
Epoch 52:  42%|████▏     | 41/97 [00:06<00:09,  5.90it/s, loss=2.52, v_num=0]
Epoch 52:  43%|████▎     | 42/97 [00:07<00:09,  5.98it/s, loss=2.52, v_num=0]
Epoch 52:  43%|████▎     | 42/97 [00:07<00:09,  5.93it/s, loss=2.52, v_num=0]
Epoch 52:  44%|████▍     | 43/97 [00:07<00:08,  6.00it/s, loss=2.52, v_num=0]
Epoch 52:  44%|████▍     | 43/97 [00:07<00:09,  5.95it/s, loss=2.53, v_num=0]
Epoch 52:  45%|████▌     | 44/97 [00:07<00:08,  6.03it/s, loss=2.53, v_num=0]
Epoch 52:  45%|████▌     | 44/97 [00:07<00:08,  5.98it/s, loss=2.52, v_num=0]
Epoch 52:  46%|████▋     | 45/97 [00:07<00:08,  6.05it/s, loss=2.52, v_num=0]
Epoch 52:  46%|████▋     | 45/97 [00:07<00:08,  6.00it/s, loss=2.52, v_num=0]
Epoch 52:  47%|████▋     | 46/97 [00:07<00:08,  6.07it/s, loss=2.52, v_num=0]
Epoch 52:  47%|████▋     | 46/97 [00:07<00:08,  6.03it/s, loss=2.51, v_num=0]
Epoch 52:  48%|████▊     | 47/97 [00:07<00:08,  6.09it/s, loss=2.51, v_num=0]
Epoch 52:  48%|████▊     | 47/97 [00:07<00:08,  6.05it/s, loss=2.51, v_num=0]
Epoch 52:  49%|████▉     | 48/97 [00:07<00:08,  6.11it/s, loss=2.51, v_num=0]
Epoch 52:  49%|████▉     | 48/97 [00:07<00:08,  6.07it/s, loss=2.5, v_num=0]
Epoch 52:  51%|█████     | 49/97 [00:07<00:07,  6.13it/s, loss=2.5, v_num=0]
Epoch 52:  51%|█████     | 49/97 [00:08<00:07,  6.09it/s, loss=2.51, v_num=0]
Epoch 52:  52%|█████▏    | 50/97 [00:08<00:07,  6.15it/s, loss=2.51, v_num=0]
Epoch 52:  52%|█████▏    | 50/97 [00:08<00:07,  6.11it/s, loss=2.51, v_num=0]
Epoch 52:  53%|█████▎    | 51/97 [00:08<00:07,  6.17it/s, loss=2.51, v_num=0]
Epoch 52:  53%|█████▎    | 51/97 [00:08<00:07,  6.13it/s, loss=2.5, v_num=0]
Epoch 52:  54%|█████▎    | 52/97 [00:08<00:07,  6.19it/s, loss=2.5, v_num=0]
Epoch 52:  54%|█████▎    | 52/97 [00:08<00:07,  6.15it/s, loss=2.49, v_num=0]
Epoch 52:  55%|█████▍    | 53/97 [00:08<00:07,  6.20it/s, loss=2.49, v_num=0]
Epoch 52:  55%|█████▍    | 53/97 [00:08<00:07,  6.16it/s, loss=2.5, v_num=0]
Epoch 52:  56%|█████▌    | 54/97 [00:08<00:06,  6.22it/s, loss=2.5, v_num=0]
Epoch 52:  56%|█████▌    | 54/97 [00:08<00:06,  6.18it/s, loss=2.49, v_num=0]
Epoch 52:  57%|█████▋    | 55/97 [00:08<00:06,  6.24it/s, loss=2.49, v_num=0]
Epoch 52:  57%|█████▋    | 55/97 [00:08<00:06,  6.20it/s, loss=2.49, v_num=0]
Epoch 52:  58%|█████▊    | 56/97 [00:08<00:06,  6.25it/s, loss=2.49, v_num=0]
Epoch 52:  58%|█████▊    | 56/97 [00:09<00:06,  6.21it/s, loss=2.49, v_num=0]
Epoch 52:  59%|█████▉    | 57/97 [00:09<00:06,  6.27it/s, loss=2.49, v_num=0]
Epoch 52:  59%|█████▉    | 57/97 [00:09<00:06,  6.23it/s, loss=2.48, v_num=0]
Epoch 52:  60%|█████▉    | 58/97 [00:09<00:06,  6.28it/s, loss=2.48, v_num=0]
Epoch 52:  60%|█████▉    | 58/97 [00:09<00:06,  6.25it/s, loss=2.48, v_num=0]
Epoch 52:  61%|██████    | 59/97 [00:09<00:06,  6.30it/s, loss=2.48, v_num=0]
Epoch 52:  61%|██████    | 59/97 [00:09<00:06,  6.26it/s, loss=2.48, v_num=0]
Epoch 52:  62%|██████▏   | 60/97 [00:09<00:05,  6.31it/s, loss=2.48, v_num=0]
Epoch 52:  62%|██████▏   | 60/97 [00:09<00:05,  6.27it/s, loss=2.47, v_num=0]
Epoch 52:  63%|██████▎   | 61/97 [00:09<00:05,  6.32it/s, loss=2.47, v_num=0]
Epoch 52:  63%|██████▎   | 61/97 [00:09<00:05,  6.29it/s, loss=2.47, v_num=0]
Epoch 52:  64%|██████▍   | 62/97 [00:09<00:05,  6.34it/s, loss=2.47, v_num=0]
Epoch 52:  64%|██████▍   | 62/97 [00:09<00:05,  6.30it/s, loss=2.47, v_num=0]
Epoch 52:  65%|██████▍   | 63/97 [00:09<00:05,  6.35it/s, loss=2.47, v_num=0]
Epoch 52:  65%|██████▍   | 63/97 [00:09<00:05,  6.32it/s, loss=2.47, v_num=0]
Epoch 52:  66%|██████▌   | 64/97 [00:10<00:05,  6.37it/s, loss=2.47, v_num=0]
Epoch 52:  66%|██████▌   | 64/97 [00:10<00:05,  6.33it/s, loss=2.48, v_num=0]
Epoch 52:  67%|██████▋   | 65/97 [00:10<00:05,  6.38it/s, loss=2.48, v_num=0]
Epoch 52:  67%|██████▋   | 65/97 [00:10<00:05,  6.34it/s, loss=2.47, v_num=0]
Epoch 52:  68%|██████▊   | 66/97 [00:10<00:04,  6.39it/s, loss=2.47, v_num=0]
Epoch 52:  68%|██████▊   | 66/97 [00:10<00:04,  6.35it/s, loss=2.47, v_num=0]
Epoch 52:  69%|██████▉   | 67/97 [00:10<00:04,  6.40it/s, loss=2.47, v_num=0]
Epoch 52:  69%|██████▉   | 67/97 [00:10<00:04,  6.37it/s, loss=2.47, v_num=0]
Epoch 52:  70%|███████   | 68/97 [00:10<00:04,  6.41it/s, loss=2.47, v_num=0]
Epoch 52:  70%|███████   | 68/97 [00:10<00:04,  6.38it/s, loss=2.47, v_num=0]
Epoch 52:  71%|███████   | 69/97 [00:10<00:04,  6.42it/s, loss=2.47, v_num=0]
Epoch 52:  71%|███████   | 69/97 [00:10<00:04,  6.39it/s, loss=2.47, v_num=0]
Epoch 52:  72%|███████▏  | 70/97 [00:10<00:04,  6.44it/s, loss=2.47, v_num=0]
Epoch 52:  72%|███████▏  | 70/97 [00:10<00:04,  6.40it/s, loss=2.46, v_num=0]
Epoch 52:  73%|███████▎  | 71/97 [00:11<00:04,  6.45it/s, loss=2.46, v_num=0]
Epoch 52:  73%|███████▎  | 71/97 [00:11<00:04,  6.41it/s, loss=2.46, v_num=0]
Epoch 52:  74%|███████▍  | 72/97 [00:11<00:03,  6.46it/s, loss=2.46, v_num=0]
Epoch 52:  74%|███████▍  | 72/97 [00:11<00:03,  6.42it/s, loss=2.46, v_num=0]
Epoch 52:  75%|███████▌  | 73/97 [00:11<00:03,  6.47it/s, loss=2.46, v_num=0]
Epoch 52:  75%|███████▌  | 73/97 [00:11<00:03,  6.43it/s, loss=2.46, v_num=0]
Epoch 52:  76%|███████▋  | 74/97 [00:11<00:03,  6.48it/s, loss=2.46, v_num=0]
Epoch 52:  76%|███████▋  | 74/97 [00:11<00:03,  6.45it/s, loss=2.47, v_num=0]
Epoch 52:  77%|███████▋  | 75/97 [00:11<00:03,  6.49it/s, loss=2.47, v_num=0]
Epoch 52:  77%|███████▋  | 75/97 [00:11<00:03,  6.46it/s, loss=2.47, v_num=0]
Epoch 52:  78%|███████▊  | 76/97 [00:11<00:03,  6.50it/s, loss=2.47, v_num=0]
Epoch 52:  78%|███████▊  | 76/97 [00:11<00:03,  6.47it/s, loss=2.47, v_num=0]
Epoch 52:  79%|███████▉  | 77/97 [00:11<00:03,  6.51it/s, loss=2.47, v_num=0]
Epoch 52:  79%|███████▉  | 77/97 [00:11<00:03,  6.48it/s, loss=2.47, v_num=0]
Epoch 52:  80%|████████  | 78/97 [00:11<00:02,  6.52it/s, loss=2.47, v_num=0]
Epoch 52:  80%|████████  | 78/97 [00:12<00:02,  6.48it/s, loss=2.47, v_num=0]
Epoch 52:  81%|████████▏ | 79/97 [00:12<00:02,  6.52it/s, loss=2.47, v_num=0]
Epoch 52:  81%|████████▏ | 79/97 [00:12<00:02,  6.49it/s, loss=2.47, v_num=0]
Epoch 52:  82%|████████▏ | 80/97 [00:12<00:02,  6.53it/s, loss=2.47, v_num=0]
Epoch 52:  82%|████████▏ | 80/97 [00:12<00:02,  6.50it/s, loss=2.47, v_num=0]
Epoch 52:  84%|████████▎ | 81/97 [00:12<00:02,  6.54it/s, loss=2.47, v_num=0]
Epoch 52:  84%|████████▎ | 81/97 [00:12<00:02,  6.51it/s, loss=2.46, v_num=0]
Epoch 52:  85%|████████▍ | 82/97 [00:12<00:02,  6.55it/s, loss=2.46, v_num=0]
Epoch 52:  85%|████████▍ | 82/97 [00:12<00:02,  6.52it/s, loss=2.46, v_num=0]
Epoch 52:  86%|████████▌ | 83/97 [00:12<00:02,  6.56it/s, loss=2.46, v_num=0]
Epoch 52:  86%|████████▌ | 83/97 [00:12<00:02,  6.53it/s, loss=2.46, v_num=0]
Epoch 52:  87%|████████▋ | 84/97 [00:12<00:01,  6.56it/s, loss=2.46, v_num=0]
Epoch 52:  87%|████████▋ | 84/97 [00:12<00:01,  6.53it/s, loss=2.46, v_num=0]
Epoch 52:  88%|████████▊ | 85/97 [00:12<00:01,  6.57it/s, loss=2.46, v_num=0]
Epoch 52:  88%|████████▊ | 85/97 [00:12<00:01,  6.54it/s, loss=2.47, v_num=0]
Epoch 52:  89%|████████▊ | 86/97 [00:13<00:01,  6.58it/s, loss=2.47, v_num=0]
Epoch 52:  89%|████████▊ | 86/97 [00:13<00:01,  6.55it/s, loss=2.47, v_num=0]
Epoch 52:  90%|████████▉ | 87/97 [00:13<00:01,  6.59it/s, loss=2.47, v_num=0]
Epoch 52:  90%|████████▉ | 87/97 [00:13<00:01,  6.56it/s, loss=2.47, v_num=0]
Epoch 52:  91%|█████████ | 88/97 [00:13<00:01,  6.59it/s, loss=2.47, v_num=0]
Epoch 52:  91%|█████████ | 88/97 [00:13<00:01,  6.56it/s, loss=2.47, v_num=0]
Epoch 52:  92%|█████████▏| 89/97 [00:13<00:01,  6.60it/s, loss=2.47, v_num=0]
Epoch 52:  92%|█████████▏| 89/97 [00:13<00:01,  6.57it/s, loss=2.48, v_num=0]
Epoch 52:  93%|█████████▎| 90/97 [00:13<00:01,  6.61it/s, loss=2.48, v_num=0]
Epoch 52:  93%|█████████▎| 90/97 [00:13<00:01,  6.58it/s, loss=2.47, v_num=0]
Epoch 52:  94%|█████████▍| 91/97 [00:13<00:00,  6.62it/s, loss=2.47, v_num=0]
Epoch 52:  94%|█████████▍| 91/97 [00:13<00:00,  6.59it/s, loss=2.48, v_num=0]
Epoch 52:  95%|█████████▍| 92/97 [00:13<00:00,  6.62it/s, loss=2.48, v_num=0]
Epoch 52:  95%|█████████▍| 92/97 [00:13<00:00,  6.59it/s, loss=2.48, v_num=0]
Epoch 52:  96%|█████████▌| 93/97 [00:14<00:00,  6.63it/s, loss=2.48, v_num=0]
Epoch 52:  96%|█████████▌| 93/97 [00:14<00:00,  6.60it/s, loss=2.48, v_num=0]
Epoch 52:  97%|█████████▋| 94/97 [00:14<00:00,  6.63it/s, loss=2.48, v_num=0]
Epoch 52:  97%|█████████▋| 94/97 [00:14<00:00,  6.61it/s, loss=2.48, v_num=0]
Epoch 52:  98%|█████████▊| 95/97 [00:14<00:00,  6.64it/s, loss=2.48, v_num=0]
Epoch 52:  98%|█████████▊| 95/97 [00:14<00:00,  6.61it/s, loss=2.47, v_num=0]
Epoch 52:  99%|█████████▉| 96/97 [00:14<00:00,  6.65it/s, loss=2.47, v_num=0]
Epoch 52:  99%|█████████▉| 96/97 [00:14<00:00,  6.62it/s, loss=2.47, v_num=0]
Epoch 52: 100%|██████████| 97/97 [00:14<00:00,  6.65it/s, loss=2.47, v_num=0]
Epoch 52: 100%|██████████| 97/97 [00:14<00:00,  6.63it/s, loss=2.48, v_num=0]
Epoch 52: 100%|██████████| 97/97 [00:14<00:00,  6.63it/s, loss=2.48, v_num=0]
Epoch 52:   0%|          | 0/97 [00:00<?, ?it/s, loss=2.48, v_num=0]
Epoch 53:   0%|          | 0/97 [00:00<?, ?it/s, loss=2.48, v_num=0]
Epoch 53:   1%|          | 1/97 [00:01<02:12,  1.38s/it, loss=2.48, v_num=0]
Epoch 53:   1%|          | 1/97 [00:01<02:17,  1.43s/it, loss=2.47, v_num=0]
Epoch 53:   2%|▏         | 2/97 [00:01<01:11,  1.32it/s, loss=2.47, v_num=0]
Epoch 53:   2%|▏         | 2/97 [00:01<01:14,  1.27it/s, loss=2.48, v_num=0]
Epoch 53:   3%|▎         | 3/97 [00:01<00:51,  1.81it/s, loss=2.48, v_num=0]
Epoch 53:   3%|▎         | 3/97 [00:01<00:53,  1.75it/s, loss=2.48, v_num=0]
Epoch 53:   4%|▍         | 4/97 [00:01<00:41,  2.23it/s, loss=2.48, v_num=0]
Epoch 53:   4%|▍         | 4/97 [00:01<00:43,  2.16it/s, loss=2.48, v_num=0]
Epoch 53:   5%|▌         | 5/97 [00:01<00:35,  2.59it/s, loss=2.48, v_num=0]
Epoch 53:   5%|▌         | 5/97 [00:01<00:36,  2.52it/s, loss=2.48, v_num=0]
Epoch 53:   6%|▌         | 6/97 [00:02<00:31,  2.90it/s, loss=2.48, v_num=0]
Epoch 53:   6%|▌         | 6/97 [00:02<00:32,  2.82it/s, loss=2.48, v_num=0]
Epoch 53:   7%|▋         | 7/97 [00:02<00:28,  3.18it/s, loss=2.48, v_num=0]
Epoch 53:   7%|▋         | 7/97 [00:02<00:29,  3.10it/s, loss=2.47, v_num=0]
Epoch 53:   8%|▊         | 8/97 [00:02<00:26,  3.42it/s, loss=2.47, v_num=0]
Epoch 53:   8%|▊         | 8/97 [00:02<00:26,  3.34it/s, loss=2.46, v_num=0]
Epoch 53:   9%|▉         | 9/97 [00:02<00:24,  3.63it/s, loss=2.46, v_num=0]
Epoch 53:   9%|▉         | 9/97 [00:02<00:24,  3.55it/s, loss=2.46, v_num=0]
Epoch 53:  10%|█         | 10/97 [00:02<00:22,  3.82it/s, loss=2.46, v_num=0]
Epoch 53:  10%|█         | 10/97 [00:02<00:23,  3.74it/s, loss=2.46, v_num=0]
Epoch 53:  11%|█▏        | 11/97 [00:02<00:21,  3.99it/s, loss=2.46, v_num=0]
Epoch 53:  11%|█▏        | 11/97 [00:02<00:21,  3.91it/s, loss=2.45, v_num=0]
Epoch 53:  12%|█▏        | 12/97 [00:02<00:20,  4.15it/s, loss=2.45, v_num=0]
Epoch 53:  12%|█▏        | 12/97 [00:02<00:20,  4.07it/s, loss=2.46, v_num=0]
Epoch 53:  13%|█▎        | 13/97 [00:03<00:19,  4.29it/s, loss=2.46, v_num=0]
Epoch 53:  13%|█▎        | 13/97 [00:03<00:19,  4.21it/s, loss=2.45, v_num=0]
Epoch 53:  14%|█▍        | 14/97 [00:03<00:18,  4.42it/s, loss=2.45, v_num=0]
Epoch 53:  14%|█▍        | 14/97 [00:03<00:19,  4.35it/s, loss=2.46, v_num=0]
Epoch 53:  15%|█▌        | 15/97 [00:03<00:18,  4.54it/s, loss=2.46, v_num=0]
Epoch 53:  15%|█▌        | 15/97 [00:03<00:18,  4.47it/s, loss=2.46, v_num=0]
Epoch 53:  16%|█▋        | 16/97 [00:03<00:17,  4.65it/s, loss=2.46, v_num=0]
Epoch 53:  16%|█▋        | 16/97 [00:03<00:17,  4.58it/s, loss=2.46, v_num=0]
Epoch 53:  18%|█▊        | 17/97 [00:03<00:16,  4.75it/s, loss=2.46, v_num=0]
Epoch 53:  18%|█▊        | 17/97 [00:03<00:17,  4.68it/s, loss=2.46, v_num=0]
Epoch 53:  19%|█▊        | 18/97 [00:03<00:16,  4.85it/s, loss=2.46, v_num=0]
Epoch 53:  19%|█▊        | 18/97 [00:03<00:16,  4.78it/s, loss=2.46, v_num=0]
Epoch 53:  20%|█▉        | 19/97 [00:03<00:15,  4.93it/s, loss=2.46, v_num=0]
Epoch 53:  20%|█▉        | 19/97 [00:03<00:16,  4.86it/s, loss=2.46, v_num=0]
Epoch 53:  21%|██        | 20/97 [00:03<00:15,  5.02it/s, loss=2.46, v_num=0]
Epoch 53:  21%|██        | 20/97 [00:04<00:15,  4.95it/s, loss=2.46, v_num=0]
Epoch 53:  22%|██▏       | 21/97 [00:04<00:14,  5.09it/s, loss=2.46, v_num=0]
Epoch 53:  22%|██▏       | 21/97 [00:04<00:15,  5.03it/s, loss=2.46, v_num=0]
Epoch 53:  23%|██▎       | 22/97 [00:04<00:14,  5.17it/s, loss=2.46, v_num=0]
Epoch 53:  23%|██▎       | 22/97 [00:04<00:14,  5.10it/s, loss=2.46, v_num=0]
Epoch 53:  24%|██▎       | 23/97 [00:04<00:14,  5.23it/s, loss=2.46, v_num=0]
Epoch 53:  24%|██▎       | 23/97 [00:04<00:14,  5.16it/s, loss=2.46, v_num=0]
Epoch 53:  25%|██▍       | 24/97 [00:04<00:13,  5.29it/s, loss=2.46, v_num=0]
Epoch 53:  25%|██▍       | 24/97 [00:04<00:13,  5.23it/s, loss=2.46, v_num=0]
Epoch 53:  26%|██▌       | 25/97 [00:04<00:13,  5.35it/s, loss=2.46, v_num=0]
Epoch 53:  26%|██▌       | 25/97 [00:04<00:13,  5.29it/s, loss=2.46, v_num=0]
Epoch 53:  27%|██▋       | 26/97 [00:04<00:13,  5.41it/s, loss=2.46, v_num=0]
Epoch 53:  27%|██▋       | 26/97 [00:04<00:13,  5.35it/s, loss=2.47, v_num=0]
Epoch 53:  28%|██▊       | 27/97 [00:04<00:12,  5.46it/s, loss=2.47, v_num=0]
Epoch 53:  28%|██▊       | 27/97 [00:05<00:12,  5.40it/s, loss=2.47, v_num=0]
Epoch 53:  29%|██▉       | 28/97 [00:05<00:12,  5.51it/s, loss=2.47, v_num=0]
Epoch 53:  29%|██▉       | 28/97 [00:05<00:12,  5.45it/s, loss=2.48, v_num=0]
Epoch 53:  30%|██▉       | 29/97 [00:05<00:12,  5.56it/s, loss=2.48, v_num=0]
Epoch 53:  30%|██▉       | 29/97 [00:05<00:12,  5.50it/s, loss=2.48, v_num=0]
Epoch 53:  31%|███       | 30/97 [00:05<00:11,  5.60it/s, loss=2.48, v_num=0]
Epoch 53:  31%|███       | 30/97 [00:05<00:12,  5.54it/s, loss=2.47, v_num=0]
Epoch 53:  32%|███▏      | 31/97 [00:05<00:11,  5.65it/s, loss=2.47, v_num=0]
Epoch 53:  32%|███▏      | 31/97 [00:05<00:11,  5.59it/s, loss=2.48, v_num=0]
Epoch 53:  33%|███▎      | 32/97 [00:05<00:11,  5.68it/s, loss=2.48, v_num=0]
Epoch 53:  33%|███▎      | 32/97 [00:05<00:11,  5.63it/s, loss=2.48, v_num=0]
Epoch 53:  34%|███▍      | 33/97 [00:05<00:11,  5.73it/s, loss=2.48, v_num=0]
Epoch 53:  34%|███▍      | 33/97 [00:05<00:11,  5.67it/s, loss=2.47, v_num=0]
Epoch 53:  35%|███▌      | 34/97 [00:05<00:10,  5.76it/s, loss=2.47, v_num=0]
Epoch 53:  35%|███▌      | 34/97 [00:05<00:11,  5.70it/s, loss=2.47, v_num=0]
Epoch 53:  36%|███▌      | 35/97 [00:06<00:10,  5.80it/s, loss=2.47, v_num=0]
Epoch 53:  36%|███▌      | 35/97 [00:06<00:10,  5.74it/s, loss=2.47, v_num=0]
Epoch 53:  37%|███▋      | 36/97 [00:06<00:10,  5.83it/s, loss=2.47, v_num=0]
Epoch 53:  37%|███▋      | 36/97 [00:06<00:10,  5.77it/s, loss=2.47, v_num=0]
Epoch 53:  38%|███▊      | 37/97 [00:06<00:10,  5.86it/s, loss=2.47, v_num=0]
Epoch 53:  38%|███▊      | 37/97 [00:06<00:10,  5.81it/s, loss=2.47, v_num=0]
Epoch 53:  39%|███▉      | 38/97 [00:06<00:10,  5.89it/s, loss=2.47, v_num=0]
Epoch 53:  39%|███▉      | 38/97 [00:06<00:10,  5.84it/s, loss=2.47, v_num=0]
Epoch 53:  40%|████      | 39/97 [00:06<00:09,  5.92it/s, loss=2.47, v_num=0]
Epoch 53:  40%|████      | 39/97 [00:06<00:09,  5.87it/s, loss=2.47, v_num=0]
Epoch 53:  41%|████      | 40/97 [00:06<00:09,  5.95it/s, loss=2.47, v_num=0]
Epoch 53:  41%|████      | 40/97 [00:06<00:09,  5.90it/s, loss=2.47, v_num=0]
Epoch 53:  42%|████▏     | 41/97 [00:06<00:09,  5.97it/s, loss=2.47, v_num=0]
Epoch 53:  42%|████▏     | 41/97 [00:06<00:09,  5.93it/s, loss=2.47, v_num=0]
Epoch 53:  43%|████▎     | 42/97 [00:07<00:09,  6.00it/s, loss=2.47, v_num=0]
Epoch 53:  43%|████▎     | 42/97 [00:07<00:09,  5.95it/s, loss=2.46, v_num=0]
Epoch 53:  44%|████▍     | 43/97 [00:07<00:08,  6.02it/s, loss=2.46, v_num=0]
Epoch 53:  44%|████▍     | 43/97 [00:07<00:09,  5.98it/s, loss=2.47, v_num=0]
Epoch 53:  45%|████▌     | 44/97 [00:07<00:08,  6.05it/s, loss=2.47, v_num=0]
Epoch 53:  45%|████▌     | 44/97 [00:07<00:08,  6.00it/s, loss=2.46, v_num=0]
Epoch 53:  46%|████▋     | 45/97 [00:07<00:08,  6.07it/s, loss=2.46, v_num=0]
Epoch 53:  46%|████▋     | 45/97 [00:07<00:08,  6.03it/s, loss=2.46, v_num=0]
Epoch 53:  47%|████▋     | 46/97 [00:07<00:08,  6.09it/s, loss=2.46, v_num=0]
Epoch 53:  47%|████▋     | 46/97 [00:07<00:08,  6.05it/s, loss=2.47, v_num=0]
Epoch 53:  48%|████▊     | 47/97 [00:07<00:08,  6.12it/s, loss=2.47, v_num=0]
Epoch 53:  48%|████▊     | 47/97 [00:07<00:08,  6.07it/s, loss=2.46, v_num=0]
Epoch 53:  49%|████▉     | 48/97 [00:07<00:07,  6.13it/s, loss=2.46, v_num=0]
Epoch 53:  49%|████▉     | 48/97 [00:07<00:08,  6.09it/s, loss=2.45, v_num=0]
Epoch 53:  51%|█████     | 49/97 [00:07<00:07,  6.15it/s, loss=2.45, v_num=0]
Epoch 53:  51%|█████     | 49/97 [00:08<00:07,  6.11it/s, loss=2.46, v_num=0]
Epoch 53:  52%|█████▏    | 50/97 [00:08<00:07,  6.17it/s, loss=2.46, v_num=0]
Epoch 53:  52%|█████▏    | 50/97 [00:08<00:07,  6.13it/s, loss=2.45, v_num=0]
Epoch 53:  53%|█████▎    | 51/97 [00:08<00:07,  6.19it/s, loss=2.45, v_num=0]
Epoch 53:  53%|█████▎    | 51/97 [00:08<00:07,  6.15it/s, loss=2.44, v_num=0]
Epoch 53:  54%|█████▎    | 52/97 [00:08<00:07,  6.20it/s, loss=2.44, v_num=0]
Epoch 53:  54%|█████▎    | 52/97 [00:08<00:07,  6.16it/s, loss=2.44, v_num=0]
Epoch 53:  55%|█████▍    | 53/97 [00:08<00:07,  6.22it/s, loss=2.44, v_num=0]
Epoch 53:  55%|█████▍    | 53/97 [00:08<00:07,  6.18it/s, loss=2.44, v_num=0]
Epoch 53:  56%|█████▌    | 54/97 [00:08<00:06,  6.24it/s, loss=2.44, v_num=0]
Epoch 53:  56%|█████▌    | 54/97 [00:08<00:06,  6.20it/s, loss=2.45, v_num=0]
Epoch 53:  57%|█████▋    | 55/97 [00:08<00:06,  6.25it/s, loss=2.45, v_num=0]
Epoch 53:  57%|█████▋    | 55/97 [00:08<00:06,  6.21it/s, loss=2.45, v_num=0]
Epoch 53:  58%|█████▊    | 56/97 [00:08<00:06,  6.27it/s, loss=2.45, v_num=0]
Epoch 53:  58%|█████▊    | 56/97 [00:08<00:06,  6.23it/s, loss=2.45, v_num=0]
Epoch 53:  59%|█████▉    | 57/97 [00:09<00:06,  6.28it/s, loss=2.45, v_num=0]
Epoch 53:  59%|█████▉    | 57/97 [00:09<00:06,  6.24it/s, loss=2.45, v_num=0]
Epoch 53:  60%|█████▉    | 58/97 [00:09<00:06,  6.30it/s, loss=2.45, v_num=0]
Epoch 53:  60%|█████▉    | 58/97 [00:09<00:06,  6.26it/s, loss=2.44, v_num=0]
Epoch 53:  61%|██████    | 59/97 [00:09<00:06,  6.31it/s, loss=2.44, v_num=0]
Epoch 53:  61%|██████    | 59/97 [00:09<00:06,  6.27it/s, loss=2.44, v_num=0]
Epoch 53:  62%|██████▏   | 60/97 [00:09<00:05,  6.32it/s, loss=2.44, v_num=0]
Epoch 53:  62%|██████▏   | 60/97 [00:09<00:05,  6.29it/s, loss=2.45, v_num=0]
Epoch 53:  63%|██████▎   | 61/97 [00:09<00:05,  6.34it/s, loss=2.45, v_num=0]
Epoch 53:  63%|██████▎   | 61/97 [00:09<00:05,  6.30it/s, loss=2.44, v_num=0]
Epoch 53:  64%|██████▍   | 62/97 [00:09<00:05,  6.35it/s, loss=2.44, v_num=0]
Epoch 53:  64%|██████▍   | 62/97 [00:09<00:05,  6.32it/s, loss=2.43, v_num=0]
Epoch 53:  65%|██████▍   | 63/97 [00:09<00:05,  6.36it/s, loss=2.43, v_num=0]
Epoch 53:  65%|██████▍   | 63/97 [00:09<00:05,  6.33it/s, loss=2.43, v_num=0]
Epoch 53:  66%|██████▌   | 64/97 [00:10<00:05,  6.38it/s, loss=2.43, v_num=0]
Epoch 53:  66%|██████▌   | 64/97 [00:10<00:05,  6.34it/s, loss=2.44, v_num=0]
Epoch 53:  67%|██████▋   | 65/97 [00:10<00:05,  6.39it/s, loss=2.44, v_num=0]
Epoch 53:  67%|██████▋   | 65/97 [00:10<00:05,  6.36it/s, loss=2.44, v_num=0]
Epoch 53:  68%|██████▊   | 66/97 [00:10<00:04,  6.40it/s, loss=2.44, v_num=0]
Epoch 53:  68%|██████▊   | 66/97 [00:10<00:04,  6.37it/s, loss=2.43, v_num=0]
Epoch 53:  69%|██████▉   | 67/97 [00:10<00:04,  6.41it/s, loss=2.43, v_num=0]
Epoch 53:  69%|██████▉   | 67/97 [00:10<00:04,  6.38it/s, loss=2.43, v_num=0]
Epoch 53:  70%|███████   | 68/97 [00:10<00:04,  6.42it/s, loss=2.43, v_num=0]
Epoch 53:  70%|███████   | 68/97 [00:10<00:04,  6.39it/s, loss=2.43, v_num=0]
Epoch 53:  71%|███████   | 69/97 [00:10<00:04,  6.44it/s, loss=2.43, v_num=0]
Epoch 53:  71%|███████   | 69/97 [00:10<00:04,  6.40it/s, loss=2.43, v_num=0]
Epoch 53:  72%|███████▏  | 70/97 [00:10<00:04,  6.45it/s, loss=2.43, v_num=0]
Epoch 53:  72%|███████▏  | 70/97 [00:10<00:04,  6.41it/s, loss=2.44, v_num=0]
Epoch 53:  73%|███████▎  | 71/97 [00:10<00:04,  6.46it/s, loss=2.44, v_num=0]
Epoch 53:  73%|███████▎  | 71/97 [00:11<00:04,  6.43it/s, loss=2.45, v_num=0]
Epoch 53:  74%|███████▍  | 72/97 [00:11<00:03,  6.47it/s, loss=2.45, v_num=0]
Epoch 53:  74%|███████▍  | 72/97 [00:11<00:03,  6.44it/s, loss=2.45, v_num=0]
Epoch 53:  75%|███████▌  | 73/97 [00:11<00:03,  6.48it/s, loss=2.45, v_num=0]
Epoch 53:  75%|███████▌  | 73/97 [00:11<00:03,  6.45it/s, loss=2.46, v_num=0]
Epoch 53:  76%|███████▋  | 74/97 [00:11<00:03,  6.49it/s, loss=2.46, v_num=0]
Epoch 53:  76%|███████▋  | 74/97 [00:11<00:03,  6.46it/s, loss=2.45, v_num=0]
Epoch 53:  77%|███████▋  | 75/97 [00:11<00:03,  6.50it/s, loss=2.45, v_num=0]
Epoch 53:  77%|███████▋  | 75/97 [00:11<00:03,  6.47it/s, loss=2.45, v_num=0]
Epoch 53:  78%|███████▊  | 76/97 [00:11<00:03,  6.51it/s, loss=2.45, v_num=0]
Epoch 53:  78%|███████▊  | 76/97 [00:11<00:03,  6.48it/s, loss=2.45, v_num=0]
Epoch 53:  79%|███████▉  | 77/97 [00:11<00:03,  6.52it/s, loss=2.45, v_num=0]
Epoch 53:  79%|███████▉  | 77/97 [00:11<00:03,  6.49it/s, loss=2.46, v_num=0]
Epoch 53:  80%|████████  | 78/97 [00:11<00:02,  6.53it/s, loss=2.46, v_num=0]
Epoch 53:  80%|████████  | 78/97 [00:12<00:02,  6.50it/s, loss=2.46, v_num=0]
Epoch 53:  81%|████████▏ | 79/97 [00:12<00:02,  6.53it/s, loss=2.46, v_num=0]
Epoch 53:  81%|████████▏ | 79/97 [00:12<00:02,  6.50it/s, loss=2.46, v_num=0]
Epoch 53:  82%|████████▏ | 80/97 [00:12<00:02,  6.54it/s, loss=2.46, v_num=0]
Epoch 53:  82%|████████▏ | 80/97 [00:12<00:02,  6.51it/s, loss=2.46, v_num=0]
Epoch 53:  84%|████████▎ | 81/97 [00:12<00:02,  6.55it/s, loss=2.46, v_num=0]
Epoch 53:  84%|████████▎ | 81/97 [00:12<00:02,  6.52it/s, loss=2.46, v_num=0]
Epoch 53:  85%|████████▍ | 82/97 [00:12<00:02,  6.56it/s, loss=2.46, v_num=0]
Epoch 53:  85%|████████▍ | 82/97 [00:12<00:02,  6.53it/s, loss=2.47, v_num=0]
Epoch 53:  86%|████████▌ | 83/97 [00:12<00:02,  6.57it/s, loss=2.47, v_num=0]
Epoch 53:  86%|████████▌ | 83/97 [00:12<00:02,  6.54it/s, loss=2.46, v_num=0]
Epoch 53:  87%|████████▋ | 84/97 [00:12<00:01,  6.58it/s, loss=2.46, v_num=0]
Epoch 53:  87%|████████▋ | 84/97 [00:12<00:01,  6.54it/s, loss=2.46, v_num=0]
Epoch 53:  88%|████████▊ | 85/97 [00:12<00:01,  6.58it/s, loss=2.46, v_num=0]
Epoch 53:  88%|████████▊ | 85/97 [00:12<00:01,  6.55it/s, loss=2.46, v_num=0]
Epoch 53:  89%|████████▊ | 86/97 [00:13<00:01,  6.59it/s, loss=2.46, v_num=0]
Epoch 53:  89%|████████▊ | 86/97 [00:13<00:01,  6.56it/s, loss=2.46, v_num=0]
Epoch 53:  90%|████████▉ | 87/97 [00:13<00:01,  6.59it/s, loss=2.46, v_num=0]
Epoch 53:  90%|████████▉ | 87/97 [00:13<00:01,  6.57it/s, loss=2.45, v_num=0]
Epoch 53:  91%|█████████ | 88/97 [00:13<00:01,  6.60it/s, loss=2.45, v_num=0]
Epoch 53:  91%|█████████ | 88/97 [00:13<00:01,  6.57it/s, loss=2.46, v_num=0]
Epoch 53:  92%|█████████▏| 89/97 [00:13<00:01,  6.61it/s, loss=2.46, v_num=0]
Epoch 53:  92%|█████████▏| 89/97 [00:13<00:01,  6.58it/s, loss=2.45, v_num=0]
Epoch 53:  93%|█████████▎| 90/97 [00:13<00:01,  6.62it/s, loss=2.45, v_num=0]
Epoch 53:  93%|█████████▎| 90/97 [00:13<00:01,  6.59it/s, loss=2.45, v_num=0]
Epoch 53:  94%|█████████▍| 91/97 [00:13<00:00,  6.62it/s, loss=2.45, v_num=0]
Epoch 53:  94%|█████████▍| 91/97 [00:13<00:00,  6.60it/s, loss=2.44, v_num=0]
Epoch 53:  95%|█████████▍| 92/97 [00:13<00:00,  6.63it/s, loss=2.44, v_num=0]
Epoch 53:  95%|█████████▍| 92/97 [00:13<00:00,  6.60it/s, loss=2.44, v_num=0]
Epoch 53:  96%|█████████▌| 93/97 [00:14<00:00,  6.64it/s, loss=2.44, v_num=0]
Epoch 53:  96%|█████████▌| 93/97 [00:14<00:00,  6.61it/s, loss=2.43, v_num=0]
Epoch 53:  97%|█████████▋| 94/97 [00:14<00:00,  6.64it/s, loss=2.43, v_num=0]
Epoch 53:  97%|█████████▋| 94/97 [00:14<00:00,  6.61it/s, loss=2.44, v_num=0]
Epoch 53:  98%|█████████▊| 95/97 [00:14<00:00,  6.65it/s, loss=2.44, v_num=0]
Epoch 53:  98%|█████████▊| 95/97 [00:14<00:00,  6.62it/s, loss=2.44, v_num=0]
Epoch 53:  99%|█████████▉| 96/97 [00:14<00:00,  6.65it/s, loss=2.44, v_num=0]
Epoch 53:  99%|█████████▉| 96/97 [00:14<00:00,  6.63it/s, loss=2.43, v_num=0]
Epoch 53: 100%|██████████| 97/97 [00:14<00:00,  6.66it/s, loss=2.43, v_num=0]
Epoch 53: 100%|██████████| 97/97 [00:14<00:00,  6.63it/s, loss=2.43, v_num=0]
Epoch 53: 100%|██████████| 97/97 [00:14<00:00,  6.63it/s, loss=2.43, v_num=0]
Epoch 53:   0%|          | 0/97 [00:00<?, ?it/s, loss=2.43, v_num=0]
Epoch 54:   0%|          | 0/97 [00:00<?, ?it/s, loss=2.43, v_num=0]
Epoch 54:   1%|          | 1/97 [00:01<02:14,  1.40s/it, loss=2.43, v_num=0]
Epoch 54:   1%|          | 1/97 [00:01<02:19,  1.46s/it, loss=2.43, v_num=0]
Epoch 54:   2%|▏         | 2/97 [00:01<01:13,  1.30it/s, loss=2.43, v_num=0]
Epoch 54:   2%|▏         | 2/97 [00:01<01:15,  1.25it/s, loss=2.43, v_num=0]
Epoch 54:   3%|▎         | 3/97 [00:01<00:52,  1.78it/s, loss=2.43, v_num=0]
Epoch 54:   3%|▎         | 3/97 [00:01<00:54,  1.73it/s, loss=2.43, v_num=0]
Epoch 54:   4%|▍         | 4/97 [00:01<00:42,  2.20it/s, loss=2.43, v_num=0]
Epoch 54:   4%|▍         | 4/97 [00:01<00:43,  2.14it/s, loss=2.43, v_num=0]
Epoch 54:   5%|▌         | 5/97 [00:01<00:36,  2.55it/s, loss=2.43, v_num=0]
Epoch 54:   5%|▌         | 5/97 [00:02<00:37,  2.48it/s, loss=2.44, v_num=0]
Epoch 54:   6%|▌         | 6/97 [00:02<00:31,  2.86it/s, loss=2.44, v_num=0]
Epoch 54:   6%|▌         | 6/97 [00:02<00:32,  2.79it/s, loss=2.44, v_num=0]
Epoch 54:   7%|▋         | 7/97 [00:02<00:28,  3.14it/s, loss=2.44, v_num=0]
Epoch 54:   7%|▋         | 7/97 [00:02<00:29,  3.06it/s, loss=2.44, v_num=0]
Epoch 54:   8%|▊         | 8/97 [00:02<00:26,  3.38it/s, loss=2.44, v_num=0]
Epoch 54:   8%|▊         | 8/97 [00:02<00:26,  3.30it/s, loss=2.44, v_num=0]
Epoch 54:   9%|▉         | 9/97 [00:02<00:24,  3.59it/s, loss=2.44, v_num=0]
Epoch 54:   9%|▉         | 9/97 [00:02<00:25,  3.52it/s, loss=2.44, v_num=0]
Epoch 54:  10%|█         | 10/97 [00:02<00:22,  3.79it/s, loss=2.44, v_num=0]
Epoch 54:  10%|█         | 10/97 [00:02<00:23,  3.71it/s, loss=2.44, v_num=0]
Epoch 54:  11%|█▏        | 11/97 [00:02<00:21,  3.96it/s, loss=2.44, v_num=0]
Epoch 54:  11%|█▏        | 11/97 [00:02<00:22,  3.88it/s, loss=2.44, v_num=0]
Epoch 54:  12%|█▏        | 12/97 [00:02<00:20,  4.12it/s, loss=2.44, v_num=0]
Epoch 54:  12%|█▏        | 12/97 [00:02<00:21,  4.04it/s, loss=2.44, v_num=0]
Epoch 54:  13%|█▎        | 13/97 [00:03<00:19,  4.26it/s, loss=2.44, v_num=0]
Epoch 54:  13%|█▎        | 13/97 [00:03<00:20,  4.18it/s, loss=2.44, v_num=0]
Epoch 54:  14%|█▍        | 14/97 [00:03<00:18,  4.39it/s, loss=2.44, v_num=0]
Epoch 54:  14%|█▍        | 14/97 [00:03<00:19,  4.31it/s, loss=2.43, v_num=0]
Epoch 54:  15%|█▌        | 15/97 [00:03<00:18,  4.51it/s, loss=2.43, v_num=0]
Epoch 54:  15%|█▌        | 15/97 [00:03<00:18,  4.43it/s, loss=2.43, v_num=0]
Epoch 54:  16%|█▋        | 16/97 [00:03<00:17,  4.62it/s, loss=2.43, v_num=0]
Epoch 54:  16%|█▋        | 16/97 [00:03<00:17,  4.55it/s, loss=2.43, v_num=0]
Epoch 54:  18%|█▊        | 17/97 [00:03<00:16,  4.71it/s, loss=2.43, v_num=0]
Epoch 54:  18%|█▊        | 17/97 [00:03<00:17,  4.64it/s, loss=2.43, v_num=0]
Epoch 54:  19%|█▊        | 18/97 [00:03<00:16,  4.81it/s, loss=2.43, v_num=0]
Epoch 54:  19%|█▊        | 18/97 [00:03<00:16,  4.74it/s, loss=2.43, v_num=0]
Epoch 54:  20%|█▉        | 19/97 [00:03<00:15,  4.90it/s, loss=2.43, v_num=0]
Epoch 54:  20%|█▉        | 19/97 [00:03<00:16,  4.83it/s, loss=2.43, v_num=0]
Epoch 54:  21%|██        | 20/97 [00:04<00:15,  4.98it/s, loss=2.43, v_num=0]
Epoch 54:  21%|██        | 20/97 [00:04<00:15,  4.91it/s, loss=2.43, v_num=0]
Epoch 54:  22%|██▏       | 21/97 [00:04<00:15,  5.06it/s, loss=2.43, v_num=0]
Epoch 54:  22%|██▏       | 21/97 [00:04<00:15,  4.99it/s, loss=2.42, v_num=0]
Epoch 54:  23%|██▎       | 22/97 [00:04<00:14,  5.13it/s, loss=2.42, v_num=0]
Epoch 54:  23%|██▎       | 22/97 [00:04<00:14,  5.06it/s, loss=2.42, v_num=0]
Epoch 54:  24%|██▎       | 23/97 [00:04<00:14,  5.20it/s, loss=2.42, v_num=0]
Epoch 54:  24%|██▎       | 23/97 [00:04<00:14,  5.13it/s, loss=2.42, v_num=0]
Epoch 54:  25%|██▍       | 24/97 [00:04<00:13,  5.26it/s, loss=2.42, v_num=0]
Epoch 54:  25%|██▍       | 24/97 [00:04<00:14,  5.19it/s, loss=2.41, v_num=0]
Epoch 54:  26%|██▌       | 25/97 [00:04<00:13,  5.31it/s, loss=2.41, v_num=0]
Epoch 54:  26%|██▌       | 25/97 [00:04<00:13,  5.25it/s, loss=2.41, v_num=0]
Epoch 54:  27%|██▋       | 26/97 [00:04<00:13,  5.36it/s, loss=2.41, v_num=0]
Epoch 54:  27%|██▋       | 26/97 [00:04<00:13,  5.30it/s, loss=2.41, v_num=0]
Epoch 54:  28%|██▊       | 27/97 [00:04<00:12,  5.42it/s, loss=2.41, v_num=0]
Epoch 54:  28%|██▊       | 27/97 [00:05<00:13,  5.36it/s, loss=2.41, v_num=0]
Epoch 54:  29%|██▉       | 28/97 [00:05<00:12,  5.47it/s, loss=2.41, v_num=0]
Epoch 54:  29%|██▉       | 28/97 [00:05<00:12,  5.41it/s, loss=2.41, v_num=0]
Epoch 54:  30%|██▉       | 29/97 [00:05<00:12,  5.52it/s, loss=2.41, v_num=0]
Epoch 54:  30%|██▉       | 29/97 [00:05<00:12,  5.46it/s, loss=2.41, v_num=0]
Epoch 54:  31%|███       | 30/97 [00:05<00:12,  5.57it/s, loss=2.41, v_num=0]
Epoch 54:  31%|███       | 30/97 [00:05<00:12,  5.51it/s, loss=2.42, v_num=0]
Epoch 54:  32%|███▏      | 31/97 [00:05<00:11,  5.60it/s, loss=2.42, v_num=0]
Epoch 54:  32%|███▏      | 31/97 [00:05<00:11,  5.55it/s, loss=2.42, v_num=0]
Epoch 54:  33%|███▎      | 32/97 [00:05<00:11,  5.65it/s, loss=2.42, v_num=0]
Epoch 54:  33%|███▎      | 32/97 [00:05<00:11,  5.59it/s, loss=2.42, v_num=0]
Epoch 54:  34%|███▍      | 33/97 [00:05<00:11,  5.68it/s, loss=2.42, v_num=0]
Epoch 54:  34%|███▍      | 33/97 [00:05<00:11,  5.63it/s, loss=2.42, v_num=0]
Epoch 54:  35%|███▌      | 34/97 [00:05<00:11,  5.72it/s, loss=2.42, v_num=0]
Epoch 54:  35%|███▌      | 34/97 [00:05<00:11,  5.67it/s, loss=2.42, v_num=0]
Epoch 54:  36%|███▌      | 35/97 [00:06<00:10,  5.76it/s, loss=2.42, v_num=0]
Epoch 54:  36%|███▌      | 35/97 [00:06<00:10,  5.71it/s, loss=2.43, v_num=0]
Epoch 54:  37%|███▋      | 36/97 [00:06<00:10,  5.80it/s, loss=2.43, v_num=0]
Epoch 54:  37%|███▋      | 36/97 [00:06<00:10,  5.74it/s, loss=2.43, v_num=0]
Epoch 54:  38%|███▊      | 37/97 [00:06<00:10,  5.83it/s, loss=2.43, v_num=0]
Epoch 54:  38%|███▊      | 37/97 [00:06<00:10,  5.77it/s, loss=2.43, v_num=0]
Epoch 54:  39%|███▉      | 38/97 [00:06<00:10,  5.85it/s, loss=2.43, v_num=0]
Epoch 54:  39%|███▉      | 38/97 [00:06<00:10,  5.80it/s, loss=2.43, v_num=0]
Epoch 54:  40%|████      | 39/97 [00:06<00:09,  5.88it/s, loss=2.43, v_num=0]
Epoch 54:  40%|████      | 39/97 [00:06<00:09,  5.83it/s, loss=2.43, v_num=0]
Epoch 54:  41%|████      | 40/97 [00:06<00:09,  5.91it/s, loss=2.43, v_num=0]
Epoch 54:  41%|████      | 40/97 [00:06<00:09,  5.86it/s, loss=2.43, v_num=0]
Epoch 54:  42%|████▏     | 41/97 [00:06<00:09,  5.93it/s, loss=2.43, v_num=0]
Epoch 54:  42%|████▏     | 41/97 [00:06<00:09,  5.89it/s, loss=2.43, v_num=0]
Epoch 54:  43%|████▎     | 42/97 [00:07<00:09,  5.96it/s, loss=2.43, v_num=0]
Epoch 54:  43%|████▎     | 42/97 [00:07<00:09,  5.91it/s, loss=2.43, v_num=0]
Epoch 54:  44%|████▍     | 43/97 [00:07<00:09,  5.99it/s, loss=2.43, v_num=0]
Epoch 54:  44%|████▍     | 43/97 [00:07<00:09,  5.94it/s, loss=2.44, v_num=0]
Epoch 54:  45%|████▌     | 44/97 [00:07<00:08,  6.01it/s, loss=2.44, v_num=0]
Epoch 54:  45%|████▌     | 44/97 [00:07<00:08,  5.97it/s, loss=2.44, v_num=0]
Epoch 54:  46%|████▋     | 45/97 [00:07<00:08,  6.03it/s, loss=2.44, v_num=0]
Epoch 54:  46%|████▋     | 45/97 [00:07<00:08,  5.99it/s, loss=2.44, v_num=0]
Epoch 54:  47%|████▋     | 46/97 [00:07<00:08,  6.06it/s, loss=2.44, v_num=0]
Epoch 54:  47%|████▋     | 46/97 [00:07<00:08,  6.01it/s, loss=2.44, v_num=0]
Epoch 54:  48%|████▊     | 47/97 [00:07<00:08,  6.08it/s, loss=2.44, v_num=0]
Epoch 54:  48%|████▊     | 47/97 [00:07<00:08,  6.03it/s, loss=2.43, v_num=0]
Epoch 54:  49%|████▉     | 48/97 [00:07<00:08,  6.10it/s, loss=2.43, v_num=0]
Epoch 54:  49%|████▉     | 48/97 [00:07<00:08,  6.06it/s, loss=2.43, v_num=0]
Epoch 54:  51%|█████     | 49/97 [00:08<00:07,  6.11it/s, loss=2.43, v_num=0]
Epoch 54:  51%|█████     | 49/97 [00:08<00:07,  6.07it/s, loss=2.43, v_num=0]
Epoch 54:  52%|█████▏    | 50/97 [00:08<00:07,  6.13it/s, loss=2.43, v_num=0]
Epoch 54:  52%|█████▏    | 50/97 [00:08<00:07,  6.09it/s, loss=2.43, v_num=0]
Epoch 54:  53%|█████▎    | 51/97 [00:08<00:07,  6.15it/s, loss=2.43, v_num=0]
Epoch 54:  53%|█████▎    | 51/97 [00:08<00:07,  6.11it/s, loss=2.43, v_num=0]
Epoch 54:  54%|█████▎    | 52/97 [00:08<00:07,  6.17it/s, loss=2.43, v_num=0]
Epoch 54:  54%|█████▎    | 52/97 [00:08<00:07,  6.13it/s, loss=2.42, v_num=0]
Epoch 54:  55%|█████▍    | 53/97 [00:08<00:07,  6.19it/s, loss=2.42, v_num=0]
Epoch 54:  55%|█████▍    | 53/97 [00:08<00:07,  6.15it/s, loss=2.43, v_num=0]
Epoch 54:  56%|█████▌    | 54/97 [00:08<00:06,  6.21it/s, loss=2.43, v_num=0]
Epoch 54:  56%|█████▌    | 54/97 [00:08<00:06,  6.17it/s, loss=2.43, v_num=0]
Epoch 54:  57%|█████▋    | 55/97 [00:08<00:06,  6.22it/s, loss=2.43, v_num=0]
Epoch 54:  57%|█████▋    | 55/97 [00:08<00:06,  6.18it/s, loss=2.42, v_num=0]
Epoch 54:  58%|█████▊    | 56/97 [00:08<00:06,  6.24it/s, loss=2.42, v_num=0]
Epoch 54:  58%|█████▊    | 56/97 [00:09<00:06,  6.20it/s, loss=2.42, v_num=0]
Epoch 54:  59%|█████▉    | 57/97 [00:09<00:06,  6.25it/s, loss=2.42, v_num=0]
Epoch 54:  59%|█████▉    | 57/97 [00:09<00:06,  6.22it/s, loss=2.42, v_num=0]
Epoch 54:  60%|█████▉    | 58/97 [00:09<00:06,  6.27it/s, loss=2.42, v_num=0]
Epoch 54:  60%|█████▉    | 58/97 [00:09<00:06,  6.23it/s, loss=2.42, v_num=0]
Epoch 54:  61%|██████    | 59/97 [00:09<00:06,  6.29it/s, loss=2.42, v_num=0]
Epoch 54:  61%|██████    | 59/97 [00:09<00:06,  6.25it/s, loss=2.42, v_num=0]
Epoch 54:  62%|██████▏   | 60/97 [00:09<00:05,  6.30it/s, loss=2.42, v_num=0]
Epoch 54:  62%|██████▏   | 60/97 [00:09<00:05,  6.26it/s, loss=2.41, v_num=0]
Epoch 54:  63%|██████▎   | 61/97 [00:09<00:05,  6.32it/s, loss=2.41, v_num=0]
Epoch 54:  63%|██████▎   | 61/97 [00:09<00:05,  6.28it/s, loss=2.42, v_num=0]
Epoch 54:  64%|██████▍   | 62/97 [00:09<00:05,  6.33it/s, loss=2.42, v_num=0]
Epoch 54:  64%|██████▍   | 62/97 [00:09<00:05,  6.29it/s, loss=2.42, v_num=0]
Epoch 54:  65%|██████▍   | 63/97 [00:09<00:05,  6.34it/s, loss=2.42, v_num=0]
Epoch 54:  65%|██████▍   | 63/97 [00:09<00:05,  6.30it/s, loss=2.41, v_num=0]
Epoch 54:  66%|██████▌   | 64/97 [00:10<00:05,  6.35it/s, loss=2.41, v_num=0]
Epoch 54:  66%|██████▌   | 64/97 [00:10<00:05,  6.32it/s, loss=2.41, v_num=0]
Epoch 54:  67%|██████▋   | 65/97 [00:10<00:05,  6.36it/s, loss=2.41, v_num=0]
Epoch 54:  67%|██████▋   | 65/97 [00:10<00:05,  6.33it/s, loss=2.41, v_num=0]
Epoch 54:  68%|██████▊   | 66/97 [00:10<00:04,  6.38it/s, loss=2.41, v_num=0]
Epoch 54:  68%|██████▊   | 66/97 [00:10<00:04,  6.34it/s, loss=2.41, v_num=0]
Epoch 54:  69%|██████▉   | 67/97 [00:10<00:04,  6.39it/s, loss=2.41, v_num=0]
Epoch 54:  69%|██████▉   | 67/97 [00:10<00:04,  6.35it/s, loss=2.41, v_num=0]
Epoch 54:  70%|███████   | 68/97 [00:10<00:04,  6.40it/s, loss=2.41, v_num=0]
Epoch 54:  70%|███████   | 68/97 [00:10<00:04,  6.36it/s, loss=2.41, v_num=0]
Epoch 54:  71%|███████   | 69/97 [00:10<00:04,  6.41it/s, loss=2.41, v_num=0]
Epoch 54:  71%|███████   | 69/97 [00:10<00:04,  6.38it/s, loss=2.41, v_num=0]
Epoch 54:  72%|███████▏  | 70/97 [00:10<00:04,  6.42it/s, loss=2.41, v_num=0]
Epoch 54:  72%|███████▏  | 70/97 [00:10<00:04,  6.39it/s, loss=2.4, v_num=0]
Epoch 54:  73%|███████▎  | 71/97 [00:11<00:04,  6.43it/s, loss=2.4, v_num=0]
Epoch 54:  73%|███████▎  | 71/97 [00:11<00:04,  6.40it/s, loss=2.4, v_num=0]
Epoch 54:  74%|███████▍  | 72/97 [00:11<00:03,  6.44it/s, loss=2.4, v_num=0]
Epoch 54:  74%|███████▍  | 72/97 [00:11<00:03,  6.41it/s, loss=2.41, v_num=0]
Epoch 54:  75%|███████▌  | 73/97 [00:11<00:03,  6.45it/s, loss=2.41, v_num=0]
Epoch 54:  75%|███████▌  | 73/97 [00:11<00:03,  6.42it/s, loss=2.41, v_num=0]
Epoch 54:  76%|███████▋  | 74/97 [00:11<00:03,  6.46it/s, loss=2.41, v_num=0]
Epoch 54:  76%|███████▋  | 74/97 [00:11<00:03,  6.43it/s, loss=2.41, v_num=0]
Epoch 54:  77%|███████▋  | 75/97 [00:11<00:03,  6.47it/s, loss=2.41, v_num=0]
Epoch 54:  77%|███████▋  | 75/97 [00:11<00:03,  6.44it/s, loss=2.41, v_num=0]
Epoch 54:  78%|███████▊  | 76/97 [00:11<00:03,  6.48it/s, loss=2.41, v_num=0]
Epoch 54:  78%|███████▊  | 76/97 [00:11<00:03,  6.45it/s, loss=2.41, v_num=0]
Epoch 54:  79%|███████▉  | 77/97 [00:11<00:03,  6.49it/s, loss=2.41, v_num=0]
Epoch 54:  79%|███████▉  | 77/97 [00:11<00:03,  6.46it/s, loss=2.4, v_num=0]
Epoch 54:  80%|████████  | 78/97 [00:11<00:02,  6.50it/s, loss=2.4, v_num=0]
Epoch 54:  80%|████████  | 78/97 [00:12<00:02,  6.47it/s, loss=2.41, v_num=0]
Epoch 54:  81%|████████▏ | 79/97 [00:12<00:02,  6.51it/s, loss=2.41, v_num=0]
Epoch 54:  81%|████████▏ | 79/97 [00:12<00:02,  6.48it/s, loss=2.41, v_num=0]
Epoch 54:  82%|████████▏ | 80/97 [00:12<00:02,  6.52it/s, loss=2.41, v_num=0]
Epoch 54:  82%|████████▏ | 80/97 [00:12<00:02,  6.49it/s, loss=2.41, v_num=0]
Epoch 54:  84%|████████▎ | 81/97 [00:12<00:02,  6.53it/s, loss=2.41, v_num=0]
Epoch 54:  84%|████████▎ | 81/97 [00:12<00:02,  6.50it/s, loss=2.41, v_num=0]
Epoch 54:  85%|████████▍ | 82/97 [00:12<00:02,  6.53it/s, loss=2.41, v_num=0]
Epoch 54:  85%|████████▍ | 82/97 [00:12<00:02,  6.50it/s, loss=2.41, v_num=0]
Epoch 54:  86%|████████▌ | 83/97 [00:12<00:02,  6.54it/s, loss=2.41, v_num=0]
Epoch 54:  86%|████████▌ | 83/97 [00:12<00:02,  6.51it/s, loss=2.41, v_num=0]
Epoch 54:  87%|████████▋ | 84/97 [00:12<00:01,  6.55it/s, loss=2.41, v_num=0]
Epoch 54:  87%|████████▋ | 84/97 [00:12<00:01,  6.52it/s, loss=2.42, v_num=0]
Epoch 54:  88%|████████▊ | 85/97 [00:12<00:01,  6.56it/s, loss=2.42, v_num=0]
Epoch 54:  88%|████████▊ | 85/97 [00:13<00:01,  6.53it/s, loss=2.42, v_num=0]
Epoch 54:  89%|████████▊ | 86/97 [00:13<00:01,  6.57it/s, loss=2.42, v_num=0]
Epoch 54:  89%|████████▊ | 86/97 [00:13<00:01,  6.54it/s, loss=2.43, v_num=0]
Epoch 54:  90%|████████▉ | 87/97 [00:13<00:01,  6.57it/s, loss=2.43, v_num=0]
Epoch 54:  90%|████████▉ | 87/97 [00:13<00:01,  6.54it/s, loss=2.43, v_num=0]
Epoch 54:  91%|█████████ | 88/97 [00:13<00:01,  6.58it/s, loss=2.43, v_num=0]
Epoch 54:  91%|█████████ | 88/97 [00:13<00:01,  6.55it/s, loss=2.42, v_num=0]
Epoch 54:  92%|█████████▏| 89/97 [00:13<00:01,  6.59it/s, loss=2.42, v_num=0]
Epoch 54:  92%|█████████▏| 89/97 [00:13<00:01,  6.56it/s, loss=2.42, v_num=0]
Epoch 54:  93%|█████████▎| 90/97 [00:13<00:01,  6.60it/s, loss=2.42, v_num=0]
Epoch 54:  93%|█████████▎| 90/97 [00:13<00:01,  6.57it/s, loss=2.42, v_num=0]
Epoch 54:  94%|█████████▍| 91/97 [00:13<00:00,  6.60it/s, loss=2.42, v_num=0]
Epoch 54:  94%|█████████▍| 91/97 [00:13<00:00,  6.57it/s, loss=2.42, v_num=0]
Epoch 54:  95%|█████████▍| 92/97 [00:13<00:00,  6.61it/s, loss=2.42, v_num=0]
Epoch 54:  95%|█████████▍| 92/97 [00:13<00:00,  6.58it/s, loss=2.42, v_num=0]
Epoch 54:  96%|█████████▌| 93/97 [00:14<00:00,  6.62it/s, loss=2.42, v_num=0]
Epoch 54:  96%|█████████▌| 93/97 [00:14<00:00,  6.59it/s, loss=2.41, v_num=0]
Epoch 54:  97%|█████████▋| 94/97 [00:14<00:00,  6.62it/s, loss=2.41, v_num=0]
Epoch 54:  97%|█████████▋| 94/97 [00:14<00:00,  6.60it/s, loss=2.42, v_num=0]
Epoch 54:  98%|█████████▊| 95/97 [00:14<00:00,  6.63it/s, loss=2.42, v_num=0]
Epoch 54:  98%|█████████▊| 95/97 [00:14<00:00,  6.60it/s, loss=2.43, v_num=0]
Epoch 54:  99%|█████████▉| 96/97 [00:14<00:00,  6.64it/s, loss=2.43, v_num=0]
Epoch 54:  99%|█████████▉| 96/97 [00:14<00:00,  6.61it/s, loss=2.42, v_num=0]
Epoch 54: 100%|██████████| 97/97 [00:14<00:00,  6.64it/s, loss=2.42, v_num=0]
Epoch 54: 100%|██████████| 97/97 [00:14<00:00,  6.62it/s, loss=2.43, v_num=0]
Epoch 54: 100%|██████████| 97/97 [00:14<00:00,  6.62it/s, loss=2.43, v_num=0]
Epoch 54:   0%|          | 0/97 [00:00<?, ?it/s, loss=2.43, v_num=0]
Epoch 55:   0%|          | 0/97 [00:00<?, ?it/s, loss=2.43, v_num=0]
Epoch 55:   1%|          | 1/97 [00:01<02:12,  1.39s/it, loss=2.43, v_num=0]
Epoch 55:   1%|          | 1/97 [00:01<02:18,  1.44s/it, loss=2.43, v_num=0]
Epoch 55:   2%|▏         | 2/97 [00:01<01:12,  1.31it/s, loss=2.43, v_num=0]
Epoch 55:   2%|▏         | 2/97 [00:01<01:14,  1.27it/s, loss=2.43, v_num=0]
Epoch 55:   3%|▎         | 3/97 [00:01<00:52,  1.80it/s, loss=2.43, v_num=0]
Epoch 55:   3%|▎         | 3/97 [00:01<00:53,  1.75it/s, loss=2.43, v_num=0]
Epoch 55:   4%|▍         | 4/97 [00:01<00:41,  2.22it/s, loss=2.43, v_num=0]
Epoch 55:   4%|▍         | 4/97 [00:01<00:43,  2.16it/s, loss=2.42, v_num=0]
Epoch 55:   5%|▌         | 5/97 [00:01<00:35,  2.58it/s, loss=2.42, v_num=0]
Epoch 55:   5%|▌         | 5/97 [00:01<00:36,  2.51it/s, loss=2.42, v_num=0]
Epoch 55:   6%|▌         | 6/97 [00:02<00:31,  2.90it/s, loss=2.42, v_num=0]
Epoch 55:   6%|▌         | 6/97 [00:02<00:32,  2.82it/s, loss=2.42, v_num=0]
Epoch 55:   7%|▋         | 7/97 [00:02<00:28,  3.17it/s, loss=2.42, v_num=0]
Epoch 55:   7%|▋         | 7/97 [00:02<00:29,  3.09it/s, loss=2.42, v_num=0]
Epoch 55:   8%|▊         | 8/97 [00:02<00:26,  3.41it/s, loss=2.42, v_num=0]
Epoch 55:   8%|▊         | 8/97 [00:02<00:26,  3.33it/s, loss=2.42, v_num=0]
Epoch 55:   9%|▉         | 9/97 [00:02<00:24,  3.62it/s, loss=2.42, v_num=0]
Epoch 55:   9%|▉         | 9/97 [00:02<00:24,  3.55it/s, loss=2.42, v_num=0]
Epoch 55:  10%|█         | 10/97 [00:02<00:22,  3.82it/s, loss=2.42, v_num=0]
Epoch 55:  10%|█         | 10/97 [00:02<00:23,  3.74it/s, loss=2.43, v_num=0]
Epoch 55:  11%|█▏        | 11/97 [00:02<00:21,  3.99it/s, loss=2.43, v_num=0]
Epoch 55:  11%|█▏        | 11/97 [00:02<00:21,  3.91it/s, loss=2.43, v_num=0]
Epoch 55:  12%|█▏        | 12/97 [00:02<00:20,  4.14it/s, loss=2.43, v_num=0]
Epoch 55:  12%|█▏        | 12/97 [00:02<00:20,  4.07it/s, loss=2.43, v_num=0]
Epoch 55:  13%|█▎        | 13/97 [00:03<00:19,  4.29it/s, loss=2.43, v_num=0]
Epoch 55:  13%|█▎        | 13/97 [00:03<00:19,  4.21it/s, loss=2.43, v_num=0]
Epoch 55:  14%|█▍        | 14/97 [00:03<00:18,  4.42it/s, loss=2.43, v_num=0]
Epoch 55:  14%|█▍        | 14/97 [00:03<00:19,  4.34it/s, loss=2.42, v_num=0]
Epoch 55:  15%|█▌        | 15/97 [00:03<00:18,  4.54it/s, loss=2.42, v_num=0]
Epoch 55:  15%|█▌        | 15/97 [00:03<00:18,  4.46it/s, loss=2.43, v_num=0]
Epoch 55:  16%|█▋        | 16/97 [00:03<00:17,  4.65it/s, loss=2.43, v_num=0]
Epoch 55:  16%|█▋        | 16/97 [00:03<00:17,  4.57it/s, loss=2.43, v_num=0]
Epoch 55:  18%|█▊        | 17/97 [00:03<00:16,  4.75it/s, loss=2.43, v_num=0]
Epoch 55:  18%|█▊        | 17/97 [00:03<00:17,  4.67it/s, loss=2.42, v_num=0]
Epoch 55:  19%|█▊        | 18/97 [00:03<00:16,  4.85it/s, loss=2.42, v_num=0]
Epoch 55:  19%|█▊        | 18/97 [00:03<00:16,  4.77it/s, loss=2.42, v_num=0]
Epoch 55:  20%|█▉        | 19/97 [00:03<00:15,  4.93it/s, loss=2.42, v_num=0]
Epoch 55:  20%|█▉        | 19/97 [00:03<00:16,  4.86it/s, loss=2.42, v_num=0]
Epoch 55:  21%|██        | 20/97 [00:03<00:15,  5.02it/s, loss=2.42, v_num=0]
Epoch 55:  21%|██        | 20/97 [00:04<00:15,  4.94it/s, loss=2.42, v_num=0]
Epoch 55:  22%|██▏       | 21/97 [00:04<00:14,  5.09it/s, loss=2.42, v_num=0]
Epoch 55:  22%|██▏       | 21/97 [00:04<00:15,  5.02it/s, loss=2.42, v_num=0]
Epoch 55:  23%|██▎       | 22/97 [00:04<00:14,  5.16it/s, loss=2.42, v_num=0]
Epoch 55:  23%|██▎       | 22/97 [00:04<00:14,  5.09it/s, loss=2.42, v_num=0]
Epoch 55:  24%|██▎       | 23/97 [00:04<00:14,  5.23it/s, loss=2.42, v_num=0]
Epoch 55:  24%|██▎       | 23/97 [00:04<00:14,  5.16it/s, loss=2.42, v_num=0]
Epoch 55:  25%|██▍       | 24/97 [00:04<00:13,  5.29it/s, loss=2.42, v_num=0]
Epoch 55:  25%|██▍       | 24/97 [00:04<00:13,  5.22it/s, loss=2.42, v_num=0]
Epoch 55:  26%|██▌       | 25/97 [00:04<00:13,  5.34it/s, loss=2.42, v_num=0]
Epoch 55:  26%|██▌       | 25/97 [00:04<00:13,  5.28it/s, loss=2.42, v_num=0]
Epoch 55:  27%|██▋       | 26/97 [00:04<00:13,  5.41it/s, loss=2.42, v_num=0]
Epoch 55:  27%|██▋       | 26/97 [00:04<00:13,  5.34it/s, loss=2.42, v_num=0]
Epoch 55:  28%|██▊       | 27/97 [00:04<00:12,  5.46it/s, loss=2.42, v_num=0]
Epoch 55:  28%|██▊       | 27/97 [00:05<00:12,  5.39it/s, loss=2.42, v_num=0]
Epoch 55:  29%|██▉       | 28/97 [00:05<00:12,  5.51it/s, loss=2.42, v_num=0]
Epoch 55:  29%|██▉       | 28/97 [00:05<00:12,  5.45it/s, loss=2.42, v_num=0]
Epoch 55:  30%|██▉       | 29/97 [00:05<00:12,  5.55it/s, loss=2.42, v_num=0]
Epoch 55:  30%|██▉       | 29/97 [00:05<00:12,  5.49it/s, loss=2.42, v_num=0]
Epoch 55:  31%|███       | 30/97 [00:05<00:11,  5.59it/s, loss=2.42, v_num=0]
Epoch 55:  31%|███       | 30/97 [00:05<00:12,  5.53it/s, loss=2.41, v_num=0]
Epoch 55:  32%|███▏      | 31/97 [00:05<00:11,  5.63it/s, loss=2.41, v_num=0]
Epoch 55:  32%|███▏      | 31/97 [00:05<00:11,  5.58it/s, loss=2.41, v_num=0]
Epoch 55:  33%|███▎      | 32/97 [00:05<00:11,  5.68it/s, loss=2.41, v_num=0]
Epoch 55:  33%|███▎      | 32/97 [00:05<00:11,  5.62it/s, loss=2.41, v_num=0]
Epoch 55:  34%|███▍      | 33/97 [00:05<00:11,  5.71it/s, loss=2.41, v_num=0]
Epoch 55:  34%|███▍      | 33/97 [00:05<00:11,  5.66it/s, loss=2.42, v_num=0]
Epoch 55:  35%|███▌      | 34/97 [00:05<00:10,  5.75it/s, loss=2.42, v_num=0]
Epoch 55:  35%|███▌      | 34/97 [00:05<00:11,  5.70it/s, loss=2.42, v_num=0]
Epoch 55:  36%|███▌      | 35/97 [00:06<00:10,  5.79it/s, loss=2.42, v_num=0]
Epoch 55:  36%|███▌      | 35/97 [00:06<00:10,  5.73it/s, loss=2.41, v_num=0]
Epoch 55:  37%|███▋      | 36/97 [00:06<00:10,  5.82it/s, loss=2.41, v_num=0]
Epoch 55:  37%|███▋      | 36/97 [00:06<00:10,  5.77it/s, loss=2.4, v_num=0]
Epoch 55:  38%|███▊      | 37/97 [00:06<00:10,  5.85it/s, loss=2.4, v_num=0]
Epoch 55:  38%|███▊      | 37/97 [00:06<00:10,  5.80it/s, loss=2.4, v_num=0]
Epoch 55:  39%|███▉      | 38/97 [00:06<00:10,  5.88it/s, loss=2.4, v_num=0]
Epoch 55:  39%|███▉      | 38/97 [00:06<00:10,  5.83it/s, loss=2.41, v_num=0]
Epoch 55:  40%|████      | 39/97 [00:06<00:09,  5.91it/s, loss=2.41, v_num=0]
Epoch 55:  40%|████      | 39/97 [00:06<00:09,  5.86it/s, loss=2.41, v_num=0]
Epoch 55:  41%|████      | 40/97 [00:06<00:09,  5.93it/s, loss=2.41, v_num=0]
Epoch 55:  41%|████      | 40/97 [00:06<00:09,  5.89it/s, loss=2.41, v_num=0]
Epoch 55:  42%|████▏     | 41/97 [00:06<00:09,  5.96it/s, loss=2.41, v_num=0]
Epoch 55:  42%|████▏     | 41/97 [00:06<00:09,  5.91it/s, loss=2.41, v_num=0]
Epoch 55:  43%|████▎     | 42/97 [00:07<00:09,  5.99it/s, loss=2.41, v_num=0]
Epoch 55:  43%|████▎     | 42/97 [00:07<00:09,  5.94it/s, loss=2.41, v_num=0]
Epoch 55:  44%|████▍     | 43/97 [00:07<00:08,  6.01it/s, loss=2.41, v_num=0]
Epoch 55:  44%|████▍     | 43/97 [00:07<00:09,  5.97it/s, loss=2.41, v_num=0]
Epoch 55:  45%|████▌     | 44/97 [00:07<00:08,  6.04it/s, loss=2.41, v_num=0]
Epoch 55:  45%|████▌     | 44/97 [00:07<00:08,  5.99it/s, loss=2.41, v_num=0]
Epoch 55:  46%|████▋     | 45/97 [00:07<00:08,  6.06it/s, loss=2.41, v_num=0]
Epoch 55:  46%|████▋     | 45/97 [00:07<00:08,  6.01it/s, loss=2.4, v_num=0]
Epoch 55:  47%|████▋     | 46/97 [00:07<00:08,  6.08it/s, loss=2.4, v_num=0]
Epoch 55:  47%|████▋     | 46/97 [00:07<00:08,  6.03it/s, loss=2.4, v_num=0]
Epoch 55:  48%|████▊     | 47/97 [00:07<00:08,  6.10it/s, loss=2.4, v_num=0]
Epoch 55:  48%|████▊     | 47/97 [00:07<00:08,  6.06it/s, loss=2.4, v_num=0]
Epoch 55:  49%|████▉     | 48/97 [00:07<00:08,  6.12it/s, loss=2.4, v_num=0]
Epoch 55:  49%|████▉     | 48/97 [00:07<00:08,  6.08it/s, loss=2.4, v_num=0]
Epoch 55:  51%|█████     | 49/97 [00:07<00:07,  6.14it/s, loss=2.4, v_num=0]
Epoch 55:  51%|█████     | 49/97 [00:08<00:07,  6.10it/s, loss=2.39, v_num=0]
Epoch 55:  52%|█████▏    | 50/97 [00:08<00:07,  6.16it/s, loss=2.39, v_num=0]
Epoch 55:  52%|█████▏    | 50/97 [00:08<00:07,  6.12it/s, loss=2.4, v_num=0]
Epoch 55:  53%|█████▎    | 51/97 [00:08<00:07,  6.18it/s, loss=2.4, v_num=0]
Epoch 55:  53%|█████▎    | 51/97 [00:08<00:07,  6.14it/s, loss=2.4, v_num=0]
Epoch 55:  54%|█████▎    | 52/97 [00:08<00:07,  6.20it/s, loss=2.4, v_num=0]
Epoch 55:  54%|█████▎    | 52/97 [00:08<00:07,  6.16it/s, loss=2.4, v_num=0]
Epoch 55:  55%|█████▍    | 53/97 [00:08<00:07,  6.21it/s, loss=2.4, v_num=0]
Epoch 55:  55%|█████▍    | 53/97 [00:08<00:07,  6.17it/s, loss=2.39, v_num=0]
Epoch 55:  56%|█████▌    | 54/97 [00:08<00:06,  6.23it/s, loss=2.39, v_num=0]
Epoch 55:  56%|█████▌    | 54/97 [00:08<00:06,  6.19it/s, loss=2.39, v_num=0]
Epoch 55:  57%|█████▋    | 55/97 [00:08<00:06,  6.24it/s, loss=2.39, v_num=0]
Epoch 55:  57%|█████▋    | 55/97 [00:08<00:06,  6.21it/s, loss=2.39, v_num=0]
Epoch 55:  58%|█████▊    | 56/97 [00:08<00:06,  6.26it/s, loss=2.39, v_num=0]
Epoch 55:  58%|█████▊    | 56/97 [00:09<00:06,  6.22it/s, loss=2.39, v_num=0]
Epoch 55:  59%|█████▉    | 57/97 [00:09<00:06,  6.28it/s, loss=2.39, v_num=0]
Epoch 55:  59%|█████▉    | 57/97 [00:09<00:06,  6.24it/s, loss=2.39, v_num=0]
Epoch 55:  60%|█████▉    | 58/97 [00:09<00:06,  6.29it/s, loss=2.39, v_num=0]
Epoch 55:  60%|█████▉    | 58/97 [00:09<00:06,  6.25it/s, loss=2.4, v_num=0]
Epoch 55:  61%|██████    | 59/97 [00:09<00:06,  6.31it/s, loss=2.4, v_num=0]
Epoch 55:  61%|██████    | 59/97 [00:09<00:06,  6.27it/s, loss=2.4, v_num=0]
Epoch 55:  62%|██████▏   | 60/97 [00:09<00:05,  6.32it/s, loss=2.4, v_num=0]
Epoch 55:  62%|██████▏   | 60/97 [00:09<00:05,  6.28it/s, loss=2.4, v_num=0]
Epoch 55:  63%|██████▎   | 61/97 [00:09<00:05,  6.33it/s, loss=2.4, v_num=0]
Epoch 55:  63%|██████▎   | 61/97 [00:09<00:05,  6.30it/s, loss=2.41, v_num=0]
Epoch 55:  64%|██████▍   | 62/97 [00:09<00:05,  6.35it/s, loss=2.41, v_num=0]
Epoch 55:  64%|██████▍   | 62/97 [00:09<00:05,  6.31it/s, loss=2.41, v_num=0]
Epoch 55:  65%|██████▍   | 63/97 [00:09<00:05,  6.36it/s, loss=2.41, v_num=0]
Epoch 55:  65%|██████▍   | 63/97 [00:09<00:05,  6.32it/s, loss=2.41, v_num=0]
Epoch 55:  66%|██████▌   | 64/97 [00:10<00:05,  6.37it/s, loss=2.41, v_num=0]
Epoch 55:  66%|██████▌   | 64/97 [00:10<00:05,  6.34it/s, loss=2.41, v_num=0]
Epoch 55:  67%|██████▋   | 65/97 [00:10<00:05,  6.39it/s, loss=2.41, v_num=0]
Epoch 55:  67%|██████▋   | 65/97 [00:10<00:05,  6.35it/s, loss=2.41, v_num=0]
Epoch 55:  68%|██████▊   | 66/97 [00:10<00:04,  6.40it/s, loss=2.41, v_num=0]
Epoch 55:  68%|██████▊   | 66/97 [00:10<00:04,  6.36it/s, loss=2.42, v_num=0]
Epoch 55:  69%|██████▉   | 67/97 [00:10<00:04,  6.41it/s, loss=2.42, v_num=0]
Epoch 55:  69%|██████▉   | 67/97 [00:10<00:04,  6.38it/s, loss=2.42, v_num=0]
Epoch 55:  70%|███████   | 68/97 [00:10<00:04,  6.42it/s, loss=2.42, v_num=0]
Epoch 55:  70%|███████   | 68/97 [00:10<00:04,  6.38it/s, loss=2.42, v_num=0]
Epoch 55:  71%|███████   | 69/97 [00:10<00:04,  6.43it/s, loss=2.42, v_num=0]
Epoch 55:  71%|███████   | 69/97 [00:10<00:04,  6.40it/s, loss=2.42, v_num=0]
Epoch 55:  72%|███████▏  | 70/97 [00:10<00:04,  6.44it/s, loss=2.42, v_num=0]
Epoch 55:  72%|███████▏  | 70/97 [00:10<00:04,  6.41it/s, loss=2.42, v_num=0]
Epoch 55:  73%|███████▎  | 71/97 [00:11<00:04,  6.45it/s, loss=2.42, v_num=0]
Epoch 55:  73%|███████▎  | 71/97 [00:11<00:04,  6.42it/s, loss=2.42, v_num=0]
Epoch 55:  74%|███████▍  | 72/97 [00:11<00:03,  6.46it/s, loss=2.42, v_num=0]
Epoch 55:  74%|███████▍  | 72/97 [00:11<00:03,  6.43it/s, loss=2.42, v_num=0]
Epoch 55:  75%|███████▌  | 73/97 [00:11<00:03,  6.47it/s, loss=2.42, v_num=0]
Epoch 55:  75%|███████▌  | 73/97 [00:11<00:03,  6.44it/s, loss=2.42, v_num=0]
Epoch 55:  76%|███████▋  | 74/97 [00:11<00:03,  6.48it/s, loss=2.42, v_num=0]
Epoch 55:  76%|███████▋  | 74/97 [00:11<00:03,  6.45it/s, loss=2.42, v_num=0]
Epoch 55:  77%|███████▋  | 75/97 [00:11<00:03,  6.49it/s, loss=2.42, v_num=0]
Epoch 55:  77%|███████▋  | 75/97 [00:11<00:03,  6.46it/s, loss=2.42, v_num=0]
Epoch 55:  78%|███████▊  | 76/97 [00:11<00:03,  6.50it/s, loss=2.42, v_num=0]
Epoch 55:  78%|███████▊  | 76/97 [00:11<00:03,  6.47it/s, loss=2.43, v_num=0]
Epoch 55:  79%|███████▉  | 77/97 [00:11<00:03,  6.51it/s, loss=2.43, v_num=0]
Epoch 55:  79%|███████▉  | 77/97 [00:11<00:03,  6.48it/s, loss=2.43, v_num=0]
Epoch 55:  80%|████████  | 78/97 [00:11<00:02,  6.52it/s, loss=2.43, v_num=0]
Epoch 55:  80%|████████  | 78/97 [00:12<00:02,  6.49it/s, loss=2.43, v_num=0]
Epoch 55:  81%|████████▏ | 79/97 [00:12<00:02,  6.53it/s, loss=2.43, v_num=0]
Epoch 55:  81%|████████▏ | 79/97 [00:12<00:02,  6.50it/s, loss=2.42, v_num=0]
Epoch 55:  82%|████████▏ | 80/97 [00:12<00:02,  6.53it/s, loss=2.42, v_num=0]
Epoch 55:  82%|████████▏ | 80/97 [00:12<00:02,  6.50it/s, loss=2.41, v_num=0]
Epoch 55:  84%|████████▎ | 81/97 [00:12<00:02,  6.54it/s, loss=2.41, v_num=0]
Epoch 55:  84%|████████▎ | 81/97 [00:12<00:02,  6.51it/s, loss=2.41, v_num=0]
Epoch 55:  85%|████████▍ | 82/97 [00:12<00:02,  6.55it/s, loss=2.41, v_num=0]
Epoch 55:  85%|████████▍ | 82/97 [00:12<00:02,  6.52it/s, loss=2.41, v_num=0]
Epoch 55:  86%|████████▌ | 83/97 [00:12<00:02,  6.56it/s, loss=2.41, v_num=0]
Epoch 55:  86%|████████▌ | 83/97 [00:12<00:02,  6.53it/s, loss=2.41, v_num=0]
Epoch 55:  87%|████████▋ | 84/97 [00:12<00:01,  6.57it/s, loss=2.41, v_num=0]
Epoch 55:  87%|████████▋ | 84/97 [00:12<00:01,  6.54it/s, loss=2.4, v_num=0]
Epoch 55:  88%|████████▊ | 85/97 [00:12<00:01,  6.57it/s, loss=2.4, v_num=0]
Epoch 55:  88%|████████▊ | 85/97 [00:12<00:01,  6.55it/s, loss=2.4, v_num=0]
Epoch 55:  89%|████████▊ | 86/97 [00:13<00:01,  6.58it/s, loss=2.4, v_num=0]
Epoch 55:  89%|████████▊ | 86/97 [00:13<00:01,  6.55it/s, loss=2.4, v_num=0]
Epoch 55:  90%|████████▉ | 87/97 [00:13<00:01,  6.59it/s, loss=2.4, v_num=0]
Epoch 55:  90%|████████▉ | 87/97 [00:13<00:01,  6.56it/s, loss=2.4, v_num=0]
Epoch 55:  91%|█████████ | 88/97 [00:13<00:01,  6.60it/s, loss=2.4, v_num=0]
Epoch 55:  91%|█████████ | 88/97 [00:13<00:01,  6.57it/s, loss=2.39, v_num=0]
Epoch 55:  92%|█████████▏| 89/97 [00:13<00:01,  6.60it/s, loss=2.39, v_num=0]
Epoch 55:  92%|█████████▏| 89/97 [00:13<00:01,  6.58it/s, loss=2.39, v_num=0]
Epoch 55:  93%|█████████▎| 90/97 [00:13<00:01,  6.61it/s, loss=2.39, v_num=0]
Epoch 55:  93%|█████████▎| 90/97 [00:13<00:01,  6.59it/s, loss=2.39, v_num=0]
Epoch 55:  94%|█████████▍| 91/97 [00:13<00:00,  6.62it/s, loss=2.39, v_num=0]
Epoch 55:  94%|█████████▍| 91/97 [00:13<00:00,  6.59it/s, loss=2.39, v_num=0]
Epoch 55:  95%|█████████▍| 92/97 [00:13<00:00,  6.63it/s, loss=2.39, v_num=0]
Epoch 55:  95%|█████████▍| 92/97 [00:13<00:00,  6.60it/s, loss=2.39, v_num=0]
Epoch 55:  96%|█████████▌| 93/97 [00:14<00:00,  6.63it/s, loss=2.39, v_num=0]
Epoch 55:  96%|█████████▌| 93/97 [00:14<00:00,  6.61it/s, loss=2.39, v_num=0]
Epoch 55:  97%|█████████▋| 94/97 [00:14<00:00,  6.64it/s, loss=2.39, v_num=0]
Epoch 55:  97%|█████████▋| 94/97 [00:14<00:00,  6.61it/s, loss=2.39, v_num=0]
Epoch 55:  98%|█████████▊| 95/97 [00:14<00:00,  6.64it/s, loss=2.39, v_num=0]
Epoch 55:  98%|█████████▊| 95/97 [00:14<00:00,  6.62it/s, loss=2.39, v_num=0]
Epoch 55:  99%|█████████▉| 96/97 [00:14<00:00,  6.65it/s, loss=2.39, v_num=0]
Epoch 55:  99%|█████████▉| 96/97 [00:14<00:00,  6.63it/s, loss=2.39, v_num=0]
Epoch 55: 100%|██████████| 97/97 [00:14<00:00,  6.66it/s, loss=2.39, v_num=0]
Epoch 55: 100%|██████████| 97/97 [00:14<00:00,  6.63it/s, loss=2.38, v_num=0]
Epoch 55: 100%|██████████| 97/97 [00:14<00:00,  6.63it/s, loss=2.38, v_num=0]
Epoch 55:   0%|          | 0/97 [00:00<?, ?it/s, loss=2.38, v_num=0]
Epoch 56:   0%|          | 0/97 [00:00<?, ?it/s, loss=2.38, v_num=0]
Epoch 56:   1%|          | 1/97 [00:01<02:13,  1.39s/it, loss=2.38, v_num=0]
Epoch 56:   1%|          | 1/97 [00:01<02:18,  1.44s/it, loss=2.38, v_num=0]
Epoch 56:   2%|▏         | 2/97 [00:01<01:12,  1.31it/s, loss=2.38, v_num=0]
Epoch 56:   2%|▏         | 2/97 [00:01<01:15,  1.27it/s, loss=2.38, v_num=0]
Epoch 56:   3%|▎         | 3/97 [00:01<00:52,  1.80it/s, loss=2.38, v_num=0]
Epoch 56:   3%|▎         | 3/97 [00:01<00:54,  1.74it/s, loss=2.38, v_num=0]
Epoch 56:   4%|▍         | 4/97 [00:01<00:41,  2.22it/s, loss=2.38, v_num=0]
Epoch 56:   4%|▍         | 4/97 [00:01<00:43,  2.15it/s, loss=2.38, v_num=0]
Epoch 56:   5%|▌         | 5/97 [00:01<00:35,  2.58it/s, loss=2.38, v_num=0]
Epoch 56:   5%|▌         | 5/97 [00:01<00:36,  2.50it/s, loss=2.39, v_num=0]
Epoch 56:   6%|▌         | 6/97 [00:02<00:31,  2.89it/s, loss=2.39, v_num=0]
Epoch 56:   6%|▌         | 6/97 [00:02<00:32,  2.81it/s, loss=2.4, v_num=0]
Epoch 56:   7%|▋         | 7/97 [00:02<00:28,  3.16it/s, loss=2.4, v_num=0]
Epoch 56:   7%|▋         | 7/97 [00:02<00:29,  3.08it/s, loss=2.4, v_num=0]
Epoch 56:   8%|▊         | 8/97 [00:02<00:26,  3.41it/s, loss=2.4, v_num=0]
Epoch 56:   8%|▊         | 8/97 [00:02<00:26,  3.33it/s, loss=2.4, v_num=0]
Epoch 56:   9%|▉         | 9/97 [00:02<00:24,  3.61it/s, loss=2.4, v_num=0]
Epoch 56:   9%|▉         | 9/97 [00:02<00:24,  3.54it/s, loss=2.4, v_num=0]
Epoch 56:  10%|█         | 10/97 [00:02<00:22,  3.81it/s, loss=2.4, v_num=0]
Epoch 56:  10%|█         | 10/97 [00:02<00:23,  3.73it/s, loss=2.41, v_num=0]
Epoch 56:  11%|█▏        | 11/97 [00:02<00:21,  3.98it/s, loss=2.41, v_num=0]
Epoch 56:  11%|█▏        | 11/97 [00:02<00:22,  3.90it/s, loss=2.42, v_num=0]
Epoch 56:  12%|█▏        | 12/97 [00:02<00:20,  4.14it/s, loss=2.42, v_num=0]
Epoch 56:  12%|█▏        | 12/97 [00:02<00:20,  4.06it/s, loss=2.42, v_num=0]
Epoch 56:  13%|█▎        | 13/97 [00:03<00:19,  4.28it/s, loss=2.42, v_num=0]
Epoch 56:  13%|█▎        | 13/97 [00:03<00:19,  4.20it/s, loss=2.42, v_num=0]
Epoch 56:  14%|█▍        | 14/97 [00:03<00:18,  4.41it/s, loss=2.42, v_num=0]
Epoch 56:  14%|█▍        | 14/97 [00:03<00:19,  4.34it/s, loss=2.42, v_num=0]
Epoch 56:  15%|█▌        | 15/97 [00:03<00:18,  4.53it/s, loss=2.42, v_num=0]
Epoch 56:  15%|█▌        | 15/97 [00:03<00:18,  4.46it/s, loss=2.42, v_num=0]
Epoch 56:  16%|█▋        | 16/97 [00:03<00:17,  4.65it/s, loss=2.42, v_num=0]
Epoch 56:  16%|█▋        | 16/97 [00:03<00:17,  4.57it/s, loss=2.42, v_num=0]
Epoch 56:  18%|█▊        | 17/97 [00:03<00:16,  4.75it/s, loss=2.42, v_num=0]
Epoch 56:  18%|█▊        | 17/97 [00:03<00:17,  4.68it/s, loss=2.43, v_num=0]
Epoch 56:  19%|█▊        | 18/97 [00:03<00:16,  4.84it/s, loss=2.43, v_num=0]
Epoch 56:  19%|█▊        | 18/97 [00:03<00:16,  4.77it/s, loss=2.43, v_num=0]
Epoch 56:  20%|█▉        | 19/97 [00:03<00:15,  4.92it/s, loss=2.43, v_num=0]
Epoch 56:  20%|█▉        | 19/97 [00:03<00:16,  4.85it/s, loss=2.43, v_num=0]
Epoch 56:  21%|██        | 20/97 [00:03<00:15,  5.01it/s, loss=2.43, v_num=0]
Epoch 56:  21%|██        | 20/97 [00:04<00:15,  4.94it/s, loss=2.43, v_num=0]
Epoch 56:  22%|██▏       | 21/97 [00:04<00:14,  5.09it/s, loss=2.43, v_num=0]
Epoch 56:  22%|██▏       | 21/97 [00:04<00:15,  5.01it/s, loss=2.42, v_num=0]
Epoch 56:  23%|██▎       | 22/97 [00:04<00:14,  5.16it/s, loss=2.42, v_num=0]
Epoch 56:  23%|██▎       | 22/97 [00:04<00:14,  5.09it/s, loss=2.43, v_num=0]
Epoch 56:  24%|██▎       | 23/97 [00:04<00:14,  5.22it/s, loss=2.43, v_num=0]
Epoch 56:  24%|██▎       | 23/97 [00:04<00:14,  5.15it/s, loss=2.43, v_num=0]
Epoch 56:  25%|██▍       | 24/97 [00:04<00:13,  5.28it/s, loss=2.43, v_num=0]
Epoch 56:  25%|██▍       | 24/97 [00:04<00:13,  5.22it/s, loss=2.44, v_num=0]
Epoch 56:  26%|██▌       | 25/97 [00:04<00:13,  5.34it/s, loss=2.44, v_num=0]
Epoch 56:  26%|██▌       | 25/97 [00:04<00:13,  5.28it/s, loss=2.43, v_num=0]
Epoch 56:  27%|██▋       | 26/97 [00:04<00:13,  5.40it/s, loss=2.43, v_num=0]
Epoch 56:  27%|██▋       | 26/97 [00:04<00:13,  5.33it/s, loss=2.42, v_num=0]
Epoch 56:  28%|██▊       | 27/97 [00:04<00:12,  5.44it/s, loss=2.42, v_num=0]
Epoch 56:  28%|██▊       | 27/97 [00:05<00:13,  5.38it/s, loss=2.41, v_num=0]
Epoch 56:  29%|██▉       | 28/97 [00:05<00:12,  5.49it/s, loss=2.41, v_num=0]
Epoch 56:  29%|██▉       | 28/97 [00:05<00:12,  5.43it/s, loss=2.42, v_num=0]
Epoch 56:  30%|██▉       | 29/97 [00:05<00:12,  5.54it/s, loss=2.42, v_num=0]
Epoch 56:  30%|██▉       | 29/97 [00:05<00:12,  5.48it/s, loss=2.42, v_num=0]
Epoch 56:  31%|███       | 30/97 [00:05<00:11,  5.58it/s, loss=2.42, v_num=0]
Epoch 56:  31%|███       | 30/97 [00:05<00:12,  5.53it/s, loss=2.41, v_num=0]
Epoch 56:  32%|███▏      | 31/97 [00:05<00:11,  5.63it/s, loss=2.41, v_num=0]
Epoch 56:  32%|███▏      | 31/97 [00:05<00:11,  5.57it/s, loss=2.41, v_num=0]
Epoch 56:  33%|███▎      | 32/97 [00:05<00:11,  5.67it/s, loss=2.41, v_num=0]
Epoch 56:  33%|███▎      | 32/97 [00:05<00:11,  5.61it/s, loss=2.41, v_num=0]
Epoch 56:  34%|███▍      | 33/97 [00:05<00:11,  5.70it/s, loss=2.41, v_num=0]
Epoch 56:  34%|███▍      | 33/97 [00:05<00:11,  5.65it/s, loss=2.41, v_num=0]
Epoch 56:  35%|███▌      | 34/97 [00:05<00:10,  5.74it/s, loss=2.41, v_num=0]
Epoch 56:  35%|███▌      | 34/97 [00:05<00:11,  5.69it/s, loss=2.41, v_num=0]
Epoch 56:  36%|███▌      | 35/97 [00:06<00:10,  5.77it/s, loss=2.41, v_num=0]
Epoch 56:  36%|███▌      | 35/97 [00:06<00:10,  5.72it/s, loss=2.42, v_num=0]
Epoch 56:  37%|███▋      | 36/97 [00:06<00:10,  5.81it/s, loss=2.42, v_num=0]
Epoch 56:  37%|███▋      | 36/97 [00:06<00:10,  5.76it/s, loss=2.42, v_num=0]
Epoch 56:  38%|███▊      | 37/97 [00:06<00:10,  5.84it/s, loss=2.42, v_num=0]
Epoch 56:  38%|███▊      | 37/97 [00:06<00:10,  5.79it/s, loss=2.42, v_num=0]
Epoch 56:  39%|███▉      | 38/97 [00:06<00:10,  5.87it/s, loss=2.42, v_num=0]
Epoch 56:  39%|███▉      | 38/97 [00:06<00:10,  5.82it/s, loss=2.42, v_num=0]
Epoch 56:  40%|████      | 39/97 [00:06<00:09,  5.90it/s, loss=2.42, v_num=0]
Epoch 56:  40%|████      | 39/97 [00:06<00:09,  5.85it/s, loss=2.42, v_num=0]
Epoch 56:  41%|████      | 40/97 [00:06<00:09,  5.93it/s, loss=2.42, v_num=0]
Epoch 56:  41%|████      | 40/97 [00:06<00:09,  5.88it/s, loss=2.42, v_num=0]
Epoch 56:  42%|████▏     | 41/97 [00:06<00:09,  5.96it/s, loss=2.42, v_num=0]
Epoch 56:  42%|████▏     | 41/97 [00:06<00:09,  5.91it/s, loss=2.43, v_num=0]
Epoch 56:  43%|████▎     | 42/97 [00:07<00:09,  5.98it/s, loss=2.43, v_num=0]
Epoch 56:  43%|████▎     | 42/97 [00:07<00:09,  5.94it/s, loss=2.42, v_num=0]
Epoch 56:  44%|████▍     | 43/97 [00:07<00:08,  6.01it/s, loss=2.42, v_num=0]
Epoch 56:  44%|████▍     | 43/97 [00:07<00:09,  5.96it/s, loss=2.42, v_num=0]
Epoch 56:  45%|████▌     | 44/97 [00:07<00:08,  6.03it/s, loss=2.42, v_num=0]
Epoch 56:  45%|████▌     | 44/97 [00:07<00:08,  5.99it/s, loss=2.42, v_num=0]
Epoch 56:  46%|████▋     | 45/97 [00:07<00:08,  6.05it/s, loss=2.42, v_num=0]
Epoch 56:  46%|████▋     | 45/97 [00:07<00:08,  6.01it/s, loss=2.42, v_num=0]
Epoch 56:  47%|████▋     | 46/97 [00:07<00:08,  6.08it/s, loss=2.42, v_num=0]
Epoch 56:  47%|████▋     | 46/97 [00:07<00:08,  6.03it/s, loss=2.42, v_num=0]
Epoch 56:  48%|████▊     | 47/97 [00:07<00:08,  6.10it/s, loss=2.42, v_num=0]
Epoch 56:  48%|████▊     | 47/97 [00:07<00:08,  6.05it/s, loss=2.42, v_num=0]
Epoch 56:  49%|████▉     | 48/97 [00:07<00:08,  6.12it/s, loss=2.42, v_num=0]
Epoch 56:  49%|████▉     | 48/97 [00:07<00:08,  6.08it/s, loss=2.42, v_num=0]
Epoch 56:  51%|█████     | 49/97 [00:07<00:07,  6.14it/s, loss=2.42, v_num=0]
Epoch 56:  51%|█████     | 49/97 [00:08<00:07,  6.09it/s, loss=2.42, v_num=0]
Epoch 56:  52%|█████▏    | 50/97 [00:08<00:07,  6.16it/s, loss=2.42, v_num=0]
Epoch 56:  52%|█████▏    | 50/97 [00:08<00:07,  6.11it/s, loss=2.41, v_num=0]
Epoch 56:  53%|█████▎    | 51/97 [00:08<00:07,  6.17it/s, loss=2.41, v_num=0]
Epoch 56:  53%|█████▎    | 51/97 [00:08<00:07,  6.13it/s, loss=2.41, v_num=0]
Epoch 56:  54%|█████▎    | 52/97 [00:08<00:07,  6.19it/s, loss=2.41, v_num=0]
Epoch 56:  54%|█████▎    | 52/97 [00:08<00:07,  6.15it/s, loss=2.41, v_num=0]
Epoch 56:  55%|█████▍    | 53/97 [00:08<00:07,  6.21it/s, loss=2.41, v_num=0]
Epoch 56:  55%|█████▍    | 53/97 [00:08<00:07,  6.17it/s, loss=2.41, v_num=0]
Epoch 56:  56%|█████▌    | 54/97 [00:08<00:06,  6.23it/s, loss=2.41, v_num=0]
Epoch 56:  56%|█████▌    | 54/97 [00:08<00:06,  6.19it/s, loss=2.41, v_num=0]
Epoch 56:  57%|█████▋    | 55/97 [00:08<00:06,  6.24it/s, loss=2.41, v_num=0]
Epoch 56:  57%|█████▋    | 55/97 [00:08<00:06,  6.20it/s, loss=2.4, v_num=0]
Epoch 56:  58%|█████▊    | 56/97 [00:08<00:06,  6.26it/s, loss=2.4, v_num=0]
Epoch 56:  58%|█████▊    | 56/97 [00:09<00:06,  6.22it/s, loss=2.4, v_num=0]
Epoch 56:  59%|█████▉    | 57/97 [00:09<00:06,  6.27it/s, loss=2.4, v_num=0]
Epoch 56:  59%|█████▉    | 57/97 [00:09<00:06,  6.23it/s, loss=2.4, v_num=0]
Epoch 56:  60%|█████▉    | 58/97 [00:09<00:06,  6.29it/s, loss=2.4, v_num=0]
Epoch 56:  60%|█████▉    | 58/97 [00:09<00:06,  6.25it/s, loss=2.4, v_num=0]
Epoch 56:  61%|██████    | 59/97 [00:09<00:06,  6.30it/s, loss=2.4, v_num=0]
Epoch 56:  61%|██████    | 59/97 [00:09<00:06,  6.27it/s, loss=2.4, v_num=0]
Epoch 56:  62%|██████▏   | 60/97 [00:09<00:05,  6.32it/s, loss=2.4, v_num=0]
Epoch 56:  62%|██████▏   | 60/97 [00:09<00:05,  6.28it/s, loss=2.41, v_num=0]
Epoch 56:  63%|██████▎   | 61/97 [00:09<00:05,  6.33it/s, loss=2.41, v_num=0]
Epoch 56:  63%|██████▎   | 61/97 [00:09<00:05,  6.29it/s, loss=2.41, v_num=0]
Epoch 56:  64%|██████▍   | 62/97 [00:09<00:05,  6.34it/s, loss=2.41, v_num=0]
Epoch 56:  64%|██████▍   | 62/97 [00:09<00:05,  6.31it/s, loss=2.41, v_num=0]
Epoch 56:  65%|██████▍   | 63/97 [00:09<00:05,  6.36it/s, loss=2.41, v_num=0]
Epoch 56:  65%|██████▍   | 63/97 [00:09<00:05,  6.32it/s, loss=2.4, v_num=0]
Epoch 56:  66%|██████▌   | 64/97 [00:10<00:05,  6.37it/s, loss=2.4, v_num=0]
Epoch 56:  66%|██████▌   | 64/97 [00:10<00:05,  6.34it/s, loss=2.42, v_num=0]
Epoch 56:  67%|██████▋   | 65/97 [00:10<00:05,  6.38it/s, loss=2.42, v_num=0]
Epoch 56:  67%|██████▋   | 65/97 [00:10<00:05,  6.35it/s, loss=2.41, v_num=0]
Epoch 56:  68%|██████▊   | 66/97 [00:10<00:04,  6.39it/s, loss=2.41, v_num=0]
Epoch 56:  68%|██████▊   | 66/97 [00:10<00:04,  6.36it/s, loss=2.41, v_num=0]
Epoch 56:  69%|██████▉   | 67/97 [00:10<00:04,  6.41it/s, loss=2.41, v_num=0]
Epoch 56:  69%|██████▉   | 67/97 [00:10<00:04,  6.37it/s, loss=2.4, v_num=0]
Epoch 56:  70%|███████   | 68/97 [00:10<00:04,  6.42it/s, loss=2.4, v_num=0]
Epoch 56:  70%|███████   | 68/97 [00:10<00:04,  6.38it/s, loss=2.41, v_num=0]
Epoch 56:  71%|███████   | 69/97 [00:10<00:04,  6.43it/s, loss=2.41, v_num=0]
Epoch 56:  71%|███████   | 69/97 [00:10<00:04,  6.39it/s, loss=2.4, v_num=0]
Epoch 56:  72%|███████▏  | 70/97 [00:10<00:04,  6.44it/s, loss=2.4, v_num=0]
Epoch 56:  72%|███████▏  | 70/97 [00:10<00:04,  6.40it/s, loss=2.4, v_num=0]
Epoch 56:  73%|███████▎  | 71/97 [00:11<00:04,  6.45it/s, loss=2.4, v_num=0]
Epoch 56:  73%|███████▎  | 71/97 [00:11<00:04,  6.41it/s, loss=2.4, v_num=0]
Epoch 56:  74%|███████▍  | 72/97 [00:11<00:03,  6.46it/s, loss=2.4, v_num=0]
Epoch 56:  74%|███████▍  | 72/97 [00:11<00:03,  6.43it/s, loss=2.4, v_num=0]
Epoch 56:  75%|███████▌  | 73/97 [00:11<00:03,  6.47it/s, loss=2.4, v_num=0]
Epoch 56:  75%|███████▌  | 73/97 [00:11<00:03,  6.44it/s, loss=2.4, v_num=0]
Epoch 56:  76%|███████▋  | 74/97 [00:11<00:03,  6.48it/s, loss=2.4, v_num=0]
Epoch 56:  76%|███████▋  | 74/97 [00:11<00:03,  6.45it/s, loss=2.4, v_num=0]
Epoch 56:  77%|███████▋  | 75/97 [00:11<00:03,  6.49it/s, loss=2.4, v_num=0]
Epoch 56:  77%|███████▋  | 75/97 [00:11<00:03,  6.46it/s, loss=2.4, v_num=0]
Epoch 56:  78%|███████▊  | 76/97 [00:11<00:03,  6.50it/s, loss=2.4, v_num=0]
Epoch 56:  78%|███████▊  | 76/97 [00:11<00:03,  6.47it/s, loss=2.39, v_num=0]
Epoch 56:  79%|███████▉  | 77/97 [00:11<00:03,  6.51it/s, loss=2.39, v_num=0]
Epoch 56:  79%|███████▉  | 77/97 [00:11<00:03,  6.48it/s, loss=2.38, v_num=0]
Epoch 56:  80%|████████  | 78/97 [00:11<00:02,  6.52it/s, loss=2.38, v_num=0]
Epoch 56:  80%|████████  | 78/97 [00:12<00:02,  6.49it/s, loss=2.39, v_num=0]
Epoch 56:  81%|████████▏ | 79/97 [00:12<00:02,  6.53it/s, loss=2.39, v_num=0]
Epoch 56:  81%|████████▏ | 79/97 [00:12<00:02,  6.49it/s, loss=2.38, v_num=0]
Epoch 56:  82%|████████▏ | 80/97 [00:12<00:02,  6.53it/s, loss=2.38, v_num=0]
Epoch 56:  82%|████████▏ | 80/97 [00:12<00:02,  6.50it/s, loss=2.38, v_num=0]
Epoch 56:  84%|████████▎ | 81/97 [00:12<00:02,  6.54it/s, loss=2.38, v_num=0]
Epoch 56:  84%|████████▎ | 81/97 [00:12<00:02,  6.51it/s, loss=2.37, v_num=0]
Epoch 56:  85%|████████▍ | 82/97 [00:12<00:02,  6.55it/s, loss=2.37, v_num=0]
Epoch 56:  85%|████████▍ | 82/97 [00:12<00:02,  6.52it/s, loss=2.37, v_num=0]
Epoch 56:  86%|████████▌ | 83/97 [00:12<00:02,  6.56it/s, loss=2.37, v_num=0]
Epoch 56:  86%|████████▌ | 83/97 [00:12<00:02,  6.53it/s, loss=2.37, v_num=0]
Epoch 56:  87%|████████▋ | 84/97 [00:12<00:01,  6.56it/s, loss=2.37, v_num=0]
Epoch 56:  87%|████████▋ | 84/97 [00:12<00:01,  6.54it/s, loss=2.36, v_num=0]
Epoch 56:  88%|████████▊ | 85/97 [00:12<00:01,  6.58it/s, loss=2.36, v_num=0]
Epoch 56:  88%|████████▊ | 85/97 [00:12<00:01,  6.55it/s, loss=2.37, v_num=0]
Epoch 56:  89%|████████▊ | 86/97 [00:13<00:01,  6.58it/s, loss=2.37, v_num=0]
Epoch 56:  89%|████████▊ | 86/97 [00:13<00:01,  6.55it/s, loss=2.36, v_num=0]
Epoch 56:  90%|████████▉ | 87/97 [00:13<00:01,  6.59it/s, loss=2.36, v_num=0]
Epoch 56:  90%|████████▉ | 87/97 [00:13<00:01,  6.56it/s, loss=2.37, v_num=0]
Epoch 56:  91%|█████████ | 88/97 [00:13<00:01,  6.60it/s, loss=2.37, v_num=0]
Epoch 56:  91%|█████████ | 88/97 [00:13<00:01,  6.57it/s, loss=2.36, v_num=0]
Epoch 56:  92%|█████████▏| 89/97 [00:13<00:01,  6.60it/s, loss=2.36, v_num=0]
Epoch 56:  92%|█████████▏| 89/97 [00:13<00:01,  6.58it/s, loss=2.36, v_num=0]
Epoch 56:  93%|█████████▎| 90/97 [00:13<00:01,  6.61it/s, loss=2.36, v_num=0]
Epoch 56:  93%|█████████▎| 90/97 [00:13<00:01,  6.58it/s, loss=2.36, v_num=0]
Epoch 56:  94%|█████████▍| 91/97 [00:13<00:00,  6.62it/s, loss=2.36, v_num=0]
Epoch 56:  94%|█████████▍| 91/97 [00:13<00:00,  6.59it/s, loss=2.36, v_num=0]
Epoch 56:  95%|█████████▍| 92/97 [00:13<00:00,  6.62it/s, loss=2.36, v_num=0]
Epoch 56:  95%|█████████▍| 92/97 [00:13<00:00,  6.60it/s, loss=2.36, v_num=0]
Epoch 56:  96%|█████████▌| 93/97 [00:14<00:00,  6.63it/s, loss=2.36, v_num=0]
Epoch 56:  96%|█████████▌| 93/97 [00:14<00:00,  6.60it/s, loss=2.37, v_num=0]
Epoch 56:  97%|█████████▋| 94/97 [00:14<00:00,  6.64it/s, loss=2.37, v_num=0]
Epoch 56:  97%|█████████▋| 94/97 [00:14<00:00,  6.61it/s, loss=2.37, v_num=0]
Epoch 56:  98%|█████████▊| 95/97 [00:14<00:00,  6.64it/s, loss=2.37, v_num=0]
Epoch 56:  98%|█████████▊| 95/97 [00:14<00:00,  6.62it/s, loss=2.37, v_num=0]
Epoch 56:  99%|█████████▉| 96/97 [00:14<00:00,  6.65it/s, loss=2.37, v_num=0]
Epoch 56:  99%|█████████▉| 96/97 [00:14<00:00,  6.62it/s, loss=2.37, v_num=0]
Epoch 56: 100%|██████████| 97/97 [00:14<00:00,  6.66it/s, loss=2.37, v_num=0]
Epoch 56: 100%|██████████| 97/97 [00:14<00:00,  6.63it/s, loss=2.37, v_num=0]
Epoch 56: 100%|██████████| 97/97 [00:14<00:00,  6.63it/s, loss=2.37, v_num=0]
Epoch 56:   0%|          | 0/97 [00:00<?, ?it/s, loss=2.37, v_num=0]
Epoch 57:   0%|          | 0/97 [00:00<?, ?it/s, loss=2.37, v_num=0]
Epoch 57:   1%|          | 1/97 [00:01<02:12,  1.38s/it, loss=2.37, v_num=0]
Epoch 57:   1%|          | 1/97 [00:01<02:18,  1.44s/it, loss=2.36, v_num=0]
Epoch 57:   2%|▏         | 2/97 [00:01<01:12,  1.32it/s, loss=2.36, v_num=0]
Epoch 57:   2%|▏         | 2/97 [00:01<01:14,  1.27it/s, loss=2.37, v_num=0]
Epoch 57:   3%|▎         | 3/97 [00:01<00:52,  1.80it/s, loss=2.37, v_num=0]
Epoch 57:   3%|▎         | 3/97 [00:01<00:53,  1.74it/s, loss=2.37, v_num=0]
Epoch 57:   4%|▍         | 4/97 [00:01<00:41,  2.22it/s, loss=2.37, v_num=0]
Epoch 57:   4%|▍         | 4/97 [00:01<00:43,  2.15it/s, loss=2.38, v_num=0]
Epoch 57:   5%|▌         | 5/97 [00:01<00:35,  2.58it/s, loss=2.38, v_num=0]
Epoch 57:   5%|▌         | 5/97 [00:01<00:36,  2.50it/s, loss=2.38, v_num=0]
Epoch 57:   6%|▌         | 6/97 [00:02<00:31,  2.89it/s, loss=2.38, v_num=0]
Epoch 57:   6%|▌         | 6/97 [00:02<00:32,  2.81it/s, loss=2.38, v_num=0]
Epoch 57:   7%|▋         | 7/97 [00:02<00:28,  3.16it/s, loss=2.38, v_num=0]
Epoch 57:   7%|▋         | 7/97 [00:02<00:29,  3.08it/s, loss=2.37, v_num=0]
Epoch 57:   8%|▊         | 8/97 [00:02<00:26,  3.40it/s, loss=2.37, v_num=0]
Epoch 57:   8%|▊         | 8/97 [00:02<00:26,  3.33it/s, loss=2.37, v_num=0]
Epoch 57:   9%|▉         | 9/97 [00:02<00:24,  3.61it/s, loss=2.37, v_num=0]
Epoch 57:   9%|▉         | 9/97 [00:02<00:24,  3.53it/s, loss=2.37, v_num=0]
Epoch 57:  10%|█         | 10/97 [00:02<00:22,  3.80it/s, loss=2.37, v_num=0]
Epoch 57:  10%|█         | 10/97 [00:02<00:23,  3.72it/s, loss=2.36, v_num=0]
Epoch 57:  11%|█▏        | 11/97 [00:02<00:21,  3.97it/s, loss=2.36, v_num=0]
Epoch 57:  11%|█▏        | 11/97 [00:02<00:22,  3.89it/s, loss=2.36, v_num=0]
Epoch 57:  12%|█▏        | 12/97 [00:02<00:20,  4.13it/s, loss=2.36, v_num=0]
Epoch 57:  12%|█▏        | 12/97 [00:02<00:20,  4.05it/s, loss=2.37, v_num=0]
Epoch 57:  13%|█▎        | 13/97 [00:03<00:19,  4.27it/s, loss=2.37, v_num=0]
Epoch 57:  13%|█▎        | 13/97 [00:03<00:20,  4.20it/s, loss=2.37, v_num=0]
Epoch 57:  14%|█▍        | 14/97 [00:03<00:18,  4.41it/s, loss=2.37, v_num=0]
Epoch 57:  14%|█▍        | 14/97 [00:03<00:19,  4.33it/s, loss=2.37, v_num=0]
Epoch 57:  15%|█▌        | 15/97 [00:03<00:18,  4.53it/s, loss=2.37, v_num=0]
Epoch 57:  15%|█▌        | 15/97 [00:03<00:18,  4.45it/s, loss=2.37, v_num=0]
Epoch 57:  16%|█▋        | 16/97 [00:03<00:17,  4.64it/s, loss=2.37, v_num=0]
Epoch 57:  16%|█▋        | 16/97 [00:03<00:17,  4.57it/s, loss=2.36, v_num=0]
Epoch 57:  18%|█▊        | 17/97 [00:03<00:16,  4.74it/s, loss=2.36, v_num=0]
Epoch 57:  18%|█▊        | 17/97 [00:03<00:17,  4.66it/s, loss=2.35, v_num=0]
Epoch 57:  19%|█▊        | 18/97 [00:03<00:16,  4.83it/s, loss=2.35, v_num=0]
Epoch 57:  19%|█▊        | 18/97 [00:03<00:16,  4.76it/s, loss=2.36, v_num=0]
Epoch 57:  20%|█▉        | 19/97 [00:03<00:15,  4.93it/s, loss=2.36, v_num=0]
Epoch 57:  20%|█▉        | 19/97 [00:03<00:16,  4.85it/s, loss=2.35, v_num=0]
Epoch 57:  21%|██        | 20/97 [00:03<00:15,  5.01it/s, loss=2.35, v_num=0]
Epoch 57:  21%|██        | 20/97 [00:04<00:15,  4.94it/s, loss=2.35, v_num=0]
Epoch 57:  22%|██▏       | 21/97 [00:04<00:14,  5.08it/s, loss=2.35, v_num=0]
Epoch 57:  22%|██▏       | 21/97 [00:04<00:15,  5.01it/s, loss=2.35, v_num=0]
Epoch 57:  23%|██▎       | 22/97 [00:04<00:14,  5.15it/s, loss=2.35, v_num=0]
Epoch 57:  23%|██▎       | 22/97 [00:04<00:14,  5.08it/s, loss=2.35, v_num=0]
Epoch 57:  24%|██▎       | 23/97 [00:04<00:14,  5.22it/s, loss=2.35, v_num=0]
Epoch 57:  24%|██▎       | 23/97 [00:04<00:14,  5.15it/s, loss=2.36, v_num=0]
Epoch 57:  25%|██▍       | 24/97 [00:04<00:13,  5.28it/s, loss=2.36, v_num=0]
Epoch 57:  25%|██▍       | 24/97 [00:04<00:13,  5.22it/s, loss=2.36, v_num=0]
Epoch 57:  26%|██▌       | 25/97 [00:04<00:13,  5.34it/s, loss=2.36, v_num=0]
Epoch 57:  26%|██▌       | 25/97 [00:04<00:13,  5.28it/s, loss=2.36, v_num=0]
Epoch 57:  27%|██▋       | 26/97 [00:04<00:13,  5.39it/s, loss=2.36, v_num=0]
Epoch 57:  27%|██▋       | 26/97 [00:04<00:13,  5.33it/s, loss=2.36, v_num=0]
Epoch 57:  28%|██▊       | 27/97 [00:04<00:12,  5.45it/s, loss=2.36, v_num=0]
Epoch 57:  28%|██▊       | 27/97 [00:05<00:12,  5.39it/s, loss=2.37, v_num=0]
Epoch 57:  29%|██▉       | 28/97 [00:05<00:12,  5.50it/s, loss=2.37, v_num=0]
Epoch 57:  29%|██▉       | 28/97 [00:05<00:12,  5.44it/s, loss=2.37, v_num=0]
Epoch 57:  30%|██▉       | 29/97 [00:05<00:12,  5.55it/s, loss=2.37, v_num=0]
Epoch 57:  30%|██▉       | 29/97 [00:05<00:12,  5.49it/s, loss=2.38, v_num=0]
Epoch 57:  31%|███       | 30/97 [00:05<00:11,  5.59it/s, loss=2.38, v_num=0]
Epoch 57:  31%|███       | 30/97 [00:05<00:12,  5.54it/s, loss=2.38, v_num=0]
Epoch 57:  32%|███▏      | 31/97 [00:05<00:11,  5.64it/s, loss=2.38, v_num=0]
Epoch 57:  32%|███▏      | 31/97 [00:05<00:11,  5.58it/s, loss=2.38, v_num=0]
Epoch 57:  33%|███▎      | 32/97 [00:05<00:11,  5.68it/s, loss=2.38, v_num=0]
Epoch 57:  33%|███▎      | 32/97 [00:05<00:11,  5.62it/s, loss=2.38, v_num=0]
Epoch 57:  34%|███▍      | 33/97 [00:05<00:11,  5.71it/s, loss=2.38, v_num=0]
Epoch 57:  34%|███▍      | 33/97 [00:05<00:11,  5.66it/s, loss=2.37, v_num=0]
Epoch 57:  35%|███▌      | 34/97 [00:05<00:10,  5.75it/s, loss=2.37, v_num=0]
Epoch 57:  35%|███▌      | 34/97 [00:05<00:11,  5.70it/s, loss=2.38, v_num=0]
Epoch 57:  36%|███▌      | 35/97 [00:06<00:10,  5.79it/s, loss=2.38, v_num=0]
Epoch 57:  36%|███▌      | 35/97 [00:06<00:10,  5.73it/s, loss=2.38, v_num=0]
Epoch 57:  37%|███▋      | 36/97 [00:06<00:10,  5.82it/s, loss=2.38, v_num=0]
Epoch 57:  37%|███▋      | 36/97 [00:06<00:10,  5.77it/s, loss=2.38, v_num=0]
Epoch 57:  38%|███▊      | 37/97 [00:06<00:10,  5.85it/s, loss=2.38, v_num=0]
Epoch 57:  38%|███▊      | 37/97 [00:06<00:10,  5.80it/s, loss=2.38, v_num=0]
Epoch 57:  39%|███▉      | 38/97 [00:06<00:10,  5.88it/s, loss=2.38, v_num=0]
Epoch 57:  39%|███▉      | 38/97 [00:06<00:10,  5.83it/s, loss=2.38, v_num=0]
Epoch 57:  40%|████      | 39/97 [00:06<00:09,  5.91it/s, loss=2.38, v_num=0]
Epoch 57:  40%|████      | 39/97 [00:06<00:09,  5.86it/s, loss=2.38, v_num=0]
Epoch 57:  41%|████      | 40/97 [00:06<00:09,  5.94it/s, loss=2.38, v_num=0]
Epoch 57:  41%|████      | 40/97 [00:06<00:09,  5.89it/s, loss=2.39, v_num=0]
Epoch 57:  42%|████▏     | 41/97 [00:06<00:09,  5.96it/s, loss=2.39, v_num=0]
Epoch 57:  42%|████▏     | 41/97 [00:06<00:09,  5.91it/s, loss=2.39, v_num=0]
Epoch 57:  43%|████▎     | 42/97 [00:07<00:09,  5.99it/s, loss=2.39, v_num=0]
Epoch 57:  43%|████▎     | 42/97 [00:07<00:09,  5.94it/s, loss=2.4, v_num=0]
Epoch 57:  44%|████▍     | 43/97 [00:07<00:08,  6.02it/s, loss=2.4, v_num=0]
Epoch 57:  44%|████▍     | 43/97 [00:07<00:09,  5.97it/s, loss=2.39, v_num=0]
Epoch 57:  45%|████▌     | 44/97 [00:07<00:08,  6.04it/s, loss=2.39, v_num=0]
Epoch 57:  45%|████▌     | 44/97 [00:07<00:08,  5.99it/s, loss=2.39, v_num=0]
Epoch 57:  46%|████▋     | 45/97 [00:07<00:08,  6.06it/s, loss=2.39, v_num=0]
Epoch 57:  46%|████▋     | 45/97 [00:07<00:08,  6.02it/s, loss=2.38, v_num=0]
Epoch 57:  47%|████▋     | 46/97 [00:07<00:08,  6.08it/s, loss=2.38, v_num=0]
Epoch 57:  47%|████▋     | 46/97 [00:07<00:08,  6.04it/s, loss=2.37, v_num=0]
Epoch 57:  48%|████▊     | 47/97 [00:07<00:08,  6.10it/s, loss=2.37, v_num=0]
Epoch 57:  48%|████▊     | 47/97 [00:07<00:08,  6.06it/s, loss=2.37, v_num=0]
Epoch 57:  49%|████▉     | 48/97 [00:07<00:07,  6.13it/s, loss=2.37, v_num=0]
Epoch 57:  49%|████▉     | 48/97 [00:07<00:08,  6.08it/s, loss=2.36, v_num=0]
Epoch 57:  51%|█████     | 49/97 [00:07<00:07,  6.14it/s, loss=2.36, v_num=0]
Epoch 57:  51%|█████     | 49/97 [00:08<00:07,  6.10it/s, loss=2.37, v_num=0]
Epoch 57:  52%|█████▏    | 50/97 [00:08<00:07,  6.16it/s, loss=2.37, v_num=0]
Epoch 57:  52%|█████▏    | 50/97 [00:08<00:07,  6.12it/s, loss=2.37, v_num=0]
Epoch 57:  53%|█████▎    | 51/97 [00:08<00:07,  6.18it/s, loss=2.37, v_num=0]
Epoch 57:  53%|█████▎    | 51/97 [00:08<00:07,  6.14it/s, loss=2.36, v_num=0]
Epoch 57:  54%|█████▎    | 52/97 [00:08<00:07,  6.20it/s, loss=2.36, v_num=0]
Epoch 57:  54%|█████▎    | 52/97 [00:08<00:07,  6.16it/s, loss=2.36, v_num=0]
Epoch 57:  55%|█████▍    | 53/97 [00:08<00:07,  6.22it/s, loss=2.36, v_num=0]
Epoch 57:  55%|█████▍    | 53/97 [00:08<00:07,  6.18it/s, loss=2.37, v_num=0]
Epoch 57:  56%|█████▌    | 54/97 [00:08<00:06,  6.24it/s, loss=2.37, v_num=0]
Epoch 57:  56%|█████▌    | 54/97 [00:08<00:06,  6.20it/s, loss=2.36, v_num=0]
Epoch 57:  57%|█████▋    | 55/97 [00:08<00:06,  6.25it/s, loss=2.36, v_num=0]
Epoch 57:  57%|█████▋    | 55/97 [00:08<00:06,  6.21it/s, loss=2.37, v_num=0]
Epoch 57:  58%|█████▊    | 56/97 [00:08<00:06,  6.27it/s, loss=2.37, v_num=0]
Epoch 57:  58%|█████▊    | 56/97 [00:08<00:06,  6.23it/s, loss=2.38, v_num=0]
Epoch 57:  59%|█████▉    | 57/97 [00:09<00:06,  6.28it/s, loss=2.38, v_num=0]
Epoch 57:  59%|█████▉    | 57/97 [00:09<00:06,  6.24it/s, loss=2.37, v_num=0]
Epoch 57:  60%|█████▉    | 58/97 [00:09<00:06,  6.30it/s, loss=2.37, v_num=0]
Epoch 57:  60%|█████▉    | 58/97 [00:09<00:06,  6.26it/s, loss=2.37, v_num=0]
Epoch 57:  61%|██████    | 59/97 [00:09<00:06,  6.31it/s, loss=2.37, v_num=0]
Epoch 57:  61%|██████    | 59/97 [00:09<00:06,  6.27it/s, loss=2.37, v_num=0]
Epoch 57:  62%|██████▏   | 60/97 [00:09<00:05,  6.32it/s, loss=2.37, v_num=0]
Epoch 57:  62%|██████▏   | 60/97 [00:09<00:05,  6.29it/s, loss=2.36, v_num=0]
Epoch 57:  63%|██████▎   | 61/97 [00:09<00:05,  6.34it/s, loss=2.36, v_num=0]
Epoch 57:  63%|██████▎   | 61/97 [00:09<00:05,  6.30it/s, loss=2.36, v_num=0]
Epoch 57:  64%|██████▍   | 62/97 [00:09<00:05,  6.35it/s, loss=2.36, v_num=0]
Epoch 57:  64%|██████▍   | 62/97 [00:09<00:05,  6.32it/s, loss=2.35, v_num=0]
Epoch 57:  65%|██████▍   | 63/97 [00:09<00:05,  6.37it/s, loss=2.35, v_num=0]
Epoch 57:  65%|██████▍   | 63/97 [00:09<00:05,  6.33it/s, loss=2.36, v_num=0]
Epoch 57:  66%|██████▌   | 64/97 [00:10<00:05,  6.38it/s, loss=2.36, v_num=0]
Epoch 57:  66%|██████▌   | 64/97 [00:10<00:05,  6.34it/s, loss=2.35, v_num=0]
Epoch 57:  67%|██████▋   | 65/97 [00:10<00:05,  6.39it/s, loss=2.35, v_num=0]
Epoch 57:  67%|██████▋   | 65/97 [00:10<00:05,  6.36it/s, loss=2.35, v_num=0]
Epoch 57:  68%|██████▊   | 66/97 [00:10<00:04,  6.40it/s, loss=2.35, v_num=0]
Epoch 57:  68%|██████▊   | 66/97 [00:10<00:04,  6.37it/s, loss=2.36, v_num=0]
Epoch 57:  69%|██████▉   | 67/97 [00:10<00:04,  6.41it/s, loss=2.36, v_num=0]
Epoch 57:  69%|██████▉   | 67/97 [00:10<00:04,  6.38it/s, loss=2.37, v_num=0]
Epoch 57:  70%|███████   | 68/97 [00:10<00:04,  6.43it/s, loss=2.37, v_num=0]
Epoch 57:  70%|███████   | 68/97 [00:10<00:04,  6.39it/s, loss=2.37, v_num=0]
Epoch 57:  71%|███████   | 69/97 [00:10<00:04,  6.44it/s, loss=2.37, v_num=0]
Epoch 57:  71%|███████   | 69/97 [00:10<00:04,  6.40it/s, loss=2.37, v_num=0]
Epoch 57:  72%|███████▏  | 70/97 [00:10<00:04,  6.45it/s, loss=2.37, v_num=0]
Epoch 57:  72%|███████▏  | 70/97 [00:10<00:04,  6.42it/s, loss=2.37, v_num=0]
Epoch 57:  73%|███████▎  | 71/97 [00:10<00:04,  6.46it/s, loss=2.37, v_num=0]
Epoch 57:  73%|███████▎  | 71/97 [00:11<00:04,  6.43it/s, loss=2.37, v_num=0]
Epoch 57:  74%|███████▍  | 72/97 [00:11<00:03,  6.47it/s, loss=2.37, v_num=0]
Epoch 57:  74%|███████▍  | 72/97 [00:11<00:03,  6.44it/s, loss=2.37, v_num=0]
Epoch 57:  75%|███████▌  | 73/97 [00:11<00:03,  6.48it/s, loss=2.37, v_num=0]
Epoch 57:  75%|███████▌  | 73/97 [00:11<00:03,  6.44it/s, loss=2.37, v_num=0]
Epoch 57:  76%|███████▋  | 74/97 [00:11<00:03,  6.49it/s, loss=2.37, v_num=0]
Epoch 57:  76%|███████▋  | 74/97 [00:11<00:03,  6.45it/s, loss=2.37, v_num=0]
Epoch 57:  77%|███████▋  | 75/97 [00:11<00:03,  6.49it/s, loss=2.37, v_num=0]
Epoch 57:  77%|███████▋  | 75/97 [00:11<00:03,  6.46it/s, loss=2.37, v_num=0]
Epoch 57:  78%|███████▊  | 76/97 [00:11<00:03,  6.50it/s, loss=2.37, v_num=0]
Epoch 57:  78%|███████▊  | 76/97 [00:11<00:03,  6.47it/s, loss=2.37, v_num=0]
Epoch 57:  79%|███████▉  | 77/97 [00:11<00:03,  6.51it/s, loss=2.37, v_num=0]
Epoch 57:  79%|███████▉  | 77/97 [00:11<00:03,  6.48it/s, loss=2.37, v_num=0]
Epoch 57:  80%|████████  | 78/97 [00:11<00:02,  6.52it/s, loss=2.37, v_num=0]
Epoch 57:  80%|████████  | 78/97 [00:12<00:02,  6.49it/s, loss=2.37, v_num=0]
Epoch 57:  81%|████████▏ | 79/97 [00:12<00:02,  6.53it/s, loss=2.37, v_num=0]
Epoch 57:  81%|████████▏ | 79/97 [00:12<00:02,  6.50it/s, loss=2.37, v_num=0]
Epoch 57:  82%|████████▏ | 80/97 [00:12<00:02,  6.54it/s, loss=2.37, v_num=0]
Epoch 57:  82%|████████▏ | 80/97 [00:12<00:02,  6.51it/s, loss=2.38, v_num=0]
Epoch 57:  84%|████████▎ | 81/97 [00:12<00:02,  6.55it/s, loss=2.38, v_num=0]
Epoch 57:  84%|████████▎ | 81/97 [00:12<00:02,  6.52it/s, loss=2.38, v_num=0]
Epoch 57:  85%|████████▍ | 82/97 [00:12<00:02,  6.56it/s, loss=2.38, v_num=0]
Epoch 57:  85%|████████▍ | 82/97 [00:12<00:02,  6.53it/s, loss=2.39, v_num=0]
Epoch 57:  86%|████████▌ | 83/97 [00:12<00:02,  6.56it/s, loss=2.39, v_num=0]
Epoch 57:  86%|████████▌ | 83/97 [00:12<00:02,  6.53it/s, loss=2.39, v_num=0]
Epoch 57:  87%|████████▋ | 84/97 [00:12<00:01,  6.57it/s, loss=2.39, v_num=0]
Epoch 57:  87%|████████▋ | 84/97 [00:12<00:01,  6.54it/s, loss=2.39, v_num=0]
Epoch 57:  88%|████████▊ | 85/97 [00:12<00:01,  6.58it/s, loss=2.39, v_num=0]
Epoch 57:  88%|████████▊ | 85/97 [00:12<00:01,  6.55it/s, loss=2.39, v_num=0]
Epoch 57:  89%|████████▊ | 86/97 [00:13<00:01,  6.59it/s, loss=2.39, v_num=0]
Epoch 57:  89%|████████▊ | 86/97 [00:13<00:01,  6.56it/s, loss=2.38, v_num=0]
Epoch 57:  90%|████████▉ | 87/97 [00:13<00:01,  6.59it/s, loss=2.38, v_num=0]
Epoch 57:  90%|████████▉ | 87/97 [00:13<00:01,  6.57it/s, loss=2.37, v_num=0]
Epoch 57:  91%|█████████ | 88/97 [00:13<00:01,  6.60it/s, loss=2.37, v_num=0]
Epoch 57:  91%|█████████ | 88/97 [00:13<00:01,  6.57it/s, loss=2.37, v_num=0]
Epoch 57:  92%|█████████▏| 89/97 [00:13<00:01,  6.61it/s, loss=2.37, v_num=0]
Epoch 57:  92%|█████████▏| 89/97 [00:13<00:01,  6.58it/s, loss=2.38, v_num=0]
Epoch 57:  93%|█████████▎| 90/97 [00:13<00:01,  6.62it/s, loss=2.38, v_num=0]
Epoch 57:  93%|█████████▎| 90/97 [00:13<00:01,  6.59it/s, loss=2.38, v_num=0]
Epoch 57:  94%|█████████▍| 91/97 [00:13<00:00,  6.62it/s, loss=2.38, v_num=0]
Epoch 57:  94%|█████████▍| 91/97 [00:13<00:00,  6.60it/s, loss=2.37, v_num=0]
Epoch 57:  95%|█████████▍| 92/97 [00:13<00:00,  6.63it/s, loss=2.37, v_num=0]
Epoch 57:  95%|█████████▍| 92/97 [00:13<00:00,  6.60it/s, loss=2.37, v_num=0]
Epoch 57:  96%|█████████▌| 93/97 [00:14<00:00,  6.64it/s, loss=2.37, v_num=0]
Epoch 57:  96%|█████████▌| 93/97 [00:14<00:00,  6.61it/s, loss=2.38, v_num=0]
Epoch 57:  97%|█████████▋| 94/97 [00:14<00:00,  6.64it/s, loss=2.38, v_num=0]
Epoch 57:  97%|█████████▋| 94/97 [00:14<00:00,  6.62it/s, loss=2.37, v_num=0]
Epoch 57:  98%|█████████▊| 95/97 [00:14<00:00,  6.65it/s, loss=2.37, v_num=0]
Epoch 57:  98%|█████████▊| 95/97 [00:14<00:00,  6.62it/s, loss=2.37, v_num=0]
Epoch 57:  99%|█████████▉| 96/97 [00:14<00:00,  6.65it/s, loss=2.37, v_num=0]
Epoch 57:  99%|█████████▉| 96/97 [00:14<00:00,  6.63it/s, loss=2.37, v_num=0]
Epoch 57: 100%|██████████| 97/97 [00:14<00:00,  6.66it/s, loss=2.37, v_num=0]
Epoch 57: 100%|██████████| 97/97 [00:14<00:00,  6.63it/s, loss=2.36, v_num=0]
Epoch 57: 100%|██████████| 97/97 [00:14<00:00,  6.63it/s, loss=2.36, v_num=0]
Epoch 57:   0%|          | 0/97 [00:00<?, ?it/s, loss=2.36, v_num=0]
Epoch 58:   0%|          | 0/97 [00:00<?, ?it/s, loss=2.36, v_num=0]
Epoch 58:   1%|          | 1/97 [00:01<02:13,  1.39s/it, loss=2.36, v_num=0]
Epoch 58:   1%|          | 1/97 [00:01<02:18,  1.44s/it, loss=2.37, v_num=0]
Epoch 58:   2%|▏         | 2/97 [00:01<01:12,  1.32it/s, loss=2.37, v_num=0]
Epoch 58:   2%|▏         | 2/97 [00:01<01:14,  1.27it/s, loss=2.36, v_num=0]
Epoch 58:   3%|▎         | 3/97 [00:01<00:51,  1.81it/s, loss=2.36, v_num=0]
Epoch 58:   3%|▎         | 3/97 [00:01<00:53,  1.75it/s, loss=2.36, v_num=0]
Epoch 58:   4%|▍         | 4/97 [00:01<00:41,  2.23it/s, loss=2.36, v_num=0]
Epoch 58:   4%|▍         | 4/97 [00:01<00:43,  2.16it/s, loss=2.36, v_num=0]
Epoch 58:   5%|▌         | 5/97 [00:01<00:35,  2.59it/s, loss=2.36, v_num=0]
Epoch 58:   5%|▌         | 5/97 [00:01<00:36,  2.51it/s, loss=2.36, v_num=0]
Epoch 58:   6%|▌         | 6/97 [00:02<00:31,  2.90it/s, loss=2.36, v_num=0]
Epoch 58:   6%|▌         | 6/97 [00:02<00:32,  2.82it/s, loss=2.36, v_num=0]
Epoch 58:   7%|▋         | 7/97 [00:02<00:28,  3.17it/s, loss=2.36, v_num=0]
Epoch 58:   7%|▋         | 7/97 [00:02<00:29,  3.09it/s, loss=2.35, v_num=0]
Epoch 58:   8%|▊         | 8/97 [00:02<00:26,  3.42it/s, loss=2.35, v_num=0]
Epoch 58:   8%|▊         | 8/97 [00:02<00:26,  3.34it/s, loss=2.35, v_num=0]
Epoch 58:   9%|▉         | 9/97 [00:02<00:24,  3.63it/s, loss=2.35, v_num=0]
Epoch 58:   9%|▉         | 9/97 [00:02<00:24,  3.55it/s, loss=2.35, v_num=0]
Epoch 58:  10%|█         | 10/97 [00:02<00:22,  3.82it/s, loss=2.35, v_num=0]
Epoch 58:  10%|█         | 10/97 [00:02<00:23,  3.73it/s, loss=2.36, v_num=0]
Epoch 58:  11%|█▏        | 11/97 [00:02<00:21,  3.99it/s, loss=2.36, v_num=0]
Epoch 58:  11%|█▏        | 11/97 [00:02<00:21,  3.91it/s, loss=2.35, v_num=0]
Epoch 58:  12%|█▏        | 12/97 [00:02<00:20,  4.15it/s, loss=2.35, v_num=0]
Epoch 58:  12%|█▏        | 12/97 [00:02<00:20,  4.07it/s, loss=2.34, v_num=0]
Epoch 58:  13%|█▎        | 13/97 [00:03<00:19,  4.29it/s, loss=2.34, v_num=0]
Epoch 58:  13%|█▎        | 13/97 [00:03<00:19,  4.21it/s, loss=2.35, v_num=0]
Epoch 58:  14%|█▍        | 14/97 [00:03<00:18,  4.42it/s, loss=2.35, v_num=0]
Epoch 58:  14%|█▍        | 14/97 [00:03<00:19,  4.34it/s, loss=2.35, v_num=0]
Epoch 58:  15%|█▌        | 15/97 [00:03<00:18,  4.53it/s, loss=2.35, v_num=0]
Epoch 58:  15%|█▌        | 15/97 [00:03<00:18,  4.46it/s, loss=2.35, v_num=0]
Epoch 58:  16%|█▋        | 16/97 [00:03<00:17,  4.65it/s, loss=2.35, v_num=0]
Epoch 58:  16%|█▋        | 16/97 [00:03<00:17,  4.57it/s, loss=2.34, v_num=0]
Epoch 58:  18%|█▊        | 17/97 [00:03<00:16,  4.74it/s, loss=2.34, v_num=0]
Epoch 58:  18%|█▊        | 17/97 [00:03<00:17,  4.67it/s, loss=2.35, v_num=0]
Epoch 58:  19%|█▊        | 18/97 [00:03<00:16,  4.83it/s, loss=2.35, v_num=0]
Epoch 58:  19%|█▊        | 18/97 [00:03<00:16,  4.76it/s, loss=2.35, v_num=0]
Epoch 58:  20%|█▉        | 19/97 [00:03<00:15,  4.93it/s, loss=2.35, v_num=0]
Epoch 58:  20%|█▉        | 19/97 [00:03<00:16,  4.85it/s, loss=2.35, v_num=0]
Epoch 58:  21%|██        | 20/97 [00:03<00:15,  5.01it/s, loss=2.35, v_num=0]
Epoch 58:  21%|██        | 20/97 [00:04<00:15,  4.94it/s, loss=2.35, v_num=0]
Epoch 58:  22%|██▏       | 21/97 [00:04<00:14,  5.09it/s, loss=2.35, v_num=0]
Epoch 58:  22%|██▏       | 21/97 [00:04<00:15,  5.02it/s, loss=2.34, v_num=0]
Epoch 58:  23%|██▎       | 22/97 [00:04<00:14,  5.15it/s, loss=2.34, v_num=0]
Epoch 58:  23%|██▎       | 22/97 [00:04<00:14,  5.09it/s, loss=2.34, v_num=0]
Epoch 58:  24%|██▎       | 23/97 [00:04<00:14,  5.22it/s, loss=2.34, v_num=0]
Epoch 58:  24%|██▎       | 23/97 [00:04<00:14,  5.16it/s, loss=2.33, v_num=0]
Epoch 58:  25%|██▍       | 24/97 [00:04<00:13,  5.29it/s, loss=2.33, v_num=0]
Epoch 58:  25%|██▍       | 24/97 [00:04<00:13,  5.22it/s, loss=2.32, v_num=0]
Epoch 58:  26%|██▌       | 25/97 [00:04<00:13,  5.34it/s, loss=2.32, v_num=0]
Epoch 58:  26%|██▌       | 25/97 [00:04<00:13,  5.28it/s, loss=2.33, v_num=0]
Epoch 58:  27%|██▋       | 26/97 [00:04<00:13,  5.40it/s, loss=2.33, v_num=0]
Epoch 58:  27%|██▋       | 26/97 [00:04<00:13,  5.33it/s, loss=2.33, v_num=0]
Epoch 58:  28%|██▊       | 27/97 [00:04<00:12,  5.45it/s, loss=2.33, v_num=0]
Epoch 58:  28%|██▊       | 27/97 [00:05<00:12,  5.39it/s, loss=2.33, v_num=0]
Epoch 58:  29%|██▉       | 28/97 [00:05<00:12,  5.51it/s, loss=2.33, v_num=0]
Epoch 58:  29%|██▉       | 28/97 [00:05<00:12,  5.44it/s, loss=2.33, v_num=0]
Epoch 58:  30%|██▉       | 29/97 [00:05<00:12,  5.55it/s, loss=2.33, v_num=0]
Epoch 58:  30%|██▉       | 29/97 [00:05<00:12,  5.49it/s, loss=2.33, v_num=0]
Epoch 58:  31%|███       | 30/97 [00:05<00:11,  5.59it/s, loss=2.33, v_num=0]
Epoch 58:  31%|███       | 30/97 [00:05<00:12,  5.54it/s, loss=2.32, v_num=0]
Epoch 58:  32%|███▏      | 31/97 [00:05<00:11,  5.63it/s, loss=2.32, v_num=0]
Epoch 58:  32%|███▏      | 31/97 [00:05<00:11,  5.58it/s, loss=2.32, v_num=0]
Epoch 58:  33%|███▎      | 32/97 [00:05<00:11,  5.67it/s, loss=2.32, v_num=0]
Epoch 58:  33%|███▎      | 32/97 [00:05<00:11,  5.62it/s, loss=2.33, v_num=0]
Epoch 58:  34%|███▍      | 33/97 [00:05<00:11,  5.71it/s, loss=2.33, v_num=0]
Epoch 58:  34%|███▍      | 33/97 [00:05<00:11,  5.66it/s, loss=2.34, v_num=0]
Epoch 58:  35%|███▌      | 34/97 [00:05<00:10,  5.75it/s, loss=2.34, v_num=0]
Epoch 58:  35%|███▌      | 34/97 [00:05<00:11,  5.70it/s, loss=2.33, v_num=0]
Epoch 58:  36%|███▌      | 35/97 [00:06<00:10,  5.79it/s, loss=2.33, v_num=0]
Epoch 58:  36%|███▌      | 35/97 [00:06<00:10,  5.73it/s, loss=2.34, v_num=0]
Epoch 58:  37%|███▋      | 36/97 [00:06<00:10,  5.82it/s, loss=2.34, v_num=0]
Epoch 58:  37%|███▋      | 36/97 [00:06<00:10,  5.77it/s, loss=2.34, v_num=0]
Epoch 58:  38%|███▊      | 37/97 [00:06<00:10,  5.85it/s, loss=2.34, v_num=0]
Epoch 58:  38%|███▊      | 37/97 [00:06<00:10,  5.80it/s, loss=2.35, v_num=0]
Epoch 58:  39%|███▉      | 38/97 [00:06<00:10,  5.89it/s, loss=2.35, v_num=0]
Epoch 58:  39%|███▉      | 38/97 [00:06<00:10,  5.83it/s, loss=2.34, v_num=0]
Epoch 58:  40%|████      | 39/97 [00:06<00:09,  5.91it/s, loss=2.34, v_num=0]
Epoch 58:  40%|████      | 39/97 [00:06<00:09,  5.86it/s, loss=2.34, v_num=0]
Epoch 58:  41%|████      | 40/97 [00:06<00:09,  5.94it/s, loss=2.34, v_num=0]
Epoch 58:  41%|████      | 40/97 [00:06<00:09,  5.89it/s, loss=2.35, v_num=0]
Epoch 58:  42%|████▏     | 41/97 [00:06<00:09,  5.97it/s, loss=2.35, v_num=0]
Epoch 58:  42%|████▏     | 41/97 [00:06<00:09,  5.92it/s, loss=2.35, v_num=0]
Epoch 58:  43%|████▎     | 42/97 [00:07<00:09,  6.00it/s, loss=2.35, v_num=0]
Epoch 58:  43%|████▎     | 42/97 [00:07<00:09,  5.95it/s, loss=2.36, v_num=0]
Epoch 58:  44%|████▍     | 43/97 [00:07<00:08,  6.02it/s, loss=2.36, v_num=0]
Epoch 58:  44%|████▍     | 43/97 [00:07<00:09,  5.97it/s, loss=2.37, v_num=0]
Epoch 58:  45%|████▌     | 44/97 [00:07<00:08,  6.04it/s, loss=2.37, v_num=0]
Epoch 58:  45%|████▌     | 44/97 [00:07<00:08,  6.00it/s, loss=2.38, v_num=0]
Epoch 58:  46%|████▋     | 45/97 [00:07<00:08,  6.06it/s, loss=2.38, v_num=0]
Epoch 58:  46%|████▋     | 45/97 [00:07<00:08,  6.02it/s, loss=2.37, v_num=0]
Epoch 58:  47%|████▋     | 46/97 [00:07<00:08,  6.09it/s, loss=2.37, v_num=0]
Epoch 58:  47%|████▋     | 46/97 [00:07<00:08,  6.04it/s, loss=2.37, v_num=0]
Epoch 58:  48%|████▊     | 47/97 [00:07<00:08,  6.11it/s, loss=2.37, v_num=0]
Epoch 58:  48%|████▊     | 47/97 [00:07<00:08,  6.06it/s, loss=2.37, v_num=0]
Epoch 58:  49%|████▉     | 48/97 [00:07<00:08,  6.12it/s, loss=2.37, v_num=0]
Epoch 58:  49%|████▉     | 48/97 [00:07<00:08,  6.08it/s, loss=2.36, v_num=0]
Epoch 58:  51%|█████     | 49/97 [00:07<00:07,  6.14it/s, loss=2.36, v_num=0]
Epoch 58:  51%|█████     | 49/97 [00:08<00:07,  6.10it/s, loss=2.36, v_num=0]
Epoch 58:  52%|█████▏    | 50/97 [00:08<00:07,  6.16it/s, loss=2.36, v_num=0]
Epoch 58:  52%|█████▏    | 50/97 [00:08<00:07,  6.12it/s, loss=2.37, v_num=0]
Epoch 58:  53%|█████▎    | 51/97 [00:08<00:07,  6.18it/s, loss=2.37, v_num=0]
Epoch 58:  53%|█████▎    | 51/97 [00:08<00:07,  6.13it/s, loss=2.37, v_num=0]
Epoch 58:  54%|█████▎    | 52/97 [00:08<00:07,  6.19it/s, loss=2.37, v_num=0]
Epoch 58:  54%|█████▎    | 52/97 [00:08<00:07,  6.15it/s, loss=2.36, v_num=0]
Epoch 58:  55%|█████▍    | 53/97 [00:08<00:07,  6.21it/s, loss=2.36, v_num=0]
Epoch 58:  55%|█████▍    | 53/97 [00:08<00:07,  6.17it/s, loss=2.35, v_num=0]
Epoch 58:  56%|█████▌    | 54/97 [00:08<00:06,  6.22it/s, loss=2.35, v_num=0]
Epoch 58:  56%|█████▌    | 54/97 [00:08<00:06,  6.18it/s, loss=2.36, v_num=0]
Epoch 58:  57%|█████▋    | 55/97 [00:08<00:06,  6.24it/s, loss=2.36, v_num=0]
Epoch 58:  57%|█████▋    | 55/97 [00:08<00:06,  6.20it/s, loss=2.35, v_num=0]
Epoch 58:  58%|█████▊    | 56/97 [00:08<00:06,  6.25it/s, loss=2.35, v_num=0]
Epoch 58:  58%|█████▊    | 56/97 [00:09<00:06,  6.22it/s, loss=2.35, v_num=0]
Epoch 58:  59%|█████▉    | 57/97 [00:09<00:06,  6.27it/s, loss=2.35, v_num=0]
Epoch 58:  59%|█████▉    | 57/97 [00:09<00:06,  6.23it/s, loss=2.35, v_num=0]
Epoch 58:  60%|█████▉    | 58/97 [00:09<00:06,  6.28it/s, loss=2.35, v_num=0]
Epoch 58:  60%|█████▉    | 58/97 [00:09<00:06,  6.25it/s, loss=2.36, v_num=0]
Epoch 58:  61%|██████    | 59/97 [00:09<00:06,  6.30it/s, loss=2.36, v_num=0]
Epoch 58:  61%|██████    | 59/97 [00:09<00:06,  6.26it/s, loss=2.36, v_num=0]
Epoch 58:  62%|██████▏   | 60/97 [00:09<00:05,  6.31it/s, loss=2.36, v_num=0]
Epoch 58:  62%|██████▏   | 60/97 [00:09<00:05,  6.28it/s, loss=2.35, v_num=0]
Epoch 58:  63%|██████▎   | 61/97 [00:09<00:05,  6.32it/s, loss=2.35, v_num=0]
Epoch 58:  63%|██████▎   | 61/97 [00:09<00:05,  6.29it/s, loss=2.35, v_num=0]
Epoch 58:  64%|██████▍   | 62/97 [00:09<00:05,  6.34it/s, loss=2.35, v_num=0]
Epoch 58:  64%|██████▍   | 62/97 [00:09<00:05,  6.30it/s, loss=2.34, v_num=0]
Epoch 58:  65%|██████▍   | 63/97 [00:09<00:05,  6.35it/s, loss=2.34, v_num=0]
Epoch 58:  65%|██████▍   | 63/97 [00:09<00:05,  6.31it/s, loss=2.34, v_num=0]
Epoch 58:  66%|██████▌   | 64/97 [00:10<00:05,  6.36it/s, loss=2.34, v_num=0]
Epoch 58:  66%|██████▌   | 64/97 [00:10<00:05,  6.33it/s, loss=2.34, v_num=0]
Epoch 58:  67%|██████▋   | 65/97 [00:10<00:05,  6.37it/s, loss=2.34, v_num=0]
Epoch 58:  67%|██████▋   | 65/97 [00:10<00:05,  6.34it/s, loss=2.34, v_num=0]
Epoch 58:  68%|██████▊   | 66/97 [00:10<00:04,  6.39it/s, loss=2.34, v_num=0]
Epoch 58:  68%|██████▊   | 66/97 [00:10<00:04,  6.35it/s, loss=2.34, v_num=0]
Epoch 58:  69%|██████▉   | 67/97 [00:10<00:04,  6.40it/s, loss=2.34, v_num=0]
Epoch 58:  69%|██████▉   | 67/97 [00:10<00:04,  6.36it/s, loss=2.34, v_num=0]
Epoch 58:  70%|███████   | 68/97 [00:10<00:04,  6.41it/s, loss=2.34, v_num=0]
Epoch 58:  70%|███████   | 68/97 [00:10<00:04,  6.37it/s, loss=2.34, v_num=0]
Epoch 58:  71%|███████   | 69/97 [00:10<00:04,  6.42it/s, loss=2.34, v_num=0]
Epoch 58:  71%|███████   | 69/97 [00:10<00:04,  6.39it/s, loss=2.34, v_num=0]
Epoch 58:  72%|███████▏  | 70/97 [00:10<00:04,  6.43it/s, loss=2.34, v_num=0]
Epoch 58:  72%|███████▏  | 70/97 [00:10<00:04,  6.39it/s, loss=2.34, v_num=0]
Epoch 58:  73%|███████▎  | 71/97 [00:11<00:04,  6.44it/s, loss=2.34, v_num=0]
Epoch 58:  73%|███████▎  | 71/97 [00:11<00:04,  6.41it/s, loss=2.34, v_num=0]
Epoch 58:  74%|███████▍  | 72/97 [00:11<00:03,  6.45it/s, loss=2.34, v_num=0]
Epoch 58:  74%|███████▍  | 72/97 [00:11<00:03,  6.42it/s, loss=2.35, v_num=0]
Epoch 58:  75%|███████▌  | 73/97 [00:11<00:03,  6.46it/s, loss=2.35, v_num=0]
Epoch 58:  75%|███████▌  | 73/97 [00:11<00:03,  6.43it/s, loss=2.35, v_num=0]
Epoch 58:  76%|███████▋  | 74/97 [00:11<00:03,  6.47it/s, loss=2.35, v_num=0]
Epoch 58:  76%|███████▋  | 74/97 [00:11<00:03,  6.44it/s, loss=2.35, v_num=0]
Epoch 58:  77%|███████▋  | 75/97 [00:11<00:03,  6.48it/s, loss=2.35, v_num=0]
Epoch 58:  77%|███████▋  | 75/97 [00:11<00:03,  6.45it/s, loss=2.34, v_num=0]
Epoch 58:  78%|███████▊  | 76/97 [00:11<00:03,  6.49it/s, loss=2.34, v_num=0]
Epoch 58:  78%|███████▊  | 76/97 [00:11<00:03,  6.46it/s, loss=2.34, v_num=0]
Epoch 58:  79%|███████▉  | 77/97 [00:11<00:03,  6.50it/s, loss=2.34, v_num=0]
Epoch 58:  79%|███████▉  | 77/97 [00:11<00:03,  6.47it/s, loss=2.34, v_num=0]
Epoch 58:  80%|████████  | 78/97 [00:11<00:02,  6.50it/s, loss=2.34, v_num=0]
Epoch 58:  80%|████████  | 78/97 [00:12<00:02,  6.48it/s, loss=2.34, v_num=0]
Epoch 58:  81%|████████▏ | 79/97 [00:12<00:02,  6.52it/s, loss=2.34, v_num=0]
Epoch 58:  81%|████████▏ | 79/97 [00:12<00:02,  6.48it/s, loss=2.34, v_num=0]
Epoch 58:  82%|████████▏ | 80/97 [00:12<00:02,  6.52it/s, loss=2.34, v_num=0]
Epoch 58:  82%|████████▏ | 80/97 [00:12<00:02,  6.49it/s, loss=2.34, v_num=0]
Epoch 58:  84%|████████▎ | 81/97 [00:12<00:02,  6.53it/s, loss=2.34, v_num=0]
Epoch 58:  84%|████████▎ | 81/97 [00:12<00:02,  6.50it/s, loss=2.33, v_num=0]
Epoch 58:  85%|████████▍ | 82/97 [00:12<00:02,  6.54it/s, loss=2.33, v_num=0]
Epoch 58:  85%|████████▍ | 82/97 [00:12<00:02,  6.51it/s, loss=2.33, v_num=0]
Epoch 58:  86%|████████▌ | 83/97 [00:12<00:02,  6.55it/s, loss=2.33, v_num=0]
Epoch 58:  86%|████████▌ | 83/97 [00:12<00:02,  6.52it/s, loss=2.32, v_num=0]
Epoch 58:  87%|████████▋ | 84/97 [00:12<00:01,  6.55it/s, loss=2.32, v_num=0]
Epoch 58:  87%|████████▋ | 84/97 [00:12<00:01,  6.53it/s, loss=2.32, v_num=0]
Epoch 58:  88%|████████▊ | 85/97 [00:12<00:01,  6.56it/s, loss=2.32, v_num=0]
Epoch 58:  88%|████████▊ | 85/97 [00:13<00:01,  6.53it/s, loss=2.33, v_num=0]
Epoch 58:  89%|████████▊ | 86/97 [00:13<00:01,  6.57it/s, loss=2.33, v_num=0]
Epoch 58:  89%|████████▊ | 86/97 [00:13<00:01,  6.54it/s, loss=2.34, v_num=0]
Epoch 58:  90%|████████▉ | 87/97 [00:13<00:01,  6.58it/s, loss=2.34, v_num=0]
Epoch 58:  90%|████████▉ | 87/97 [00:13<00:01,  6.55it/s, loss=2.34, v_num=0]
Epoch 58:  91%|█████████ | 88/97 [00:13<00:01,  6.58it/s, loss=2.34, v_num=0]
Epoch 58:  91%|█████████ | 88/97 [00:13<00:01,  6.56it/s, loss=2.34, v_num=0]
Epoch 58:  92%|█████████▏| 89/97 [00:13<00:01,  6.59it/s, loss=2.34, v_num=0]
Epoch 58:  92%|█████████▏| 89/97 [00:13<00:01,  6.57it/s, loss=2.35, v_num=0]
Epoch 58:  93%|█████████▎| 90/97 [00:13<00:01,  6.60it/s, loss=2.35, v_num=0]
Epoch 58:  93%|█████████▎| 90/97 [00:13<00:01,  6.57it/s, loss=2.34, v_num=0]
Epoch 58:  94%|█████████▍| 91/97 [00:13<00:00,  6.61it/s, loss=2.34, v_num=0]
Epoch 58:  94%|█████████▍| 91/97 [00:13<00:00,  6.58it/s, loss=2.35, v_num=0]
Epoch 58:  95%|█████████▍| 92/97 [00:13<00:00,  6.62it/s, loss=2.35, v_num=0]
Epoch 58:  95%|█████████▍| 92/97 [00:13<00:00,  6.59it/s, loss=2.35, v_num=0]
Epoch 58:  96%|█████████▌| 93/97 [00:14<00:00,  6.62it/s, loss=2.35, v_num=0]
Epoch 58:  96%|█████████▌| 93/97 [00:14<00:00,  6.59it/s, loss=2.36, v_num=0]
Epoch 58:  97%|█████████▋| 94/97 [00:14<00:00,  6.63it/s, loss=2.36, v_num=0]
Epoch 58:  97%|█████████▋| 94/97 [00:14<00:00,  6.60it/s, loss=2.35, v_num=0]
Epoch 58:  98%|█████████▊| 95/97 [00:14<00:00,  6.63it/s, loss=2.35, v_num=0]
Epoch 58:  98%|█████████▊| 95/97 [00:14<00:00,  6.61it/s, loss=2.36, v_num=0]
Epoch 58:  99%|█████████▉| 96/97 [00:14<00:00,  6.64it/s, loss=2.36, v_num=0]
Epoch 58:  99%|█████████▉| 96/97 [00:14<00:00,  6.61it/s, loss=2.36, v_num=0]
Epoch 58: 100%|██████████| 97/97 [00:14<00:00,  6.65it/s, loss=2.36, v_num=0]
Epoch 58: 100%|██████████| 97/97 [00:14<00:00,  6.62it/s, loss=2.36, v_num=0]
Epoch 58: 100%|██████████| 97/97 [00:14<00:00,  6.62it/s, loss=2.36, v_num=0]
Epoch 58:   0%|          | 0/97 [00:00<?, ?it/s, loss=2.36, v_num=0]
Epoch 59:   0%|          | 0/97 [00:00<?, ?it/s, loss=2.36, v_num=0]
Epoch 59:   1%|          | 1/97 [00:01<02:12,  1.38s/it, loss=2.36, v_num=0]
Epoch 59:   1%|          | 1/97 [00:01<02:17,  1.43s/it, loss=2.36, v_num=0]
Epoch 59:   2%|▏         | 2/97 [00:01<01:12,  1.32it/s, loss=2.36, v_num=0]
Epoch 59:   2%|▏         | 2/97 [00:01<01:14,  1.27it/s, loss=2.36, v_num=0]
Epoch 59:   3%|▎         | 3/97 [00:01<00:51,  1.81it/s, loss=2.36, v_num=0]
Epoch 59:   3%|▎         | 3/97 [00:01<00:53,  1.75it/s, loss=2.36, v_num=0]
Epoch 59:   4%|▍         | 4/97 [00:01<00:41,  2.23it/s, loss=2.36, v_num=0]
Epoch 59:   4%|▍         | 4/97 [00:01<00:43,  2.16it/s, loss=2.37, v_num=0]
Epoch 59:   5%|▌         | 5/97 [00:01<00:35,  2.59it/s, loss=2.37, v_num=0]
Epoch 59:   5%|▌         | 5/97 [00:01<00:36,  2.52it/s, loss=2.36, v_num=0]
Epoch 59:   6%|▌         | 6/97 [00:02<00:31,  2.90it/s, loss=2.36, v_num=0]
Epoch 59:   6%|▌         | 6/97 [00:02<00:32,  2.82it/s, loss=2.38, v_num=0]
Epoch 59:   7%|▋         | 7/97 [00:02<00:28,  3.17it/s, loss=2.38, v_num=0]
Epoch 59:   7%|▋         | 7/97 [00:02<00:29,  3.10it/s, loss=2.38, v_num=0]
Epoch 59:   8%|▊         | 8/97 [00:02<00:26,  3.42it/s, loss=2.38, v_num=0]
Epoch 59:   8%|▊         | 8/97 [00:02<00:26,  3.34it/s, loss=2.37, v_num=0]
Epoch 59:   9%|▉         | 9/97 [00:02<00:24,  3.63it/s, loss=2.37, v_num=0]
Epoch 59:   9%|▉         | 9/97 [00:02<00:24,  3.55it/s, loss=2.37, v_num=0]
Epoch 59:  10%|█         | 10/97 [00:02<00:22,  3.82it/s, loss=2.37, v_num=0]
Epoch 59:  10%|█         | 10/97 [00:02<00:23,  3.74it/s, loss=2.36, v_num=0]
Epoch 59:  11%|█▏        | 11/97 [00:02<00:21,  4.00it/s, loss=2.36, v_num=0]
Epoch 59:  11%|█▏        | 11/97 [00:02<00:21,  3.91it/s, loss=2.35, v_num=0]
Epoch 59:  12%|█▏        | 12/97 [00:02<00:20,  4.15it/s, loss=2.35, v_num=0]
Epoch 59:  12%|█▏        | 12/97 [00:02<00:20,  4.07it/s, loss=2.35, v_num=0]
Epoch 59:  13%|█▎        | 13/97 [00:03<00:19,  4.30it/s, loss=2.35, v_num=0]
Epoch 59:  13%|█▎        | 13/97 [00:03<00:19,  4.22it/s, loss=2.35, v_num=0]
Epoch 59:  14%|█▍        | 14/97 [00:03<00:18,  4.43it/s, loss=2.35, v_num=0]
Epoch 59:  14%|█▍        | 14/97 [00:03<00:19,  4.35it/s, loss=2.35, v_num=0]
Epoch 59:  15%|█▌        | 15/97 [00:03<00:18,  4.55it/s, loss=2.35, v_num=0]
Epoch 59:  15%|█▌        | 15/97 [00:03<00:18,  4.47it/s, loss=2.34, v_num=0]
Epoch 59:  16%|█▋        | 16/97 [00:03<00:17,  4.66it/s, loss=2.34, v_num=0]
Epoch 59:  16%|█▋        | 16/97 [00:03<00:17,  4.59it/s, loss=2.34, v_num=0]
Epoch 59:  18%|█▊        | 17/97 [00:03<00:16,  4.75it/s, loss=2.34, v_num=0]
Epoch 59:  18%|█▊        | 17/97 [00:03<00:17,  4.68it/s, loss=2.33, v_num=0]
Epoch 59:  19%|█▊        | 18/97 [00:03<00:16,  4.85it/s, loss=2.33, v_num=0]
Epoch 59:  19%|█▊        | 18/97 [00:03<00:16,  4.77it/s, loss=2.34, v_num=0]
Epoch 59:  20%|█▉        | 19/97 [00:03<00:15,  4.94it/s, loss=2.34, v_num=0]
Epoch 59:  20%|█▉        | 19/97 [00:03<00:16,  4.86it/s, loss=2.33, v_num=0]
Epoch 59:  21%|██        | 20/97 [00:03<00:15,  5.01it/s, loss=2.33, v_num=0]
Epoch 59:  21%|██        | 20/97 [00:04<00:15,  4.95it/s, loss=2.34, v_num=0]
Epoch 59:  22%|██▏       | 21/97 [00:04<00:14,  5.09it/s, loss=2.34, v_num=0]
Epoch 59:  22%|██▏       | 21/97 [00:04<00:15,  5.02it/s, loss=2.33, v_num=0]
Epoch 59:  23%|██▎       | 22/97 [00:04<00:14,  5.16it/s, loss=2.33, v_num=0]
Epoch 59:  23%|██▎       | 22/97 [00:04<00:14,  5.10it/s, loss=2.33, v_num=0]
Epoch 59:  24%|██▎       | 23/97 [00:04<00:14,  5.23it/s, loss=2.33, v_num=0]
Epoch 59:  24%|██▎       | 23/97 [00:04<00:14,  5.16it/s, loss=2.32, v_num=0]
Epoch 59:  25%|██▍       | 24/97 [00:04<00:13,  5.29it/s, loss=2.32, v_num=0]
Epoch 59:  25%|██▍       | 24/97 [00:04<00:13,  5.23it/s, loss=2.32, v_num=0]
Epoch 59:  26%|██▌       | 25/97 [00:04<00:13,  5.35it/s, loss=2.32, v_num=0]
Epoch 59:  26%|██▌       | 25/97 [00:04<00:13,  5.29it/s, loss=2.33, v_num=0]
Epoch 59:  27%|██▋       | 26/97 [00:04<00:13,  5.41it/s, loss=2.33, v_num=0]
Epoch 59:  27%|██▋       | 26/97 [00:04<00:13,  5.34it/s, loss=2.32, v_num=0]
Epoch 59:  28%|██▊       | 27/97 [00:04<00:12,  5.46it/s, loss=2.32, v_num=0]
Epoch 59:  28%|██▊       | 27/97 [00:05<00:12,  5.40it/s, loss=2.32, v_num=0]
Epoch 59:  29%|██▉       | 28/97 [00:05<00:12,  5.51it/s, loss=2.32, v_num=0]
Epoch 59:  29%|██▉       | 28/97 [00:05<00:12,  5.45it/s, loss=2.32, v_num=0]
Epoch 59:  30%|██▉       | 29/97 [00:05<00:12,  5.55it/s, loss=2.32, v_num=0]
Epoch 59:  30%|██▉       | 29/97 [00:05<00:12,  5.50it/s, loss=2.32, v_num=0]
Epoch 59:  31%|███       | 30/97 [00:05<00:11,  5.60it/s, loss=2.32, v_num=0]
Epoch 59:  31%|███       | 30/97 [00:05<00:12,  5.54it/s, loss=2.32, v_num=0]
Epoch 59:  32%|███▏      | 31/97 [00:05<00:11,  5.64it/s, loss=2.32, v_num=0]
Epoch 59:  32%|███▏      | 31/97 [00:05<00:11,  5.59it/s, loss=2.33, v_num=0]
Epoch 59:  33%|███▎      | 32/97 [00:05<00:11,  5.68it/s, loss=2.33, v_num=0]
Epoch 59:  33%|███▎      | 32/97 [00:05<00:11,  5.63it/s, loss=2.34, v_num=0]
Epoch 59:  34%|███▍      | 33/97 [00:05<00:11,  5.72it/s, loss=2.34, v_num=0]
Epoch 59:  34%|███▍      | 33/97 [00:05<00:11,  5.67it/s, loss=2.33, v_num=0]
Epoch 59:  35%|███▌      | 34/97 [00:05<00:10,  5.75it/s, loss=2.33, v_num=0]
Epoch 59:  35%|███▌      | 34/97 [00:05<00:11,  5.70it/s, loss=2.33, v_num=0]
Epoch 59:  36%|███▌      | 35/97 [00:06<00:10,  5.79it/s, loss=2.33, v_num=0]
Epoch 59:  36%|███▌      | 35/97 [00:06<00:10,  5.74it/s, loss=2.32, v_num=0]
Epoch 59:  37%|███▋      | 36/97 [00:06<00:10,  5.82it/s, loss=2.32, v_num=0]
Epoch 59:  37%|███▋      | 36/97 [00:06<00:10,  5.77it/s, loss=2.33, v_num=0]
Epoch 59:  38%|███▊      | 37/97 [00:06<00:10,  5.86it/s, loss=2.33, v_num=0]
Epoch 59:  38%|███▊      | 37/97 [00:06<00:10,  5.80it/s, loss=2.32, v_num=0]
Epoch 59:  39%|███▉      | 38/97 [00:06<00:10,  5.89it/s, loss=2.32, v_num=0]
Epoch 59:  39%|███▉      | 38/97 [00:06<00:10,  5.84it/s, loss=2.32, v_num=0]
Epoch 59:  40%|████      | 39/97 [00:06<00:09,  5.92it/s, loss=2.32, v_num=0]
Epoch 59:  40%|████      | 39/97 [00:06<00:09,  5.87it/s, loss=2.32, v_num=0]
Epoch 59:  41%|████      | 40/97 [00:06<00:09,  5.94it/s, loss=2.32, v_num=0]
Epoch 59:  41%|████      | 40/97 [00:06<00:09,  5.90it/s, loss=2.32, v_num=0]
Epoch 59:  42%|████▏     | 41/97 [00:06<00:09,  5.97it/s, loss=2.32, v_num=0]
Epoch 59:  42%|████▏     | 41/97 [00:06<00:09,  5.92it/s, loss=2.32, v_num=0]
Epoch 59:  43%|████▎     | 42/97 [00:07<00:09,  5.99it/s, loss=2.32, v_num=0]
Epoch 59:  43%|████▎     | 42/97 [00:07<00:09,  5.95it/s, loss=2.32, v_num=0]
Epoch 59:  44%|████▍     | 43/97 [00:07<00:08,  6.02it/s, loss=2.32, v_num=0]
Epoch 59:  44%|████▍     | 43/97 [00:07<00:09,  5.97it/s, loss=2.32, v_num=0]
Epoch 59:  45%|████▌     | 44/97 [00:07<00:08,  6.04it/s, loss=2.32, v_num=0]
Epoch 59:  45%|████▌     | 44/97 [00:07<00:08,  6.00it/s, loss=2.33, v_num=0]
Epoch 59:  46%|████▋     | 45/97 [00:07<00:08,  6.07it/s, loss=2.33, v_num=0]
Epoch 59:  46%|████▋     | 45/97 [00:07<00:08,  6.02it/s, loss=2.33, v_num=0]
Epoch 59:  47%|████▋     | 46/97 [00:07<00:08,  6.09it/s, loss=2.33, v_num=0]
Epoch 59:  47%|████▋     | 46/97 [00:07<00:08,  6.04it/s, loss=2.33, v_num=0]
Epoch 59:  48%|████▊     | 47/97 [00:07<00:08,  6.11it/s, loss=2.33, v_num=0]
Epoch 59:  48%|████▊     | 47/97 [00:07<00:08,  6.07it/s, loss=2.33, v_num=0]
Epoch 59:  49%|████▉     | 48/97 [00:07<00:07,  6.13it/s, loss=2.33, v_num=0]
Epoch 59:  49%|████▉     | 48/97 [00:07<00:08,  6.09it/s, loss=2.32, v_num=0]
Epoch 59:  51%|█████     | 49/97 [00:07<00:07,  6.15it/s, loss=2.32, v_num=0]
Epoch 59:  51%|█████     | 49/97 [00:08<00:07,  6.10it/s, loss=2.33, v_num=0]
Epoch 59:  52%|█████▏    | 50/97 [00:08<00:07,  6.17it/s, loss=2.33, v_num=0]
Epoch 59:  52%|█████▏    | 50/97 [00:08<00:07,  6.12it/s, loss=2.32, v_num=0]
Epoch 59:  53%|█████▎    | 51/97 [00:08<00:07,  6.18it/s, loss=2.32, v_num=0]
Epoch 59:  53%|█████▎    | 51/97 [00:08<00:07,  6.14it/s, loss=2.31, v_num=0]
Epoch 59:  54%|█████▎    | 52/97 [00:08<00:07,  6.20it/s, loss=2.31, v_num=0]
Epoch 59:  54%|█████▎    | 52/97 [00:08<00:07,  6.16it/s, loss=2.3, v_num=0]
Epoch 59:  55%|█████▍    | 53/97 [00:08<00:07,  6.22it/s, loss=2.3, v_num=0]
Epoch 59:  55%|█████▍    | 53/97 [00:08<00:07,  6.18it/s, loss=2.31, v_num=0]
Epoch 59:  56%|█████▌    | 54/97 [00:08<00:06,  6.24it/s, loss=2.31, v_num=0]
Epoch 59:  56%|█████▌    | 54/97 [00:08<00:06,  6.19it/s, loss=2.31, v_num=0]
Epoch 59:  57%|█████▋    | 55/97 [00:08<00:06,  6.25it/s, loss=2.31, v_num=0]
Epoch 59:  57%|█████▋    | 55/97 [00:08<00:06,  6.21it/s, loss=2.32, v_num=0]
Epoch 59:  58%|█████▊    | 56/97 [00:08<00:06,  6.27it/s, loss=2.32, v_num=0]
Epoch 59:  58%|█████▊    | 56/97 [00:08<00:06,  6.23it/s, loss=2.32, v_num=0]
Epoch 59:  59%|█████▉    | 57/97 [00:09<00:06,  6.28it/s, loss=2.32, v_num=0]
Epoch 59:  59%|█████▉    | 57/97 [00:09<00:06,  6.24it/s, loss=2.32, v_num=0]
Epoch 59:  60%|█████▉    | 58/97 [00:09<00:06,  6.30it/s, loss=2.32, v_num=0]
Epoch 59:  60%|█████▉    | 58/97 [00:09<00:06,  6.26it/s, loss=2.33, v_num=0]
Epoch 59:  61%|██████    | 59/97 [00:09<00:06,  6.31it/s, loss=2.33, v_num=0]
Epoch 59:  61%|██████    | 59/97 [00:09<00:06,  6.27it/s, loss=2.32, v_num=0]
Epoch 59:  62%|██████▏   | 60/97 [00:09<00:05,  6.33it/s, loss=2.32, v_num=0]
Epoch 59:  62%|██████▏   | 60/97 [00:09<00:05,  6.29it/s, loss=2.33, v_num=0]
Epoch 59:  63%|██████▎   | 61/97 [00:09<00:05,  6.34it/s, loss=2.33, v_num=0]
Epoch 59:  63%|██████▎   | 61/97 [00:09<00:05,  6.30it/s, loss=2.33, v_num=0]
Epoch 59:  64%|██████▍   | 62/97 [00:09<00:05,  6.35it/s, loss=2.33, v_num=0]
Epoch 59:  64%|██████▍   | 62/97 [00:09<00:05,  6.32it/s, loss=2.33, v_num=0]
Epoch 59:  65%|██████▍   | 63/97 [00:09<00:05,  6.37it/s, loss=2.33, v_num=0]
Epoch 59:  65%|██████▍   | 63/97 [00:09<00:05,  6.33it/s, loss=2.33, v_num=0]
Epoch 59:  66%|██████▌   | 64/97 [00:10<00:05,  6.38it/s, loss=2.33, v_num=0]
Epoch 59:  66%|██████▌   | 64/97 [00:10<00:05,  6.34it/s, loss=2.33, v_num=0]
Epoch 59:  67%|██████▋   | 65/97 [00:10<00:05,  6.39it/s, loss=2.33, v_num=0]
Epoch 59:  67%|██████▋   | 65/97 [00:10<00:05,  6.36it/s, loss=2.33, v_num=0]
Epoch 59:  68%|██████▊   | 66/97 [00:10<00:04,  6.41it/s, loss=2.33, v_num=0]
Epoch 59:  68%|██████▊   | 66/97 [00:10<00:04,  6.37it/s, loss=2.33, v_num=0]
Epoch 59:  69%|██████▉   | 67/97 [00:10<00:04,  6.42it/s, loss=2.33, v_num=0]
Epoch 59:  69%|██████▉   | 67/97 [00:10<00:04,  6.38it/s, loss=2.33, v_num=0]
Epoch 59:  70%|███████   | 68/97 [00:10<00:04,  6.43it/s, loss=2.33, v_num=0]
Epoch 59:  70%|███████   | 68/97 [00:10<00:04,  6.39it/s, loss=2.33, v_num=0]
Epoch 59:  71%|███████   | 69/97 [00:10<00:04,  6.44it/s, loss=2.33, v_num=0]
Epoch 59:  71%|███████   | 69/97 [00:10<00:04,  6.41it/s, loss=2.33, v_num=0]
Epoch 59:  72%|███████▏  | 70/97 [00:10<00:04,  6.45it/s, loss=2.33, v_num=0]
Epoch 59:  72%|███████▏  | 70/97 [00:10<00:04,  6.42it/s, loss=2.32, v_num=0]
Epoch 59:  73%|███████▎  | 71/97 [00:10<00:04,  6.46it/s, loss=2.32, v_num=0]
Epoch 59:  73%|███████▎  | 71/97 [00:11<00:04,  6.43it/s, loss=2.33, v_num=0]
Epoch 59:  74%|███████▍  | 72/97 [00:11<00:03,  6.47it/s, loss=2.33, v_num=0]
Epoch 59:  74%|███████▍  | 72/97 [00:11<00:03,  6.44it/s, loss=2.33, v_num=0]
Epoch 59:  75%|███████▌  | 73/97 [00:11<00:03,  6.48it/s, loss=2.33, v_num=0]
Epoch 59:  75%|███████▌  | 73/97 [00:11<00:03,  6.45it/s, loss=2.33, v_num=0]
Epoch 59:  76%|███████▋  | 74/97 [00:11<00:03,  6.49it/s, loss=2.33, v_num=0]
Epoch 59:  76%|███████▋  | 74/97 [00:11<00:03,  6.46it/s, loss=2.33, v_num=0]
Epoch 59:  77%|███████▋  | 75/97 [00:11<00:03,  6.50it/s, loss=2.33, v_num=0]
Epoch 59:  77%|███████▋  | 75/97 [00:11<00:03,  6.47it/s, loss=2.33, v_num=0]
Epoch 59:  78%|███████▊  | 76/97 [00:11<00:03,  6.51it/s, loss=2.33, v_num=0]
Epoch 59:  78%|███████▊  | 76/97 [00:11<00:03,  6.48it/s, loss=2.33, v_num=0]
Epoch 59:  79%|███████▉  | 77/97 [00:11<00:03,  6.52it/s, loss=2.33, v_num=0]
Epoch 59:  79%|███████▉  | 77/97 [00:11<00:03,  6.49it/s, loss=2.32, v_num=0]
Epoch 59:  80%|████████  | 78/97 [00:11<00:02,  6.53it/s, loss=2.32, v_num=0]
Epoch 59:  80%|████████  | 78/97 [00:12<00:02,  6.50it/s, loss=2.31, v_num=0]
Epoch 59:  81%|████████▏ | 79/97 [00:12<00:02,  6.54it/s, loss=2.31, v_num=0]
Epoch 59:  81%|████████▏ | 79/97 [00:12<00:02,  6.51it/s, loss=2.32, v_num=0]
Epoch 59:  82%|████████▏ | 80/97 [00:12<00:02,  6.55it/s, loss=2.32, v_num=0]
Epoch 59:  82%|████████▏ | 80/97 [00:12<00:02,  6.51it/s, loss=2.32, v_num=0]
Epoch 59:  84%|████████▎ | 81/97 [00:12<00:02,  6.55it/s, loss=2.32, v_num=0]
Epoch 59:  84%|████████▎ | 81/97 [00:12<00:02,  6.52it/s, loss=2.31, v_num=0]
Epoch 59:  85%|████████▍ | 82/97 [00:12<00:02,  6.56it/s, loss=2.31, v_num=0]
Epoch 59:  85%|████████▍ | 82/97 [00:12<00:02,  6.53it/s, loss=2.32, v_num=0]
Epoch 59:  86%|████████▌ | 83/97 [00:12<00:02,  6.57it/s, loss=2.32, v_num=0]
Epoch 59:  86%|████████▌ | 83/97 [00:12<00:02,  6.54it/s, loss=2.32, v_num=0]
Epoch 59:  87%|████████▋ | 84/97 [00:12<00:01,  6.57it/s, loss=2.32, v_num=0]
Epoch 59:  87%|████████▋ | 84/97 [00:12<00:01,  6.55it/s, loss=2.31, v_num=0]
Epoch 59:  88%|████████▊ | 85/97 [00:12<00:01,  6.58it/s, loss=2.31, v_num=0]
Epoch 59:  88%|████████▊ | 85/97 [00:12<00:01,  6.55it/s, loss=2.31, v_num=0]
Epoch 59:  89%|████████▊ | 86/97 [00:13<00:01,  6.59it/s, loss=2.31, v_num=0]
Epoch 59:  89%|████████▊ | 86/97 [00:13<00:01,  6.56it/s, loss=2.31, v_num=0]
Epoch 59:  90%|████████▉ | 87/97 [00:13<00:01,  6.60it/s, loss=2.31, v_num=0]
Epoch 59:  90%|████████▉ | 87/97 [00:13<00:01,  6.57it/s, loss=2.31, v_num=0]
Epoch 59:  91%|█████████ | 88/97 [00:13<00:01,  6.61it/s, loss=2.31, v_num=0]
Epoch 59:  91%|█████████ | 88/97 [00:13<00:01,  6.58it/s, loss=2.31, v_num=0]
Epoch 59:  92%|█████████▏| 89/97 [00:13<00:01,  6.61it/s, loss=2.31, v_num=0]
Epoch 59:  92%|█████████▏| 89/97 [00:13<00:01,  6.58it/s, loss=2.32, v_num=0]
Epoch 59:  93%|█████████▎| 90/97 [00:13<00:01,  6.62it/s, loss=2.32, v_num=0]
Epoch 59:  93%|█████████▎| 90/97 [00:13<00:01,  6.59it/s, loss=2.32, v_num=0]
Epoch 59:  94%|█████████▍| 91/97 [00:13<00:00,  6.63it/s, loss=2.32, v_num=0]
Epoch 59:  94%|█████████▍| 91/97 [00:13<00:00,  6.60it/s, loss=2.33, v_num=0]
Epoch 59:  95%|█████████▍| 92/97 [00:13<00:00,  6.63it/s, loss=2.33, v_num=0]
Epoch 59:  95%|█████████▍| 92/97 [00:13<00:00,  6.61it/s, loss=2.32, v_num=0]
Epoch 59:  96%|█████████▌| 93/97 [00:14<00:00,  6.64it/s, loss=2.32, v_num=0]
Epoch 59:  96%|█████████▌| 93/97 [00:14<00:00,  6.61it/s, loss=2.32, v_num=0]
Epoch 59:  97%|█████████▋| 94/97 [00:14<00:00,  6.65it/s, loss=2.32, v_num=0]
Epoch 59:  97%|█████████▋| 94/97 [00:14<00:00,  6.62it/s, loss=2.32, v_num=0]
Epoch 59:  98%|█████████▊| 95/97 [00:14<00:00,  6.65it/s, loss=2.32, v_num=0]
Epoch 59:  98%|█████████▊| 95/97 [00:14<00:00,  6.63it/s, loss=2.32, v_num=0]
Epoch 59:  99%|█████████▉| 96/97 [00:14<00:00,  6.66it/s, loss=2.32, v_num=0]
Epoch 59:  99%|█████████▉| 96/97 [00:14<00:00,  6.63it/s, loss=2.32, v_num=0]
Epoch 59: 100%|██████████| 97/97 [00:14<00:00,  6.66it/s, loss=2.32, v_num=0]
Epoch 59: 100%|██████████| 97/97 [00:14<00:00,  6.64it/s, loss=2.32, v_num=0]
Epoch 59: 100%|██████████| 97/97 [00:14<00:00,  6.64it/s, loss=2.32, v_num=0]
Epoch 59:   0%|          | 0/97 [00:00<?, ?it/s, loss=2.32, v_num=0]
Epoch 60:   0%|          | 0/97 [00:00<?, ?it/s, loss=2.32, v_num=0]
Epoch 60:   1%|          | 1/97 [00:01<02:12,  1.38s/it, loss=2.32, v_num=0]
Epoch 60:   1%|          | 1/97 [00:01<02:17,  1.43s/it, loss=2.33, v_num=0]
Epoch 60:   2%|▏         | 2/97 [00:01<01:12,  1.31it/s, loss=2.33, v_num=0]
Epoch 60:   2%|▏         | 2/97 [00:01<01:15,  1.26it/s, loss=2.33, v_num=0]
Epoch 60:   3%|▎         | 3/97 [00:01<00:52,  1.81it/s, loss=2.33, v_num=0]
Epoch 60:   3%|▎         | 3/97 [00:01<00:53,  1.75it/s, loss=2.32, v_num=0]
Epoch 60:   4%|▍         | 4/97 [00:01<00:41,  2.22it/s, loss=2.32, v_num=0]
Epoch 60:   4%|▍         | 4/97 [00:01<00:43,  2.16it/s, loss=2.32, v_num=0]
Epoch 60:   5%|▌         | 5/97 [00:01<00:35,  2.59it/s, loss=2.32, v_num=0]
Epoch 60:   5%|▌         | 5/97 [00:01<00:36,  2.51it/s, loss=2.32, v_num=0]
Epoch 60:   6%|▌         | 6/97 [00:02<00:31,  2.90it/s, loss=2.32, v_num=0]
Epoch 60:   6%|▌         | 6/97 [00:02<00:32,  2.82it/s, loss=2.32, v_num=0]
Epoch 60:   7%|▋         | 7/97 [00:02<00:28,  3.18it/s, loss=2.32, v_num=0]
Epoch 60:   7%|▋         | 7/97 [00:02<00:29,  3.09it/s, loss=2.32, v_num=0]
Epoch 60:   8%|▊         | 8/97 [00:02<00:26,  3.41it/s, loss=2.32, v_num=0]
Epoch 60:   8%|▊         | 8/97 [00:02<00:26,  3.33it/s, loss=2.32, v_num=0]
Epoch 60:   9%|▉         | 9/97 [00:02<00:24,  3.63it/s, loss=2.32, v_num=0]
Epoch 60:   9%|▉         | 9/97 [00:02<00:24,  3.55it/s, loss=2.31, v_num=0]
Epoch 60:  10%|█         | 10/97 [00:02<00:22,  3.81it/s, loss=2.31, v_num=0]
Epoch 60:  10%|█         | 10/97 [00:02<00:23,  3.74it/s, loss=2.32, v_num=0]
Epoch 60:  11%|█▏        | 11/97 [00:02<00:21,  3.99it/s, loss=2.32, v_num=0]
Epoch 60:  11%|█▏        | 11/97 [00:02<00:21,  3.91it/s, loss=2.31, v_num=0]
Epoch 60:  12%|█▏        | 12/97 [00:02<00:20,  4.15it/s, loss=2.31, v_num=0]
Epoch 60:  12%|█▏        | 12/97 [00:02<00:20,  4.07it/s, loss=2.31, v_num=0]
Epoch 60:  13%|█▎        | 13/97 [00:03<00:19,  4.30it/s, loss=2.31, v_num=0]
Epoch 60:  13%|█▎        | 13/97 [00:03<00:19,  4.22it/s, loss=2.3, v_num=0]
Epoch 60:  14%|█▍        | 14/97 [00:03<00:18,  4.42it/s, loss=2.3, v_num=0]
Epoch 60:  14%|█▍        | 14/97 [00:03<00:19,  4.35it/s, loss=2.31, v_num=0]
Epoch 60:  15%|█▌        | 15/97 [00:03<00:18,  4.55it/s, loss=2.31, v_num=0]
Epoch 60:  15%|█▌        | 15/97 [00:03<00:18,  4.47it/s, loss=2.31, v_num=0]
Epoch 60:  16%|█▋        | 16/97 [00:03<00:17,  4.65it/s, loss=2.31, v_num=0]
Epoch 60:  16%|█▋        | 16/97 [00:03<00:17,  4.57it/s, loss=2.31, v_num=0]
Epoch 60:  18%|█▊        | 17/97 [00:03<00:16,  4.76it/s, loss=2.31, v_num=0]
Epoch 60:  18%|█▊        | 17/97 [00:03<00:17,  4.68it/s, loss=2.31, v_num=0]
Epoch 60:  19%|█▊        | 18/97 [00:03<00:16,  4.84it/s, loss=2.31, v_num=0]
Epoch 60:  19%|█▊        | 18/97 [00:03<00:16,  4.77it/s, loss=2.31, v_num=0]
Epoch 60:  20%|█▉        | 19/97 [00:03<00:15,  4.94it/s, loss=2.31, v_num=0]
Epoch 60:  20%|█▉        | 19/97 [00:03<00:16,  4.86it/s, loss=2.31, v_num=0]
Epoch 60:  21%|██        | 20/97 [00:03<00:15,  5.01it/s, loss=2.31, v_num=0]
Epoch 60:  21%|██        | 20/97 [00:04<00:15,  4.94it/s, loss=2.31, v_num=0]
Epoch 60:  22%|██▏       | 21/97 [00:04<00:14,  5.09it/s, loss=2.31, v_num=0]
Epoch 60:  22%|██▏       | 21/97 [00:04<00:15,  5.02it/s, loss=2.31, v_num=0]
Epoch 60:  23%|██▎       | 22/97 [00:04<00:14,  5.16it/s, loss=2.31, v_num=0]
Epoch 60:  23%|██▎       | 22/97 [00:04<00:14,  5.09it/s, loss=2.31, v_num=0]
Epoch 60:  24%|██▎       | 23/97 [00:04<00:14,  5.23it/s, loss=2.31, v_num=0]
Epoch 60:  24%|██▎       | 23/97 [00:04<00:14,  5.16it/s, loss=2.3, v_num=0]
Epoch 60:  25%|██▍       | 24/97 [00:04<00:13,  5.28it/s, loss=2.3, v_num=0]
Epoch 60:  25%|██▍       | 24/97 [00:04<00:13,  5.22it/s, loss=2.3, v_num=0]
Epoch 60:  26%|██▌       | 25/97 [00:04<00:13,  5.34it/s, loss=2.3, v_num=0]
Epoch 60:  26%|██▌       | 25/97 [00:04<00:13,  5.28it/s, loss=2.31, v_num=0]
Epoch 60:  27%|██▋       | 26/97 [00:04<00:13,  5.40it/s, loss=2.31, v_num=0]
Epoch 60:  27%|██▋       | 26/97 [00:04<00:13,  5.33it/s, loss=2.31, v_num=0]
Epoch 60:  28%|██▊       | 27/97 [00:04<00:12,  5.45it/s, loss=2.31, v_num=0]
Epoch 60:  28%|██▊       | 27/97 [00:05<00:12,  5.39it/s, loss=2.3, v_num=0]
Epoch 60:  29%|██▉       | 28/97 [00:05<00:12,  5.50it/s, loss=2.3, v_num=0]
Epoch 60:  29%|██▉       | 28/97 [00:05<00:12,  5.44it/s, loss=2.31, v_num=0]
Epoch 60:  30%|██▉       | 29/97 [00:05<00:12,  5.54it/s, loss=2.31, v_num=0]
Epoch 60:  30%|██▉       | 29/97 [00:05<00:12,  5.49it/s, loss=2.31, v_num=0]
Epoch 60:  31%|███       | 30/97 [00:05<00:11,  5.59it/s, loss=2.31, v_num=0]
Epoch 60:  31%|███       | 30/97 [00:05<00:12,  5.53it/s, loss=2.31, v_num=0]
Epoch 60:  32%|███▏      | 31/97 [00:05<00:11,  5.63it/s, loss=2.31, v_num=0]
Epoch 60:  32%|███▏      | 31/97 [00:05<00:11,  5.58it/s, loss=2.32, v_num=0]
Epoch 60:  33%|███▎      | 32/97 [00:05<00:11,  5.67it/s, loss=2.32, v_num=0]
Epoch 60:  33%|███▎      | 32/97 [00:05<00:11,  5.62it/s, loss=2.32, v_num=0]
Epoch 60:  34%|███▍      | 33/97 [00:05<00:11,  5.71it/s, loss=2.32, v_num=0]
Epoch 60:  34%|███▍      | 33/97 [00:05<00:11,  5.66it/s, loss=2.32, v_num=0]
Epoch 60:  35%|███▌      | 34/97 [00:05<00:10,  5.75it/s, loss=2.32, v_num=0]
Epoch 60:  35%|███▌      | 34/97 [00:05<00:11,  5.70it/s, loss=2.32, v_num=0]
Epoch 60:  36%|███▌      | 35/97 [00:06<00:10,  5.78it/s, loss=2.32, v_num=0]
Epoch 60:  36%|███▌      | 35/97 [00:06<00:10,  5.73it/s, loss=2.31, v_num=0]
Epoch 60:  37%|███▋      | 36/97 [00:06<00:10,  5.82it/s, loss=2.31, v_num=0]
Epoch 60:  37%|███▋      | 36/97 [00:06<00:10,  5.77it/s, loss=2.32, v_num=0]
Epoch 60:  38%|███▊      | 37/97 [00:06<00:10,  5.85it/s, loss=2.32, v_num=0]
Epoch 60:  38%|███▊      | 37/97 [00:06<00:10,  5.80it/s, loss=2.32, v_num=0]
Epoch 60:  39%|███▉      | 38/97 [00:06<00:10,  5.88it/s, loss=2.32, v_num=0]
Epoch 60:  39%|███▉      | 38/97 [00:06<00:10,  5.83it/s, loss=2.31, v_num=0]
Epoch 60:  40%|████      | 39/97 [00:06<00:09,  5.91it/s, loss=2.31, v_num=0]
Epoch 60:  40%|████      | 39/97 [00:06<00:09,  5.86it/s, loss=2.32, v_num=0]
Epoch 60:  41%|████      | 40/97 [00:06<00:09,  5.94it/s, loss=2.32, v_num=0]
Epoch 60:  41%|████      | 40/97 [00:06<00:09,  5.89it/s, loss=2.32, v_num=0]
Epoch 60:  42%|████▏     | 41/97 [00:06<00:09,  5.97it/s, loss=2.32, v_num=0]
Epoch 60:  42%|████▏     | 41/97 [00:06<00:09,  5.92it/s, loss=2.32, v_num=0]
Epoch 60:  43%|████▎     | 42/97 [00:07<00:09,  5.99it/s, loss=2.32, v_num=0]
Epoch 60:  43%|████▎     | 42/97 [00:07<00:09,  5.95it/s, loss=2.32, v_num=0]
Epoch 60:  44%|████▍     | 43/97 [00:07<00:08,  6.02it/s, loss=2.32, v_num=0]
Epoch 60:  44%|████▍     | 43/97 [00:07<00:09,  5.97it/s, loss=2.32, v_num=0]
Epoch 60:  45%|████▌     | 44/97 [00:07<00:08,  6.04it/s, loss=2.32, v_num=0]
Epoch 60:  45%|████▌     | 44/97 [00:07<00:08,  6.00it/s, loss=2.32, v_num=0]
Epoch 60:  46%|████▋     | 45/97 [00:07<00:08,  6.07it/s, loss=2.32, v_num=0]
Epoch 60:  46%|████▋     | 45/97 [00:07<00:08,  6.02it/s, loss=2.31, v_num=0]
Epoch 60:  47%|████▋     | 46/97 [00:07<00:08,  6.08it/s, loss=2.31, v_num=0]
Epoch 60:  47%|████▋     | 46/97 [00:07<00:08,  6.04it/s, loss=2.31, v_num=0]
Epoch 60:  48%|████▊     | 47/97 [00:07<00:08,  6.11it/s, loss=2.31, v_num=0]
Epoch 60:  48%|████▊     | 47/97 [00:07<00:08,  6.06it/s, loss=2.31, v_num=0]
Epoch 60:  49%|████▉     | 48/97 [00:07<00:07,  6.13it/s, loss=2.31, v_num=0]
Epoch 60:  49%|████▉     | 48/97 [00:07<00:08,  6.08it/s, loss=2.31, v_num=0]
Epoch 60:  51%|█████     | 49/97 [00:07<00:07,  6.15it/s, loss=2.31, v_num=0]
Epoch 60:  51%|█████     | 49/97 [00:08<00:07,  6.11it/s, loss=2.31, v_num=0]
Epoch 60:  52%|█████▏    | 50/97 [00:08<00:07,  6.17it/s, loss=2.31, v_num=0]
Epoch 60:  52%|█████▏    | 50/97 [00:08<00:07,  6.13it/s, loss=2.31, v_num=0]
Epoch 60:  53%|█████▎    | 51/97 [00:08<00:07,  6.19it/s, loss=2.31, v_num=0]
Epoch 60:  53%|█████▎    | 51/97 [00:08<00:07,  6.15it/s, loss=2.3, v_num=0]
Epoch 60:  54%|█████▎    | 52/97 [00:08<00:07,  6.20it/s, loss=2.3, v_num=0]
Epoch 60:  54%|█████▎    | 52/97 [00:08<00:07,  6.16it/s, loss=2.31, v_num=0]
Epoch 60:  55%|█████▍    | 53/97 [00:08<00:07,  6.22it/s, loss=2.31, v_num=0]
Epoch 60:  55%|█████▍    | 53/97 [00:08<00:07,  6.18it/s, loss=2.31, v_num=0]
Epoch 60:  56%|█████▌    | 54/97 [00:08<00:06,  6.24it/s, loss=2.31, v_num=0]
Epoch 60:  56%|█████▌    | 54/97 [00:08<00:06,  6.20it/s, loss=2.31, v_num=0]
Epoch 60:  57%|█████▋    | 55/97 [00:08<00:06,  6.26it/s, loss=2.31, v_num=0]
Epoch 60:  57%|█████▋    | 55/97 [00:08<00:06,  6.22it/s, loss=2.31, v_num=0]
Epoch 60:  58%|█████▊    | 56/97 [00:08<00:06,  6.27it/s, loss=2.31, v_num=0]
Epoch 60:  58%|█████▊    | 56/97 [00:08<00:06,  6.23it/s, loss=2.31, v_num=0]
Epoch 60:  59%|█████▉    | 57/97 [00:09<00:06,  6.29it/s, loss=2.31, v_num=0]
Epoch 60:  59%|█████▉    | 57/97 [00:09<00:06,  6.25it/s, loss=2.31, v_num=0]
Epoch 60:  60%|█████▉    | 58/97 [00:09<00:06,  6.30it/s, loss=2.31, v_num=0]
Epoch 60:  60%|█████▉    | 58/97 [00:09<00:06,  6.26it/s, loss=2.31, v_num=0]
Epoch 60:  61%|██████    | 59/97 [00:09<00:06,  6.31it/s, loss=2.31, v_num=0]
Epoch 60:  61%|██████    | 59/97 [00:09<00:06,  6.28it/s, loss=2.3, v_num=0]
Epoch 60:  62%|██████▏   | 60/97 [00:09<00:05,  6.33it/s, loss=2.3, v_num=0]
Epoch 60:  62%|██████▏   | 60/97 [00:09<00:05,  6.29it/s, loss=2.3, v_num=0]
Epoch 60:  63%|██████▎   | 61/97 [00:09<00:05,  6.34it/s, loss=2.3, v_num=0]
Epoch 60:  63%|██████▎   | 61/97 [00:09<00:05,  6.31it/s, loss=2.3, v_num=0]
Epoch 60:  64%|██████▍   | 62/97 [00:09<00:05,  6.36it/s, loss=2.3, v_num=0]
Epoch 60:  64%|██████▍   | 62/97 [00:09<00:05,  6.32it/s, loss=2.3, v_num=0]
Epoch 60:  65%|██████▍   | 63/97 [00:09<00:05,  6.37it/s, loss=2.3, v_num=0]
Epoch 60:  65%|██████▍   | 63/97 [00:09<00:05,  6.33it/s, loss=2.3, v_num=0]
Epoch 60:  66%|██████▌   | 64/97 [00:10<00:05,  6.38it/s, loss=2.3, v_num=0]
Epoch 60:  66%|██████▌   | 64/97 [00:10<00:05,  6.35it/s, loss=2.3, v_num=0]
Epoch 60:  67%|██████▋   | 65/97 [00:10<00:05,  6.39it/s, loss=2.3, v_num=0]
Epoch 60:  67%|██████▋   | 65/97 [00:10<00:05,  6.36it/s, loss=2.31, v_num=0]
Epoch 60:  68%|██████▊   | 66/97 [00:10<00:04,  6.41it/s, loss=2.31, v_num=0]
Epoch 60:  68%|██████▊   | 66/97 [00:10<00:04,  6.37it/s, loss=2.31, v_num=0]
Epoch 60:  69%|██████▉   | 67/97 [00:10<00:04,  6.42it/s, loss=2.31, v_num=0]
Epoch 60:  69%|██████▉   | 67/97 [00:10<00:04,  6.38it/s, loss=2.31, v_num=0]
Epoch 60:  70%|███████   | 68/97 [00:10<00:04,  6.43it/s, loss=2.31, v_num=0]
Epoch 60:  70%|███████   | 68/97 [00:10<00:04,  6.40it/s, loss=2.32, v_num=0]
Epoch 60:  71%|███████   | 69/97 [00:10<00:04,  6.44it/s, loss=2.32, v_num=0]
Epoch 60:  71%|███████   | 69/97 [00:10<00:04,  6.41it/s, loss=2.32, v_num=0]
Epoch 60:  72%|███████▏  | 70/97 [00:10<00:04,  6.45it/s, loss=2.32, v_num=0]
Epoch 60:  72%|███████▏  | 70/97 [00:10<00:04,  6.42it/s, loss=2.32, v_num=0]
Epoch 60:  73%|███████▎  | 71/97 [00:10<00:04,  6.46it/s, loss=2.32, v_num=0]
Epoch 60:  73%|███████▎  | 71/97 [00:11<00:04,  6.43it/s, loss=2.32, v_num=0]
Epoch 60:  74%|███████▍  | 72/97 [00:11<00:03,  6.47it/s, loss=2.32, v_num=0]
Epoch 60:  74%|███████▍  | 72/97 [00:11<00:03,  6.44it/s, loss=2.33, v_num=0]
Epoch 60:  75%|███████▌  | 73/97 [00:11<00:03,  6.48it/s, loss=2.33, v_num=0]
Epoch 60:  75%|███████▌  | 73/97 [00:11<00:03,  6.45it/s, loss=2.32, v_num=0]
Epoch 60:  76%|███████▋  | 74/97 [00:11<00:03,  6.49it/s, loss=2.32, v_num=0]
Epoch 60:  76%|███████▋  | 74/97 [00:11<00:03,  6.46it/s, loss=2.32, v_num=0]
Epoch 60:  77%|███████▋  | 75/97 [00:11<00:03,  6.50it/s, loss=2.32, v_num=0]
Epoch 60:  77%|███████▋  | 75/97 [00:11<00:03,  6.47it/s, loss=2.31, v_num=0]
Epoch 60:  78%|███████▊  | 76/97 [00:11<00:03,  6.51it/s, loss=2.31, v_num=0]
Epoch 60:  78%|███████▊  | 76/97 [00:11<00:03,  6.48it/s, loss=2.31, v_num=0]
Epoch 60:  79%|███████▉  | 77/97 [00:11<00:03,  6.52it/s, loss=2.31, v_num=0]
Epoch 60:  79%|███████▉  | 77/97 [00:11<00:03,  6.49it/s, loss=2.31, v_num=0]
Epoch 60:  80%|████████  | 78/97 [00:11<00:02,  6.53it/s, loss=2.31, v_num=0]
Epoch 60:  80%|████████  | 78/97 [00:12<00:02,  6.50it/s, loss=2.31, v_num=0]
Epoch 60:  81%|████████▏ | 79/97 [00:12<00:02,  6.54it/s, loss=2.31, v_num=0]
Epoch 60:  81%|████████▏ | 79/97 [00:12<00:02,  6.51it/s, loss=2.3, v_num=0]
Epoch 60:  82%|████████▏ | 80/97 [00:12<00:02,  6.54it/s, loss=2.3, v_num=0]
Epoch 60:  82%|████████▏ | 80/97 [00:12<00:02,  6.52it/s, loss=2.3, v_num=0]
Epoch 60:  84%|████████▎ | 81/97 [00:12<00:02,  6.55it/s, loss=2.3, v_num=0]
Epoch 60:  84%|████████▎ | 81/97 [00:12<00:02,  6.52it/s, loss=2.3, v_num=0]
Epoch 60:  85%|████████▍ | 82/97 [00:12<00:02,  6.56it/s, loss=2.3, v_num=0]
Epoch 60:  85%|████████▍ | 82/97 [00:12<00:02,  6.53it/s, loss=2.3, v_num=0]
Epoch 60:  86%|████████▌ | 83/97 [00:12<00:02,  6.57it/s, loss=2.3, v_num=0]
Epoch 60:  86%|████████▌ | 83/97 [00:12<00:02,  6.54it/s, loss=2.3, v_num=0]
Epoch 60:  87%|████████▋ | 84/97 [00:12<00:01,  6.58it/s, loss=2.3, v_num=0]
Epoch 60:  87%|████████▋ | 84/97 [00:12<00:01,  6.55it/s, loss=2.3, v_num=0]
Epoch 60:  88%|████████▊ | 85/97 [00:12<00:01,  6.58it/s, loss=2.3, v_num=0]
Epoch 60:  88%|████████▊ | 85/97 [00:12<00:01,  6.56it/s, loss=2.29, v_num=0]
Epoch 60:  89%|████████▊ | 86/97 [00:13<00:01,  6.59it/s, loss=2.29, v_num=0]
Epoch 60:  89%|████████▊ | 86/97 [00:13<00:01,  6.56it/s, loss=2.29, v_num=0]
Epoch 60:  90%|████████▉ | 87/97 [00:13<00:01,  6.60it/s, loss=2.29, v_num=0]
Epoch 60:  90%|████████▉ | 87/97 [00:13<00:01,  6.57it/s, loss=2.28, v_num=0]
Epoch 60:  91%|█████████ | 88/97 [00:13<00:01,  6.61it/s, loss=2.28, v_num=0]
Epoch 60:  91%|█████████ | 88/97 [00:13<00:01,  6.58it/s, loss=2.28, v_num=0]
Epoch 60:  92%|█████████▏| 89/97 [00:13<00:01,  6.61it/s, loss=2.28, v_num=0]
Epoch 60:  92%|█████████▏| 89/97 [00:13<00:01,  6.59it/s, loss=2.29, v_num=0]
Epoch 60:  93%|█████████▎| 90/97 [00:13<00:01,  6.62it/s, loss=2.29, v_num=0]
Epoch 60:  93%|█████████▎| 90/97 [00:13<00:01,  6.59it/s, loss=2.28, v_num=0]
Epoch 60:  94%|█████████▍| 91/97 [00:13<00:00,  6.63it/s, loss=2.28, v_num=0]
Epoch 60:  94%|█████████▍| 91/97 [00:13<00:00,  6.60it/s, loss=2.29, v_num=0]
Epoch 60:  95%|█████████▍| 92/97 [00:13<00:00,  6.63it/s, loss=2.29, v_num=0]
Epoch 60:  95%|█████████▍| 92/97 [00:13<00:00,  6.61it/s, loss=2.28, v_num=0]
Epoch 60:  96%|█████████▌| 93/97 [00:14<00:00,  6.64it/s, loss=2.28, v_num=0]
Epoch 60:  96%|█████████▌| 93/97 [00:14<00:00,  6.61it/s, loss=2.29, v_num=0]
Epoch 60:  97%|█████████▋| 94/97 [00:14<00:00,  6.65it/s, loss=2.29, v_num=0]
Epoch 60:  97%|█████████▋| 94/97 [00:14<00:00,  6.62it/s, loss=2.29, v_num=0]
Epoch 60:  98%|█████████▊| 95/97 [00:14<00:00,  6.65it/s, loss=2.29, v_num=0]
Epoch 60:  98%|█████████▊| 95/97 [00:14<00:00,  6.63it/s, loss=2.29, v_num=0]
Epoch 60:  99%|█████████▉| 96/97 [00:14<00:00,  6.66it/s, loss=2.29, v_num=0]
Epoch 60:  99%|█████████▉| 96/97 [00:14<00:00,  6.63it/s, loss=2.3, v_num=0]
Epoch 60: 100%|██████████| 97/97 [00:14<00:00,  6.66it/s, loss=2.3, v_num=0]
Epoch 60: 100%|██████████| 97/97 [00:14<00:00,  6.64it/s, loss=2.3, v_num=0]
Epoch 60: 100%|██████████| 97/97 [00:14<00:00,  6.64it/s, loss=2.3, v_num=0]
Epoch 60:   0%|          | 0/97 [00:00<?, ?it/s, loss=2.3, v_num=0]
Epoch 61:   0%|          | 0/97 [00:00<?, ?it/s, loss=2.3, v_num=0]
Epoch 61:   1%|          | 1/97 [00:01<02:11,  1.37s/it, loss=2.3, v_num=0]
Epoch 61:   1%|          | 1/97 [00:01<02:17,  1.43s/it, loss=2.31, v_num=0]
Epoch 61:   2%|▏         | 2/97 [00:01<01:12,  1.32it/s, loss=2.31, v_num=0]
Epoch 61:   2%|▏         | 2/97 [00:01<01:14,  1.27it/s, loss=2.31, v_num=0]
Epoch 61:   3%|▎         | 3/97 [00:01<00:51,  1.82it/s, loss=2.31, v_num=0]
Epoch 61:   3%|▎         | 3/97 [00:01<00:53,  1.76it/s, loss=2.31, v_num=0]
Epoch 61:   4%|▍         | 4/97 [00:01<00:41,  2.24it/s, loss=2.31, v_num=0]
Epoch 61:   4%|▍         | 4/97 [00:01<00:42,  2.17it/s, loss=2.33, v_num=0]
Epoch 61:   5%|▌         | 5/97 [00:01<00:35,  2.60it/s, loss=2.33, v_num=0]
Epoch 61:   5%|▌         | 5/97 [00:01<00:36,  2.52it/s, loss=2.34, v_num=0]
Epoch 61:   6%|▌         | 6/97 [00:02<00:31,  2.92it/s, loss=2.34, v_num=0]
Epoch 61:   6%|▌         | 6/97 [00:02<00:32,  2.83it/s, loss=2.33, v_num=0]
Epoch 61:   7%|▋         | 7/97 [00:02<00:28,  3.18it/s, loss=2.33, v_num=0]
Epoch 61:   7%|▋         | 7/97 [00:02<00:28,  3.10it/s, loss=2.33, v_num=0]
Epoch 61:   8%|▊         | 8/97 [00:02<00:25,  3.42it/s, loss=2.33, v_num=0]
Epoch 61:   8%|▊         | 8/97 [00:02<00:26,  3.35it/s, loss=2.34, v_num=0]
Epoch 61:   9%|▉         | 9/97 [00:02<00:24,  3.63it/s, loss=2.34, v_num=0]
Epoch 61:   9%|▉         | 9/97 [00:02<00:24,  3.55it/s, loss=2.34, v_num=0]
Epoch 61:  10%|█         | 10/97 [00:02<00:22,  3.82it/s, loss=2.34, v_num=0]
Epoch 61:  10%|█         | 10/97 [00:02<00:23,  3.74it/s, loss=2.34, v_num=0]
Epoch 61:  11%|█▏        | 11/97 [00:02<00:21,  3.99it/s, loss=2.34, v_num=0]
Epoch 61:  11%|█▏        | 11/97 [00:02<00:21,  3.92it/s, loss=2.34, v_num=0]
Epoch 61:  12%|█▏        | 12/97 [00:02<00:20,  4.16it/s, loss=2.34, v_num=0]
Epoch 61:  12%|█▏        | 12/97 [00:02<00:20,  4.07it/s, loss=2.33, v_num=0]
Epoch 61:  13%|█▎        | 13/97 [00:03<00:19,  4.30it/s, loss=2.33, v_num=0]
Epoch 61:  13%|█▎        | 13/97 [00:03<00:19,  4.22it/s, loss=2.33, v_num=0]
Epoch 61:  14%|█▍        | 14/97 [00:03<00:18,  4.43it/s, loss=2.33, v_num=0]
Epoch 61:  14%|█▍        | 14/97 [00:03<00:19,  4.35it/s, loss=2.34, v_num=0]
Epoch 61:  15%|█▌        | 15/97 [00:03<00:18,  4.55it/s, loss=2.34, v_num=0]
Epoch 61:  15%|█▌        | 15/97 [00:03<00:18,  4.47it/s, loss=2.34, v_num=0]
Epoch 61:  16%|█▋        | 16/97 [00:03<00:17,  4.66it/s, loss=2.34, v_num=0]
Epoch 61:  16%|█▋        | 16/97 [00:03<00:17,  4.59it/s, loss=2.33, v_num=0]
Epoch 61:  18%|█▊        | 17/97 [00:03<00:16,  4.76it/s, loss=2.33, v_num=0]
Epoch 61:  18%|█▊        | 17/97 [00:03<00:17,  4.68it/s, loss=2.32, v_num=0]
Epoch 61:  19%|█▊        | 18/97 [00:03<00:16,  4.85it/s, loss=2.32, v_num=0]
Epoch 61:  19%|█▊        | 18/97 [00:03<00:16,  4.78it/s, loss=2.32, v_num=0]
Epoch 61:  20%|█▉        | 19/97 [00:03<00:15,  4.94it/s, loss=2.32, v_num=0]
Epoch 61:  20%|█▉        | 19/97 [00:03<00:16,  4.87it/s, loss=2.32, v_num=0]
Epoch 61:  21%|██        | 20/97 [00:03<00:15,  5.02it/s, loss=2.32, v_num=0]
Epoch 61:  21%|██        | 20/97 [00:04<00:15,  4.95it/s, loss=2.31, v_num=0]
Epoch 61:  22%|██▏       | 21/97 [00:04<00:14,  5.10it/s, loss=2.31, v_num=0]
Epoch 61:  22%|██▏       | 21/97 [00:04<00:15,  5.03it/s, loss=2.3, v_num=0]
Epoch 61:  23%|██▎       | 22/97 [00:04<00:14,  5.17it/s, loss=2.3, v_num=0]
Epoch 61:  23%|██▎       | 22/97 [00:04<00:14,  5.10it/s, loss=2.31, v_num=0]
Epoch 61:  24%|██▎       | 23/97 [00:04<00:14,  5.24it/s, loss=2.31, v_num=0]
Epoch 61:  24%|██▎       | 23/97 [00:04<00:14,  5.17it/s, loss=2.29, v_num=0]
Epoch 61:  25%|██▍       | 24/97 [00:04<00:13,  5.30it/s, loss=2.29, v_num=0]
Epoch 61:  25%|██▍       | 24/97 [00:04<00:13,  5.23it/s, loss=2.29, v_num=0]
Epoch 61:  26%|██▌       | 25/97 [00:04<00:13,  5.36it/s, loss=2.29, v_num=0]
Epoch 61:  26%|██▌       | 25/97 [00:04<00:13,  5.30it/s, loss=2.28, v_num=0]
Epoch 61:  27%|██▋       | 26/97 [00:04<00:13,  5.42it/s, loss=2.28, v_num=0]
Epoch 61:  27%|██▋       | 26/97 [00:04<00:13,  5.35it/s, loss=2.28, v_num=0]
Epoch 61:  28%|██▊       | 27/97 [00:04<00:12,  5.47it/s, loss=2.28, v_num=0]
Epoch 61:  28%|██▊       | 27/97 [00:04<00:12,  5.41it/s, loss=2.28, v_num=0]
Epoch 61:  29%|██▉       | 28/97 [00:05<00:12,  5.52it/s, loss=2.28, v_num=0]
Epoch 61:  29%|██▉       | 28/97 [00:05<00:12,  5.46it/s, loss=2.28, v_num=0]
Epoch 61:  30%|██▉       | 29/97 [00:05<00:12,  5.56it/s, loss=2.28, v_num=0]
Epoch 61:  30%|██▉       | 29/97 [00:05<00:12,  5.50it/s, loss=2.27, v_num=0]
Epoch 61:  31%|███       | 30/97 [00:05<00:11,  5.60it/s, loss=2.27, v_num=0]
Epoch 61:  31%|███       | 30/97 [00:05<00:12,  5.55it/s, loss=2.27, v_num=0]
Epoch 61:  32%|███▏      | 31/97 [00:05<00:11,  5.64it/s, loss=2.27, v_num=0]
Epoch 61:  32%|███▏      | 31/97 [00:05<00:11,  5.59it/s, loss=2.27, v_num=0]
Epoch 61:  33%|███▎      | 32/97 [00:05<00:11,  5.68it/s, loss=2.27, v_num=0]
Epoch 61:  33%|███▎      | 32/97 [00:05<00:11,  5.63it/s, loss=2.27, v_num=0]
Epoch 61:  34%|███▍      | 33/97 [00:05<00:11,  5.72it/s, loss=2.27, v_num=0]
Epoch 61:  34%|███▍      | 33/97 [00:05<00:11,  5.67it/s, loss=2.26, v_num=0]
Epoch 61:  35%|███▌      | 34/97 [00:05<00:10,  5.76it/s, loss=2.26, v_num=0]
Epoch 61:  35%|███▌      | 34/97 [00:05<00:11,  5.70it/s, loss=2.26, v_num=0]
Epoch 61:  36%|███▌      | 35/97 [00:06<00:10,  5.79it/s, loss=2.26, v_num=0]
Epoch 61:  36%|███▌      | 35/97 [00:06<00:10,  5.74it/s, loss=2.26, v_num=0]
Epoch 61:  37%|███▋      | 36/97 [00:06<00:10,  5.83it/s, loss=2.26, v_num=0]
Epoch 61:  37%|███▋      | 36/97 [00:06<00:10,  5.78it/s, loss=2.26, v_num=0]
Epoch 61:  38%|███▊      | 37/97 [00:06<00:10,  5.86it/s, loss=2.26, v_num=0]
Epoch 61:  38%|███▊      | 37/97 [00:06<00:10,  5.81it/s, loss=2.27, v_num=0]
Epoch 61:  39%|███▉      | 38/97 [00:06<00:10,  5.89it/s, loss=2.27, v_num=0]
Epoch 61:  39%|███▉      | 38/97 [00:06<00:10,  5.84it/s, loss=2.27, v_num=0]
Epoch 61:  40%|████      | 39/97 [00:06<00:09,  5.92it/s, loss=2.27, v_num=0]
Epoch 61:  40%|████      | 39/97 [00:06<00:09,  5.87it/s, loss=2.27, v_num=0]
Epoch 61:  41%|████      | 40/97 [00:06<00:09,  5.95it/s, loss=2.27, v_num=0]
Epoch 61:  41%|████      | 40/97 [00:06<00:09,  5.90it/s, loss=2.27, v_num=0]
Epoch 61:  42%|████▏     | 41/97 [00:06<00:09,  5.97it/s, loss=2.27, v_num=0]
Epoch 61:  42%|████▏     | 41/97 [00:06<00:09,  5.93it/s, loss=2.28, v_num=0]
Epoch 61:  43%|████▎     | 42/97 [00:07<00:09,  6.00it/s, loss=2.28, v_num=0]
Epoch 61:  43%|████▎     | 42/97 [00:07<00:09,  5.95it/s, loss=2.29, v_num=0]
Epoch 61:  44%|████▍     | 43/97 [00:07<00:08,  6.02it/s, loss=2.29, v_num=0]
Epoch 61:  44%|████▍     | 43/97 [00:07<00:09,  5.97it/s, loss=2.29, v_num=0]
Epoch 61:  45%|████▌     | 44/97 [00:07<00:08,  6.04it/s, loss=2.29, v_num=0]
Epoch 61:  45%|████▌     | 44/97 [00:07<00:08,  6.00it/s, loss=2.29, v_num=0]
Epoch 61:  46%|████▋     | 45/97 [00:07<00:08,  6.07it/s, loss=2.29, v_num=0]
Epoch 61:  46%|████▋     | 45/97 [00:07<00:08,  6.02it/s, loss=2.29, v_num=0]
Epoch 61:  47%|████▋     | 46/97 [00:07<00:08,  6.08it/s, loss=2.29, v_num=0]
Epoch 61:  47%|████▋     | 46/97 [00:07<00:08,  6.04it/s, loss=2.29, v_num=0]
Epoch 61:  48%|████▊     | 47/97 [00:07<00:08,  6.11it/s, loss=2.29, v_num=0]
Epoch 61:  48%|████▊     | 47/97 [00:07<00:08,  6.06it/s, loss=2.29, v_num=0]
Epoch 61:  49%|████▉     | 48/97 [00:07<00:08,  6.12it/s, loss=2.29, v_num=0]
Epoch 61:  49%|████▉     | 48/97 [00:07<00:08,  6.08it/s, loss=2.29, v_num=0]
Epoch 61:  51%|█████     | 49/97 [00:07<00:07,  6.14it/s, loss=2.29, v_num=0]
Epoch 61:  51%|█████     | 49/97 [00:08<00:07,  6.10it/s, loss=2.29, v_num=0]
Epoch 61:  52%|█████▏    | 50/97 [00:08<00:07,  6.17it/s, loss=2.29, v_num=0]
Epoch 61:  52%|█████▏    | 50/97 [00:08<00:07,  6.12it/s, loss=2.29, v_num=0]
Epoch 61:  53%|█████▎    | 51/97 [00:08<00:07,  6.18it/s, loss=2.29, v_num=0]
Epoch 61:  53%|█████▎    | 51/97 [00:08<00:07,  6.14it/s, loss=2.29, v_num=0]
Epoch 61:  54%|█████▎    | 52/97 [00:08<00:07,  6.20it/s, loss=2.29, v_num=0]
Epoch 61:  54%|█████▎    | 52/97 [00:08<00:07,  6.16it/s, loss=2.29, v_num=0]
Epoch 61:  55%|█████▍    | 53/97 [00:08<00:07,  6.22it/s, loss=2.29, v_num=0]
Epoch 61:  55%|█████▍    | 53/97 [00:08<00:07,  6.18it/s, loss=2.29, v_num=0]
Epoch 61:  56%|█████▌    | 54/97 [00:08<00:06,  6.24it/s, loss=2.29, v_num=0]
Epoch 61:  56%|█████▌    | 54/97 [00:08<00:06,  6.19it/s, loss=2.29, v_num=0]
Epoch 61:  57%|█████▋    | 55/97 [00:08<00:06,  6.25it/s, loss=2.29, v_num=0]
Epoch 61:  57%|█████▋    | 55/97 [00:08<00:06,  6.21it/s, loss=2.29, v_num=0]
Epoch 61:  58%|█████▊    | 56/97 [00:08<00:06,  6.27it/s, loss=2.29, v_num=0]
Epoch 61:  58%|█████▊    | 56/97 [00:08<00:06,  6.23it/s, loss=2.28, v_num=0]
Epoch 61:  59%|█████▉    | 57/97 [00:09<00:06,  6.28it/s, loss=2.28, v_num=0]
Epoch 61:  59%|█████▉    | 57/97 [00:09<00:06,  6.24it/s, loss=2.28, v_num=0]
Epoch 61:  60%|█████▉    | 58/97 [00:09<00:06,  6.29it/s, loss=2.28, v_num=0]
Epoch 61:  60%|█████▉    | 58/97 [00:09<00:06,  6.26it/s, loss=2.29, v_num=0]
Epoch 61:  61%|██████    | 59/97 [00:09<00:06,  6.31it/s, loss=2.29, v_num=0]
Epoch 61:  61%|██████    | 59/97 [00:09<00:06,  6.27it/s, loss=2.29, v_num=0]
Epoch 61:  62%|██████▏   | 60/97 [00:09<00:05,  6.32it/s, loss=2.29, v_num=0]
Epoch 61:  62%|██████▏   | 60/97 [00:09<00:05,  6.29it/s, loss=2.29, v_num=0]
Epoch 61:  63%|██████▎   | 61/97 [00:09<00:05,  6.33it/s, loss=2.29, v_num=0]
Epoch 61:  63%|██████▎   | 61/97 [00:09<00:05,  6.30it/s, loss=2.28, v_num=0]
Epoch 61:  64%|██████▍   | 62/97 [00:09<00:05,  6.35it/s, loss=2.28, v_num=0]
Epoch 61:  64%|██████▍   | 62/97 [00:09<00:05,  6.31it/s, loss=2.28, v_num=0]
Epoch 61:  65%|██████▍   | 63/97 [00:09<00:05,  6.36it/s, loss=2.28, v_num=0]
Epoch 61:  65%|██████▍   | 63/97 [00:09<00:05,  6.32it/s, loss=2.28, v_num=0]
Epoch 61:  66%|██████▌   | 64/97 [00:10<00:05,  6.37it/s, loss=2.28, v_num=0]
Epoch 61:  66%|██████▌   | 64/97 [00:10<00:05,  6.34it/s, loss=2.28, v_num=0]
Epoch 61:  67%|██████▋   | 65/97 [00:10<00:05,  6.38it/s, loss=2.28, v_num=0]
Epoch 61:  67%|██████▋   | 65/97 [00:10<00:05,  6.35it/s, loss=2.28, v_num=0]
Epoch 61:  68%|██████▊   | 66/97 [00:10<00:04,  6.39it/s, loss=2.28, v_num=0]
Epoch 61:  68%|██████▊   | 66/97 [00:10<00:04,  6.36it/s, loss=2.28, v_num=0]
Epoch 61:  69%|██████▉   | 67/97 [00:10<00:04,  6.41it/s, loss=2.28, v_num=0]
Epoch 61:  69%|██████▉   | 67/97 [00:10<00:04,  6.37it/s, loss=2.28, v_num=0]
Epoch 61:  70%|███████   | 68/97 [00:10<00:04,  6.42it/s, loss=2.28, v_num=0]
Epoch 61:  70%|███████   | 68/97 [00:10<00:04,  6.38it/s, loss=2.28, v_num=0]
Epoch 61:  71%|███████   | 69/97 [00:10<00:04,  6.43it/s, loss=2.28, v_num=0]
Epoch 61:  71%|███████   | 69/97 [00:10<00:04,  6.39it/s, loss=2.29, v_num=0]
Epoch 61:  72%|███████▏  | 70/97 [00:10<00:04,  6.44it/s, loss=2.29, v_num=0]
Epoch 61:  72%|███████▏  | 70/97 [00:10<00:04,  6.41it/s, loss=2.3, v_num=0]
Epoch 61:  73%|███████▎  | 71/97 [00:11<00:04,  6.45it/s, loss=2.3, v_num=0]
Epoch 61:  73%|███████▎  | 71/97 [00:11<00:04,  6.42it/s, loss=2.3, v_num=0]
Epoch 61:  74%|███████▍  | 72/97 [00:11<00:03,  6.46it/s, loss=2.3, v_num=0]
Epoch 61:  74%|███████▍  | 72/97 [00:11<00:03,  6.43it/s, loss=2.29, v_num=0]
Epoch 61:  75%|███████▌  | 73/97 [00:11<00:03,  6.47it/s, loss=2.29, v_num=0]
Epoch 61:  75%|███████▌  | 73/97 [00:11<00:03,  6.44it/s, loss=2.3, v_num=0]
Epoch 61:  76%|███████▋  | 74/97 [00:11<00:03,  6.48it/s, loss=2.3, v_num=0]
Epoch 61:  76%|███████▋  | 74/97 [00:11<00:03,  6.45it/s, loss=2.3, v_num=0]
Epoch 61:  77%|███████▋  | 75/97 [00:11<00:03,  6.49it/s, loss=2.3, v_num=0]
Epoch 61:  77%|███████▋  | 75/97 [00:11<00:03,  6.46it/s, loss=2.3, v_num=0]
Epoch 61:  78%|███████▊  | 76/97 [00:11<00:03,  6.49it/s, loss=2.3, v_num=0]
Epoch 61:  78%|███████▊  | 76/97 [00:11<00:03,  6.46it/s, loss=2.3, v_num=0]
Epoch 61:  79%|███████▉  | 77/97 [00:11<00:03,  6.50it/s, loss=2.3, v_num=0]
Epoch 61:  79%|███████▉  | 77/97 [00:11<00:03,  6.47it/s, loss=2.3, v_num=0]
Epoch 61:  80%|████████  | 78/97 [00:11<00:02,  6.51it/s, loss=2.3, v_num=0]
Epoch 61:  80%|████████  | 78/97 [00:12<00:02,  6.48it/s, loss=2.3, v_num=0]
Epoch 61:  81%|████████▏ | 79/97 [00:12<00:02,  6.52it/s, loss=2.3, v_num=0]
Epoch 61:  81%|████████▏ | 79/97 [00:12<00:02,  6.49it/s, loss=2.31, v_num=0]
Epoch 61:  82%|████████▏ | 80/97 [00:12<00:02,  6.53it/s, loss=2.31, v_num=0]
Epoch 61:  82%|████████▏ | 80/97 [00:12<00:02,  6.50it/s, loss=2.31, v_num=0]
Epoch 61:  84%|████████▎ | 81/97 [00:12<00:02,  6.54it/s, loss=2.31, v_num=0]
Epoch 61:  84%|████████▎ | 81/97 [00:12<00:02,  6.51it/s, loss=2.31, v_num=0]
Epoch 61:  85%|████████▍ | 82/97 [00:12<00:02,  6.54it/s, loss=2.31, v_num=0]
Epoch 61:  85%|████████▍ | 82/97 [00:12<00:02,  6.51it/s, loss=2.32, v_num=0]
Epoch 61:  86%|████████▌ | 83/97 [00:12<00:02,  6.55it/s, loss=2.32, v_num=0]
Epoch 61:  86%|████████▌ | 83/97 [00:12<00:02,  6.52it/s, loss=2.32, v_num=0]
Epoch 61:  87%|████████▋ | 84/97 [00:12<00:01,  6.56it/s, loss=2.32, v_num=0]
Epoch 61:  87%|████████▋ | 84/97 [00:12<00:01,  6.53it/s, loss=2.31, v_num=0]
Epoch 61:  88%|████████▊ | 85/97 [00:12<00:01,  6.57it/s, loss=2.31, v_num=0]
Epoch 61:  88%|████████▊ | 85/97 [00:12<00:01,  6.54it/s, loss=2.31, v_num=0]
Epoch 61:  89%|████████▊ | 86/97 [00:13<00:01,  6.57it/s, loss=2.31, v_num=0]
Epoch 61:  89%|████████▊ | 86/97 [00:13<00:01,  6.55it/s, loss=2.31, v_num=0]
Epoch 61:  90%|████████▉ | 87/97 [00:13<00:01,  6.58it/s, loss=2.31, v_num=0]
Epoch 61:  90%|████████▉ | 87/97 [00:13<00:01,  6.55it/s, loss=2.31, v_num=0]
Epoch 61:  91%|█████████ | 88/97 [00:13<00:01,  6.59it/s, loss=2.31, v_num=0]
Epoch 61:  91%|█████████ | 88/97 [00:13<00:01,  6.56it/s, loss=2.31, v_num=0]
Epoch 61:  92%|█████████▏| 89/97 [00:13<00:01,  6.60it/s, loss=2.31, v_num=0]
Epoch 61:  92%|█████████▏| 89/97 [00:13<00:01,  6.57it/s, loss=2.3, v_num=0]
Epoch 61:  93%|█████████▎| 90/97 [00:13<00:01,  6.60it/s, loss=2.3, v_num=0]
Epoch 61:  93%|█████████▎| 90/97 [00:13<00:01,  6.58it/s, loss=2.29, v_num=0]
Epoch 61:  94%|█████████▍| 91/97 [00:13<00:00,  6.61it/s, loss=2.29, v_num=0]
Epoch 61:  94%|█████████▍| 91/97 [00:13<00:00,  6.58it/s, loss=2.3, v_num=0]
Epoch 61:  95%|█████████▍| 92/97 [00:13<00:00,  6.61it/s, loss=2.3, v_num=0]
Epoch 61:  95%|█████████▍| 92/97 [00:13<00:00,  6.59it/s, loss=2.3, v_num=0]
Epoch 61:  96%|█████████▌| 93/97 [00:14<00:00,  6.62it/s, loss=2.3, v_num=0]
Epoch 61:  96%|█████████▌| 93/97 [00:14<00:00,  6.59it/s, loss=2.3, v_num=0]
Epoch 61:  97%|█████████▋| 94/97 [00:14<00:00,  6.63it/s, loss=2.3, v_num=0]
Epoch 61:  97%|█████████▋| 94/97 [00:14<00:00,  6.60it/s, loss=2.3, v_num=0]
Epoch 61:  98%|█████████▊| 95/97 [00:14<00:00,  6.63it/s, loss=2.3, v_num=0]
Epoch 61:  98%|█████████▊| 95/97 [00:14<00:00,  6.61it/s, loss=2.3, v_num=0]
Epoch 61:  99%|█████████▉| 96/97 [00:14<00:00,  6.64it/s, loss=2.3, v_num=0]
Epoch 61:  99%|█████████▉| 96/97 [00:14<00:00,  6.61it/s, loss=2.3, v_num=0]
Epoch 61: 100%|██████████| 97/97 [00:14<00:00,  6.65it/s, loss=2.3, v_num=0]
Epoch 61: 100%|██████████| 97/97 [00:14<00:00,  6.62it/s, loss=2.3, v_num=0]
Epoch 61: 100%|██████████| 97/97 [00:14<00:00,  6.62it/s, loss=2.3, v_num=0]
Epoch 61:   0%|          | 0/97 [00:00<?, ?it/s, loss=2.3, v_num=0]
Epoch 62:   0%|          | 0/97 [00:00<?, ?it/s, loss=2.3, v_num=0]
Epoch 62:   1%|          | 1/97 [00:01<02:14,  1.40s/it, loss=2.3, v_num=0]
Epoch 62:   1%|          | 1/97 [00:01<02:19,  1.45s/it, loss=2.3, v_num=0]
Epoch 62:   2%|▏         | 2/97 [00:01<01:12,  1.30it/s, loss=2.3, v_num=0]
Epoch 62:   2%|▏         | 2/97 [00:01<01:15,  1.26it/s, loss=2.29, v_num=0]
Epoch 62:   3%|▎         | 3/97 [00:01<00:52,  1.79it/s, loss=2.29, v_num=0]
Epoch 62:   3%|▎         | 3/97 [00:01<00:54,  1.73it/s, loss=2.29, v_num=0]
Epoch 62:   4%|▍         | 4/97 [00:01<00:42,  2.21it/s, loss=2.29, v_num=0]
Epoch 62:   4%|▍         | 4/97 [00:01<00:43,  2.14it/s, loss=2.29, v_num=0]
Epoch 62:   5%|▌         | 5/97 [00:01<00:35,  2.57it/s, loss=2.29, v_num=0]
Epoch 62:   5%|▌         | 5/97 [00:02<00:36,  2.50it/s, loss=2.29, v_num=0]
Epoch 62:   6%|▌         | 6/97 [00:02<00:31,  2.88it/s, loss=2.29, v_num=0]
Epoch 62:   6%|▌         | 6/97 [00:02<00:32,  2.81it/s, loss=2.3, v_num=0]
Epoch 62:   7%|▋         | 7/97 [00:02<00:28,  3.15it/s, loss=2.3, v_num=0]
Epoch 62:   7%|▋         | 7/97 [00:02<00:29,  3.08it/s, loss=2.3, v_num=0]
Epoch 62:   8%|▊         | 8/97 [00:02<00:26,  3.40it/s, loss=2.3, v_num=0]
Epoch 62:   8%|▊         | 8/97 [00:02<00:26,  3.32it/s, loss=2.3, v_num=0]
Epoch 62:   9%|▉         | 9/97 [00:02<00:24,  3.62it/s, loss=2.3, v_num=0]
Epoch 62:   9%|▉         | 9/97 [00:02<00:24,  3.53it/s, loss=2.3, v_num=0]
Epoch 62:  10%|█         | 10/97 [00:02<00:22,  3.80it/s, loss=2.3, v_num=0]
Epoch 62:  10%|█         | 10/97 [00:02<00:23,  3.72it/s, loss=2.3, v_num=0]
Epoch 62:  11%|█▏        | 11/97 [00:02<00:21,  3.97it/s, loss=2.3, v_num=0]
Epoch 62:  11%|█▏        | 11/97 [00:02<00:22,  3.89it/s, loss=2.3, v_num=0]
Epoch 62:  12%|█▏        | 12/97 [00:02<00:20,  4.13it/s, loss=2.3, v_num=0]
Epoch 62:  12%|█▏        | 12/97 [00:02<00:20,  4.05it/s, loss=2.3, v_num=0]
Epoch 62:  13%|█▎        | 13/97 [00:03<00:19,  4.28it/s, loss=2.3, v_num=0]
Epoch 62:  13%|█▎        | 13/97 [00:03<00:20,  4.20it/s, loss=2.3, v_num=0]
Epoch 62:  14%|█▍        | 14/97 [00:03<00:18,  4.41it/s, loss=2.3, v_num=0]
Epoch 62:  14%|█▍        | 14/97 [00:03<00:19,  4.33it/s, loss=2.29, v_num=0]
Epoch 62:  15%|█▌        | 15/97 [00:03<00:18,  4.53it/s, loss=2.29, v_num=0]
Epoch 62:  15%|█▌        | 15/97 [00:03<00:18,  4.45it/s, loss=2.29, v_num=0]
Epoch 62:  16%|█▋        | 16/97 [00:03<00:17,  4.64it/s, loss=2.29, v_num=0]
Epoch 62:  16%|█▋        | 16/97 [00:03<00:17,  4.57it/s, loss=2.29, v_num=0]
Epoch 62:  18%|█▊        | 17/97 [00:03<00:16,  4.74it/s, loss=2.29, v_num=0]
Epoch 62:  18%|█▊        | 17/97 [00:03<00:17,  4.67it/s, loss=2.29, v_num=0]
Epoch 62:  19%|█▊        | 18/97 [00:03<00:16,  4.84it/s, loss=2.29, v_num=0]
Epoch 62:  19%|█▊        | 18/97 [00:03<00:16,  4.76it/s, loss=2.3, v_num=0]
Epoch 62:  20%|█▉        | 19/97 [00:03<00:15,  4.93it/s, loss=2.3, v_num=0]
Epoch 62:  20%|█▉        | 19/97 [00:03<00:16,  4.85it/s, loss=2.3, v_num=0]
Epoch 62:  21%|██        | 20/97 [00:03<00:15,  5.00it/s, loss=2.3, v_num=0]
Epoch 62:  21%|██        | 20/97 [00:04<00:15,  4.94it/s, loss=2.29, v_num=0]
Epoch 62:  22%|██▏       | 21/97 [00:04<00:14,  5.08it/s, loss=2.29, v_num=0]
Epoch 62:  22%|██▏       | 21/97 [00:04<00:15,  5.02it/s, loss=2.29, v_num=0]
Epoch 62:  23%|██▎       | 22/97 [00:04<00:14,  5.15it/s, loss=2.29, v_num=0]
Epoch 62:  23%|██▎       | 22/97 [00:04<00:14,  5.09it/s, loss=2.29, v_num=0]
Epoch 62:  24%|██▎       | 23/97 [00:04<00:14,  5.23it/s, loss=2.29, v_num=0]
Epoch 62:  24%|██▎       | 23/97 [00:04<00:14,  5.16it/s, loss=2.29, v_num=0]
Epoch 62:  25%|██▍       | 24/97 [00:04<00:13,  5.28it/s, loss=2.29, v_num=0]
Epoch 62:  25%|██▍       | 24/97 [00:04<00:13,  5.22it/s, loss=2.29, v_num=0]
Epoch 62:  26%|██▌       | 25/97 [00:04<00:13,  5.34it/s, loss=2.29, v_num=0]
Epoch 62:  26%|██▌       | 25/97 [00:04<00:13,  5.28it/s, loss=2.29, v_num=0]
Epoch 62:  27%|██▋       | 26/97 [00:04<00:13,  5.40it/s, loss=2.29, v_num=0]
Epoch 62:  27%|██▋       | 26/97 [00:04<00:13,  5.34it/s, loss=2.29, v_num=0]
Epoch 62:  28%|██▊       | 27/97 [00:04<00:12,  5.45it/s, loss=2.29, v_num=0]
Epoch 62:  28%|██▊       | 27/97 [00:05<00:12,  5.39it/s, loss=2.28, v_num=0]
Epoch 62:  29%|██▉       | 28/97 [00:05<00:12,  5.51it/s, loss=2.28, v_num=0]
Epoch 62:  29%|██▉       | 28/97 [00:05<00:12,  5.44it/s, loss=2.28, v_num=0]
Epoch 62:  30%|██▉       | 29/97 [00:05<00:12,  5.55it/s, loss=2.28, v_num=0]
Epoch 62:  30%|██▉       | 29/97 [00:05<00:12,  5.49it/s, loss=2.28, v_num=0]
Epoch 62:  31%|███       | 30/97 [00:05<00:11,  5.60it/s, loss=2.28, v_num=0]
Epoch 62:  31%|███       | 30/97 [00:05<00:12,  5.54it/s, loss=2.28, v_num=0]
Epoch 62:  32%|███▏      | 31/97 [00:05<00:11,  5.64it/s, loss=2.28, v_num=0]
Epoch 62:  32%|███▏      | 31/97 [00:05<00:11,  5.58it/s, loss=2.29, v_num=0]
Epoch 62:  33%|███▎      | 32/97 [00:05<00:11,  5.67it/s, loss=2.29, v_num=0]
Epoch 62:  33%|███▎      | 32/97 [00:05<00:11,  5.62it/s, loss=2.28, v_num=0]
Epoch 62:  34%|███▍      | 33/97 [00:05<00:11,  5.71it/s, loss=2.28, v_num=0]
Epoch 62:  34%|███▍      | 33/97 [00:05<00:11,  5.66it/s, loss=2.28, v_num=0]
Epoch 62:  35%|███▌      | 34/97 [00:05<00:10,  5.75it/s, loss=2.28, v_num=0]
Epoch 62:  35%|███▌      | 34/97 [00:05<00:11,  5.70it/s, loss=2.28, v_num=0]
Epoch 62:  36%|███▌      | 35/97 [00:06<00:10,  5.78it/s, loss=2.28, v_num=0]
Epoch 62:  36%|███▌      | 35/97 [00:06<00:10,  5.73it/s, loss=2.28, v_num=0]
Epoch 62:  37%|███▋      | 36/97 [00:06<00:10,  5.82it/s, loss=2.28, v_num=0]
Epoch 62:  37%|███▋      | 36/97 [00:06<00:10,  5.77it/s, loss=2.28, v_num=0]
Epoch 62:  38%|███▊      | 37/97 [00:06<00:10,  5.85it/s, loss=2.28, v_num=0]
Epoch 62:  38%|███▊      | 37/97 [00:06<00:10,  5.80it/s, loss=2.28, v_num=0]
Epoch 62:  39%|███▉      | 38/97 [00:06<00:10,  5.88it/s, loss=2.28, v_num=0]
Epoch 62:  39%|███▉      | 38/97 [00:06<00:10,  5.83it/s, loss=2.28, v_num=0]
Epoch 62:  40%|████      | 39/97 [00:06<00:09,  5.91it/s, loss=2.28, v_num=0]
Epoch 62:  40%|████      | 39/97 [00:06<00:09,  5.86it/s, loss=2.28, v_num=0]
Epoch 62:  41%|████      | 40/97 [00:06<00:09,  5.94it/s, loss=2.28, v_num=0]
Epoch 62:  41%|████      | 40/97 [00:06<00:09,  5.89it/s, loss=2.29, v_num=0]
Epoch 62:  42%|████▏     | 41/97 [00:06<00:09,  5.97it/s, loss=2.29, v_num=0]
Epoch 62:  42%|████▏     | 41/97 [00:06<00:09,  5.92it/s, loss=2.29, v_num=0]
Epoch 62:  43%|████▎     | 42/97 [00:07<00:09,  5.99it/s, loss=2.29, v_num=0]
Epoch 62:  43%|████▎     | 42/97 [00:07<00:09,  5.94it/s, loss=2.29, v_num=0]
Epoch 62:  44%|████▍     | 43/97 [00:07<00:08,  6.02it/s, loss=2.29, v_num=0]
Epoch 62:  44%|████▍     | 43/97 [00:07<00:09,  5.97it/s, loss=2.29, v_num=0]
Epoch 62:  45%|████▌     | 44/97 [00:07<00:08,  6.04it/s, loss=2.29, v_num=0]
Epoch 62:  45%|████▌     | 44/97 [00:07<00:08,  6.00it/s, loss=2.28, v_num=0]
Epoch 62:  46%|████▋     | 45/97 [00:07<00:08,  6.06it/s, loss=2.28, v_num=0]
Epoch 62:  46%|████▋     | 45/97 [00:07<00:08,  6.02it/s, loss=2.27, v_num=0]
Epoch 62:  47%|████▋     | 46/97 [00:07<00:08,  6.08it/s, loss=2.27, v_num=0]
Epoch 62:  47%|████▋     | 46/97 [00:07<00:08,  6.04it/s, loss=2.27, v_num=0]
Epoch 62:  48%|████▊     | 47/97 [00:07<00:08,  6.11it/s, loss=2.27, v_num=0]
Epoch 62:  48%|████▊     | 47/97 [00:07<00:08,  6.06it/s, loss=2.28, v_num=0]
Epoch 62:  49%|████▉     | 48/97 [00:07<00:08,  6.12it/s, loss=2.28, v_num=0]
Epoch 62:  49%|████▉     | 48/97 [00:07<00:08,  6.08it/s, loss=2.29, v_num=0]
Epoch 62:  51%|█████     | 49/97 [00:07<00:07,  6.15it/s, loss=2.29, v_num=0]
Epoch 62:  51%|█████     | 49/97 [00:08<00:07,  6.10it/s, loss=2.28, v_num=0]
Epoch 62:  52%|█████▏    | 50/97 [00:08<00:07,  6.16it/s, loss=2.28, v_num=0]
Epoch 62:  52%|█████▏    | 50/97 [00:08<00:07,  6.12it/s, loss=2.28, v_num=0]
Epoch 62:  53%|█████▎    | 51/97 [00:08<00:07,  6.18it/s, loss=2.28, v_num=0]
Epoch 62:  53%|█████▎    | 51/97 [00:08<00:07,  6.14it/s, loss=2.28, v_num=0]
Epoch 62:  54%|█████▎    | 52/97 [00:08<00:07,  6.20it/s, loss=2.28, v_num=0]
Epoch 62:  54%|█████▎    | 52/97 [00:08<00:07,  6.16it/s, loss=2.28, v_num=0]
Epoch 62:  55%|█████▍    | 53/97 [00:08<00:07,  6.22it/s, loss=2.28, v_num=0]
Epoch 62:  55%|█████▍    | 53/97 [00:08<00:07,  6.18it/s, loss=2.29, v_num=0]
Epoch 62:  56%|█████▌    | 54/97 [00:08<00:06,  6.23it/s, loss=2.29, v_num=0]
Epoch 62:  56%|█████▌    | 54/97 [00:08<00:06,  6.19it/s, loss=2.29, v_num=0]
Epoch 62:  57%|█████▋    | 55/97 [00:08<00:06,  6.25it/s, loss=2.29, v_num=0]
Epoch 62:  57%|█████▋    | 55/97 [00:08<00:06,  6.21it/s, loss=2.28, v_num=0]
Epoch 62:  58%|█████▊    | 56/97 [00:08<00:06,  6.27it/s, loss=2.28, v_num=0]
Epoch 62:  58%|█████▊    | 56/97 [00:08<00:06,  6.23it/s, loss=2.28, v_num=0]
Epoch 62:  59%|█████▉    | 57/97 [00:09<00:06,  6.28it/s, loss=2.28, v_num=0]
Epoch 62:  59%|█████▉    | 57/97 [00:09<00:06,  6.24it/s, loss=2.29, v_num=0]
Epoch 62:  60%|█████▉    | 58/97 [00:09<00:06,  6.30it/s, loss=2.29, v_num=0]
Epoch 62:  60%|█████▉    | 58/97 [00:09<00:06,  6.26it/s, loss=2.29, v_num=0]
Epoch 62:  61%|██████    | 59/97 [00:09<00:06,  6.31it/s, loss=2.29, v_num=0]
Epoch 62:  61%|██████    | 59/97 [00:09<00:06,  6.27it/s, loss=2.28, v_num=0]
Epoch 62:  62%|██████▏   | 60/97 [00:09<00:05,  6.32it/s, loss=2.28, v_num=0]
Epoch 62:  62%|██████▏   | 60/97 [00:09<00:05,  6.29it/s, loss=2.28, v_num=0]
Epoch 62:  63%|██████▎   | 61/97 [00:09<00:05,  6.34it/s, loss=2.28, v_num=0]
Epoch 62:  63%|██████▎   | 61/97 [00:09<00:05,  6.30it/s, loss=2.27, v_num=0]
Epoch 62:  64%|██████▍   | 62/97 [00:09<00:05,  6.35it/s, loss=2.27, v_num=0]
Epoch 62:  64%|██████▍   | 62/97 [00:09<00:05,  6.31it/s, loss=2.27, v_num=0]
Epoch 62:  65%|██████▍   | 63/97 [00:09<00:05,  6.36it/s, loss=2.27, v_num=0]
Epoch 62:  65%|██████▍   | 63/97 [00:09<00:05,  6.33it/s, loss=2.27, v_num=0]
Epoch 62:  66%|██████▌   | 64/97 [00:10<00:05,  6.37it/s, loss=2.27, v_num=0]
Epoch 62:  66%|██████▌   | 64/97 [00:10<00:05,  6.34it/s, loss=2.27, v_num=0]
Epoch 62:  67%|██████▋   | 65/97 [00:10<00:05,  6.39it/s, loss=2.27, v_num=0]
Epoch 62:  67%|██████▋   | 65/97 [00:10<00:05,  6.35it/s, loss=2.27, v_num=0]
Epoch 62:  68%|██████▊   | 66/97 [00:10<00:04,  6.40it/s, loss=2.27, v_num=0]
Epoch 62:  68%|██████▊   | 66/97 [00:10<00:04,  6.36it/s, loss=2.26, v_num=0]
Epoch 62:  69%|██████▉   | 67/97 [00:10<00:04,  6.41it/s, loss=2.26, v_num=0]
Epoch 62:  69%|██████▉   | 67/97 [00:10<00:04,  6.38it/s, loss=2.26, v_num=0]
Epoch 62:  70%|███████   | 68/97 [00:10<00:04,  6.42it/s, loss=2.26, v_num=0]
Epoch 62:  70%|███████   | 68/97 [00:10<00:04,  6.39it/s, loss=2.26, v_num=0]
Epoch 62:  71%|███████   | 69/97 [00:10<00:04,  6.43it/s, loss=2.26, v_num=0]
Epoch 62:  71%|███████   | 69/97 [00:10<00:04,  6.40it/s, loss=2.27, v_num=0]
Epoch 62:  72%|███████▏  | 70/97 [00:10<00:04,  6.44it/s, loss=2.27, v_num=0]
Epoch 62:  72%|███████▏  | 70/97 [00:10<00:04,  6.41it/s, loss=2.27, v_num=0]
Epoch 62:  73%|███████▎  | 71/97 [00:10<00:04,  6.46it/s, loss=2.27, v_num=0]
Epoch 62:  73%|███████▎  | 71/97 [00:11<00:04,  6.42it/s, loss=2.27, v_num=0]
Epoch 62:  74%|███████▍  | 72/97 [00:11<00:03,  6.47it/s, loss=2.27, v_num=0]
Epoch 62:  74%|███████▍  | 72/97 [00:11<00:03,  6.43it/s, loss=2.27, v_num=0]
Epoch 62:  75%|███████▌  | 73/97 [00:11<00:03,  6.48it/s, loss=2.27, v_num=0]
Epoch 62:  75%|███████▌  | 73/97 [00:11<00:03,  6.44it/s, loss=2.25, v_num=0]
Epoch 62:  76%|███████▋  | 74/97 [00:11<00:03,  6.49it/s, loss=2.25, v_num=0]
Epoch 62:  76%|███████▋  | 74/97 [00:11<00:03,  6.46it/s, loss=2.26, v_num=0]
Epoch 62:  77%|███████▋  | 75/97 [00:11<00:03,  6.50it/s, loss=2.26, v_num=0]
Epoch 62:  77%|███████▋  | 75/97 [00:11<00:03,  6.46it/s, loss=2.26, v_num=0]
Epoch 62:  78%|███████▊  | 76/97 [00:11<00:03,  6.50it/s, loss=2.26, v_num=0]
Epoch 62:  78%|███████▊  | 76/97 [00:11<00:03,  6.47it/s, loss=2.25, v_num=0]
Epoch 62:  79%|███████▉  | 77/97 [00:11<00:03,  6.52it/s, loss=2.25, v_num=0]
Epoch 62:  79%|███████▉  | 77/97 [00:11<00:03,  6.48it/s, loss=2.24, v_num=0]
Epoch 62:  80%|████████  | 78/97 [00:11<00:02,  6.52it/s, loss=2.24, v_num=0]
Epoch 62:  80%|████████  | 78/97 [00:12<00:02,  6.49it/s, loss=2.24, v_num=0]
Epoch 62:  81%|████████▏ | 79/97 [00:12<00:02,  6.53it/s, loss=2.24, v_num=0]
Epoch 62:  81%|████████▏ | 79/97 [00:12<00:02,  6.50it/s, loss=2.25, v_num=0]
Epoch 62:  82%|████████▏ | 80/97 [00:12<00:02,  6.54it/s, loss=2.25, v_num=0]
Epoch 62:  82%|████████▏ | 80/97 [00:12<00:02,  6.51it/s, loss=2.25, v_num=0]
Epoch 62:  84%|████████▎ | 81/97 [00:12<00:02,  6.55it/s, loss=2.25, v_num=0]
Epoch 62:  84%|████████▎ | 81/97 [00:12<00:02,  6.52it/s, loss=2.25, v_num=0]
Epoch 62:  85%|████████▍ | 82/97 [00:12<00:02,  6.56it/s, loss=2.25, v_num=0]
Epoch 62:  85%|████████▍ | 82/97 [00:12<00:02,  6.53it/s, loss=2.25, v_num=0]
Epoch 62:  86%|████████▌ | 83/97 [00:12<00:02,  6.56it/s, loss=2.25, v_num=0]
Epoch 62:  86%|████████▌ | 83/97 [00:12<00:02,  6.54it/s, loss=2.25, v_num=0]
Epoch 62:  87%|████████▋ | 84/97 [00:12<00:01,  6.57it/s, loss=2.25, v_num=0]
Epoch 62:  87%|████████▋ | 84/97 [00:12<00:01,  6.54it/s, loss=2.25, v_num=0]
Epoch 62:  88%|████████▊ | 85/97 [00:12<00:01,  6.58it/s, loss=2.25, v_num=0]
Epoch 62:  88%|████████▊ | 85/97 [00:12<00:01,  6.55it/s, loss=2.26, v_num=0]
Epoch 62:  89%|████████▊ | 86/97 [00:13<00:01,  6.59it/s, loss=2.26, v_num=0]
Epoch 62:  89%|████████▊ | 86/97 [00:13<00:01,  6.56it/s, loss=2.26, v_num=0]
Epoch 62:  90%|████████▉ | 87/97 [00:13<00:01,  6.59it/s, loss=2.26, v_num=0]
Epoch 62:  90%|████████▉ | 87/97 [00:13<00:01,  6.57it/s, loss=2.26, v_num=0]
Epoch 62:  91%|█████████ | 88/97 [00:13<00:01,  6.60it/s, loss=2.26, v_num=0]
Epoch 62:  91%|█████████ | 88/97 [00:13<00:01,  6.58it/s, loss=2.26, v_num=0]
Epoch 62:  92%|█████████▏| 89/97 [00:13<00:01,  6.61it/s, loss=2.26, v_num=0]
Epoch 62:  92%|█████████▏| 89/97 [00:13<00:01,  6.58it/s, loss=2.25, v_num=0]
Epoch 62:  93%|█████████▎| 90/97 [00:13<00:01,  6.62it/s, loss=2.25, v_num=0]
Epoch 62:  93%|█████████▎| 90/97 [00:13<00:01,  6.59it/s, loss=2.25, v_num=0]
Epoch 62:  94%|█████████▍| 91/97 [00:13<00:00,  6.62it/s, loss=2.25, v_num=0]
Epoch 62:  94%|█████████▍| 91/97 [00:13<00:00,  6.60it/s, loss=2.25, v_num=0]
Epoch 62:  95%|█████████▍| 92/97 [00:13<00:00,  6.63it/s, loss=2.25, v_num=0]
Epoch 62:  95%|█████████▍| 92/97 [00:13<00:00,  6.60it/s, loss=2.25, v_num=0]
Epoch 62:  96%|█████████▌| 93/97 [00:14<00:00,  6.64it/s, loss=2.25, v_num=0]
Epoch 62:  96%|█████████▌| 93/97 [00:14<00:00,  6.61it/s, loss=2.26, v_num=0]
Epoch 62:  97%|█████████▋| 94/97 [00:14<00:00,  6.64it/s, loss=2.26, v_num=0]
Epoch 62:  97%|█████████▋| 94/97 [00:14<00:00,  6.62it/s, loss=2.27, v_num=0]
Epoch 62:  98%|█████████▊| 95/97 [00:14<00:00,  6.65it/s, loss=2.27, v_num=0]
Epoch 62:  98%|█████████▊| 95/97 [00:14<00:00,  6.62it/s, loss=2.27, v_num=0]
Epoch 62:  99%|█████████▉| 96/97 [00:14<00:00,  6.65it/s, loss=2.27, v_num=0]
Epoch 62:  99%|█████████▉| 96/97 [00:14<00:00,  6.63it/s, loss=2.28, v_num=0]
Epoch 62: 100%|██████████| 97/97 [00:14<00:00,  6.66it/s, loss=2.28, v_num=0]
Epoch 62: 100%|██████████| 97/97 [00:14<00:00,  6.64it/s, loss=2.28, v_num=0]
Epoch 62: 100%|██████████| 97/97 [00:14<00:00,  6.64it/s, loss=2.28, v_num=0]
Epoch 62:   0%|          | 0/97 [00:00<?, ?it/s, loss=2.28, v_num=0]
Epoch 63:   0%|          | 0/97 [00:00<?, ?it/s, loss=2.28, v_num=0]
Epoch 63:   1%|          | 1/97 [00:01<02:13,  1.39s/it, loss=2.28, v_num=0]
Epoch 63:   1%|          | 1/97 [00:01<02:18,  1.44s/it, loss=2.28, v_num=0]
Epoch 63:   2%|▏         | 2/97 [00:01<01:12,  1.31it/s, loss=2.28, v_num=0]
Epoch 63:   2%|▏         | 2/97 [00:01<01:15,  1.26it/s, loss=2.29, v_num=0]
Epoch 63:   3%|▎         | 3/97 [00:01<00:52,  1.80it/s, loss=2.29, v_num=0]
Epoch 63:   3%|▎         | 3/97 [00:01<00:53,  1.74it/s, loss=2.28, v_num=0]
Epoch 63:   4%|▍         | 4/97 [00:01<00:41,  2.22it/s, loss=2.28, v_num=0]
Epoch 63:   4%|▍         | 4/97 [00:01<00:43,  2.15it/s, loss=2.28, v_num=0]
Epoch 63:   5%|▌         | 5/97 [00:01<00:35,  2.57it/s, loss=2.28, v_num=0]
Epoch 63:   5%|▌         | 5/97 [00:01<00:36,  2.50it/s, loss=2.28, v_num=0]
Epoch 63:   6%|▌         | 6/97 [00:02<00:31,  2.89it/s, loss=2.28, v_num=0]
Epoch 63:   6%|▌         | 6/97 [00:02<00:32,  2.81it/s, loss=2.27, v_num=0]
Epoch 63:   7%|▋         | 7/97 [00:02<00:28,  3.17it/s, loss=2.27, v_num=0]
Epoch 63:   7%|▋         | 7/97 [00:02<00:29,  3.08it/s, loss=2.28, v_num=0]
Epoch 63:   8%|▊         | 8/97 [00:02<00:26,  3.40it/s, loss=2.28, v_num=0]
Epoch 63:   8%|▊         | 8/97 [00:02<00:26,  3.33it/s, loss=2.28, v_num=0]
Epoch 63:   9%|▉         | 9/97 [00:02<00:24,  3.62it/s, loss=2.28, v_num=0]
Epoch 63:   9%|▉         | 9/97 [00:02<00:24,  3.54it/s, loss=2.28, v_num=0]
Epoch 63:  10%|█         | 10/97 [00:02<00:22,  3.80it/s, loss=2.28, v_num=0]
Epoch 63:  10%|█         | 10/97 [00:02<00:23,  3.73it/s, loss=2.28, v_num=0]
Epoch 63:  11%|█▏        | 11/97 [00:02<00:21,  3.98it/s, loss=2.28, v_num=0]
Epoch 63:  11%|█▏        | 11/97 [00:02<00:22,  3.90it/s, loss=2.28, v_num=0]
Epoch 63:  12%|█▏        | 12/97 [00:02<00:20,  4.14it/s, loss=2.28, v_num=0]
Epoch 63:  12%|█▏        | 12/97 [00:02<00:20,  4.06it/s, loss=2.28, v_num=0]
Epoch 63:  13%|█▎        | 13/97 [00:03<00:19,  4.28it/s, loss=2.28, v_num=0]
Epoch 63:  13%|█▎        | 13/97 [00:03<00:19,  4.20it/s, loss=2.28, v_num=0]
Epoch 63:  14%|█▍        | 14/97 [00:03<00:18,  4.41it/s, loss=2.28, v_num=0]
Epoch 63:  14%|█▍        | 14/97 [00:03<00:19,  4.33it/s, loss=2.28, v_num=0]
Epoch 63:  15%|█▌        | 15/97 [00:03<00:18,  4.53it/s, loss=2.28, v_num=0]
Epoch 63:  15%|█▌        | 15/97 [00:03<00:18,  4.46it/s, loss=2.28, v_num=0]
Epoch 63:  16%|█▋        | 16/97 [00:03<00:17,  4.64it/s, loss=2.28, v_num=0]
Epoch 63:  16%|█▋        | 16/97 [00:03<00:17,  4.57it/s, loss=2.28, v_num=0]
Epoch 63:  18%|█▊        | 17/97 [00:03<00:16,  4.75it/s, loss=2.28, v_num=0]
Epoch 63:  18%|█▊        | 17/97 [00:03<00:17,  4.67it/s, loss=2.27, v_num=0]
Epoch 63:  19%|█▊        | 18/97 [00:03<00:16,  4.84it/s, loss=2.27, v_num=0]
Epoch 63:  19%|█▊        | 18/97 [00:03<00:16,  4.77it/s, loss=2.27, v_num=0]
Epoch 63:  20%|█▉        | 19/97 [00:03<00:15,  4.92it/s, loss=2.27, v_num=0]
Epoch 63:  20%|█▉        | 19/97 [00:03<00:16,  4.86it/s, loss=2.26, v_num=0]
Epoch 63:  21%|██        | 20/97 [00:03<00:15,  5.01it/s, loss=2.26, v_num=0]
Epoch 63:  21%|██        | 20/97 [00:04<00:15,  4.94it/s, loss=2.26, v_num=0]
Epoch 63:  22%|██▏       | 21/97 [00:04<00:14,  5.09it/s, loss=2.26, v_num=0]
Epoch 63:  22%|██▏       | 21/97 [00:04<00:15,  5.02it/s, loss=2.26, v_num=0]
Epoch 63:  23%|██▎       | 22/97 [00:04<00:14,  5.16it/s, loss=2.26, v_num=0]
Epoch 63:  23%|██▎       | 22/97 [00:04<00:14,  5.09it/s, loss=2.25, v_num=0]
Epoch 63:  24%|██▎       | 23/97 [00:04<00:14,  5.23it/s, loss=2.25, v_num=0]
Epoch 63:  24%|██▎       | 23/97 [00:04<00:14,  5.16it/s, loss=2.26, v_num=0]
Epoch 63:  25%|██▍       | 24/97 [00:04<00:13,  5.29it/s, loss=2.26, v_num=0]
Epoch 63:  25%|██▍       | 24/97 [00:04<00:13,  5.22it/s, loss=2.25, v_num=0]
Epoch 63:  26%|██▌       | 25/97 [00:04<00:13,  5.35it/s, loss=2.25, v_num=0]
Epoch 63:  26%|██▌       | 25/97 [00:04<00:13,  5.28it/s, loss=2.26, v_num=0]
Epoch 63:  27%|██▋       | 26/97 [00:04<00:13,  5.40it/s, loss=2.26, v_num=0]
Epoch 63:  27%|██▋       | 26/97 [00:04<00:13,  5.34it/s, loss=2.27, v_num=0]
Epoch 63:  28%|██▊       | 27/97 [00:04<00:12,  5.45it/s, loss=2.27, v_num=0]
Epoch 63:  28%|██▊       | 27/97 [00:05<00:12,  5.39it/s, loss=2.26, v_num=0]
Epoch 63:  29%|██▉       | 28/97 [00:05<00:12,  5.50it/s, loss=2.26, v_num=0]
Epoch 63:  29%|██▉       | 28/97 [00:05<00:12,  5.44it/s, loss=2.26, v_num=0]
Epoch 63:  30%|██▉       | 29/97 [00:05<00:12,  5.55it/s, loss=2.26, v_num=0]
Epoch 63:  30%|██▉       | 29/97 [00:05<00:12,  5.49it/s, loss=2.26, v_num=0]
Epoch 63:  31%|███       | 30/97 [00:05<00:11,  5.60it/s, loss=2.26, v_num=0]
Epoch 63:  31%|███       | 30/97 [00:05<00:12,  5.54it/s, loss=2.26, v_num=0]
Epoch 63:  32%|███▏      | 31/97 [00:05<00:11,  5.64it/s, loss=2.26, v_num=0]
Epoch 63:  32%|███▏      | 31/97 [00:05<00:11,  5.58it/s, loss=2.26, v_num=0]
Epoch 63:  33%|███▎      | 32/97 [00:05<00:11,  5.68it/s, loss=2.26, v_num=0]
Epoch 63:  33%|███▎      | 32/97 [00:05<00:11,  5.62it/s, loss=2.27, v_num=0]
Epoch 63:  34%|███▍      | 33/97 [00:05<00:11,  5.71it/s, loss=2.27, v_num=0]
Epoch 63:  34%|███▍      | 33/97 [00:05<00:11,  5.66it/s, loss=2.26, v_num=0]
Epoch 63:  35%|███▌      | 34/97 [00:05<00:10,  5.75it/s, loss=2.26, v_num=0]
Epoch 63:  35%|███▌      | 34/97 [00:05<00:11,  5.70it/s, loss=2.26, v_num=0]
Epoch 63:  36%|███▌      | 35/97 [00:06<00:10,  5.79it/s, loss=2.26, v_num=0]
Epoch 63:  36%|███▌      | 35/97 [00:06<00:10,  5.73it/s, loss=2.26, v_num=0]
Epoch 63:  37%|███▋      | 36/97 [00:06<00:10,  5.82it/s, loss=2.26, v_num=0]
Epoch 63:  37%|███▋      | 36/97 [00:06<00:10,  5.76it/s, loss=2.26, v_num=0]
Epoch 63:  38%|███▊      | 37/97 [00:06<00:10,  5.85it/s, loss=2.26, v_num=0]
Epoch 63:  38%|███▊      | 37/97 [00:06<00:10,  5.80it/s, loss=2.27, v_num=0]
Epoch 63:  39%|███▉      | 38/97 [00:06<00:10,  5.88it/s, loss=2.27, v_num=0]
Epoch 63:  39%|███▉      | 38/97 [00:06<00:10,  5.83it/s, loss=2.27, v_num=0]
Epoch 63:  40%|████      | 39/97 [00:06<00:09,  5.91it/s, loss=2.27, v_num=0]
Epoch 63:  40%|████      | 39/97 [00:06<00:09,  5.86it/s, loss=2.27, v_num=0]
Epoch 63:  41%|████      | 40/97 [00:06<00:09,  5.93it/s, loss=2.27, v_num=0]
Epoch 63:  41%|████      | 40/97 [00:06<00:09,  5.89it/s, loss=2.27, v_num=0]
Epoch 63:  42%|████▏     | 41/97 [00:06<00:09,  5.96it/s, loss=2.27, v_num=0]
Epoch 63:  42%|████▏     | 41/97 [00:06<00:09,  5.91it/s, loss=2.27, v_num=0]
Epoch 63:  43%|████▎     | 42/97 [00:07<00:09,  5.99it/s, loss=2.27, v_num=0]
Epoch 63:  43%|████▎     | 42/97 [00:07<00:09,  5.94it/s, loss=2.28, v_num=0]
Epoch 63:  44%|████▍     | 43/97 [00:07<00:08,  6.01it/s, loss=2.28, v_num=0]
Epoch 63:  44%|████▍     | 43/97 [00:07<00:09,  5.97it/s, loss=2.27, v_num=0]
Epoch 63:  45%|████▌     | 44/97 [00:07<00:08,  6.03it/s, loss=2.27, v_num=0]
Epoch 63:  45%|████▌     | 44/97 [00:07<00:08,  5.99it/s, loss=2.27, v_num=0]
Epoch 63:  46%|████▋     | 45/97 [00:07<00:08,  6.06it/s, loss=2.27, v_num=0]
Epoch 63:  46%|████▋     | 45/97 [00:07<00:08,  6.01it/s, loss=2.27, v_num=0]
Epoch 63:  47%|████▋     | 46/97 [00:07<00:08,  6.08it/s, loss=2.27, v_num=0]
Epoch 63:  47%|████▋     | 46/97 [00:07<00:08,  6.03it/s, loss=2.27, v_num=0]
Epoch 63:  48%|████▊     | 47/97 [00:07<00:08,  6.10it/s, loss=2.27, v_num=0]
Epoch 63:  48%|████▊     | 47/97 [00:07<00:08,  6.06it/s, loss=2.27, v_num=0]
Epoch 63:  49%|████▉     | 48/97 [00:07<00:08,  6.12it/s, loss=2.27, v_num=0]
Epoch 63:  49%|████▉     | 48/97 [00:07<00:08,  6.08it/s, loss=2.26, v_num=0]
Epoch 63:  51%|█████     | 49/97 [00:07<00:07,  6.14it/s, loss=2.26, v_num=0]
Epoch 63:  51%|█████     | 49/97 [00:08<00:07,  6.09it/s, loss=2.26, v_num=0]
Epoch 63:  52%|█████▏    | 50/97 [00:08<00:07,  6.16it/s, loss=2.26, v_num=0]
Epoch 63:  52%|█████▏    | 50/97 [00:08<00:07,  6.11it/s, loss=2.26, v_num=0]
Epoch 63:  53%|█████▎    | 51/97 [00:08<00:07,  6.18it/s, loss=2.26, v_num=0]
Epoch 63:  53%|█████▎    | 51/97 [00:08<00:07,  6.13it/s, loss=2.26, v_num=0]
Epoch 63:  54%|█████▎    | 52/97 [00:08<00:07,  6.20it/s, loss=2.26, v_num=0]
Epoch 63:  54%|█████▎    | 52/97 [00:08<00:07,  6.15it/s, loss=2.26, v_num=0]
Epoch 63:  55%|█████▍    | 53/97 [00:08<00:07,  6.21it/s, loss=2.26, v_num=0]
Epoch 63:  55%|█████▍    | 53/97 [00:08<00:07,  6.17it/s, loss=2.26, v_num=0]
Epoch 63:  56%|█████▌    | 54/97 [00:08<00:06,  6.22it/s, loss=2.26, v_num=0]
Epoch 63:  56%|█████▌    | 54/97 [00:08<00:06,  6.18it/s, loss=2.26, v_num=0]
Epoch 63:  57%|█████▋    | 55/97 [00:08<00:06,  6.24it/s, loss=2.26, v_num=0]
Epoch 63:  57%|█████▋    | 55/97 [00:08<00:06,  6.20it/s, loss=2.26, v_num=0]
Epoch 63:  58%|█████▊    | 56/97 [00:08<00:06,  6.25it/s, loss=2.26, v_num=0]
Epoch 63:  58%|█████▊    | 56/97 [00:09<00:06,  6.21it/s, loss=2.26, v_num=0]
Epoch 63:  59%|█████▉    | 57/97 [00:09<00:06,  6.26it/s, loss=2.26, v_num=0]
Epoch 63:  59%|█████▉    | 57/97 [00:09<00:06,  6.23it/s, loss=2.26, v_num=0]
Epoch 63:  60%|█████▉    | 58/97 [00:09<00:06,  6.28it/s, loss=2.26, v_num=0]
Epoch 63:  60%|█████▉    | 58/97 [00:09<00:06,  6.24it/s, loss=2.26, v_num=0]
Epoch 63:  61%|██████    | 59/97 [00:09<00:06,  6.29it/s, loss=2.26, v_num=0]
Epoch 63:  61%|██████    | 59/97 [00:09<00:06,  6.26it/s, loss=2.27, v_num=0]
Epoch 63:  62%|██████▏   | 60/97 [00:09<00:05,  6.31it/s, loss=2.27, v_num=0]
Epoch 63:  62%|██████▏   | 60/97 [00:09<00:05,  6.27it/s, loss=2.26, v_num=0]
Epoch 63:  63%|██████▎   | 61/97 [00:09<00:05,  6.32it/s, loss=2.26, v_num=0]
Epoch 63:  63%|██████▎   | 61/97 [00:09<00:05,  6.29it/s, loss=2.27, v_num=0]
Epoch 63:  64%|██████▍   | 62/97 [00:09<00:05,  6.34it/s, loss=2.27, v_num=0]
Epoch 63:  64%|██████▍   | 62/97 [00:09<00:05,  6.30it/s, loss=2.27, v_num=0]
Epoch 63:  65%|██████▍   | 63/97 [00:09<00:05,  6.35it/s, loss=2.27, v_num=0]
Epoch 63:  65%|██████▍   | 63/97 [00:09<00:05,  6.31it/s, loss=2.27, v_num=0]
Epoch 63:  66%|██████▌   | 64/97 [00:10<00:05,  6.36it/s, loss=2.27, v_num=0]
Epoch 63:  66%|██████▌   | 64/97 [00:10<00:05,  6.33it/s, loss=2.27, v_num=0]
Epoch 63:  67%|██████▋   | 65/97 [00:10<00:05,  6.37it/s, loss=2.27, v_num=0]
Epoch 63:  67%|██████▋   | 65/97 [00:10<00:05,  6.33it/s, loss=2.27, v_num=0]
Epoch 63:  68%|██████▊   | 66/97 [00:10<00:04,  6.38it/s, loss=2.27, v_num=0]
Epoch 63:  68%|██████▊   | 66/97 [00:10<00:04,  6.35it/s, loss=2.27, v_num=0]
Epoch 63:  69%|██████▉   | 67/97 [00:10<00:04,  6.39it/s, loss=2.27, v_num=0]
Epoch 63:  69%|██████▉   | 67/97 [00:10<00:04,  6.36it/s, loss=2.26, v_num=0]
Epoch 63:  70%|███████   | 68/97 [00:10<00:04,  6.40it/s, loss=2.26, v_num=0]
Epoch 63:  70%|███████   | 68/97 [00:10<00:04,  6.37it/s, loss=2.26, v_num=0]
Epoch 63:  71%|███████   | 69/97 [00:10<00:04,  6.42it/s, loss=2.26, v_num=0]
Epoch 63:  71%|███████   | 69/97 [00:10<00:04,  6.38it/s, loss=2.26, v_num=0]
Epoch 63:  72%|███████▏  | 70/97 [00:10<00:04,  6.43it/s, loss=2.26, v_num=0]
Epoch 63:  72%|███████▏  | 70/97 [00:10<00:04,  6.39it/s, loss=2.26, v_num=0]
Epoch 63:  73%|███████▎  | 71/97 [00:11<00:04,  6.44it/s, loss=2.26, v_num=0]
Epoch 63:  73%|███████▎  | 71/97 [00:11<00:04,  6.40it/s, loss=2.26, v_num=0]
Epoch 63:  74%|███████▍  | 72/97 [00:11<00:03,  6.45it/s, loss=2.26, v_num=0]
Epoch 63:  74%|███████▍  | 72/97 [00:11<00:03,  6.41it/s, loss=2.25, v_num=0]
Epoch 63:  75%|███████▌  | 73/97 [00:11<00:03,  6.46it/s, loss=2.25, v_num=0]
Epoch 63:  75%|███████▌  | 73/97 [00:11<00:03,  6.42it/s, loss=2.26, v_num=0]
Epoch 63:  76%|███████▋  | 74/97 [00:11<00:03,  6.47it/s, loss=2.26, v_num=0]
Epoch 63:  76%|███████▋  | 74/97 [00:11<00:03,  6.43it/s, loss=2.26, v_num=0]
Epoch 63:  77%|███████▋  | 75/97 [00:11<00:03,  6.47it/s, loss=2.26, v_num=0]
Epoch 63:  77%|███████▋  | 75/97 [00:11<00:03,  6.44it/s, loss=2.26, v_num=0]
Epoch 63:  78%|███████▊  | 76/97 [00:11<00:03,  6.48it/s, loss=2.26, v_num=0]
Epoch 63:  78%|███████▊  | 76/97 [00:11<00:03,  6.45it/s, loss=2.26, v_num=0]
Epoch 63:  79%|███████▉  | 77/97 [00:11<00:03,  6.49it/s, loss=2.26, v_num=0]
Epoch 63:  79%|███████▉  | 77/97 [00:11<00:03,  6.46it/s, loss=2.26, v_num=0]
Epoch 63:  80%|████████  | 78/97 [00:11<00:02,  6.50it/s, loss=2.26, v_num=0]
Epoch 63:  80%|████████  | 78/97 [00:12<00:02,  6.47it/s, loss=2.26, v_num=0]
Epoch 63:  81%|████████▏ | 79/97 [00:12<00:02,  6.51it/s, loss=2.26, v_num=0]
Epoch 63:  81%|████████▏ | 79/97 [00:12<00:02,  6.48it/s, loss=2.25, v_num=0]
Epoch 63:  82%|████████▏ | 80/97 [00:12<00:02,  6.52it/s, loss=2.25, v_num=0]
Epoch 63:  82%|████████▏ | 80/97 [00:12<00:02,  6.49it/s, loss=2.25, v_num=0]
Epoch 63:  84%|████████▎ | 81/97 [00:12<00:02,  6.52it/s, loss=2.25, v_num=0]
Epoch 63:  84%|████████▎ | 81/97 [00:12<00:02,  6.49it/s, loss=2.25, v_num=0]
Epoch 63:  85%|████████▍ | 82/97 [00:12<00:02,  6.53it/s, loss=2.25, v_num=0]
Epoch 63:  85%|████████▍ | 82/97 [00:12<00:02,  6.50it/s, loss=2.24, v_num=0]
Epoch 63:  86%|████████▌ | 83/97 [00:12<00:02,  6.54it/s, loss=2.24, v_num=0]
Epoch 63:  86%|████████▌ | 83/97 [00:12<00:02,  6.51it/s, loss=2.24, v_num=0]
Epoch 63:  87%|████████▋ | 84/97 [00:12<00:01,  6.54it/s, loss=2.24, v_num=0]
Epoch 63:  87%|████████▋ | 84/97 [00:12<00:01,  6.52it/s, loss=2.24, v_num=0]
Epoch 63:  88%|████████▊ | 85/97 [00:12<00:01,  6.55it/s, loss=2.24, v_num=0]
Epoch 63:  88%|████████▊ | 85/97 [00:13<00:01,  6.53it/s, loss=2.24, v_num=0]
Epoch 63:  89%|████████▊ | 86/97 [00:13<00:01,  6.56it/s, loss=2.24, v_num=0]
Epoch 63:  89%|████████▊ | 86/97 [00:13<00:01,  6.53it/s, loss=2.25, v_num=0]
Epoch 63:  90%|████████▉ | 87/97 [00:13<00:01,  6.57it/s, loss=2.25, v_num=0]
Epoch 63:  90%|████████▉ | 87/97 [00:13<00:01,  6.54it/s, loss=2.26, v_num=0]
Epoch 63:  91%|█████████ | 88/97 [00:13<00:01,  6.58it/s, loss=2.26, v_num=0]
Epoch 63:  91%|█████████ | 88/97 [00:13<00:01,  6.55it/s, loss=2.25, v_num=0]
Epoch 63:  92%|█████████▏| 89/97 [00:13<00:01,  6.58it/s, loss=2.25, v_num=0]
Epoch 63:  92%|█████████▏| 89/97 [00:13<00:01,  6.56it/s, loss=2.25, v_num=0]
Epoch 63:  93%|█████████▎| 90/97 [00:13<00:01,  6.59it/s, loss=2.25, v_num=0]
Epoch 63:  93%|█████████▎| 90/97 [00:13<00:01,  6.56it/s, loss=2.26, v_num=0]
Epoch 63:  94%|█████████▍| 91/97 [00:13<00:00,  6.60it/s, loss=2.26, v_num=0]
Epoch 63:  94%|█████████▍| 91/97 [00:13<00:00,  6.57it/s, loss=2.25, v_num=0]
Epoch 63:  95%|█████████▍| 92/97 [00:13<00:00,  6.60it/s, loss=2.25, v_num=0]
Epoch 63:  95%|█████████▍| 92/97 [00:13<00:00,  6.58it/s, loss=2.26, v_num=0]
Epoch 63:  96%|█████████▌| 93/97 [00:14<00:00,  6.61it/s, loss=2.26, v_num=0]
Epoch 63:  96%|█████████▌| 93/97 [00:14<00:00,  6.59it/s, loss=2.26, v_num=0]
Epoch 63:  97%|█████████▋| 94/97 [00:14<00:00,  6.62it/s, loss=2.26, v_num=0]
Epoch 63:  97%|█████████▋| 94/97 [00:14<00:00,  6.59it/s, loss=2.26, v_num=0]
Epoch 63:  98%|█████████▊| 95/97 [00:14<00:00,  6.62it/s, loss=2.26, v_num=0]
Epoch 63:  98%|█████████▊| 95/97 [00:14<00:00,  6.60it/s, loss=2.25, v_num=0]
Epoch 63:  99%|█████████▉| 96/97 [00:14<00:00,  6.63it/s, loss=2.25, v_num=0]
Epoch 63:  99%|█████████▉| 96/97 [00:14<00:00,  6.61it/s, loss=2.25, v_num=0]
Epoch 63: 100%|██████████| 97/97 [00:14<00:00,  6.64it/s, loss=2.25, v_num=0]
Epoch 63: 100%|██████████| 97/97 [00:14<00:00,  6.61it/s, loss=2.24, v_num=0]
Epoch 63: 100%|██████████| 97/97 [00:14<00:00,  6.61it/s, loss=2.24, v_num=0]
Epoch 63:   0%|          | 0/97 [00:00<?, ?it/s, loss=2.24, v_num=0]
Epoch 64:   0%|          | 0/97 [00:00<?, ?it/s, loss=2.24, v_num=0]
Epoch 64:   1%|          | 1/97 [00:01<02:16,  1.42s/it, loss=2.24, v_num=0]
Epoch 64:   1%|          | 1/97 [00:01<02:21,  1.48s/it, loss=2.24, v_num=0]
Epoch 64:   2%|▏         | 2/97 [00:01<01:14,  1.28it/s, loss=2.24, v_num=0]
Epoch 64:   2%|▏         | 2/97 [00:01<01:16,  1.24it/s, loss=2.25, v_num=0]
Epoch 64:   3%|▎         | 3/97 [00:01<00:53,  1.77it/s, loss=2.25, v_num=0]
Epoch 64:   3%|▎         | 3/97 [00:01<00:54,  1.71it/s, loss=2.25, v_num=0]
Epoch 64:   4%|▍         | 4/97 [00:01<00:42,  2.19it/s, loss=2.25, v_num=0]
Epoch 64:   4%|▍         | 4/97 [00:01<00:43,  2.12it/s, loss=2.25, v_num=0]
Epoch 64:   5%|▌         | 5/97 [00:01<00:36,  2.54it/s, loss=2.25, v_num=0]
Epoch 64:   5%|▌         | 5/97 [00:02<00:37,  2.47it/s, loss=2.24, v_num=0]
Epoch 64:   6%|▌         | 6/97 [00:02<00:31,  2.85it/s, loss=2.24, v_num=0]
Epoch 64:   6%|▌         | 6/97 [00:02<00:32,  2.78it/s, loss=2.24, v_num=0]
Epoch 64:   7%|▋         | 7/97 [00:02<00:28,  3.12it/s, loss=2.24, v_num=0]
Epoch 64:   7%|▋         | 7/97 [00:02<00:29,  3.05it/s, loss=2.23, v_num=0]
Epoch 64:   8%|▊         | 8/97 [00:02<00:26,  3.37it/s, loss=2.23, v_num=0]
Epoch 64:   8%|▊         | 8/97 [00:02<00:27,  3.29it/s, loss=2.23, v_num=0]
Epoch 64:   9%|▉         | 9/97 [00:02<00:24,  3.57it/s, loss=2.23, v_num=0]
Epoch 64:   9%|▉         | 9/97 [00:02<00:25,  3.49it/s, loss=2.23, v_num=0]
Epoch 64:  10%|█         | 10/97 [00:02<00:23,  3.76it/s, loss=2.23, v_num=0]
Epoch 64:  10%|█         | 10/97 [00:02<00:23,  3.69it/s, loss=2.22, v_num=0]
Epoch 64:  11%|█▏        | 11/97 [00:02<00:21,  3.93it/s, loss=2.22, v_num=0]
Epoch 64:  11%|█▏        | 11/97 [00:02<00:22,  3.86it/s, loss=2.22, v_num=0]
Epoch 64:  12%|█▏        | 12/97 [00:02<00:20,  4.09it/s, loss=2.22, v_num=0]
Epoch 64:  12%|█▏        | 12/97 [00:02<00:21,  4.02it/s, loss=2.23, v_num=0]
Epoch 64:  13%|█▎        | 13/97 [00:03<00:19,  4.24it/s, loss=2.23, v_num=0]
Epoch 64:  13%|█▎        | 13/97 [00:03<00:20,  4.16it/s, loss=2.22, v_num=0]
Epoch 64:  14%|█▍        | 14/97 [00:03<00:18,  4.37it/s, loss=2.22, v_num=0]
Epoch 64:  14%|█▍        | 14/97 [00:03<00:19,  4.30it/s, loss=2.23, v_num=0]
Epoch 64:  15%|█▌        | 15/97 [00:03<00:18,  4.50it/s, loss=2.23, v_num=0]
Epoch 64:  15%|█▌        | 15/97 [00:03<00:18,  4.42it/s, loss=2.23, v_num=0]
Epoch 64:  16%|█▋        | 16/97 [00:03<00:17,  4.60it/s, loss=2.23, v_num=0]
Epoch 64:  16%|█▋        | 16/97 [00:03<00:17,  4.53it/s, loss=2.22, v_num=0]
Epoch 64:  18%|█▊        | 17/97 [00:03<00:17,  4.70it/s, loss=2.22, v_num=0]
Epoch 64:  18%|█▊        | 17/97 [00:03<00:17,  4.63it/s, loss=2.22, v_num=0]
Epoch 64:  19%|█▊        | 18/97 [00:03<00:16,  4.80it/s, loss=2.22, v_num=0]
Epoch 64:  19%|█▊        | 18/97 [00:03<00:16,  4.73it/s, loss=2.22, v_num=0]
Epoch 64:  20%|█▉        | 19/97 [00:03<00:15,  4.88it/s, loss=2.22, v_num=0]
Epoch 64:  20%|█▉        | 19/97 [00:03<00:16,  4.82it/s, loss=2.22, v_num=0]
Epoch 64:  21%|██        | 20/97 [00:04<00:15,  4.97it/s, loss=2.22, v_num=0]
Epoch 64:  21%|██        | 20/97 [00:04<00:15,  4.90it/s, loss=2.23, v_num=0]
Epoch 64:  22%|██▏       | 21/97 [00:04<00:15,  5.05it/s, loss=2.23, v_num=0]
Epoch 64:  22%|██▏       | 21/97 [00:04<00:15,  4.98it/s, loss=2.23, v_num=0]
Epoch 64:  23%|██▎       | 22/97 [00:04<00:14,  5.12it/s, loss=2.23, v_num=0]
Epoch 64:  23%|██▎       | 22/97 [00:04<00:14,  5.06it/s, loss=2.23, v_num=0]
Epoch 64:  24%|██▎       | 23/97 [00:04<00:14,  5.19it/s, loss=2.23, v_num=0]
Epoch 64:  24%|██▎       | 23/97 [00:04<00:14,  5.12it/s, loss=2.22, v_num=0]
Epoch 64:  25%|██▍       | 24/97 [00:04<00:13,  5.25it/s, loss=2.22, v_num=0]
Epoch 64:  25%|██▍       | 24/97 [00:04<00:14,  5.19it/s, loss=2.22, v_num=0]
Epoch 64:  26%|██▌       | 25/97 [00:04<00:13,  5.31it/s, loss=2.22, v_num=0]
Epoch 64:  26%|██▌       | 25/97 [00:04<00:13,  5.25it/s, loss=2.22, v_num=0]
Epoch 64:  27%|██▋       | 26/97 [00:04<00:13,  5.37it/s, loss=2.22, v_num=0]
Epoch 64:  27%|██▋       | 26/97 [00:04<00:13,  5.31it/s, loss=2.22, v_num=0]
Epoch 64:  28%|██▊       | 27/97 [00:04<00:12,  5.42it/s, loss=2.22, v_num=0]
Epoch 64:  28%|██▊       | 27/97 [00:05<00:13,  5.36it/s, loss=2.23, v_num=0]
Epoch 64:  29%|██▉       | 28/97 [00:05<00:12,  5.47it/s, loss=2.23, v_num=0]
Epoch 64:  29%|██▉       | 28/97 [00:05<00:12,  5.41it/s, loss=2.23, v_num=0]
Epoch 64:  30%|██▉       | 29/97 [00:05<00:12,  5.52it/s, loss=2.23, v_num=0]
Epoch 64:  30%|██▉       | 29/97 [00:05<00:12,  5.46it/s, loss=2.23, v_num=0]
Epoch 64:  31%|███       | 30/97 [00:05<00:12,  5.56it/s, loss=2.23, v_num=0]
Epoch 64:  31%|███       | 30/97 [00:05<00:12,  5.51it/s, loss=2.23, v_num=0]
Epoch 64:  32%|███▏      | 31/97 [00:05<00:11,  5.61it/s, loss=2.23, v_num=0]
Epoch 64:  32%|███▏      | 31/97 [00:05<00:11,  5.55it/s, loss=2.24, v_num=0]
Epoch 64:  33%|███▎      | 32/97 [00:05<00:11,  5.65it/s, loss=2.24, v_num=0]
Epoch 64:  33%|███▎      | 32/97 [00:05<00:11,  5.59it/s, loss=2.24, v_num=0]
Epoch 64:  34%|███▍      | 33/97 [00:05<00:11,  5.69it/s, loss=2.24, v_num=0]
Epoch 64:  34%|███▍      | 33/97 [00:05<00:11,  5.63it/s, loss=2.24, v_num=0]
Epoch 64:  35%|███▌      | 34/97 [00:05<00:11,  5.73it/s, loss=2.24, v_num=0]
Epoch 64:  35%|███▌      | 34/97 [00:05<00:11,  5.67it/s, loss=2.24, v_num=0]
Epoch 64:  36%|███▌      | 35/97 [00:06<00:10,  5.76it/s, loss=2.24, v_num=0]
Epoch 64:  36%|███▌      | 35/97 [00:06<00:10,  5.71it/s, loss=2.25, v_num=0]
Epoch 64:  37%|███▋      | 36/97 [00:06<00:10,  5.80it/s, loss=2.25, v_num=0]
Epoch 64:  37%|███▋      | 36/97 [00:06<00:10,  5.74it/s, loss=2.25, v_num=0]
Epoch 64:  38%|███▊      | 37/97 [00:06<00:10,  5.83it/s, loss=2.25, v_num=0]
Epoch 64:  38%|███▊      | 37/97 [00:06<00:10,  5.78it/s, loss=2.25, v_num=0]
Epoch 64:  39%|███▉      | 38/97 [00:06<00:10,  5.86it/s, loss=2.25, v_num=0]
Epoch 64:  39%|███▉      | 38/97 [00:06<00:10,  5.81it/s, loss=2.24, v_num=0]
Epoch 64:  40%|████      | 39/97 [00:06<00:09,  5.89it/s, loss=2.24, v_num=0]
Epoch 64:  40%|████      | 39/97 [00:06<00:09,  5.84it/s, loss=2.23, v_num=0]
Epoch 64:  41%|████      | 40/97 [00:06<00:09,  5.92it/s, loss=2.23, v_num=0]
Epoch 64:  41%|████      | 40/97 [00:06<00:09,  5.87it/s, loss=2.23, v_num=0]
Epoch 64:  42%|████▏     | 41/97 [00:06<00:09,  5.95it/s, loss=2.23, v_num=0]
Epoch 64:  42%|████▏     | 41/97 [00:06<00:09,  5.90it/s, loss=2.23, v_num=0]
Epoch 64:  43%|████▎     | 42/97 [00:07<00:09,  5.97it/s, loss=2.23, v_num=0]
Epoch 64:  43%|████▎     | 42/97 [00:07<00:09,  5.92it/s, loss=2.22, v_num=0]
Epoch 64:  44%|████▍     | 43/97 [00:07<00:09,  6.00it/s, loss=2.22, v_num=0]
Epoch 64:  44%|████▍     | 43/97 [00:07<00:09,  5.95it/s, loss=2.23, v_num=0]
Epoch 64:  45%|████▌     | 44/97 [00:07<00:08,  6.02it/s, loss=2.23, v_num=0]
Epoch 64:  45%|████▌     | 44/97 [00:07<00:08,  5.98it/s, loss=2.23, v_num=0]
Epoch 64:  46%|████▋     | 45/97 [00:07<00:08,  6.04it/s, loss=2.23, v_num=0]
Epoch 64:  46%|████▋     | 45/97 [00:07<00:08,  6.00it/s, loss=2.24, v_num=0]
Epoch 64:  47%|████▋     | 46/97 [00:07<00:08,  6.07it/s, loss=2.24, v_num=0]
Epoch 64:  47%|████▋     | 46/97 [00:07<00:08,  6.02it/s, loss=2.24, v_num=0]
Epoch 64:  48%|████▊     | 47/97 [00:07<00:08,  6.09it/s, loss=2.24, v_num=0]
Epoch 64:  48%|████▊     | 47/97 [00:07<00:08,  6.05it/s, loss=2.23, v_num=0]
Epoch 64:  49%|████▉     | 48/97 [00:07<00:08,  6.11it/s, loss=2.23, v_num=0]
Epoch 64:  49%|████▉     | 48/97 [00:07<00:08,  6.07it/s, loss=2.23, v_num=0]
Epoch 64:  51%|█████     | 49/97 [00:07<00:07,  6.13it/s, loss=2.23, v_num=0]
Epoch 64:  51%|█████     | 49/97 [00:08<00:07,  6.09it/s, loss=2.23, v_num=0]
Epoch 64:  52%|█████▏    | 50/97 [00:08<00:07,  6.15it/s, loss=2.23, v_num=0]
Epoch 64:  52%|█████▏    | 50/97 [00:08<00:07,  6.11it/s, loss=2.24, v_num=0]
Epoch 64:  53%|█████▎    | 51/97 [00:08<00:07,  6.17it/s, loss=2.24, v_num=0]
Epoch 64:  53%|█████▎    | 51/97 [00:08<00:07,  6.13it/s, loss=2.23, v_num=0]
Epoch 64:  54%|█████▎    | 52/97 [00:08<00:07,  6.19it/s, loss=2.23, v_num=0]
Epoch 64:  54%|█████▎    | 52/97 [00:08<00:07,  6.15it/s, loss=2.23, v_num=0]
Epoch 64:  55%|█████▍    | 53/97 [00:08<00:07,  6.20it/s, loss=2.23, v_num=0]
Epoch 64:  55%|█████▍    | 53/97 [00:08<00:07,  6.16it/s, loss=2.23, v_num=0]
Epoch 64:  56%|█████▌    | 54/97 [00:08<00:06,  6.22it/s, loss=2.23, v_num=0]
Epoch 64:  56%|█████▌    | 54/97 [00:08<00:06,  6.18it/s, loss=2.23, v_num=0]
Epoch 64:  57%|█████▋    | 55/97 [00:08<00:06,  6.24it/s, loss=2.23, v_num=0]
Epoch 64:  57%|█████▋    | 55/97 [00:08<00:06,  6.20it/s, loss=2.22, v_num=0]
Epoch 64:  58%|█████▊    | 56/97 [00:08<00:06,  6.25it/s, loss=2.22, v_num=0]
Epoch 64:  58%|█████▊    | 56/97 [00:09<00:06,  6.22it/s, loss=2.22, v_num=0]
Epoch 64:  59%|█████▉    | 57/97 [00:09<00:06,  6.27it/s, loss=2.22, v_num=0]
Epoch 64:  59%|█████▉    | 57/97 [00:09<00:06,  6.23it/s, loss=2.23, v_num=0]
Epoch 64:  60%|█████▉    | 58/97 [00:09<00:06,  6.29it/s, loss=2.23, v_num=0]
Epoch 64:  60%|█████▉    | 58/97 [00:09<00:06,  6.25it/s, loss=2.23, v_num=0]
Epoch 64:  61%|██████    | 59/97 [00:09<00:06,  6.30it/s, loss=2.23, v_num=0]
Epoch 64:  61%|██████    | 59/97 [00:09<00:06,  6.26it/s, loss=2.24, v_num=0]
Epoch 64:  62%|██████▏   | 60/97 [00:09<00:05,  6.31it/s, loss=2.24, v_num=0]
Epoch 64:  62%|██████▏   | 60/97 [00:09<00:05,  6.28it/s, loss=2.23, v_num=0]
Epoch 64:  63%|██████▎   | 61/97 [00:09<00:05,  6.33it/s, loss=2.23, v_num=0]
Epoch 64:  63%|██████▎   | 61/97 [00:09<00:05,  6.29it/s, loss=2.24, v_num=0]
Epoch 64:  64%|██████▍   | 62/97 [00:09<00:05,  6.34it/s, loss=2.24, v_num=0]
Epoch 64:  64%|██████▍   | 62/97 [00:09<00:05,  6.31it/s, loss=2.24, v_num=0]
Epoch 64:  65%|██████▍   | 63/97 [00:09<00:05,  6.35it/s, loss=2.24, v_num=0]
Epoch 64:  65%|██████▍   | 63/97 [00:09<00:05,  6.32it/s, loss=2.24, v_num=0]
Epoch 64:  66%|██████▌   | 64/97 [00:10<00:05,  6.37it/s, loss=2.24, v_num=0]
Epoch 64:  66%|██████▌   | 64/97 [00:10<00:05,  6.33it/s, loss=2.24, v_num=0]
Epoch 64:  67%|██████▋   | 65/97 [00:10<00:05,  6.38it/s, loss=2.24, v_num=0]
Epoch 64:  67%|██████▋   | 65/97 [00:10<00:05,  6.35it/s, loss=2.24, v_num=0]
Epoch 64:  68%|██████▊   | 66/97 [00:10<00:04,  6.39it/s, loss=2.24, v_num=0]
Epoch 64:  68%|██████▊   | 66/97 [00:10<00:04,  6.36it/s, loss=2.24, v_num=0]
Epoch 64:  69%|██████▉   | 67/97 [00:10<00:04,  6.40it/s, loss=2.24, v_num=0]
Epoch 64:  69%|██████▉   | 67/97 [00:10<00:04,  6.37it/s, loss=2.25, v_num=0]
Epoch 64:  70%|███████   | 68/97 [00:10<00:04,  6.42it/s, loss=2.25, v_num=0]
Epoch 64:  70%|███████   | 68/97 [00:10<00:04,  6.38it/s, loss=2.25, v_num=0]
Epoch 64:  71%|███████   | 69/97 [00:10<00:04,  6.43it/s, loss=2.25, v_num=0]
Epoch 64:  71%|███████   | 69/97 [00:10<00:04,  6.39it/s, loss=2.25, v_num=0]
Epoch 64:  72%|███████▏  | 70/97 [00:10<00:04,  6.44it/s, loss=2.25, v_num=0]
Epoch 64:  72%|███████▏  | 70/97 [00:10<00:04,  6.41it/s, loss=2.25, v_num=0]
Epoch 64:  73%|███████▎  | 71/97 [00:11<00:04,  6.45it/s, loss=2.25, v_num=0]
Epoch 64:  73%|███████▎  | 71/97 [00:11<00:04,  6.42it/s, loss=2.25, v_num=0]
Epoch 64:  74%|███████▍  | 72/97 [00:11<00:03,  6.46it/s, loss=2.25, v_num=0]
Epoch 64:  74%|███████▍  | 72/97 [00:11<00:03,  6.43it/s, loss=2.25, v_num=0]
Epoch 64:  75%|███████▌  | 73/97 [00:11<00:03,  6.47it/s, loss=2.25, v_num=0]
Epoch 64:  75%|███████▌  | 73/97 [00:11<00:03,  6.44it/s, loss=2.25, v_num=0]
Epoch 64:  76%|███████▋  | 74/97 [00:11<00:03,  6.48it/s, loss=2.25, v_num=0]
Epoch 64:  76%|███████▋  | 74/97 [00:11<00:03,  6.45it/s, loss=2.25, v_num=0]
Epoch 64:  77%|███████▋  | 75/97 [00:11<00:03,  6.49it/s, loss=2.25, v_num=0]
Epoch 64:  77%|███████▋  | 75/97 [00:11<00:03,  6.46it/s, loss=2.25, v_num=0]
Epoch 64:  78%|███████▊  | 76/97 [00:11<00:03,  6.50it/s, loss=2.25, v_num=0]
Epoch 64:  78%|███████▊  | 76/97 [00:11<00:03,  6.47it/s, loss=2.25, v_num=0]
Epoch 64:  79%|███████▉  | 77/97 [00:11<00:03,  6.51it/s, loss=2.25, v_num=0]
Epoch 64:  79%|███████▉  | 77/97 [00:11<00:03,  6.48it/s, loss=2.25, v_num=0]
Epoch 64:  80%|████████  | 78/97 [00:11<00:02,  6.52it/s, loss=2.25, v_num=0]
Epoch 64:  80%|████████  | 78/97 [00:12<00:02,  6.49it/s, loss=2.26, v_num=0]
Epoch 64:  81%|████████▏ | 79/97 [00:12<00:02,  6.53it/s, loss=2.26, v_num=0]
Epoch 64:  81%|████████▏ | 79/97 [00:12<00:02,  6.50it/s, loss=2.25, v_num=0]
Epoch 64:  82%|████████▏ | 80/97 [00:12<00:02,  6.53it/s, loss=2.25, v_num=0]
Epoch 64:  82%|████████▏ | 80/97 [00:12<00:02,  6.50it/s, loss=2.26, v_num=0]
Epoch 64:  84%|████████▎ | 81/97 [00:12<00:02,  6.54it/s, loss=2.26, v_num=0]
Epoch 64:  84%|████████▎ | 81/97 [00:12<00:02,  6.51it/s, loss=2.25, v_num=0]
Epoch 64:  85%|████████▍ | 82/97 [00:12<00:02,  6.55it/s, loss=2.25, v_num=0]
Epoch 64:  85%|████████▍ | 82/97 [00:12<00:02,  6.52it/s, loss=2.25, v_num=0]
Epoch 64:  86%|████████▌ | 83/97 [00:12<00:02,  6.56it/s, loss=2.25, v_num=0]
Epoch 64:  86%|████████▌ | 83/97 [00:12<00:02,  6.53it/s, loss=2.26, v_num=0]
Epoch 64:  87%|████████▋ | 84/97 [00:12<00:01,  6.56it/s, loss=2.26, v_num=0]
Epoch 64:  87%|████████▋ | 84/97 [00:12<00:01,  6.54it/s, loss=2.26, v_num=0]
Epoch 64:  88%|████████▊ | 85/97 [00:12<00:01,  6.57it/s, loss=2.26, v_num=0]
Epoch 64:  88%|████████▊ | 85/97 [00:12<00:01,  6.54it/s, loss=2.27, v_num=0]
Epoch 64:  89%|████████▊ | 86/97 [00:13<00:01,  6.58it/s, loss=2.27, v_num=0]
Epoch 64:  89%|████████▊ | 86/97 [00:13<00:01,  6.55it/s, loss=2.26, v_num=0]
Epoch 64:  90%|████████▉ | 87/97 [00:13<00:01,  6.59it/s, loss=2.26, v_num=0]
Epoch 64:  90%|████████▉ | 87/97 [00:13<00:01,  6.56it/s, loss=2.26, v_num=0]
Epoch 64:  91%|█████████ | 88/97 [00:13<00:01,  6.60it/s, loss=2.26, v_num=0]
Epoch 64:  91%|█████████ | 88/97 [00:13<00:01,  6.57it/s, loss=2.25, v_num=0]
Epoch 64:  92%|█████████▏| 89/97 [00:13<00:01,  6.60it/s, loss=2.25, v_num=0]
Epoch 64:  92%|█████████▏| 89/97 [00:13<00:01,  6.58it/s, loss=2.25, v_num=0]
Epoch 64:  93%|█████████▎| 90/97 [00:13<00:01,  6.61it/s, loss=2.25, v_num=0]
Epoch 64:  93%|█████████▎| 90/97 [00:13<00:01,  6.58it/s, loss=2.25, v_num=0]
Epoch 64:  94%|█████████▍| 91/97 [00:13<00:00,  6.62it/s, loss=2.25, v_num=0]
Epoch 64:  94%|█████████▍| 91/97 [00:13<00:00,  6.59it/s, loss=2.25, v_num=0]
Epoch 64:  95%|█████████▍| 92/97 [00:13<00:00,  6.63it/s, loss=2.25, v_num=0]
Epoch 64:  95%|█████████▍| 92/97 [00:13<00:00,  6.60it/s, loss=2.25, v_num=0]
Epoch 64:  96%|█████████▌| 93/97 [00:14<00:00,  6.63it/s, loss=2.25, v_num=0]
Epoch 64:  96%|█████████▌| 93/97 [00:14<00:00,  6.60it/s, loss=2.25, v_num=0]
Epoch 64:  97%|█████████▋| 94/97 [00:14<00:00,  6.64it/s, loss=2.25, v_num=0]
Epoch 64:  97%|█████████▋| 94/97 [00:14<00:00,  6.61it/s, loss=2.25, v_num=0]
Epoch 64:  98%|█████████▊| 95/97 [00:14<00:00,  6.64it/s, loss=2.25, v_num=0]
Epoch 64:  98%|█████████▊| 95/97 [00:14<00:00,  6.62it/s, loss=2.25, v_num=0]
Epoch 64:  99%|█████████▉| 96/97 [00:14<00:00,  6.65it/s, loss=2.25, v_num=0]
Epoch 64:  99%|█████████▉| 96/97 [00:14<00:00,  6.62it/s, loss=2.26, v_num=0]
Epoch 64: 100%|██████████| 97/97 [00:14<00:00,  6.66it/s, loss=2.26, v_num=0]
Epoch 64: 100%|██████████| 97/97 [00:14<00:00,  6.63it/s, loss=2.26, v_num=0]
Epoch 64: 100%|██████████| 97/97 [00:14<00:00,  6.63it/s, loss=2.26, v_num=0]
Epoch 64:   0%|          | 0/97 [00:00<?, ?it/s, loss=2.26, v_num=0]
Epoch 65:   0%|          | 0/97 [00:00<?, ?it/s, loss=2.26, v_num=0]
Epoch 65:   1%|          | 1/97 [00:01<02:15,  1.41s/it, loss=2.26, v_num=0]
Epoch 65:   1%|          | 1/97 [00:01<02:20,  1.46s/it, loss=2.25, v_num=0]
Epoch 65:   2%|▏         | 2/97 [00:01<01:13,  1.30it/s, loss=2.25, v_num=0]
Epoch 65:   2%|▏         | 2/97 [00:01<01:15,  1.25it/s, loss=2.25, v_num=0]
Epoch 65:   3%|▎         | 3/97 [00:01<00:52,  1.79it/s, loss=2.25, v_num=0]
Epoch 65:   3%|▎         | 3/97 [00:01<00:54,  1.73it/s, loss=2.25, v_num=0]
Epoch 65:   4%|▍         | 4/97 [00:01<00:42,  2.20it/s, loss=2.25, v_num=0]
Epoch 65:   4%|▍         | 4/97 [00:01<00:43,  2.13it/s, loss=2.25, v_num=0]
Epoch 65:   5%|▌         | 5/97 [00:01<00:35,  2.56it/s, loss=2.25, v_num=0]
Epoch 65:   5%|▌         | 5/97 [00:02<00:36,  2.49it/s, loss=2.25, v_num=0]
Epoch 65:   6%|▌         | 6/97 [00:02<00:31,  2.87it/s, loss=2.25, v_num=0]
Epoch 65:   6%|▌         | 6/97 [00:02<00:32,  2.80it/s, loss=2.24, v_num=0]
Epoch 65:   7%|▋         | 7/97 [00:02<00:28,  3.14it/s, loss=2.24, v_num=0]
Epoch 65:   7%|▋         | 7/97 [00:02<00:29,  3.07it/s, loss=2.23, v_num=0]
Epoch 65:   8%|▊         | 8/97 [00:02<00:26,  3.39it/s, loss=2.23, v_num=0]
Epoch 65:   8%|▊         | 8/97 [00:02<00:26,  3.31it/s, loss=2.23, v_num=0]
Epoch 65:   9%|▉         | 9/97 [00:02<00:24,  3.59it/s, loss=2.23, v_num=0]
Epoch 65:   9%|▉         | 9/97 [00:02<00:25,  3.51it/s, loss=2.24, v_num=0]
Epoch 65:  10%|█         | 10/97 [00:02<00:22,  3.79it/s, loss=2.24, v_num=0]
Epoch 65:  10%|█         | 10/97 [00:02<00:23,  3.70it/s, loss=2.24, v_num=0]
Epoch 65:  11%|█▏        | 11/97 [00:02<00:21,  3.96it/s, loss=2.24, v_num=0]
Epoch 65:  11%|█▏        | 11/97 [00:02<00:22,  3.88it/s, loss=2.24, v_num=0]
Epoch 65:  12%|█▏        | 12/97 [00:02<00:20,  4.11it/s, loss=2.24, v_num=0]
Epoch 65:  12%|█▏        | 12/97 [00:02<00:21,  4.04it/s, loss=2.25, v_num=0]
Epoch 65:  13%|█▎        | 13/97 [00:03<00:19,  4.26it/s, loss=2.25, v_num=0]
Epoch 65:  13%|█▎        | 13/97 [00:03<00:20,  4.18it/s, loss=2.24, v_num=0]
Epoch 65:  14%|█▍        | 14/97 [00:03<00:18,  4.39it/s, loss=2.24, v_num=0]
Epoch 65:  14%|█▍        | 14/97 [00:03<00:19,  4.32it/s, loss=2.25, v_num=0]
Epoch 65:  15%|█▌        | 15/97 [00:03<00:18,  4.52it/s, loss=2.25, v_num=0]
Epoch 65:  15%|█▌        | 15/97 [00:03<00:18,  4.44it/s, loss=2.24, v_num=0]
Epoch 65:  16%|█▋        | 16/97 [00:03<00:17,  4.63it/s, loss=2.24, v_num=0]
Epoch 65:  16%|█▋        | 16/97 [00:03<00:17,  4.55it/s, loss=2.23, v_num=0]
Epoch 65:  18%|█▊        | 17/97 [00:03<00:16,  4.73it/s, loss=2.23, v_num=0]
Epoch 65:  18%|█▊        | 17/97 [00:03<00:17,  4.65it/s, loss=2.24, v_num=0]
Epoch 65:  19%|█▊        | 18/97 [00:03<00:16,  4.82it/s, loss=2.24, v_num=0]
Epoch 65:  19%|█▊        | 18/97 [00:03<00:16,  4.75it/s, loss=2.25, v_num=0]
Epoch 65:  20%|█▉        | 19/97 [00:03<00:15,  4.91it/s, loss=2.25, v_num=0]
Epoch 65:  20%|█▉        | 19/97 [00:03<00:16,  4.84it/s, loss=2.24, v_num=0]
Epoch 65:  21%|██        | 20/97 [00:04<00:15,  4.99it/s, loss=2.24, v_num=0]
Epoch 65:  21%|██        | 20/97 [00:04<00:15,  4.92it/s, loss=2.24, v_num=0]
Epoch 65:  22%|██▏       | 21/97 [00:04<00:14,  5.07it/s, loss=2.24, v_num=0]
Epoch 65:  22%|██▏       | 21/97 [00:04<00:15,  5.00it/s, loss=2.24, v_num=0]
Epoch 65:  23%|██▎       | 22/97 [00:04<00:14,  5.14it/s, loss=2.24, v_num=0]
Epoch 65:  23%|██▎       | 22/97 [00:04<00:14,  5.08it/s, loss=2.23, v_num=0]
Epoch 65:  24%|██▎       | 23/97 [00:04<00:14,  5.21it/s, loss=2.23, v_num=0]
Epoch 65:  24%|██▎       | 23/97 [00:04<00:14,  5.14it/s, loss=2.23, v_num=0]
Epoch 65:  25%|██▍       | 24/97 [00:04<00:13,  5.27it/s, loss=2.23, v_num=0]
Epoch 65:  25%|██▍       | 24/97 [00:04<00:14,  5.21it/s, loss=2.23, v_num=0]
Epoch 65:  26%|██▌       | 25/97 [00:04<00:13,  5.33it/s, loss=2.23, v_num=0]
Epoch 65:  26%|██▌       | 25/97 [00:04<00:13,  5.27it/s, loss=2.23, v_num=0]
Epoch 65:  27%|██▋       | 26/97 [00:04<00:13,  5.39it/s, loss=2.23, v_num=0]
Epoch 65:  27%|██▋       | 26/97 [00:04<00:13,  5.33it/s, loss=2.23, v_num=0]
Epoch 65:  28%|██▊       | 27/97 [00:04<00:12,  5.45it/s, loss=2.23, v_num=0]
Epoch 65:  28%|██▊       | 27/97 [00:05<00:13,  5.38it/s, loss=2.23, v_num=0]
Epoch 65:  29%|██▉       | 28/97 [00:05<00:12,  5.49it/s, loss=2.23, v_num=0]
Epoch 65:  29%|██▉       | 28/97 [00:05<00:12,  5.43it/s, loss=2.23, v_num=0]
Epoch 65:  30%|██▉       | 29/97 [00:05<00:12,  5.54it/s, loss=2.23, v_num=0]
Epoch 65:  30%|██▉       | 29/97 [00:05<00:12,  5.48it/s, loss=2.23, v_num=0]
Epoch 65:  31%|███       | 30/97 [00:05<00:12,  5.58it/s, loss=2.23, v_num=0]
Epoch 65:  31%|███       | 30/97 [00:05<00:12,  5.53it/s, loss=2.23, v_num=0]
Epoch 65:  32%|███▏      | 31/97 [00:05<00:11,  5.63it/s, loss=2.23, v_num=0]
Epoch 65:  32%|███▏      | 31/97 [00:05<00:11,  5.57it/s, loss=2.23, v_num=0]
Epoch 65:  33%|███▎      | 32/97 [00:05<00:11,  5.67it/s, loss=2.23, v_num=0]
Epoch 65:  33%|███▎      | 32/97 [00:05<00:11,  5.61it/s, loss=2.22, v_num=0]
Epoch 65:  34%|███▍      | 33/97 [00:05<00:11,  5.71it/s, loss=2.22, v_num=0]
Epoch 65:  34%|███▍      | 33/97 [00:05<00:11,  5.65it/s, loss=2.23, v_num=0]
Epoch 65:  35%|███▌      | 34/97 [00:05<00:10,  5.74it/s, loss=2.23, v_num=0]
Epoch 65:  35%|███▌      | 34/97 [00:05<00:11,  5.69it/s, loss=2.23, v_num=0]
Epoch 65:  36%|███▌      | 35/97 [00:06<00:10,  5.78it/s, loss=2.23, v_num=0]
Epoch 65:  36%|███▌      | 35/97 [00:06<00:10,  5.73it/s, loss=2.23, v_num=0]
Epoch 65:  37%|███▋      | 36/97 [00:06<00:10,  5.81it/s, loss=2.23, v_num=0]
Epoch 65:  37%|███▋      | 36/97 [00:06<00:10,  5.76it/s, loss=2.23, v_num=0]
Epoch 65:  38%|███▊      | 37/97 [00:06<00:10,  5.85it/s, loss=2.23, v_num=0]
Epoch 65:  38%|███▊      | 37/97 [00:06<00:10,  5.80it/s, loss=2.23, v_num=0]
Epoch 65:  39%|███▉      | 38/97 [00:06<00:10,  5.88it/s, loss=2.23, v_num=0]
Epoch 65:  39%|███▉      | 38/97 [00:06<00:10,  5.83it/s, loss=2.22, v_num=0]
Epoch 65:  40%|████      | 39/97 [00:06<00:09,  5.91it/s, loss=2.22, v_num=0]
Epoch 65:  40%|████      | 39/97 [00:06<00:09,  5.86it/s, loss=2.23, v_num=0]
Epoch 65:  41%|████      | 40/97 [00:06<00:09,  5.93it/s, loss=2.23, v_num=0]
Epoch 65:  41%|████      | 40/97 [00:06<00:09,  5.89it/s, loss=2.23, v_num=0]
Epoch 65:  42%|████▏     | 41/97 [00:06<00:09,  5.96it/s, loss=2.23, v_num=0]
Epoch 65:  42%|████▏     | 41/97 [00:06<00:09,  5.92it/s, loss=2.24, v_num=0]
Epoch 65:  43%|████▎     | 42/97 [00:07<00:09,  5.99it/s, loss=2.24, v_num=0]
Epoch 65:  43%|████▎     | 42/97 [00:07<00:09,  5.94it/s, loss=2.24, v_num=0]
Epoch 65:  44%|████▍     | 43/97 [00:07<00:08,  6.01it/s, loss=2.24, v_num=0]
Epoch 65:  44%|████▍     | 43/97 [00:07<00:09,  5.97it/s, loss=2.24, v_num=0]
Epoch 65:  45%|████▌     | 44/97 [00:07<00:08,  6.03it/s, loss=2.24, v_num=0]
Epoch 65:  45%|████▌     | 44/97 [00:07<00:08,  5.99it/s, loss=2.25, v_num=0]
Epoch 65:  46%|████▋     | 45/97 [00:07<00:08,  6.06it/s, loss=2.25, v_num=0]
Epoch 65:  46%|████▋     | 45/97 [00:07<00:08,  6.01it/s, loss=2.25, v_num=0]
Epoch 65:  47%|████▋     | 46/97 [00:07<00:08,  6.07it/s, loss=2.25, v_num=0]
Epoch 65:  47%|████▋     | 46/97 [00:07<00:08,  6.02it/s, loss=2.26, v_num=0]
Epoch 65:  48%|████▊     | 47/97 [00:07<00:08,  6.09it/s, loss=2.26, v_num=0]
Epoch 65:  48%|████▊     | 47/97 [00:07<00:08,  6.05it/s, loss=2.26, v_num=0]
Epoch 65:  49%|████▉     | 48/97 [00:07<00:08,  6.11it/s, loss=2.26, v_num=0]
Epoch 65:  49%|████▉     | 48/97 [00:07<00:08,  6.07it/s, loss=2.25, v_num=0]
Epoch 65:  51%|█████     | 49/97 [00:07<00:07,  6.13it/s, loss=2.25, v_num=0]
Epoch 65:  51%|█████     | 49/97 [00:08<00:07,  6.09it/s, loss=2.25, v_num=0]
Epoch 65:  52%|█████▏    | 50/97 [00:08<00:07,  6.15it/s, loss=2.25, v_num=0]
Epoch 65:  52%|█████▏    | 50/97 [00:08<00:07,  6.11it/s, loss=2.26, v_num=0]
Epoch 65:  53%|█████▎    | 51/97 [00:08<00:07,  6.17it/s, loss=2.26, v_num=0]
Epoch 65:  53%|█████▎    | 51/97 [00:08<00:07,  6.13it/s, loss=2.25, v_num=0]
Epoch 65:  54%|█████▎    | 52/97 [00:08<00:07,  6.19it/s, loss=2.25, v_num=0]
Epoch 65:  54%|█████▎    | 52/97 [00:08<00:07,  6.15it/s, loss=2.26, v_num=0]
Epoch 65:  55%|█████▍    | 53/97 [00:08<00:07,  6.21it/s, loss=2.26, v_num=0]
Epoch 65:  55%|█████▍    | 53/97 [00:08<00:07,  6.17it/s, loss=2.25, v_num=0]
Epoch 65:  56%|█████▌    | 54/97 [00:08<00:06,  6.22it/s, loss=2.25, v_num=0]
Epoch 65:  56%|█████▌    | 54/97 [00:08<00:06,  6.18it/s, loss=2.25, v_num=0]
Epoch 65:  57%|█████▋    | 55/97 [00:08<00:06,  6.24it/s, loss=2.25, v_num=0]
Epoch 65:  57%|█████▋    | 55/97 [00:08<00:06,  6.20it/s, loss=2.24, v_num=0]
Epoch 65:  58%|█████▊    | 56/97 [00:08<00:06,  6.25it/s, loss=2.24, v_num=0]
Epoch 65:  58%|█████▊    | 56/97 [00:09<00:06,  6.22it/s, loss=2.24, v_num=0]
Epoch 65:  59%|█████▉    | 57/97 [00:09<00:06,  6.27it/s, loss=2.24, v_num=0]
Epoch 65:  59%|█████▉    | 57/97 [00:09<00:06,  6.23it/s, loss=2.24, v_num=0]
Epoch 65:  60%|█████▉    | 58/97 [00:09<00:06,  6.29it/s, loss=2.24, v_num=0]
Epoch 65:  60%|█████▉    | 58/97 [00:09<00:06,  6.25it/s, loss=2.23, v_num=0]
Epoch 65:  61%|██████    | 59/97 [00:09<00:06,  6.30it/s, loss=2.23, v_num=0]
Epoch 65:  61%|██████    | 59/97 [00:09<00:06,  6.26it/s, loss=2.24, v_num=0]
Epoch 65:  62%|██████▏   | 60/97 [00:09<00:05,  6.31it/s, loss=2.24, v_num=0]
Epoch 65:  62%|██████▏   | 60/97 [00:09<00:05,  6.28it/s, loss=2.23, v_num=0]
Epoch 65:  63%|██████▎   | 61/97 [00:09<00:05,  6.33it/s, loss=2.23, v_num=0]
Epoch 65:  63%|██████▎   | 61/97 [00:09<00:05,  6.29it/s, loss=2.23, v_num=0]
Epoch 65:  64%|██████▍   | 62/97 [00:09<00:05,  6.34it/s, loss=2.23, v_num=0]
Epoch 65:  64%|██████▍   | 62/97 [00:09<00:05,  6.31it/s, loss=2.23, v_num=0]
Epoch 65:  65%|██████▍   | 63/97 [00:09<00:05,  6.35it/s, loss=2.23, v_num=0]
Epoch 65:  65%|██████▍   | 63/97 [00:09<00:05,  6.32it/s, loss=2.22, v_num=0]
Epoch 65:  66%|██████▌   | 64/97 [00:10<00:05,  6.36it/s, loss=2.22, v_num=0]
Epoch 65:  66%|██████▌   | 64/97 [00:10<00:05,  6.33it/s, loss=2.22, v_num=0]
Epoch 65:  67%|██████▋   | 65/97 [00:10<00:05,  6.38it/s, loss=2.22, v_num=0]
Epoch 65:  67%|██████▋   | 65/97 [00:10<00:05,  6.34it/s, loss=2.22, v_num=0]
Epoch 65:  68%|██████▊   | 66/97 [00:10<00:04,  6.39it/s, loss=2.22, v_num=0]
Epoch 65:  68%|██████▊   | 66/97 [00:10<00:04,  6.35it/s, loss=2.22, v_num=0]
Epoch 65:  69%|██████▉   | 67/97 [00:10<00:04,  6.40it/s, loss=2.22, v_num=0]
Epoch 65:  69%|██████▉   | 67/97 [00:10<00:04,  6.37it/s, loss=2.21, v_num=0]
Epoch 65:  70%|███████   | 68/97 [00:10<00:04,  6.41it/s, loss=2.21, v_num=0]
Epoch 65:  70%|███████   | 68/97 [00:10<00:04,  6.38it/s, loss=2.22, v_num=0]
Epoch 65:  71%|███████   | 69/97 [00:10<00:04,  6.42it/s, loss=2.22, v_num=0]
Epoch 65:  71%|███████   | 69/97 [00:10<00:04,  6.39it/s, loss=2.21, v_num=0]
Epoch 65:  72%|███████▏  | 70/97 [00:10<00:04,  6.43it/s, loss=2.21, v_num=0]
Epoch 65:  72%|███████▏  | 70/97 [00:10<00:04,  6.40it/s, loss=2.21, v_num=0]
Epoch 65:  73%|███████▎  | 71/97 [00:11<00:04,  6.44it/s, loss=2.21, v_num=0]
Epoch 65:  73%|███████▎  | 71/97 [00:11<00:04,  6.41it/s, loss=2.22, v_num=0]
Epoch 65:  74%|███████▍  | 72/97 [00:11<00:03,  6.45it/s, loss=2.22, v_num=0]
Epoch 65:  74%|███████▍  | 72/97 [00:11<00:03,  6.42it/s, loss=2.21, v_num=0]
Epoch 65:  75%|███████▌  | 73/97 [00:11<00:03,  6.46it/s, loss=2.21, v_num=0]
Epoch 65:  75%|███████▌  | 73/97 [00:11<00:03,  6.43it/s, loss=2.21, v_num=0]
Epoch 65:  76%|███████▋  | 74/97 [00:11<00:03,  6.47it/s, loss=2.21, v_num=0]
Epoch 65:  76%|███████▋  | 74/97 [00:11<00:03,  6.44it/s, loss=2.21, v_num=0]
Epoch 65:  77%|███████▋  | 75/97 [00:11<00:03,  6.48it/s, loss=2.21, v_num=0]
Epoch 65:  77%|███████▋  | 75/97 [00:11<00:03,  6.45it/s, loss=2.21, v_num=0]
Epoch 65:  78%|███████▊  | 76/97 [00:11<00:03,  6.49it/s, loss=2.21, v_num=0]
Epoch 65:  78%|███████▊  | 76/97 [00:11<00:03,  6.46it/s, loss=2.21, v_num=0]
Epoch 65:  79%|███████▉  | 77/97 [00:11<00:03,  6.50it/s, loss=2.21, v_num=0]
Epoch 65:  79%|███████▉  | 77/97 [00:11<00:03,  6.47it/s, loss=2.21, v_num=0]
Epoch 65:  80%|████████  | 78/97 [00:11<00:02,  6.51it/s, loss=2.21, v_num=0]
Epoch 65:  80%|████████  | 78/97 [00:12<00:02,  6.48it/s, loss=2.21, v_num=0]
Epoch 65:  81%|████████▏ | 79/97 [00:12<00:02,  6.52it/s, loss=2.21, v_num=0]
Epoch 65:  81%|████████▏ | 79/97 [00:12<00:02,  6.49it/s, loss=2.21, v_num=0]
Epoch 65:  82%|████████▏ | 80/97 [00:12<00:02,  6.53it/s, loss=2.21, v_num=0]
Epoch 65:  82%|████████▏ | 80/97 [00:12<00:02,  6.50it/s, loss=2.21, v_num=0]
Epoch 65:  84%|████████▎ | 81/97 [00:12<00:02,  6.54it/s, loss=2.21, v_num=0]
Epoch 65:  84%|████████▎ | 81/97 [00:12<00:02,  6.51it/s, loss=2.21, v_num=0]
Epoch 65:  85%|████████▍ | 82/97 [00:12<00:02,  6.54it/s, loss=2.21, v_num=0]
Epoch 65:  85%|████████▍ | 82/97 [00:12<00:02,  6.51it/s, loss=2.21, v_num=0]
Epoch 65:  86%|████████▌ | 83/97 [00:12<00:02,  6.55it/s, loss=2.21, v_num=0]
Epoch 65:  86%|████████▌ | 83/97 [00:12<00:02,  6.52it/s, loss=2.22, v_num=0]
Epoch 65:  87%|████████▋ | 84/97 [00:12<00:01,  6.56it/s, loss=2.22, v_num=0]
Epoch 65:  87%|████████▋ | 84/97 [00:12<00:01,  6.53it/s, loss=2.21, v_num=0]
Epoch 65:  88%|████████▊ | 85/97 [00:12<00:01,  6.57it/s, loss=2.21, v_num=0]
Epoch 65:  88%|████████▊ | 85/97 [00:13<00:01,  6.54it/s, loss=2.2, v_num=0]
Epoch 65:  89%|████████▊ | 86/97 [00:13<00:01,  6.57it/s, loss=2.2, v_num=0]
Epoch 65:  89%|████████▊ | 86/97 [00:13<00:01,  6.55it/s, loss=2.21, v_num=0]
Epoch 65:  90%|████████▉ | 87/97 [00:13<00:01,  6.58it/s, loss=2.21, v_num=0]
Epoch 65:  90%|████████▉ | 87/97 [00:13<00:01,  6.55it/s, loss=2.21, v_num=0]
Epoch 65:  91%|█████████ | 88/97 [00:13<00:01,  6.59it/s, loss=2.21, v_num=0]
Epoch 65:  91%|█████████ | 88/97 [00:13<00:01,  6.56it/s, loss=2.21, v_num=0]
Epoch 65:  92%|█████████▏| 89/97 [00:13<00:01,  6.60it/s, loss=2.21, v_num=0]
Epoch 65:  92%|█████████▏| 89/97 [00:13<00:01,  6.57it/s, loss=2.21, v_num=0]
Epoch 65:  93%|█████████▎| 90/97 [00:13<00:01,  6.60it/s, loss=2.21, v_num=0]
Epoch 65:  93%|█████████▎| 90/97 [00:13<00:01,  6.58it/s, loss=2.21, v_num=0]
Epoch 65:  94%|█████████▍| 91/97 [00:13<00:00,  6.61it/s, loss=2.21, v_num=0]
Epoch 65:  94%|█████████▍| 91/97 [00:13<00:00,  6.58it/s, loss=2.21, v_num=0]
Epoch 65:  95%|█████████▍| 92/97 [00:13<00:00,  6.62it/s, loss=2.21, v_num=0]
Epoch 65:  95%|█████████▍| 92/97 [00:13<00:00,  6.59it/s, loss=2.22, v_num=0]
Epoch 65:  96%|█████████▌| 93/97 [00:14<00:00,  6.62it/s, loss=2.22, v_num=0]
Epoch 65:  96%|█████████▌| 93/97 [00:14<00:00,  6.60it/s, loss=2.21, v_num=0]
Epoch 65:  97%|█████████▋| 94/97 [00:14<00:00,  6.63it/s, loss=2.21, v_num=0]
Epoch 65:  97%|█████████▋| 94/97 [00:14<00:00,  6.60it/s, loss=2.22, v_num=0]
Epoch 65:  98%|█████████▊| 95/97 [00:14<00:00,  6.63it/s, loss=2.22, v_num=0]
Epoch 65:  98%|█████████▊| 95/97 [00:14<00:00,  6.61it/s, loss=2.23, v_num=0]
Epoch 65:  99%|█████████▉| 96/97 [00:14<00:00,  6.64it/s, loss=2.23, v_num=0]
Epoch 65:  99%|█████████▉| 96/97 [00:14<00:00,  6.61it/s, loss=2.22, v_num=0]
Epoch 65: 100%|██████████| 97/97 [00:14<00:00,  6.64it/s, loss=2.22, v_num=0]
Epoch 65: 100%|██████████| 97/97 [00:14<00:00,  6.62it/s, loss=2.23, v_num=0]
Epoch 65: 100%|██████████| 97/97 [00:14<00:00,  6.62it/s, loss=2.23, v_num=0]
Epoch 65:   0%|          | 0/97 [00:00<?, ?it/s, loss=2.23, v_num=0]
Epoch 66:   0%|          | 0/97 [00:00<?, ?it/s, loss=2.23, v_num=0]
Epoch 66:   1%|          | 1/97 [00:01<02:12,  1.38s/it, loss=2.23, v_num=0]
Epoch 66:   1%|          | 1/97 [00:01<02:17,  1.43s/it, loss=2.22, v_num=0]
Epoch 66:   2%|▏         | 2/97 [00:01<01:11,  1.32it/s, loss=2.22, v_num=0]
Epoch 66:   2%|▏         | 2/97 [00:01<01:14,  1.27it/s, loss=2.22, v_num=0]
Epoch 66:   3%|▎         | 3/97 [00:01<00:51,  1.82it/s, loss=2.22, v_num=0]
Epoch 66:   3%|▎         | 3/97 [00:01<00:53,  1.76it/s, loss=2.22, v_num=0]
Epoch 66:   4%|▍         | 4/97 [00:01<00:41,  2.24it/s, loss=2.22, v_num=0]
Epoch 66:   4%|▍         | 4/97 [00:01<00:42,  2.17it/s, loss=2.22, v_num=0]
Epoch 66:   5%|▌         | 5/97 [00:01<00:35,  2.59it/s, loss=2.22, v_num=0]
Epoch 66:   5%|▌         | 5/97 [00:01<00:36,  2.52it/s, loss=2.22, v_num=0]
Epoch 66:   6%|▌         | 6/97 [00:02<00:31,  2.91it/s, loss=2.22, v_num=0]
Epoch 66:   6%|▌         | 6/97 [00:02<00:32,  2.83it/s, loss=2.21, v_num=0]
Epoch 66:   7%|▋         | 7/97 [00:02<00:28,  3.18it/s, loss=2.21, v_num=0]
Epoch 66:   7%|▋         | 7/97 [00:02<00:28,  3.10it/s, loss=2.22, v_num=0]
Epoch 66:   8%|▊         | 8/97 [00:02<00:25,  3.43it/s, loss=2.22, v_num=0]
Epoch 66:   8%|▊         | 8/97 [00:02<00:26,  3.35it/s, loss=2.22, v_num=0]
Epoch 66:   9%|▉         | 9/97 [00:02<00:24,  3.63it/s, loss=2.22, v_num=0]
Epoch 66:   9%|▉         | 9/97 [00:02<00:24,  3.55it/s, loss=2.22, v_num=0]
Epoch 66:  10%|█         | 10/97 [00:02<00:22,  3.83it/s, loss=2.22, v_num=0]
Epoch 66:  10%|█         | 10/97 [00:02<00:23,  3.75it/s, loss=2.22, v_num=0]
Epoch 66:  11%|█▏        | 11/97 [00:02<00:21,  4.01it/s, loss=2.22, v_num=0]
Epoch 66:  11%|█▏        | 11/97 [00:02<00:21,  3.92it/s, loss=2.22, v_num=0]
Epoch 66:  12%|█▏        | 12/97 [00:02<00:20,  4.16it/s, loss=2.22, v_num=0]
Epoch 66:  12%|█▏        | 12/97 [00:02<00:20,  4.08it/s, loss=2.21, v_num=0]
Epoch 66:  13%|█▎        | 13/97 [00:03<00:19,  4.30it/s, loss=2.21, v_num=0]
Epoch 66:  13%|█▎        | 13/97 [00:03<00:19,  4.22it/s, loss=2.22, v_num=0]
Epoch 66:  14%|█▍        | 14/97 [00:03<00:18,  4.44it/s, loss=2.22, v_num=0]
Epoch 66:  14%|█▍        | 14/97 [00:03<00:19,  4.36it/s, loss=2.22, v_num=0]
Epoch 66:  15%|█▌        | 15/97 [00:03<00:17,  4.56it/s, loss=2.22, v_num=0]
Epoch 66:  15%|█▌        | 15/97 [00:03<00:18,  4.48it/s, loss=2.22, v_num=0]
Epoch 66:  16%|█▋        | 16/97 [00:03<00:17,  4.66it/s, loss=2.22, v_num=0]
Epoch 66:  16%|█▋        | 16/97 [00:03<00:17,  4.59it/s, loss=2.22, v_num=0]
Epoch 66:  18%|█▊        | 17/97 [00:03<00:16,  4.76it/s, loss=2.22, v_num=0]
Epoch 66:  18%|█▊        | 17/97 [00:03<00:17,  4.69it/s, loss=2.22, v_num=0]
Epoch 66:  19%|█▊        | 18/97 [00:03<00:16,  4.85it/s, loss=2.22, v_num=0]
Epoch 66:  19%|█▊        | 18/97 [00:03<00:16,  4.78it/s, loss=2.22, v_num=0]
Epoch 66:  20%|█▉        | 19/97 [00:03<00:15,  4.94it/s, loss=2.22, v_num=0]
Epoch 66:  20%|█▉        | 19/97 [00:03<00:16,  4.87it/s, loss=2.22, v_num=0]
Epoch 66:  21%|██        | 20/97 [00:03<00:15,  5.02it/s, loss=2.22, v_num=0]
Epoch 66:  21%|██        | 20/97 [00:04<00:15,  4.95it/s, loss=2.22, v_num=0]
Epoch 66:  22%|██▏       | 21/97 [00:04<00:14,  5.10it/s, loss=2.22, v_num=0]
Epoch 66:  22%|██▏       | 21/97 [00:04<00:15,  5.03it/s, loss=2.22, v_num=0]
Epoch 66:  23%|██▎       | 22/97 [00:04<00:14,  5.17it/s, loss=2.22, v_num=0]
Epoch 66:  23%|██▎       | 22/97 [00:04<00:14,  5.10it/s, loss=2.23, v_num=0]
Epoch 66:  24%|██▎       | 23/97 [00:04<00:14,  5.23it/s, loss=2.23, v_num=0]
Epoch 66:  24%|██▎       | 23/97 [00:04<00:14,  5.17it/s, loss=2.22, v_num=0]
Epoch 66:  25%|██▍       | 24/97 [00:04<00:13,  5.30it/s, loss=2.22, v_num=0]
Epoch 66:  25%|██▍       | 24/97 [00:04<00:13,  5.23it/s, loss=2.22, v_num=0]
Epoch 66:  26%|██▌       | 25/97 [00:04<00:13,  5.36it/s, loss=2.22, v_num=0]
Epoch 66:  26%|██▌       | 25/97 [00:04<00:13,  5.29it/s, loss=2.22, v_num=0]
Epoch 66:  27%|██▋       | 26/97 [00:04<00:13,  5.41it/s, loss=2.22, v_num=0]
Epoch 66:  27%|██▋       | 26/97 [00:04<00:13,  5.35it/s, loss=2.22, v_num=0]
Epoch 66:  28%|██▊       | 27/97 [00:04<00:12,  5.47it/s, loss=2.22, v_num=0]
Epoch 66:  28%|██▊       | 27/97 [00:04<00:12,  5.40it/s, loss=2.21, v_num=0]
Epoch 66:  29%|██▉       | 28/97 [00:05<00:12,  5.51it/s, loss=2.21, v_num=0]
Epoch 66:  29%|██▉       | 28/97 [00:05<00:12,  5.45it/s, loss=2.21, v_num=0]
Epoch 66:  30%|██▉       | 29/97 [00:05<00:12,  5.56it/s, loss=2.21, v_num=0]
Epoch 66:  30%|██▉       | 29/97 [00:05<00:12,  5.50it/s, loss=2.21, v_num=0]
Epoch 66:  31%|███       | 30/97 [00:05<00:11,  5.60it/s, loss=2.21, v_num=0]
Epoch 66:  31%|███       | 30/97 [00:05<00:12,  5.55it/s, loss=2.2, v_num=0]
Epoch 66:  32%|███▏      | 31/97 [00:05<00:11,  5.65it/s, loss=2.2, v_num=0]
Epoch 66:  32%|███▏      | 31/97 [00:05<00:11,  5.59it/s, loss=2.21, v_num=0]
Epoch 66:  33%|███▎      | 32/97 [00:05<00:11,  5.69it/s, loss=2.21, v_num=0]
Epoch 66:  33%|███▎      | 32/97 [00:05<00:11,  5.63it/s, loss=2.21, v_num=0]
Epoch 66:  34%|███▍      | 33/97 [00:05<00:11,  5.72it/s, loss=2.21, v_num=0]
Epoch 66:  34%|███▍      | 33/97 [00:05<00:11,  5.67it/s, loss=2.21, v_num=0]
Epoch 66:  35%|███▌      | 34/97 [00:05<00:10,  5.76it/s, loss=2.21, v_num=0]
Epoch 66:  35%|███▌      | 34/97 [00:05<00:11,  5.70it/s, loss=2.21, v_num=0]
Epoch 66:  36%|███▌      | 35/97 [00:06<00:10,  5.79it/s, loss=2.21, v_num=0]
Epoch 66:  36%|███▌      | 35/97 [00:06<00:10,  5.74it/s, loss=2.21, v_num=0]
Epoch 66:  37%|███▋      | 36/97 [00:06<00:10,  5.83it/s, loss=2.21, v_num=0]
Epoch 66:  37%|███▋      | 36/97 [00:06<00:10,  5.77it/s, loss=2.2, v_num=0]
Epoch 66:  38%|███▊      | 37/97 [00:06<00:10,  5.86it/s, loss=2.2, v_num=0]
Epoch 66:  38%|███▊      | 37/97 [00:06<00:10,  5.81it/s, loss=2.2, v_num=0]
Epoch 66:  39%|███▉      | 38/97 [00:06<00:10,  5.89it/s, loss=2.2, v_num=0]
Epoch 66:  39%|███▉      | 38/97 [00:06<00:10,  5.84it/s, loss=2.21, v_num=0]
Epoch 66:  40%|████      | 39/97 [00:06<00:09,  5.92it/s, loss=2.21, v_num=0]
Epoch 66:  40%|████      | 39/97 [00:06<00:09,  5.87it/s, loss=2.21, v_num=0]
Epoch 66:  41%|████      | 40/97 [00:06<00:09,  5.95it/s, loss=2.21, v_num=0]
Epoch 66:  41%|████      | 40/97 [00:06<00:09,  5.90it/s, loss=2.2, v_num=0]
Epoch 66:  42%|████▏     | 41/97 [00:06<00:09,  5.97it/s, loss=2.2, v_num=0]
Epoch 66:  42%|████▏     | 41/97 [00:06<00:09,  5.92it/s, loss=2.2, v_num=0]
Epoch 66:  43%|████▎     | 42/97 [00:06<00:09,  6.00it/s, loss=2.2, v_num=0]
Epoch 66:  43%|████▎     | 42/97 [00:07<00:09,  5.95it/s, loss=2.19, v_num=0]
Epoch 66:  44%|████▍     | 43/97 [00:07<00:08,  6.03it/s, loss=2.19, v_num=0]
Epoch 66:  44%|████▍     | 43/97 [00:07<00:09,  5.98it/s, loss=2.2, v_num=0]
Epoch 66:  45%|████▌     | 44/97 [00:07<00:08,  6.05it/s, loss=2.2, v_num=0]
Epoch 66:  45%|████▌     | 44/97 [00:07<00:08,  6.00it/s, loss=2.21, v_num=0]
Epoch 66:  46%|████▋     | 45/97 [00:07<00:08,  6.07it/s, loss=2.21, v_num=0]
Epoch 66:  46%|████▋     | 45/97 [00:07<00:08,  6.02it/s, loss=2.21, v_num=0]
Epoch 66:  47%|████▋     | 46/97 [00:07<00:08,  6.09it/s, loss=2.21, v_num=0]
Epoch 66:  47%|████▋     | 46/97 [00:07<00:08,  6.05it/s, loss=2.21, v_num=0]
Epoch 66:  48%|████▊     | 47/97 [00:07<00:08,  6.11it/s, loss=2.21, v_num=0]
Epoch 66:  48%|████▊     | 47/97 [00:07<00:08,  6.07it/s, loss=2.22, v_num=0]
Epoch 66:  49%|████▉     | 48/97 [00:07<00:07,  6.13it/s, loss=2.22, v_num=0]
Epoch 66:  49%|████▉     | 48/97 [00:07<00:08,  6.09it/s, loss=2.22, v_num=0]
Epoch 66:  51%|█████     | 49/97 [00:07<00:07,  6.15it/s, loss=2.22, v_num=0]
Epoch 66:  51%|█████     | 49/97 [00:08<00:07,  6.11it/s, loss=2.21, v_num=0]
Epoch 66:  52%|█████▏    | 50/97 [00:08<00:07,  6.17it/s, loss=2.21, v_num=0]
Epoch 66:  52%|█████▏    | 50/97 [00:08<00:07,  6.13it/s, loss=2.21, v_num=0]
Epoch 66:  53%|█████▎    | 51/97 [00:08<00:07,  6.19it/s, loss=2.21, v_num=0]
Epoch 66:  53%|█████▎    | 51/97 [00:08<00:07,  6.15it/s, loss=2.21, v_num=0]
Epoch 66:  54%|█████▎    | 52/97 [00:08<00:07,  6.21it/s, loss=2.21, v_num=0]
Epoch 66:  54%|█████▎    | 52/97 [00:08<00:07,  6.17it/s, loss=2.22, v_num=0]
Epoch 66:  55%|█████▍    | 53/97 [00:08<00:07,  6.22it/s, loss=2.22, v_num=0]
Epoch 66:  55%|█████▍    | 53/97 [00:08<00:07,  6.18it/s, loss=2.22, v_num=0]
Epoch 66:  56%|█████▌    | 54/97 [00:08<00:06,  6.24it/s, loss=2.22, v_num=0]
Epoch 66:  56%|█████▌    | 54/97 [00:08<00:06,  6.20it/s, loss=2.21, v_num=0]
Epoch 66:  57%|█████▋    | 55/97 [00:08<00:06,  6.25it/s, loss=2.21, v_num=0]
Epoch 66:  57%|█████▋    | 55/97 [00:08<00:06,  6.21it/s, loss=2.22, v_num=0]
Epoch 66:  58%|█████▊    | 56/97 [00:08<00:06,  6.27it/s, loss=2.22, v_num=0]
Epoch 66:  58%|█████▊    | 56/97 [00:08<00:06,  6.23it/s, loss=2.22, v_num=0]
Epoch 66:  59%|█████▉    | 57/97 [00:09<00:06,  6.28it/s, loss=2.22, v_num=0]
Epoch 66:  59%|█████▉    | 57/97 [00:09<00:06,  6.24it/s, loss=2.21, v_num=0]
Epoch 66:  60%|█████▉    | 58/97 [00:09<00:06,  6.30it/s, loss=2.21, v_num=0]
Epoch 66:  60%|█████▉    | 58/97 [00:09<00:06,  6.26it/s, loss=2.21, v_num=0]
Epoch 66:  61%|██████    | 59/97 [00:09<00:06,  6.31it/s, loss=2.21, v_num=0]
Epoch 66:  61%|██████    | 59/97 [00:09<00:06,  6.27it/s, loss=2.2, v_num=0]
Epoch 66:  62%|██████▏   | 60/97 [00:09<00:05,  6.32it/s, loss=2.2, v_num=0]
Epoch 66:  62%|██████▏   | 60/97 [00:09<00:05,  6.29it/s, loss=2.2, v_num=0]
Epoch 66:  63%|██████▎   | 61/97 [00:09<00:05,  6.34it/s, loss=2.2, v_num=0]
Epoch 66:  63%|██████▎   | 61/97 [00:09<00:05,  6.30it/s, loss=2.2, v_num=0]
Epoch 66:  64%|██████▍   | 62/97 [00:09<00:05,  6.35it/s, loss=2.2, v_num=0]
Epoch 66:  64%|██████▍   | 62/97 [00:09<00:05,  6.32it/s, loss=2.21, v_num=0]
Epoch 66:  65%|██████▍   | 63/97 [00:09<00:05,  6.36it/s, loss=2.21, v_num=0]
Epoch 66:  65%|██████▍   | 63/97 [00:09<00:05,  6.33it/s, loss=2.2, v_num=0]
Epoch 66:  66%|██████▌   | 64/97 [00:10<00:05,  6.37it/s, loss=2.2, v_num=0]
Epoch 66:  66%|██████▌   | 64/97 [00:10<00:05,  6.34it/s, loss=2.19, v_num=0]
Epoch 66:  67%|██████▋   | 65/97 [00:10<00:05,  6.39it/s, loss=2.19, v_num=0]
Epoch 66:  67%|██████▋   | 65/97 [00:10<00:05,  6.35it/s, loss=2.19, v_num=0]
Epoch 66:  68%|██████▊   | 66/97 [00:10<00:04,  6.39it/s, loss=2.19, v_num=0]
Epoch 66:  68%|██████▊   | 66/97 [00:10<00:04,  6.36it/s, loss=2.19, v_num=0]
Epoch 66:  69%|██████▉   | 67/97 [00:10<00:04,  6.41it/s, loss=2.19, v_num=0]
Epoch 66:  69%|██████▉   | 67/97 [00:10<00:04,  6.37it/s, loss=2.18, v_num=0]
Epoch 66:  70%|███████   | 68/97 [00:10<00:04,  6.42it/s, loss=2.18, v_num=0]
Epoch 66:  70%|███████   | 68/97 [00:10<00:04,  6.38it/s, loss=2.19, v_num=0]
Epoch 66:  71%|███████   | 69/97 [00:10<00:04,  6.43it/s, loss=2.19, v_num=0]
Epoch 66:  71%|███████   | 69/97 [00:10<00:04,  6.40it/s, loss=2.2, v_num=0]
Epoch 66:  72%|███████▏  | 70/97 [00:10<00:04,  6.44it/s, loss=2.2, v_num=0]
Epoch 66:  72%|███████▏  | 70/97 [00:10<00:04,  6.41it/s, loss=2.2, v_num=0]
Epoch 66:  73%|███████▎  | 71/97 [00:11<00:04,  6.45it/s, loss=2.2, v_num=0]
Epoch 66:  73%|███████▎  | 71/97 [00:11<00:04,  6.42it/s, loss=2.2, v_num=0]
Epoch 66:  74%|███████▍  | 72/97 [00:11<00:03,  6.46it/s, loss=2.2, v_num=0]
Epoch 66:  74%|███████▍  | 72/97 [00:11<00:03,  6.43it/s, loss=2.2, v_num=0]
Epoch 66:  75%|███████▌  | 73/97 [00:11<00:03,  6.47it/s, loss=2.2, v_num=0]
Epoch 66:  75%|███████▌  | 73/97 [00:11<00:03,  6.44it/s, loss=2.2, v_num=0]
Epoch 66:  76%|███████▋  | 74/97 [00:11<00:03,  6.48it/s, loss=2.2, v_num=0]
Epoch 66:  76%|███████▋  | 74/97 [00:11<00:03,  6.45it/s, loss=2.2, v_num=0]
Epoch 66:  77%|███████▋  | 75/97 [00:11<00:03,  6.49it/s, loss=2.2, v_num=0]
Epoch 66:  77%|███████▋  | 75/97 [00:11<00:03,  6.46it/s, loss=2.19, v_num=0]
Epoch 66:  78%|███████▊  | 76/97 [00:11<00:03,  6.49it/s, loss=2.19, v_num=0]
Epoch 66:  78%|███████▊  | 76/97 [00:11<00:03,  6.46it/s, loss=2.19, v_num=0]
Epoch 66:  79%|███████▉  | 77/97 [00:11<00:03,  6.50it/s, loss=2.19, v_num=0]
Epoch 66:  79%|███████▉  | 77/97 [00:11<00:03,  6.47it/s, loss=2.19, v_num=0]
Epoch 66:  80%|████████  | 78/97 [00:11<00:02,  6.51it/s, loss=2.19, v_num=0]
Epoch 66:  80%|████████  | 78/97 [00:12<00:02,  6.48it/s, loss=2.19, v_num=0]
Epoch 66:  81%|████████▏ | 79/97 [00:12<00:02,  6.52it/s, loss=2.19, v_num=0]
Epoch 66:  81%|████████▏ | 79/97 [00:12<00:02,  6.49it/s, loss=2.2, v_num=0]
Epoch 66:  82%|████████▏ | 80/97 [00:12<00:02,  6.53it/s, loss=2.2, v_num=0]
Epoch 66:  82%|████████▏ | 80/97 [00:12<00:02,  6.50it/s, loss=2.2, v_num=0]
Epoch 66:  84%|████████▎ | 81/97 [00:12<00:02,  6.54it/s, loss=2.2, v_num=0]
Epoch 66:  84%|████████▎ | 81/97 [00:12<00:02,  6.51it/s, loss=2.2, v_num=0]
Epoch 66:  85%|████████▍ | 82/97 [00:12<00:02,  6.55it/s, loss=2.2, v_num=0]
Epoch 66:  85%|████████▍ | 82/97 [00:12<00:02,  6.52it/s, loss=2.19, v_num=0]
Epoch 66:  86%|████████▌ | 83/97 [00:12<00:02,  6.55it/s, loss=2.19, v_num=0]
Epoch 66:  86%|████████▌ | 83/97 [00:12<00:02,  6.52it/s, loss=2.2, v_num=0]
Epoch 66:  87%|████████▋ | 84/97 [00:12<00:01,  6.56it/s, loss=2.2, v_num=0]
Epoch 66:  87%|████████▋ | 84/97 [00:12<00:01,  6.53it/s, loss=2.2, v_num=0]
Epoch 66:  88%|████████▊ | 85/97 [00:12<00:01,  6.57it/s, loss=2.2, v_num=0]
Epoch 66:  88%|████████▊ | 85/97 [00:13<00:01,  6.54it/s, loss=2.19, v_num=0]
Epoch 66:  89%|████████▊ | 86/97 [00:13<00:01,  6.57it/s, loss=2.19, v_num=0]
Epoch 66:  89%|████████▊ | 86/97 [00:13<00:01,  6.55it/s, loss=2.19, v_num=0]
Epoch 66:  90%|████████▉ | 87/97 [00:13<00:01,  6.58it/s, loss=2.19, v_num=0]
Epoch 66:  90%|████████▉ | 87/97 [00:13<00:01,  6.55it/s, loss=2.19, v_num=0]
Epoch 66:  91%|█████████ | 88/97 [00:13<00:01,  6.59it/s, loss=2.19, v_num=0]
Epoch 66:  91%|█████████ | 88/97 [00:13<00:01,  6.56it/s, loss=2.19, v_num=0]
Epoch 66:  92%|█████████▏| 89/97 [00:13<00:01,  6.60it/s, loss=2.19, v_num=0]
Epoch 66:  92%|█████████▏| 89/97 [00:13<00:01,  6.57it/s, loss=2.19, v_num=0]
Epoch 66:  93%|█████████▎| 90/97 [00:13<00:01,  6.60it/s, loss=2.19, v_num=0]
Epoch 66:  93%|█████████▎| 90/97 [00:13<00:01,  6.58it/s, loss=2.19, v_num=0]
Epoch 66:  94%|█████████▍| 91/97 [00:13<00:00,  6.61it/s, loss=2.19, v_num=0]
Epoch 66:  94%|█████████▍| 91/97 [00:13<00:00,  6.58it/s, loss=2.19, v_num=0]
Epoch 66:  95%|█████████▍| 92/97 [00:13<00:00,  6.62it/s, loss=2.19, v_num=0]
Epoch 66:  95%|█████████▍| 92/97 [00:13<00:00,  6.59it/s, loss=2.19, v_num=0]
Epoch 66:  96%|█████████▌| 93/97 [00:14<00:00,  6.62it/s, loss=2.19, v_num=0]
Epoch 66:  96%|█████████▌| 93/97 [00:14<00:00,  6.60it/s, loss=2.19, v_num=0]
Epoch 66:  97%|█████████▋| 94/97 [00:14<00:00,  6.63it/s, loss=2.19, v_num=0]
Epoch 66:  97%|█████████▋| 94/97 [00:14<00:00,  6.60it/s, loss=2.19, v_num=0]
Epoch 66:  98%|█████████▊| 95/97 [00:14<00:00,  6.64it/s, loss=2.19, v_num=0]
Epoch 66:  98%|█████████▊| 95/97 [00:14<00:00,  6.61it/s, loss=2.2, v_num=0]
Epoch 66:  99%|█████████▉| 96/97 [00:14<00:00,  6.64it/s, loss=2.2, v_num=0]
Epoch 66:  99%|█████████▉| 96/97 [00:14<00:00,  6.62it/s, loss=2.2, v_num=0]
Epoch 66: 100%|██████████| 97/97 [00:14<00:00,  6.65it/s, loss=2.2, v_num=0]
Epoch 66: 100%|██████████| 97/97 [00:14<00:00,  6.62it/s, loss=2.21, v_num=0]
Epoch 66: 100%|██████████| 97/97 [00:14<00:00,  6.62it/s, loss=2.21, v_num=0]
Epoch 66:   0%|          | 0/97 [00:00<?, ?it/s, loss=2.21, v_num=0]
Epoch 67:   0%|          | 0/97 [00:00<?, ?it/s, loss=2.21, v_num=0]
Epoch 67:   1%|          | 1/97 [00:01<02:14,  1.40s/it, loss=2.21, v_num=0]
Epoch 67:   1%|          | 1/97 [00:01<02:20,  1.46s/it, loss=2.21, v_num=0]
Epoch 67:   2%|▏         | 2/97 [00:01<01:13,  1.30it/s, loss=2.21, v_num=0]
Epoch 67:   2%|▏         | 2/97 [00:01<01:15,  1.25it/s, loss=2.2, v_num=0]
Epoch 67:   3%|▎         | 3/97 [00:01<00:52,  1.79it/s, loss=2.2, v_num=0]
Epoch 67:   3%|▎         | 3/97 [00:01<00:54,  1.73it/s, loss=2.21, v_num=0]
Epoch 67:   4%|▍         | 4/97 [00:01<00:42,  2.21it/s, loss=2.21, v_num=0]
Epoch 67:   4%|▍         | 4/97 [00:01<00:43,  2.14it/s, loss=2.21, v_num=0]
Epoch 67:   5%|▌         | 5/97 [00:01<00:35,  2.56it/s, loss=2.21, v_num=0]
Epoch 67:   5%|▌         | 5/97 [00:02<00:36,  2.49it/s, loss=2.22, v_num=0]
Epoch 67:   6%|▌         | 6/97 [00:02<00:31,  2.87it/s, loss=2.22, v_num=0]
Epoch 67:   6%|▌         | 6/97 [00:02<00:32,  2.80it/s, loss=2.22, v_num=0]
Epoch 67:   7%|▋         | 7/97 [00:02<00:28,  3.15it/s, loss=2.22, v_num=0]
Epoch 67:   7%|▋         | 7/97 [00:02<00:29,  3.07it/s, loss=2.22, v_num=0]
Epoch 67:   8%|▊         | 8/97 [00:02<00:26,  3.39it/s, loss=2.22, v_num=0]
Epoch 67:   8%|▊         | 8/97 [00:02<00:26,  3.31it/s, loss=2.22, v_num=0]
Epoch 67:   9%|▉         | 9/97 [00:02<00:24,  3.59it/s, loss=2.22, v_num=0]
Epoch 67:   9%|▉         | 9/97 [00:02<00:25,  3.51it/s, loss=2.23, v_num=0]
Epoch 67:  10%|█         | 10/97 [00:02<00:23,  3.78it/s, loss=2.23, v_num=0]
Epoch 67:  10%|█         | 10/97 [00:02<00:23,  3.70it/s, loss=2.23, v_num=0]
Epoch 67:  11%|█▏        | 11/97 [00:02<00:21,  3.96it/s, loss=2.23, v_num=0]
Epoch 67:  11%|█▏        | 11/97 [00:02<00:22,  3.88it/s, loss=2.23, v_num=0]
Epoch 67:  12%|█▏        | 12/97 [00:02<00:20,  4.11it/s, loss=2.23, v_num=0]
Epoch 67:  12%|█▏        | 12/97 [00:02<00:21,  4.04it/s, loss=2.23, v_num=0]
Epoch 67:  13%|█▎        | 13/97 [00:03<00:19,  4.25it/s, loss=2.23, v_num=0]
Epoch 67:  13%|█▎        | 13/97 [00:03<00:20,  4.18it/s, loss=2.22, v_num=0]
Epoch 67:  14%|█▍        | 14/97 [00:03<00:18,  4.39it/s, loss=2.22, v_num=0]
Epoch 67:  14%|█▍        | 14/97 [00:03<00:19,  4.31it/s, loss=2.22, v_num=0]
Epoch 67:  15%|█▌        | 15/97 [00:03<00:18,  4.51it/s, loss=2.22, v_num=0]
Epoch 67:  15%|█▌        | 15/97 [00:03<00:18,  4.43it/s, loss=2.21, v_num=0]
Epoch 67:  16%|█▋        | 16/97 [00:03<00:17,  4.62it/s, loss=2.21, v_num=0]
Epoch 67:  16%|█▋        | 16/97 [00:03<00:17,  4.55it/s, loss=2.21, v_num=0]
Epoch 67:  18%|█▊        | 17/97 [00:03<00:16,  4.72it/s, loss=2.21, v_num=0]
Epoch 67:  18%|█▊        | 17/97 [00:03<00:17,  4.65it/s, loss=2.22, v_num=0]
Epoch 67:  19%|█▊        | 18/97 [00:03<00:16,  4.81it/s, loss=2.22, v_num=0]
Epoch 67:  19%|█▊        | 18/97 [00:03<00:16,  4.74it/s, loss=2.21, v_num=0]
Epoch 67:  20%|█▉        | 19/97 [00:03<00:15,  4.90it/s, loss=2.21, v_num=0]
Epoch 67:  20%|█▉        | 19/97 [00:03<00:16,  4.83it/s, loss=2.21, v_num=0]
Epoch 67:  21%|██        | 20/97 [00:04<00:15,  4.98it/s, loss=2.21, v_num=0]
Epoch 67:  21%|██        | 20/97 [00:04<00:15,  4.92it/s, loss=2.2, v_num=0]
Epoch 67:  22%|██▏       | 21/97 [00:04<00:15,  5.06it/s, loss=2.2, v_num=0]
Epoch 67:  22%|██▏       | 21/97 [00:04<00:15,  4.99it/s, loss=2.2, v_num=0]
Epoch 67:  23%|██▎       | 22/97 [00:04<00:14,  5.13it/s, loss=2.2, v_num=0]
Epoch 67:  23%|██▎       | 22/97 [00:04<00:14,  5.07it/s, loss=2.2, v_num=0]
Epoch 67:  24%|██▎       | 23/97 [00:04<00:14,  5.20it/s, loss=2.2, v_num=0]
Epoch 67:  24%|██▎       | 23/97 [00:04<00:14,  5.13it/s, loss=2.2, v_num=0]
Epoch 67:  25%|██▍       | 24/97 [00:04<00:13,  5.26it/s, loss=2.2, v_num=0]
Epoch 67:  25%|██▍       | 24/97 [00:04<00:14,  5.20it/s, loss=2.19, v_num=0]
Epoch 67:  26%|██▌       | 25/97 [00:04<00:13,  5.32it/s, loss=2.19, v_num=0]
Epoch 67:  26%|██▌       | 25/97 [00:04<00:13,  5.26it/s, loss=2.19, v_num=0]
Epoch 67:  27%|██▋       | 26/97 [00:04<00:13,  5.37it/s, loss=2.19, v_num=0]
Epoch 67:  27%|██▋       | 26/97 [00:04<00:13,  5.31it/s, loss=2.19, v_num=0]
Epoch 67:  28%|██▊       | 27/97 [00:04<00:12,  5.43it/s, loss=2.19, v_num=0]
Epoch 67:  28%|██▊       | 27/97 [00:05<00:13,  5.37it/s, loss=2.19, v_num=0]
Epoch 67:  29%|██▉       | 28/97 [00:05<00:12,  5.48it/s, loss=2.19, v_num=0]
Epoch 67:  29%|██▉       | 28/97 [00:05<00:12,  5.42it/s, loss=2.19, v_num=0]
Epoch 67:  30%|██▉       | 29/97 [00:05<00:12,  5.53it/s, loss=2.19, v_num=0]
Epoch 67:  30%|██▉       | 29/97 [00:05<00:12,  5.47it/s, loss=2.18, v_num=0]
Epoch 67:  31%|███       | 30/97 [00:05<00:12,  5.57it/s, loss=2.18, v_num=0]
Epoch 67:  31%|███       | 30/97 [00:05<00:12,  5.51it/s, loss=2.18, v_num=0]
Epoch 67:  32%|███▏      | 31/97 [00:05<00:11,  5.61it/s, loss=2.18, v_num=0]
Epoch 67:  32%|███▏      | 31/97 [00:05<00:11,  5.56it/s, loss=2.18, v_num=0]
Epoch 67:  33%|███▎      | 32/97 [00:05<00:11,  5.65it/s, loss=2.18, v_num=0]
Epoch 67:  33%|███▎      | 32/97 [00:05<00:11,  5.60it/s, loss=2.17, v_num=0]
Epoch 67:  34%|███▍      | 33/97 [00:05<00:11,  5.70it/s, loss=2.17, v_num=0]
Epoch 67:  34%|███▍      | 33/97 [00:05<00:11,  5.64it/s, loss=2.18, v_num=0]
Epoch 67:  35%|███▌      | 34/97 [00:05<00:10,  5.74it/s, loss=2.18, v_num=0]
Epoch 67:  35%|███▌      | 34/97 [00:05<00:11,  5.68it/s, loss=2.18, v_num=0]
Epoch 67:  36%|███▌      | 35/97 [00:06<00:10,  5.77it/s, loss=2.18, v_num=0]
Epoch 67:  36%|███▌      | 35/97 [00:06<00:10,  5.72it/s, loss=2.18, v_num=0]
Epoch 67:  37%|███▋      | 36/97 [00:06<00:10,  5.80it/s, loss=2.18, v_num=0]
Epoch 67:  37%|███▋      | 36/97 [00:06<00:10,  5.75it/s, loss=2.18, v_num=0]
Epoch 67:  38%|███▊      | 37/97 [00:06<00:10,  5.83it/s, loss=2.18, v_num=0]
Epoch 67:  38%|███▊      | 37/97 [00:06<00:10,  5.78it/s, loss=2.18, v_num=0]
Epoch 67:  39%|███▉      | 38/97 [00:06<00:10,  5.87it/s, loss=2.18, v_num=0]
Epoch 67:  39%|███▉      | 38/97 [00:06<00:10,  5.82it/s, loss=2.19, v_num=0]
Epoch 67:  40%|████      | 39/97 [00:06<00:09,  5.89it/s, loss=2.19, v_num=0]
Epoch 67:  40%|████      | 39/97 [00:06<00:09,  5.85it/s, loss=2.18, v_num=0]
Epoch 67:  41%|████      | 40/97 [00:06<00:09,  5.92it/s, loss=2.18, v_num=0]
Epoch 67:  41%|████      | 40/97 [00:06<00:09,  5.88it/s, loss=2.19, v_num=0]
Epoch 67:  42%|████▏     | 41/97 [00:06<00:09,  5.95it/s, loss=2.19, v_num=0]
Epoch 67:  42%|████▏     | 41/97 [00:06<00:09,  5.90it/s, loss=2.19, v_num=0]
Epoch 67:  43%|████▎     | 42/97 [00:07<00:09,  5.98it/s, loss=2.19, v_num=0]
Epoch 67:  43%|████▎     | 42/97 [00:07<00:09,  5.93it/s, loss=2.19, v_num=0]
Epoch 67:  44%|████▍     | 43/97 [00:07<00:08,  6.00it/s, loss=2.19, v_num=0]
Epoch 67:  44%|████▍     | 43/97 [00:07<00:09,  5.96it/s, loss=2.19, v_num=0]
Epoch 67:  45%|████▌     | 44/97 [00:07<00:08,  6.03it/s, loss=2.19, v_num=0]
Epoch 67:  45%|████▌     | 44/97 [00:07<00:08,  5.98it/s, loss=2.19, v_num=0]
Epoch 67:  46%|████▋     | 45/97 [00:07<00:08,  6.05it/s, loss=2.19, v_num=0]
Epoch 67:  46%|████▋     | 45/97 [00:07<00:08,  6.01it/s, loss=2.19, v_num=0]
Epoch 67:  47%|████▋     | 46/97 [00:07<00:08,  6.07it/s, loss=2.19, v_num=0]
Epoch 67:  47%|████▋     | 46/97 [00:07<00:08,  6.03it/s, loss=2.19, v_num=0]
Epoch 67:  48%|████▊     | 47/97 [00:07<00:08,  6.09it/s, loss=2.19, v_num=0]
Epoch 67:  48%|████▊     | 47/97 [00:07<00:08,  6.05it/s, loss=2.18, v_num=0]
Epoch 67:  49%|████▉     | 48/97 [00:07<00:08,  6.12it/s, loss=2.18, v_num=0]
Epoch 67:  49%|████▉     | 48/97 [00:07<00:08,  6.07it/s, loss=2.19, v_num=0]
Epoch 67:  51%|█████     | 49/97 [00:07<00:07,  6.14it/s, loss=2.19, v_num=0]
Epoch 67:  51%|█████     | 49/97 [00:08<00:07,  6.09it/s, loss=2.19, v_num=0]
Epoch 67:  52%|█████▏    | 50/97 [00:08<00:07,  6.16it/s, loss=2.19, v_num=0]
Epoch 67:  52%|█████▏    | 50/97 [00:08<00:07,  6.11it/s, loss=2.19, v_num=0]
Epoch 67:  53%|█████▎    | 51/97 [00:08<00:07,  6.17it/s, loss=2.19, v_num=0]
Epoch 67:  53%|█████▎    | 51/97 [00:08<00:07,  6.13it/s, loss=2.2, v_num=0]
Epoch 67:  54%|█████▎    | 52/97 [00:08<00:07,  6.19it/s, loss=2.2, v_num=0]
Epoch 67:  54%|█████▎    | 52/97 [00:08<00:07,  6.15it/s, loss=2.21, v_num=0]
Epoch 67:  55%|█████▍    | 53/97 [00:08<00:07,  6.21it/s, loss=2.21, v_num=0]
Epoch 67:  55%|█████▍    | 53/97 [00:08<00:07,  6.17it/s, loss=2.21, v_num=0]
Epoch 67:  56%|█████▌    | 54/97 [00:08<00:06,  6.23it/s, loss=2.21, v_num=0]
Epoch 67:  56%|█████▌    | 54/97 [00:08<00:06,  6.19it/s, loss=2.21, v_num=0]
Epoch 67:  57%|█████▋    | 55/97 [00:08<00:06,  6.25it/s, loss=2.21, v_num=0]
Epoch 67:  57%|█████▋    | 55/97 [00:08<00:06,  6.21it/s, loss=2.22, v_num=0]
Epoch 67:  58%|█████▊    | 56/97 [00:08<00:06,  6.26it/s, loss=2.22, v_num=0]
Epoch 67:  58%|█████▊    | 56/97 [00:08<00:06,  6.22it/s, loss=2.21, v_num=0]
Epoch 67:  59%|█████▉    | 57/97 [00:09<00:06,  6.28it/s, loss=2.21, v_num=0]
Epoch 67:  59%|█████▉    | 57/97 [00:09<00:06,  6.24it/s, loss=2.21, v_num=0]
Epoch 67:  60%|█████▉    | 58/97 [00:09<00:06,  6.29it/s, loss=2.21, v_num=0]
Epoch 67:  60%|█████▉    | 58/97 [00:09<00:06,  6.26it/s, loss=2.2, v_num=0]
Epoch 67:  61%|██████    | 59/97 [00:09<00:06,  6.31it/s, loss=2.2, v_num=0]
Epoch 67:  61%|██████    | 59/97 [00:09<00:06,  6.27it/s, loss=2.2, v_num=0]
Epoch 67:  62%|██████▏   | 60/97 [00:09<00:05,  6.32it/s, loss=2.2, v_num=0]
Epoch 67:  62%|██████▏   | 60/97 [00:09<00:05,  6.29it/s, loss=2.21, v_num=0]
Epoch 67:  63%|██████▎   | 61/97 [00:09<00:05,  6.34it/s, loss=2.21, v_num=0]
Epoch 67:  63%|██████▎   | 61/97 [00:09<00:05,  6.30it/s, loss=2.2, v_num=0]
Epoch 67:  64%|██████▍   | 62/97 [00:09<00:05,  6.35it/s, loss=2.2, v_num=0]
Epoch 67:  64%|██████▍   | 62/97 [00:09<00:05,  6.31it/s, loss=2.2, v_num=0]
Epoch 67:  65%|██████▍   | 63/97 [00:09<00:05,  6.36it/s, loss=2.2, v_num=0]
Epoch 67:  65%|██████▍   | 63/97 [00:09<00:05,  6.33it/s, loss=2.21, v_num=0]
Epoch 67:  66%|██████▌   | 64/97 [00:10<00:05,  6.38it/s, loss=2.21, v_num=0]
Epoch 67:  66%|██████▌   | 64/97 [00:10<00:05,  6.34it/s, loss=2.21, v_num=0]
Epoch 67:  67%|██████▋   | 65/97 [00:10<00:05,  6.39it/s, loss=2.21, v_num=0]
Epoch 67:  67%|██████▋   | 65/97 [00:10<00:05,  6.35it/s, loss=2.21, v_num=0]
Epoch 67:  68%|██████▊   | 66/97 [00:10<00:04,  6.40it/s, loss=2.21, v_num=0]
Epoch 67:  68%|██████▊   | 66/97 [00:10<00:04,  6.37it/s, loss=2.21, v_num=0]
Epoch 67:  69%|██████▉   | 67/97 [00:10<00:04,  6.41it/s, loss=2.21, v_num=0]
Epoch 67:  69%|██████▉   | 67/97 [00:10<00:04,  6.38it/s, loss=2.21, v_num=0]
Epoch 67:  70%|███████   | 68/97 [00:10<00:04,  6.42it/s, loss=2.21, v_num=0]
Epoch 67:  70%|███████   | 68/97 [00:10<00:04,  6.39it/s, loss=2.21, v_num=0]
Epoch 67:  71%|███████   | 69/97 [00:10<00:04,  6.44it/s, loss=2.21, v_num=0]
Epoch 67:  71%|███████   | 69/97 [00:10<00:04,  6.40it/s, loss=2.2, v_num=0]
Epoch 67:  72%|███████▏  | 70/97 [00:10<00:04,  6.45it/s, loss=2.2, v_num=0]
Epoch 67:  72%|███████▏  | 70/97 [00:10<00:04,  6.41it/s, loss=2.21, v_num=0]
Epoch 67:  73%|███████▎  | 71/97 [00:10<00:04,  6.46it/s, loss=2.21, v_num=0]
Epoch 67:  73%|███████▎  | 71/97 [00:11<00:04,  6.42it/s, loss=2.21, v_num=0]
Epoch 67:  74%|███████▍  | 72/97 [00:11<00:03,  6.47it/s, loss=2.21, v_num=0]
Epoch 67:  74%|███████▍  | 72/97 [00:11<00:03,  6.43it/s, loss=2.21, v_num=0]
Epoch 67:  75%|███████▌  | 73/97 [00:11<00:03,  6.48it/s, loss=2.21, v_num=0]
Epoch 67:  75%|███████▌  | 73/97 [00:11<00:03,  6.45it/s, loss=2.2, v_num=0]
Epoch 67:  76%|███████▋  | 74/97 [00:11<00:03,  6.48it/s, loss=2.2, v_num=0]
Epoch 67:  76%|███████▋  | 74/97 [00:11<00:03,  6.45it/s, loss=2.2, v_num=0]
Epoch 67:  77%|███████▋  | 75/97 [00:11<00:03,  6.50it/s, loss=2.2, v_num=0]
Epoch 67:  77%|███████▋  | 75/97 [00:11<00:03,  6.46it/s, loss=2.19, v_num=0]
Epoch 67:  78%|███████▊  | 76/97 [00:11<00:03,  6.50it/s, loss=2.19, v_num=0]
Epoch 67:  78%|███████▊  | 76/97 [00:11<00:03,  6.47it/s, loss=2.2, v_num=0]
Epoch 67:  79%|███████▉  | 77/97 [00:11<00:03,  6.51it/s, loss=2.2, v_num=0]
Epoch 67:  79%|███████▉  | 77/97 [00:11<00:03,  6.48it/s, loss=2.2, v_num=0]
Epoch 67:  80%|████████  | 78/97 [00:11<00:02,  6.52it/s, loss=2.2, v_num=0]
Epoch 67:  80%|████████  | 78/97 [00:12<00:02,  6.49it/s, loss=2.19, v_num=0]
Epoch 67:  81%|████████▏ | 79/97 [00:12<00:02,  6.53it/s, loss=2.19, v_num=0]
Epoch 67:  81%|████████▏ | 79/97 [00:12<00:02,  6.50it/s, loss=2.19, v_num=0]
Epoch 67:  82%|████████▏ | 80/97 [00:12<00:02,  6.54it/s, loss=2.19, v_num=0]
Epoch 67:  82%|████████▏ | 80/97 [00:12<00:02,  6.51it/s, loss=2.19, v_num=0]
Epoch 67:  84%|████████▎ | 81/97 [00:12<00:02,  6.55it/s, loss=2.19, v_num=0]
Epoch 67:  84%|████████▎ | 81/97 [00:12<00:02,  6.52it/s, loss=2.19, v_num=0]
Epoch 67:  85%|████████▍ | 82/97 [00:12<00:02,  6.56it/s, loss=2.19, v_num=0]
Epoch 67:  85%|████████▍ | 82/97 [00:12<00:02,  6.52it/s, loss=2.2, v_num=0]
Epoch 67:  86%|████████▌ | 83/97 [00:12<00:02,  6.56it/s, loss=2.2, v_num=0]
Epoch 67:  86%|████████▌ | 83/97 [00:12<00:02,  6.53it/s, loss=2.19, v_num=0]
Epoch 67:  87%|████████▋ | 84/97 [00:12<00:01,  6.57it/s, loss=2.19, v_num=0]
Epoch 67:  87%|████████▋ | 84/97 [00:12<00:01,  6.54it/s, loss=2.19, v_num=0]
Epoch 67:  88%|████████▊ | 85/97 [00:12<00:01,  6.58it/s, loss=2.19, v_num=0]
Epoch 67:  88%|████████▊ | 85/97 [00:12<00:01,  6.55it/s, loss=2.19, v_num=0]
Epoch 67:  89%|████████▊ | 86/97 [00:13<00:01,  6.58it/s, loss=2.19, v_num=0]
Epoch 67:  89%|████████▊ | 86/97 [00:13<00:01,  6.56it/s, loss=2.19, v_num=0]
Epoch 67:  90%|████████▉ | 87/97 [00:13<00:01,  6.59it/s, loss=2.19, v_num=0]
Epoch 67:  90%|████████▉ | 87/97 [00:13<00:01,  6.56it/s, loss=2.19, v_num=0]
Epoch 67:  91%|█████████ | 88/97 [00:13<00:01,  6.60it/s, loss=2.19, v_num=0]
Epoch 67:  91%|█████████ | 88/97 [00:13<00:01,  6.57it/s, loss=2.19, v_num=0]
Epoch 67:  92%|█████████▏| 89/97 [00:13<00:01,  6.61it/s, loss=2.19, v_num=0]
Epoch 67:  92%|█████████▏| 89/97 [00:13<00:01,  6.58it/s, loss=2.19, v_num=0]
Epoch 67:  93%|█████████▎| 90/97 [00:13<00:01,  6.61it/s, loss=2.19, v_num=0]
Epoch 67:  93%|█████████▎| 90/97 [00:13<00:01,  6.59it/s, loss=2.18, v_num=0]
Epoch 67:  94%|█████████▍| 91/97 [00:13<00:00,  6.62it/s, loss=2.18, v_num=0]
Epoch 67:  94%|█████████▍| 91/97 [00:13<00:00,  6.59it/s, loss=2.17, v_num=0]
Epoch 67:  95%|█████████▍| 92/97 [00:13<00:00,  6.63it/s, loss=2.17, v_num=0]
Epoch 67:  95%|█████████▍| 92/97 [00:13<00:00,  6.60it/s, loss=2.16, v_num=0]
Epoch 67:  96%|█████████▌| 93/97 [00:14<00:00,  6.63it/s, loss=2.16, v_num=0]
Epoch 67:  96%|█████████▌| 93/97 [00:14<00:00,  6.61it/s, loss=2.16, v_num=0]
Epoch 67:  97%|█████████▋| 94/97 [00:14<00:00,  6.64it/s, loss=2.16, v_num=0]
Epoch 67:  97%|█████████▋| 94/97 [00:14<00:00,  6.61it/s, loss=2.16, v_num=0]
Epoch 67:  98%|█████████▊| 95/97 [00:14<00:00,  6.65it/s, loss=2.16, v_num=0]
Epoch 67:  98%|█████████▊| 95/97 [00:14<00:00,  6.62it/s, loss=2.16, v_num=0]
Epoch 67:  99%|█████████▉| 96/97 [00:14<00:00,  6.65it/s, loss=2.16, v_num=0]
Epoch 67:  99%|█████████▉| 96/97 [00:14<00:00,  6.63it/s, loss=2.16, v_num=0]
Epoch 67: 100%|██████████| 97/97 [00:14<00:00,  6.66it/s, loss=2.16, v_num=0]
Epoch 67: 100%|██████████| 97/97 [00:14<00:00,  6.63it/s, loss=2.17, v_num=0]
Epoch 67: 100%|██████████| 97/97 [00:14<00:00,  6.63it/s, loss=2.17, v_num=0]
Epoch 67:   0%|          | 0/97 [00:00<?, ?it/s, loss=2.17, v_num=0]
Epoch 68:   0%|          | 0/97 [00:00<?, ?it/s, loss=2.17, v_num=0]
Epoch 68:   1%|          | 1/97 [00:01<02:18,  1.45s/it, loss=2.17, v_num=0]
Epoch 68:   1%|          | 1/97 [00:01<02:24,  1.50s/it, loss=2.18, v_num=0]
Epoch 68:   2%|▏         | 2/97 [00:01<01:15,  1.26it/s, loss=2.18, v_num=0]
Epoch 68:   2%|▏         | 2/97 [00:01<01:17,  1.22it/s, loss=2.18, v_num=0]
Epoch 68:   3%|▎         | 3/97 [00:01<00:53,  1.74it/s, loss=2.18, v_num=0]
Epoch 68:   3%|▎         | 3/97 [00:01<00:55,  1.69it/s, loss=2.17, v_num=0]
Epoch 68:   4%|▍         | 4/97 [00:01<00:43,  2.16it/s, loss=2.17, v_num=0]
Epoch 68:   4%|▍         | 4/97 [00:01<00:44,  2.09it/s, loss=2.17, v_num=0]
Epoch 68:   5%|▌         | 5/97 [00:01<00:36,  2.51it/s, loss=2.17, v_num=0]
Epoch 68:   5%|▌         | 5/97 [00:02<00:37,  2.44it/s, loss=2.17, v_num=0]
Epoch 68:   6%|▌         | 6/97 [00:02<00:32,  2.82it/s, loss=2.17, v_num=0]
Epoch 68:   6%|▌         | 6/97 [00:02<00:33,  2.74it/s, loss=2.17, v_num=0]
Epoch 68:   7%|▋         | 7/97 [00:02<00:29,  3.09it/s, loss=2.17, v_num=0]
Epoch 68:   7%|▋         | 7/97 [00:02<00:29,  3.01it/s, loss=2.17, v_num=0]
Epoch 68:   8%|▊         | 8/97 [00:02<00:26,  3.34it/s, loss=2.17, v_num=0]
Epoch 68:   8%|▊         | 8/97 [00:02<00:27,  3.25it/s, loss=2.17, v_num=0]
Epoch 68:   9%|▉         | 9/97 [00:02<00:24,  3.54it/s, loss=2.17, v_num=0]
Epoch 68:   9%|▉         | 9/97 [00:02<00:25,  3.46it/s, loss=2.17, v_num=0]
Epoch 68:  10%|█         | 10/97 [00:02<00:23,  3.73it/s, loss=2.17, v_num=0]
Epoch 68:  10%|█         | 10/97 [00:02<00:23,  3.65it/s, loss=2.17, v_num=0]
Epoch 68:  11%|█▏        | 11/97 [00:02<00:22,  3.90it/s, loss=2.17, v_num=0]
Epoch 68:  11%|█▏        | 11/97 [00:02<00:22,  3.83it/s, loss=2.17, v_num=0]
Epoch 68:  12%|█▏        | 12/97 [00:02<00:20,  4.06it/s, loss=2.17, v_num=0]
Epoch 68:  12%|█▏        | 12/97 [00:03<00:21,  3.99it/s, loss=2.17, v_num=0]
Epoch 68:  13%|█▎        | 13/97 [00:03<00:19,  4.20it/s, loss=2.17, v_num=0]
Epoch 68:  13%|█▎        | 13/97 [00:03<00:20,  4.13it/s, loss=2.18, v_num=0]
Epoch 68:  14%|█▍        | 14/97 [00:03<00:19,  4.33it/s, loss=2.18, v_num=0]
Epoch 68:  14%|█▍        | 14/97 [00:03<00:19,  4.26it/s, loss=2.19, v_num=0]
Epoch 68:  15%|█▌        | 15/97 [00:03<00:18,  4.45it/s, loss=2.19, v_num=0]
Epoch 68:  15%|█▌        | 15/97 [00:03<00:18,  4.38it/s, loss=2.19, v_num=0]
Epoch 68:  16%|█▋        | 16/97 [00:03<00:17,  4.57it/s, loss=2.19, v_num=0]
Epoch 68:  16%|█▋        | 16/97 [00:03<00:18,  4.49it/s, loss=2.19, v_num=0]
Epoch 68:  18%|█▊        | 17/97 [00:03<00:17,  4.66it/s, loss=2.19, v_num=0]
Epoch 68:  18%|█▊        | 17/97 [00:03<00:17,  4.59it/s, loss=2.2, v_num=0]
Epoch 68:  19%|█▊        | 18/97 [00:03<00:16,  4.75it/s, loss=2.2, v_num=0]
Epoch 68:  19%|█▊        | 18/97 [00:03<00:16,  4.69it/s, loss=2.19, v_num=0]
Epoch 68:  20%|█▉        | 19/97 [00:03<00:16,  4.85it/s, loss=2.19, v_num=0]
Epoch 68:  20%|█▉        | 19/97 [00:03<00:16,  4.78it/s, loss=2.19, v_num=0]
Epoch 68:  21%|██        | 20/97 [00:04<00:15,  4.93it/s, loss=2.19, v_num=0]
Epoch 68:  21%|██        | 20/97 [00:04<00:15,  4.86it/s, loss=2.19, v_num=0]
Epoch 68:  22%|██▏       | 21/97 [00:04<00:15,  5.01it/s, loss=2.19, v_num=0]
Epoch 68:  22%|██▏       | 21/97 [00:04<00:15,  4.94it/s, loss=2.18, v_num=0]
Epoch 68:  23%|██▎       | 22/97 [00:04<00:14,  5.08it/s, loss=2.18, v_num=0]
Epoch 68:  23%|██▎       | 22/97 [00:04<00:14,  5.02it/s, loss=2.18, v_num=0]
Epoch 68:  24%|██▎       | 23/97 [00:04<00:14,  5.15it/s, loss=2.18, v_num=0]
Epoch 68:  24%|██▎       | 23/97 [00:04<00:14,  5.08it/s, loss=2.18, v_num=0]
Epoch 68:  25%|██▍       | 24/97 [00:04<00:14,  5.21it/s, loss=2.18, v_num=0]
Epoch 68:  25%|██▍       | 24/97 [00:04<00:14,  5.15it/s, loss=2.19, v_num=0]
Epoch 68:  26%|██▌       | 25/97 [00:04<00:13,  5.27it/s, loss=2.19, v_num=0]
Epoch 68:  26%|██▌       | 25/97 [00:04<00:13,  5.21it/s, loss=2.18, v_num=0]
Epoch 68:  27%|██▋       | 26/97 [00:04<00:13,  5.33it/s, loss=2.18, v_num=0]
Epoch 68:  27%|██▋       | 26/97 [00:04<00:13,  5.27it/s, loss=2.18, v_num=0]
Epoch 68:  28%|██▊       | 27/97 [00:05<00:13,  5.38it/s, loss=2.18, v_num=0]
Epoch 68:  28%|██▊       | 27/97 [00:05<00:13,  5.32it/s, loss=2.18, v_num=0]
Epoch 68:  29%|██▉       | 28/97 [00:05<00:12,  5.43it/s, loss=2.18, v_num=0]
Epoch 68:  29%|██▉       | 28/97 [00:05<00:12,  5.37it/s, loss=2.19, v_num=0]
Epoch 68:  30%|██▉       | 29/97 [00:05<00:12,  5.48it/s, loss=2.19, v_num=0]
Epoch 68:  30%|██▉       | 29/97 [00:05<00:12,  5.42it/s, loss=2.19, v_num=0]
Epoch 68:  31%|███       | 30/97 [00:05<00:12,  5.53it/s, loss=2.19, v_num=0]
Epoch 68:  31%|███       | 30/97 [00:05<00:12,  5.47it/s, loss=2.2, v_num=0]
Epoch 68:  32%|███▏      | 31/97 [00:05<00:11,  5.57it/s, loss=2.2, v_num=0]
Epoch 68:  32%|███▏      | 31/97 [00:05<00:11,  5.51it/s, loss=2.2, v_num=0]
Epoch 68:  33%|███▎      | 32/97 [00:05<00:11,  5.61it/s, loss=2.2, v_num=0]
Epoch 68:  33%|███▎      | 32/97 [00:05<00:11,  5.55it/s, loss=2.2, v_num=0]
Epoch 68:  34%|███▍      | 33/97 [00:05<00:11,  5.65it/s, loss=2.2, v_num=0]
Epoch 68:  34%|███▍      | 33/97 [00:05<00:11,  5.59it/s, loss=2.2, v_num=0]
Epoch 68:  35%|███▌      | 34/97 [00:05<00:11,  5.68it/s, loss=2.2, v_num=0]
Epoch 68:  35%|███▌      | 34/97 [00:06<00:11,  5.63it/s, loss=2.19, v_num=0]
Epoch 68:  36%|███▌      | 35/97 [00:06<00:10,  5.72it/s, loss=2.19, v_num=0]
Epoch 68:  36%|███▌      | 35/97 [00:06<00:10,  5.67it/s, loss=2.19, v_num=0]
Epoch 68:  37%|███▋      | 36/97 [00:06<00:10,  5.76it/s, loss=2.19, v_num=0]
Epoch 68:  37%|███▋      | 36/97 [00:06<00:10,  5.71it/s, loss=2.19, v_num=0]
Epoch 68:  38%|███▊      | 37/97 [00:06<00:10,  5.79it/s, loss=2.19, v_num=0]
Epoch 68:  38%|███▊      | 37/97 [00:06<00:10,  5.74it/s, loss=2.19, v_num=0]
Epoch 68:  39%|███▉      | 38/97 [00:06<00:10,  5.83it/s, loss=2.19, v_num=0]
Epoch 68:  39%|███▉      | 38/97 [00:06<00:10,  5.77it/s, loss=2.18, v_num=0]
Epoch 68:  40%|████      | 39/97 [00:06<00:09,  5.85it/s, loss=2.18, v_num=0]
Epoch 68:  40%|████      | 39/97 [00:06<00:09,  5.80it/s, loss=2.18, v_num=0]
Epoch 68:  41%|████      | 40/97 [00:06<00:09,  5.88it/s, loss=2.18, v_num=0]
Epoch 68:  41%|████      | 40/97 [00:06<00:09,  5.83it/s, loss=2.18, v_num=0]
Epoch 68:  42%|████▏     | 41/97 [00:06<00:09,  5.91it/s, loss=2.18, v_num=0]
Epoch 68:  42%|████▏     | 41/97 [00:06<00:09,  5.86it/s, loss=2.19, v_num=0]
Epoch 68:  43%|████▎     | 42/97 [00:07<00:09,  5.93it/s, loss=2.19, v_num=0]
Epoch 68:  43%|████▎     | 42/97 [00:07<00:09,  5.89it/s, loss=2.18, v_num=0]
Epoch 68:  44%|████▍     | 43/97 [00:07<00:09,  5.96it/s, loss=2.18, v_num=0]
Epoch 68:  44%|████▍     | 43/97 [00:07<00:09,  5.91it/s, loss=2.19, v_num=0]
Epoch 68:  45%|████▌     | 44/97 [00:07<00:08,  5.98it/s, loss=2.19, v_num=0]
Epoch 68:  45%|████▌     | 44/97 [00:07<00:08,  5.94it/s, loss=2.18, v_num=0]
Epoch 68:  46%|████▋     | 45/97 [00:07<00:08,  6.01it/s, loss=2.18, v_num=0]
Epoch 68:  46%|████▋     | 45/97 [00:07<00:08,  5.96it/s, loss=2.19, v_num=0]
Epoch 68:  47%|████▋     | 46/97 [00:07<00:08,  6.03it/s, loss=2.19, v_num=0]
Epoch 68:  47%|████▋     | 46/97 [00:07<00:08,  5.99it/s, loss=2.19, v_num=0]
Epoch 68:  48%|████▊     | 47/97 [00:07<00:08,  6.05it/s, loss=2.19, v_num=0]
Epoch 68:  48%|████▊     | 47/97 [00:07<00:08,  6.01it/s, loss=2.18, v_num=0]
Epoch 68:  49%|████▉     | 48/97 [00:07<00:08,  6.08it/s, loss=2.18, v_num=0]
Epoch 68:  49%|████▉     | 48/97 [00:07<00:08,  6.03it/s, loss=2.18, v_num=0]
Epoch 68:  51%|█████     | 49/97 [00:08<00:07,  6.09it/s, loss=2.18, v_num=0]
Epoch 68:  51%|█████     | 49/97 [00:08<00:07,  6.05it/s, loss=2.18, v_num=0]
Epoch 68:  52%|█████▏    | 50/97 [00:08<00:07,  6.11it/s, loss=2.18, v_num=0]
Epoch 68:  52%|█████▏    | 50/97 [00:08<00:07,  6.07it/s, loss=2.18, v_num=0]
Epoch 68:  53%|█████▎    | 51/97 [00:08<00:07,  6.13it/s, loss=2.18, v_num=0]
Epoch 68:  53%|█████▎    | 51/97 [00:08<00:07,  6.09it/s, loss=2.18, v_num=0]
Epoch 68:  54%|█████▎    | 52/97 [00:08<00:07,  6.15it/s, loss=2.18, v_num=0]
Epoch 68:  54%|█████▎    | 52/97 [00:08<00:07,  6.11it/s, loss=2.17, v_num=0]
Epoch 68:  55%|█████▍    | 53/97 [00:08<00:07,  6.17it/s, loss=2.17, v_num=0]
Epoch 68:  55%|█████▍    | 53/97 [00:08<00:07,  6.13it/s, loss=2.17, v_num=0]
Epoch 68:  56%|█████▌    | 54/97 [00:08<00:06,  6.19it/s, loss=2.17, v_num=0]
Epoch 68:  56%|█████▌    | 54/97 [00:08<00:06,  6.15it/s, loss=2.17, v_num=0]
Epoch 68:  57%|█████▋    | 55/97 [00:08<00:06,  6.21it/s, loss=2.17, v_num=0]
Epoch 68:  57%|█████▋    | 55/97 [00:08<00:06,  6.17it/s, loss=2.16, v_num=0]
Epoch 68:  58%|█████▊    | 56/97 [00:09<00:06,  6.22it/s, loss=2.16, v_num=0]
Epoch 68:  58%|█████▊    | 56/97 [00:09<00:06,  6.18it/s, loss=2.18, v_num=0]
Epoch 68:  59%|█████▉    | 57/97 [00:09<00:06,  6.24it/s, loss=2.18, v_num=0]
Epoch 68:  59%|█████▉    | 57/97 [00:09<00:06,  6.20it/s, loss=2.18, v_num=0]
Epoch 68:  60%|█████▉    | 58/97 [00:09<00:06,  6.25it/s, loss=2.18, v_num=0]
Epoch 68:  60%|█████▉    | 58/97 [00:09<00:06,  6.22it/s, loss=2.18, v_num=0]
Epoch 68:  61%|██████    | 59/97 [00:09<00:06,  6.27it/s, loss=2.18, v_num=0]
Epoch 68:  61%|██████    | 59/97 [00:09<00:06,  6.23it/s, loss=2.19, v_num=0]
Epoch 68:  62%|██████▏   | 60/97 [00:09<00:05,  6.28it/s, loss=2.19, v_num=0]
Epoch 68:  62%|██████▏   | 60/97 [00:09<00:05,  6.25it/s, loss=2.18, v_num=0]
Epoch 68:  63%|██████▎   | 61/97 [00:09<00:05,  6.30it/s, loss=2.18, v_num=0]
Epoch 68:  63%|██████▎   | 61/97 [00:09<00:05,  6.26it/s, loss=2.17, v_num=0]
Epoch 68:  64%|██████▍   | 62/97 [00:09<00:05,  6.31it/s, loss=2.17, v_num=0]
Epoch 68:  64%|██████▍   | 62/97 [00:09<00:05,  6.27it/s, loss=2.18, v_num=0]
Epoch 68:  65%|██████▍   | 63/97 [00:09<00:05,  6.32it/s, loss=2.18, v_num=0]
Epoch 68:  65%|██████▍   | 63/97 [00:10<00:05,  6.29it/s, loss=2.18, v_num=0]
Epoch 68:  66%|██████▌   | 64/97 [00:10<00:05,  6.33it/s, loss=2.18, v_num=0]
Epoch 68:  66%|██████▌   | 64/97 [00:10<00:05,  6.30it/s, loss=2.18, v_num=0]
Epoch 68:  67%|██████▋   | 65/97 [00:10<00:05,  6.35it/s, loss=2.18, v_num=0]
Epoch 68:  67%|██████▋   | 65/97 [00:10<00:05,  6.31it/s, loss=2.17, v_num=0]
Epoch 68:  68%|██████▊   | 66/97 [00:10<00:04,  6.36it/s, loss=2.17, v_num=0]
Epoch 68:  68%|██████▊   | 66/97 [00:10<00:04,  6.32it/s, loss=2.18, v_num=0]
Epoch 68:  69%|██████▉   | 67/97 [00:10<00:04,  6.37it/s, loss=2.18, v_num=0]
Epoch 68:  69%|██████▉   | 67/97 [00:10<00:04,  6.34it/s, loss=2.17, v_num=0]
Epoch 68:  70%|███████   | 68/97 [00:10<00:04,  6.38it/s, loss=2.17, v_num=0]
Epoch 68:  70%|███████   | 68/97 [00:10<00:04,  6.35it/s, loss=2.18, v_num=0]
Epoch 68:  71%|███████   | 69/97 [00:10<00:04,  6.39it/s, loss=2.18, v_num=0]
Epoch 68:  71%|███████   | 69/97 [00:10<00:04,  6.36it/s, loss=2.17, v_num=0]
Epoch 68:  72%|███████▏  | 70/97 [00:10<00:04,  6.41it/s, loss=2.17, v_num=0]
Epoch 68:  72%|███████▏  | 70/97 [00:10<00:04,  6.37it/s, loss=2.17, v_num=0]
Epoch 68:  73%|███████▎  | 71/97 [00:11<00:04,  6.42it/s, loss=2.17, v_num=0]
Epoch 68:  73%|███████▎  | 71/97 [00:11<00:04,  6.38it/s, loss=2.17, v_num=0]
Epoch 68:  74%|███████▍  | 72/97 [00:11<00:03,  6.43it/s, loss=2.17, v_num=0]
Epoch 68:  74%|███████▍  | 72/97 [00:11<00:03,  6.40it/s, loss=2.17, v_num=0]
Epoch 68:  75%|███████▌  | 73/97 [00:11<00:03,  6.44it/s, loss=2.17, v_num=0]
Epoch 68:  75%|███████▌  | 73/97 [00:11<00:03,  6.41it/s, loss=2.17, v_num=0]
Epoch 68:  76%|███████▋  | 74/97 [00:11<00:03,  6.45it/s, loss=2.17, v_num=0]
Epoch 68:  76%|███████▋  | 74/97 [00:11<00:03,  6.42it/s, loss=2.17, v_num=0]
Epoch 68:  77%|███████▋  | 75/97 [00:11<00:03,  6.46it/s, loss=2.17, v_num=0]
Epoch 68:  77%|███████▋  | 75/97 [00:11<00:03,  6.43it/s, loss=2.17, v_num=0]
Epoch 68:  78%|███████▊  | 76/97 [00:11<00:03,  6.47it/s, loss=2.17, v_num=0]
Epoch 68:  78%|███████▊  | 76/97 [00:11<00:03,  6.44it/s, loss=2.17, v_num=0]
Epoch 68:  79%|███████▉  | 77/97 [00:11<00:03,  6.48it/s, loss=2.17, v_num=0]
Epoch 68:  79%|███████▉  | 77/97 [00:11<00:03,  6.45it/s, loss=2.17, v_num=0]
Epoch 68:  80%|████████  | 78/97 [00:12<00:02,  6.49it/s, loss=2.17, v_num=0]
Epoch 68:  80%|████████  | 78/97 [00:12<00:02,  6.46it/s, loss=2.17, v_num=0]
Epoch 68:  81%|████████▏ | 79/97 [00:12<00:02,  6.50it/s, loss=2.17, v_num=0]
Epoch 68:  81%|████████▏ | 79/97 [00:12<00:02,  6.47it/s, loss=2.17, v_num=0]
Epoch 68:  82%|████████▏ | 80/97 [00:12<00:02,  6.50it/s, loss=2.17, v_num=0]
Epoch 68:  82%|████████▏ | 80/97 [00:12<00:02,  6.47it/s, loss=2.17, v_num=0]
Epoch 68:  84%|████████▎ | 81/97 [00:12<00:02,  6.51it/s, loss=2.17, v_num=0]
Epoch 68:  84%|████████▎ | 81/97 [00:12<00:02,  6.48it/s, loss=2.17, v_num=0]
Epoch 68:  85%|████████▍ | 82/97 [00:12<00:02,  6.52it/s, loss=2.17, v_num=0]
Epoch 68:  85%|████████▍ | 82/97 [00:12<00:02,  6.49it/s, loss=2.17, v_num=0]
Epoch 68:  86%|████████▌ | 83/97 [00:12<00:02,  6.53it/s, loss=2.17, v_num=0]
Epoch 68:  86%|████████▌ | 83/97 [00:12<00:02,  6.50it/s, loss=2.16, v_num=0]
Epoch 68:  87%|████████▋ | 84/97 [00:12<00:01,  6.54it/s, loss=2.16, v_num=0]
Epoch 68:  87%|████████▋ | 84/97 [00:12<00:01,  6.51it/s, loss=2.16, v_num=0]
Epoch 68:  88%|████████▊ | 85/97 [00:12<00:01,  6.54it/s, loss=2.16, v_num=0]
Epoch 68:  88%|████████▊ | 85/97 [00:13<00:01,  6.52it/s, loss=2.16, v_num=0]
Epoch 68:  89%|████████▊ | 86/97 [00:13<00:01,  6.56it/s, loss=2.16, v_num=0]
Epoch 68:  89%|████████▊ | 86/97 [00:13<00:01,  6.53it/s, loss=2.16, v_num=0]
Epoch 68:  90%|████████▉ | 87/97 [00:13<00:01,  6.56it/s, loss=2.16, v_num=0]
Epoch 68:  90%|████████▉ | 87/97 [00:13<00:01,  6.53it/s, loss=2.17, v_num=0]
Epoch 68:  91%|█████████ | 88/97 [00:13<00:01,  6.57it/s, loss=2.17, v_num=0]
Epoch 68:  91%|█████████ | 88/97 [00:13<00:01,  6.54it/s, loss=2.17, v_num=0]
Epoch 68:  92%|█████████▏| 89/97 [00:13<00:01,  6.58it/s, loss=2.17, v_num=0]
Epoch 68:  92%|█████████▏| 89/97 [00:13<00:01,  6.55it/s, loss=2.17, v_num=0]
Epoch 68:  93%|█████████▎| 90/97 [00:13<00:01,  6.58it/s, loss=2.17, v_num=0]
Epoch 68:  93%|█████████▎| 90/97 [00:13<00:01,  6.56it/s, loss=2.17, v_num=0]
Epoch 68:  94%|█████████▍| 91/97 [00:13<00:00,  6.59it/s, loss=2.17, v_num=0]
Epoch 68:  94%|█████████▍| 91/97 [00:13<00:00,  6.56it/s, loss=2.17, v_num=0]
Epoch 68:  95%|█████████▍| 92/97 [00:13<00:00,  6.60it/s, loss=2.17, v_num=0]
Epoch 68:  95%|█████████▍| 92/97 [00:14<00:00,  6.57it/s, loss=2.17, v_num=0]
Epoch 68:  96%|█████████▌| 93/97 [00:14<00:00,  6.60it/s, loss=2.17, v_num=0]
Epoch 68:  96%|█████████▌| 93/97 [00:14<00:00,  6.58it/s, loss=2.17, v_num=0]
Epoch 68:  97%|█████████▋| 94/97 [00:14<00:00,  6.61it/s, loss=2.17, v_num=0]
Epoch 68:  97%|█████████▋| 94/97 [00:14<00:00,  6.58it/s, loss=2.18, v_num=0]
Epoch 68:  98%|█████████▊| 95/97 [00:14<00:00,  6.62it/s, loss=2.18, v_num=0]
Epoch 68:  98%|█████████▊| 95/97 [00:14<00:00,  6.59it/s, loss=2.18, v_num=0]
Epoch 68:  99%|█████████▉| 96/97 [00:14<00:00,  6.62it/s, loss=2.18, v_num=0]
Epoch 68:  99%|█████████▉| 96/97 [00:14<00:00,  6.60it/s, loss=2.18, v_num=0]
Epoch 68: 100%|██████████| 97/97 [00:14<00:00,  6.63it/s, loss=2.18, v_num=0]
Epoch 68: 100%|██████████| 97/97 [00:14<00:00,  6.60it/s, loss=2.17, v_num=0]
Epoch 68: 100%|██████████| 97/97 [00:14<00:00,  6.60it/s, loss=2.17, v_num=0]
Epoch 68:   0%|          | 0/97 [00:00<?, ?it/s, loss=2.17, v_num=0]
Epoch 69:   0%|          | 0/97 [00:00<?, ?it/s, loss=2.17, v_num=0]
Epoch 69:   1%|          | 1/97 [00:01<02:17,  1.43s/it, loss=2.17, v_num=0]
Epoch 69:   1%|          | 1/97 [00:01<02:22,  1.48s/it, loss=2.17, v_num=0]
Epoch 69:   2%|▏         | 2/97 [00:01<01:14,  1.28it/s, loss=2.17, v_num=0]
Epoch 69:   2%|▏         | 2/97 [00:01<01:16,  1.23it/s, loss=2.17, v_num=0]
Epoch 69:   3%|▎         | 3/97 [00:01<00:53,  1.77it/s, loss=2.17, v_num=0]
Epoch 69:   3%|▎         | 3/97 [00:01<00:55,  1.71it/s, loss=2.17, v_num=0]
Epoch 69:   4%|▍         | 4/97 [00:01<00:42,  2.17it/s, loss=2.17, v_num=0]
Epoch 69:   4%|▍         | 4/97 [00:01<00:44,  2.11it/s, loss=2.17, v_num=0]
Epoch 69:   5%|▌         | 5/97 [00:01<00:36,  2.53it/s, loss=2.17, v_num=0]
Epoch 69:   5%|▌         | 5/97 [00:02<00:37,  2.46it/s, loss=2.18, v_num=0]
Epoch 69:   6%|▌         | 6/97 [00:02<00:32,  2.84it/s, loss=2.18, v_num=0]
Epoch 69:   6%|▌         | 6/97 [00:02<00:32,  2.77it/s, loss=2.18, v_num=0]
Epoch 69:   7%|▋         | 7/97 [00:02<00:28,  3.11it/s, loss=2.18, v_num=0]
Epoch 69:   7%|▋         | 7/97 [00:02<00:29,  3.04it/s, loss=2.19, v_num=0]
Epoch 69:   8%|▊         | 8/97 [00:02<00:26,  3.35it/s, loss=2.19, v_num=0]
Epoch 69:   8%|▊         | 8/97 [00:02<00:27,  3.28it/s, loss=2.19, v_num=0]
Epoch 69:   9%|▉         | 9/97 [00:02<00:24,  3.55it/s, loss=2.19, v_num=0]
Epoch 69:   9%|▉         | 9/97 [00:02<00:25,  3.47it/s, loss=2.18, v_num=0]
Epoch 69:  10%|█         | 10/97 [00:02<00:23,  3.74it/s, loss=2.18, v_num=0]
Epoch 69:  10%|█         | 10/97 [00:02<00:23,  3.67it/s, loss=2.19, v_num=0]
Epoch 69:  11%|█▏        | 11/97 [00:02<00:21,  3.92it/s, loss=2.19, v_num=0]
Epoch 69:  11%|█▏        | 11/97 [00:02<00:22,  3.84it/s, loss=2.18, v_num=0]
Epoch 69:  12%|█▏        | 12/97 [00:02<00:20,  4.07it/s, loss=2.18, v_num=0]
Epoch 69:  12%|█▏        | 12/97 [00:03<00:21,  4.00it/s, loss=2.18, v_num=0]
Epoch 69:  13%|█▎        | 13/97 [00:03<00:19,  4.21it/s, loss=2.18, v_num=0]
Epoch 69:  13%|█▎        | 13/97 [00:03<00:20,  4.14it/s, loss=2.19, v_num=0]
Epoch 69:  14%|█▍        | 14/97 [00:03<00:19,  4.35it/s, loss=2.19, v_num=0]
Epoch 69:  14%|█▍        | 14/97 [00:03<00:19,  4.27it/s, loss=2.18, v_num=0]
Epoch 69:  15%|█▌        | 15/97 [00:03<00:18,  4.47it/s, loss=2.18, v_num=0]
Epoch 69:  15%|█▌        | 15/97 [00:03<00:18,  4.40it/s, loss=2.19, v_num=0]
Epoch 69:  16%|█▋        | 16/97 [00:03<00:17,  4.59it/s, loss=2.19, v_num=0]
Epoch 69:  16%|█▋        | 16/97 [00:03<00:17,  4.51it/s, loss=2.18, v_num=0]
Epoch 69:  18%|█▊        | 17/97 [00:03<00:17,  4.68it/s, loss=2.18, v_num=0]
Epoch 69:  18%|█▊        | 17/97 [00:03<00:17,  4.61it/s, loss=2.18, v_num=0]
Epoch 69:  19%|█▊        | 18/97 [00:03<00:16,  4.78it/s, loss=2.18, v_num=0]
Epoch 69:  19%|█▊        | 18/97 [00:03<00:16,  4.71it/s, loss=2.19, v_num=0]
Epoch 69:  20%|█▉        | 19/97 [00:03<00:16,  4.86it/s, loss=2.19, v_num=0]
Epoch 69:  20%|█▉        | 19/97 [00:03<00:16,  4.79it/s, loss=2.18, v_num=0]
Epoch 69:  21%|██        | 20/97 [00:04<00:15,  4.94it/s, loss=2.18, v_num=0]
Epoch 69:  21%|██        | 20/97 [00:04<00:15,  4.88it/s, loss=2.18, v_num=0]
Epoch 69:  22%|██▏       | 21/97 [00:04<00:15,  5.02it/s, loss=2.18, v_num=0]
Epoch 69:  22%|██▏       | 21/97 [00:04<00:15,  4.96it/s, loss=2.19, v_num=0]
Epoch 69:  23%|██▎       | 22/97 [00:04<00:14,  5.09it/s, loss=2.19, v_num=0]
Epoch 69:  23%|██▎       | 22/97 [00:04<00:14,  5.03it/s, loss=2.18, v_num=0]
Epoch 69:  24%|██▎       | 23/97 [00:04<00:14,  5.16it/s, loss=2.18, v_num=0]
Epoch 69:  24%|██▎       | 23/97 [00:04<00:14,  5.09it/s, loss=2.18, v_num=0]
Epoch 69:  25%|██▍       | 24/97 [00:04<00:13,  5.22it/s, loss=2.18, v_num=0]
Epoch 69:  25%|██▍       | 24/97 [00:04<00:14,  5.15it/s, loss=2.18, v_num=0]
Epoch 69:  26%|██▌       | 25/97 [00:04<00:13,  5.28it/s, loss=2.18, v_num=0]
Epoch 69:  26%|██▌       | 25/97 [00:04<00:13,  5.22it/s, loss=2.17, v_num=0]
Epoch 69:  27%|██▋       | 26/97 [00:04<00:13,  5.33it/s, loss=2.17, v_num=0]
Epoch 69:  27%|██▋       | 26/97 [00:04<00:13,  5.27it/s, loss=2.17, v_num=0]
Epoch 69:  28%|██▊       | 27/97 [00:05<00:12,  5.39it/s, loss=2.17, v_num=0]
Epoch 69:  28%|██▊       | 27/97 [00:05<00:13,  5.33it/s, loss=2.17, v_num=0]
Epoch 69:  29%|██▉       | 28/97 [00:05<00:12,  5.44it/s, loss=2.17, v_num=0]
Epoch 69:  29%|██▉       | 28/97 [00:05<00:12,  5.38it/s, loss=2.17, v_num=0]
Epoch 69:  30%|██▉       | 29/97 [00:05<00:12,  5.49it/s, loss=2.17, v_num=0]
Epoch 69:  30%|██▉       | 29/97 [00:05<00:12,  5.43it/s, loss=2.17, v_num=0]
Epoch 69:  31%|███       | 30/97 [00:05<00:12,  5.53it/s, loss=2.17, v_num=0]
Epoch 69:  31%|███       | 30/97 [00:05<00:12,  5.48it/s, loss=2.16, v_num=0]
Epoch 69:  32%|███▏      | 31/97 [00:05<00:11,  5.57it/s, loss=2.16, v_num=0]
Epoch 69:  32%|███▏      | 31/97 [00:05<00:11,  5.52it/s, loss=2.17, v_num=0]
Epoch 69:  33%|███▎      | 32/97 [00:05<00:11,  5.62it/s, loss=2.17, v_num=0]
Epoch 69:  33%|███▎      | 32/97 [00:05<00:11,  5.56it/s, loss=2.17, v_num=0]
Epoch 69:  34%|███▍      | 33/97 [00:05<00:11,  5.65it/s, loss=2.17, v_num=0]
Epoch 69:  34%|███▍      | 33/97 [00:05<00:11,  5.60it/s, loss=2.17, v_num=0]
Epoch 69:  35%|███▌      | 34/97 [00:05<00:11,  5.69it/s, loss=2.17, v_num=0]
Epoch 69:  35%|███▌      | 34/97 [00:06<00:11,  5.64it/s, loss=2.17, v_num=0]
Epoch 69:  36%|███▌      | 35/97 [00:06<00:10,  5.73it/s, loss=2.17, v_num=0]
Epoch 69:  36%|███▌      | 35/97 [00:06<00:10,  5.68it/s, loss=2.17, v_num=0]
Epoch 69:  37%|███▋      | 36/97 [00:06<00:10,  5.76it/s, loss=2.17, v_num=0]
Epoch 69:  37%|███▋      | 36/97 [00:06<00:10,  5.71it/s, loss=2.16, v_num=0]
Epoch 69:  38%|███▊      | 37/97 [00:06<00:10,  5.79it/s, loss=2.16, v_num=0]
Epoch 69:  38%|███▊      | 37/97 [00:06<00:10,  5.75it/s, loss=2.17, v_num=0]
Epoch 69:  39%|███▉      | 38/97 [00:06<00:10,  5.83it/s, loss=2.17, v_num=0]
Epoch 69:  39%|███▉      | 38/97 [00:06<00:10,  5.78it/s, loss=2.16, v_num=0]
Epoch 69:  40%|████      | 39/97 [00:06<00:09,  5.86it/s, loss=2.16, v_num=0]
Epoch 69:  40%|████      | 39/97 [00:06<00:09,  5.81it/s, loss=2.16, v_num=0]
Epoch 69:  41%|████      | 40/97 [00:06<00:09,  5.88it/s, loss=2.16, v_num=0]
Epoch 69:  41%|████      | 40/97 [00:06<00:09,  5.84it/s, loss=2.16, v_num=0]
Epoch 69:  42%|████▏     | 41/97 [00:06<00:09,  5.91it/s, loss=2.16, v_num=0]
Epoch 69:  42%|████▏     | 41/97 [00:06<00:09,  5.87it/s, loss=2.16, v_num=0]
Epoch 69:  43%|████▎     | 42/97 [00:07<00:09,  5.94it/s, loss=2.16, v_num=0]
Epoch 69:  43%|████▎     | 42/97 [00:07<00:09,  5.89it/s, loss=2.16, v_num=0]
Epoch 69:  44%|████▍     | 43/97 [00:07<00:09,  5.97it/s, loss=2.16, v_num=0]
Epoch 69:  44%|████▍     | 43/97 [00:07<00:09,  5.92it/s, loss=2.16, v_num=0]
Epoch 69:  45%|████▌     | 44/97 [00:07<00:08,  5.99it/s, loss=2.16, v_num=0]
Epoch 69:  45%|████▌     | 44/97 [00:07<00:08,  5.94it/s, loss=2.16, v_num=0]
Epoch 69:  46%|████▋     | 45/97 [00:07<00:08,  6.01it/s, loss=2.16, v_num=0]
Epoch 69:  46%|████▋     | 45/97 [00:07<00:08,  5.97it/s, loss=2.16, v_num=0]
Epoch 69:  47%|████▋     | 46/97 [00:07<00:08,  6.04it/s, loss=2.16, v_num=0]
Epoch 69:  47%|████▋     | 46/97 [00:07<00:08,  5.99it/s, loss=2.16, v_num=0]
Epoch 69:  48%|████▊     | 47/97 [00:07<00:08,  6.06it/s, loss=2.16, v_num=0]
Epoch 69:  48%|████▊     | 47/97 [00:07<00:08,  6.01it/s, loss=2.15, v_num=0]
Epoch 69:  49%|████▉     | 48/97 [00:07<00:08,  6.08it/s, loss=2.15, v_num=0]
Epoch 69:  49%|████▉     | 48/97 [00:07<00:08,  6.03it/s, loss=2.15, v_num=0]
Epoch 69:  51%|█████     | 49/97 [00:08<00:07,  6.10it/s, loss=2.15, v_num=0]
Epoch 69:  51%|█████     | 49/97 [00:08<00:07,  6.06it/s, loss=2.15, v_num=0]
Epoch 69:  52%|█████▏    | 50/97 [00:08<00:07,  6.11it/s, loss=2.15, v_num=0]
Epoch 69:  52%|█████▏    | 50/97 [00:08<00:07,  6.07it/s, loss=2.16, v_num=0]
Epoch 69:  53%|█████▎    | 51/97 [00:08<00:07,  6.13it/s, loss=2.16, v_num=0]
Epoch 69:  53%|█████▎    | 51/97 [00:08<00:07,  6.09it/s, loss=2.15, v_num=0]
Epoch 69:  54%|█████▎    | 52/97 [00:08<00:07,  6.15it/s, loss=2.15, v_num=0]
Epoch 69:  54%|█████▎    | 52/97 [00:08<00:07,  6.11it/s, loss=2.16, v_num=0]
Epoch 69:  55%|█████▍    | 53/97 [00:08<00:07,  6.17it/s, loss=2.16, v_num=0]
Epoch 69:  55%|█████▍    | 53/97 [00:08<00:07,  6.13it/s, loss=2.15, v_num=0]
Epoch 69:  56%|█████▌    | 54/97 [00:08<00:06,  6.19it/s, loss=2.15, v_num=0]
Epoch 69:  56%|█████▌    | 54/97 [00:08<00:06,  6.15it/s, loss=2.15, v_num=0]
Epoch 69:  57%|█████▋    | 55/97 [00:08<00:06,  6.20it/s, loss=2.15, v_num=0]
Epoch 69:  57%|█████▋    | 55/97 [00:08<00:06,  6.16it/s, loss=2.15, v_num=0]
Epoch 69:  58%|█████▊    | 56/97 [00:09<00:06,  6.22it/s, loss=2.15, v_num=0]
Epoch 69:  58%|█████▊    | 56/97 [00:09<00:06,  6.18it/s, loss=2.16, v_num=0]
Epoch 69:  59%|█████▉    | 57/97 [00:09<00:06,  6.23it/s, loss=2.16, v_num=0]
Epoch 69:  59%|█████▉    | 57/97 [00:09<00:06,  6.19it/s, loss=2.15, v_num=0]
Epoch 69:  60%|█████▉    | 58/97 [00:09<00:06,  6.24it/s, loss=2.15, v_num=0]
Epoch 69:  60%|█████▉    | 58/97 [00:09<00:06,  6.21it/s, loss=2.15, v_num=0]
Epoch 69:  61%|██████    | 59/97 [00:09<00:06,  6.26it/s, loss=2.15, v_num=0]
Epoch 69:  61%|██████    | 59/97 [00:09<00:06,  6.22it/s, loss=2.15, v_num=0]
Epoch 69:  62%|██████▏   | 60/97 [00:09<00:05,  6.27it/s, loss=2.15, v_num=0]
Epoch 69:  62%|██████▏   | 60/97 [00:09<00:05,  6.24it/s, loss=2.15, v_num=0]
Epoch 69:  63%|██████▎   | 61/97 [00:09<00:05,  6.29it/s, loss=2.15, v_num=0]
Epoch 69:  63%|██████▎   | 61/97 [00:09<00:05,  6.25it/s, loss=2.16, v_num=0]
Epoch 69:  64%|██████▍   | 62/97 [00:09<00:05,  6.30it/s, loss=2.16, v_num=0]
Epoch 69:  64%|██████▍   | 62/97 [00:09<00:05,  6.27it/s, loss=2.16, v_num=0]
Epoch 69:  65%|██████▍   | 63/97 [00:09<00:05,  6.32it/s, loss=2.16, v_num=0]
Epoch 69:  65%|██████▍   | 63/97 [00:10<00:05,  6.28it/s, loss=2.17, v_num=0]
Epoch 69:  66%|██████▌   | 64/97 [00:10<00:05,  6.33it/s, loss=2.17, v_num=0]
Epoch 69:  66%|██████▌   | 64/97 [00:10<00:05,  6.29it/s, loss=2.16, v_num=0]
Epoch 69:  67%|██████▋   | 65/97 [00:10<00:05,  6.34it/s, loss=2.16, v_num=0]
Epoch 69:  67%|██████▋   | 65/97 [00:10<00:05,  6.30it/s, loss=2.17, v_num=0]
Epoch 69:  68%|██████▊   | 66/97 [00:10<00:04,  6.35it/s, loss=2.17, v_num=0]
Epoch 69:  68%|██████▊   | 66/97 [00:10<00:04,  6.32it/s, loss=2.17, v_num=0]
Epoch 69:  69%|██████▉   | 67/97 [00:10<00:04,  6.36it/s, loss=2.17, v_num=0]
Epoch 69:  69%|██████▉   | 67/97 [00:10<00:04,  6.33it/s, loss=2.17, v_num=0]
Epoch 69:  70%|███████   | 68/97 [00:10<00:04,  6.37it/s, loss=2.17, v_num=0]
Epoch 69:  70%|███████   | 68/97 [00:10<00:04,  6.34it/s, loss=2.17, v_num=0]
Epoch 69:  71%|███████   | 69/97 [00:10<00:04,  6.39it/s, loss=2.17, v_num=0]
Epoch 69:  71%|███████   | 69/97 [00:10<00:04,  6.35it/s, loss=2.17, v_num=0]
Epoch 69:  72%|███████▏  | 70/97 [00:10<00:04,  6.40it/s, loss=2.17, v_num=0]
Epoch 69:  72%|███████▏  | 70/97 [00:10<00:04,  6.37it/s, loss=2.17, v_num=0]
Epoch 69:  73%|███████▎  | 71/97 [00:11<00:04,  6.41it/s, loss=2.17, v_num=0]
Epoch 69:  73%|███████▎  | 71/97 [00:11<00:04,  6.38it/s, loss=2.17, v_num=0]
Epoch 69:  74%|███████▍  | 72/97 [00:11<00:03,  6.42it/s, loss=2.17, v_num=0]
Epoch 69:  74%|███████▍  | 72/97 [00:11<00:03,  6.39it/s, loss=2.15, v_num=0]
Epoch 69:  75%|███████▌  | 73/97 [00:11<00:03,  6.43it/s, loss=2.15, v_num=0]
Epoch 69:  75%|███████▌  | 73/97 [00:11<00:03,  6.40it/s, loss=2.16, v_num=0]
Epoch 69:  76%|███████▋  | 74/97 [00:11<00:03,  6.44it/s, loss=2.16, v_num=0]
Epoch 69:  76%|███████▋  | 74/97 [00:11<00:03,  6.41it/s, loss=2.16, v_num=0]
Epoch 69:  77%|███████▋  | 75/97 [00:11<00:03,  6.45it/s, loss=2.16, v_num=0]
Epoch 69:  77%|███████▋  | 75/97 [00:11<00:03,  6.42it/s, loss=2.16, v_num=0]
Epoch 69:  78%|███████▊  | 76/97 [00:11<00:03,  6.46it/s, loss=2.16, v_num=0]
Epoch 69:  78%|███████▊  | 76/97 [00:11<00:03,  6.43it/s, loss=2.16, v_num=0]
Epoch 69:  79%|███████▉  | 77/97 [00:11<00:03,  6.47it/s, loss=2.16, v_num=0]
Epoch 69:  79%|███████▉  | 77/97 [00:11<00:03,  6.44it/s, loss=2.16, v_num=0]
Epoch 69:  80%|████████  | 78/97 [00:12<00:02,  6.48it/s, loss=2.16, v_num=0]
Epoch 69:  80%|████████  | 78/97 [00:12<00:02,  6.45it/s, loss=2.17, v_num=0]
Epoch 69:  81%|████████▏ | 79/97 [00:12<00:02,  6.49it/s, loss=2.17, v_num=0]
Epoch 69:  81%|████████▏ | 79/97 [00:12<00:02,  6.46it/s, loss=2.17, v_num=0]
Epoch 69:  82%|████████▏ | 80/97 [00:12<00:02,  6.49it/s, loss=2.17, v_num=0]
Epoch 69:  82%|████████▏ | 80/97 [00:12<00:02,  6.47it/s, loss=2.16, v_num=0]
Epoch 69:  84%|████████▎ | 81/97 [00:12<00:02,  6.50it/s, loss=2.16, v_num=0]
Epoch 69:  84%|████████▎ | 81/97 [00:12<00:02,  6.47it/s, loss=2.17, v_num=0]
Epoch 69:  85%|████████▍ | 82/97 [00:12<00:02,  6.51it/s, loss=2.17, v_num=0]
Epoch 69:  85%|████████▍ | 82/97 [00:12<00:02,  6.48it/s, loss=2.16, v_num=0]
Epoch 69:  86%|████████▌ | 83/97 [00:12<00:02,  6.52it/s, loss=2.16, v_num=0]
Epoch 69:  86%|████████▌ | 83/97 [00:12<00:02,  6.49it/s, loss=2.17, v_num=0]
Epoch 69:  87%|████████▋ | 84/97 [00:12<00:01,  6.53it/s, loss=2.17, v_num=0]
Epoch 69:  87%|████████▋ | 84/97 [00:12<00:02,  6.50it/s, loss=2.17, v_num=0]
Epoch 69:  88%|████████▊ | 85/97 [00:13<00:01,  6.53it/s, loss=2.17, v_num=0]
Epoch 69:  88%|████████▊ | 85/97 [00:13<00:01,  6.51it/s, loss=2.17, v_num=0]
Epoch 69:  89%|████████▊ | 86/97 [00:13<00:01,  6.54it/s, loss=2.17, v_num=0]
Epoch 69:  89%|████████▊ | 86/97 [00:13<00:01,  6.51it/s, loss=2.16, v_num=0]
Epoch 69:  90%|████████▉ | 87/97 [00:13<00:01,  6.55it/s, loss=2.16, v_num=0]
Epoch 69:  90%|████████▉ | 87/97 [00:13<00:01,  6.52it/s, loss=2.17, v_num=0]
Epoch 69:  91%|█████████ | 88/97 [00:13<00:01,  6.56it/s, loss=2.17, v_num=0]
Epoch 69:  91%|█████████ | 88/97 [00:13<00:01,  6.53it/s, loss=2.16, v_num=0]
Epoch 69:  92%|█████████▏| 89/97 [00:13<00:01,  6.56it/s, loss=2.16, v_num=0]
Epoch 69:  92%|█████████▏| 89/97 [00:13<00:01,  6.54it/s, loss=2.16, v_num=0]
Epoch 69:  93%|█████████▎| 90/97 [00:13<00:01,  6.57it/s, loss=2.16, v_num=0]
Epoch 69:  93%|█████████▎| 90/97 [00:13<00:01,  6.55it/s, loss=2.16, v_num=0]
Epoch 69:  94%|█████████▍| 91/97 [00:13<00:00,  6.58it/s, loss=2.16, v_num=0]
Epoch 69:  94%|█████████▍| 91/97 [00:13<00:00,  6.55it/s, loss=2.16, v_num=0]
Epoch 69:  95%|█████████▍| 92/97 [00:13<00:00,  6.59it/s, loss=2.16, v_num=0]
Epoch 69:  95%|█████████▍| 92/97 [00:14<00:00,  6.56it/s, loss=2.17, v_num=0]
Epoch 69:  96%|█████████▌| 93/97 [00:14<00:00,  6.59it/s, loss=2.17, v_num=0]
Epoch 69:  96%|█████████▌| 93/97 [00:14<00:00,  6.57it/s, loss=2.16, v_num=0]
Epoch 69:  97%|█████████▋| 94/97 [00:14<00:00,  6.59it/s, loss=2.16, v_num=0]
Epoch 69:  97%|█████████▋| 94/97 [00:14<00:00,  6.57it/s, loss=2.17, v_num=0]
Epoch 69:  98%|█████████▊| 95/97 [00:14<00:00,  6.60it/s, loss=2.17, v_num=0]
Epoch 69:  98%|█████████▊| 95/97 [00:14<00:00,  6.57it/s, loss=2.16, v_num=0]
Epoch 69:  99%|█████████▉| 96/97 [00:14<00:00,  6.61it/s, loss=2.16, v_num=0]
Epoch 69:  99%|█████████▉| 96/97 [00:14<00:00,  6.58it/s, loss=2.16, v_num=0]
Epoch 69: 100%|██████████| 97/97 [00:14<00:00,  6.61it/s, loss=2.16, v_num=0]
Epoch 69: 100%|██████████| 97/97 [00:14<00:00,  6.59it/s, loss=2.16, v_num=0]
Epoch 69: 100%|██████████| 97/97 [00:14<00:00,  6.59it/s, loss=2.16, v_num=0]
Epoch 69:   0%|          | 0/97 [00:00<?, ?it/s, loss=2.16, v_num=0]
Epoch 70:   0%|          | 0/97 [00:00<?, ?it/s, loss=2.16, v_num=0]
Epoch 70:   1%|          | 1/97 [00:01<02:18,  1.44s/it, loss=2.16, v_num=0]
Epoch 70:   1%|          | 1/97 [00:01<02:23,  1.50s/it, loss=2.16, v_num=0]
Epoch 70:   2%|▏         | 2/97 [00:01<01:15,  1.26it/s, loss=2.16, v_num=0]
Epoch 70:   2%|▏         | 2/97 [00:01<01:17,  1.22it/s, loss=2.16, v_num=0]
Epoch 70:   3%|▎         | 3/97 [00:01<00:54,  1.74it/s, loss=2.16, v_num=0]
Epoch 70:   3%|▎         | 3/97 [00:01<00:55,  1.68it/s, loss=2.17, v_num=0]
Epoch 70:   4%|▍         | 4/97 [00:01<00:43,  2.15it/s, loss=2.17, v_num=0]
Epoch 70:   4%|▍         | 4/97 [00:01<00:44,  2.08it/s, loss=2.16, v_num=0]
Epoch 70:   5%|▌         | 5/97 [00:01<00:36,  2.50it/s, loss=2.16, v_num=0]
Epoch 70:   5%|▌         | 5/97 [00:02<00:37,  2.43it/s, loss=2.17, v_num=0]
Epoch 70:   6%|▌         | 6/97 [00:02<00:32,  2.81it/s, loss=2.17, v_num=0]
Epoch 70:   6%|▌         | 6/97 [00:02<00:33,  2.74it/s, loss=2.16, v_num=0]
Epoch 70:   7%|▋         | 7/97 [00:02<00:29,  3.08it/s, loss=2.16, v_num=0]
Epoch 70:   7%|▋         | 7/97 [00:02<00:29,  3.01it/s, loss=2.16, v_num=0]
Epoch 70:   8%|▊         | 8/97 [00:02<00:26,  3.32it/s, loss=2.16, v_num=0]
Epoch 70:   8%|▊         | 8/97 [00:02<00:27,  3.25it/s, loss=2.16, v_num=0]
Epoch 70:   9%|▉         | 9/97 [00:02<00:24,  3.54it/s, loss=2.16, v_num=0]
Epoch 70:   9%|▉         | 9/97 [00:02<00:25,  3.46it/s, loss=2.16, v_num=0]
Epoch 70:  10%|█         | 10/97 [00:02<00:23,  3.72it/s, loss=2.16, v_num=0]
Epoch 70:  10%|█         | 10/97 [00:02<00:23,  3.64it/s, loss=2.16, v_num=0]
Epoch 70:  11%|█▏        | 11/97 [00:02<00:22,  3.89it/s, loss=2.16, v_num=0]
Epoch 70:  11%|█▏        | 11/97 [00:02<00:22,  3.81it/s, loss=2.15, v_num=0]
Epoch 70:  12%|█▏        | 12/97 [00:02<00:21,  4.05it/s, loss=2.15, v_num=0]
Epoch 70:  12%|█▏        | 12/97 [00:03<00:21,  3.97it/s, loss=2.16, v_num=0]
Epoch 70:  13%|█▎        | 13/97 [00:03<00:20,  4.19it/s, loss=2.16, v_num=0]
Epoch 70:  13%|█▎        | 13/97 [00:03<00:20,  4.12it/s, loss=2.16, v_num=0]
Epoch 70:  14%|█▍        | 14/97 [00:03<00:19,  4.33it/s, loss=2.16, v_num=0]
Epoch 70:  14%|█▍        | 14/97 [00:03<00:19,  4.25it/s, loss=2.16, v_num=0]
Epoch 70:  15%|█▌        | 15/97 [00:03<00:18,  4.45it/s, loss=2.16, v_num=0]
Epoch 70:  15%|█▌        | 15/97 [00:03<00:18,  4.38it/s, loss=2.16, v_num=0]
Epoch 70:  16%|█▋        | 16/97 [00:03<00:17,  4.56it/s, loss=2.16, v_num=0]
Epoch 70:  16%|█▋        | 16/97 [00:03<00:18,  4.49it/s, loss=2.16, v_num=0]
Epoch 70:  18%|█▊        | 17/97 [00:03<00:17,  4.67it/s, loss=2.16, v_num=0]
Epoch 70:  18%|█▊        | 17/97 [00:03<00:17,  4.59it/s, loss=2.15, v_num=0]
Epoch 70:  19%|█▊        | 18/97 [00:03<00:16,  4.76it/s, loss=2.15, v_num=0]
Epoch 70:  19%|█▊        | 18/97 [00:03<00:16,  4.69it/s, loss=2.16, v_num=0]
Epoch 70:  20%|█▉        | 19/97 [00:03<00:16,  4.85it/s, loss=2.16, v_num=0]
Epoch 70:  20%|█▉        | 19/97 [00:03<00:16,  4.78it/s, loss=2.16, v_num=0]
Epoch 70:  21%|██        | 20/97 [00:04<00:15,  4.93it/s, loss=2.16, v_num=0]
Epoch 70:  21%|██        | 20/97 [00:04<00:15,  4.86it/s, loss=2.16, v_num=0]
Epoch 70:  22%|██▏       | 21/97 [00:04<00:15,  5.01it/s, loss=2.16, v_num=0]
Epoch 70:  22%|██▏       | 21/97 [00:04<00:15,  4.94it/s, loss=2.16, v_num=0]
Epoch 70:  23%|██▎       | 22/97 [00:04<00:14,  5.08it/s, loss=2.16, v_num=0]
Epoch 70:  23%|██▎       | 22/97 [00:04<00:14,  5.01it/s, loss=2.16, v_num=0]
Epoch 70:  24%|██▎       | 23/97 [00:04<00:14,  5.14it/s, loss=2.16, v_num=0]
Epoch 70:  24%|██▎       | 23/97 [00:04<00:14,  5.08it/s, loss=2.16, v_num=0]
Epoch 70:  25%|██▍       | 24/97 [00:04<00:14,  5.21it/s, loss=2.16, v_num=0]
Epoch 70:  25%|██▍       | 24/97 [00:04<00:14,  5.15it/s, loss=2.16, v_num=0]
Epoch 70:  26%|██▌       | 25/97 [00:04<00:13,  5.26it/s, loss=2.16, v_num=0]
Epoch 70:  26%|██▌       | 25/97 [00:04<00:13,  5.20it/s, loss=2.15, v_num=0]
Epoch 70:  27%|██▋       | 26/97 [00:04<00:13,  5.32it/s, loss=2.15, v_num=0]
Epoch 70:  27%|██▋       | 26/97 [00:04<00:13,  5.26it/s, loss=2.15, v_num=0]
Epoch 70:  28%|██▊       | 27/97 [00:05<00:13,  5.37it/s, loss=2.15, v_num=0]
Epoch 70:  28%|██▊       | 27/97 [00:05<00:13,  5.31it/s, loss=2.16, v_num=0]
Epoch 70:  29%|██▉       | 28/97 [00:05<00:12,  5.42it/s, loss=2.16, v_num=0]
Epoch 70:  29%|██▉       | 28/97 [00:05<00:12,  5.37it/s, loss=2.16, v_num=0]
Epoch 70:  30%|██▉       | 29/97 [00:05<00:12,  5.47it/s, loss=2.16, v_num=0]
Epoch 70:  30%|██▉       | 29/97 [00:05<00:12,  5.41it/s, loss=2.16, v_num=0]
Epoch 70:  31%|███       | 30/97 [00:05<00:12,  5.52it/s, loss=2.16, v_num=0]
Epoch 70:  31%|███       | 30/97 [00:05<00:12,  5.46it/s, loss=2.16, v_num=0]
Epoch 70:  32%|███▏      | 31/97 [00:05<00:11,  5.56it/s, loss=2.16, v_num=0]
Epoch 70:  32%|███▏      | 31/97 [00:05<00:11,  5.50it/s, loss=2.16, v_num=0]
Epoch 70:  33%|███▎      | 32/97 [00:05<00:11,  5.60it/s, loss=2.16, v_num=0]
Epoch 70:  33%|███▎      | 32/97 [00:05<00:11,  5.55it/s, loss=2.17, v_num=0]
Epoch 70:  34%|███▍      | 33/97 [00:05<00:11,  5.65it/s, loss=2.17, v_num=0]
Epoch 70:  34%|███▍      | 33/97 [00:05<00:11,  5.59it/s, loss=2.17, v_num=0]
Epoch 70:  35%|███▌      | 34/97 [00:05<00:11,  5.68it/s, loss=2.17, v_num=0]
Epoch 70:  35%|███▌      | 34/97 [00:06<00:11,  5.63it/s, loss=2.16, v_num=0]
Epoch 70:  36%|███▌      | 35/97 [00:06<00:10,  5.72it/s, loss=2.16, v_num=0]
Epoch 70:  36%|███▌      | 35/97 [00:06<00:10,  5.67it/s, loss=2.15, v_num=0]
Epoch 70:  37%|███▋      | 36/97 [00:06<00:10,  5.75it/s, loss=2.15, v_num=0]
Epoch 70:  37%|███▋      | 36/97 [00:06<00:10,  5.70it/s, loss=2.15, v_num=0]
Epoch 70:  38%|███▊      | 37/97 [00:06<00:10,  5.79it/s, loss=2.15, v_num=0]
Epoch 70:  38%|███▊      | 37/97 [00:06<00:10,  5.74it/s, loss=2.16, v_num=0]
Epoch 70:  39%|███▉      | 38/97 [00:06<00:10,  5.82it/s, loss=2.16, v_num=0]
Epoch 70:  39%|███▉      | 38/97 [00:06<00:10,  5.77it/s, loss=2.16, v_num=0]
Epoch 70:  40%|████      | 39/97 [00:06<00:09,  5.85it/s, loss=2.16, v_num=0]
Epoch 70:  40%|████      | 39/97 [00:06<00:10,  5.80it/s, loss=2.15, v_num=0]
Epoch 70:  41%|████      | 40/97 [00:06<00:09,  5.87it/s, loss=2.15, v_num=0]
Epoch 70:  41%|████      | 40/97 [00:06<00:09,  5.83it/s, loss=2.15, v_num=0]
Epoch 70:  42%|████▏     | 41/97 [00:06<00:09,  5.90it/s, loss=2.15, v_num=0]
Epoch 70:  42%|████▏     | 41/97 [00:07<00:09,  5.86it/s, loss=2.15, v_num=0]
Epoch 70:  43%|████▎     | 42/97 [00:07<00:09,  5.93it/s, loss=2.15, v_num=0]
Epoch 70:  43%|████▎     | 42/97 [00:07<00:09,  5.88it/s, loss=2.15, v_num=0]
Epoch 70:  44%|████▍     | 43/97 [00:07<00:09,  5.95it/s, loss=2.15, v_num=0]
Epoch 70:  44%|████▍     | 43/97 [00:07<00:09,  5.91it/s, loss=2.14, v_num=0]
Epoch 70:  45%|████▌     | 44/97 [00:07<00:08,  5.98it/s, loss=2.14, v_num=0]
Epoch 70:  45%|████▌     | 44/97 [00:07<00:08,  5.93it/s, loss=2.14, v_num=0]
Epoch 70:  46%|████▋     | 45/97 [00:07<00:08,  6.00it/s, loss=2.14, v_num=0]
Epoch 70:  46%|████▋     | 45/97 [00:07<00:08,  5.96it/s, loss=2.14, v_num=0]
Epoch 70:  47%|████▋     | 46/97 [00:07<00:08,  6.03it/s, loss=2.14, v_num=0]
Epoch 70:  47%|████▋     | 46/97 [00:07<00:08,  5.98it/s, loss=2.14, v_num=0]
Epoch 70:  48%|████▊     | 47/97 [00:07<00:08,  6.05it/s, loss=2.14, v_num=0]
Epoch 70:  48%|████▊     | 47/97 [00:07<00:08,  6.01it/s, loss=2.14, v_num=0]
Epoch 70:  49%|████▉     | 48/97 [00:07<00:08,  6.07it/s, loss=2.14, v_num=0]
Epoch 70:  49%|████▉     | 48/97 [00:07<00:08,  6.03it/s, loss=2.14, v_num=0]
Epoch 70:  51%|█████     | 49/97 [00:08<00:07,  6.09it/s, loss=2.14, v_num=0]
Epoch 70:  51%|█████     | 49/97 [00:08<00:07,  6.05it/s, loss=2.14, v_num=0]
Epoch 70:  52%|█████▏    | 50/97 [00:08<00:07,  6.10it/s, loss=2.14, v_num=0]
Epoch 70:  52%|█████▏    | 50/97 [00:08<00:07,  6.06it/s, loss=2.14, v_num=0]
Epoch 70:  53%|█████▎    | 51/97 [00:08<00:07,  6.12it/s, loss=2.14, v_num=0]
Epoch 70:  53%|█████▎    | 51/97 [00:08<00:07,  6.08it/s, loss=2.15, v_num=0]
Epoch 70:  54%|█████▎    | 52/97 [00:08<00:07,  6.14it/s, loss=2.15, v_num=0]
Epoch 70:  54%|█████▎    | 52/97 [00:08<00:07,  6.10it/s, loss=2.15, v_num=0]
Epoch 70:  55%|█████▍    | 53/97 [00:08<00:07,  6.15it/s, loss=2.15, v_num=0]
Epoch 70:  55%|█████▍    | 53/97 [00:08<00:07,  6.12it/s, loss=2.15, v_num=0]
Epoch 70:  56%|█████▌    | 54/97 [00:08<00:06,  6.17it/s, loss=2.15, v_num=0]
Epoch 70:  56%|█████▌    | 54/97 [00:08<00:07,  6.13it/s, loss=2.15, v_num=0]
Epoch 70:  57%|█████▋    | 55/97 [00:08<00:06,  6.18it/s, loss=2.15, v_num=0]
Epoch 70:  57%|█████▋    | 55/97 [00:08<00:06,  6.15it/s, loss=2.16, v_num=0]
Epoch 70:  58%|█████▊    | 56/97 [00:09<00:06,  6.20it/s, loss=2.16, v_num=0]
Epoch 70:  58%|█████▊    | 56/97 [00:09<00:06,  6.16it/s, loss=2.16, v_num=0]
Epoch 70:  59%|█████▉    | 57/97 [00:09<00:06,  6.21it/s, loss=2.16, v_num=0]
Epoch 70:  59%|█████▉    | 57/97 [00:09<00:06,  6.18it/s, loss=2.16, v_num=0]
Epoch 70:  60%|█████▉    | 58/97 [00:09<00:06,  6.23it/s, loss=2.16, v_num=0]
Epoch 70:  60%|█████▉    | 58/97 [00:09<00:06,  6.19it/s, loss=2.15, v_num=0]
Epoch 70:  61%|██████    | 59/97 [00:09<00:06,  6.25it/s, loss=2.15, v_num=0]
Epoch 70:  61%|██████    | 59/97 [00:09<00:06,  6.21it/s, loss=2.15, v_num=0]
Epoch 70:  62%|██████▏   | 60/97 [00:09<00:05,  6.26it/s, loss=2.15, v_num=0]
Epoch 70:  62%|██████▏   | 60/97 [00:09<00:05,  6.22it/s, loss=2.15, v_num=0]
Epoch 70:  63%|██████▎   | 61/97 [00:09<00:05,  6.27it/s, loss=2.15, v_num=0]
Epoch 70:  63%|██████▎   | 61/97 [00:09<00:05,  6.24it/s, loss=2.16, v_num=0]
Epoch 70:  64%|██████▍   | 62/97 [00:09<00:05,  6.29it/s, loss=2.16, v_num=0]
Epoch 70:  64%|██████▍   | 62/97 [00:09<00:05,  6.25it/s, loss=2.16, v_num=0]
Epoch 70:  65%|██████▍   | 63/97 [00:09<00:05,  6.30it/s, loss=2.16, v_num=0]
Epoch 70:  65%|██████▍   | 63/97 [00:10<00:05,  6.27it/s, loss=2.16, v_num=0]
Epoch 70:  66%|██████▌   | 64/97 [00:10<00:05,  6.31it/s, loss=2.16, v_num=0]
Epoch 70:  66%|██████▌   | 64/97 [00:10<00:05,  6.28it/s, loss=2.17, v_num=0]
Epoch 70:  67%|██████▋   | 65/97 [00:10<00:05,  6.33it/s, loss=2.17, v_num=0]
Epoch 70:  67%|██████▋   | 65/97 [00:10<00:05,  6.29it/s, loss=2.17, v_num=0]
Epoch 70:  68%|██████▊   | 66/97 [00:10<00:04,  6.34it/s, loss=2.17, v_num=0]
Epoch 70:  68%|██████▊   | 66/97 [00:10<00:04,  6.31it/s, loss=2.17, v_num=0]
Epoch 70:  69%|██████▉   | 67/97 [00:10<00:04,  6.36it/s, loss=2.17, v_num=0]
Epoch 70:  69%|██████▉   | 67/97 [00:10<00:04,  6.32it/s, loss=2.17, v_num=0]
Epoch 70:  70%|███████   | 68/97 [00:10<00:04,  6.37it/s, loss=2.17, v_num=0]
Epoch 70:  70%|███████   | 68/97 [00:10<00:04,  6.33it/s, loss=2.17, v_num=0]
Epoch 70:  71%|███████   | 69/97 [00:10<00:04,  6.37it/s, loss=2.17, v_num=0]
Epoch 70:  71%|███████   | 69/97 [00:10<00:04,  6.34it/s, loss=2.17, v_num=0]
Epoch 70:  72%|███████▏  | 70/97 [00:10<00:04,  6.39it/s, loss=2.17, v_num=0]
Epoch 70:  72%|███████▏  | 70/97 [00:11<00:04,  6.35it/s, loss=2.17, v_num=0]
Epoch 70:  73%|███████▎  | 71/97 [00:11<00:04,  6.40it/s, loss=2.17, v_num=0]
Epoch 70:  73%|███████▎  | 71/97 [00:11<00:04,  6.37it/s, loss=2.17, v_num=0]
Epoch 70:  74%|███████▍  | 72/97 [00:11<00:03,  6.41it/s, loss=2.17, v_num=0]
Epoch 70:  74%|███████▍  | 72/97 [00:11<00:03,  6.38it/s, loss=2.17, v_num=0]
Epoch 70:  75%|███████▌  | 73/97 [00:11<00:03,  6.42it/s, loss=2.17, v_num=0]
Epoch 70:  75%|███████▌  | 73/97 [00:11<00:03,  6.39it/s, loss=2.17, v_num=0]
Epoch 70:  76%|███████▋  | 74/97 [00:11<00:03,  6.43it/s, loss=2.17, v_num=0]
Epoch 70:  76%|███████▋  | 74/97 [00:11<00:03,  6.40it/s, loss=2.17, v_num=0]
Epoch 70:  77%|███████▋  | 75/97 [00:11<00:03,  6.44it/s, loss=2.17, v_num=0]
Epoch 70:  77%|███████▋  | 75/97 [00:11<00:03,  6.41it/s, loss=2.17, v_num=0]
Epoch 70:  78%|███████▊  | 76/97 [00:11<00:03,  6.45it/s, loss=2.17, v_num=0]
Epoch 70:  78%|███████▊  | 76/97 [00:11<00:03,  6.42it/s, loss=2.18, v_num=0]
Epoch 70:  79%|███████▉  | 77/97 [00:11<00:03,  6.46it/s, loss=2.18, v_num=0]
Epoch 70:  79%|███████▉  | 77/97 [00:11<00:03,  6.43it/s, loss=2.18, v_num=0]
Epoch 70:  80%|████████  | 78/97 [00:12<00:02,  6.47it/s, loss=2.18, v_num=0]
Epoch 70:  80%|████████  | 78/97 [00:12<00:02,  6.44it/s, loss=2.18, v_num=0]
Epoch 70:  81%|████████▏ | 79/97 [00:12<00:02,  6.47it/s, loss=2.18, v_num=0]
Epoch 70:  81%|████████▏ | 79/97 [00:12<00:02,  6.45it/s, loss=2.18, v_num=0]
Epoch 70:  82%|████████▏ | 80/97 [00:12<00:02,  6.49it/s, loss=2.18, v_num=0]
Epoch 70:  82%|████████▏ | 80/97 [00:12<00:02,  6.45it/s, loss=2.17, v_num=0]
Epoch 70:  84%|████████▎ | 81/97 [00:12<00:02,  6.49it/s, loss=2.17, v_num=0]
Epoch 70:  84%|████████▎ | 81/97 [00:12<00:02,  6.46it/s, loss=2.17, v_num=0]
Epoch 70:  85%|████████▍ | 82/97 [00:12<00:02,  6.49it/s, loss=2.17, v_num=0]
Epoch 70:  85%|████████▍ | 82/97 [00:12<00:02,  6.46it/s, loss=2.17, v_num=0]
Epoch 70:  86%|████████▌ | 83/97 [00:12<00:02,  6.50it/s, loss=2.17, v_num=0]
Epoch 70:  86%|████████▌ | 83/97 [00:12<00:02,  6.47it/s, loss=2.17, v_num=0]
Epoch 70:  87%|████████▋ | 84/97 [00:12<00:01,  6.51it/s, loss=2.17, v_num=0]
Epoch 70:  87%|████████▋ | 84/97 [00:12<00:02,  6.48it/s, loss=2.16, v_num=0]
Epoch 70:  88%|████████▊ | 85/97 [00:13<00:01,  6.51it/s, loss=2.16, v_num=0]
Epoch 70:  88%|████████▊ | 85/97 [00:13<00:01,  6.48it/s, loss=2.16, v_num=0]
Epoch 70:  89%|████████▊ | 86/97 [00:13<00:01,  6.52it/s, loss=2.16, v_num=0]
Epoch 70:  89%|████████▊ | 86/97 [00:13<00:01,  6.49it/s, loss=2.17, v_num=0]
Epoch 70:  90%|████████▉ | 87/97 [00:13<00:01,  6.53it/s, loss=2.17, v_num=0]
Epoch 70:  90%|████████▉ | 87/97 [00:13<00:01,  6.50it/s, loss=2.17, v_num=0]
Epoch 70:  91%|█████████ | 88/97 [00:13<00:01,  6.54it/s, loss=2.17, v_num=0]
Epoch 70:  91%|█████████ | 88/97 [00:13<00:01,  6.51it/s, loss=2.17, v_num=0]
Epoch 70:  92%|█████████▏| 89/97 [00:13<00:01,  6.54it/s, loss=2.17, v_num=0]
Epoch 70:  92%|█████████▏| 89/97 [00:13<00:01,  6.52it/s, loss=2.16, v_num=0]
Epoch 70:  93%|█████████▎| 90/97 [00:13<00:01,  6.55it/s, loss=2.16, v_num=0]
Epoch 70:  93%|█████████▎| 90/97 [00:13<00:01,  6.53it/s, loss=2.16, v_num=0]
Epoch 70:  94%|█████████▍| 91/97 [00:13<00:00,  6.56it/s, loss=2.16, v_num=0]
Epoch 70:  94%|█████████▍| 91/97 [00:13<00:00,  6.53it/s, loss=2.15, v_num=0]
Epoch 70:  95%|█████████▍| 92/97 [00:14<00:00,  6.57it/s, loss=2.15, v_num=0]
Epoch 70:  95%|█████████▍| 92/97 [00:14<00:00,  6.54it/s, loss=2.15, v_num=0]
Epoch 70:  96%|█████████▌| 93/97 [00:14<00:00,  6.58it/s, loss=2.15, v_num=0]
Epoch 70:  96%|█████████▌| 93/97 [00:14<00:00,  6.55it/s, loss=2.14, v_num=0]
Epoch 70:  97%|█████████▋| 94/97 [00:14<00:00,  6.58it/s, loss=2.14, v_num=0]
Epoch 70:  97%|█████████▋| 94/97 [00:14<00:00,  6.56it/s, loss=2.14, v_num=0]
Epoch 70:  98%|█████████▊| 95/97 [00:14<00:00,  6.59it/s, loss=2.14, v_num=0]
Epoch 70:  98%|█████████▊| 95/97 [00:14<00:00,  6.56it/s, loss=2.14, v_num=0]
Epoch 70:  99%|█████████▉| 96/97 [00:14<00:00,  6.60it/s, loss=2.14, v_num=0]
Epoch 70:  99%|█████████▉| 96/97 [00:14<00:00,  6.57it/s, loss=2.14, v_num=0]
Epoch 70: 100%|██████████| 97/97 [00:14<00:00,  6.60it/s, loss=2.14, v_num=0]
Epoch 70: 100%|██████████| 97/97 [00:14<00:00,  6.58it/s, loss=2.14, v_num=0]
Epoch 70: 100%|██████████| 97/97 [00:14<00:00,  6.58it/s, loss=2.14, v_num=0]
Epoch 70:   0%|          | 0/97 [00:00<?, ?it/s, loss=2.14, v_num=0]
Epoch 71:   0%|          | 0/97 [00:00<?, ?it/s, loss=2.14, v_num=0]
Epoch 71:   1%|          | 1/97 [00:01<02:22,  1.48s/it, loss=2.14, v_num=0]
Epoch 71:   1%|          | 1/97 [00:01<02:27,  1.54s/it, loss=2.14, v_num=0]
Epoch 71:   2%|▏         | 2/97 [00:01<01:16,  1.24it/s, loss=2.14, v_num=0]
Epoch 71:   2%|▏         | 2/97 [00:01<01:19,  1.19it/s, loss=2.14, v_num=0]
Epoch 71:   3%|▎         | 3/97 [00:01<00:55,  1.71it/s, loss=2.14, v_num=0]
Epoch 71:   3%|▎         | 3/97 [00:01<00:56,  1.65it/s, loss=2.15, v_num=0]
Epoch 71:   4%|▍         | 4/97 [00:01<00:44,  2.11it/s, loss=2.15, v_num=0]
Epoch 71:   4%|▍         | 4/97 [00:01<00:45,  2.05it/s, loss=2.15, v_num=0]
Epoch 71:   5%|▌         | 5/97 [00:02<00:37,  2.46it/s, loss=2.15, v_num=0]
Epoch 71:   5%|▌         | 5/97 [00:02<00:38,  2.40it/s, loss=2.15, v_num=0]
Epoch 71:   6%|▌         | 6/97 [00:02<00:32,  2.77it/s, loss=2.15, v_num=0]
Epoch 71:   6%|▌         | 6/97 [00:02<00:33,  2.70it/s, loss=2.15, v_num=0]
Epoch 71:   7%|▋         | 7/97 [00:02<00:29,  3.04it/s, loss=2.15, v_num=0]
Epoch 71:   7%|▋         | 7/97 [00:02<00:30,  2.97it/s, loss=2.15, v_num=0]
Epoch 71:   8%|▊         | 8/97 [00:02<00:27,  3.28it/s, loss=2.15, v_num=0]
Epoch 71:   8%|▊         | 8/97 [00:02<00:27,  3.20it/s, loss=2.15, v_num=0]
Epoch 71:   9%|▉         | 9/97 [00:02<00:25,  3.48it/s, loss=2.15, v_num=0]
Epoch 71:   9%|▉         | 9/97 [00:02<00:25,  3.41it/s, loss=2.14, v_num=0]
Epoch 71:  10%|█         | 10/97 [00:02<00:23,  3.67it/s, loss=2.14, v_num=0]
Epoch 71:  10%|█         | 10/97 [00:02<00:24,  3.60it/s, loss=2.14, v_num=0]
Epoch 71:  11%|█▏        | 11/97 [00:02<00:22,  3.84it/s, loss=2.14, v_num=0]
Epoch 71:  11%|█▏        | 11/97 [00:02<00:22,  3.77it/s, loss=2.14, v_num=0]
Epoch 71:  12%|█▏        | 12/97 [00:02<00:21,  4.00it/s, loss=2.14, v_num=0]
Epoch 71:  12%|█▏        | 12/97 [00:03<00:21,  3.93it/s, loss=2.14, v_num=0]
Epoch 71:  13%|█▎        | 13/97 [00:03<00:20,  4.16it/s, loss=2.14, v_num=0]
Epoch 71:  13%|█▎        | 13/97 [00:03<00:20,  4.08it/s, loss=2.13, v_num=0]
Epoch 71:  14%|█▍        | 14/97 [00:03<00:19,  4.29it/s, loss=2.13, v_num=0]
Epoch 71:  14%|█▍        | 14/97 [00:03<00:19,  4.21it/s, loss=2.14, v_num=0]
Epoch 71:  15%|█▌        | 15/97 [00:03<00:18,  4.41it/s, loss=2.14, v_num=0]
Epoch 71:  15%|█▌        | 15/97 [00:03<00:18,  4.34it/s, loss=2.13, v_num=0]
Epoch 71:  16%|█▋        | 16/97 [00:03<00:17,  4.52it/s, loss=2.13, v_num=0]
Epoch 71:  16%|█▋        | 16/97 [00:03<00:18,  4.45it/s, loss=2.13, v_num=0]
Epoch 71:  18%|█▊        | 17/97 [00:03<00:17,  4.62it/s, loss=2.13, v_num=0]
Epoch 71:  18%|█▊        | 17/97 [00:03<00:17,  4.55it/s, loss=2.13, v_num=0]
Epoch 71:  19%|█▊        | 18/97 [00:03<00:16,  4.72it/s, loss=2.13, v_num=0]
Epoch 71:  19%|█▊        | 18/97 [00:03<00:16,  4.65it/s, loss=2.15, v_num=0]
Epoch 71:  20%|█▉        | 19/97 [00:03<00:16,  4.81it/s, loss=2.15, v_num=0]
Epoch 71:  20%|█▉        | 19/97 [00:04<00:16,  4.74it/s, loss=2.15, v_num=0]
Epoch 71:  21%|██        | 20/97 [00:04<00:15,  4.89it/s, loss=2.15, v_num=0]
Epoch 71:  21%|██        | 20/97 [00:04<00:15,  4.82it/s, loss=2.14, v_num=0]
Epoch 71:  22%|██▏       | 21/97 [00:04<00:15,  4.97it/s, loss=2.14, v_num=0]
Epoch 71:  22%|██▏       | 21/97 [00:04<00:15,  4.90it/s, loss=2.13, v_num=0]
Epoch 71:  23%|██▎       | 22/97 [00:04<00:14,  5.04it/s, loss=2.13, v_num=0]
Epoch 71:  23%|██▎       | 22/97 [00:04<00:15,  4.97it/s, loss=2.14, v_num=0]
Epoch 71:  24%|██▎       | 23/97 [00:04<00:14,  5.10it/s, loss=2.14, v_num=0]
Epoch 71:  24%|██▎       | 23/97 [00:04<00:14,  5.04it/s, loss=2.13, v_num=0]
Epoch 71:  25%|██▍       | 24/97 [00:04<00:14,  5.17it/s, loss=2.13, v_num=0]
Epoch 71:  25%|██▍       | 24/97 [00:04<00:14,  5.10it/s, loss=2.14, v_num=0]
Epoch 71:  26%|██▌       | 25/97 [00:04<00:13,  5.20it/s, loss=2.14, v_num=0]
Epoch 71:  26%|██▌       | 25/97 [00:04<00:14,  5.14it/s, loss=2.14, v_num=0]
Epoch 71:  27%|██▋       | 26/97 [00:04<00:13,  5.25it/s, loss=2.14, v_num=0]
Epoch 71:  27%|██▋       | 26/97 [00:05<00:13,  5.20it/s, loss=2.14, v_num=0]
Epoch 71:  28%|██▊       | 27/97 [00:05<00:13,  5.31it/s, loss=2.14, v_num=0]
Epoch 71:  28%|██▊       | 27/97 [00:05<00:13,  5.25it/s, loss=2.14, v_num=0]
Epoch 71:  29%|██▉       | 28/97 [00:05<00:12,  5.37it/s, loss=2.14, v_num=0]
Epoch 71:  29%|██▉       | 28/97 [00:05<00:13,  5.31it/s, loss=2.14, v_num=0]
Epoch 71:  30%|██▉       | 29/97 [00:05<00:12,  5.41it/s, loss=2.14, v_num=0]
Epoch 71:  30%|██▉       | 29/97 [00:05<00:12,  5.35it/s, loss=2.15, v_num=0]
Epoch 71:  31%|███       | 30/97 [00:05<00:12,  5.46it/s, loss=2.15, v_num=0]
Epoch 71:  31%|███       | 30/97 [00:05<00:12,  5.40it/s, loss=2.14, v_num=0]
Epoch 71:  32%|███▏      | 31/97 [00:05<00:11,  5.50it/s, loss=2.14, v_num=0]
Epoch 71:  32%|███▏      | 31/97 [00:05<00:12,  5.45it/s, loss=2.14, v_num=0]
Epoch 71:  33%|███▎      | 32/97 [00:05<00:11,  5.54it/s, loss=2.14, v_num=0]
Epoch 71:  33%|███▎      | 32/97 [00:05<00:11,  5.49it/s, loss=2.15, v_num=0]
Epoch 71:  34%|███▍      | 33/97 [00:05<00:11,  5.58it/s, loss=2.15, v_num=0]
Epoch 71:  34%|███▍      | 33/97 [00:05<00:11,  5.53it/s, loss=2.15, v_num=0]
Epoch 71:  35%|███▌      | 34/97 [00:06<00:11,  5.62it/s, loss=2.15, v_num=0]
Epoch 71:  35%|███▌      | 34/97 [00:06<00:11,  5.57it/s, loss=2.15, v_num=0]
Epoch 71:  36%|███▌      | 35/97 [00:06<00:10,  5.66it/s, loss=2.15, v_num=0]
Epoch 71:  36%|███▌      | 35/97 [00:06<00:11,  5.61it/s, loss=2.15, v_num=0]
Epoch 71:  37%|███▋      | 36/97 [00:06<00:10,  5.70it/s, loss=2.15, v_num=0]
Epoch 71:  37%|███▋      | 36/97 [00:06<00:10,  5.65it/s, loss=2.14, v_num=0]
Epoch 71:  38%|███▊      | 37/97 [00:06<00:10,  5.73it/s, loss=2.14, v_num=0]
Epoch 71:  38%|███▊      | 37/97 [00:06<00:10,  5.68it/s, loss=2.14, v_num=0]
Epoch 71:  39%|███▉      | 38/97 [00:06<00:10,  5.76it/s, loss=2.14, v_num=0]
Epoch 71:  39%|███▉      | 38/97 [00:06<00:10,  5.71it/s, loss=2.13, v_num=0]
Epoch 71:  40%|████      | 39/97 [00:06<00:10,  5.79it/s, loss=2.13, v_num=0]
Epoch 71:  40%|████      | 39/97 [00:06<00:10,  5.75it/s, loss=2.12, v_num=0]
Epoch 71:  41%|████      | 40/97 [00:06<00:09,  5.82it/s, loss=2.12, v_num=0]
Epoch 71:  41%|████      | 40/97 [00:06<00:09,  5.78it/s, loss=2.13, v_num=0]
Epoch 71:  42%|████▏     | 41/97 [00:07<00:09,  5.86it/s, loss=2.13, v_num=0]
Epoch 71:  42%|████▏     | 41/97 [00:07<00:09,  5.81it/s, loss=2.14, v_num=0]
Epoch 71:  43%|████▎     | 42/97 [00:07<00:09,  5.88it/s, loss=2.14, v_num=0]
Epoch 71:  43%|████▎     | 42/97 [00:07<00:09,  5.84it/s, loss=2.14, v_num=0]
Epoch 71:  44%|████▍     | 43/97 [00:07<00:09,  5.91it/s, loss=2.14, v_num=0]
Epoch 71:  44%|████▍     | 43/97 [00:07<00:09,  5.86it/s, loss=2.13, v_num=0]
Epoch 71:  45%|████▌     | 44/97 [00:07<00:08,  5.93it/s, loss=2.13, v_num=0]
Epoch 71:  45%|████▌     | 44/97 [00:07<00:09,  5.89it/s, loss=2.12, v_num=0]
Epoch 71:  46%|████▋     | 45/97 [00:07<00:08,  5.96it/s, loss=2.12, v_num=0]
Epoch 71:  46%|████▋     | 45/97 [00:07<00:08,  5.91it/s, loss=2.12, v_num=0]
Epoch 71:  47%|████▋     | 46/97 [00:07<00:08,  5.98it/s, loss=2.12, v_num=0]
Epoch 71:  47%|████▋     | 46/97 [00:07<00:08,  5.94it/s, loss=2.12, v_num=0]
Epoch 71:  48%|████▊     | 47/97 [00:07<00:08,  6.00it/s, loss=2.12, v_num=0]
Epoch 71:  48%|████▊     | 47/97 [00:07<00:08,  5.96it/s, loss=2.13, v_num=0]
Epoch 71:  49%|████▉     | 48/97 [00:07<00:08,  6.02it/s, loss=2.13, v_num=0]
Epoch 71:  49%|████▉     | 48/97 [00:08<00:08,  5.98it/s, loss=2.13, v_num=0]
Epoch 71:  51%|█████     | 49/97 [00:08<00:07,  6.05it/s, loss=2.13, v_num=0]
Epoch 71:  51%|█████     | 49/97 [00:08<00:07,  6.00it/s, loss=2.12, v_num=0]
Epoch 71:  52%|█████▏    | 50/97 [00:08<00:07,  6.07it/s, loss=2.12, v_num=0]
Epoch 71:  52%|█████▏    | 50/97 [00:08<00:07,  6.02it/s, loss=2.13, v_num=0]
Epoch 71:  53%|█████▎    | 51/97 [00:08<00:07,  6.09it/s, loss=2.13, v_num=0]
Epoch 71:  53%|█████▎    | 51/97 [00:08<00:07,  6.05it/s, loss=2.13, v_num=0]
Epoch 71:  54%|█████▎    | 52/97 [00:08<00:07,  6.11it/s, loss=2.13, v_num=0]
Epoch 71:  54%|█████▎    | 52/97 [00:08<00:07,  6.07it/s, loss=2.13, v_num=0]
Epoch 71:  55%|█████▍    | 53/97 [00:08<00:07,  6.12it/s, loss=2.13, v_num=0]
Epoch 71:  55%|█████▍    | 53/97 [00:08<00:07,  6.08it/s, loss=2.13, v_num=0]
Epoch 71:  56%|█████▌    | 54/97 [00:08<00:07,  6.14it/s, loss=2.13, v_num=0]
Epoch 71:  56%|█████▌    | 54/97 [00:08<00:07,  6.10it/s, loss=2.12, v_num=0]
Epoch 71:  57%|█████▋    | 55/97 [00:08<00:06,  6.16it/s, loss=2.12, v_num=0]
Epoch 71:  57%|█████▋    | 55/97 [00:08<00:06,  6.12it/s, loss=2.12, v_num=0]
Epoch 71:  58%|█████▊    | 56/97 [00:09<00:06,  6.17it/s, loss=2.12, v_num=0]
Epoch 71:  58%|█████▊    | 56/97 [00:09<00:06,  6.13it/s, loss=2.12, v_num=0]
Epoch 71:  59%|█████▉    | 57/97 [00:09<00:06,  6.19it/s, loss=2.12, v_num=0]
Epoch 71:  59%|█████▉    | 57/97 [00:09<00:06,  6.15it/s, loss=2.13, v_num=0]
Epoch 71:  60%|█████▉    | 58/97 [00:09<00:06,  6.20it/s, loss=2.13, v_num=0]
Epoch 71:  60%|█████▉    | 58/97 [00:09<00:06,  6.17it/s, loss=2.12, v_num=0]
Epoch 71:  61%|██████    | 59/97 [00:09<00:06,  6.22it/s, loss=2.12, v_num=0]
Epoch 71:  61%|██████    | 59/97 [00:09<00:06,  6.18it/s, loss=2.12, v_num=0]
Epoch 71:  62%|██████▏   | 60/97 [00:09<00:05,  6.23it/s, loss=2.12, v_num=0]
Epoch 71:  62%|██████▏   | 60/97 [00:09<00:05,  6.20it/s, loss=2.11, v_num=0]
Epoch 71:  63%|██████▎   | 61/97 [00:09<00:05,  6.25it/s, loss=2.11, v_num=0]
Epoch 71:  63%|██████▎   | 61/97 [00:09<00:05,  6.21it/s, loss=2.12, v_num=0]
Epoch 71:  64%|██████▍   | 62/97 [00:09<00:05,  6.26it/s, loss=2.12, v_num=0]
Epoch 71:  64%|██████▍   | 62/97 [00:09<00:05,  6.23it/s, loss=2.12, v_num=0]
Epoch 71:  65%|██████▍   | 63/97 [00:10<00:05,  6.27it/s, loss=2.12, v_num=0]
Epoch 71:  65%|██████▍   | 63/97 [00:10<00:05,  6.24it/s, loss=2.12, v_num=0]
Epoch 71:  66%|██████▌   | 64/97 [00:10<00:05,  6.28it/s, loss=2.12, v_num=0]
Epoch 71:  66%|██████▌   | 64/97 [00:10<00:05,  6.25it/s, loss=2.12, v_num=0]
Epoch 71:  67%|██████▋   | 65/97 [00:10<00:05,  6.30it/s, loss=2.12, v_num=0]
Epoch 71:  67%|██████▋   | 65/97 [00:10<00:05,  6.26it/s, loss=2.12, v_num=0]
Epoch 71:  68%|██████▊   | 66/97 [00:10<00:04,  6.31it/s, loss=2.12, v_num=0]
Epoch 71:  68%|██████▊   | 66/97 [00:10<00:04,  6.28it/s, loss=2.12, v_num=0]
Epoch 71:  69%|██████▉   | 67/97 [00:10<00:04,  6.32it/s, loss=2.12, v_num=0]
Epoch 71:  69%|██████▉   | 67/97 [00:10<00:04,  6.29it/s, loss=2.12, v_num=0]
Epoch 71:  70%|███████   | 68/97 [00:10<00:04,  6.34it/s, loss=2.12, v_num=0]
Epoch 71:  70%|███████   | 68/97 [00:10<00:04,  6.30it/s, loss=2.13, v_num=0]
Epoch 71:  71%|███████   | 69/97 [00:10<00:04,  6.35it/s, loss=2.13, v_num=0]
Epoch 71:  71%|███████   | 69/97 [00:10<00:04,  6.31it/s, loss=2.13, v_num=0]
Epoch 71:  72%|███████▏  | 70/97 [00:11<00:04,  6.36it/s, loss=2.13, v_num=0]
Epoch 71:  72%|███████▏  | 70/97 [00:11<00:04,  6.33it/s, loss=2.12, v_num=0]
Epoch 71:  73%|███████▎  | 71/97 [00:11<00:04,  6.37it/s, loss=2.12, v_num=0]
Epoch 71:  73%|███████▎  | 71/97 [00:11<00:04,  6.34it/s, loss=2.12, v_num=0]
Epoch 71:  74%|███████▍  | 72/97 [00:11<00:03,  6.38it/s, loss=2.12, v_num=0]
Epoch 71:  74%|███████▍  | 72/97 [00:11<00:03,  6.35it/s, loss=2.13, v_num=0]
Epoch 71:  75%|███████▌  | 73/97 [00:11<00:03,  6.39it/s, loss=2.13, v_num=0]
Epoch 71:  75%|███████▌  | 73/97 [00:11<00:03,  6.36it/s, loss=2.13, v_num=0]
Epoch 71:  76%|███████▋  | 74/97 [00:11<00:03,  6.40it/s, loss=2.13, v_num=0]
Epoch 71:  76%|███████▋  | 74/97 [00:11<00:03,  6.37it/s, loss=2.14, v_num=0]
Epoch 71:  77%|███████▋  | 75/97 [00:11<00:03,  6.41it/s, loss=2.14, v_num=0]
Epoch 71:  77%|███████▋  | 75/97 [00:11<00:03,  6.38it/s, loss=2.14, v_num=0]
Epoch 71:  78%|███████▊  | 76/97 [00:11<00:03,  6.42it/s, loss=2.14, v_num=0]
Epoch 71:  78%|███████▊  | 76/97 [00:11<00:03,  6.39it/s, loss=2.14, v_num=0]
Epoch 71:  79%|███████▉  | 77/97 [00:11<00:03,  6.43it/s, loss=2.14, v_num=0]
Epoch 71:  79%|███████▉  | 77/97 [00:12<00:03,  6.40it/s, loss=2.15, v_num=0]
Epoch 71:  80%|████████  | 78/97 [00:12<00:02,  6.44it/s, loss=2.15, v_num=0]
Epoch 71:  80%|████████  | 78/97 [00:12<00:02,  6.41it/s, loss=2.15, v_num=0]
Epoch 71:  81%|████████▏ | 79/97 [00:12<00:02,  6.45it/s, loss=2.15, v_num=0]
Epoch 71:  81%|████████▏ | 79/97 [00:12<00:02,  6.42it/s, loss=2.15, v_num=0]
Epoch 71:  82%|████████▏ | 80/97 [00:12<00:02,  6.46it/s, loss=2.15, v_num=0]
Epoch 71:  82%|████████▏ | 80/97 [00:12<00:02,  6.43it/s, loss=2.15, v_num=0]
Epoch 71:  84%|████████▎ | 81/97 [00:12<00:02,  6.47it/s, loss=2.15, v_num=0]
Epoch 71:  84%|████████▎ | 81/97 [00:12<00:02,  6.44it/s, loss=2.15, v_num=0]
Epoch 71:  85%|████████▍ | 82/97 [00:12<00:02,  6.47it/s, loss=2.15, v_num=0]
Epoch 71:  85%|████████▍ | 82/97 [00:12<00:02,  6.44it/s, loss=2.14, v_num=0]
Epoch 71:  86%|████████▌ | 83/97 [00:12<00:02,  6.48it/s, loss=2.14, v_num=0]
Epoch 71:  86%|████████▌ | 83/97 [00:12<00:02,  6.45it/s, loss=2.14, v_num=0]
Epoch 71:  87%|████████▋ | 84/97 [00:12<00:02,  6.48it/s, loss=2.14, v_num=0]
Epoch 71:  87%|████████▋ | 84/97 [00:13<00:02,  6.46it/s, loss=2.14, v_num=0]
Epoch 71:  88%|████████▊ | 85/97 [00:13<00:01,  6.49it/s, loss=2.14, v_num=0]
Epoch 71:  88%|████████▊ | 85/97 [00:13<00:01,  6.46it/s, loss=2.14, v_num=0]
Epoch 71:  89%|████████▊ | 86/97 [00:13<00:01,  6.50it/s, loss=2.14, v_num=0]
Epoch 71:  89%|████████▊ | 86/97 [00:13<00:01,  6.47it/s, loss=2.15, v_num=0]
Epoch 71:  90%|████████▉ | 87/97 [00:13<00:01,  6.51it/s, loss=2.15, v_num=0]
Epoch 71:  90%|████████▉ | 87/97 [00:13<00:01,  6.48it/s, loss=2.15, v_num=0]
Epoch 71:  91%|█████████ | 88/97 [00:13<00:01,  6.52it/s, loss=2.15, v_num=0]
Epoch 71:  91%|█████████ | 88/97 [00:13<00:01,  6.49it/s, loss=2.14, v_num=0]
Epoch 71:  92%|█████████▏| 89/97 [00:13<00:01,  6.52it/s, loss=2.14, v_num=0]
Epoch 71:  92%|█████████▏| 89/97 [00:13<00:01,  6.49it/s, loss=2.15, v_num=0]
Epoch 71:  93%|█████████▎| 90/97 [00:13<00:01,  6.53it/s, loss=2.15, v_num=0]
Epoch 71:  93%|█████████▎| 90/97 [00:13<00:01,  6.50it/s, loss=2.15, v_num=0]
Epoch 71:  94%|█████████▍| 91/97 [00:13<00:00,  6.54it/s, loss=2.15, v_num=0]
Epoch 71:  94%|█████████▍| 91/97 [00:13<00:00,  6.51it/s, loss=2.14, v_num=0]
Epoch 71:  95%|█████████▍| 92/97 [00:14<00:00,  6.54it/s, loss=2.14, v_num=0]
Epoch 71:  95%|█████████▍| 92/97 [00:14<00:00,  6.52it/s, loss=2.15, v_num=0]
Epoch 71:  96%|█████████▌| 93/97 [00:14<00:00,  6.55it/s, loss=2.15, v_num=0]
Epoch 71:  96%|█████████▌| 93/97 [00:14<00:00,  6.52it/s, loss=2.15, v_num=0]
Epoch 71:  97%|█████████▋| 94/97 [00:14<00:00,  6.56it/s, loss=2.15, v_num=0]
Epoch 71:  97%|█████████▋| 94/97 [00:14<00:00,  6.53it/s, loss=2.14, v_num=0]
Epoch 71:  98%|█████████▊| 95/97 [00:14<00:00,  6.56it/s, loss=2.14, v_num=0]
Epoch 71:  98%|█████████▊| 95/97 [00:14<00:00,  6.54it/s, loss=2.14, v_num=0]
Epoch 71:  99%|█████████▉| 96/97 [00:14<00:00,  6.57it/s, loss=2.14, v_num=0]
Epoch 71:  99%|█████████▉| 96/97 [00:14<00:00,  6.54it/s, loss=2.14, v_num=0]
Epoch 71: 100%|██████████| 97/97 [00:14<00:00,  6.58it/s, loss=2.14, v_num=0]
Epoch 71: 100%|██████████| 97/97 [00:14<00:00,  6.55it/s, loss=2.14, v_num=0]
Epoch 71: 100%|██████████| 97/97 [00:14<00:00,  6.55it/s, loss=2.14, v_num=0]
Epoch 71:   0%|          | 0/97 [00:00<?, ?it/s, loss=2.14, v_num=0]
Epoch 72:   0%|          | 0/97 [00:00<?, ?it/s, loss=2.14, v_num=0]
Epoch 72:   1%|          | 1/97 [00:01<02:31,  1.57s/it, loss=2.14, v_num=0]
Epoch 72:   1%|          | 1/97 [00:01<02:36,  1.63s/it, loss=2.15, v_num=0]
Epoch 72:   2%|▏         | 2/97 [00:01<01:25,  1.11it/s, loss=2.15, v_num=0]
Epoch 72:   2%|▏         | 2/97 [00:01<01:28,  1.08it/s, loss=2.15, v_num=0]
Epoch 72:   3%|▎         | 3/97 [00:01<01:00,  1.55it/s, loss=2.15, v_num=0]
Epoch 72:   3%|▎         | 3/97 [00:01<01:02,  1.51it/s, loss=2.14, v_num=0]
Epoch 72:   4%|▍         | 4/97 [00:02<00:48,  1.92it/s, loss=2.14, v_num=0]
Epoch 72:   4%|▍         | 4/97 [00:02<00:49,  1.87it/s, loss=2.15, v_num=0]
Epoch 72:   5%|▌         | 5/97 [00:02<00:40,  2.25it/s, loss=2.15, v_num=0]
Epoch 72:   5%|▌         | 5/97 [00:02<00:41,  2.19it/s, loss=2.15, v_num=0]
Epoch 72:   6%|▌         | 6/97 [00:02<00:36,  2.53it/s, loss=2.15, v_num=0]
Epoch 72:   6%|▌         | 6/97 [00:02<00:36,  2.47it/s, loss=2.15, v_num=0]
Epoch 72:   7%|▋         | 7/97 [00:02<00:32,  2.78it/s, loss=2.15, v_num=0]
Epoch 72:   7%|▋         | 7/97 [00:02<00:33,  2.72it/s, loss=2.15, v_num=0]
Epoch 72:   8%|▊         | 8/97 [00:02<00:29,  3.00it/s, loss=2.15, v_num=0]
Epoch 72:   8%|▊         | 8/97 [00:02<00:30,  2.94it/s, loss=2.15, v_num=0]
Epoch 72:   9%|▉         | 9/97 [00:02<00:28,  3.14it/s, loss=2.15, v_num=0]
Epoch 72:   9%|▉         | 9/97 [00:02<00:28,  3.08it/s, loss=2.15, v_num=0]
Epoch 72:  10%|█         | 10/97 [00:03<00:26,  3.32it/s, loss=2.15, v_num=0]
Epoch 72:  10%|█         | 10/97 [00:03<00:26,  3.26it/s, loss=2.14, v_num=0]
Epoch 72:  11%|█▏        | 11/97 [00:03<00:24,  3.49it/s, loss=2.14, v_num=0]
Epoch 72:  11%|█▏        | 11/97 [00:03<00:25,  3.42it/s, loss=2.14, v_num=0]
Epoch 72:  12%|█▏        | 12/97 [00:03<00:23,  3.63it/s, loss=2.14, v_num=0]
Epoch 72:  12%|█▏        | 12/97 [00:03<00:23,  3.57it/s, loss=2.14, v_num=0]
Epoch 72:  13%|█▎        | 13/97 [00:03<00:22,  3.78it/s, loss=2.14, v_num=0]
Epoch 72:  13%|█▎        | 13/97 [00:03<00:22,  3.71it/s, loss=2.13, v_num=0]
Epoch 72:  14%|█▍        | 14/97 [00:03<00:21,  3.91it/s, loss=2.13, v_num=0]
Epoch 72:  14%|█▍        | 14/97 [00:03<00:21,  3.85it/s, loss=2.13, v_num=0]
Epoch 72:  15%|█▌        | 15/97 [00:03<00:20,  4.03it/s, loss=2.13, v_num=0]
Epoch 72:  15%|█▌        | 15/97 [00:03<00:20,  3.97it/s, loss=2.13, v_num=0]
Epoch 72:  16%|█▋        | 16/97 [00:03<00:19,  4.14it/s, loss=2.13, v_num=0]
Epoch 72:  16%|█▋        | 16/97 [00:03<00:19,  4.08it/s, loss=2.12, v_num=0]
Epoch 72:  18%|█▊        | 17/97 [00:04<00:18,  4.22it/s, loss=2.12, v_num=0]
Epoch 72:  18%|█▊        | 17/97 [00:04<00:19,  4.16it/s, loss=2.12, v_num=0]
Epoch 72:  19%|█▊        | 18/97 [00:04<00:18,  4.31it/s, loss=2.12, v_num=0]
Epoch 72:  19%|█▊        | 18/97 [00:04<00:18,  4.25it/s, loss=2.13, v_num=0]
Epoch 72:  20%|█▉        | 19/97 [00:04<00:17,  4.41it/s, loss=2.13, v_num=0]
Epoch 72:  20%|█▉        | 19/97 [00:04<00:17,  4.35it/s, loss=2.12, v_num=0]
Epoch 72:  21%|██        | 20/97 [00:04<00:17,  4.49it/s, loss=2.12, v_num=0]
Epoch 72:  21%|██        | 20/97 [00:04<00:17,  4.44it/s, loss=2.12, v_num=0]
Epoch 72:  22%|██▏       | 21/97 [00:04<00:16,  4.58it/s, loss=2.12, v_num=0]
Epoch 72:  22%|██▏       | 21/97 [00:04<00:16,  4.52it/s, loss=2.12, v_num=0]
Epoch 72:  23%|██▎       | 22/97 [00:04<00:16,  4.65it/s, loss=2.12, v_num=0]
Epoch 72:  23%|██▎       | 22/97 [00:04<00:16,  4.60it/s, loss=2.12, v_num=0]
Epoch 72:  24%|██▎       | 23/97 [00:04<00:15,  4.72it/s, loss=2.12, v_num=0]
Epoch 72:  24%|██▎       | 23/97 [00:04<00:15,  4.67it/s, loss=2.12, v_num=0]
Epoch 72:  25%|██▍       | 24/97 [00:05<00:15,  4.79it/s, loss=2.12, v_num=0]
Epoch 72:  25%|██▍       | 24/97 [00:05<00:15,  4.74it/s, loss=2.11, v_num=0]
Epoch 72:  26%|██▌       | 25/97 [00:05<00:14,  4.83it/s, loss=2.11, v_num=0]
Epoch 72:  26%|██▌       | 25/97 [00:05<00:15,  4.78it/s, loss=2.12, v_num=0]
Epoch 72:  27%|██▋       | 26/97 [00:05<00:14,  4.89it/s, loss=2.12, v_num=0]
Epoch 72:  27%|██▋       | 26/97 [00:05<00:14,  4.84it/s, loss=2.12, v_num=0]
Epoch 72:  28%|██▊       | 27/97 [00:05<00:14,  4.95it/s, loss=2.12, v_num=0]
Epoch 72:  28%|██▊       | 27/97 [00:05<00:14,  4.90it/s, loss=2.12, v_num=0]
Epoch 72:  29%|██▉       | 28/97 [00:05<00:13,  5.00it/s, loss=2.12, v_num=0]
Epoch 72:  29%|██▉       | 28/97 [00:05<00:13,  4.96it/s, loss=2.11, v_num=0]
Epoch 72:  30%|██▉       | 29/97 [00:05<00:13,  5.06it/s, loss=2.11, v_num=0]
Epoch 72:  30%|██▉       | 29/97 [00:05<00:13,  5.01it/s, loss=2.11, v_num=0]
Epoch 72:  31%|███       | 30/97 [00:05<00:13,  5.10it/s, loss=2.11, v_num=0]
Epoch 72:  31%|███       | 30/97 [00:05<00:13,  5.06it/s, loss=2.11, v_num=0]
Epoch 72:  32%|███▏      | 31/97 [00:06<00:12,  5.16it/s, loss=2.11, v_num=0]
Epoch 72:  32%|███▏      | 31/97 [00:06<00:12,  5.11it/s, loss=2.11, v_num=0]
Epoch 72:  33%|███▎      | 32/97 [00:06<00:12,  5.20it/s, loss=2.11, v_num=0]
Epoch 72:  33%|███▎      | 32/97 [00:06<00:12,  5.15it/s, loss=2.11, v_num=0]
Epoch 72:  34%|███▍      | 33/97 [00:06<00:12,  5.24it/s, loss=2.11, v_num=0]
Epoch 72:  34%|███▍      | 33/97 [00:06<00:12,  5.20it/s, loss=2.11, v_num=0]
Epoch 72:  35%|███▌      | 34/97 [00:06<00:11,  5.28it/s, loss=2.11, v_num=0]
Epoch 72:  35%|███▌      | 34/97 [00:06<00:12,  5.24it/s, loss=2.12, v_num=0]
Epoch 72:  36%|███▌      | 35/97 [00:06<00:11,  5.32it/s, loss=2.12, v_num=0]
Epoch 72:  36%|███▌      | 35/97 [00:06<00:11,  5.28it/s, loss=2.11, v_num=0]
Epoch 72:  37%|███▋      | 36/97 [00:06<00:11,  5.36it/s, loss=2.11, v_num=0]
Epoch 72:  37%|███▋      | 36/97 [00:06<00:11,  5.32it/s, loss=2.12, v_num=0]
Epoch 72:  38%|███▊      | 37/97 [00:06<00:11,  5.39it/s, loss=2.12, v_num=0]
Epoch 72:  38%|███▊      | 37/97 [00:06<00:11,  5.35it/s, loss=2.12, v_num=0]
Epoch 72:  39%|███▉      | 38/97 [00:06<00:10,  5.43it/s, loss=2.12, v_num=0]
Epoch 72:  39%|███▉      | 38/97 [00:07<00:10,  5.38it/s, loss=2.12, v_num=0]
Epoch 72:  40%|████      | 39/97 [00:07<00:10,  5.46it/s, loss=2.12, v_num=0]
Epoch 72:  40%|████      | 39/97 [00:07<00:10,  5.42it/s, loss=2.12, v_num=0]
Epoch 72:  41%|████      | 40/97 [00:07<00:10,  5.49it/s, loss=2.12, v_num=0]
Epoch 72:  41%|████      | 40/97 [00:07<00:10,  5.45it/s, loss=2.11, v_num=0]
Epoch 72:  42%|████▏     | 41/97 [00:07<00:10,  5.52it/s, loss=2.11, v_num=0]
Epoch 72:  42%|████▏     | 41/97 [00:07<00:10,  5.48it/s, loss=2.11, v_num=0]
Epoch 72:  43%|████▎     | 42/97 [00:07<00:09,  5.54it/s, loss=2.11, v_num=0]
Epoch 72:  43%|████▎     | 42/97 [00:07<00:09,  5.50it/s, loss=2.11, v_num=0]
Epoch 72:  44%|████▍     | 43/97 [00:07<00:09,  5.57it/s, loss=2.11, v_num=0]
Epoch 72:  44%|████▍     | 43/97 [00:07<00:09,  5.53it/s, loss=2.11, v_num=0]
Epoch 72:  45%|████▌     | 44/97 [00:07<00:09,  5.60it/s, loss=2.11, v_num=0]
Epoch 72:  45%|████▌     | 44/97 [00:07<00:09,  5.56it/s, loss=2.11, v_num=0]
Epoch 72:  46%|████▋     | 45/97 [00:07<00:09,  5.63it/s, loss=2.11, v_num=0]
Epoch 72:  46%|████▋     | 45/97 [00:08<00:09,  5.59it/s, loss=2.11, v_num=0]
Epoch 72:  47%|████▋     | 46/97 [00:08<00:09,  5.65it/s, loss=2.11, v_num=0]
Epoch 72:  47%|████▋     | 46/97 [00:08<00:09,  5.61it/s, loss=2.11, v_num=0]
Epoch 72:  48%|████▊     | 47/97 [00:08<00:08,  5.68it/s, loss=2.11, v_num=0]
Epoch 72:  48%|████▊     | 47/97 [00:08<00:08,  5.64it/s, loss=2.11, v_num=0]
Epoch 72:  49%|████▉     | 48/97 [00:08<00:08,  5.70it/s, loss=2.11, v_num=0]
Epoch 72:  49%|████▉     | 48/97 [00:08<00:08,  5.67it/s, loss=2.11, v_num=0]
Epoch 72:  51%|█████     | 49/97 [00:08<00:08,  5.72it/s, loss=2.11, v_num=0]
Epoch 72:  51%|█████     | 49/97 [00:08<00:08,  5.69it/s, loss=2.11, v_num=0]
Epoch 72:  52%|█████▏    | 50/97 [00:08<00:08,  5.75it/s, loss=2.11, v_num=0]
Epoch 72:  52%|█████▏    | 50/97 [00:08<00:08,  5.71it/s, loss=2.11, v_num=0]
Epoch 72:  53%|█████▎    | 51/97 [00:08<00:07,  5.77it/s, loss=2.11, v_num=0]
Epoch 72:  53%|█████▎    | 51/97 [00:08<00:08,  5.73it/s, loss=2.1, v_num=0]
Epoch 72:  54%|█████▎    | 52/97 [00:08<00:07,  5.79it/s, loss=2.1, v_num=0]
Epoch 72:  54%|█████▎    | 52/97 [00:09<00:07,  5.75it/s, loss=2.1, v_num=0]
Epoch 72:  55%|█████▍    | 53/97 [00:09<00:07,  5.81it/s, loss=2.1, v_num=0]
Epoch 72:  55%|█████▍    | 53/97 [00:09<00:07,  5.78it/s, loss=2.11, v_num=0]
Epoch 72:  56%|█████▌    | 54/97 [00:09<00:07,  5.83it/s, loss=2.11, v_num=0]
Epoch 72:  56%|█████▌    | 54/97 [00:09<00:07,  5.80it/s, loss=2.1, v_num=0]
Epoch 72:  57%|█████▋    | 55/97 [00:09<00:07,  5.85it/s, loss=2.1, v_num=0]
Epoch 72:  57%|█████▋    | 55/97 [00:09<00:07,  5.82it/s, loss=2.11, v_num=0]
Epoch 72:  58%|█████▊    | 56/97 [00:09<00:06,  5.87it/s, loss=2.11, v_num=0]
Epoch 72:  58%|█████▊    | 56/97 [00:09<00:07,  5.84it/s, loss=2.1, v_num=0]
Epoch 72:  59%|█████▉    | 57/97 [00:09<00:06,  5.89it/s, loss=2.1, v_num=0]
Epoch 72:  59%|█████▉    | 57/97 [00:09<00:06,  5.85it/s, loss=2.1, v_num=0]
Epoch 72:  60%|█████▉    | 58/97 [00:09<00:06,  5.90it/s, loss=2.1, v_num=0]
Epoch 72:  60%|█████▉    | 58/97 [00:09<00:06,  5.87it/s, loss=2.11, v_num=0]
Epoch 72:  61%|██████    | 59/97 [00:09<00:06,  5.92it/s, loss=2.11, v_num=0]
Epoch 72:  61%|██████    | 59/97 [00:10<00:06,  5.89it/s, loss=2.1, v_num=0]
Epoch 72:  62%|██████▏   | 60/97 [00:10<00:06,  5.94it/s, loss=2.1, v_num=0]
Epoch 72:  62%|██████▏   | 60/97 [00:10<00:06,  5.90it/s, loss=2.12, v_num=0]
Epoch 72:  63%|██████▎   | 61/97 [00:10<00:06,  5.95it/s, loss=2.12, v_num=0]
Epoch 72:  63%|██████▎   | 61/97 [00:10<00:06,  5.92it/s, loss=2.11, v_num=0]
Epoch 72:  64%|██████▍   | 62/97 [00:10<00:05,  5.97it/s, loss=2.11, v_num=0]
Epoch 72:  64%|██████▍   | 62/97 [00:10<00:05,  5.94it/s, loss=2.12, v_num=0]
Epoch 72:  65%|██████▍   | 63/97 [00:10<00:05,  5.98it/s, loss=2.12, v_num=0]
Epoch 72:  65%|██████▍   | 63/97 [00:10<00:05,  5.95it/s, loss=2.11, v_num=0]
Epoch 72:  66%|██████▌   | 64/97 [00:10<00:05,  6.00it/s, loss=2.11, v_num=0]
Epoch 72:  66%|██████▌   | 64/97 [00:10<00:05,  5.97it/s, loss=2.11, v_num=0]
Epoch 72:  67%|██████▋   | 65/97 [00:10<00:05,  6.01it/s, loss=2.11, v_num=0]
Epoch 72:  67%|██████▋   | 65/97 [00:10<00:05,  5.98it/s, loss=2.11, v_num=0]
Epoch 72:  68%|██████▊   | 66/97 [00:10<00:05,  6.03it/s, loss=2.11, v_num=0]
Epoch 72:  68%|██████▊   | 66/97 [00:11<00:05,  6.00it/s, loss=2.12, v_num=0]
Epoch 72:  69%|██████▉   | 67/97 [00:11<00:04,  6.04it/s, loss=2.12, v_num=0]
Epoch 72:  69%|██████▉   | 67/97 [00:11<00:04,  6.01it/s, loss=2.12, v_num=0]
Epoch 72:  70%|███████   | 68/97 [00:11<00:04,  6.06it/s, loss=2.12, v_num=0]
Epoch 72:  70%|███████   | 68/97 [00:11<00:04,  6.02it/s, loss=2.12, v_num=0]
Epoch 72:  71%|███████   | 69/97 [00:11<00:04,  6.07it/s, loss=2.12, v_num=0]
Epoch 72:  71%|███████   | 69/97 [00:11<00:04,  6.04it/s, loss=2.12, v_num=0]
Epoch 72:  72%|███████▏  | 70/97 [00:11<00:04,  6.08it/s, loss=2.12, v_num=0]
Epoch 72:  72%|███████▏  | 70/97 [00:11<00:04,  6.05it/s, loss=2.12, v_num=0]
Epoch 72:  73%|███████▎  | 71/97 [00:11<00:04,  6.09it/s, loss=2.12, v_num=0]
Epoch 72:  73%|███████▎  | 71/97 [00:11<00:04,  6.06it/s, loss=2.13, v_num=0]
Epoch 72:  74%|███████▍  | 72/97 [00:11<00:04,  6.11it/s, loss=2.13, v_num=0]
Epoch 72:  74%|███████▍  | 72/97 [00:11<00:04,  6.08it/s, loss=2.12, v_num=0]
Epoch 72:  75%|███████▌  | 73/97 [00:11<00:03,  6.12it/s, loss=2.12, v_num=0]
Epoch 72:  75%|███████▌  | 73/97 [00:11<00:03,  6.09it/s, loss=2.12, v_num=0]
Epoch 72:  76%|███████▋  | 74/97 [00:12<00:03,  6.13it/s, loss=2.12, v_num=0]
Epoch 72:  76%|███████▋  | 74/97 [00:12<00:03,  6.10it/s, loss=2.12, v_num=0]
Epoch 72:  77%|███████▋  | 75/97 [00:12<00:03,  6.14it/s, loss=2.12, v_num=0]
Epoch 72:  77%|███████▋  | 75/97 [00:12<00:03,  6.11it/s, loss=2.12, v_num=0]
Epoch 72:  78%|███████▊  | 76/97 [00:12<00:03,  6.15it/s, loss=2.12, v_num=0]
Epoch 72:  78%|███████▊  | 76/97 [00:12<00:03,  6.12it/s, loss=2.12, v_num=0]
Epoch 72:  79%|███████▉  | 77/97 [00:12<00:03,  6.16it/s, loss=2.12, v_num=0]
Epoch 72:  79%|███████▉  | 77/97 [00:12<00:03,  6.13it/s, loss=2.12, v_num=0]
Epoch 72:  80%|████████  | 78/97 [00:12<00:03,  6.17it/s, loss=2.12, v_num=0]
Epoch 72:  80%|████████  | 78/97 [00:12<00:03,  6.14it/s, loss=2.12, v_num=0]
Epoch 72:  81%|████████▏ | 79/97 [00:12<00:02,  6.19it/s, loss=2.12, v_num=0]
Epoch 72:  81%|████████▏ | 79/97 [00:12<00:02,  6.16it/s, loss=2.12, v_num=0]
Epoch 72:  82%|████████▏ | 80/97 [00:12<00:02,  6.20it/s, loss=2.12, v_num=0]
Epoch 72:  82%|████████▏ | 80/97 [00:12<00:02,  6.17it/s, loss=2.12, v_num=0]
Epoch 72:  84%|████████▎ | 81/97 [00:13<00:02,  6.21it/s, loss=2.12, v_num=0]
Epoch 72:  84%|████████▎ | 81/97 [00:13<00:02,  6.18it/s, loss=2.12, v_num=0]
Epoch 72:  85%|████████▍ | 82/97 [00:13<00:02,  6.22it/s, loss=2.12, v_num=0]
Epoch 72:  85%|████████▍ | 82/97 [00:13<00:02,  6.19it/s, loss=2.12, v_num=0]
Epoch 72:  86%|████████▌ | 83/97 [00:13<00:02,  6.23it/s, loss=2.12, v_num=0]
Epoch 72:  86%|████████▌ | 83/97 [00:13<00:02,  6.20it/s, loss=2.12, v_num=0]
Epoch 72:  87%|████████▋ | 84/97 [00:13<00:02,  6.24it/s, loss=2.12, v_num=0]
Epoch 72:  87%|████████▋ | 84/97 [00:13<00:02,  6.21it/s, loss=2.11, v_num=0]
Epoch 72:  88%|████████▊ | 85/97 [00:13<00:01,  6.25it/s, loss=2.11, v_num=0]
Epoch 72:  88%|████████▊ | 85/97 [00:13<00:01,  6.22it/s, loss=2.12, v_num=0]
Epoch 72:  89%|████████▊ | 86/97 [00:13<00:01,  6.26it/s, loss=2.12, v_num=0]
Epoch 72:  89%|████████▊ | 86/97 [00:13<00:01,  6.24it/s, loss=2.11, v_num=0]
Epoch 72:  90%|████████▉ | 87/97 [00:13<00:01,  6.27it/s, loss=2.11, v_num=0]
Epoch 72:  90%|████████▉ | 87/97 [00:13<00:01,  6.25it/s, loss=2.11, v_num=0]
Epoch 72:  91%|█████████ | 88/97 [00:14<00:01,  6.28it/s, loss=2.11, v_num=0]
Epoch 72:  91%|█████████ | 88/97 [00:14<00:01,  6.26it/s, loss=2.11, v_num=0]
Epoch 72:  92%|█████████▏| 89/97 [00:14<00:01,  6.29it/s, loss=2.11, v_num=0]
Epoch 72:  92%|█████████▏| 89/97 [00:14<00:01,  6.27it/s, loss=2.11, v_num=0]
Epoch 72:  93%|█████████▎| 90/97 [00:14<00:01,  6.30it/s, loss=2.11, v_num=0]
Epoch 72:  93%|█████████▎| 90/97 [00:14<00:01,  6.28it/s, loss=2.11, v_num=0]
Epoch 72:  94%|█████████▍| 91/97 [00:14<00:00,  6.31it/s, loss=2.11, v_num=0]
Epoch 72:  94%|█████████▍| 91/97 [00:14<00:00,  6.29it/s, loss=2.11, v_num=0]
Epoch 72:  95%|█████████▍| 92/97 [00:14<00:00,  6.32it/s, loss=2.11, v_num=0]
Epoch 72:  95%|█████████▍| 92/97 [00:14<00:00,  6.30it/s, loss=2.12, v_num=0]
Epoch 72:  96%|█████████▌| 93/97 [00:14<00:00,  6.33it/s, loss=2.12, v_num=0]
Epoch 72:  96%|█████████▌| 93/97 [00:14<00:00,  6.31it/s, loss=2.12, v_num=0]
Epoch 72:  97%|█████████▋| 94/97 [00:14<00:00,  6.34it/s, loss=2.12, v_num=0]
Epoch 72:  97%|█████████▋| 94/97 [00:14<00:00,  6.31it/s, loss=2.11, v_num=0]
Epoch 72:  98%|█████████▊| 95/97 [00:14<00:00,  6.35it/s, loss=2.11, v_num=0]
Epoch 72:  98%|█████████▊| 95/97 [00:15<00:00,  6.32it/s, loss=2.11, v_num=0]
Epoch 72:  99%|█████████▉| 96/97 [00:15<00:00,  6.36it/s, loss=2.11, v_num=0]
Epoch 72:  99%|█████████▉| 96/97 [00:15<00:00,  6.33it/s, loss=2.11, v_num=0]
Epoch 72: 100%|██████████| 97/97 [00:15<00:00,  6.37it/s, loss=2.11, v_num=0]
Epoch 72: 100%|██████████| 97/97 [00:15<00:00,  6.34it/s, loss=2.12, v_num=0]
Epoch 72: 100%|██████████| 97/97 [00:15<00:00,  6.34it/s, loss=2.12, v_num=0]
Epoch 72:   0%|          | 0/97 [00:00<?, ?it/s, loss=2.12, v_num=0]
Epoch 73:   0%|          | 0/97 [00:00<?, ?it/s, loss=2.12, v_num=0]
Epoch 73:   1%|          | 1/97 [00:01<02:20,  1.47s/it, loss=2.12, v_num=0]
Epoch 73:   1%|          | 1/97 [00:01<02:25,  1.52s/it, loss=2.13, v_num=0]
Epoch 73:   2%|▏         | 2/97 [00:01<01:16,  1.25it/s, loss=2.13, v_num=0]
Epoch 73:   2%|▏         | 2/97 [00:01<01:18,  1.21it/s, loss=2.13, v_num=0]
Epoch 73:   3%|▎         | 3/97 [00:01<00:54,  1.72it/s, loss=2.13, v_num=0]
Epoch 73:   3%|▎         | 3/97 [00:01<00:56,  1.67it/s, loss=2.13, v_num=0]
Epoch 73:   4%|▍         | 4/97 [00:01<00:43,  2.14it/s, loss=2.13, v_num=0]
Epoch 73:   4%|▍         | 4/97 [00:01<00:44,  2.07it/s, loss=2.13, v_num=0]
Epoch 73:   5%|▌         | 5/97 [00:02<00:37,  2.48it/s, loss=2.13, v_num=0]
Epoch 73:   5%|▌         | 5/97 [00:02<00:38,  2.42it/s, loss=2.14, v_num=0]
Epoch 73:   6%|▌         | 6/97 [00:02<00:32,  2.79it/s, loss=2.14, v_num=0]
Epoch 73:   6%|▌         | 6/97 [00:02<00:33,  2.72it/s, loss=2.13, v_num=0]
Epoch 73:   7%|▋         | 7/97 [00:02<00:29,  3.07it/s, loss=2.13, v_num=0]
Epoch 73:   7%|▋         | 7/97 [00:02<00:30,  2.99it/s, loss=2.14, v_num=0]
Epoch 73:   8%|▊         | 8/97 [00:02<00:26,  3.31it/s, loss=2.14, v_num=0]
Epoch 73:   8%|▊         | 8/97 [00:02<00:27,  3.23it/s, loss=2.14, v_num=0]
Epoch 73:   9%|▉         | 9/97 [00:02<00:25,  3.51it/s, loss=2.14, v_num=0]
Epoch 73:   9%|▉         | 9/97 [00:02<00:25,  3.44it/s, loss=2.14, v_num=0]
Epoch 73:  10%|█         | 10/97 [00:02<00:23,  3.70it/s, loss=2.14, v_num=0]
Epoch 73:  10%|█         | 10/97 [00:02<00:23,  3.63it/s, loss=2.15, v_num=0]
Epoch 73:  11%|█▏        | 11/97 [00:02<00:22,  3.87it/s, loss=2.15, v_num=0]
Epoch 73:  11%|█▏        | 11/97 [00:02<00:22,  3.80it/s, loss=2.15, v_num=0]
Epoch 73:  12%|█▏        | 12/97 [00:02<00:21,  4.03it/s, loss=2.15, v_num=0]
Epoch 73:  12%|█▏        | 12/97 [00:03<00:21,  3.95it/s, loss=2.15, v_num=0]
Epoch 73:  13%|█▎        | 13/97 [00:03<00:20,  4.17it/s, loss=2.15, v_num=0]
Epoch 73:  13%|█▎        | 13/97 [00:03<00:20,  4.10it/s, loss=2.15, v_num=0]
Epoch 73:  14%|█▍        | 14/97 [00:03<00:19,  4.30it/s, loss=2.15, v_num=0]
Epoch 73:  14%|█▍        | 14/97 [00:03<00:19,  4.23it/s, loss=2.15, v_num=0]
Epoch 73:  15%|█▌        | 15/97 [00:03<00:18,  4.43it/s, loss=2.15, v_num=0]
Epoch 73:  15%|█▌        | 15/97 [00:03<00:18,  4.35it/s, loss=2.15, v_num=0]
Epoch 73:  16%|█▋        | 16/97 [00:03<00:17,  4.54it/s, loss=2.15, v_num=0]
Epoch 73:  16%|█▋        | 16/97 [00:03<00:18,  4.47it/s, loss=2.15, v_num=0]
Epoch 73:  18%|█▊        | 17/97 [00:03<00:17,  4.56it/s, loss=2.15, v_num=0]
Epoch 73:  18%|█▊        | 17/97 [00:03<00:17,  4.50it/s, loss=2.15, v_num=0]
Epoch 73:  19%|█▊        | 18/97 [00:03<00:16,  4.66it/s, loss=2.15, v_num=0]
Epoch 73:  19%|█▊        | 18/97 [00:03<00:17,  4.59it/s, loss=2.15, v_num=0]
Epoch 73:  20%|█▉        | 19/97 [00:04<00:16,  4.75it/s, loss=2.15, v_num=0]
Epoch 73:  20%|█▉        | 19/97 [00:04<00:16,  4.68it/s, loss=2.15, v_num=0]
Epoch 73:  21%|██        | 20/97 [00:04<00:15,  4.83it/s, loss=2.15, v_num=0]
Epoch 73:  21%|██        | 20/97 [00:04<00:16,  4.77it/s, loss=2.15, v_num=0]
Epoch 73:  22%|██▏       | 21/97 [00:04<00:15,  4.91it/s, loss=2.15, v_num=0]
Epoch 73:  22%|██▏       | 21/97 [00:04<00:15,  4.85it/s, loss=2.14, v_num=0]
Epoch 73:  23%|██▎       | 22/97 [00:04<00:15,  4.98it/s, loss=2.14, v_num=0]
Epoch 73:  23%|██▎       | 22/97 [00:04<00:15,  4.92it/s, loss=2.14, v_num=0]
Epoch 73:  24%|██▎       | 23/97 [00:04<00:14,  5.05it/s, loss=2.14, v_num=0]
Epoch 73:  24%|██▎       | 23/97 [00:04<00:14,  4.99it/s, loss=2.12, v_num=0]
Epoch 73:  25%|██▍       | 24/97 [00:04<00:14,  5.12it/s, loss=2.12, v_num=0]
Epoch 73:  25%|██▍       | 24/97 [00:04<00:14,  5.06it/s, loss=2.13, v_num=0]
Epoch 73:  26%|██▌       | 25/97 [00:04<00:13,  5.18it/s, loss=2.13, v_num=0]
Epoch 73:  26%|██▌       | 25/97 [00:04<00:14,  5.12it/s, loss=2.12, v_num=0]
Epoch 73:  27%|██▋       | 26/97 [00:04<00:13,  5.24it/s, loss=2.12, v_num=0]
Epoch 73:  27%|██▋       | 26/97 [00:05<00:13,  5.18it/s, loss=2.13, v_num=0]
Epoch 73:  28%|██▊       | 27/97 [00:05<00:13,  5.30it/s, loss=2.13, v_num=0]
Epoch 73:  28%|██▊       | 27/97 [00:05<00:13,  5.24it/s, loss=2.13, v_num=0]
Epoch 73:  29%|██▉       | 28/97 [00:05<00:12,  5.35it/s, loss=2.13, v_num=0]
Epoch 73:  29%|██▉       | 28/97 [00:05<00:13,  5.29it/s, loss=2.12, v_num=0]
Epoch 73:  30%|██▉       | 29/97 [00:05<00:12,  5.40it/s, loss=2.12, v_num=0]
Epoch 73:  30%|██▉       | 29/97 [00:05<00:12,  5.34it/s, loss=2.13, v_num=0]
Epoch 73:  31%|███       | 30/97 [00:05<00:12,  5.45it/s, loss=2.13, v_num=0]
Epoch 73:  31%|███       | 30/97 [00:05<00:12,  5.39it/s, loss=2.13, v_num=0]
Epoch 73:  32%|███▏      | 31/97 [00:05<00:12,  5.49it/s, loss=2.13, v_num=0]
Epoch 73:  32%|███▏      | 31/97 [00:05<00:12,  5.44it/s, loss=2.12, v_num=0]
Epoch 73:  33%|███▎      | 32/97 [00:05<00:11,  5.53it/s, loss=2.12, v_num=0]
Epoch 73:  33%|███▎      | 32/97 [00:05<00:11,  5.48it/s, loss=2.12, v_num=0]
Epoch 73:  34%|███▍      | 33/97 [00:05<00:11,  5.57it/s, loss=2.12, v_num=0]
Epoch 73:  34%|███▍      | 33/97 [00:05<00:11,  5.52it/s, loss=2.12, v_num=0]
Epoch 73:  35%|███▌      | 34/97 [00:06<00:11,  5.61it/s, loss=2.12, v_num=0]
Epoch 73:  35%|███▌      | 34/97 [00:06<00:11,  5.56it/s, loss=2.11, v_num=0]
Epoch 73:  36%|███▌      | 35/97 [00:06<00:10,  5.65it/s, loss=2.11, v_num=0]
Epoch 73:  36%|███▌      | 35/97 [00:06<00:11,  5.60it/s, loss=2.11, v_num=0]
Epoch 73:  37%|███▋      | 36/97 [00:06<00:10,  5.68it/s, loss=2.11, v_num=0]
Epoch 73:  37%|███▋      | 36/97 [00:06<00:10,  5.63it/s, loss=2.12, v_num=0]
Epoch 73:  38%|███▊      | 37/97 [00:06<00:10,  5.72it/s, loss=2.12, v_num=0]
Epoch 73:  38%|███▊      | 37/97 [00:06<00:10,  5.67it/s, loss=2.11, v_num=0]
Epoch 73:  39%|███▉      | 38/97 [00:06<00:10,  5.75it/s, loss=2.11, v_num=0]
Epoch 73:  39%|███▉      | 38/97 [00:06<00:10,  5.70it/s, loss=2.11, v_num=0]
Epoch 73:  40%|████      | 39/97 [00:06<00:10,  5.78it/s, loss=2.11, v_num=0]
Epoch 73:  40%|████      | 39/97 [00:06<00:10,  5.73it/s, loss=2.12, v_num=0]
Epoch 73:  41%|████      | 40/97 [00:06<00:09,  5.81it/s, loss=2.12, v_num=0]
Epoch 73:  41%|████      | 40/97 [00:06<00:09,  5.76it/s, loss=2.11, v_num=0]
Epoch 73:  42%|████▏     | 41/97 [00:07<00:09,  5.84it/s, loss=2.11, v_num=0]
Epoch 73:  42%|████▏     | 41/97 [00:07<00:09,  5.79it/s, loss=2.11, v_num=0]
Epoch 73:  43%|████▎     | 42/97 [00:07<00:09,  5.87it/s, loss=2.11, v_num=0]
Epoch 73:  43%|████▎     | 42/97 [00:07<00:09,  5.82it/s, loss=2.11, v_num=0]
Epoch 73:  44%|████▍     | 43/97 [00:07<00:09,  5.89it/s, loss=2.11, v_num=0]
Epoch 73:  44%|████▍     | 43/97 [00:07<00:09,  5.85it/s, loss=2.12, v_num=0]
Epoch 73:  45%|████▌     | 44/97 [00:07<00:08,  5.92it/s, loss=2.12, v_num=0]
Epoch 73:  45%|████▌     | 44/97 [00:07<00:09,  5.88it/s, loss=2.11, v_num=0]
Epoch 73:  46%|████▋     | 45/97 [00:07<00:08,  5.94it/s, loss=2.11, v_num=0]
Epoch 73:  46%|████▋     | 45/97 [00:07<00:08,  5.90it/s, loss=2.12, v_num=0]
Epoch 73:  47%|████▋     | 46/97 [00:07<00:08,  5.97it/s, loss=2.12, v_num=0]
Epoch 73:  47%|████▋     | 46/97 [00:07<00:08,  5.92it/s, loss=2.11, v_num=0]
Epoch 73:  48%|████▊     | 47/97 [00:07<00:08,  5.99it/s, loss=2.11, v_num=0]
Epoch 73:  48%|████▊     | 47/97 [00:07<00:08,  5.95it/s, loss=2.11, v_num=0]
Epoch 73:  49%|████▉     | 48/97 [00:07<00:08,  6.02it/s, loss=2.11, v_num=0]
Epoch 73:  49%|████▉     | 48/97 [00:08<00:08,  5.97it/s, loss=2.11, v_num=0]
Epoch 73:  51%|█████     | 49/97 [00:08<00:07,  6.03it/s, loss=2.11, v_num=0]
Epoch 73:  51%|█████     | 49/97 [00:08<00:08,  5.99it/s, loss=2.11, v_num=0]
Epoch 73:  52%|█████▏    | 50/97 [00:08<00:07,  6.05it/s, loss=2.11, v_num=0]
Epoch 73:  52%|█████▏    | 50/97 [00:08<00:07,  6.01it/s, loss=2.11, v_num=0]
Epoch 73:  53%|█████▎    | 51/97 [00:08<00:07,  6.06it/s, loss=2.11, v_num=0]
Epoch 73:  53%|█████▎    | 51/97 [00:08<00:07,  6.03it/s, loss=2.11, v_num=0]
Epoch 73:  54%|█████▎    | 52/97 [00:08<00:07,  6.08it/s, loss=2.11, v_num=0]
Epoch 73:  54%|█████▎    | 52/97 [00:08<00:07,  6.05it/s, loss=2.11, v_num=0]
Epoch 73:  55%|█████▍    | 53/97 [00:08<00:07,  6.11it/s, loss=2.11, v_num=0]
Epoch 73:  55%|█████▍    | 53/97 [00:08<00:07,  6.07it/s, loss=2.12, v_num=0]
Epoch 73:  56%|█████▌    | 54/97 [00:08<00:07,  6.12it/s, loss=2.12, v_num=0]
Epoch 73:  56%|█████▌    | 54/97 [00:08<00:07,  6.09it/s, loss=2.12, v_num=0]
Epoch 73:  57%|█████▋    | 55/97 [00:08<00:06,  6.14it/s, loss=2.12, v_num=0]
Epoch 73:  57%|█████▋    | 55/97 [00:09<00:06,  6.10it/s, loss=2.11, v_num=0]
Epoch 73:  58%|█████▊    | 56/97 [00:09<00:06,  6.16it/s, loss=2.11, v_num=0]
Epoch 73:  58%|█████▊    | 56/97 [00:09<00:06,  6.12it/s, loss=2.11, v_num=0]
Epoch 73:  59%|█████▉    | 57/97 [00:09<00:06,  6.17it/s, loss=2.11, v_num=0]
Epoch 73:  59%|█████▉    | 57/97 [00:09<00:06,  6.13it/s, loss=2.11, v_num=0]
Epoch 73:  60%|█████▉    | 58/97 [00:09<00:06,  6.19it/s, loss=2.11, v_num=0]
Epoch 73:  60%|█████▉    | 58/97 [00:09<00:06,  6.15it/s, loss=2.11, v_num=0]
Epoch 73:  61%|██████    | 59/97 [00:09<00:06,  6.20it/s, loss=2.11, v_num=0]
Epoch 73:  61%|██████    | 59/97 [00:09<00:06,  6.17it/s, loss=2.11, v_num=0]
Epoch 73:  62%|██████▏   | 60/97 [00:09<00:05,  6.22it/s, loss=2.11, v_num=0]
Epoch 73:  62%|██████▏   | 60/97 [00:09<00:05,  6.18it/s, loss=2.12, v_num=0]
Epoch 73:  63%|██████▎   | 61/97 [00:09<00:05,  6.23it/s, loss=2.12, v_num=0]
Epoch 73:  63%|██████▎   | 61/97 [00:09<00:05,  6.19it/s, loss=2.11, v_num=0]
Epoch 73:  64%|██████▍   | 62/97 [00:09<00:05,  6.24it/s, loss=2.11, v_num=0]
Epoch 73:  64%|██████▍   | 62/97 [00:09<00:05,  6.21it/s, loss=2.11, v_num=0]
Epoch 73:  65%|██████▍   | 63/97 [00:10<00:05,  6.26it/s, loss=2.11, v_num=0]
Epoch 73:  65%|██████▍   | 63/97 [00:10<00:05,  6.23it/s, loss=2.11, v_num=0]
Epoch 73:  66%|██████▌   | 64/97 [00:10<00:05,  6.28it/s, loss=2.11, v_num=0]
Epoch 73:  66%|██████▌   | 64/97 [00:10<00:05,  6.24it/s, loss=2.12, v_num=0]
Epoch 73:  67%|██████▋   | 65/97 [00:10<00:05,  6.29it/s, loss=2.12, v_num=0]
Epoch 73:  67%|██████▋   | 65/97 [00:10<00:05,  6.25it/s, loss=2.13, v_num=0]
Epoch 73:  68%|██████▊   | 66/97 [00:10<00:04,  6.30it/s, loss=2.13, v_num=0]
Epoch 73:  68%|██████▊   | 66/97 [00:10<00:04,  6.27it/s, loss=2.13, v_num=0]
Epoch 73:  69%|██████▉   | 67/97 [00:10<00:04,  6.31it/s, loss=2.13, v_num=0]
Epoch 73:  69%|██████▉   | 67/97 [00:10<00:04,  6.28it/s, loss=2.13, v_num=0]
Epoch 73:  70%|███████   | 68/97 [00:10<00:04,  6.32it/s, loss=2.13, v_num=0]
Epoch 73:  70%|███████   | 68/97 [00:10<00:04,  6.29it/s, loss=2.13, v_num=0]
Epoch 73:  71%|███████   | 69/97 [00:10<00:04,  6.33it/s, loss=2.13, v_num=0]
Epoch 73:  71%|███████   | 69/97 [00:10<00:04,  6.30it/s, loss=2.14, v_num=0]
Epoch 73:  72%|███████▏  | 70/97 [00:11<00:04,  6.35it/s, loss=2.14, v_num=0]
Epoch 73:  72%|███████▏  | 70/97 [00:11<00:04,  6.31it/s, loss=2.13, v_num=0]
Epoch 73:  73%|███████▎  | 71/97 [00:11<00:04,  6.36it/s, loss=2.13, v_num=0]
Epoch 73:  73%|███████▎  | 71/97 [00:11<00:04,  6.33it/s, loss=2.14, v_num=0]
Epoch 73:  74%|███████▍  | 72/97 [00:11<00:03,  6.37it/s, loss=2.14, v_num=0]
Epoch 73:  74%|███████▍  | 72/97 [00:11<00:03,  6.34it/s, loss=2.14, v_num=0]
Epoch 73:  75%|███████▌  | 73/97 [00:11<00:03,  6.38it/s, loss=2.14, v_num=0]
Epoch 73:  75%|███████▌  | 73/97 [00:11<00:03,  6.35it/s, loss=2.13, v_num=0]
Epoch 73:  76%|███████▋  | 74/97 [00:11<00:03,  6.39it/s, loss=2.13, v_num=0]
Epoch 73:  76%|███████▋  | 74/97 [00:11<00:03,  6.36it/s, loss=2.14, v_num=0]
Epoch 73:  77%|███████▋  | 75/97 [00:11<00:03,  6.40it/s, loss=2.14, v_num=0]
Epoch 73:  77%|███████▋  | 75/97 [00:11<00:03,  6.37it/s, loss=2.13, v_num=0]
Epoch 73:  78%|███████▊  | 76/97 [00:11<00:03,  6.41it/s, loss=2.13, v_num=0]
Epoch 73:  78%|███████▊  | 76/97 [00:11<00:03,  6.38it/s, loss=2.13, v_num=0]
Epoch 73:  79%|███████▉  | 77/97 [00:12<00:03,  6.41it/s, loss=2.13, v_num=0]
Epoch 73:  79%|███████▉  | 77/97 [00:12<00:03,  6.38it/s, loss=2.13, v_num=0]
Epoch 73:  80%|████████  | 78/97 [00:12<00:02,  6.42it/s, loss=2.13, v_num=0]
Epoch 73:  80%|████████  | 78/97 [00:12<00:02,  6.39it/s, loss=2.13, v_num=0]
Epoch 73:  81%|████████▏ | 79/97 [00:12<00:02,  6.43it/s, loss=2.13, v_num=0]
Epoch 73:  81%|████████▏ | 79/97 [00:12<00:02,  6.40it/s, loss=2.13, v_num=0]
Epoch 73:  82%|████████▏ | 80/97 [00:12<00:02,  6.44it/s, loss=2.13, v_num=0]
Epoch 73:  82%|████████▏ | 80/97 [00:12<00:02,  6.41it/s, loss=2.13, v_num=0]
Epoch 73:  84%|████████▎ | 81/97 [00:12<00:02,  6.45it/s, loss=2.13, v_num=0]
Epoch 73:  84%|████████▎ | 81/97 [00:12<00:02,  6.42it/s, loss=2.13, v_num=0]
Epoch 73:  85%|████████▍ | 82/97 [00:12<00:02,  6.46it/s, loss=2.13, v_num=0]
Epoch 73:  85%|████████▍ | 82/97 [00:12<00:02,  6.43it/s, loss=2.13, v_num=0]
Epoch 73:  86%|████████▌ | 83/97 [00:12<00:02,  6.46it/s, loss=2.13, v_num=0]
Epoch 73:  86%|████████▌ | 83/97 [00:12<00:02,  6.44it/s, loss=2.13, v_num=0]
Epoch 73:  87%|████████▋ | 84/97 [00:12<00:02,  6.47it/s, loss=2.13, v_num=0]
Epoch 73:  87%|████████▋ | 84/97 [00:13<00:02,  6.45it/s, loss=2.13, v_num=0]
Epoch 73:  88%|████████▊ | 85/97 [00:13<00:01,  6.48it/s, loss=2.13, v_num=0]
Epoch 73:  88%|████████▊ | 85/97 [00:13<00:01,  6.45it/s, loss=2.12, v_num=0]
Epoch 73:  89%|████████▊ | 86/97 [00:13<00:01,  6.49it/s, loss=2.12, v_num=0]
Epoch 73:  89%|████████▊ | 86/97 [00:13<00:01,  6.46it/s, loss=2.12, v_num=0]
Epoch 73:  90%|████████▉ | 87/97 [00:13<00:01,  6.50it/s, loss=2.12, v_num=0]
Epoch 73:  90%|████████▉ | 87/97 [00:13<00:01,  6.47it/s, loss=2.11, v_num=0]
Epoch 73:  91%|█████████ | 88/97 [00:13<00:01,  6.51it/s, loss=2.11, v_num=0]
Epoch 73:  91%|█████████ | 88/97 [00:13<00:01,  6.48it/s, loss=2.1, v_num=0]
Epoch 73:  92%|█████████▏| 89/97 [00:13<00:01,  6.51it/s, loss=2.1, v_num=0]
Epoch 73:  92%|█████████▏| 89/97 [00:13<00:01,  6.49it/s, loss=2.1, v_num=0]
Epoch 73:  93%|█████████▎| 90/97 [00:13<00:01,  6.52it/s, loss=2.1, v_num=0]
Epoch 73:  93%|█████████▎| 90/97 [00:13<00:01,  6.49it/s, loss=2.09, v_num=0]
Epoch 73:  94%|█████████▍| 91/97 [00:13<00:00,  6.53it/s, loss=2.09, v_num=0]
Epoch 73:  94%|█████████▍| 91/97 [00:14<00:00,  6.50it/s, loss=2.09, v_num=0]
Epoch 73:  95%|█████████▍| 92/97 [00:14<00:00,  6.53it/s, loss=2.09, v_num=0]
Epoch 73:  95%|█████████▍| 92/97 [00:14<00:00,  6.50it/s, loss=2.09, v_num=0]
Epoch 73:  96%|█████████▌| 93/97 [00:14<00:00,  6.54it/s, loss=2.09, v_num=0]
Epoch 73:  96%|█████████▌| 93/97 [00:14<00:00,  6.51it/s, loss=2.08, v_num=0]
Epoch 73:  97%|█████████▋| 94/97 [00:14<00:00,  6.54it/s, loss=2.08, v_num=0]
Epoch 73:  97%|█████████▋| 94/97 [00:14<00:00,  6.52it/s, loss=2.08, v_num=0]
Epoch 73:  98%|█████████▊| 95/97 [00:14<00:00,  6.55it/s, loss=2.08, v_num=0]
Epoch 73:  98%|█████████▊| 95/97 [00:14<00:00,  6.53it/s, loss=2.08, v_num=0]
Epoch 73:  99%|█████████▉| 96/97 [00:14<00:00,  6.56it/s, loss=2.08, v_num=0]
Epoch 73:  99%|█████████▉| 96/97 [00:14<00:00,  6.53it/s, loss=2.09, v_num=0]
Epoch 73: 100%|██████████| 97/97 [00:14<00:00,  6.56it/s, loss=2.09, v_num=0]
Epoch 73: 100%|██████████| 97/97 [00:14<00:00,  6.54it/s, loss=2.09, v_num=0]
Epoch 73: 100%|██████████| 97/97 [00:14<00:00,  6.54it/s, loss=2.09, v_num=0]
Epoch 73:   0%|          | 0/97 [00:00<?, ?it/s, loss=2.09, v_num=0]
Epoch 74:   0%|          | 0/97 [00:00<?, ?it/s, loss=2.09, v_num=0]
Epoch 74:   1%|          | 1/97 [00:01<02:12,  1.38s/it, loss=2.09, v_num=0]
Epoch 74:   1%|          | 1/97 [00:01<02:17,  1.43s/it, loss=2.09, v_num=0]
Epoch 74:   2%|▏         | 2/97 [00:01<01:11,  1.32it/s, loss=2.09, v_num=0]
Epoch 74:   2%|▏         | 2/97 [00:01<01:14,  1.27it/s, loss=2.09, v_num=0]
Epoch 74:   3%|▎         | 3/97 [00:01<00:51,  1.82it/s, loss=2.09, v_num=0]
Epoch 74:   3%|▎         | 3/97 [00:01<00:53,  1.76it/s, loss=2.09, v_num=0]
Epoch 74:   4%|▍         | 4/97 [00:01<00:41,  2.24it/s, loss=2.09, v_num=0]
Epoch 74:   4%|▍         | 4/97 [00:01<00:42,  2.17it/s, loss=2.09, v_num=0]
Epoch 74:   5%|▌         | 5/97 [00:01<00:35,  2.60it/s, loss=2.09, v_num=0]
Epoch 74:   5%|▌         | 5/97 [00:01<00:36,  2.52it/s, loss=2.09, v_num=0]
Epoch 74:   6%|▌         | 6/97 [00:02<00:31,  2.91it/s, loss=2.09, v_num=0]
Epoch 74:   6%|▌         | 6/97 [00:02<00:32,  2.83it/s, loss=2.09, v_num=0]
Epoch 74:   7%|▋         | 7/97 [00:02<00:28,  3.19it/s, loss=2.09, v_num=0]
Epoch 74:   7%|▋         | 7/97 [00:02<00:28,  3.11it/s, loss=2.09, v_num=0]
Epoch 74:   8%|▊         | 8/97 [00:02<00:25,  3.43it/s, loss=2.09, v_num=0]
Epoch 74:   8%|▊         | 8/97 [00:02<00:26,  3.35it/s, loss=2.09, v_num=0]
Epoch 74:   9%|▉         | 9/97 [00:02<00:27,  3.23it/s, loss=2.09, v_num=0]
Epoch 74:   9%|▉         | 9/97 [00:02<00:27,  3.16it/s, loss=2.1, v_num=0]
Epoch 74:  10%|█         | 10/97 [00:02<00:25,  3.42it/s, loss=2.1, v_num=0]
Epoch 74:  10%|█         | 10/97 [00:02<00:25,  3.35it/s, loss=2.1, v_num=0]
Epoch 74:  11%|█▏        | 11/97 [00:03<00:23,  3.60it/s, loss=2.1, v_num=0]
Epoch 74:  11%|█▏        | 11/97 [00:03<00:24,  3.53it/s, loss=2.1, v_num=0]
Epoch 74:  12%|█▏        | 12/97 [00:03<00:22,  3.75it/s, loss=2.1, v_num=0]
Epoch 74:  12%|█▏        | 12/97 [00:03<00:23,  3.69it/s, loss=2.1, v_num=0]
Epoch 74:  13%|█▎        | 13/97 [00:03<00:21,  3.90it/s, loss=2.1, v_num=0]
Epoch 74:  13%|█▎        | 13/97 [00:03<00:21,  3.83it/s, loss=2.11, v_num=0]
Epoch 74:  14%|█▍        | 14/97 [00:03<00:20,  4.03it/s, loss=2.11, v_num=0]
Epoch 74:  14%|█▍        | 14/97 [00:03<00:20,  3.97it/s, loss=2.11, v_num=0]
Epoch 74:  15%|█▌        | 15/97 [00:03<00:19,  4.16it/s, loss=2.11, v_num=0]
Epoch 74:  15%|█▌        | 15/97 [00:03<00:20,  4.09it/s, loss=2.1, v_num=0]
Epoch 74:  16%|█▋        | 16/97 [00:03<00:18,  4.27it/s, loss=2.1, v_num=0]
Epoch 74:  16%|█▋        | 16/97 [00:03<00:19,  4.21it/s, loss=2.11, v_num=0]
Epoch 74:  18%|█▊        | 17/97 [00:03<00:18,  4.37it/s, loss=2.11, v_num=0]
Epoch 74:  18%|█▊        | 17/97 [00:03<00:18,  4.31it/s, loss=2.11, v_num=0]
Epoch 74:  19%|█▊        | 18/97 [00:04<00:17,  4.47it/s, loss=2.11, v_num=0]
Epoch 74:  19%|█▊        | 18/97 [00:04<00:17,  4.41it/s, loss=2.11, v_num=0]
Epoch 74:  20%|█▉        | 19/97 [00:04<00:17,  4.57it/s, loss=2.11, v_num=0]
Epoch 74:  20%|█▉        | 19/97 [00:04<00:17,  4.51it/s, loss=2.11, v_num=0]
Epoch 74:  21%|██        | 20/97 [00:04<00:16,  4.66it/s, loss=2.11, v_num=0]
Epoch 74:  21%|██        | 20/97 [00:04<00:16,  4.60it/s, loss=2.11, v_num=0]
Epoch 74:  22%|██▏       | 21/97 [00:04<00:16,  4.74it/s, loss=2.11, v_num=0]
Epoch 74:  22%|██▏       | 21/97 [00:04<00:16,  4.68it/s, loss=2.11, v_num=0]
Epoch 74:  23%|██▎       | 22/97 [00:04<00:15,  4.82it/s, loss=2.11, v_num=0]
Epoch 74:  23%|██▎       | 22/97 [00:04<00:15,  4.76it/s, loss=2.11, v_num=0]
Epoch 74:  24%|██▎       | 23/97 [00:04<00:15,  4.89it/s, loss=2.11, v_num=0]
Epoch 74:  24%|██▎       | 23/97 [00:04<00:15,  4.83it/s, loss=2.11, v_num=0]
Epoch 74:  25%|██▍       | 24/97 [00:04<00:14,  4.95it/s, loss=2.11, v_num=0]
Epoch 74:  25%|██▍       | 24/97 [00:04<00:14,  4.90it/s, loss=2.11, v_num=0]
Epoch 74:  26%|██▌       | 25/97 [00:04<00:14,  5.01it/s, loss=2.11, v_num=0]
Epoch 74:  26%|██▌       | 25/97 [00:05<00:14,  4.96it/s, loss=2.11, v_num=0]
Epoch 74:  27%|██▋       | 26/97 [00:05<00:13,  5.08it/s, loss=2.11, v_num=0]
Epoch 74:  27%|██▋       | 26/97 [00:05<00:14,  5.02it/s, loss=2.1, v_num=0]
Epoch 74:  28%|██▊       | 27/97 [00:05<00:13,  5.13it/s, loss=2.1, v_num=0]
Epoch 74:  28%|██▊       | 27/97 [00:05<00:13,  5.08it/s, loss=2.1, v_num=0]
Epoch 74:  29%|██▉       | 28/97 [00:05<00:13,  5.19it/s, loss=2.1, v_num=0]
Epoch 74:  29%|██▉       | 28/97 [00:05<00:13,  5.14it/s, loss=2.1, v_num=0]
Epoch 74:  30%|██▉       | 29/97 [00:05<00:12,  5.24it/s, loss=2.1, v_num=0]
Epoch 74:  30%|██▉       | 29/97 [00:05<00:13,  5.19it/s, loss=2.1, v_num=0]
Epoch 74:  31%|███       | 30/97 [00:05<00:12,  5.29it/s, loss=2.1, v_num=0]
Epoch 74:  31%|███       | 30/97 [00:05<00:12,  5.24it/s, loss=2.1, v_num=0]
Epoch 74:  32%|███▏      | 31/97 [00:05<00:12,  5.34it/s, loss=2.1, v_num=0]
Epoch 74:  32%|███▏      | 31/97 [00:05<00:12,  5.29it/s, loss=2.1, v_num=0]
Epoch 74:  33%|███▎      | 32/97 [00:05<00:12,  5.38it/s, loss=2.1, v_num=0]
Epoch 74:  33%|███▎      | 32/97 [00:06<00:12,  5.33it/s, loss=2.1, v_num=0]
Epoch 74:  34%|███▍      | 33/97 [00:06<00:11,  5.42it/s, loss=2.1, v_num=0]
Epoch 74:  34%|███▍      | 33/97 [00:06<00:11,  5.38it/s, loss=2.1, v_num=0]
Epoch 74:  35%|███▌      | 34/97 [00:06<00:11,  5.46it/s, loss=2.1, v_num=0]
Epoch 74:  35%|███▌      | 34/97 [00:06<00:11,  5.42it/s, loss=2.1, v_num=0]
Epoch 74:  36%|███▌      | 35/97 [00:06<00:11,  5.50it/s, loss=2.1, v_num=0]
Epoch 74:  36%|███▌      | 35/97 [00:06<00:11,  5.46it/s, loss=2.11, v_num=0]
Epoch 74:  37%|███▋      | 36/97 [00:06<00:11,  5.54it/s, loss=2.11, v_num=0]
Epoch 74:  37%|███▋      | 36/97 [00:06<00:11,  5.50it/s, loss=2.11, v_num=0]
Epoch 74:  38%|███▊      | 37/97 [00:06<00:10,  5.58it/s, loss=2.11, v_num=0]
Epoch 74:  38%|███▊      | 37/97 [00:06<00:10,  5.53it/s, loss=2.1, v_num=0]
Epoch 74:  39%|███▉      | 38/97 [00:06<00:10,  5.61it/s, loss=2.1, v_num=0]
Epoch 74:  39%|███▉      | 38/97 [00:06<00:10,  5.57it/s, loss=2.1, v_num=0]
Epoch 74:  40%|████      | 39/97 [00:06<00:10,  5.64it/s, loss=2.1, v_num=0]
Epoch 74:  40%|████      | 39/97 [00:06<00:10,  5.60it/s, loss=2.1, v_num=0]
Epoch 74:  41%|████      | 40/97 [00:07<00:10,  5.68it/s, loss=2.1, v_num=0]
Epoch 74:  41%|████      | 40/97 [00:07<00:10,  5.63it/s, loss=2.1, v_num=0]
Epoch 74:  42%|████▏     | 41/97 [00:07<00:09,  5.71it/s, loss=2.1, v_num=0]
Epoch 74:  42%|████▏     | 41/97 [00:07<00:09,  5.66it/s, loss=2.1, v_num=0]
Epoch 74:  43%|████▎     | 42/97 [00:07<00:09,  5.74it/s, loss=2.1, v_num=0]
Epoch 74:  43%|████▎     | 42/97 [00:07<00:09,  5.69it/s, loss=2.1, v_num=0]
Epoch 74:  44%|████▍     | 43/97 [00:07<00:09,  5.76it/s, loss=2.1, v_num=0]
Epoch 74:  44%|████▍     | 43/97 [00:07<00:09,  5.72it/s, loss=2.1, v_num=0]
Epoch 74:  45%|████▌     | 44/97 [00:07<00:09,  5.79it/s, loss=2.1, v_num=0]
Epoch 74:  45%|████▌     | 44/97 [00:07<00:09,  5.75it/s, loss=2.1, v_num=0]
Epoch 74:  46%|████▋     | 45/97 [00:07<00:08,  5.82it/s, loss=2.1, v_num=0]
Epoch 74:  46%|████▋     | 45/97 [00:07<00:09,  5.77it/s, loss=2.1, v_num=0]
Epoch 74:  47%|████▋     | 46/97 [00:07<00:08,  5.84it/s, loss=2.1, v_num=0]
Epoch 74:  47%|████▋     | 46/97 [00:07<00:08,  5.80it/s, loss=2.09, v_num=0]
Epoch 74:  48%|████▊     | 47/97 [00:08<00:08,  5.86it/s, loss=2.09, v_num=0]
Epoch 74:  48%|████▊     | 47/97 [00:08<00:08,  5.82it/s, loss=2.1, v_num=0]
Epoch 74:  49%|████▉     | 48/97 [00:08<00:08,  5.88it/s, loss=2.1, v_num=0]
Epoch 74:  49%|████▉     | 48/97 [00:08<00:08,  5.84it/s, loss=2.09, v_num=0]
Epoch 74:  51%|█████     | 49/97 [00:08<00:08,  5.90it/s, loss=2.09, v_num=0]
Epoch 74:  51%|█████     | 49/97 [00:08<00:08,  5.86it/s, loss=2.09, v_num=0]
Epoch 74:  52%|█████▏    | 50/97 [00:08<00:07,  5.92it/s, loss=2.09, v_num=0]
Epoch 74:  52%|█████▏    | 50/97 [00:08<00:07,  5.88it/s, loss=2.09, v_num=0]
Epoch 74:  53%|█████▎    | 51/97 [00:08<00:07,  5.94it/s, loss=2.09, v_num=0]
Epoch 74:  53%|█████▎    | 51/97 [00:08<00:07,  5.90it/s, loss=2.09, v_num=0]
Epoch 74:  54%|█████▎    | 52/97 [00:08<00:07,  5.96it/s, loss=2.09, v_num=0]
Epoch 74:  54%|█████▎    | 52/97 [00:08<00:07,  5.92it/s, loss=2.09, v_num=0]
Epoch 74:  55%|█████▍    | 53/97 [00:08<00:07,  5.98it/s, loss=2.09, v_num=0]
Epoch 74:  55%|█████▍    | 53/97 [00:08<00:07,  5.94it/s, loss=2.08, v_num=0]
Epoch 74:  56%|█████▌    | 54/97 [00:09<00:07,  6.00it/s, loss=2.08, v_num=0]
Epoch 74:  56%|█████▌    | 54/97 [00:09<00:07,  5.96it/s, loss=2.08, v_num=0]
Epoch 74:  57%|█████▋    | 55/97 [00:09<00:06,  6.02it/s, loss=2.08, v_num=0]
Epoch 74:  57%|█████▋    | 55/97 [00:09<00:07,  5.98it/s, loss=2.08, v_num=0]
Epoch 74:  58%|█████▊    | 56/97 [00:09<00:06,  6.04it/s, loss=2.08, v_num=0]
Epoch 74:  58%|█████▊    | 56/97 [00:09<00:06,  6.00it/s, loss=2.08, v_num=0]
Epoch 74:  59%|█████▉    | 57/97 [00:09<00:06,  6.05it/s, loss=2.08, v_num=0]
Epoch 74:  59%|█████▉    | 57/97 [00:09<00:06,  6.02it/s, loss=2.08, v_num=0]
Epoch 74:  60%|█████▉    | 58/97 [00:09<00:06,  6.07it/s, loss=2.08, v_num=0]
Epoch 74:  60%|█████▉    | 58/97 [00:09<00:06,  6.04it/s, loss=2.07, v_num=0]
Epoch 74:  61%|██████    | 59/97 [00:09<00:06,  6.09it/s, loss=2.07, v_num=0]
Epoch 74:  61%|██████    | 59/97 [00:09<00:06,  6.05it/s, loss=2.07, v_num=0]
Epoch 74:  62%|██████▏   | 60/97 [00:09<00:06,  6.10it/s, loss=2.07, v_num=0]
Epoch 74:  62%|██████▏   | 60/97 [00:09<00:06,  6.07it/s, loss=2.06, v_num=0]
Epoch 74:  63%|██████▎   | 61/97 [00:09<00:05,  6.12it/s, loss=2.06, v_num=0]
Epoch 74:  63%|██████▎   | 61/97 [00:10<00:05,  6.09it/s, loss=2.06, v_num=0]
Epoch 74:  64%|██████▍   | 62/97 [00:10<00:05,  6.13it/s, loss=2.06, v_num=0]
Epoch 74:  64%|██████▍   | 62/97 [00:10<00:05,  6.10it/s, loss=2.07, v_num=0]
Epoch 74:  65%|██████▍   | 63/97 [00:10<00:05,  6.15it/s, loss=2.07, v_num=0]
Epoch 74:  65%|██████▍   | 63/97 [00:10<00:05,  6.12it/s, loss=2.07, v_num=0]
Epoch 74:  66%|██████▌   | 64/97 [00:10<00:05,  6.17it/s, loss=2.07, v_num=0]
Epoch 74:  66%|██████▌   | 64/97 [00:10<00:05,  6.13it/s, loss=2.06, v_num=0]
Epoch 74:  67%|██████▋   | 65/97 [00:10<00:05,  6.18it/s, loss=2.06, v_num=0]
Epoch 74:  67%|██████▋   | 65/97 [00:10<00:05,  6.15it/s, loss=2.07, v_num=0]
Epoch 74:  68%|██████▊   | 66/97 [00:10<00:05,  6.19it/s, loss=2.07, v_num=0]
Epoch 74:  68%|██████▊   | 66/97 [00:10<00:05,  6.16it/s, loss=2.07, v_num=0]
Epoch 74:  69%|██████▉   | 67/97 [00:10<00:04,  6.21it/s, loss=2.07, v_num=0]
Epoch 74:  69%|██████▉   | 67/97 [00:10<00:04,  6.18it/s, loss=2.07, v_num=0]
Epoch 74:  70%|███████   | 68/97 [00:10<00:04,  6.22it/s, loss=2.07, v_num=0]
Epoch 74:  70%|███████   | 68/97 [00:10<00:04,  6.19it/s, loss=2.08, v_num=0]
Epoch 74:  71%|███████   | 69/97 [00:11<00:04,  6.23it/s, loss=2.08, v_num=0]
Epoch 74:  71%|███████   | 69/97 [00:11<00:04,  6.20it/s, loss=2.08, v_num=0]
Epoch 74:  72%|███████▏  | 70/97 [00:11<00:04,  6.25it/s, loss=2.08, v_num=0]
Epoch 74:  72%|███████▏  | 70/97 [00:11<00:04,  6.22it/s, loss=2.08, v_num=0]
Epoch 74:  73%|███████▎  | 71/97 [00:11<00:04,  6.26it/s, loss=2.08, v_num=0]
Epoch 74:  73%|███████▎  | 71/97 [00:11<00:04,  6.23it/s, loss=2.07, v_num=0]
Epoch 74:  74%|███████▍  | 72/97 [00:11<00:03,  6.27it/s, loss=2.07, v_num=0]
Epoch 74:  74%|███████▍  | 72/97 [00:11<00:04,  6.24it/s, loss=2.07, v_num=0]
Epoch 74:  75%|███████▌  | 73/97 [00:11<00:03,  6.28it/s, loss=2.07, v_num=0]
Epoch 74:  75%|███████▌  | 73/97 [00:11<00:03,  6.25it/s, loss=2.06, v_num=0]
Epoch 74:  76%|███████▋  | 74/97 [00:11<00:03,  6.29it/s, loss=2.06, v_num=0]
Epoch 74:  76%|███████▋  | 74/97 [00:11<00:03,  6.27it/s, loss=2.07, v_num=0]
Epoch 74:  77%|███████▋  | 75/97 [00:11<00:03,  6.31it/s, loss=2.07, v_num=0]
Epoch 74:  77%|███████▋  | 75/97 [00:11<00:03,  6.28it/s, loss=2.07, v_num=0]
Epoch 74:  78%|███████▊  | 76/97 [00:12<00:03,  6.32it/s, loss=2.07, v_num=0]
Epoch 74:  78%|███████▊  | 76/97 [00:12<00:03,  6.29it/s, loss=2.08, v_num=0]
Epoch 74:  79%|███████▉  | 77/97 [00:12<00:03,  6.33it/s, loss=2.08, v_num=0]
Epoch 74:  79%|███████▉  | 77/97 [00:12<00:03,  6.30it/s, loss=2.09, v_num=0]
Epoch 74:  80%|████████  | 78/97 [00:12<00:02,  6.34it/s, loss=2.09, v_num=0]
Epoch 74:  80%|████████  | 78/97 [00:12<00:03,  6.31it/s, loss=2.09, v_num=0]
Epoch 74:  81%|████████▏ | 79/97 [00:12<00:02,  6.35it/s, loss=2.09, v_num=0]
Epoch 74:  81%|████████▏ | 79/97 [00:12<00:02,  6.32it/s, loss=2.1, v_num=0]
Epoch 74:  82%|████████▏ | 80/97 [00:12<00:02,  6.36it/s, loss=2.1, v_num=0]
Epoch 74:  82%|████████▏ | 80/97 [00:12<00:02,  6.33it/s, loss=2.1, v_num=0]
Epoch 74:  84%|████████▎ | 81/97 [00:12<00:02,  6.37it/s, loss=2.1, v_num=0]
Epoch 74:  84%|████████▎ | 81/97 [00:12<00:02,  6.34it/s, loss=2.09, v_num=0]
Epoch 74:  85%|████████▍ | 82/97 [00:12<00:02,  6.38it/s, loss=2.09, v_num=0]
Epoch 74:  85%|████████▍ | 82/97 [00:12<00:02,  6.35it/s, loss=2.09, v_num=0]
Epoch 74:  86%|████████▌ | 83/97 [00:12<00:02,  6.39it/s, loss=2.09, v_num=0]
Epoch 74:  86%|████████▌ | 83/97 [00:13<00:02,  6.36it/s, loss=2.09, v_num=0]
Epoch 74:  87%|████████▋ | 84/97 [00:13<00:02,  6.40it/s, loss=2.09, v_num=0]
Epoch 74:  87%|████████▋ | 84/97 [00:13<00:02,  6.37it/s, loss=2.09, v_num=0]
Epoch 74:  88%|████████▊ | 85/97 [00:13<00:01,  6.40it/s, loss=2.09, v_num=0]
Epoch 74:  88%|████████▊ | 85/97 [00:13<00:01,  6.38it/s, loss=2.1, v_num=0]
Epoch 74:  89%|████████▊ | 86/97 [00:13<00:01,  6.41it/s, loss=2.1, v_num=0]
Epoch 74:  89%|████████▊ | 86/97 [00:13<00:01,  6.39it/s, loss=2.09, v_num=0]
Epoch 74:  90%|████████▉ | 87/97 [00:13<00:01,  6.42it/s, loss=2.09, v_num=0]
Epoch 74:  90%|████████▉ | 87/97 [00:13<00:01,  6.40it/s, loss=2.1, v_num=0]
Epoch 74:  91%|█████████ | 88/97 [00:13<00:01,  6.43it/s, loss=2.1, v_num=0]
Epoch 74:  91%|█████████ | 88/97 [00:13<00:01,  6.41it/s, loss=2.09, v_num=0]
Epoch 74:  92%|█████████▏| 89/97 [00:13<00:01,  6.44it/s, loss=2.09, v_num=0]
Epoch 74:  92%|█████████▏| 89/97 [00:13<00:01,  6.41it/s, loss=2.09, v_num=0]
Epoch 74:  93%|█████████▎| 90/97 [00:13<00:01,  6.45it/s, loss=2.09, v_num=0]
Epoch 74:  93%|█████████▎| 90/97 [00:14<00:01,  6.42it/s, loss=2.09, v_num=0]
Epoch 74:  94%|█████████▍| 91/97 [00:14<00:00,  6.46it/s, loss=2.09, v_num=0]
Epoch 74:  94%|█████████▍| 91/97 [00:14<00:00,  6.43it/s, loss=2.1, v_num=0]
Epoch 74:  95%|█████████▍| 92/97 [00:14<00:00,  6.47it/s, loss=2.1, v_num=0]
Epoch 74:  95%|█████████▍| 92/97 [00:14<00:00,  6.44it/s, loss=2.1, v_num=0]
Epoch 74:  96%|█████████▌| 93/97 [00:14<00:00,  6.47it/s, loss=2.1, v_num=0]
Epoch 74:  96%|█████████▌| 93/97 [00:14<00:00,  6.45it/s, loss=2.11, v_num=0]
Epoch 74:  97%|█████████▋| 94/97 [00:14<00:00,  6.48it/s, loss=2.11, v_num=0]
Epoch 74:  97%|█████████▋| 94/97 [00:14<00:00,  6.46it/s, loss=2.11, v_num=0]
Epoch 74:  98%|█████████▊| 95/97 [00:14<00:00,  6.49it/s, loss=2.11, v_num=0]
Epoch 74:  98%|█████████▊| 95/97 [00:14<00:00,  6.46it/s, loss=2.11, v_num=0]
Epoch 74:  99%|█████████▉| 96/97 [00:14<00:00,  6.50it/s, loss=2.11, v_num=0]
Epoch 74:  99%|█████████▉| 96/97 [00:14<00:00,  6.47it/s, loss=2.1, v_num=0]
Epoch 74: 100%|██████████| 97/97 [00:14<00:00,  6.50it/s, loss=2.1, v_num=0]
Epoch 74: 100%|██████████| 97/97 [00:14<00:00,  6.48it/s, loss=2.09, v_num=0]
Epoch 74: 100%|██████████| 97/97 [00:14<00:00,  6.48it/s, loss=2.09, v_num=0]
Epoch 74:   0%|          | 0/97 [00:00<?, ?it/s, loss=2.09, v_num=0]
Epoch 75:   0%|          | 0/97 [00:00<?, ?it/s, loss=2.09, v_num=0]
Epoch 75:   1%|          | 1/97 [00:01<02:20,  1.46s/it, loss=2.09, v_num=0]
Epoch 75:   1%|          | 1/97 [00:01<02:25,  1.52s/it, loss=2.09, v_num=0]
Epoch 75:   2%|▏         | 2/97 [00:01<01:16,  1.25it/s, loss=2.09, v_num=0]
Epoch 75:   2%|▏         | 2/97 [00:01<01:18,  1.21it/s, loss=2.08, v_num=0]
Epoch 75:   3%|▎         | 3/97 [00:01<00:54,  1.73it/s, loss=2.08, v_num=0]
Epoch 75:   3%|▎         | 3/97 [00:01<00:56,  1.67it/s, loss=2.08, v_num=0]
Epoch 75:   4%|▍         | 4/97 [00:01<00:43,  2.14it/s, loss=2.08, v_num=0]
Epoch 75:   4%|▍         | 4/97 [00:01<00:44,  2.07it/s, loss=2.09, v_num=0]
Epoch 75:   5%|▌         | 5/97 [00:02<00:37,  2.48it/s, loss=2.09, v_num=0]
Epoch 75:   5%|▌         | 5/97 [00:02<00:38,  2.42it/s, loss=2.09, v_num=0]
Epoch 75:   6%|▌         | 6/97 [00:02<00:35,  2.56it/s, loss=2.09, v_num=0]
Epoch 75:   6%|▌         | 6/97 [00:02<00:36,  2.50it/s, loss=2.09, v_num=0]
Epoch 75:   7%|▋         | 7/97 [00:02<00:32,  2.81it/s, loss=2.09, v_num=0]
Epoch 75:   7%|▋         | 7/97 [00:02<00:32,  2.75it/s, loss=2.08, v_num=0]
Epoch 75:   8%|▊         | 8/97 [00:02<00:29,  3.04it/s, loss=2.08, v_num=0]
Epoch 75:   8%|▊         | 8/97 [00:02<00:29,  2.98it/s, loss=2.07, v_num=0]
Epoch 75:   9%|▉         | 9/97 [00:02<00:27,  3.25it/s, loss=2.07, v_num=0]
Epoch 75:   9%|▉         | 9/97 [00:02<00:27,  3.19it/s, loss=2.08, v_num=0]
Epoch 75:  10%|█         | 10/97 [00:02<00:25,  3.44it/s, loss=2.08, v_num=0]
Epoch 75:  10%|█         | 10/97 [00:02<00:25,  3.38it/s, loss=2.08, v_num=0]
Epoch 75:  11%|█▏        | 11/97 [00:03<00:23,  3.61it/s, loss=2.08, v_num=0]
Epoch 75:  11%|█▏        | 11/97 [00:03<00:24,  3.55it/s, loss=2.09, v_num=0]
Epoch 75:  12%|█▏        | 12/97 [00:03<00:22,  3.77it/s, loss=2.09, v_num=0]
Epoch 75:  12%|█▏        | 12/97 [00:03<00:22,  3.70it/s, loss=2.09, v_num=0]
Epoch 75:  13%|█▎        | 13/97 [00:03<00:21,  3.91it/s, loss=2.09, v_num=0]
Epoch 75:  13%|█▎        | 13/97 [00:03<00:21,  3.85it/s, loss=2.09, v_num=0]
Epoch 75:  14%|█▍        | 14/97 [00:03<00:20,  4.04it/s, loss=2.09, v_num=0]
Epoch 75:  14%|█▍        | 14/97 [00:03<00:20,  3.98it/s, loss=2.08, v_num=0]
Epoch 75:  15%|█▌        | 15/97 [00:03<00:19,  4.17it/s, loss=2.08, v_num=0]
Epoch 75:  15%|█▌        | 15/97 [00:03<00:19,  4.10it/s, loss=2.08, v_num=0]
Epoch 75:  16%|█▋        | 16/97 [00:03<00:18,  4.28it/s, loss=2.08, v_num=0]
Epoch 75:  16%|█▋        | 16/97 [00:03<00:19,  4.22it/s, loss=2.07, v_num=0]
Epoch 75:  18%|█▊        | 17/97 [00:03<00:18,  4.39it/s, loss=2.07, v_num=0]
Epoch 75:  18%|█▊        | 17/97 [00:03<00:18,  4.32it/s, loss=2.07, v_num=0]
Epoch 75:  19%|█▊        | 18/97 [00:04<00:17,  4.48it/s, loss=2.07, v_num=0]
Epoch 75:  19%|█▊        | 18/97 [00:04<00:17,  4.42it/s, loss=2.07, v_num=0]
Epoch 75:  20%|█▉        | 19/97 [00:04<00:17,  4.57it/s, loss=2.07, v_num=0]
Epoch 75:  20%|█▉        | 19/97 [00:04<00:17,  4.51it/s, loss=2.07, v_num=0]
Epoch 75:  21%|██        | 20/97 [00:04<00:16,  4.66it/s, loss=2.07, v_num=0]
Epoch 75:  21%|██        | 20/97 [00:04<00:16,  4.59it/s, loss=2.07, v_num=0]
Epoch 75:  22%|██▏       | 21/97 [00:04<00:16,  4.73it/s, loss=2.07, v_num=0]
Epoch 75:  22%|██▏       | 21/97 [00:04<00:16,  4.68it/s, loss=2.07, v_num=0]
Epoch 75:  23%|██▎       | 22/97 [00:04<00:15,  4.82it/s, loss=2.07, v_num=0]
Epoch 75:  23%|██▎       | 22/97 [00:04<00:15,  4.76it/s, loss=2.08, v_num=0]
Epoch 75:  24%|██▎       | 23/97 [00:04<00:15,  4.89it/s, loss=2.08, v_num=0]
Epoch 75:  24%|██▎       | 23/97 [00:04<00:15,  4.83it/s, loss=2.07, v_num=0]
Epoch 75:  25%|██▍       | 24/97 [00:04<00:14,  4.96it/s, loss=2.07, v_num=0]
Epoch 75:  25%|██▍       | 24/97 [00:04<00:14,  4.90it/s, loss=2.07, v_num=0]
Epoch 75:  26%|██▌       | 25/97 [00:04<00:14,  5.02it/s, loss=2.07, v_num=0]
Epoch 75:  26%|██▌       | 25/97 [00:05<00:14,  4.96it/s, loss=2.06, v_num=0]
Epoch 75:  27%|██▋       | 26/97 [00:05<00:13,  5.07it/s, loss=2.06, v_num=0]
Epoch 75:  27%|██▋       | 26/97 [00:05<00:14,  5.02it/s, loss=2.07, v_num=0]
Epoch 75:  28%|██▊       | 27/97 [00:05<00:13,  5.13it/s, loss=2.07, v_num=0]
Epoch 75:  28%|██▊       | 27/97 [00:05<00:13,  5.08it/s, loss=2.07, v_num=0]
Epoch 75:  29%|██▉       | 28/97 [00:05<00:13,  5.19it/s, loss=2.07, v_num=0]
Epoch 75:  29%|██▉       | 28/97 [00:05<00:13,  5.13it/s, loss=2.07, v_num=0]
Epoch 75:  30%|██▉       | 29/97 [00:05<00:12,  5.23it/s, loss=2.07, v_num=0]
Epoch 75:  30%|██▉       | 29/97 [00:05<00:13,  5.18it/s, loss=2.07, v_num=0]
Epoch 75:  31%|███       | 30/97 [00:05<00:12,  5.28it/s, loss=2.07, v_num=0]
Epoch 75:  31%|███       | 30/97 [00:05<00:12,  5.23it/s, loss=2.07, v_num=0]
Epoch 75:  32%|███▏      | 31/97 [00:05<00:12,  5.32it/s, loss=2.07, v_num=0]
Epoch 75:  32%|███▏      | 31/97 [00:05<00:12,  5.27it/s, loss=2.06, v_num=0]
Epoch 75:  33%|███▎      | 32/97 [00:05<00:12,  5.36it/s, loss=2.06, v_num=0]
Epoch 75:  33%|███▎      | 32/97 [00:06<00:12,  5.31it/s, loss=2.06, v_num=0]
Epoch 75:  34%|███▍      | 33/97 [00:06<00:11,  5.41it/s, loss=2.06, v_num=0]
Epoch 75:  34%|███▍      | 33/97 [00:06<00:11,  5.36it/s, loss=2.06, v_num=0]
Epoch 75:  35%|███▌      | 34/97 [00:06<00:11,  5.44it/s, loss=2.06, v_num=0]
Epoch 75:  35%|███▌      | 34/97 [00:06<00:11,  5.40it/s, loss=2.06, v_num=0]
Epoch 75:  36%|███▌      | 35/97 [00:06<00:11,  5.46it/s, loss=2.06, v_num=0]
Epoch 75:  36%|███▌      | 35/97 [00:06<00:11,  5.42it/s, loss=2.07, v_num=0]
Epoch 75:  37%|███▋      | 36/97 [00:06<00:11,  5.50it/s, loss=2.07, v_num=0]
Epoch 75:  37%|███▋      | 36/97 [00:06<00:11,  5.45it/s, loss=2.07, v_num=0]
Epoch 75:  38%|███▊      | 37/97 [00:06<00:10,  5.53it/s, loss=2.07, v_num=0]
Epoch 75:  38%|███▊      | 37/97 [00:06<00:10,  5.49it/s, loss=2.07, v_num=0]
Epoch 75:  39%|███▉      | 38/97 [00:06<00:10,  5.56it/s, loss=2.07, v_num=0]
Epoch 75:  39%|███▉      | 38/97 [00:06<00:10,  5.52it/s, loss=2.08, v_num=0]
Epoch 75:  40%|████      | 39/97 [00:06<00:10,  5.60it/s, loss=2.08, v_num=0]
Epoch 75:  40%|████      | 39/97 [00:07<00:10,  5.55it/s, loss=2.07, v_num=0]
Epoch 75:  41%|████      | 40/97 [00:07<00:10,  5.63it/s, loss=2.07, v_num=0]
Epoch 75:  41%|████      | 40/97 [00:07<00:10,  5.59it/s, loss=2.08, v_num=0]
Epoch 75:  42%|████▏     | 41/97 [00:07<00:09,  5.66it/s, loss=2.08, v_num=0]
Epoch 75:  42%|████▏     | 41/97 [00:07<00:09,  5.62it/s, loss=2.08, v_num=0]
Epoch 75:  43%|████▎     | 42/97 [00:07<00:09,  5.68it/s, loss=2.08, v_num=0]
Epoch 75:  43%|████▎     | 42/97 [00:07<00:09,  5.65it/s, loss=2.08, v_num=0]
Epoch 75:  44%|████▍     | 43/97 [00:07<00:09,  5.72it/s, loss=2.08, v_num=0]
Epoch 75:  44%|████▍     | 43/97 [00:07<00:09,  5.67it/s, loss=2.09, v_num=0]
Epoch 75:  45%|████▌     | 44/97 [00:07<00:09,  5.74it/s, loss=2.09, v_num=0]
Epoch 75:  45%|████▌     | 44/97 [00:07<00:09,  5.70it/s, loss=2.09, v_num=0]
Epoch 75:  46%|████▋     | 45/97 [00:07<00:09,  5.77it/s, loss=2.09, v_num=0]
Epoch 75:  46%|████▋     | 45/97 [00:07<00:09,  5.73it/s, loss=2.09, v_num=0]
Epoch 75:  47%|████▋     | 46/97 [00:07<00:08,  5.79it/s, loss=2.09, v_num=0]
Epoch 75:  47%|████▋     | 46/97 [00:07<00:08,  5.75it/s, loss=2.09, v_num=0]
Epoch 75:  48%|████▊     | 47/97 [00:08<00:08,  5.82it/s, loss=2.09, v_num=0]
Epoch 75:  48%|████▊     | 47/97 [00:08<00:08,  5.78it/s, loss=2.09, v_num=0]
Epoch 75:  49%|████▉     | 48/97 [00:08<00:08,  5.84it/s, loss=2.09, v_num=0]
Epoch 75:  49%|████▉     | 48/97 [00:08<00:08,  5.80it/s, loss=2.09, v_num=0]
Epoch 75:  51%|█████     | 49/97 [00:08<00:08,  5.86it/s, loss=2.09, v_num=0]
Epoch 75:  51%|█████     | 49/97 [00:08<00:08,  5.82it/s, loss=2.09, v_num=0]
Epoch 75:  52%|█████▏    | 50/97 [00:08<00:07,  5.89it/s, loss=2.09, v_num=0]
Epoch 75:  52%|█████▏    | 50/97 [00:08<00:08,  5.85it/s, loss=2.09, v_num=0]
Epoch 75:  53%|█████▎    | 51/97 [00:08<00:07,  5.91it/s, loss=2.09, v_num=0]
Epoch 75:  53%|█████▎    | 51/97 [00:08<00:07,  5.87it/s, loss=2.09, v_num=0]
Epoch 75:  54%|█████▎    | 52/97 [00:08<00:07,  5.92it/s, loss=2.09, v_num=0]
Epoch 75:  54%|█████▎    | 52/97 [00:08<00:07,  5.88it/s, loss=2.09, v_num=0]
Epoch 75:  55%|█████▍    | 53/97 [00:08<00:07,  5.94it/s, loss=2.09, v_num=0]
Epoch 75:  55%|█████▍    | 53/97 [00:08<00:07,  5.90it/s, loss=2.1, v_num=0]
Epoch 75:  56%|█████▌    | 54/97 [00:09<00:07,  5.96it/s, loss=2.1, v_num=0]
Epoch 75:  56%|█████▌    | 54/97 [00:09<00:07,  5.92it/s, loss=2.1, v_num=0]
Epoch 75:  57%|█████▋    | 55/97 [00:09<00:07,  5.98it/s, loss=2.1, v_num=0]
Epoch 75:  57%|█████▋    | 55/97 [00:09<00:07,  5.94it/s, loss=2.1, v_num=0]
Epoch 75:  58%|█████▊    | 56/97 [00:09<00:06,  5.99it/s, loss=2.1, v_num=0]
Epoch 75:  58%|█████▊    | 56/97 [00:09<00:06,  5.96it/s, loss=2.1, v_num=0]
Epoch 75:  59%|█████▉    | 57/97 [00:09<00:06,  6.01it/s, loss=2.1, v_num=0]
Epoch 75:  59%|█████▉    | 57/97 [00:09<00:06,  5.98it/s, loss=2.1, v_num=0]
Epoch 75:  60%|█████▉    | 58/97 [00:09<00:06,  6.03it/s, loss=2.1, v_num=0]
Epoch 75:  60%|█████▉    | 58/97 [00:09<00:06,  6.00it/s, loss=2.09, v_num=0]
Epoch 75:  61%|██████    | 59/97 [00:09<00:06,  6.05it/s, loss=2.09, v_num=0]
Epoch 75:  61%|██████    | 59/97 [00:09<00:06,  6.02it/s, loss=2.1, v_num=0]
Epoch 75:  62%|██████▏   | 60/97 [00:09<00:06,  6.07it/s, loss=2.1, v_num=0]
Epoch 75:  62%|██████▏   | 60/97 [00:09<00:06,  6.03it/s, loss=2.1, v_num=0]
Epoch 75:  63%|██████▎   | 61/97 [00:10<00:05,  6.08it/s, loss=2.1, v_num=0]
Epoch 75:  63%|██████▎   | 61/97 [00:10<00:05,  6.05it/s, loss=2.09, v_num=0]
Epoch 75:  64%|██████▍   | 62/97 [00:10<00:05,  6.10it/s, loss=2.09, v_num=0]
Epoch 75:  64%|██████▍   | 62/97 [00:10<00:05,  6.07it/s, loss=2.09, v_num=0]
Epoch 75:  65%|██████▍   | 63/97 [00:10<00:05,  6.11it/s, loss=2.09, v_num=0]
Epoch 75:  65%|██████▍   | 63/97 [00:10<00:05,  6.08it/s, loss=2.09, v_num=0]
Epoch 75:  66%|██████▌   | 64/97 [00:10<00:05,  6.13it/s, loss=2.09, v_num=0]
Epoch 75:  66%|██████▌   | 64/97 [00:10<00:05,  6.10it/s, loss=2.09, v_num=0]
Epoch 75:  67%|██████▋   | 65/97 [00:10<00:05,  6.14it/s, loss=2.09, v_num=0]
Epoch 75:  67%|██████▋   | 65/97 [00:10<00:05,  6.11it/s, loss=2.09, v_num=0]
Epoch 75:  68%|██████▊   | 66/97 [00:10<00:05,  6.16it/s, loss=2.09, v_num=0]
Epoch 75:  68%|██████▊   | 66/97 [00:10<00:05,  6.12it/s, loss=2.09, v_num=0]
Epoch 75:  69%|██████▉   | 67/97 [00:10<00:04,  6.17it/s, loss=2.09, v_num=0]
Epoch 75:  69%|██████▉   | 67/97 [00:10<00:04,  6.14it/s, loss=2.09, v_num=0]
Epoch 75:  70%|███████   | 68/97 [00:11<00:04,  6.18it/s, loss=2.09, v_num=0]
Epoch 75:  70%|███████   | 68/97 [00:11<00:04,  6.15it/s, loss=2.09, v_num=0]
Epoch 75:  71%|███████   | 69/97 [00:11<00:04,  6.19it/s, loss=2.09, v_num=0]
Epoch 75:  71%|███████   | 69/97 [00:11<00:04,  6.16it/s, loss=2.09, v_num=0]
Epoch 75:  72%|███████▏  | 70/97 [00:11<00:04,  6.20it/s, loss=2.09, v_num=0]
Epoch 75:  72%|███████▏  | 70/97 [00:11<00:04,  6.17it/s, loss=2.09, v_num=0]
Epoch 75:  73%|███████▎  | 71/97 [00:11<00:04,  6.20it/s, loss=2.09, v_num=0]
Epoch 75:  73%|███████▎  | 71/97 [00:11<00:04,  6.17it/s, loss=2.09, v_num=0]
Epoch 75:  74%|███████▍  | 72/97 [00:11<00:04,  6.21it/s, loss=2.09, v_num=0]
Epoch 75:  74%|███████▍  | 72/97 [00:11<00:04,  6.18it/s, loss=2.09, v_num=0]
Epoch 75:  75%|███████▌  | 73/97 [00:11<00:03,  6.21it/s, loss=2.09, v_num=0]
Epoch 75:  75%|███████▌  | 73/97 [00:11<00:03,  6.19it/s, loss=2.09, v_num=0]
Epoch 75:  76%|███████▋  | 74/97 [00:11<00:03,  6.22it/s, loss=2.09, v_num=0]
Epoch 75:  76%|███████▋  | 74/97 [00:11<00:03,  6.20it/s, loss=2.08, v_num=0]
Epoch 75:  77%|███████▋  | 75/97 [00:12<00:03,  6.24it/s, loss=2.08, v_num=0]
Epoch 75:  77%|███████▋  | 75/97 [00:12<00:03,  6.21it/s, loss=2.08, v_num=0]
Epoch 75:  78%|███████▊  | 76/97 [00:12<00:03,  6.24it/s, loss=2.08, v_num=0]
Epoch 75:  78%|███████▊  | 76/97 [00:12<00:03,  6.21it/s, loss=2.08, v_num=0]
Epoch 75:  79%|███████▉  | 77/97 [00:12<00:03,  6.25it/s, loss=2.08, v_num=0]
Epoch 75:  79%|███████▉  | 77/97 [00:12<00:03,  6.22it/s, loss=2.08, v_num=0]
Epoch 75:  80%|████████  | 78/97 [00:12<00:03,  6.26it/s, loss=2.08, v_num=0]
Epoch 75:  80%|████████  | 78/97 [00:12<00:03,  6.23it/s, loss=2.09, v_num=0]
Epoch 75:  81%|████████▏ | 79/97 [00:12<00:02,  6.27it/s, loss=2.09, v_num=0]
Epoch 75:  81%|████████▏ | 79/97 [00:12<00:02,  6.24it/s, loss=2.08, v_num=0]
Epoch 75:  82%|████████▏ | 80/97 [00:12<00:02,  6.28it/s, loss=2.08, v_num=0]
Epoch 75:  82%|████████▏ | 80/97 [00:12<00:02,  6.25it/s, loss=2.08, v_num=0]
Epoch 75:  84%|████████▎ | 81/97 [00:12<00:02,  6.29it/s, loss=2.08, v_num=0]
Epoch 75:  84%|████████▎ | 81/97 [00:12<00:02,  6.26it/s, loss=2.07, v_num=0]
Epoch 75:  85%|████████▍ | 82/97 [00:13<00:02,  6.29it/s, loss=2.07, v_num=0]
Epoch 75:  85%|████████▍ | 82/97 [00:13<00:02,  6.26it/s, loss=2.07, v_num=0]
Epoch 75:  86%|████████▌ | 83/97 [00:13<00:02,  6.30it/s, loss=2.07, v_num=0]
Epoch 75:  86%|████████▌ | 83/97 [00:13<00:02,  6.27it/s, loss=2.07, v_num=0]
Epoch 75:  87%|████████▋ | 84/97 [00:13<00:02,  6.31it/s, loss=2.07, v_num=0]
Epoch 75:  87%|████████▋ | 84/97 [00:13<00:02,  6.28it/s, loss=2.08, v_num=0]
Epoch 75:  88%|████████▊ | 85/97 [00:13<00:01,  6.32it/s, loss=2.08, v_num=0]
Epoch 75:  88%|████████▊ | 85/97 [00:13<00:01,  6.29it/s, loss=2.08, v_num=0]
Epoch 75:  89%|████████▊ | 86/97 [00:13<00:01,  6.33it/s, loss=2.08, v_num=0]
Epoch 75:  89%|████████▊ | 86/97 [00:13<00:01,  6.30it/s, loss=2.08, v_num=0]
Epoch 75:  90%|████████▉ | 87/97 [00:13<00:01,  6.34it/s, loss=2.08, v_num=0]
Epoch 75:  90%|████████▉ | 87/97 [00:13<00:01,  6.31it/s, loss=2.08, v_num=0]
Epoch 75:  91%|█████████ | 88/97 [00:13<00:01,  6.35it/s, loss=2.08, v_num=0]
Epoch 75:  91%|█████████ | 88/97 [00:13<00:01,  6.32it/s, loss=2.08, v_num=0]
Epoch 75:  92%|█████████▏| 89/97 [00:13<00:01,  6.36it/s, loss=2.08, v_num=0]
Epoch 75:  92%|█████████▏| 89/97 [00:14<00:01,  6.33it/s, loss=2.08, v_num=0]
Epoch 75:  93%|█████████▎| 90/97 [00:14<00:01,  6.37it/s, loss=2.08, v_num=0]
Epoch 75:  93%|█████████▎| 90/97 [00:14<00:01,  6.34it/s, loss=2.08, v_num=0]
Epoch 75:  94%|█████████▍| 91/97 [00:14<00:00,  6.37it/s, loss=2.08, v_num=0]
Epoch 75:  94%|█████████▍| 91/97 [00:14<00:00,  6.35it/s, loss=2.08, v_num=0]
Epoch 75:  95%|█████████▍| 92/97 [00:14<00:00,  6.38it/s, loss=2.08, v_num=0]
Epoch 75:  95%|█████████▍| 92/97 [00:14<00:00,  6.36it/s, loss=2.08, v_num=0]
Epoch 75:  96%|█████████▌| 93/97 [00:14<00:00,  6.39it/s, loss=2.08, v_num=0]
Epoch 75:  96%|█████████▌| 93/97 [00:14<00:00,  6.37it/s, loss=2.07, v_num=0]
Epoch 75:  97%|█████████▋| 94/97 [00:14<00:00,  6.40it/s, loss=2.07, v_num=0]
Epoch 75:  97%|█████████▋| 94/97 [00:14<00:00,  6.38it/s, loss=2.08, v_num=0]
Epoch 75:  98%|█████████▊| 95/97 [00:14<00:00,  6.41it/s, loss=2.08, v_num=0]
Epoch 75:  98%|█████████▊| 95/97 [00:14<00:00,  6.39it/s, loss=2.08, v_num=0]
Epoch 75:  99%|█████████▉| 96/97 [00:14<00:00,  6.42it/s, loss=2.08, v_num=0]
Epoch 75:  99%|█████████▉| 96/97 [00:15<00:00,  6.39it/s, loss=2.08, v_num=0]
Epoch 75: 100%|██████████| 97/97 [00:15<00:00,  6.43it/s, loss=2.08, v_num=0]
Epoch 75: 100%|██████████| 97/97 [00:15<00:00,  6.40it/s, loss=2.08, v_num=0]
Epoch 75: 100%|██████████| 97/97 [00:15<00:00,  6.40it/s, loss=2.08, v_num=0]
Epoch 75:   0%|          | 0/97 [00:00<?, ?it/s, loss=2.08, v_num=0]
Epoch 76:   0%|          | 0/97 [00:00<?, ?it/s, loss=2.08, v_num=0]
Epoch 76:   1%|          | 1/97 [00:01<02:30,  1.57s/it, loss=2.08, v_num=0]
Epoch 76:   1%|          | 1/97 [00:01<02:35,  1.62s/it, loss=2.08, v_num=0]
Epoch 76:   2%|▏         | 2/97 [00:01<01:20,  1.18it/s, loss=2.08, v_num=0]
Epoch 76:   2%|▏         | 2/97 [00:01<01:23,  1.14it/s, loss=2.09, v_num=0]
Epoch 76:   3%|▎         | 3/97 [00:01<00:57,  1.64it/s, loss=2.09, v_num=0]
Epoch 76:   3%|▎         | 3/97 [00:01<00:59,  1.58it/s, loss=2.09, v_num=0]
Epoch 76:   4%|▍         | 4/97 [00:01<00:45,  2.03it/s, loss=2.09, v_num=0]
Epoch 76:   4%|▍         | 4/97 [00:02<00:47,  1.97it/s, loss=2.09, v_num=0]
Epoch 76:   5%|▌         | 5/97 [00:02<00:38,  2.37it/s, loss=2.09, v_num=0]
Epoch 76:   5%|▌         | 5/97 [00:02<00:39,  2.31it/s, loss=2.09, v_num=0]
Epoch 76:   6%|▌         | 6/97 [00:02<00:34,  2.66it/s, loss=2.09, v_num=0]
Epoch 76:   6%|▌         | 6/97 [00:02<00:35,  2.60it/s, loss=2.08, v_num=0]
Epoch 76:   7%|▋         | 7/97 [00:02<00:30,  2.93it/s, loss=2.08, v_num=0]
Epoch 76:   7%|▋         | 7/97 [00:02<00:31,  2.86it/s, loss=2.08, v_num=0]
Epoch 76:   8%|▊         | 8/97 [00:02<00:28,  3.16it/s, loss=2.08, v_num=0]
Epoch 76:   8%|▊         | 8/97 [00:02<00:28,  3.09it/s, loss=2.08, v_num=0]
Epoch 76:   9%|▉         | 9/97 [00:02<00:26,  3.37it/s, loss=2.08, v_num=0]
Epoch 76:   9%|▉         | 9/97 [00:02<00:26,  3.30it/s, loss=2.08, v_num=0]
Epoch 76:  10%|█         | 10/97 [00:02<00:24,  3.56it/s, loss=2.08, v_num=0]
Epoch 76:  10%|█         | 10/97 [00:02<00:24,  3.50it/s, loss=2.08, v_num=0]
Epoch 76:  11%|█▏        | 11/97 [00:02<00:22,  3.74it/s, loss=2.08, v_num=0]
Epoch 76:  11%|█▏        | 11/97 [00:02<00:23,  3.67it/s, loss=2.08, v_num=0]
Epoch 76:  12%|█▏        | 12/97 [00:03<00:21,  3.90it/s, loss=2.08, v_num=0]
Epoch 76:  12%|█▏        | 12/97 [00:03<00:22,  3.83it/s, loss=2.08, v_num=0]
Epoch 76:  13%|█▎        | 13/97 [00:03<00:20,  4.04it/s, loss=2.08, v_num=0]
Epoch 76:  13%|█▎        | 13/97 [00:03<00:21,  3.98it/s, loss=2.07, v_num=0]
Epoch 76:  14%|█▍        | 14/97 [00:03<00:19,  4.17it/s, loss=2.07, v_num=0]
Epoch 76:  14%|█▍        | 14/97 [00:03<00:20,  4.11it/s, loss=2.08, v_num=0]
Epoch 76:  15%|█▌        | 15/97 [00:03<00:19,  4.30it/s, loss=2.08, v_num=0]
Epoch 76:  15%|█▌        | 15/97 [00:03<00:19,  4.23it/s, loss=2.08, v_num=0]
Epoch 76:  16%|█▋        | 16/97 [00:03<00:18,  4.41it/s, loss=2.08, v_num=0]
Epoch 76:  16%|█▋        | 16/97 [00:03<00:18,  4.35it/s, loss=2.08, v_num=0]
Epoch 76:  18%|█▊        | 17/97 [00:03<00:17,  4.52it/s, loss=2.08, v_num=0]
Epoch 76:  18%|█▊        | 17/97 [00:03<00:17,  4.45it/s, loss=2.07, v_num=0]
Epoch 76:  19%|█▊        | 18/97 [00:03<00:17,  4.62it/s, loss=2.07, v_num=0]
Epoch 76:  19%|█▊        | 18/97 [00:03<00:17,  4.55it/s, loss=2.06, v_num=0]
Epoch 76:  20%|█▉        | 19/97 [00:04<00:16,  4.71it/s, loss=2.06, v_num=0]
Epoch 76:  20%|█▉        | 19/97 [00:04<00:16,  4.65it/s, loss=2.07, v_num=0]
Epoch 76:  21%|██        | 20/97 [00:04<00:16,  4.80it/s, loss=2.07, v_num=0]
Epoch 76:  21%|██        | 20/97 [00:04<00:16,  4.73it/s, loss=2.07, v_num=0]
Epoch 76:  22%|██▏       | 21/97 [00:04<00:15,  4.87it/s, loss=2.07, v_num=0]
Epoch 76:  22%|██▏       | 21/97 [00:04<00:15,  4.81it/s, loss=2.07, v_num=0]
Epoch 76:  23%|██▎       | 22/97 [00:04<00:15,  4.96it/s, loss=2.07, v_num=0]
Epoch 76:  23%|██▎       | 22/97 [00:04<00:15,  4.89it/s, loss=2.07, v_num=0]
Epoch 76:  24%|██▎       | 23/97 [00:04<00:14,  5.03it/s, loss=2.07, v_num=0]
Epoch 76:  24%|██▎       | 23/97 [00:04<00:14,  4.96it/s, loss=2.07, v_num=0]
Epoch 76:  25%|██▍       | 24/97 [00:04<00:14,  5.09it/s, loss=2.07, v_num=0]
Epoch 76:  25%|██▍       | 24/97 [00:04<00:14,  5.03it/s, loss=2.07, v_num=0]
Epoch 76:  26%|██▌       | 25/97 [00:04<00:13,  5.15it/s, loss=2.07, v_num=0]
Epoch 76:  26%|██▌       | 25/97 [00:04<00:14,  5.09it/s, loss=2.07, v_num=0]
Epoch 76:  27%|██▋       | 26/97 [00:04<00:13,  5.21it/s, loss=2.07, v_num=0]
Epoch 76:  27%|██▋       | 26/97 [00:05<00:13,  5.15it/s, loss=2.08, v_num=0]
Epoch 76:  28%|██▊       | 27/97 [00:05<00:13,  5.26it/s, loss=2.08, v_num=0]
Epoch 76:  28%|██▊       | 27/97 [00:05<00:13,  5.21it/s, loss=2.08, v_num=0]
Epoch 76:  29%|██▉       | 28/97 [00:05<00:12,  5.32it/s, loss=2.08, v_num=0]
Epoch 76:  29%|██▉       | 28/97 [00:05<00:13,  5.26it/s, loss=2.08, v_num=0]
Epoch 76:  30%|██▉       | 29/97 [00:05<00:12,  5.37it/s, loss=2.08, v_num=0]
Epoch 76:  30%|██▉       | 29/97 [00:05<00:12,  5.31it/s, loss=2.08, v_num=0]
Epoch 76:  31%|███       | 30/97 [00:05<00:12,  5.41it/s, loss=2.08, v_num=0]
Epoch 76:  31%|███       | 30/97 [00:05<00:12,  5.35it/s, loss=2.08, v_num=0]
Epoch 76:  32%|███▏      | 31/97 [00:05<00:12,  5.45it/s, loss=2.08, v_num=0]
Epoch 76:  32%|███▏      | 31/97 [00:05<00:12,  5.40it/s, loss=2.08, v_num=0]
Epoch 76:  33%|███▎      | 32/97 [00:05<00:11,  5.50it/s, loss=2.08, v_num=0]
Epoch 76:  33%|███▎      | 32/97 [00:05<00:11,  5.45it/s, loss=2.08, v_num=0]
Epoch 76:  34%|███▍      | 33/97 [00:05<00:11,  5.54it/s, loss=2.08, v_num=0]
Epoch 76:  34%|███▍      | 33/97 [00:06<00:11,  5.49it/s, loss=2.09, v_num=0]
Epoch 76:  35%|███▌      | 34/97 [00:06<00:11,  5.58it/s, loss=2.09, v_num=0]
Epoch 76:  35%|███▌      | 34/97 [00:06<00:11,  5.53it/s, loss=2.09, v_num=0]
Epoch 76:  36%|███▌      | 35/97 [00:06<00:11,  5.61it/s, loss=2.09, v_num=0]
Epoch 76:  36%|███▌      | 35/97 [00:06<00:11,  5.56it/s, loss=2.09, v_num=0]
Epoch 76:  37%|███▋      | 36/97 [00:06<00:10,  5.65it/s, loss=2.09, v_num=0]
Epoch 76:  37%|███▋      | 36/97 [00:06<00:10,  5.60it/s, loss=2.09, v_num=0]
Epoch 76:  38%|███▊      | 37/97 [00:06<00:10,  5.68it/s, loss=2.09, v_num=0]
Epoch 76:  38%|███▊      | 37/97 [00:06<00:10,  5.63it/s, loss=2.1, v_num=0]
Epoch 76:  39%|███▉      | 38/97 [00:06<00:10,  5.71it/s, loss=2.1, v_num=0]
Epoch 76:  39%|███▉      | 38/97 [00:06<00:10,  5.66it/s, loss=2.1, v_num=0]
Epoch 76:  40%|████      | 39/97 [00:06<00:10,  5.70it/s, loss=2.1, v_num=0]
Epoch 76:  40%|████      | 39/97 [00:06<00:10,  5.66it/s, loss=2.1, v_num=0]
Epoch 76:  41%|████      | 40/97 [00:06<00:09,  5.73it/s, loss=2.1, v_num=0]
Epoch 76:  41%|████      | 40/97 [00:07<00:10,  5.69it/s, loss=2.08, v_num=0]
Epoch 76:  42%|████▏     | 41/97 [00:07<00:09,  5.76it/s, loss=2.08, v_num=0]
Epoch 76:  42%|████▏     | 41/97 [00:07<00:09,  5.72it/s, loss=2.08, v_num=0]
Epoch 76:  43%|████▎     | 42/97 [00:07<00:09,  5.79it/s, loss=2.08, v_num=0]
Epoch 76:  43%|████▎     | 42/97 [00:07<00:09,  5.75it/s, loss=2.08, v_num=0]
Epoch 76:  44%|████▍     | 43/97 [00:07<00:09,  5.82it/s, loss=2.08, v_num=0]
Epoch 76:  44%|████▍     | 43/97 [00:07<00:09,  5.77it/s, loss=2.08, v_num=0]
Epoch 76:  45%|████▌     | 44/97 [00:07<00:09,  5.84it/s, loss=2.08, v_num=0]
Epoch 76:  45%|████▌     | 44/97 [00:07<00:09,  5.80it/s, loss=2.09, v_num=0]
Epoch 76:  46%|████▋     | 45/97 [00:07<00:08,  5.87it/s, loss=2.09, v_num=0]
Epoch 76:  46%|████▋     | 45/97 [00:07<00:08,  5.82it/s, loss=2.08, v_num=0]
Epoch 76:  47%|████▋     | 46/97 [00:07<00:08,  5.89it/s, loss=2.08, v_num=0]
Epoch 76:  47%|████▋     | 46/97 [00:07<00:08,  5.85it/s, loss=2.08, v_num=0]
Epoch 76:  48%|████▊     | 47/97 [00:07<00:08,  5.90it/s, loss=2.08, v_num=0]
Epoch 76:  48%|████▊     | 47/97 [00:08<00:08,  5.86it/s, loss=2.07, v_num=0]
Epoch 76:  49%|████▉     | 48/97 [00:08<00:08,  5.92it/s, loss=2.07, v_num=0]
Epoch 76:  49%|████▉     | 48/97 [00:08<00:08,  5.88it/s, loss=2.07, v_num=0]
Epoch 76:  51%|█████     | 49/97 [00:08<00:08,  5.94it/s, loss=2.07, v_num=0]
Epoch 76:  51%|█████     | 49/97 [00:08<00:08,  5.89it/s, loss=2.07, v_num=0]
Epoch 76:  52%|█████▏    | 50/97 [00:08<00:07,  5.96it/s, loss=2.07, v_num=0]
Epoch 76:  52%|█████▏    | 50/97 [00:08<00:07,  5.92it/s, loss=2.07, v_num=0]
Epoch 76:  53%|█████▎    | 51/97 [00:08<00:07,  5.98it/s, loss=2.07, v_num=0]
Epoch 76:  53%|█████▎    | 51/97 [00:08<00:07,  5.94it/s, loss=2.07, v_num=0]
Epoch 76:  54%|█████▎    | 52/97 [00:08<00:07,  5.99it/s, loss=2.07, v_num=0]
Epoch 76:  54%|█████▎    | 52/97 [00:08<00:07,  5.95it/s, loss=2.06, v_num=0]
Epoch 76:  55%|█████▍    | 53/97 [00:08<00:07,  6.01it/s, loss=2.06, v_num=0]
Epoch 76:  55%|█████▍    | 53/97 [00:08<00:07,  5.97it/s, loss=2.06, v_num=0]
Epoch 76:  56%|█████▌    | 54/97 [00:08<00:07,  6.03it/s, loss=2.06, v_num=0]
Epoch 76:  56%|█████▌    | 54/97 [00:09<00:07,  5.99it/s, loss=2.05, v_num=0]
Epoch 76:  57%|█████▋    | 55/97 [00:09<00:06,  6.04it/s, loss=2.05, v_num=0]
Epoch 76:  57%|█████▋    | 55/97 [00:09<00:06,  6.01it/s, loss=2.05, v_num=0]
Epoch 76:  58%|█████▊    | 56/97 [00:09<00:06,  6.06it/s, loss=2.05, v_num=0]
Epoch 76:  58%|█████▊    | 56/97 [00:09<00:06,  6.02it/s, loss=2.05, v_num=0]
Epoch 76:  59%|█████▉    | 57/97 [00:09<00:06,  6.08it/s, loss=2.05, v_num=0]
Epoch 76:  59%|█████▉    | 57/97 [00:09<00:06,  6.04it/s, loss=2.06, v_num=0]
Epoch 76:  60%|█████▉    | 58/97 [00:09<00:06,  6.09it/s, loss=2.06, v_num=0]
Epoch 76:  60%|█████▉    | 58/97 [00:09<00:06,  6.06it/s, loss=2.06, v_num=0]
Epoch 76:  61%|██████    | 59/97 [00:09<00:06,  6.11it/s, loss=2.06, v_num=0]
Epoch 76:  61%|██████    | 59/97 [00:09<00:06,  6.07it/s, loss=2.06, v_num=0]
Epoch 76:  62%|██████▏   | 60/97 [00:09<00:06,  6.12it/s, loss=2.06, v_num=0]
Epoch 76:  62%|██████▏   | 60/97 [00:09<00:06,  6.09it/s, loss=2.07, v_num=0]
Epoch 76:  63%|██████▎   | 61/97 [00:09<00:05,  6.14it/s, loss=2.07, v_num=0]
Epoch 76:  63%|██████▎   | 61/97 [00:09<00:05,  6.10it/s, loss=2.06, v_num=0]
Epoch 76:  64%|██████▍   | 62/97 [00:10<00:05,  6.15it/s, loss=2.06, v_num=0]
Epoch 76:  64%|██████▍   | 62/97 [00:10<00:05,  6.12it/s, loss=2.06, v_num=0]
Epoch 76:  65%|██████▍   | 63/97 [00:10<00:05,  6.17it/s, loss=2.06, v_num=0]
Epoch 76:  65%|██████▍   | 63/97 [00:10<00:05,  6.13it/s, loss=2.06, v_num=0]
Epoch 76:  66%|██████▌   | 64/97 [00:10<00:05,  6.18it/s, loss=2.06, v_num=0]
Epoch 76:  66%|██████▌   | 64/97 [00:10<00:05,  6.15it/s, loss=2.06, v_num=0]
Epoch 76:  67%|██████▋   | 65/97 [00:10<00:05,  6.19it/s, loss=2.06, v_num=0]
Epoch 76:  67%|██████▋   | 65/97 [00:10<00:05,  6.16it/s, loss=2.07, v_num=0]
Epoch 76:  68%|██████▊   | 66/97 [00:10<00:04,  6.21it/s, loss=2.07, v_num=0]
Epoch 76:  68%|██████▊   | 66/97 [00:10<00:05,  6.17it/s, loss=2.07, v_num=0]
Epoch 76:  69%|██████▉   | 67/97 [00:10<00:04,  6.22it/s, loss=2.07, v_num=0]
Epoch 76:  69%|██████▉   | 67/97 [00:10<00:04,  6.19it/s, loss=2.08, v_num=0]
Epoch 76:  70%|███████   | 68/97 [00:10<00:04,  6.23it/s, loss=2.08, v_num=0]
Epoch 76:  70%|███████   | 68/97 [00:10<00:04,  6.20it/s, loss=2.08, v_num=0]
Epoch 76:  71%|███████   | 69/97 [00:11<00:04,  6.24it/s, loss=2.08, v_num=0]
Epoch 76:  71%|███████   | 69/97 [00:11<00:04,  6.21it/s, loss=2.07, v_num=0]
Epoch 76:  72%|███████▏  | 70/97 [00:11<00:04,  6.25it/s, loss=2.07, v_num=0]
Epoch 76:  72%|███████▏  | 70/97 [00:11<00:04,  6.22it/s, loss=2.07, v_num=0]
Epoch 76:  73%|███████▎  | 71/97 [00:11<00:04,  6.26it/s, loss=2.07, v_num=0]
Epoch 76:  73%|███████▎  | 71/97 [00:11<00:04,  6.23it/s, loss=2.07, v_num=0]
Epoch 76:  74%|███████▍  | 72/97 [00:11<00:03,  6.27it/s, loss=2.07, v_num=0]
Epoch 76:  74%|███████▍  | 72/97 [00:11<00:04,  6.24it/s, loss=2.07, v_num=0]
Epoch 76:  75%|███████▌  | 73/97 [00:11<00:03,  6.28it/s, loss=2.07, v_num=0]
Epoch 76:  75%|███████▌  | 73/97 [00:11<00:03,  6.25it/s, loss=2.08, v_num=0]
Epoch 76:  76%|███████▋  | 74/97 [00:11<00:03,  6.29it/s, loss=2.08, v_num=0]
Epoch 76:  76%|███████▋  | 74/97 [00:11<00:03,  6.26it/s, loss=2.08, v_num=0]
Epoch 76:  77%|███████▋  | 75/97 [00:11<00:03,  6.30it/s, loss=2.08, v_num=0]
Epoch 76:  77%|███████▋  | 75/97 [00:11<00:03,  6.27it/s, loss=2.08, v_num=0]
Epoch 76:  78%|███████▊  | 76/97 [00:12<00:03,  6.31it/s, loss=2.08, v_num=0]
Epoch 76:  78%|███████▊  | 76/97 [00:12<00:03,  6.28it/s, loss=2.08, v_num=0]
Epoch 76:  79%|███████▉  | 77/97 [00:12<00:03,  6.32it/s, loss=2.08, v_num=0]
Epoch 76:  79%|███████▉  | 77/97 [00:12<00:03,  6.29it/s, loss=2.07, v_num=0]
Epoch 76:  80%|████████  | 78/97 [00:12<00:03,  6.32it/s, loss=2.07, v_num=0]
Epoch 76:  80%|████████  | 78/97 [00:12<00:03,  6.29it/s, loss=2.07, v_num=0]
Epoch 76:  81%|████████▏ | 79/97 [00:12<00:02,  6.33it/s, loss=2.07, v_num=0]
Epoch 76:  81%|████████▏ | 79/97 [00:12<00:02,  6.30it/s, loss=2.07, v_num=0]
Epoch 76:  82%|████████▏ | 80/97 [00:12<00:02,  6.34it/s, loss=2.07, v_num=0]
Epoch 76:  82%|████████▏ | 80/97 [00:12<00:02,  6.31it/s, loss=2.08, v_num=0]
Epoch 76:  84%|████████▎ | 81/97 [00:12<00:02,  6.35it/s, loss=2.08, v_num=0]
Epoch 76:  84%|████████▎ | 81/97 [00:12<00:02,  6.32it/s, loss=2.08, v_num=0]
Epoch 76:  85%|████████▍ | 82/97 [00:12<00:02,  6.35it/s, loss=2.08, v_num=0]
Epoch 76:  85%|████████▍ | 82/97 [00:12<00:02,  6.32it/s, loss=2.08, v_num=0]
Epoch 76:  86%|████████▌ | 83/97 [00:13<00:02,  6.36it/s, loss=2.08, v_num=0]
Epoch 76:  86%|████████▌ | 83/97 [00:13<00:02,  6.33it/s, loss=2.07, v_num=0]
Epoch 76:  87%|████████▋ | 84/97 [00:13<00:02,  6.37it/s, loss=2.07, v_num=0]
Epoch 76:  87%|████████▋ | 84/97 [00:13<00:02,  6.34it/s, loss=2.07, v_num=0]
Epoch 76:  88%|████████▊ | 85/97 [00:13<00:01,  6.37it/s, loss=2.07, v_num=0]
Epoch 76:  88%|████████▊ | 85/97 [00:13<00:01,  6.35it/s, loss=2.06, v_num=0]
Epoch 76:  89%|████████▊ | 86/97 [00:13<00:01,  6.38it/s, loss=2.06, v_num=0]
Epoch 76:  89%|████████▊ | 86/97 [00:13<00:01,  6.36it/s, loss=2.05, v_num=0]
Epoch 76:  90%|████████▉ | 87/97 [00:13<00:01,  6.39it/s, loss=2.05, v_num=0]
Epoch 76:  90%|████████▉ | 87/97 [00:13<00:01,  6.36it/s, loss=2.05, v_num=0]
Epoch 76:  91%|█████████ | 88/97 [00:13<00:01,  6.40it/s, loss=2.05, v_num=0]
Epoch 76:  91%|█████████ | 88/97 [00:13<00:01,  6.37it/s, loss=2.06, v_num=0]
Epoch 76:  92%|█████████▏| 89/97 [00:13<00:01,  6.41it/s, loss=2.06, v_num=0]
Epoch 76:  92%|█████████▏| 89/97 [00:13<00:01,  6.38it/s, loss=2.06, v_num=0]
Epoch 76:  93%|█████████▎| 90/97 [00:14<00:01,  6.41it/s, loss=2.06, v_num=0]
Epoch 76:  93%|█████████▎| 90/97 [00:14<00:01,  6.39it/s, loss=2.06, v_num=0]
Epoch 76:  94%|█████████▍| 91/97 [00:14<00:00,  6.42it/s, loss=2.06, v_num=0]
Epoch 76:  94%|█████████▍| 91/97 [00:14<00:00,  6.40it/s, loss=2.06, v_num=0]
Epoch 76:  95%|█████████▍| 92/97 [00:14<00:00,  6.43it/s, loss=2.06, v_num=0]
Epoch 76:  95%|█████████▍| 92/97 [00:14<00:00,  6.40it/s, loss=2.06, v_num=0]
Epoch 76:  96%|█████████▌| 93/97 [00:14<00:00,  6.44it/s, loss=2.06, v_num=0]
Epoch 76:  96%|█████████▌| 93/97 [00:14<00:00,  6.41it/s, loss=2.06, v_num=0]
Epoch 76:  97%|█████████▋| 94/97 [00:14<00:00,  6.44it/s, loss=2.06, v_num=0]
Epoch 76:  97%|█████████▋| 94/97 [00:14<00:00,  6.42it/s, loss=2.06, v_num=0]
Epoch 76:  98%|█████████▊| 95/97 [00:14<00:00,  6.45it/s, loss=2.06, v_num=0]
Epoch 76:  98%|█████████▊| 95/97 [00:14<00:00,  6.43it/s, loss=2.06, v_num=0]
Epoch 76:  99%|█████████▉| 96/97 [00:14<00:00,  6.46it/s, loss=2.06, v_num=0]
Epoch 76:  99%|█████████▉| 96/97 [00:14<00:00,  6.43it/s, loss=2.06, v_num=0]
Epoch 76: 100%|██████████| 97/97 [00:15<00:00,  6.46it/s, loss=2.06, v_num=0]
Epoch 76: 100%|██████████| 97/97 [00:15<00:00,  6.44it/s, loss=2.06, v_num=0]
Epoch 76: 100%|██████████| 97/97 [00:15<00:00,  6.44it/s, loss=2.06, v_num=0]
Epoch 76:   0%|          | 0/97 [00:00<?, ?it/s, loss=2.06, v_num=0]
Epoch 77:   0%|          | 0/97 [00:00<?, ?it/s, loss=2.06, v_num=0]
Epoch 77:   1%|          | 1/97 [00:01<02:44,  1.71s/it, loss=2.06, v_num=0]
Epoch 77:   1%|          | 1/97 [00:01<02:49,  1.77s/it, loss=2.07, v_num=0]
Epoch 77:   2%|▏         | 2/97 [00:01<01:27,  1.08it/s, loss=2.07, v_num=0]
Epoch 77:   2%|▏         | 2/97 [00:01<01:30,  1.05it/s, loss=2.07, v_num=0]
Epoch 77:   3%|▎         | 3/97 [00:01<01:02,  1.50it/s, loss=2.07, v_num=0]
Epoch 77:   3%|▎         | 3/97 [00:02<01:04,  1.46it/s, loss=2.06, v_num=0]
Epoch 77:   4%|▍         | 4/97 [00:02<00:49,  1.88it/s, loss=2.06, v_num=0]
Epoch 77:   4%|▍         | 4/97 [00:02<00:50,  1.83it/s, loss=2.06, v_num=0]
Epoch 77:   5%|▌         | 5/97 [00:02<00:41,  2.21it/s, loss=2.06, v_num=0]
Epoch 77:   5%|▌         | 5/97 [00:02<00:42,  2.15it/s, loss=2.07, v_num=0]
Epoch 77:   6%|▌         | 6/97 [00:02<00:36,  2.49it/s, loss=2.07, v_num=0]
Epoch 77:   6%|▌         | 6/97 [00:02<00:37,  2.43it/s, loss=2.07, v_num=0]
Epoch 77:   7%|▋         | 7/97 [00:02<00:32,  2.75it/s, loss=2.07, v_num=0]
Epoch 77:   7%|▋         | 7/97 [00:02<00:33,  2.69it/s, loss=2.08, v_num=0]
Epoch 77:   8%|▊         | 8/97 [00:02<00:29,  2.98it/s, loss=2.08, v_num=0]
Epoch 77:   8%|▊         | 8/97 [00:02<00:30,  2.91it/s, loss=2.09, v_num=0]
Epoch 77:   9%|▉         | 9/97 [00:02<00:28,  3.14it/s, loss=2.09, v_num=0]
Epoch 77:   9%|▉         | 9/97 [00:02<00:28,  3.07it/s, loss=2.09, v_num=0]
Epoch 77:  10%|█         | 10/97 [00:03<00:26,  3.32it/s, loss=2.09, v_num=0]
Epoch 77:  10%|█         | 10/97 [00:03<00:26,  3.26it/s, loss=2.09, v_num=0]
Epoch 77:  11%|█▏        | 11/97 [00:03<00:24,  3.49it/s, loss=2.09, v_num=0]
Epoch 77:  11%|█▏        | 11/97 [00:03<00:25,  3.43it/s, loss=2.09, v_num=0]
Epoch 77:  12%|█▏        | 12/97 [00:03<00:23,  3.65it/s, loss=2.09, v_num=0]
Epoch 77:  12%|█▏        | 12/97 [00:03<00:23,  3.59it/s, loss=2.09, v_num=0]
Epoch 77:  13%|█▎        | 13/97 [00:03<00:22,  3.80it/s, loss=2.09, v_num=0]
Epoch 77:  13%|█▎        | 13/97 [00:03<00:22,  3.73it/s, loss=2.09, v_num=0]
Epoch 77:  14%|█▍        | 14/97 [00:03<00:21,  3.92it/s, loss=2.09, v_num=0]
Epoch 77:  14%|█▍        | 14/97 [00:03<00:21,  3.87it/s, loss=2.1, v_num=0]
Epoch 77:  15%|█▌        | 15/97 [00:03<00:20,  4.04it/s, loss=2.1, v_num=0]
Epoch 77:  15%|█▌        | 15/97 [00:03<00:20,  3.99it/s, loss=2.09, v_num=0]
Epoch 77:  16%|█▋        | 16/97 [00:03<00:19,  4.15it/s, loss=2.09, v_num=0]
Epoch 77:  16%|█▋        | 16/97 [00:03<00:19,  4.10it/s, loss=2.09, v_num=0]
Epoch 77:  18%|█▊        | 17/97 [00:04<00:18,  4.21it/s, loss=2.09, v_num=0]
Epoch 77:  18%|█▊        | 17/97 [00:04<00:19,  4.16it/s, loss=2.09, v_num=0]
Epoch 77:  19%|█▊        | 18/97 [00:04<00:18,  4.32it/s, loss=2.09, v_num=0]
Epoch 77:  19%|█▊        | 18/97 [00:04<00:18,  4.26it/s, loss=2.08, v_num=0]
Epoch 77:  20%|█▉        | 19/97 [00:04<00:17,  4.41it/s, loss=2.08, v_num=0]
Epoch 77:  20%|█▉        | 19/97 [00:04<00:17,  4.35it/s, loss=2.08, v_num=0]
Epoch 77:  21%|██        | 20/97 [00:04<00:17,  4.49it/s, loss=2.08, v_num=0]
Epoch 77:  21%|██        | 20/97 [00:04<00:17,  4.44it/s, loss=2.08, v_num=0]
Epoch 77:  22%|██▏       | 21/97 [00:04<00:16,  4.57it/s, loss=2.08, v_num=0]
Epoch 77:  22%|██▏       | 21/97 [00:04<00:16,  4.52it/s, loss=2.08, v_num=0]
Epoch 77:  23%|██▎       | 22/97 [00:04<00:16,  4.65it/s, loss=2.08, v_num=0]
Epoch 77:  23%|██▎       | 22/97 [00:04<00:16,  4.60it/s, loss=2.08, v_num=0]
Epoch 77:  24%|██▎       | 23/97 [00:04<00:15,  4.73it/s, loss=2.08, v_num=0]
Epoch 77:  24%|██▎       | 23/97 [00:04<00:15,  4.67it/s, loss=2.09, v_num=0]
Epoch 77:  25%|██▍       | 24/97 [00:05<00:15,  4.79it/s, loss=2.09, v_num=0]
Epoch 77:  25%|██▍       | 24/97 [00:05<00:15,  4.74it/s, loss=2.09, v_num=0]
Epoch 77:  26%|██▌       | 25/97 [00:05<00:14,  4.83it/s, loss=2.09, v_num=0]
Epoch 77:  26%|██▌       | 25/97 [00:05<00:15,  4.78it/s, loss=2.09, v_num=0]
Epoch 77:  27%|██▋       | 26/97 [00:05<00:14,  4.89it/s, loss=2.09, v_num=0]
Epoch 77:  27%|██▋       | 26/97 [00:05<00:14,  4.84it/s, loss=2.08, v_num=0]
Epoch 77:  28%|██▊       | 27/97 [00:05<00:14,  4.95it/s, loss=2.08, v_num=0]
Epoch 77:  28%|██▊       | 27/97 [00:05<00:14,  4.90it/s, loss=2.07, v_num=0]
Epoch 77:  29%|██▉       | 28/97 [00:05<00:13,  5.01it/s, loss=2.07, v_num=0]
Epoch 77:  29%|██▉       | 28/97 [00:05<00:13,  4.96it/s, loss=2.07, v_num=0]
Epoch 77:  30%|██▉       | 29/97 [00:05<00:13,  5.06it/s, loss=2.07, v_num=0]
Epoch 77:  30%|██▉       | 29/97 [00:05<00:13,  5.01it/s, loss=2.07, v_num=0]
Epoch 77:  31%|███       | 30/97 [00:05<00:13,  5.11it/s, loss=2.07, v_num=0]
Epoch 77:  31%|███       | 30/97 [00:05<00:13,  5.07it/s, loss=2.07, v_num=0]
Epoch 77:  32%|███▏      | 31/97 [00:06<00:12,  5.16it/s, loss=2.07, v_num=0]
Epoch 77:  32%|███▏      | 31/97 [00:06<00:12,  5.11it/s, loss=2.08, v_num=0]
Epoch 77:  33%|███▎      | 32/97 [00:06<00:12,  5.21it/s, loss=2.08, v_num=0]
Epoch 77:  33%|███▎      | 32/97 [00:06<00:12,  5.16it/s, loss=2.07, v_num=0]
Epoch 77:  34%|███▍      | 33/97 [00:06<00:12,  5.25it/s, loss=2.07, v_num=0]
Epoch 77:  34%|███▍      | 33/97 [00:06<00:12,  5.21it/s, loss=2.07, v_num=0]
Epoch 77:  35%|███▌      | 34/97 [00:06<00:11,  5.30it/s, loss=2.07, v_num=0]
Epoch 77:  35%|███▌      | 34/97 [00:06<00:11,  5.25it/s, loss=2.07, v_num=0]
Epoch 77:  36%|███▌      | 35/97 [00:06<00:11,  5.34it/s, loss=2.07, v_num=0]
Epoch 77:  36%|███▌      | 35/97 [00:06<00:11,  5.29it/s, loss=2.07, v_num=0]
Epoch 77:  37%|███▋      | 36/97 [00:06<00:11,  5.38it/s, loss=2.07, v_num=0]
Epoch 77:  37%|███▋      | 36/97 [00:06<00:11,  5.33it/s, loss=2.07, v_num=0]
Epoch 77:  38%|███▊      | 37/97 [00:06<00:11,  5.42it/s, loss=2.07, v_num=0]
Epoch 77:  38%|███▊      | 37/97 [00:06<00:11,  5.37it/s, loss=2.07, v_num=0]
Epoch 77:  39%|███▉      | 38/97 [00:06<00:10,  5.45it/s, loss=2.07, v_num=0]
Epoch 77:  39%|███▉      | 38/97 [00:07<00:10,  5.41it/s, loss=2.07, v_num=0]
Epoch 77:  40%|████      | 39/97 [00:07<00:10,  5.48it/s, loss=2.07, v_num=0]
Epoch 77:  40%|████      | 39/97 [00:07<00:10,  5.44it/s, loss=2.07, v_num=0]
Epoch 77:  41%|████      | 40/97 [00:07<00:10,  5.52it/s, loss=2.07, v_num=0]
Epoch 77:  41%|████      | 40/97 [00:07<00:10,  5.47it/s, loss=2.07, v_num=0]
Epoch 77:  42%|████▏     | 41/97 [00:07<00:10,  5.55it/s, loss=2.07, v_num=0]
Epoch 77:  42%|████▏     | 41/97 [00:07<00:10,  5.50it/s, loss=2.07, v_num=0]
Epoch 77:  43%|████▎     | 42/97 [00:07<00:09,  5.58it/s, loss=2.07, v_num=0]
Epoch 77:  43%|████▎     | 42/97 [00:07<00:09,  5.54it/s, loss=2.06, v_num=0]
Epoch 77:  44%|████▍     | 43/97 [00:07<00:09,  5.60it/s, loss=2.06, v_num=0]
Epoch 77:  44%|████▍     | 43/97 [00:07<00:09,  5.56it/s, loss=2.06, v_num=0]
Epoch 77:  45%|████▌     | 44/97 [00:07<00:09,  5.63it/s, loss=2.06, v_num=0]
Epoch 77:  45%|████▌     | 44/97 [00:07<00:09,  5.59it/s, loss=2.06, v_num=0]
Epoch 77:  46%|████▋     | 45/97 [00:07<00:09,  5.66it/s, loss=2.06, v_num=0]
Epoch 77:  46%|████▋     | 45/97 [00:08<00:09,  5.62it/s, loss=2.06, v_num=0]
Epoch 77:  47%|████▋     | 46/97 [00:08<00:08,  5.68it/s, loss=2.06, v_num=0]
Epoch 77:  47%|████▋     | 46/97 [00:08<00:09,  5.64it/s, loss=2.06, v_num=0]
Epoch 77:  48%|████▊     | 47/97 [00:08<00:08,  5.71it/s, loss=2.06, v_num=0]
Epoch 77:  48%|████▊     | 47/97 [00:08<00:08,  5.67it/s, loss=2.06, v_num=0]
Epoch 77:  49%|████▉     | 48/97 [00:08<00:08,  5.73it/s, loss=2.06, v_num=0]
Epoch 77:  49%|████▉     | 48/97 [00:08<00:08,  5.69it/s, loss=2.06, v_num=0]
Epoch 77:  51%|█████     | 49/97 [00:08<00:08,  5.76it/s, loss=2.06, v_num=0]
Epoch 77:  51%|█████     | 49/97 [00:08<00:08,  5.72it/s, loss=2.06, v_num=0]
Epoch 77:  52%|█████▏    | 50/97 [00:08<00:08,  5.78it/s, loss=2.06, v_num=0]
Epoch 77:  52%|█████▏    | 50/97 [00:08<00:08,  5.74it/s, loss=2.06, v_num=0]
Epoch 77:  53%|█████▎    | 51/97 [00:08<00:07,  5.80it/s, loss=2.06, v_num=0]
Epoch 77:  53%|█████▎    | 51/97 [00:08<00:07,  5.76it/s, loss=2.06, v_num=0]
Epoch 77:  54%|█████▎    | 52/97 [00:08<00:07,  5.82it/s, loss=2.06, v_num=0]
Epoch 77:  54%|█████▎    | 52/97 [00:08<00:07,  5.78it/s, loss=2.06, v_num=0]
Epoch 77:  55%|█████▍    | 53/97 [00:09<00:07,  5.84it/s, loss=2.06, v_num=0]
Epoch 77:  55%|█████▍    | 53/97 [00:09<00:07,  5.81it/s, loss=2.06, v_num=0]
Epoch 77:  56%|█████▌    | 54/97 [00:09<00:07,  5.86it/s, loss=2.06, v_num=0]
Epoch 77:  56%|█████▌    | 54/97 [00:09<00:07,  5.83it/s, loss=2.06, v_num=0]
Epoch 77:  57%|█████▋    | 55/97 [00:09<00:07,  5.87it/s, loss=2.06, v_num=0]
Epoch 77:  57%|█████▋    | 55/97 [00:09<00:07,  5.84it/s, loss=2.07, v_num=0]
Epoch 77:  58%|█████▊    | 56/97 [00:09<00:06,  5.89it/s, loss=2.07, v_num=0]
Epoch 77:  58%|█████▊    | 56/97 [00:09<00:06,  5.86it/s, loss=2.07, v_num=0]
Epoch 77:  59%|█████▉    | 57/97 [00:09<00:06,  5.91it/s, loss=2.07, v_num=0]
Epoch 77:  59%|█████▉    | 57/97 [00:09<00:06,  5.87it/s, loss=2.07, v_num=0]
Epoch 77:  60%|█████▉    | 58/97 [00:09<00:06,  5.92it/s, loss=2.07, v_num=0]
Epoch 77:  60%|█████▉    | 58/97 [00:09<00:06,  5.89it/s, loss=2.06, v_num=0]
Epoch 77:  61%|██████    | 59/97 [00:09<00:06,  5.94it/s, loss=2.06, v_num=0]
Epoch 77:  61%|██████    | 59/97 [00:09<00:06,  5.91it/s, loss=2.06, v_num=0]
Epoch 77:  62%|██████▏   | 60/97 [00:10<00:06,  5.96it/s, loss=2.06, v_num=0]
Epoch 77:  62%|██████▏   | 60/97 [00:10<00:06,  5.92it/s, loss=2.06, v_num=0]
Epoch 77:  63%|██████▎   | 61/97 [00:10<00:06,  5.97it/s, loss=2.06, v_num=0]
Epoch 77:  63%|██████▎   | 61/97 [00:10<00:06,  5.94it/s, loss=2.07, v_num=0]
Epoch 77:  64%|██████▍   | 62/97 [00:10<00:05,  5.99it/s, loss=2.07, v_num=0]
Epoch 77:  64%|██████▍   | 62/97 [00:10<00:05,  5.96it/s, loss=2.07, v_num=0]
Epoch 77:  65%|██████▍   | 63/97 [00:10<00:05,  6.00it/s, loss=2.07, v_num=0]
Epoch 77:  65%|██████▍   | 63/97 [00:10<00:05,  5.97it/s, loss=2.07, v_num=0]
Epoch 77:  66%|██████▌   | 64/97 [00:10<00:05,  6.02it/s, loss=2.07, v_num=0]
Epoch 77:  66%|██████▌   | 64/97 [00:10<00:05,  5.99it/s, loss=2.07, v_num=0]
Epoch 77:  67%|██████▋   | 65/97 [00:10<00:05,  6.03it/s, loss=2.07, v_num=0]
Epoch 77:  67%|██████▋   | 65/97 [00:10<00:05,  6.00it/s, loss=2.07, v_num=0]
Epoch 77:  68%|██████▊   | 66/97 [00:10<00:05,  6.05it/s, loss=2.07, v_num=0]
Epoch 77:  68%|██████▊   | 66/97 [00:10<00:05,  6.01it/s, loss=2.06, v_num=0]
Epoch 77:  69%|██████▉   | 67/97 [00:11<00:04,  6.06it/s, loss=2.06, v_num=0]
Epoch 77:  69%|██████▉   | 67/97 [00:11<00:04,  6.03it/s, loss=2.07, v_num=0]
Epoch 77:  70%|███████   | 68/97 [00:11<00:04,  6.07it/s, loss=2.07, v_num=0]
Epoch 77:  70%|███████   | 68/97 [00:11<00:04,  6.04it/s, loss=2.07, v_num=0]
Epoch 77:  71%|███████   | 69/97 [00:11<00:04,  6.09it/s, loss=2.07, v_num=0]
Epoch 77:  71%|███████   | 69/97 [00:11<00:04,  6.05it/s, loss=2.07, v_num=0]
Epoch 77:  72%|███████▏  | 70/97 [00:11<00:04,  6.10it/s, loss=2.07, v_num=0]
Epoch 77:  72%|███████▏  | 70/97 [00:11<00:04,  6.07it/s, loss=2.06, v_num=0]
Epoch 77:  73%|███████▎  | 71/97 [00:11<00:04,  6.11it/s, loss=2.06, v_num=0]
Epoch 77:  73%|███████▎  | 71/97 [00:11<00:04,  6.08it/s, loss=2.06, v_num=0]
Epoch 77:  74%|███████▍  | 72/97 [00:11<00:04,  6.12it/s, loss=2.06, v_num=0]
Epoch 77:  74%|███████▍  | 72/97 [00:11<00:04,  6.09it/s, loss=2.07, v_num=0]
Epoch 77:  75%|███████▌  | 73/97 [00:11<00:03,  6.14it/s, loss=2.07, v_num=0]
Epoch 77:  75%|███████▌  | 73/97 [00:11<00:03,  6.11it/s, loss=2.07, v_num=0]
Epoch 77:  76%|███████▋  | 74/97 [00:12<00:03,  6.14it/s, loss=2.07, v_num=0]
Epoch 77:  76%|███████▋  | 74/97 [00:12<00:03,  6.11it/s, loss=2.06, v_num=0]
Epoch 77:  77%|███████▋  | 75/97 [00:12<00:03,  6.15it/s, loss=2.06, v_num=0]
Epoch 77:  77%|███████▋  | 75/97 [00:12<00:03,  6.13it/s, loss=2.06, v_num=0]
Epoch 77:  78%|███████▊  | 76/97 [00:12<00:03,  6.17it/s, loss=2.06, v_num=0]
Epoch 77:  78%|███████▊  | 76/97 [00:12<00:03,  6.14it/s, loss=2.06, v_num=0]
Epoch 77:  79%|███████▉  | 77/97 [00:12<00:03,  6.17it/s, loss=2.06, v_num=0]
Epoch 77:  79%|███████▉  | 77/97 [00:12<00:03,  6.15it/s, loss=2.05, v_num=0]
Epoch 77:  80%|████████  | 78/97 [00:12<00:03,  6.19it/s, loss=2.05, v_num=0]
Epoch 77:  80%|████████  | 78/97 [00:12<00:03,  6.16it/s, loss=2.06, v_num=0]
Epoch 77:  81%|████████▏ | 79/97 [00:12<00:02,  6.20it/s, loss=2.06, v_num=0]
Epoch 77:  81%|████████▏ | 79/97 [00:12<00:02,  6.17it/s, loss=2.07, v_num=0]
Epoch 77:  82%|████████▏ | 80/97 [00:12<00:02,  6.21it/s, loss=2.07, v_num=0]
Epoch 77:  82%|████████▏ | 80/97 [00:12<00:02,  6.19it/s, loss=2.07, v_num=0]
Epoch 77:  84%|████████▎ | 81/97 [00:13<00:02,  6.23it/s, loss=2.07, v_num=0]
Epoch 77:  84%|████████▎ | 81/97 [00:13<00:02,  6.20it/s, loss=2.07, v_num=0]
Epoch 77:  85%|████████▍ | 82/97 [00:13<00:02,  6.24it/s, loss=2.07, v_num=0]
Epoch 77:  85%|████████▍ | 82/97 [00:13<00:02,  6.21it/s, loss=2.06, v_num=0]
Epoch 77:  86%|████████▌ | 83/97 [00:13<00:02,  6.25it/s, loss=2.06, v_num=0]
Epoch 77:  86%|████████▌ | 83/97 [00:13<00:02,  6.22it/s, loss=2.06, v_num=0]
Epoch 77:  87%|████████▋ | 84/97 [00:13<00:02,  6.26it/s, loss=2.06, v_num=0]
Epoch 77:  87%|████████▋ | 84/97 [00:13<00:02,  6.23it/s, loss=2.07, v_num=0]
Epoch 77:  88%|████████▊ | 85/97 [00:13<00:01,  6.26it/s, loss=2.07, v_num=0]
Epoch 77:  88%|████████▊ | 85/97 [00:13<00:01,  6.24it/s, loss=2.07, v_num=0]
Epoch 77:  89%|████████▊ | 86/97 [00:13<00:01,  6.28it/s, loss=2.07, v_num=0]
Epoch 77:  89%|████████▊ | 86/97 [00:13<00:01,  6.25it/s, loss=2.07, v_num=0]
Epoch 77:  90%|████████▉ | 87/97 [00:13<00:01,  6.29it/s, loss=2.07, v_num=0]
Epoch 77:  90%|████████▉ | 87/97 [00:13<00:01,  6.26it/s, loss=2.07, v_num=0]
Epoch 77:  91%|█████████ | 88/97 [00:13<00:01,  6.30it/s, loss=2.07, v_num=0]
Epoch 77:  91%|█████████ | 88/97 [00:14<00:01,  6.27it/s, loss=2.06, v_num=0]
Epoch 77:  92%|█████████▏| 89/97 [00:14<00:01,  6.31it/s, loss=2.06, v_num=0]
Epoch 77:  92%|█████████▏| 89/97 [00:14<00:01,  6.28it/s, loss=2.06, v_num=0]
Epoch 77:  93%|█████████▎| 90/97 [00:14<00:01,  6.32it/s, loss=2.06, v_num=0]
Epoch 77:  93%|█████████▎| 90/97 [00:14<00:01,  6.29it/s, loss=2.07, v_num=0]
Epoch 77:  94%|█████████▍| 91/97 [00:14<00:00,  6.33it/s, loss=2.07, v_num=0]
Epoch 77:  94%|█████████▍| 91/97 [00:14<00:00,  6.30it/s, loss=2.07, v_num=0]
Epoch 77:  95%|█████████▍| 92/97 [00:14<00:00,  6.33it/s, loss=2.07, v_num=0]
Epoch 77:  95%|█████████▍| 92/97 [00:14<00:00,  6.31it/s, loss=2.07, v_num=0]
Epoch 77:  96%|█████████▌| 93/97 [00:14<00:00,  6.34it/s, loss=2.07, v_num=0]
Epoch 77:  96%|█████████▌| 93/97 [00:14<00:00,  6.32it/s, loss=2.07, v_num=0]
Epoch 77:  97%|█████████▋| 94/97 [00:14<00:00,  6.35it/s, loss=2.07, v_num=0]
Epoch 77:  97%|█████████▋| 94/97 [00:14<00:00,  6.32it/s, loss=2.08, v_num=0]
Epoch 77:  98%|█████████▊| 95/97 [00:14<00:00,  6.36it/s, loss=2.08, v_num=0]
Epoch 77:  98%|█████████▊| 95/97 [00:14<00:00,  6.33it/s, loss=2.07, v_num=0]
Epoch 77:  99%|█████████▉| 96/97 [00:15<00:00,  6.37it/s, loss=2.07, v_num=0]
Epoch 77:  99%|█████████▉| 96/97 [00:15<00:00,  6.34it/s, loss=2.07, v_num=0]
Epoch 77: 100%|██████████| 97/97 [00:15<00:00,  6.37it/s, loss=2.07, v_num=0]
Epoch 77: 100%|██████████| 97/97 [00:15<00:00,  6.35it/s, loss=2.07, v_num=0]
Epoch 77: 100%|██████████| 97/97 [00:15<00:00,  6.35it/s, loss=2.07, v_num=0]
Epoch 77:   0%|          | 0/97 [00:00<?, ?it/s, loss=2.07, v_num=0]
Epoch 78:   0%|          | 0/97 [00:00<?, ?it/s, loss=2.07, v_num=0]
Epoch 78:   1%|          | 1/97 [00:01<02:15,  1.41s/it, loss=2.07, v_num=0]
Epoch 78:   1%|          | 1/97 [00:01<02:21,  1.47s/it, loss=2.07, v_num=0]
Epoch 78:   2%|▏         | 2/97 [00:01<01:14,  1.28it/s, loss=2.07, v_num=0]
Epoch 78:   2%|▏         | 2/97 [00:01<01:16,  1.24it/s, loss=2.07, v_num=0]
Epoch 78:   3%|▎         | 3/97 [00:01<00:53,  1.77it/s, loss=2.07, v_num=0]
Epoch 78:   3%|▎         | 3/97 [00:01<00:54,  1.71it/s, loss=2.07, v_num=0]
Epoch 78:   4%|▍         | 4/97 [00:01<00:42,  2.18it/s, loss=2.07, v_num=0]
Epoch 78:   4%|▍         | 4/97 [00:01<00:43,  2.11it/s, loss=2.07, v_num=0]
Epoch 78:   5%|▌         | 5/97 [00:01<00:36,  2.54it/s, loss=2.07, v_num=0]
Epoch 78:   5%|▌         | 5/97 [00:02<00:37,  2.47it/s, loss=2.07, v_num=0]
Epoch 78:   6%|▌         | 6/97 [00:02<00:32,  2.84it/s, loss=2.07, v_num=0]
Epoch 78:   6%|▌         | 6/97 [00:02<00:32,  2.77it/s, loss=2.07, v_num=0]
Epoch 78:   7%|▋         | 7/97 [00:02<00:28,  3.12it/s, loss=2.07, v_num=0]
Epoch 78:   7%|▋         | 7/97 [00:02<00:29,  3.04it/s, loss=2.06, v_num=0]
Epoch 78:   8%|▊         | 8/97 [00:02<00:26,  3.36it/s, loss=2.06, v_num=0]
Epoch 78:   8%|▊         | 8/97 [00:02<00:27,  3.28it/s, loss=2.07, v_num=0]
Epoch 78:   9%|▉         | 9/97 [00:02<00:24,  3.56it/s, loss=2.07, v_num=0]
Epoch 78:   9%|▉         | 9/97 [00:02<00:25,  3.48it/s, loss=2.06, v_num=0]
Epoch 78:  10%|█         | 10/97 [00:02<00:23,  3.75it/s, loss=2.06, v_num=0]
Epoch 78:  10%|█         | 10/97 [00:02<00:23,  3.67it/s, loss=2.06, v_num=0]
Epoch 78:  11%|█▏        | 11/97 [00:02<00:21,  3.93it/s, loss=2.06, v_num=0]
Epoch 78:  11%|█▏        | 11/97 [00:02<00:22,  3.85it/s, loss=2.06, v_num=0]
Epoch 78:  12%|█▏        | 12/97 [00:02<00:20,  4.08it/s, loss=2.06, v_num=0]
Epoch 78:  12%|█▏        | 12/97 [00:02<00:21,  4.01it/s, loss=2.06, v_num=0]
Epoch 78:  13%|█▎        | 13/97 [00:03<00:19,  4.22it/s, loss=2.06, v_num=0]
Epoch 78:  13%|█▎        | 13/97 [00:03<00:20,  4.15it/s, loss=2.06, v_num=0]
Epoch 78:  14%|█▍        | 14/97 [00:03<00:19,  4.36it/s, loss=2.06, v_num=0]
Epoch 78:  14%|█▍        | 14/97 [00:03<00:19,  4.28it/s, loss=2.06, v_num=0]
Epoch 78:  15%|█▌        | 15/97 [00:03<00:18,  4.47it/s, loss=2.06, v_num=0]
Epoch 78:  15%|█▌        | 15/97 [00:03<00:18,  4.40it/s, loss=2.06, v_num=0]
Epoch 78:  16%|█▋        | 16/97 [00:03<00:17,  4.58it/s, loss=2.06, v_num=0]
Epoch 78:  16%|█▋        | 16/97 [00:03<00:17,  4.51it/s, loss=2.06, v_num=0]
Epoch 78:  18%|█▊        | 17/97 [00:03<00:17,  4.68it/s, loss=2.06, v_num=0]
Epoch 78:  18%|█▊        | 17/97 [00:03<00:17,  4.61it/s, loss=2.05, v_num=0]
Epoch 78:  19%|█▊        | 18/97 [00:03<00:16,  4.77it/s, loss=2.05, v_num=0]
Epoch 78:  19%|█▊        | 18/97 [00:03<00:16,  4.70it/s, loss=2.05, v_num=0]
Epoch 78:  20%|█▉        | 19/97 [00:03<00:16,  4.86it/s, loss=2.05, v_num=0]
Epoch 78:  20%|█▉        | 19/97 [00:03<00:16,  4.79it/s, loss=2.05, v_num=0]
Epoch 78:  21%|██        | 20/97 [00:04<00:15,  4.94it/s, loss=2.05, v_num=0]
Epoch 78:  21%|██        | 20/97 [00:04<00:15,  4.87it/s, loss=2.05, v_num=0]
Epoch 78:  22%|██▏       | 21/97 [00:04<00:15,  5.02it/s, loss=2.05, v_num=0]
Epoch 78:  22%|██▏       | 21/97 [00:04<00:15,  4.95it/s, loss=2.05, v_num=0]
Epoch 78:  23%|██▎       | 22/97 [00:04<00:14,  5.09it/s, loss=2.05, v_num=0]
Epoch 78:  23%|██▎       | 22/97 [00:04<00:14,  5.03it/s, loss=2.05, v_num=0]
Epoch 78:  24%|██▎       | 23/97 [00:04<00:14,  5.16it/s, loss=2.05, v_num=0]
Epoch 78:  24%|██▎       | 23/97 [00:04<00:14,  5.10it/s, loss=2.05, v_num=0]
Epoch 78:  25%|██▍       | 24/97 [00:04<00:13,  5.22it/s, loss=2.05, v_num=0]
Epoch 78:  25%|██▍       | 24/97 [00:04<00:14,  5.16it/s, loss=2.05, v_num=0]
Epoch 78:  26%|██▌       | 25/97 [00:04<00:13,  5.28it/s, loss=2.05, v_num=0]
Epoch 78:  26%|██▌       | 25/97 [00:04<00:13,  5.22it/s, loss=2.05, v_num=0]
Epoch 78:  27%|██▋       | 26/97 [00:04<00:13,  5.33it/s, loss=2.05, v_num=0]
Epoch 78:  27%|██▋       | 26/97 [00:04<00:13,  5.27it/s, loss=2.05, v_num=0]
Epoch 78:  28%|██▊       | 27/97 [00:05<00:12,  5.39it/s, loss=2.05, v_num=0]
Epoch 78:  28%|██▊       | 27/97 [00:05<00:13,  5.33it/s, loss=2.05, v_num=0]
Epoch 78:  29%|██▉       | 28/97 [00:05<00:12,  5.44it/s, loss=2.05, v_num=0]
Epoch 78:  29%|██▉       | 28/97 [00:05<00:12,  5.38it/s, loss=2.04, v_num=0]
Epoch 78:  30%|██▉       | 29/97 [00:05<00:12,  5.48it/s, loss=2.04, v_num=0]
Epoch 78:  30%|██▉       | 29/97 [00:05<00:12,  5.43it/s, loss=2.05, v_num=0]
Epoch 78:  31%|███       | 30/97 [00:05<00:12,  5.53it/s, loss=2.05, v_num=0]
Epoch 78:  31%|███       | 30/97 [00:05<00:12,  5.48it/s, loss=2.05, v_num=0]
Epoch 78:  32%|███▏      | 31/97 [00:05<00:11,  5.57it/s, loss=2.05, v_num=0]
Epoch 78:  32%|███▏      | 31/97 [00:05<00:11,  5.52it/s, loss=2.05, v_num=0]
Epoch 78:  33%|███▎      | 32/97 [00:05<00:11,  5.61it/s, loss=2.05, v_num=0]
Epoch 78:  33%|███▎      | 32/97 [00:05<00:11,  5.56it/s, loss=2.04, v_num=0]
Epoch 78:  34%|███▍      | 33/97 [00:05<00:11,  5.65it/s, loss=2.04, v_num=0]
Epoch 78:  34%|███▍      | 33/97 [00:05<00:11,  5.60it/s, loss=2.03, v_num=0]
Epoch 78:  35%|███▌      | 34/97 [00:05<00:11,  5.68it/s, loss=2.03, v_num=0]
Epoch 78:  35%|███▌      | 34/97 [00:06<00:11,  5.63it/s, loss=2.03, v_num=0]
Epoch 78:  36%|███▌      | 35/97 [00:06<00:10,  5.72it/s, loss=2.03, v_num=0]
Epoch 78:  36%|███▌      | 35/97 [00:06<00:10,  5.67it/s, loss=2.03, v_num=0]
Epoch 78:  37%|███▋      | 36/97 [00:06<00:10,  5.75it/s, loss=2.03, v_num=0]
Epoch 78:  37%|███▋      | 36/97 [00:06<00:10,  5.70it/s, loss=2.02, v_num=0]
Epoch 78:  38%|███▊      | 37/97 [00:06<00:10,  5.79it/s, loss=2.02, v_num=0]
Epoch 78:  38%|███▊      | 37/97 [00:06<00:10,  5.74it/s, loss=2.03, v_num=0]
Epoch 78:  39%|███▉      | 38/97 [00:06<00:10,  5.82it/s, loss=2.03, v_num=0]
Epoch 78:  39%|███▉      | 38/97 [00:06<00:10,  5.77it/s, loss=2.03, v_num=0]
Epoch 78:  40%|████      | 39/97 [00:06<00:09,  5.85it/s, loss=2.03, v_num=0]
Epoch 78:  40%|████      | 39/97 [00:06<00:10,  5.80it/s, loss=2.02, v_num=0]
Epoch 78:  41%|████      | 40/97 [00:06<00:09,  5.88it/s, loss=2.02, v_num=0]
Epoch 78:  41%|████      | 40/97 [00:06<00:09,  5.83it/s, loss=2.03, v_num=0]
Epoch 78:  42%|████▏     | 41/97 [00:06<00:09,  5.91it/s, loss=2.03, v_num=0]
Epoch 78:  42%|████▏     | 41/97 [00:06<00:09,  5.86it/s, loss=2.03, v_num=0]
Epoch 78:  43%|████▎     | 42/97 [00:07<00:09,  5.93it/s, loss=2.03, v_num=0]
Epoch 78:  43%|████▎     | 42/97 [00:07<00:09,  5.88it/s, loss=2.04, v_num=0]
Epoch 78:  44%|████▍     | 43/97 [00:07<00:09,  5.96it/s, loss=2.04, v_num=0]
Epoch 78:  44%|████▍     | 43/97 [00:07<00:09,  5.91it/s, loss=2.04, v_num=0]
Epoch 78:  45%|████▌     | 44/97 [00:07<00:08,  5.98it/s, loss=2.04, v_num=0]
Epoch 78:  45%|████▌     | 44/97 [00:07<00:08,  5.94it/s, loss=2.03, v_num=0]
Epoch 78:  46%|████▋     | 45/97 [00:07<00:08,  6.00it/s, loss=2.03, v_num=0]
Epoch 78:  46%|████▋     | 45/97 [00:07<00:08,  5.96it/s, loss=2.04, v_num=0]
Epoch 78:  47%|████▋     | 46/97 [00:07<00:08,  6.03it/s, loss=2.04, v_num=0]
Epoch 78:  47%|████▋     | 46/97 [00:07<00:08,  5.99it/s, loss=2.04, v_num=0]
Epoch 78:  48%|████▊     | 47/97 [00:07<00:08,  6.05it/s, loss=2.04, v_num=0]
Epoch 78:  48%|████▊     | 47/97 [00:07<00:08,  6.01it/s, loss=2.04, v_num=0]
Epoch 78:  49%|████▉     | 48/97 [00:07<00:08,  6.07it/s, loss=2.04, v_num=0]
Epoch 78:  49%|████▉     | 48/97 [00:07<00:08,  6.03it/s, loss=2.04, v_num=0]
Epoch 78:  51%|█████     | 49/97 [00:08<00:07,  6.09it/s, loss=2.04, v_num=0]
Epoch 78:  51%|█████     | 49/97 [00:08<00:07,  6.05it/s, loss=2.04, v_num=0]
Epoch 78:  52%|█████▏    | 50/97 [00:08<00:07,  6.11it/s, loss=2.04, v_num=0]
Epoch 78:  52%|█████▏    | 50/97 [00:08<00:07,  6.07it/s, loss=2.03, v_num=0]
Epoch 78:  53%|█████▎    | 51/97 [00:08<00:07,  6.13it/s, loss=2.03, v_num=0]
Epoch 78:  53%|█████▎    | 51/97 [00:08<00:07,  6.08it/s, loss=2.03, v_num=0]
Epoch 78:  54%|█████▎    | 52/97 [00:08<00:07,  6.14it/s, loss=2.03, v_num=0]
Epoch 78:  54%|█████▎    | 52/97 [00:08<00:07,  6.10it/s, loss=2.04, v_num=0]
Epoch 78:  55%|█████▍    | 53/97 [00:08<00:07,  6.16it/s, loss=2.04, v_num=0]
Epoch 78:  55%|█████▍    | 53/97 [00:08<00:07,  6.12it/s, loss=2.05, v_num=0]
Epoch 78:  56%|█████▌    | 54/97 [00:08<00:06,  6.18it/s, loss=2.05, v_num=0]
Epoch 78:  56%|█████▌    | 54/97 [00:08<00:07,  6.14it/s, loss=2.06, v_num=0]
Epoch 78:  57%|█████▋    | 55/97 [00:08<00:06,  6.19it/s, loss=2.06, v_num=0]
Epoch 78:  57%|█████▋    | 55/97 [00:08<00:06,  6.16it/s, loss=2.05, v_num=0]
Epoch 78:  58%|█████▊    | 56/97 [00:09<00:06,  6.21it/s, loss=2.05, v_num=0]
Epoch 78:  58%|█████▊    | 56/97 [00:09<00:06,  6.17it/s, loss=2.05, v_num=0]
Epoch 78:  59%|█████▉    | 57/97 [00:09<00:06,  6.23it/s, loss=2.05, v_num=0]
Epoch 78:  59%|█████▉    | 57/97 [00:09<00:06,  6.19it/s, loss=2.06, v_num=0]
Epoch 78:  60%|█████▉    | 58/97 [00:09<00:06,  6.24it/s, loss=2.06, v_num=0]
Epoch 78:  60%|█████▉    | 58/97 [00:09<00:06,  6.21it/s, loss=2.06, v_num=0]
Epoch 78:  61%|██████    | 59/97 [00:09<00:06,  6.26it/s, loss=2.06, v_num=0]
Epoch 78:  61%|██████    | 59/97 [00:09<00:06,  6.22it/s, loss=2.07, v_num=0]
Epoch 78:  62%|██████▏   | 60/97 [00:09<00:05,  6.27it/s, loss=2.07, v_num=0]
Epoch 78:  62%|██████▏   | 60/97 [00:09<00:05,  6.23it/s, loss=2.07, v_num=0]
Epoch 78:  63%|██████▎   | 61/97 [00:09<00:05,  6.28it/s, loss=2.07, v_num=0]
Epoch 78:  63%|██████▎   | 61/97 [00:09<00:05,  6.25it/s, loss=2.06, v_num=0]
Epoch 78:  64%|██████▍   | 62/97 [00:09<00:05,  6.30it/s, loss=2.06, v_num=0]
Epoch 78:  64%|██████▍   | 62/97 [00:09<00:05,  6.26it/s, loss=2.06, v_num=0]
Epoch 78:  65%|██████▍   | 63/97 [00:09<00:05,  6.31it/s, loss=2.06, v_num=0]
Epoch 78:  65%|██████▍   | 63/97 [00:10<00:05,  6.28it/s, loss=2.06, v_num=0]
Epoch 78:  66%|██████▌   | 64/97 [00:10<00:05,  6.32it/s, loss=2.06, v_num=0]
Epoch 78:  66%|██████▌   | 64/97 [00:10<00:05,  6.29it/s, loss=2.06, v_num=0]
Epoch 78:  67%|██████▋   | 65/97 [00:10<00:05,  6.33it/s, loss=2.06, v_num=0]
Epoch 78:  67%|██████▋   | 65/97 [00:10<00:05,  6.30it/s, loss=2.06, v_num=0]
Epoch 78:  68%|██████▊   | 66/97 [00:10<00:04,  6.35it/s, loss=2.06, v_num=0]
Epoch 78:  68%|██████▊   | 66/97 [00:10<00:04,  6.31it/s, loss=2.06, v_num=0]
Epoch 78:  69%|██████▉   | 67/97 [00:10<00:04,  6.36it/s, loss=2.06, v_num=0]
Epoch 78:  69%|██████▉   | 67/97 [00:10<00:04,  6.33it/s, loss=2.06, v_num=0]
Epoch 78:  70%|███████   | 68/97 [00:10<00:04,  6.37it/s, loss=2.06, v_num=0]
Epoch 78:  70%|███████   | 68/97 [00:10<00:04,  6.34it/s, loss=2.06, v_num=0]
Epoch 78:  71%|███████   | 69/97 [00:10<00:04,  6.38it/s, loss=2.06, v_num=0]
Epoch 78:  71%|███████   | 69/97 [00:10<00:04,  6.35it/s, loss=2.06, v_num=0]
Epoch 78:  72%|███████▏  | 70/97 [00:10<00:04,  6.39it/s, loss=2.06, v_num=0]
Epoch 78:  72%|███████▏  | 70/97 [00:11<00:04,  6.36it/s, loss=2.07, v_num=0]
Epoch 78:  73%|███████▎  | 71/97 [00:11<00:04,  6.41it/s, loss=2.07, v_num=0]
Epoch 78:  73%|███████▎  | 71/97 [00:11<00:04,  6.37it/s, loss=2.07, v_num=0]
Epoch 78:  74%|███████▍  | 72/97 [00:11<00:03,  6.41it/s, loss=2.07, v_num=0]
Epoch 78:  74%|███████▍  | 72/97 [00:11<00:03,  6.38it/s, loss=2.07, v_num=0]
Epoch 78:  75%|███████▌  | 73/97 [00:11<00:03,  6.43it/s, loss=2.07, v_num=0]
Epoch 78:  75%|███████▌  | 73/97 [00:11<00:03,  6.39it/s, loss=2.07, v_num=0]
Epoch 78:  76%|███████▋  | 74/97 [00:11<00:03,  6.44it/s, loss=2.07, v_num=0]
Epoch 78:  76%|███████▋  | 74/97 [00:11<00:03,  6.41it/s, loss=2.06, v_num=0]
Epoch 78:  77%|███████▋  | 75/97 [00:11<00:03,  6.45it/s, loss=2.06, v_num=0]
Epoch 78:  77%|███████▋  | 75/97 [00:11<00:03,  6.42it/s, loss=2.07, v_num=0]
Epoch 78:  78%|███████▊  | 76/97 [00:11<00:03,  6.46it/s, loss=2.07, v_num=0]
Epoch 78:  78%|███████▊  | 76/97 [00:11<00:03,  6.43it/s, loss=2.07, v_num=0]
Epoch 78:  79%|███████▉  | 77/97 [00:11<00:03,  6.46it/s, loss=2.07, v_num=0]
Epoch 78:  79%|███████▉  | 77/97 [00:11<00:03,  6.43it/s, loss=2.08, v_num=0]
Epoch 78:  80%|████████  | 78/97 [00:12<00:02,  6.47it/s, loss=2.08, v_num=0]
Epoch 78:  80%|████████  | 78/97 [00:12<00:02,  6.44it/s, loss=2.07, v_num=0]
Epoch 78:  81%|████████▏ | 79/97 [00:12<00:02,  6.48it/s, loss=2.07, v_num=0]
Epoch 78:  81%|████████▏ | 79/97 [00:12<00:02,  6.45it/s, loss=2.06, v_num=0]
Epoch 78:  82%|████████▏ | 80/97 [00:12<00:02,  6.49it/s, loss=2.06, v_num=0]
Epoch 78:  82%|████████▏ | 80/97 [00:12<00:02,  6.46it/s, loss=2.06, v_num=0]
Epoch 78:  84%|████████▎ | 81/97 [00:12<00:02,  6.50it/s, loss=2.06, v_num=0]
Epoch 78:  84%|████████▎ | 81/97 [00:12<00:02,  6.47it/s, loss=2.06, v_num=0]
Epoch 78:  85%|████████▍ | 82/97 [00:12<00:02,  6.50it/s, loss=2.06, v_num=0]
Epoch 78:  85%|████████▍ | 82/97 [00:12<00:02,  6.48it/s, loss=2.06, v_num=0]
Epoch 78:  86%|████████▌ | 83/97 [00:12<00:02,  6.51it/s, loss=2.06, v_num=0]
Epoch 78:  86%|████████▌ | 83/97 [00:12<00:02,  6.48it/s, loss=2.06, v_num=0]
Epoch 78:  87%|████████▋ | 84/97 [00:12<00:01,  6.52it/s, loss=2.06, v_num=0]
Epoch 78:  87%|████████▋ | 84/97 [00:12<00:02,  6.49it/s, loss=2.06, v_num=0]
Epoch 78:  88%|████████▊ | 85/97 [00:13<00:01,  6.53it/s, loss=2.06, v_num=0]
Epoch 78:  88%|████████▊ | 85/97 [00:13<00:01,  6.50it/s, loss=2.06, v_num=0]
Epoch 78:  89%|████████▊ | 86/97 [00:13<00:01,  6.54it/s, loss=2.06, v_num=0]
Epoch 78:  89%|████████▊ | 86/97 [00:13<00:01,  6.51it/s, loss=2.06, v_num=0]
Epoch 78:  90%|████████▉ | 87/97 [00:13<00:01,  6.55it/s, loss=2.06, v_num=0]
Epoch 78:  90%|████████▉ | 87/97 [00:13<00:01,  6.52it/s, loss=2.05, v_num=0]
Epoch 78:  91%|█████████ | 88/97 [00:13<00:01,  6.55it/s, loss=2.05, v_num=0]
Epoch 78:  91%|█████████ | 88/97 [00:13<00:01,  6.53it/s, loss=2.06, v_num=0]
Epoch 78:  92%|█████████▏| 89/97 [00:13<00:01,  6.56it/s, loss=2.06, v_num=0]
Epoch 78:  92%|█████████▏| 89/97 [00:13<00:01,  6.54it/s, loss=2.06, v_num=0]
Epoch 78:  93%|█████████▎| 90/97 [00:13<00:01,  6.57it/s, loss=2.06, v_num=0]
Epoch 78:  93%|█████████▎| 90/97 [00:13<00:01,  6.54it/s, loss=2.06, v_num=0]
Epoch 78:  94%|█████████▍| 91/97 [00:13<00:00,  6.58it/s, loss=2.06, v_num=0]
Epoch 78:  94%|█████████▍| 91/97 [00:13<00:00,  6.55it/s, loss=2.06, v_num=0]
Epoch 78:  95%|█████████▍| 92/97 [00:13<00:00,  6.59it/s, loss=2.06, v_num=0]
Epoch 78:  95%|█████████▍| 92/97 [00:14<00:00,  6.56it/s, loss=2.06, v_num=0]
Epoch 78:  96%|█████████▌| 93/97 [00:14<00:00,  6.59it/s, loss=2.06, v_num=0]
Epoch 78:  96%|█████████▌| 93/97 [00:14<00:00,  6.57it/s, loss=2.05, v_num=0]
Epoch 78:  97%|█████████▋| 94/97 [00:14<00:00,  6.60it/s, loss=2.05, v_num=0]
Epoch 78:  97%|█████████▋| 94/97 [00:14<00:00,  6.57it/s, loss=2.05, v_num=0]
Epoch 78:  98%|█████████▊| 95/97 [00:14<00:00,  6.61it/s, loss=2.05, v_num=0]
Epoch 78:  98%|█████████▊| 95/97 [00:14<00:00,  6.58it/s, loss=2.06, v_num=0]
Epoch 78:  99%|█████████▉| 96/97 [00:14<00:00,  6.61it/s, loss=2.06, v_num=0]
Epoch 78:  99%|█████████▉| 96/97 [00:14<00:00,  6.59it/s, loss=2.06, v_num=0]
Epoch 78: 100%|██████████| 97/97 [00:14<00:00,  6.62it/s, loss=2.06, v_num=0]
Epoch 78: 100%|██████████| 97/97 [00:14<00:00,  6.59it/s, loss=2.05, v_num=0]
Epoch 78: 100%|██████████| 97/97 [00:14<00:00,  6.59it/s, loss=2.05, v_num=0]
Epoch 78:   0%|          | 0/97 [00:00<?, ?it/s, loss=2.05, v_num=0]
Epoch 79:   0%|          | 0/97 [00:00<?, ?it/s, loss=2.05, v_num=0]
Epoch 79:   1%|          | 1/97 [00:01<02:17,  1.43s/it, loss=2.05, v_num=0]
Epoch 79:   1%|          | 1/97 [00:01<02:22,  1.48s/it, loss=2.06, v_num=0]
Epoch 79:   2%|▏         | 2/97 [00:01<01:14,  1.27it/s, loss=2.06, v_num=0]
Epoch 79:   2%|▏         | 2/97 [00:01<01:17,  1.23it/s, loss=2.05, v_num=0]
Epoch 79:   3%|▎         | 3/97 [00:01<00:53,  1.76it/s, loss=2.05, v_num=0]
Epoch 79:   3%|▎         | 3/97 [00:01<00:55,  1.70it/s, loss=2.06, v_num=0]
Epoch 79:   4%|▍         | 4/97 [00:01<00:42,  2.17it/s, loss=2.06, v_num=0]
Epoch 79:   4%|▍         | 4/97 [00:01<00:44,  2.11it/s, loss=2.06, v_num=0]
Epoch 79:   5%|▌         | 5/97 [00:01<00:36,  2.53it/s, loss=2.06, v_num=0]
Epoch 79:   5%|▌         | 5/97 [00:02<00:37,  2.46it/s, loss=2.05, v_num=0]
Epoch 79:   6%|▌         | 6/97 [00:02<00:32,  2.83it/s, loss=2.05, v_num=0]
Epoch 79:   6%|▌         | 6/97 [00:02<00:32,  2.76it/s, loss=2.06, v_num=0]
Epoch 79:   7%|▋         | 7/97 [00:02<00:29,  3.10it/s, loss=2.06, v_num=0]
Epoch 79:   7%|▋         | 7/97 [00:02<00:29,  3.03it/s, loss=2.05, v_num=0]
Epoch 79:   8%|▊         | 8/97 [00:02<00:26,  3.35it/s, loss=2.05, v_num=0]
Epoch 79:   8%|▊         | 8/97 [00:02<00:27,  3.27it/s, loss=2.06, v_num=0]
Epoch 79:   9%|▉         | 9/97 [00:02<00:24,  3.55it/s, loss=2.06, v_num=0]
Epoch 79:   9%|▉         | 9/97 [00:02<00:25,  3.47it/s, loss=2.06, v_num=0]
Epoch 79:  10%|█         | 10/97 [00:02<00:23,  3.74it/s, loss=2.06, v_num=0]
Epoch 79:  10%|█         | 10/97 [00:02<00:23,  3.66it/s, loss=2.05, v_num=0]
Epoch 79:  11%|█▏        | 11/97 [00:02<00:22,  3.90it/s, loss=2.05, v_num=0]
Epoch 79:  11%|█▏        | 11/97 [00:02<00:22,  3.83it/s, loss=2.04, v_num=0]
Epoch 79:  12%|█▏        | 12/97 [00:02<00:20,  4.06it/s, loss=2.04, v_num=0]
Epoch 79:  12%|█▏        | 12/97 [00:03<00:21,  3.99it/s, loss=2.04, v_num=0]
Epoch 79:  13%|█▎        | 13/97 [00:03<00:19,  4.21it/s, loss=2.04, v_num=0]
Epoch 79:  13%|█▎        | 13/97 [00:03<00:20,  4.14it/s, loss=2.04, v_num=0]
Epoch 79:  14%|█▍        | 14/97 [00:03<00:19,  4.35it/s, loss=2.04, v_num=0]
Epoch 79:  14%|█▍        | 14/97 [00:03<00:19,  4.27it/s, loss=2.04, v_num=0]
Epoch 79:  15%|█▌        | 15/97 [00:03<00:18,  4.46it/s, loss=2.04, v_num=0]
Epoch 79:  15%|█▌        | 15/97 [00:03<00:18,  4.39it/s, loss=2.04, v_num=0]
Epoch 79:  16%|█▋        | 16/97 [00:03<00:17,  4.57it/s, loss=2.04, v_num=0]
Epoch 79:  16%|█▋        | 16/97 [00:03<00:17,  4.50it/s, loss=2.04, v_num=0]
Epoch 79:  18%|█▊        | 17/97 [00:03<00:17,  4.67it/s, loss=2.04, v_num=0]
Epoch 79:  18%|█▊        | 17/97 [00:03<00:17,  4.60it/s, loss=2.04, v_num=0]
Epoch 79:  19%|█▊        | 18/97 [00:03<00:16,  4.77it/s, loss=2.04, v_num=0]
Epoch 79:  19%|█▊        | 18/97 [00:03<00:16,  4.70it/s, loss=2.04, v_num=0]
Epoch 79:  20%|█▉        | 19/97 [00:03<00:16,  4.86it/s, loss=2.04, v_num=0]
Epoch 79:  20%|█▉        | 19/97 [00:03<00:16,  4.79it/s, loss=2.04, v_num=0]
Epoch 79:  21%|██        | 20/97 [00:04<00:15,  4.94it/s, loss=2.04, v_num=0]
Epoch 79:  21%|██        | 20/97 [00:04<00:15,  4.87it/s, loss=2.03, v_num=0]
Epoch 79:  22%|██▏       | 21/97 [00:04<00:15,  5.02it/s, loss=2.03, v_num=0]
Epoch 79:  22%|██▏       | 21/97 [00:04<00:15,  4.95it/s, loss=2.04, v_num=0]
Epoch 79:  23%|██▎       | 22/97 [00:04<00:14,  5.09it/s, loss=2.04, v_num=0]
Epoch 79:  23%|██▎       | 22/97 [00:04<00:14,  5.03it/s, loss=2.04, v_num=0]
Epoch 79:  24%|██▎       | 23/97 [00:04<00:14,  5.16it/s, loss=2.04, v_num=0]
Epoch 79:  24%|██▎       | 23/97 [00:04<00:14,  5.09it/s, loss=2.04, v_num=0]
Epoch 79:  25%|██▍       | 24/97 [00:04<00:13,  5.22it/s, loss=2.04, v_num=0]
Epoch 79:  25%|██▍       | 24/97 [00:04<00:14,  5.16it/s, loss=2.03, v_num=0]
Epoch 79:  26%|██▌       | 25/97 [00:04<00:13,  5.28it/s, loss=2.03, v_num=0]
Epoch 79:  26%|██▌       | 25/97 [00:04<00:13,  5.22it/s, loss=2.03, v_num=0]
Epoch 79:  27%|██▋       | 26/97 [00:04<00:13,  5.33it/s, loss=2.03, v_num=0]
Epoch 79:  27%|██▋       | 26/97 [00:04<00:13,  5.27it/s, loss=2.03, v_num=0]
Epoch 79:  28%|██▊       | 27/97 [00:05<00:12,  5.39it/s, loss=2.03, v_num=0]
Epoch 79:  28%|██▊       | 27/97 [00:05<00:13,  5.33it/s, loss=2.03, v_num=0]
Epoch 79:  29%|██▉       | 28/97 [00:05<00:12,  5.44it/s, loss=2.03, v_num=0]
Epoch 79:  29%|██▉       | 28/97 [00:05<00:12,  5.38it/s, loss=2.03, v_num=0]
Epoch 79:  30%|██▉       | 29/97 [00:05<00:12,  5.49it/s, loss=2.03, v_num=0]
Epoch 79:  30%|██▉       | 29/97 [00:05<00:12,  5.43it/s, loss=2.03, v_num=0]
Epoch 79:  31%|███       | 30/97 [00:05<00:12,  5.54it/s, loss=2.03, v_num=0]
Epoch 79:  31%|███       | 30/97 [00:05<00:12,  5.48it/s, loss=2.04, v_num=0]
Epoch 79:  32%|███▏      | 31/97 [00:05<00:11,  5.58it/s, loss=2.04, v_num=0]
Epoch 79:  32%|███▏      | 31/97 [00:05<00:11,  5.52it/s, loss=2.04, v_num=0]
Epoch 79:  33%|███▎      | 32/97 [00:05<00:11,  5.62it/s, loss=2.04, v_num=0]
Epoch 79:  33%|███▎      | 32/97 [00:05<00:11,  5.56it/s, loss=2.04, v_num=0]
Epoch 79:  34%|███▍      | 33/97 [00:05<00:11,  5.66it/s, loss=2.04, v_num=0]
Epoch 79:  34%|███▍      | 33/97 [00:05<00:11,  5.60it/s, loss=2.04, v_num=0]
Epoch 79:  35%|███▌      | 34/97 [00:05<00:11,  5.70it/s, loss=2.04, v_num=0]
Epoch 79:  35%|███▌      | 34/97 [00:06<00:11,  5.64it/s, loss=2.04, v_num=0]
Epoch 79:  36%|███▌      | 35/97 [00:06<00:10,  5.73it/s, loss=2.04, v_num=0]
Epoch 79:  36%|███▌      | 35/97 [00:06<00:10,  5.68it/s, loss=2.04, v_num=0]
Epoch 79:  37%|███▋      | 36/97 [00:06<00:10,  5.77it/s, loss=2.04, v_num=0]
Epoch 79:  37%|███▋      | 36/97 [00:06<00:10,  5.71it/s, loss=2.04, v_num=0]
Epoch 79:  38%|███▊      | 37/97 [00:06<00:10,  5.80it/s, loss=2.04, v_num=0]
Epoch 79:  38%|███▊      | 37/97 [00:06<00:10,  5.75it/s, loss=2.04, v_num=0]
Epoch 79:  39%|███▉      | 38/97 [00:06<00:10,  5.83it/s, loss=2.04, v_num=0]
Epoch 79:  39%|███▉      | 38/97 [00:06<00:10,  5.78it/s, loss=2.04, v_num=0]
Epoch 79:  40%|████      | 39/97 [00:06<00:09,  5.86it/s, loss=2.04, v_num=0]
Epoch 79:  40%|████      | 39/97 [00:06<00:09,  5.81it/s, loss=2.04, v_num=0]
Epoch 79:  41%|████      | 40/97 [00:06<00:09,  5.89it/s, loss=2.04, v_num=0]
Epoch 79:  41%|████      | 40/97 [00:06<00:09,  5.84it/s, loss=2.04, v_num=0]
Epoch 79:  42%|████▏     | 41/97 [00:06<00:09,  5.92it/s, loss=2.04, v_num=0]
Epoch 79:  42%|████▏     | 41/97 [00:06<00:09,  5.87it/s, loss=2.04, v_num=0]
Epoch 79:  43%|████▎     | 42/97 [00:07<00:09,  5.94it/s, loss=2.04, v_num=0]
Epoch 79:  43%|████▎     | 42/97 [00:07<00:09,  5.90it/s, loss=2.04, v_num=0]
Epoch 79:  44%|████▍     | 43/97 [00:07<00:09,  5.97it/s, loss=2.04, v_num=0]
Epoch 79:  44%|████▍     | 43/97 [00:07<00:09,  5.93it/s, loss=2.04, v_num=0]
Epoch 79:  45%|████▌     | 44/97 [00:07<00:08,  6.00it/s, loss=2.04, v_num=0]
Epoch 79:  45%|████▌     | 44/97 [00:07<00:08,  5.95it/s, loss=2.04, v_num=0]
Epoch 79:  46%|████▋     | 45/97 [00:07<00:08,  6.02it/s, loss=2.04, v_num=0]
Epoch 79:  46%|████▋     | 45/97 [00:07<00:08,  5.98it/s, loss=2.04, v_num=0]
Epoch 79:  47%|████▋     | 46/97 [00:07<00:08,  6.04it/s, loss=2.04, v_num=0]
Epoch 79:  47%|████▋     | 46/97 [00:07<00:08,  6.00it/s, loss=2.04, v_num=0]
Epoch 79:  48%|████▊     | 47/97 [00:07<00:08,  6.07it/s, loss=2.04, v_num=0]
Epoch 79:  48%|████▊     | 47/97 [00:07<00:08,  6.02it/s, loss=2.04, v_num=0]
Epoch 79:  49%|████▉     | 48/97 [00:07<00:08,  6.09it/s, loss=2.04, v_num=0]
Epoch 79:  49%|████▉     | 48/97 [00:07<00:08,  6.04it/s, loss=2.04, v_num=0]
Epoch 79:  51%|█████     | 49/97 [00:08<00:07,  6.10it/s, loss=2.04, v_num=0]
Epoch 79:  51%|█████     | 49/97 [00:08<00:07,  6.06it/s, loss=2.04, v_num=0]
Epoch 79:  52%|█████▏    | 50/97 [00:08<00:07,  6.13it/s, loss=2.04, v_num=0]
Epoch 79:  52%|█████▏    | 50/97 [00:08<00:07,  6.08it/s, loss=2.03, v_num=0]
Epoch 79:  53%|█████▎    | 51/97 [00:08<00:07,  6.14it/s, loss=2.03, v_num=0]
Epoch 79:  53%|█████▎    | 51/97 [00:08<00:07,  6.10it/s, loss=2.03, v_num=0]
Epoch 79:  54%|█████▎    | 52/97 [00:08<00:07,  6.16it/s, loss=2.03, v_num=0]
Epoch 79:  54%|█████▎    | 52/97 [00:08<00:07,  6.12it/s, loss=2.04, v_num=0]
Epoch 79:  55%|█████▍    | 53/97 [00:08<00:07,  6.18it/s, loss=2.04, v_num=0]
Epoch 79:  55%|█████▍    | 53/97 [00:08<00:07,  6.14it/s, loss=2.03, v_num=0]
Epoch 79:  56%|█████▌    | 54/97 [00:08<00:06,  6.20it/s, loss=2.03, v_num=0]
Epoch 79:  56%|█████▌    | 54/97 [00:08<00:06,  6.16it/s, loss=2.03, v_num=0]
Epoch 79:  57%|█████▋    | 55/97 [00:08<00:06,  6.21it/s, loss=2.03, v_num=0]
Epoch 79:  57%|█████▋    | 55/97 [00:08<00:06,  6.17it/s, loss=2.04, v_num=0]
Epoch 79:  58%|█████▊    | 56/97 [00:08<00:06,  6.22it/s, loss=2.04, v_num=0]
Epoch 79:  58%|█████▊    | 56/97 [00:09<00:06,  6.19it/s, loss=2.04, v_num=0]
Epoch 79:  59%|█████▉    | 57/97 [00:09<00:06,  6.24it/s, loss=2.04, v_num=0]
Epoch 79:  59%|█████▉    | 57/97 [00:09<00:06,  6.20it/s, loss=2.03, v_num=0]
Epoch 79:  60%|█████▉    | 58/97 [00:09<00:06,  6.25it/s, loss=2.03, v_num=0]
Epoch 79:  60%|█████▉    | 58/97 [00:09<00:06,  6.21it/s, loss=2.03, v_num=0]
Epoch 79:  61%|██████    | 59/97 [00:09<00:06,  6.26it/s, loss=2.03, v_num=0]
Epoch 79:  61%|██████    | 59/97 [00:09<00:06,  6.23it/s, loss=2.03, v_num=0]
Epoch 79:  62%|██████▏   | 60/97 [00:09<00:05,  6.28it/s, loss=2.03, v_num=0]
Epoch 79:  62%|██████▏   | 60/97 [00:09<00:05,  6.24it/s, loss=2.02, v_num=0]
Epoch 79:  63%|██████▎   | 61/97 [00:09<00:05,  6.29it/s, loss=2.02, v_num=0]
Epoch 79:  63%|██████▎   | 61/97 [00:09<00:05,  6.25it/s, loss=2.03, v_num=0]
Epoch 79:  64%|██████▍   | 62/97 [00:09<00:05,  6.30it/s, loss=2.03, v_num=0]
Epoch 79:  64%|██████▍   | 62/97 [00:09<00:05,  6.27it/s, loss=2.03, v_num=0]
Epoch 79:  65%|██████▍   | 63/97 [00:09<00:05,  6.32it/s, loss=2.03, v_num=0]
Epoch 79:  65%|██████▍   | 63/97 [00:10<00:05,  6.28it/s, loss=2.03, v_num=0]
Epoch 79:  66%|██████▌   | 64/97 [00:10<00:05,  6.33it/s, loss=2.03, v_num=0]
Epoch 79:  66%|██████▌   | 64/97 [00:10<00:05,  6.29it/s, loss=2.03, v_num=0]
Epoch 79:  67%|██████▋   | 65/97 [00:10<00:05,  6.34it/s, loss=2.03, v_num=0]
Epoch 79:  67%|██████▋   | 65/97 [00:10<00:05,  6.30it/s, loss=2.03, v_num=0]
Epoch 79:  68%|██████▊   | 66/97 [00:10<00:04,  6.35it/s, loss=2.03, v_num=0]
Epoch 79:  68%|██████▊   | 66/97 [00:10<00:04,  6.32it/s, loss=2.03, v_num=0]
Epoch 79:  69%|██████▉   | 67/97 [00:10<00:04,  6.36it/s, loss=2.03, v_num=0]
Epoch 79:  69%|██████▉   | 67/97 [00:10<00:04,  6.33it/s, loss=2.03, v_num=0]
Epoch 79:  70%|███████   | 68/97 [00:10<00:04,  6.37it/s, loss=2.03, v_num=0]
Epoch 79:  70%|███████   | 68/97 [00:10<00:04,  6.34it/s, loss=2.03, v_num=0]
Epoch 79:  71%|███████   | 69/97 [00:10<00:04,  6.38it/s, loss=2.03, v_num=0]
Epoch 79:  71%|███████   | 69/97 [00:10<00:04,  6.35it/s, loss=2.03, v_num=0]
Epoch 79:  72%|███████▏  | 70/97 [00:10<00:04,  6.39it/s, loss=2.03, v_num=0]
Epoch 79:  72%|███████▏  | 70/97 [00:11<00:04,  6.36it/s, loss=2.04, v_num=0]
Epoch 79:  73%|███████▎  | 71/97 [00:11<00:04,  6.41it/s, loss=2.04, v_num=0]
Epoch 79:  73%|███████▎  | 71/97 [00:11<00:04,  6.37it/s, loss=2.04, v_num=0]
Epoch 79:  74%|███████▍  | 72/97 [00:11<00:03,  6.42it/s, loss=2.04, v_num=0]
Epoch 79:  74%|███████▍  | 72/97 [00:11<00:03,  6.38it/s, loss=2.04, v_num=0]
Epoch 79:  75%|███████▌  | 73/97 [00:11<00:03,  6.43it/s, loss=2.04, v_num=0]
Epoch 79:  75%|███████▌  | 73/97 [00:11<00:03,  6.40it/s, loss=2.04, v_num=0]
Epoch 79:  76%|███████▋  | 74/97 [00:11<00:03,  6.44it/s, loss=2.04, v_num=0]
Epoch 79:  76%|███████▋  | 74/97 [00:11<00:03,  6.41it/s, loss=2.03, v_num=0]
Epoch 79:  77%|███████▋  | 75/97 [00:11<00:03,  6.45it/s, loss=2.03, v_num=0]
Epoch 79:  77%|███████▋  | 75/97 [00:11<00:03,  6.42it/s, loss=2.03, v_num=0]
Epoch 79:  78%|███████▊  | 76/97 [00:11<00:03,  6.46it/s, loss=2.03, v_num=0]
Epoch 79:  78%|███████▊  | 76/97 [00:11<00:03,  6.43it/s, loss=2.03, v_num=0]
Epoch 79:  79%|███████▉  | 77/97 [00:11<00:03,  6.47it/s, loss=2.03, v_num=0]
Epoch 79:  79%|███████▉  | 77/97 [00:11<00:03,  6.44it/s, loss=2.03, v_num=0]
Epoch 79:  80%|████████  | 78/97 [00:12<00:02,  6.48it/s, loss=2.03, v_num=0]
Epoch 79:  80%|████████  | 78/97 [00:12<00:02,  6.45it/s, loss=2.03, v_num=0]
Epoch 79:  81%|████████▏ | 79/97 [00:12<00:02,  6.49it/s, loss=2.03, v_num=0]
Epoch 79:  81%|████████▏ | 79/97 [00:12<00:02,  6.46it/s, loss=2.03, v_num=0]
Epoch 79:  82%|████████▏ | 80/97 [00:12<00:02,  6.49it/s, loss=2.03, v_num=0]
Epoch 79:  82%|████████▏ | 80/97 [00:12<00:02,  6.47it/s, loss=2.04, v_num=0]
Epoch 79:  84%|████████▎ | 81/97 [00:12<00:02,  6.50it/s, loss=2.04, v_num=0]
Epoch 79:  84%|████████▎ | 81/97 [00:12<00:02,  6.47it/s, loss=2.03, v_num=0]
Epoch 79:  85%|████████▍ | 82/97 [00:12<00:02,  6.51it/s, loss=2.03, v_num=0]
Epoch 79:  85%|████████▍ | 82/97 [00:12<00:02,  6.48it/s, loss=2.04, v_num=0]
Epoch 79:  86%|████████▌ | 83/97 [00:12<00:02,  6.52it/s, loss=2.04, v_num=0]
Epoch 79:  86%|████████▌ | 83/97 [00:12<00:02,  6.49it/s, loss=2.03, v_num=0]
Epoch 79:  87%|████████▋ | 84/97 [00:12<00:01,  6.53it/s, loss=2.03, v_num=0]
Epoch 79:  87%|████████▋ | 84/97 [00:12<00:02,  6.50it/s, loss=2.04, v_num=0]
Epoch 79:  88%|████████▊ | 85/97 [00:13<00:01,  6.54it/s, loss=2.04, v_num=0]
Epoch 79:  88%|████████▊ | 85/97 [00:13<00:01,  6.51it/s, loss=2.04, v_num=0]
Epoch 79:  89%|████████▊ | 86/97 [00:13<00:01,  6.54it/s, loss=2.04, v_num=0]
Epoch 79:  89%|████████▊ | 86/97 [00:13<00:01,  6.52it/s, loss=2.04, v_num=0]
Epoch 79:  90%|████████▉ | 87/97 [00:13<00:01,  6.55it/s, loss=2.04, v_num=0]
Epoch 79:  90%|████████▉ | 87/97 [00:13<00:01,  6.52it/s, loss=2.04, v_num=0]
Epoch 79:  91%|█████████ | 88/97 [00:13<00:01,  6.56it/s, loss=2.04, v_num=0]
Epoch 79:  91%|█████████ | 88/97 [00:13<00:01,  6.53it/s, loss=2.05, v_num=0]
Epoch 79:  92%|█████████▏| 89/97 [00:13<00:01,  6.57it/s, loss=2.05, v_num=0]
Epoch 79:  92%|█████████▏| 89/97 [00:13<00:01,  6.54it/s, loss=2.05, v_num=0]
Epoch 79:  93%|█████████▎| 90/97 [00:13<00:01,  6.58it/s, loss=2.05, v_num=0]
Epoch 79:  93%|█████████▎| 90/97 [00:13<00:01,  6.55it/s, loss=2.04, v_num=0]
Epoch 79:  94%|█████████▍| 91/97 [00:13<00:00,  6.58it/s, loss=2.04, v_num=0]
Epoch 79:  94%|█████████▍| 91/97 [00:13<00:00,  6.56it/s, loss=2.04, v_num=0]
Epoch 79:  95%|█████████▍| 92/97 [00:13<00:00,  6.59it/s, loss=2.04, v_num=0]
Epoch 79:  95%|█████████▍| 92/97 [00:14<00:00,  6.56it/s, loss=2.04, v_num=0]
Epoch 79:  96%|█████████▌| 93/97 [00:14<00:00,  6.60it/s, loss=2.04, v_num=0]
Epoch 79:  96%|█████████▌| 93/97 [00:14<00:00,  6.57it/s, loss=2.04, v_num=0]
Epoch 79:  97%|█████████▋| 94/97 [00:14<00:00,  6.60it/s, loss=2.04, v_num=0]
Epoch 79:  97%|█████████▋| 94/97 [00:14<00:00,  6.58it/s, loss=2.04, v_num=0]
Epoch 79:  98%|█████████▊| 95/97 [00:14<00:00,  6.61it/s, loss=2.04, v_num=0]
Epoch 79:  98%|█████████▊| 95/97 [00:14<00:00,  6.58it/s, loss=2.05, v_num=0]
Epoch 79:  99%|█████████▉| 96/97 [00:14<00:00,  6.62it/s, loss=2.05, v_num=0]
Epoch 79:  99%|█████████▉| 96/97 [00:14<00:00,  6.59it/s, loss=2.05, v_num=0]
Epoch 79: 100%|██████████| 97/97 [00:14<00:00,  6.62it/s, loss=2.05, v_num=0]
Epoch 79: 100%|██████████| 97/97 [00:14<00:00,  6.60it/s, loss=2.05, v_num=0]
Epoch 79: 100%|██████████| 97/97 [00:14<00:00,  6.60it/s, loss=2.05, v_num=0]
Epoch 79:   0%|          | 0/97 [00:00<?, ?it/s, loss=2.05, v_num=0]
Epoch 80:   0%|          | 0/97 [00:00<?, ?it/s, loss=2.05, v_num=0]
Epoch 80:   1%|          | 1/97 [00:01<02:20,  1.46s/it, loss=2.05, v_num=0]
Epoch 80:   1%|          | 1/97 [00:01<02:25,  1.52s/it, loss=2.05, v_num=0]
Epoch 80:   2%|▏         | 2/97 [00:01<01:15,  1.25it/s, loss=2.05, v_num=0]
Epoch 80:   2%|▏         | 2/97 [00:01<01:18,  1.21it/s, loss=2.05, v_num=0]
Epoch 80:   3%|▎         | 3/97 [00:01<00:54,  1.73it/s, loss=2.05, v_num=0]
Epoch 80:   3%|▎         | 3/97 [00:01<00:56,  1.68it/s, loss=2.05, v_num=0]
Epoch 80:   4%|▍         | 4/97 [00:01<00:43,  2.14it/s, loss=2.05, v_num=0]
Epoch 80:   4%|▍         | 4/97 [00:01<00:44,  2.08it/s, loss=2.05, v_num=0]
Epoch 80:   5%|▌         | 5/97 [00:02<00:36,  2.49it/s, loss=2.05, v_num=0]
Epoch 80:   5%|▌         | 5/97 [00:02<00:37,  2.42it/s, loss=2.06, v_num=0]
Epoch 80:   6%|▌         | 6/97 [00:02<00:32,  2.80it/s, loss=2.06, v_num=0]
Epoch 80:   6%|▌         | 6/97 [00:02<00:33,  2.73it/s, loss=2.06, v_num=0]
Epoch 80:   7%|▋         | 7/97 [00:02<00:29,  3.07it/s, loss=2.06, v_num=0]
Epoch 80:   7%|▋         | 7/97 [00:02<00:30,  3.00it/s, loss=2.06, v_num=0]
Epoch 80:   8%|▊         | 8/97 [00:02<00:26,  3.31it/s, loss=2.06, v_num=0]
Epoch 80:   8%|▊         | 8/97 [00:02<00:27,  3.24it/s, loss=2.06, v_num=0]
Epoch 80:   9%|▉         | 9/97 [00:02<00:25,  3.51it/s, loss=2.06, v_num=0]
Epoch 80:   9%|▉         | 9/97 [00:02<00:25,  3.44it/s, loss=2.06, v_num=0]
Epoch 80:  10%|█         | 10/97 [00:02<00:23,  3.70it/s, loss=2.06, v_num=0]
Epoch 80:  10%|█         | 10/97 [00:02<00:23,  3.63it/s, loss=2.05, v_num=0]
Epoch 80:  11%|█▏        | 11/97 [00:02<00:22,  3.88it/s, loss=2.05, v_num=0]
Epoch 80:  11%|█▏        | 11/97 [00:02<00:22,  3.80it/s, loss=2.05, v_num=0]
Epoch 80:  12%|█▏        | 12/97 [00:02<00:21,  4.04it/s, loss=2.05, v_num=0]
Epoch 80:  12%|█▏        | 12/97 [00:03<00:21,  3.96it/s, loss=2.06, v_num=0]
Epoch 80:  13%|█▎        | 13/97 [00:03<00:20,  4.18it/s, loss=2.06, v_num=0]
Epoch 80:  13%|█▎        | 13/97 [00:03<00:20,  4.11it/s, loss=2.06, v_num=0]
Epoch 80:  14%|█▍        | 14/97 [00:03<00:19,  4.31it/s, loss=2.06, v_num=0]
Epoch 80:  14%|█▍        | 14/97 [00:03<00:19,  4.23it/s, loss=2.07, v_num=0]
Epoch 80:  15%|█▌        | 15/97 [00:03<00:18,  4.43it/s, loss=2.07, v_num=0]
Epoch 80:  15%|█▌        | 15/97 [00:03<00:18,  4.36it/s, loss=2.06, v_num=0]
Epoch 80:  16%|█▋        | 16/97 [00:03<00:17,  4.54it/s, loss=2.06, v_num=0]
Epoch 80:  16%|█▋        | 16/97 [00:03<00:18,  4.47it/s, loss=2.06, v_num=0]
Epoch 80:  18%|█▊        | 17/97 [00:03<00:17,  4.64it/s, loss=2.06, v_num=0]
Epoch 80:  18%|█▊        | 17/97 [00:03<00:17,  4.57it/s, loss=2.06, v_num=0]
Epoch 80:  19%|█▊        | 18/97 [00:03<00:16,  4.74it/s, loss=2.06, v_num=0]
Epoch 80:  19%|█▊        | 18/97 [00:03<00:16,  4.67it/s, loss=2.06, v_num=0]
Epoch 80:  20%|█▉        | 19/97 [00:03<00:16,  4.82it/s, loss=2.06, v_num=0]
Epoch 80:  20%|█▉        | 19/97 [00:03<00:16,  4.76it/s, loss=2.06, v_num=0]
Epoch 80:  21%|██        | 20/97 [00:04<00:15,  4.91it/s, loss=2.06, v_num=0]
Epoch 80:  21%|██        | 20/97 [00:04<00:15,  4.84it/s, loss=2.06, v_num=0]
Epoch 80:  22%|██▏       | 21/97 [00:04<00:15,  4.99it/s, loss=2.06, v_num=0]
Epoch 80:  22%|██▏       | 21/97 [00:04<00:15,  4.92it/s, loss=2.05, v_num=0]
Epoch 80:  23%|██▎       | 22/97 [00:04<00:14,  5.06it/s, loss=2.05, v_num=0]
Epoch 80:  23%|██▎       | 22/97 [00:04<00:15,  5.00it/s, loss=2.04, v_num=0]
Epoch 80:  24%|██▎       | 23/97 [00:04<00:14,  5.12it/s, loss=2.04, v_num=0]
Epoch 80:  24%|██▎       | 23/97 [00:04<00:14,  5.06it/s, loss=2.04, v_num=0]
Epoch 80:  25%|██▍       | 24/97 [00:04<00:14,  5.19it/s, loss=2.04, v_num=0]
Epoch 80:  25%|██▍       | 24/97 [00:04<00:14,  5.12it/s, loss=2.04, v_num=0]
Epoch 80:  26%|██▌       | 25/97 [00:04<00:13,  5.24it/s, loss=2.04, v_num=0]
Epoch 80:  26%|██▌       | 25/97 [00:04<00:13,  5.19it/s, loss=2.03, v_num=0]
Epoch 80:  27%|██▋       | 26/97 [00:04<00:13,  5.31it/s, loss=2.03, v_num=0]
Epoch 80:  27%|██▋       | 26/97 [00:04<00:13,  5.24it/s, loss=2.03, v_num=0]
Epoch 80:  28%|██▊       | 27/97 [00:05<00:13,  5.36it/s, loss=2.03, v_num=0]
Epoch 80:  28%|██▊       | 27/97 [00:05<00:13,  5.30it/s, loss=2.04, v_num=0]
Epoch 80:  29%|██▉       | 28/97 [00:05<00:12,  5.41it/s, loss=2.04, v_num=0]
Epoch 80:  29%|██▉       | 28/97 [00:05<00:12,  5.35it/s, loss=2.04, v_num=0]
Epoch 80:  30%|██▉       | 29/97 [00:05<00:12,  5.45it/s, loss=2.04, v_num=0]
Epoch 80:  30%|██▉       | 29/97 [00:05<00:12,  5.39it/s, loss=2.04, v_num=0]
Epoch 80:  31%|███       | 30/97 [00:05<00:12,  5.49it/s, loss=2.04, v_num=0]
Epoch 80:  31%|███       | 30/97 [00:05<00:12,  5.44it/s, loss=2.04, v_num=0]
Epoch 80:  32%|███▏      | 31/97 [00:05<00:11,  5.54it/s, loss=2.04, v_num=0]
Epoch 80:  32%|███▏      | 31/97 [00:05<00:12,  5.48it/s, loss=2.04, v_num=0]
Epoch 80:  33%|███▎      | 32/97 [00:05<00:11,  5.58it/s, loss=2.04, v_num=0]
Epoch 80:  33%|███▎      | 32/97 [00:05<00:11,  5.52it/s, loss=2.03, v_num=0]
Epoch 80:  34%|███▍      | 33/97 [00:05<00:11,  5.61it/s, loss=2.03, v_num=0]
Epoch 80:  34%|███▍      | 33/97 [00:05<00:11,  5.56it/s, loss=2.04, v_num=0]
Epoch 80:  35%|███▌      | 34/97 [00:06<00:11,  5.65it/s, loss=2.04, v_num=0]
Epoch 80:  35%|███▌      | 34/97 [00:06<00:11,  5.60it/s, loss=2.04, v_num=0]
Epoch 80:  36%|███▌      | 35/97 [00:06<00:10,  5.69it/s, loss=2.04, v_num=0]
Epoch 80:  36%|███▌      | 35/97 [00:06<00:11,  5.63it/s, loss=2.04, v_num=0]
Epoch 80:  37%|███▋      | 36/97 [00:06<00:10,  5.72it/s, loss=2.04, v_num=0]
Epoch 80:  37%|███▋      | 36/97 [00:06<00:10,  5.67it/s, loss=2.04, v_num=0]
Epoch 80:  38%|███▊      | 37/97 [00:06<00:10,  5.75it/s, loss=2.04, v_num=0]
Epoch 80:  38%|███▊      | 37/97 [00:06<00:10,  5.70it/s, loss=2.03, v_num=0]
Epoch 80:  39%|███▉      | 38/97 [00:06<00:10,  5.79it/s, loss=2.03, v_num=0]
Epoch 80:  39%|███▉      | 38/97 [00:06<00:10,  5.74it/s, loss=2.03, v_num=0]
Epoch 80:  40%|████      | 39/97 [00:06<00:09,  5.81it/s, loss=2.03, v_num=0]
Epoch 80:  40%|████      | 39/97 [00:06<00:10,  5.77it/s, loss=2.04, v_num=0]
Epoch 80:  41%|████      | 40/97 [00:06<00:09,  5.84it/s, loss=2.04, v_num=0]
Epoch 80:  41%|████      | 40/97 [00:06<00:09,  5.79it/s, loss=2.04, v_num=0]
Epoch 80:  42%|████▏     | 41/97 [00:06<00:09,  5.87it/s, loss=2.04, v_num=0]
Epoch 80:  42%|████▏     | 41/97 [00:07<00:09,  5.82it/s, loss=2.04, v_num=0]
Epoch 80:  43%|████▎     | 42/97 [00:07<00:09,  5.89it/s, loss=2.04, v_num=0]
Epoch 80:  43%|████▎     | 42/97 [00:07<00:09,  5.85it/s, loss=2.04, v_num=0]
Epoch 80:  44%|████▍     | 43/97 [00:07<00:09,  5.92it/s, loss=2.04, v_num=0]
Epoch 80:  44%|████▍     | 43/97 [00:07<00:09,  5.87it/s, loss=2.04, v_num=0]
Epoch 80:  45%|████▌     | 44/97 [00:07<00:08,  5.94it/s, loss=2.04, v_num=0]
Epoch 80:  45%|████▌     | 44/97 [00:07<00:08,  5.90it/s, loss=2.04, v_num=0]
Epoch 80:  46%|████▋     | 45/97 [00:07<00:08,  5.96it/s, loss=2.04, v_num=0]
Epoch 80:  46%|████▋     | 45/97 [00:07<00:08,  5.92it/s, loss=2.04, v_num=0]
Epoch 80:  47%|████▋     | 46/97 [00:07<00:08,  5.99it/s, loss=2.04, v_num=0]
Epoch 80:  47%|████▋     | 46/97 [00:07<00:08,  5.95it/s, loss=2.03, v_num=0]
Epoch 80:  48%|████▊     | 47/97 [00:07<00:08,  6.01it/s, loss=2.03, v_num=0]
Epoch 80:  48%|████▊     | 47/97 [00:07<00:08,  5.97it/s, loss=2.03, v_num=0]
Epoch 80:  49%|████▉     | 48/97 [00:07<00:08,  6.04it/s, loss=2.03, v_num=0]
Epoch 80:  49%|████▉     | 48/97 [00:08<00:08,  5.99it/s, loss=2.03, v_num=0]
Epoch 80:  51%|█████     | 49/97 [00:08<00:07,  6.06it/s, loss=2.03, v_num=0]
Epoch 80:  51%|█████     | 49/97 [00:08<00:07,  6.01it/s, loss=2.02, v_num=0]
Epoch 80:  52%|█████▏    | 50/97 [00:08<00:07,  6.08it/s, loss=2.02, v_num=0]
Epoch 80:  52%|█████▏    | 50/97 [00:08<00:07,  6.04it/s, loss=2.03, v_num=0]
Epoch 80:  53%|█████▎    | 51/97 [00:08<00:07,  6.10it/s, loss=2.03, v_num=0]
Epoch 80:  53%|█████▎    | 51/97 [00:08<00:07,  6.06it/s, loss=2.02, v_num=0]
Epoch 80:  54%|█████▎    | 52/97 [00:08<00:07,  6.11it/s, loss=2.02, v_num=0]
Epoch 80:  54%|█████▎    | 52/97 [00:08<00:07,  6.07it/s, loss=2.03, v_num=0]
Epoch 80:  55%|█████▍    | 53/97 [00:08<00:07,  6.13it/s, loss=2.03, v_num=0]
Epoch 80:  55%|█████▍    | 53/97 [00:08<00:07,  6.09it/s, loss=2.03, v_num=0]
Epoch 80:  56%|█████▌    | 54/97 [00:08<00:06,  6.14it/s, loss=2.03, v_num=0]
Epoch 80:  56%|█████▌    | 54/97 [00:08<00:07,  6.11it/s, loss=2.03, v_num=0]
Epoch 80:  57%|█████▋    | 55/97 [00:08<00:06,  6.16it/s, loss=2.03, v_num=0]
Epoch 80:  57%|█████▋    | 55/97 [00:08<00:06,  6.12it/s, loss=2.03, v_num=0]
Epoch 80:  58%|█████▊    | 56/97 [00:09<00:06,  6.18it/s, loss=2.03, v_num=0]
Epoch 80:  58%|█████▊    | 56/97 [00:09<00:06,  6.14it/s, loss=2.03, v_num=0]
Epoch 80:  59%|█████▉    | 57/97 [00:09<00:06,  6.19it/s, loss=2.03, v_num=0]
Epoch 80:  59%|█████▉    | 57/97 [00:09<00:06,  6.15it/s, loss=2.03, v_num=0]
Epoch 80:  60%|█████▉    | 58/97 [00:09<00:06,  6.21it/s, loss=2.03, v_num=0]
Epoch 80:  60%|█████▉    | 58/97 [00:09<00:06,  6.17it/s, loss=2.03, v_num=0]
Epoch 80:  61%|██████    | 59/97 [00:09<00:06,  6.22it/s, loss=2.03, v_num=0]
Epoch 80:  61%|██████    | 59/97 [00:09<00:06,  6.18it/s, loss=2.03, v_num=0]
Epoch 80:  62%|██████▏   | 60/97 [00:09<00:05,  6.23it/s, loss=2.03, v_num=0]
Epoch 80:  62%|██████▏   | 60/97 [00:09<00:05,  6.20it/s, loss=2.02, v_num=0]
Epoch 80:  63%|██████▎   | 61/97 [00:09<00:05,  6.25it/s, loss=2.02, v_num=0]
Epoch 80:  63%|██████▎   | 61/97 [00:09<00:05,  6.21it/s, loss=2.02, v_num=0]
Epoch 80:  64%|██████▍   | 62/97 [00:09<00:05,  6.26it/s, loss=2.02, v_num=0]
Epoch 80:  64%|██████▍   | 62/97 [00:09<00:05,  6.23it/s, loss=2.02, v_num=0]
Epoch 80:  65%|██████▍   | 63/97 [00:10<00:05,  6.27it/s, loss=2.02, v_num=0]
Epoch 80:  65%|██████▍   | 63/97 [00:10<00:05,  6.24it/s, loss=2.02, v_num=0]
Epoch 80:  66%|██████▌   | 64/97 [00:10<00:05,  6.28it/s, loss=2.02, v_num=0]
Epoch 80:  66%|██████▌   | 64/97 [00:10<00:05,  6.25it/s, loss=2.02, v_num=0]
Epoch 80:  67%|██████▋   | 65/97 [00:10<00:05,  6.30it/s, loss=2.02, v_num=0]
Epoch 80:  67%|██████▋   | 65/97 [00:10<00:05,  6.26it/s, loss=2.03, v_num=0]
Epoch 80:  68%|██████▊   | 66/97 [00:10<00:04,  6.31it/s, loss=2.03, v_num=0]
Epoch 80:  68%|██████▊   | 66/97 [00:10<00:04,  6.27it/s, loss=2.03, v_num=0]
Epoch 80:  69%|██████▉   | 67/97 [00:10<00:04,  6.32it/s, loss=2.03, v_num=0]
Epoch 80:  69%|██████▉   | 67/97 [00:10<00:04,  6.29it/s, loss=2.03, v_num=0]
Epoch 80:  70%|███████   | 68/97 [00:10<00:04,  6.33it/s, loss=2.03, v_num=0]
Epoch 80:  70%|███████   | 68/97 [00:10<00:04,  6.30it/s, loss=2.02, v_num=0]
Epoch 80:  71%|███████   | 69/97 [00:10<00:04,  6.35it/s, loss=2.02, v_num=0]
Epoch 80:  71%|███████   | 69/97 [00:10<00:04,  6.31it/s, loss=2.03, v_num=0]
Epoch 80:  72%|███████▏  | 70/97 [00:11<00:04,  6.36it/s, loss=2.03, v_num=0]
Epoch 80:  72%|███████▏  | 70/97 [00:11<00:04,  6.32it/s, loss=2.03, v_num=0]
Epoch 80:  73%|███████▎  | 71/97 [00:11<00:04,  6.36it/s, loss=2.03, v_num=0]
Epoch 80:  73%|███████▎  | 71/97 [00:11<00:04,  6.33it/s, loss=2.03, v_num=0]
Epoch 80:  74%|███████▍  | 72/97 [00:11<00:03,  6.38it/s, loss=2.03, v_num=0]
Epoch 80:  74%|███████▍  | 72/97 [00:11<00:03,  6.34it/s, loss=2.02, v_num=0]
Epoch 80:  75%|███████▌  | 73/97 [00:11<00:03,  6.38it/s, loss=2.02, v_num=0]
Epoch 80:  75%|███████▌  | 73/97 [00:11<00:03,  6.35it/s, loss=2.02, v_num=0]
Epoch 80:  76%|███████▋  | 74/97 [00:11<00:03,  6.39it/s, loss=2.02, v_num=0]
Epoch 80:  76%|███████▋  | 74/97 [00:11<00:03,  6.36it/s, loss=2.02, v_num=0]
Epoch 80:  77%|███████▋  | 75/97 [00:11<00:03,  6.40it/s, loss=2.02, v_num=0]
Epoch 80:  77%|███████▋  | 75/97 [00:11<00:03,  6.37it/s, loss=2.02, v_num=0]
Epoch 80:  78%|███████▊  | 76/97 [00:11<00:03,  6.41it/s, loss=2.02, v_num=0]
Epoch 80:  78%|███████▊  | 76/97 [00:11<00:03,  6.38it/s, loss=2.02, v_num=0]
Epoch 80:  79%|███████▉  | 77/97 [00:12<00:03,  6.42it/s, loss=2.02, v_num=0]
Epoch 80:  79%|███████▉  | 77/97 [00:12<00:03,  6.39it/s, loss=2.02, v_num=0]
Epoch 80:  80%|████████  | 78/97 [00:12<00:02,  6.42it/s, loss=2.02, v_num=0]
Epoch 80:  80%|████████  | 78/97 [00:12<00:02,  6.40it/s, loss=2.02, v_num=0]
Epoch 80:  81%|████████▏ | 79/97 [00:12<00:02,  6.43it/s, loss=2.02, v_num=0]
Epoch 80:  81%|████████▏ | 79/97 [00:12<00:02,  6.41it/s, loss=2.02, v_num=0]
Epoch 80:  82%|████████▏ | 80/97 [00:12<00:02,  6.44it/s, loss=2.02, v_num=0]
Epoch 80:  82%|████████▏ | 80/97 [00:12<00:02,  6.41it/s, loss=2.02, v_num=0]
Epoch 80:  84%|████████▎ | 81/97 [00:12<00:02,  6.45it/s, loss=2.02, v_num=0]
Epoch 80:  84%|████████▎ | 81/97 [00:12<00:02,  6.42it/s, loss=2.02, v_num=0]
Epoch 80:  85%|████████▍ | 82/97 [00:12<00:02,  6.46it/s, loss=2.02, v_num=0]
Epoch 80:  85%|████████▍ | 82/97 [00:12<00:02,  6.43it/s, loss=2.02, v_num=0]
Epoch 80:  86%|████████▌ | 83/97 [00:12<00:02,  6.47it/s, loss=2.02, v_num=0]
Epoch 80:  86%|████████▌ | 83/97 [00:12<00:02,  6.44it/s, loss=2.03, v_num=0]
Epoch 80:  87%|████████▋ | 84/97 [00:12<00:02,  6.47it/s, loss=2.03, v_num=0]
Epoch 80:  87%|████████▋ | 84/97 [00:13<00:02,  6.45it/s, loss=2.02, v_num=0]
Epoch 80:  88%|████████▊ | 85/97 [00:13<00:01,  6.48it/s, loss=2.02, v_num=0]
Epoch 80:  88%|████████▊ | 85/97 [00:13<00:01,  6.45it/s, loss=2.02, v_num=0]
Epoch 80:  89%|████████▊ | 86/97 [00:13<00:01,  6.49it/s, loss=2.02, v_num=0]
Epoch 80:  89%|████████▊ | 86/97 [00:13<00:01,  6.46it/s, loss=2.02, v_num=0]
Epoch 80:  90%|████████▉ | 87/97 [00:13<00:01,  6.50it/s, loss=2.02, v_num=0]
Epoch 80:  90%|████████▉ | 87/97 [00:13<00:01,  6.47it/s, loss=2.02, v_num=0]
Epoch 80:  91%|█████████ | 88/97 [00:13<00:01,  6.51it/s, loss=2.02, v_num=0]
Epoch 80:  91%|█████████ | 88/97 [00:13<00:01,  6.48it/s, loss=2.02, v_num=0]
Epoch 80:  92%|█████████▏| 89/97 [00:13<00:01,  6.51it/s, loss=2.02, v_num=0]
Epoch 80:  92%|█████████▏| 89/97 [00:13<00:01,  6.49it/s, loss=2.01, v_num=0]
Epoch 80:  93%|█████████▎| 90/97 [00:13<00:01,  6.52it/s, loss=2.01, v_num=0]
Epoch 80:  93%|█████████▎| 90/97 [00:13<00:01,  6.49it/s, loss=2.02, v_num=0]
Epoch 80:  94%|█████████▍| 91/97 [00:13<00:00,  6.53it/s, loss=2.02, v_num=0]
Epoch 80:  94%|█████████▍| 91/97 [00:14<00:00,  6.50it/s, loss=2.03, v_num=0]
Epoch 80:  95%|█████████▍| 92/97 [00:14<00:00,  6.53it/s, loss=2.03, v_num=0]
Epoch 80:  95%|█████████▍| 92/97 [00:14<00:00,  6.50it/s, loss=2.03, v_num=0]
Epoch 80:  96%|█████████▌| 93/97 [00:14<00:00,  6.54it/s, loss=2.03, v_num=0]
Epoch 80:  96%|█████████▌| 93/97 [00:14<00:00,  6.51it/s, loss=2.03, v_num=0]
Epoch 80:  97%|█████████▋| 94/97 [00:14<00:00,  6.54it/s, loss=2.03, v_num=0]
Epoch 80:  97%|█████████▋| 94/97 [00:14<00:00,  6.52it/s, loss=2.03, v_num=0]
Epoch 80:  98%|█████████▊| 95/97 [00:14<00:00,  6.55it/s, loss=2.03, v_num=0]
Epoch 80:  98%|█████████▊| 95/97 [00:14<00:00,  6.52it/s, loss=2.02, v_num=0]
Epoch 80:  99%|█████████▉| 96/97 [00:14<00:00,  6.56it/s, loss=2.02, v_num=0]
Epoch 80:  99%|█████████▉| 96/97 [00:14<00:00,  6.53it/s, loss=2.02, v_num=0]
Epoch 80: 100%|██████████| 97/97 [00:14<00:00,  6.56it/s, loss=2.02, v_num=0]
Epoch 80: 100%|██████████| 97/97 [00:14<00:00,  6.54it/s, loss=2.02, v_num=0]
Epoch 80: 100%|██████████| 97/97 [00:14<00:00,  6.54it/s, loss=2.02, v_num=0]
Epoch 80:   0%|          | 0/97 [00:00<?, ?it/s, loss=2.02, v_num=0]
Epoch 81:   0%|          | 0/97 [00:00<?, ?it/s, loss=2.02, v_num=0]
Epoch 81:   1%|          | 1/97 [00:01<02:16,  1.43s/it, loss=2.02, v_num=0]
Epoch 81:   1%|          | 1/97 [00:01<02:22,  1.48s/it, loss=2.03, v_num=0]
Epoch 81:   2%|▏         | 2/97 [00:01<01:14,  1.27it/s, loss=2.03, v_num=0]
Epoch 81:   2%|▏         | 2/97 [00:01<01:17,  1.23it/s, loss=2.04, v_num=0]
Epoch 81:   3%|▎         | 3/97 [00:01<00:54,  1.74it/s, loss=2.04, v_num=0]
Epoch 81:   3%|▎         | 3/97 [00:01<00:55,  1.69it/s, loss=2.04, v_num=0]
Epoch 81:   4%|▍         | 4/97 [00:01<00:43,  2.15it/s, loss=2.04, v_num=0]
Epoch 81:   4%|▍         | 4/97 [00:01<00:44,  2.08it/s, loss=2.03, v_num=0]
Epoch 81:   5%|▌         | 5/97 [00:02<00:36,  2.49it/s, loss=2.03, v_num=0]
Epoch 81:   5%|▌         | 5/97 [00:02<00:37,  2.43it/s, loss=2.03, v_num=0]
Epoch 81:   6%|▌         | 6/97 [00:02<00:32,  2.79it/s, loss=2.03, v_num=0]
Epoch 81:   6%|▌         | 6/97 [00:02<00:33,  2.72it/s, loss=2.03, v_num=0]
Epoch 81:   7%|▋         | 7/97 [00:02<00:29,  3.05it/s, loss=2.03, v_num=0]
Epoch 81:   7%|▋         | 7/97 [00:02<00:30,  2.98it/s, loss=2.04, v_num=0]
Epoch 81:   8%|▊         | 8/97 [00:02<00:27,  3.29it/s, loss=2.04, v_num=0]
Epoch 81:   8%|▊         | 8/97 [00:02<00:27,  3.22it/s, loss=2.04, v_num=0]
Epoch 81:   9%|▉         | 9/97 [00:02<00:25,  3.49it/s, loss=2.04, v_num=0]
Epoch 81:   9%|▉         | 9/97 [00:02<00:25,  3.42it/s, loss=2.04, v_num=0]
Epoch 81:  10%|█         | 10/97 [00:02<00:23,  3.67it/s, loss=2.04, v_num=0]
Epoch 81:  10%|█         | 10/97 [00:02<00:24,  3.60it/s, loss=2.04, v_num=0]
Epoch 81:  11%|█▏        | 11/97 [00:02<00:22,  3.84it/s, loss=2.04, v_num=0]
Epoch 81:  11%|█▏        | 11/97 [00:02<00:22,  3.77it/s, loss=2.04, v_num=0]
Epoch 81:  12%|█▏        | 12/97 [00:03<00:21,  4.00it/s, loss=2.04, v_num=0]
Epoch 81:  12%|█▏        | 12/97 [00:03<00:21,  3.93it/s, loss=2.05, v_num=0]
Epoch 81:  13%|█▎        | 13/97 [00:03<00:20,  4.13it/s, loss=2.05, v_num=0]
Epoch 81:  13%|█▎        | 13/97 [00:03<00:20,  4.06it/s, loss=2.05, v_num=0]
Epoch 81:  14%|█▍        | 14/97 [00:03<00:19,  4.26it/s, loss=2.05, v_num=0]
Epoch 81:  14%|█▍        | 14/97 [00:03<00:19,  4.19it/s, loss=2.04, v_num=0]
Epoch 81:  15%|█▌        | 15/97 [00:03<00:18,  4.39it/s, loss=2.04, v_num=0]
Epoch 81:  15%|█▌        | 15/97 [00:03<00:18,  4.32it/s, loss=2.05, v_num=0]
Epoch 81:  16%|█▋        | 16/97 [00:03<00:17,  4.50it/s, loss=2.05, v_num=0]
Epoch 81:  16%|█▋        | 16/97 [00:03<00:18,  4.43it/s, loss=2.05, v_num=0]
Epoch 81:  18%|█▊        | 17/97 [00:03<00:17,  4.60it/s, loss=2.05, v_num=0]
Epoch 81:  18%|█▊        | 17/97 [00:03<00:17,  4.53it/s, loss=2.05, v_num=0]
Epoch 81:  19%|█▊        | 18/97 [00:03<00:16,  4.70it/s, loss=2.05, v_num=0]
Epoch 81:  19%|█▊        | 18/97 [00:03<00:17,  4.63it/s, loss=2.05, v_num=0]
Epoch 81:  20%|█▉        | 19/97 [00:03<00:16,  4.79it/s, loss=2.05, v_num=0]
Epoch 81:  20%|█▉        | 19/97 [00:04<00:16,  4.72it/s, loss=2.05, v_num=0]
Epoch 81:  21%|██        | 20/97 [00:04<00:15,  4.87it/s, loss=2.05, v_num=0]
Epoch 81:  21%|██        | 20/97 [00:04<00:16,  4.80it/s, loss=2.04, v_num=0]
Epoch 81:  22%|██▏       | 21/97 [00:04<00:15,  4.94it/s, loss=2.04, v_num=0]
Epoch 81:  22%|██▏       | 21/97 [00:04<00:15,  4.88it/s, loss=2.04, v_num=0]
Epoch 81:  23%|██▎       | 22/97 [00:04<00:14,  5.01it/s, loss=2.04, v_num=0]
Epoch 81:  23%|██▎       | 22/97 [00:04<00:15,  4.95it/s, loss=2.03, v_num=0]
Epoch 81:  24%|██▎       | 23/97 [00:04<00:14,  5.08it/s, loss=2.03, v_num=0]
Epoch 81:  24%|██▎       | 23/97 [00:04<00:14,  5.02it/s, loss=2.03, v_num=0]
Epoch 81:  25%|██▍       | 24/97 [00:04<00:14,  5.15it/s, loss=2.03, v_num=0]
Epoch 81:  25%|██▍       | 24/97 [00:04<00:14,  5.08it/s, loss=2.04, v_num=0]
Epoch 81:  26%|██▌       | 25/97 [00:04<00:13,  5.20it/s, loss=2.04, v_num=0]
Epoch 81:  26%|██▌       | 25/97 [00:04<00:14,  5.14it/s, loss=2.04, v_num=0]
Epoch 81:  27%|██▋       | 26/97 [00:04<00:13,  5.26it/s, loss=2.04, v_num=0]
Epoch 81:  27%|██▋       | 26/97 [00:04<00:13,  5.20it/s, loss=2.04, v_num=0]
Epoch 81:  28%|██▊       | 27/97 [00:05<00:13,  5.31it/s, loss=2.04, v_num=0]
Epoch 81:  28%|██▊       | 27/97 [00:05<00:13,  5.25it/s, loss=2.03, v_num=0]
Epoch 81:  29%|██▉       | 28/97 [00:05<00:12,  5.36it/s, loss=2.03, v_num=0]
Epoch 81:  29%|██▉       | 28/97 [00:05<00:13,  5.31it/s, loss=2.03, v_num=0]
Epoch 81:  30%|██▉       | 29/97 [00:05<00:12,  5.41it/s, loss=2.03, v_num=0]
Epoch 81:  30%|██▉       | 29/97 [00:05<00:12,  5.36it/s, loss=2.02, v_num=0]
Epoch 81:  31%|███       | 30/97 [00:05<00:12,  5.46it/s, loss=2.02, v_num=0]
Epoch 81:  31%|███       | 30/97 [00:05<00:12,  5.40it/s, loss=2.02, v_num=0]
Epoch 81:  32%|███▏      | 31/97 [00:05<00:12,  5.50it/s, loss=2.02, v_num=0]
Epoch 81:  32%|███▏      | 31/97 [00:05<00:12,  5.44it/s, loss=2.02, v_num=0]
Epoch 81:  33%|███▎      | 32/97 [00:05<00:11,  5.54it/s, loss=2.02, v_num=0]
Epoch 81:  33%|███▎      | 32/97 [00:05<00:11,  5.49it/s, loss=2.02, v_num=0]
Epoch 81:  34%|███▍      | 33/97 [00:05<00:11,  5.58it/s, loss=2.02, v_num=0]
Epoch 81:  34%|███▍      | 33/97 [00:05<00:11,  5.53it/s, loss=2.02, v_num=0]
Epoch 81:  35%|███▌      | 34/97 [00:06<00:11,  5.62it/s, loss=2.02, v_num=0]
Epoch 81:  35%|███▌      | 34/97 [00:06<00:11,  5.57it/s, loss=2.02, v_num=0]
Epoch 81:  36%|███▌      | 35/97 [00:06<00:10,  5.65it/s, loss=2.02, v_num=0]
Epoch 81:  36%|███▌      | 35/97 [00:06<00:11,  5.60it/s, loss=2.02, v_num=0]
Epoch 81:  37%|███▋      | 36/97 [00:06<00:10,  5.69it/s, loss=2.02, v_num=0]
Epoch 81:  37%|███▋      | 36/97 [00:06<00:10,  5.64it/s, loss=2.02, v_num=0]
Epoch 81:  38%|███▊      | 37/97 [00:06<00:10,  5.72it/s, loss=2.02, v_num=0]
Epoch 81:  38%|███▊      | 37/97 [00:06<00:10,  5.67it/s, loss=2.01, v_num=0]
Epoch 81:  39%|███▉      | 38/97 [00:06<00:10,  5.76it/s, loss=2.01, v_num=0]
Epoch 81:  39%|███▉      | 38/97 [00:06<00:10,  5.71it/s, loss=2.02, v_num=0]
Epoch 81:  40%|████      | 39/97 [00:06<00:10,  5.79it/s, loss=2.02, v_num=0]
Epoch 81:  40%|████      | 39/97 [00:06<00:10,  5.74it/s, loss=2.02, v_num=0]
Epoch 81:  41%|████      | 40/97 [00:06<00:09,  5.82it/s, loss=2.02, v_num=0]
Epoch 81:  41%|████      | 40/97 [00:06<00:09,  5.77it/s, loss=2.03, v_num=0]
Epoch 81:  42%|████▏     | 41/97 [00:07<00:09,  5.84it/s, loss=2.03, v_num=0]
Epoch 81:  42%|████▏     | 41/97 [00:07<00:09,  5.79it/s, loss=2.03, v_num=0]
Epoch 81:  43%|████▎     | 42/97 [00:07<00:09,  5.86it/s, loss=2.03, v_num=0]
Epoch 81:  43%|████▎     | 42/97 [00:07<00:09,  5.82it/s, loss=2.03, v_num=0]
Epoch 81:  44%|████▍     | 43/97 [00:07<00:09,  5.89it/s, loss=2.03, v_num=0]
Epoch 81:  44%|████▍     | 43/97 [00:07<00:09,  5.84it/s, loss=2.03, v_num=0]
Epoch 81:  45%|████▌     | 44/97 [00:07<00:08,  5.91it/s, loss=2.03, v_num=0]
Epoch 81:  45%|████▌     | 44/97 [00:07<00:09,  5.86it/s, loss=2.02, v_num=0]
Epoch 81:  46%|████▋     | 45/97 [00:07<00:08,  5.93it/s, loss=2.02, v_num=0]
Epoch 81:  46%|████▋     | 45/97 [00:07<00:08,  5.88it/s, loss=2.01, v_num=0]
Epoch 81:  47%|████▋     | 46/97 [00:07<00:08,  5.95it/s, loss=2.01, v_num=0]
Epoch 81:  47%|████▋     | 46/97 [00:07<00:08,  5.91it/s, loss=2.01, v_num=0]
Epoch 81:  48%|████▊     | 47/97 [00:07<00:08,  5.97it/s, loss=2.01, v_num=0]
Epoch 81:  48%|████▊     | 47/97 [00:07<00:08,  5.93it/s, loss=2.01, v_num=0]
Epoch 81:  49%|████▉     | 48/97 [00:08<00:08,  5.99it/s, loss=2.01, v_num=0]
Epoch 81:  49%|████▉     | 48/97 [00:08<00:08,  5.95it/s, loss=2.02, v_num=0]
Epoch 81:  51%|█████     | 49/97 [00:08<00:07,  6.01it/s, loss=2.02, v_num=0]
Epoch 81:  51%|█████     | 49/97 [00:08<00:08,  5.97it/s, loss=2.02, v_num=0]
Epoch 81:  52%|█████▏    | 50/97 [00:08<00:07,  6.03it/s, loss=2.02, v_num=0]
Epoch 81:  52%|█████▏    | 50/97 [00:08<00:07,  5.99it/s, loss=2.02, v_num=0]
Epoch 81:  53%|█████▎    | 51/97 [00:08<00:07,  6.05it/s, loss=2.02, v_num=0]
Epoch 81:  53%|█████▎    | 51/97 [00:08<00:07,  6.01it/s, loss=2.03, v_num=0]
Epoch 81:  54%|█████▎    | 52/97 [00:08<00:07,  6.07it/s, loss=2.03, v_num=0]
Epoch 81:  54%|█████▎    | 52/97 [00:08<00:07,  6.03it/s, loss=2.03, v_num=0]
Epoch 81:  55%|█████▍    | 53/97 [00:08<00:07,  6.08it/s, loss=2.03, v_num=0]
Epoch 81:  55%|█████▍    | 53/97 [00:08<00:07,  6.04it/s, loss=2.03, v_num=0]
Epoch 81:  56%|█████▌    | 54/97 [00:08<00:07,  6.09it/s, loss=2.03, v_num=0]
Epoch 81:  56%|█████▌    | 54/97 [00:08<00:07,  6.06it/s, loss=2.03, v_num=0]
Epoch 81:  57%|█████▋    | 55/97 [00:09<00:06,  6.11it/s, loss=2.03, v_num=0]
Epoch 81:  57%|█████▋    | 55/97 [00:09<00:06,  6.07it/s, loss=2.02, v_num=0]
Epoch 81:  58%|█████▊    | 56/97 [00:09<00:06,  6.12it/s, loss=2.02, v_num=0]
Epoch 81:  58%|█████▊    | 56/97 [00:09<00:06,  6.08it/s, loss=2.03, v_num=0]
Epoch 81:  59%|█████▉    | 57/97 [00:09<00:06,  6.13it/s, loss=2.03, v_num=0]
Epoch 81:  59%|█████▉    | 57/97 [00:09<00:06,  6.09it/s, loss=2.03, v_num=0]
Epoch 81:  60%|█████▉    | 58/97 [00:09<00:06,  6.13it/s, loss=2.03, v_num=0]
Epoch 81:  60%|█████▉    | 58/97 [00:09<00:06,  6.10it/s, loss=2.02, v_num=0]
Epoch 81:  61%|██████    | 59/97 [00:09<00:06,  6.15it/s, loss=2.02, v_num=0]
Epoch 81:  61%|██████    | 59/97 [00:09<00:06,  6.11it/s, loss=2.02, v_num=0]
Epoch 81:  62%|██████▏   | 60/97 [00:09<00:06,  6.16it/s, loss=2.02, v_num=0]
Epoch 81:  62%|██████▏   | 60/97 [00:09<00:06,  6.13it/s, loss=2.02, v_num=0]
Epoch 81:  63%|██████▎   | 61/97 [00:09<00:05,  6.17it/s, loss=2.02, v_num=0]
Epoch 81:  63%|██████▎   | 61/97 [00:09<00:05,  6.13it/s, loss=2.02, v_num=0]
Epoch 81:  64%|██████▍   | 62/97 [00:10<00:05,  6.17it/s, loss=2.02, v_num=0]
Epoch 81:  64%|██████▍   | 62/97 [00:10<00:05,  6.14it/s, loss=2.02, v_num=0]
Epoch 81:  65%|██████▍   | 63/97 [00:10<00:05,  6.19it/s, loss=2.02, v_num=0]
Epoch 81:  65%|██████▍   | 63/97 [00:10<00:05,  6.15it/s, loss=2.02, v_num=0]
Epoch 81:  66%|██████▌   | 64/97 [00:10<00:05,  6.20it/s, loss=2.02, v_num=0]
Epoch 81:  66%|██████▌   | 64/97 [00:10<00:05,  6.16it/s, loss=2.02, v_num=0]
Epoch 81:  67%|██████▋   | 65/97 [00:10<00:05,  6.21it/s, loss=2.02, v_num=0]
Epoch 81:  67%|██████▋   | 65/97 [00:10<00:05,  6.18it/s, loss=2.02, v_num=0]
Epoch 81:  68%|██████▊   | 66/97 [00:10<00:04,  6.22it/s, loss=2.02, v_num=0]
Epoch 81:  68%|██████▊   | 66/97 [00:10<00:05,  6.19it/s, loss=2.03, v_num=0]
Epoch 81:  69%|██████▉   | 67/97 [00:10<00:04,  6.23it/s, loss=2.03, v_num=0]
Epoch 81:  69%|██████▉   | 67/97 [00:10<00:04,  6.20it/s, loss=2.03, v_num=0]
Epoch 81:  70%|███████   | 68/97 [00:10<00:04,  6.24it/s, loss=2.03, v_num=0]
Epoch 81:  70%|███████   | 68/97 [00:10<00:04,  6.21it/s, loss=2.03, v_num=0]
Epoch 81:  71%|███████   | 69/97 [00:11<00:04,  6.26it/s, loss=2.03, v_num=0]
Epoch 81:  71%|███████   | 69/97 [00:11<00:04,  6.22it/s, loss=2.03, v_num=0]
Epoch 81:  72%|███████▏  | 70/97 [00:11<00:04,  6.27it/s, loss=2.03, v_num=0]
Epoch 81:  72%|███████▏  | 70/97 [00:11<00:04,  6.23it/s, loss=2.03, v_num=0]
Epoch 81:  73%|███████▎  | 71/97 [00:11<00:04,  6.28it/s, loss=2.03, v_num=0]
Epoch 81:  73%|███████▎  | 71/97 [00:11<00:04,  6.25it/s, loss=2.02, v_num=0]
Epoch 81:  74%|███████▍  | 72/97 [00:11<00:03,  6.29it/s, loss=2.02, v_num=0]
Epoch 81:  74%|███████▍  | 72/97 [00:11<00:03,  6.26it/s, loss=2.03, v_num=0]
Epoch 81:  75%|███████▌  | 73/97 [00:11<00:03,  6.30it/s, loss=2.03, v_num=0]
Epoch 81:  75%|███████▌  | 73/97 [00:11<00:03,  6.27it/s, loss=2.03, v_num=0]
Epoch 81:  76%|███████▋  | 74/97 [00:11<00:03,  6.31it/s, loss=2.03, v_num=0]
Epoch 81:  76%|███████▋  | 74/97 [00:11<00:03,  6.28it/s, loss=2.04, v_num=0]
Epoch 81:  77%|███████▋  | 75/97 [00:11<00:03,  6.32it/s, loss=2.04, v_num=0]
Epoch 81:  77%|███████▋  | 75/97 [00:11<00:03,  6.29it/s, loss=2.04, v_num=0]
Epoch 81:  78%|███████▊  | 76/97 [00:12<00:03,  6.33it/s, loss=2.04, v_num=0]
Epoch 81:  78%|███████▊  | 76/97 [00:12<00:03,  6.30it/s, loss=2.03, v_num=0]
Epoch 81:  79%|███████▉  | 77/97 [00:12<00:03,  6.34it/s, loss=2.03, v_num=0]
Epoch 81:  79%|███████▉  | 77/97 [00:12<00:03,  6.31it/s, loss=2.02, v_num=0]
Epoch 81:  80%|████████  | 78/97 [00:12<00:02,  6.35it/s, loss=2.02, v_num=0]
Epoch 81:  80%|████████  | 78/97 [00:12<00:03,  6.32it/s, loss=2.03, v_num=0]
Epoch 81:  81%|████████▏ | 79/97 [00:12<00:02,  6.36it/s, loss=2.03, v_num=0]
Epoch 81:  81%|████████▏ | 79/97 [00:12<00:02,  6.33it/s, loss=2.04, v_num=0]
Epoch 81:  82%|████████▏ | 80/97 [00:12<00:02,  6.36it/s, loss=2.04, v_num=0]
Epoch 81:  82%|████████▏ | 80/97 [00:12<00:02,  6.34it/s, loss=2.03, v_num=0]
Epoch 81:  84%|████████▎ | 81/97 [00:12<00:02,  6.37it/s, loss=2.03, v_num=0]
Epoch 81:  84%|████████▎ | 81/97 [00:12<00:02,  6.34it/s, loss=2.03, v_num=0]
Epoch 81:  85%|████████▍ | 82/97 [00:12<00:02,  6.38it/s, loss=2.03, v_num=0]
Epoch 81:  85%|████████▍ | 82/97 [00:12<00:02,  6.35it/s, loss=2.04, v_num=0]
Epoch 81:  86%|████████▌ | 83/97 [00:13<00:02,  6.38it/s, loss=2.04, v_num=0]
Epoch 81:  86%|████████▌ | 83/97 [00:13<00:02,  6.36it/s, loss=2.04, v_num=0]
Epoch 81:  87%|████████▋ | 84/97 [00:13<00:02,  6.39it/s, loss=2.04, v_num=0]
Epoch 81:  87%|████████▋ | 84/97 [00:13<00:02,  6.36it/s, loss=2.03, v_num=0]
Epoch 81:  88%|████████▊ | 85/97 [00:13<00:01,  6.40it/s, loss=2.03, v_num=0]
Epoch 81:  88%|████████▊ | 85/97 [00:13<00:01,  6.37it/s, loss=2.03, v_num=0]
Epoch 81:  89%|████████▊ | 86/97 [00:13<00:01,  6.40it/s, loss=2.03, v_num=0]
Epoch 81:  89%|████████▊ | 86/97 [00:13<00:01,  6.38it/s, loss=2.03, v_num=0]
Epoch 81:  90%|████████▉ | 87/97 [00:13<00:01,  6.41it/s, loss=2.03, v_num=0]
Epoch 81:  90%|████████▉ | 87/97 [00:13<00:01,  6.38it/s, loss=2.03, v_num=0]
Epoch 81:  91%|█████████ | 88/97 [00:13<00:01,  6.41it/s, loss=2.03, v_num=0]
Epoch 81:  91%|█████████ | 88/97 [00:13<00:01,  6.39it/s, loss=2.03, v_num=0]
Epoch 81:  92%|█████████▏| 89/97 [00:13<00:01,  6.42it/s, loss=2.03, v_num=0]
Epoch 81:  92%|█████████▏| 89/97 [00:13<00:01,  6.40it/s, loss=2.02, v_num=0]
Epoch 81:  93%|█████████▎| 90/97 [00:13<00:01,  6.43it/s, loss=2.02, v_num=0]
Epoch 81:  93%|█████████▎| 90/97 [00:14<00:01,  6.40it/s, loss=2.02, v_num=0]
Epoch 81:  94%|█████████▍| 91/97 [00:14<00:00,  6.44it/s, loss=2.02, v_num=0]
Epoch 81:  94%|█████████▍| 91/97 [00:14<00:00,  6.41it/s, loss=2.02, v_num=0]
Epoch 81:  95%|█████████▍| 92/97 [00:14<00:00,  6.45it/s, loss=2.02, v_num=0]
Epoch 81:  95%|█████████▍| 92/97 [00:14<00:00,  6.42it/s, loss=2.01, v_num=0]
Epoch 81:  96%|█████████▌| 93/97 [00:14<00:00,  6.46it/s, loss=2.01, v_num=0]
Epoch 81:  96%|█████████▌| 93/97 [00:14<00:00,  6.43it/s, loss=2.01, v_num=0]
Epoch 81:  97%|█████████▋| 94/97 [00:14<00:00,  6.46it/s, loss=2.01, v_num=0]
Epoch 81:  97%|█████████▋| 94/97 [00:14<00:00,  6.44it/s, loss=2, v_num=0]
Epoch 81:  98%|█████████▊| 95/97 [00:14<00:00,  6.47it/s, loss=2, v_num=0]
Epoch 81:  98%|█████████▊| 95/97 [00:14<00:00,  6.44it/s, loss=2, v_num=0]
Epoch 81:  99%|█████████▉| 96/97 [00:14<00:00,  6.48it/s, loss=2, v_num=0]
Epoch 81:  99%|█████████▉| 96/97 [00:14<00:00,  6.45it/s, loss=2, v_num=0]
Epoch 81: 100%|██████████| 97/97 [00:14<00:00,  6.48it/s, loss=2, v_num=0]
Epoch 81: 100%|██████████| 97/97 [00:15<00:00,  6.46it/s, loss=2, v_num=0]
Epoch 81: 100%|██████████| 97/97 [00:15<00:00,  6.46it/s, loss=2, v_num=0]
Epoch 81:   0%|          | 0/97 [00:00<?, ?it/s, loss=2, v_num=0]
Epoch 82:   0%|          | 0/97 [00:00<?, ?it/s, loss=2, v_num=0]
Epoch 82:   1%|          | 1/97 [00:01<02:29,  1.56s/it, loss=2, v_num=0]
Epoch 82:   1%|          | 1/97 [00:01<02:35,  1.62s/it, loss=1.99, v_num=0]
Epoch 82:   2%|▏         | 2/97 [00:01<01:20,  1.18it/s, loss=1.99, v_num=0]
Epoch 82:   2%|▏         | 2/97 [00:01<01:23,  1.14it/s, loss=1.99, v_num=0]
Epoch 82:   3%|▎         | 3/97 [00:01<00:57,  1.63it/s, loss=1.99, v_num=0]
Epoch 82:   3%|▎         | 3/97 [00:01<00:59,  1.58it/s, loss=2, v_num=0]
Epoch 82:   4%|▍         | 4/97 [00:02<00:47,  1.97it/s, loss=2, v_num=0]
Epoch 82:   4%|▍         | 4/97 [00:02<00:48,  1.91it/s, loss=2, v_num=0]
Epoch 82:   5%|▌         | 5/97 [00:02<00:40,  2.30it/s, loss=2, v_num=0]
Epoch 82:   5%|▌         | 5/97 [00:02<00:41,  2.24it/s, loss=2, v_num=0]
Epoch 82:   6%|▌         | 6/97 [00:02<00:35,  2.60it/s, loss=2, v_num=0]
Epoch 82:   6%|▌         | 6/97 [00:02<00:35,  2.53it/s, loss=2, v_num=0]
Epoch 82:   7%|▋         | 7/97 [00:02<00:31,  2.85it/s, loss=2, v_num=0]
Epoch 82:   7%|▋         | 7/97 [00:02<00:32,  2.79it/s, loss=2, v_num=0]
Epoch 82:   8%|▊         | 8/97 [00:02<00:28,  3.08it/s, loss=2, v_num=0]
Epoch 82:   8%|▊         | 8/97 [00:02<00:29,  3.02it/s, loss=2, v_num=0]
Epoch 82:   9%|▉         | 9/97 [00:02<00:27,  3.25it/s, loss=2, v_num=0]
Epoch 82:   9%|▉         | 9/97 [00:02<00:27,  3.18it/s, loss=2, v_num=0]
Epoch 82:  10%|█         | 10/97 [00:02<00:25,  3.43it/s, loss=2, v_num=0]
Epoch 82:  10%|█         | 10/97 [00:02<00:25,  3.37it/s, loss=2, v_num=0]
Epoch 82:  11%|█▏        | 11/97 [00:03<00:23,  3.61it/s, loss=2, v_num=0]
Epoch 82:  11%|█▏        | 11/97 [00:03<00:24,  3.54it/s, loss=2.01, v_num=0]
Epoch 82:  12%|█▏        | 12/97 [00:03<00:22,  3.76it/s, loss=2.01, v_num=0]
Epoch 82:  12%|█▏        | 12/97 [00:03<00:23,  3.69it/s, loss=2.01, v_num=0]
Epoch 82:  13%|█▎        | 13/97 [00:03<00:21,  3.90it/s, loss=2.01, v_num=0]
Epoch 82:  13%|█▎        | 13/97 [00:03<00:21,  3.84it/s, loss=2.01, v_num=0]
Epoch 82:  14%|█▍        | 14/97 [00:03<00:20,  4.03it/s, loss=2.01, v_num=0]
Epoch 82:  14%|█▍        | 14/97 [00:03<00:20,  3.97it/s, loss=2.01, v_num=0]
Epoch 82:  15%|█▌        | 15/97 [00:03<00:19,  4.15it/s, loss=2.01, v_num=0]
Epoch 82:  15%|█▌        | 15/97 [00:03<00:20,  4.09it/s, loss=2.02, v_num=0]
Epoch 82:  16%|█▋        | 16/97 [00:03<00:18,  4.27it/s, loss=2.02, v_num=0]
Epoch 82:  16%|█▋        | 16/97 [00:03<00:19,  4.21it/s, loss=2.02, v_num=0]
Epoch 82:  18%|█▊        | 17/97 [00:03<00:18,  4.37it/s, loss=2.02, v_num=0]
Epoch 82:  18%|█▊        | 17/97 [00:03<00:18,  4.31it/s, loss=2.02, v_num=0]
Epoch 82:  19%|█▊        | 18/97 [00:04<00:17,  4.47it/s, loss=2.02, v_num=0]
Epoch 82:  19%|█▊        | 18/97 [00:04<00:17,  4.41it/s, loss=2.02, v_num=0]
Epoch 82:  20%|█▉        | 19/97 [00:04<00:17,  4.57it/s, loss=2.02, v_num=0]
Epoch 82:  20%|█▉        | 19/97 [00:04<00:17,  4.50it/s, loss=2.03, v_num=0]
Epoch 82:  21%|██        | 20/97 [00:04<00:16,  4.65it/s, loss=2.03, v_num=0]
Epoch 82:  21%|██        | 20/97 [00:04<00:16,  4.59it/s, loss=2.02, v_num=0]
Epoch 82:  22%|██▏       | 21/97 [00:04<00:16,  4.73it/s, loss=2.02, v_num=0]
Epoch 82:  22%|██▏       | 21/97 [00:04<00:16,  4.67it/s, loss=2.03, v_num=0]
Epoch 82:  23%|██▎       | 22/97 [00:04<00:15,  4.81it/s, loss=2.03, v_num=0]
Epoch 82:  23%|██▎       | 22/97 [00:04<00:15,  4.75it/s, loss=2.02, v_num=0]
Epoch 82:  24%|██▎       | 23/97 [00:04<00:15,  4.87it/s, loss=2.02, v_num=0]
Epoch 82:  24%|██▎       | 23/97 [00:04<00:15,  4.81it/s, loss=2.02, v_num=0]
Epoch 82:  25%|██▍       | 24/97 [00:04<00:14,  4.94it/s, loss=2.02, v_num=0]
Epoch 82:  25%|██▍       | 24/97 [00:04<00:14,  4.88it/s, loss=2.01, v_num=0]
Epoch 82:  26%|██▌       | 25/97 [00:05<00:14,  5.00it/s, loss=2.01, v_num=0]
Epoch 82:  26%|██▌       | 25/97 [00:05<00:14,  4.94it/s, loss=2.01, v_num=0]
Epoch 82:  27%|██▋       | 26/97 [00:05<00:14,  5.05it/s, loss=2.01, v_num=0]
Epoch 82:  27%|██▋       | 26/97 [00:05<00:14,  5.00it/s, loss=2.01, v_num=0]
Epoch 82:  28%|██▊       | 27/97 [00:05<00:13,  5.11it/s, loss=2.01, v_num=0]
Epoch 82:  28%|██▊       | 27/97 [00:05<00:13,  5.05it/s, loss=2.02, v_num=0]
Epoch 82:  29%|██▉       | 28/97 [00:05<00:13,  5.16it/s, loss=2.02, v_num=0]
Epoch 82:  29%|██▉       | 28/97 [00:05<00:13,  5.11it/s, loss=2.03, v_num=0]
Epoch 82:  30%|██▉       | 29/97 [00:05<00:13,  5.21it/s, loss=2.03, v_num=0]
Epoch 82:  30%|██▉       | 29/97 [00:05<00:13,  5.15it/s, loss=2.02, v_num=0]
Epoch 82:  31%|███       | 30/97 [00:05<00:12,  5.26it/s, loss=2.02, v_num=0]
Epoch 82:  31%|███       | 30/97 [00:05<00:12,  5.21it/s, loss=2.02, v_num=0]
Epoch 82:  32%|███▏      | 31/97 [00:05<00:12,  5.30it/s, loss=2.02, v_num=0]
Epoch 82:  32%|███▏      | 31/97 [00:05<00:12,  5.25it/s, loss=2.01, v_num=0]
Epoch 82:  33%|███▎      | 32/97 [00:05<00:12,  5.35it/s, loss=2.01, v_num=0]
Epoch 82:  33%|███▎      | 32/97 [00:06<00:12,  5.30it/s, loss=2.01, v_num=0]
Epoch 82:  34%|███▍      | 33/97 [00:06<00:11,  5.39it/s, loss=2.01, v_num=0]
Epoch 82:  34%|███▍      | 33/97 [00:06<00:11,  5.35it/s, loss=2.01, v_num=0]
Epoch 82:  35%|███▌      | 34/97 [00:06<00:11,  5.44it/s, loss=2.01, v_num=0]
Epoch 82:  35%|███▌      | 34/97 [00:06<00:11,  5.39it/s, loss=2.01, v_num=0]
Epoch 82:  36%|███▌      | 35/97 [00:06<00:11,  5.48it/s, loss=2.01, v_num=0]
Epoch 82:  36%|███▌      | 35/97 [00:06<00:11,  5.43it/s, loss=2, v_num=0]
Epoch 82:  37%|███▋      | 36/97 [00:06<00:11,  5.51it/s, loss=2, v_num=0]
Epoch 82:  37%|███▋      | 36/97 [00:06<00:11,  5.47it/s, loss=2, v_num=0]
Epoch 82:  38%|███▊      | 37/97 [00:06<00:10,  5.55it/s, loss=2, v_num=0]
Epoch 82:  38%|███▊      | 37/97 [00:06<00:10,  5.50it/s, loss=2, v_num=0]
Epoch 82:  39%|███▉      | 38/97 [00:06<00:10,  5.59it/s, loss=2, v_num=0]
Epoch 82:  39%|███▉      | 38/97 [00:06<00:10,  5.54it/s, loss=2.01, v_num=0]
Epoch 82:  40%|████      | 39/97 [00:06<00:10,  5.62it/s, loss=2.01, v_num=0]
Epoch 82:  40%|████      | 39/97 [00:06<00:10,  5.58it/s, loss=2.01, v_num=0]
Epoch 82:  41%|████      | 40/97 [00:07<00:10,  5.65it/s, loss=2.01, v_num=0]
Epoch 82:  41%|████      | 40/97 [00:07<00:10,  5.61it/s, loss=2.01, v_num=0]
Epoch 82:  42%|████▏     | 41/97 [00:07<00:09,  5.69it/s, loss=2.01, v_num=0]
Epoch 82:  42%|████▏     | 41/97 [00:07<00:09,  5.64it/s, loss=2.01, v_num=0]
Epoch 82:  43%|████▎     | 42/97 [00:07<00:09,  5.71it/s, loss=2.01, v_num=0]
Epoch 82:  43%|████▎     | 42/97 [00:07<00:09,  5.67it/s, loss=2.01, v_num=0]
Epoch 82:  44%|████▍     | 43/97 [00:07<00:09,  5.74it/s, loss=2.01, v_num=0]
Epoch 82:  44%|████▍     | 43/97 [00:07<00:09,  5.70it/s, loss=2.01, v_num=0]
Epoch 82:  45%|████▌     | 44/97 [00:07<00:09,  5.76it/s, loss=2.01, v_num=0]
Epoch 82:  45%|████▌     | 44/97 [00:07<00:09,  5.72it/s, loss=2.02, v_num=0]
Epoch 82:  46%|████▋     | 45/97 [00:07<00:08,  5.79it/s, loss=2.02, v_num=0]
Epoch 82:  46%|████▋     | 45/97 [00:07<00:09,  5.74it/s, loss=2.02, v_num=0]
Epoch 82:  47%|████▋     | 46/97 [00:07<00:08,  5.81it/s, loss=2.02, v_num=0]
Epoch 82:  47%|████▋     | 46/97 [00:07<00:08,  5.77it/s, loss=2.02, v_num=0]
Epoch 82:  48%|████▊     | 47/97 [00:08<00:08,  5.82it/s, loss=2.02, v_num=0]
Epoch 82:  48%|████▊     | 47/97 [00:08<00:08,  5.78it/s, loss=2.01, v_num=0]
Epoch 82:  49%|████▉     | 48/97 [00:08<00:08,  5.85it/s, loss=2.01, v_num=0]
Epoch 82:  49%|████▉     | 48/97 [00:08<00:08,  5.81it/s, loss=2.01, v_num=0]
Epoch 82:  51%|█████     | 49/97 [00:08<00:08,  5.87it/s, loss=2.01, v_num=0]
Epoch 82:  51%|█████     | 49/97 [00:08<00:08,  5.83it/s, loss=2.01, v_num=0]
Epoch 82:  52%|█████▏    | 50/97 [00:08<00:07,  5.89it/s, loss=2.01, v_num=0]
Epoch 82:  52%|█████▏    | 50/97 [00:08<00:08,  5.85it/s, loss=2.02, v_num=0]
Epoch 82:  53%|█████▎    | 51/97 [00:08<00:07,  5.91it/s, loss=2.02, v_num=0]
Epoch 82:  53%|█████▎    | 51/97 [00:08<00:07,  5.87it/s, loss=2.02, v_num=0]
Epoch 82:  54%|█████▎    | 52/97 [00:08<00:07,  5.92it/s, loss=2.02, v_num=0]
Epoch 82:  54%|█████▎    | 52/97 [00:08<00:07,  5.89it/s, loss=2.02, v_num=0]
Epoch 82:  55%|█████▍    | 53/97 [00:08<00:07,  5.94it/s, loss=2.02, v_num=0]
Epoch 82:  55%|█████▍    | 53/97 [00:08<00:07,  5.90it/s, loss=2.01, v_num=0]
Epoch 82:  56%|█████▌    | 54/97 [00:09<00:07,  5.95it/s, loss=2.01, v_num=0]
Epoch 82:  56%|█████▌    | 54/97 [00:09<00:07,  5.92it/s, loss=2.02, v_num=0]
Epoch 82:  57%|█████▋    | 55/97 [00:09<00:07,  5.97it/s, loss=2.02, v_num=0]
Epoch 82:  57%|█████▋    | 55/97 [00:09<00:07,  5.93it/s, loss=2.02, v_num=0]
Epoch 82:  58%|█████▊    | 56/97 [00:09<00:06,  5.99it/s, loss=2.02, v_num=0]
Epoch 82:  58%|█████▊    | 56/97 [00:09<00:06,  5.95it/s, loss=2.02, v_num=0]
Epoch 82:  59%|█████▉    | 57/97 [00:09<00:06,  6.00it/s, loss=2.02, v_num=0]
Epoch 82:  59%|█████▉    | 57/97 [00:09<00:06,  5.97it/s, loss=2.02, v_num=0]
Epoch 82:  60%|█████▉    | 58/97 [00:09<00:06,  6.02it/s, loss=2.02, v_num=0]
Epoch 82:  60%|█████▉    | 58/97 [00:09<00:06,  5.98it/s, loss=2.02, v_num=0]
Epoch 82:  61%|██████    | 59/97 [00:09<00:06,  6.03it/s, loss=2.02, v_num=0]
Epoch 82:  61%|██████    | 59/97 [00:09<00:06,  6.00it/s, loss=2.02, v_num=0]
Epoch 82:  62%|██████▏   | 60/97 [00:09<00:06,  6.05it/s, loss=2.02, v_num=0]
Epoch 82:  62%|██████▏   | 60/97 [00:09<00:06,  6.01it/s, loss=2.02, v_num=0]
Epoch 82:  63%|██████▎   | 61/97 [00:10<00:05,  6.06it/s, loss=2.02, v_num=0]
Epoch 82:  63%|██████▎   | 61/97 [00:10<00:05,  6.03it/s, loss=2.02, v_num=0]
Epoch 82:  64%|██████▍   | 62/97 [00:10<00:05,  6.07it/s, loss=2.02, v_num=0]
Epoch 82:  64%|██████▍   | 62/97 [00:10<00:05,  6.04it/s, loss=2.02, v_num=0]
Epoch 82:  65%|██████▍   | 63/97 [00:10<00:05,  6.08it/s, loss=2.02, v_num=0]
Epoch 82:  65%|██████▍   | 63/97 [00:10<00:05,  6.05it/s, loss=2.01, v_num=0]
Epoch 82:  66%|██████▌   | 64/97 [00:10<00:05,  6.09it/s, loss=2.01, v_num=0]
Epoch 82:  66%|██████▌   | 64/97 [00:10<00:05,  6.06it/s, loss=2.02, v_num=0]
Epoch 82:  67%|██████▋   | 65/97 [00:10<00:05,  6.10it/s, loss=2.02, v_num=0]
Epoch 82:  67%|██████▋   | 65/97 [00:10<00:05,  6.07it/s, loss=2.02, v_num=0]
Epoch 82:  68%|██████▊   | 66/97 [00:10<00:05,  6.11it/s, loss=2.02, v_num=0]
Epoch 82:  68%|██████▊   | 66/97 [00:10<00:05,  6.08it/s, loss=2.02, v_num=0]
Epoch 82:  69%|██████▉   | 67/97 [00:10<00:04,  6.13it/s, loss=2.02, v_num=0]
Epoch 82:  69%|██████▉   | 67/97 [00:10<00:04,  6.09it/s, loss=2.02, v_num=0]
Epoch 82:  70%|███████   | 68/97 [00:11<00:04,  6.14it/s, loss=2.02, v_num=0]
Epoch 82:  70%|███████   | 68/97 [00:11<00:04,  6.11it/s, loss=2.02, v_num=0]
Epoch 82:  71%|███████   | 69/97 [00:11<00:04,  6.15it/s, loss=2.02, v_num=0]
Epoch 82:  71%|███████   | 69/97 [00:11<00:04,  6.12it/s, loss=2.02, v_num=0]
Epoch 82:  72%|███████▏  | 70/97 [00:11<00:04,  6.16it/s, loss=2.02, v_num=0]
Epoch 82:  72%|███████▏  | 70/97 [00:11<00:04,  6.13it/s, loss=2.02, v_num=0]
Epoch 82:  73%|███████▎  | 71/97 [00:11<00:04,  6.17it/s, loss=2.02, v_num=0]
Epoch 82:  73%|███████▎  | 71/97 [00:11<00:04,  6.14it/s, loss=2.02, v_num=0]
Epoch 82:  74%|███████▍  | 72/97 [00:11<00:04,  6.18it/s, loss=2.02, v_num=0]
Epoch 82:  74%|███████▍  | 72/97 [00:11<00:04,  6.15it/s, loss=2.03, v_num=0]
Epoch 82:  75%|███████▌  | 73/97 [00:11<00:03,  6.20it/s, loss=2.03, v_num=0]
Epoch 82:  75%|███████▌  | 73/97 [00:11<00:03,  6.17it/s, loss=2.03, v_num=0]
Epoch 82:  76%|███████▋  | 74/97 [00:11<00:03,  6.21it/s, loss=2.03, v_num=0]
Epoch 82:  76%|███████▋  | 74/97 [00:11<00:03,  6.18it/s, loss=2.03, v_num=0]
Epoch 82:  77%|███████▋  | 75/97 [00:12<00:03,  6.22it/s, loss=2.03, v_num=0]
Epoch 82:  77%|███████▋  | 75/97 [00:12<00:03,  6.19it/s, loss=2.03, v_num=0]
Epoch 82:  78%|███████▊  | 76/97 [00:12<00:03,  6.23it/s, loss=2.03, v_num=0]
Epoch 82:  78%|███████▊  | 76/97 [00:12<00:03,  6.20it/s, loss=2.04, v_num=0]
Epoch 82:  79%|███████▉  | 77/97 [00:12<00:03,  6.21it/s, loss=2.04, v_num=0]
Epoch 82:  79%|███████▉  | 77/97 [00:12<00:03,  6.19it/s, loss=2.03, v_num=0]
Epoch 82:  80%|████████  | 78/97 [00:12<00:03,  6.21it/s, loss=2.03, v_num=0]
Epoch 82:  80%|████████  | 78/97 [00:12<00:03,  6.19it/s, loss=2.03, v_num=0]
Epoch 82:  81%|████████▏ | 79/97 [00:12<00:02,  6.22it/s, loss=2.03, v_num=0]
Epoch 82:  81%|████████▏ | 79/97 [00:12<00:02,  6.19it/s, loss=2.03, v_num=0]
Epoch 82:  82%|████████▏ | 80/97 [00:12<00:02,  6.23it/s, loss=2.03, v_num=0]
Epoch 82:  82%|████████▏ | 80/97 [00:12<00:02,  6.20it/s, loss=2.03, v_num=0]
Epoch 82:  84%|████████▎ | 81/97 [00:12<00:02,  6.24it/s, loss=2.03, v_num=0]
Epoch 82:  84%|████████▎ | 81/97 [00:13<00:02,  6.22it/s, loss=2.03, v_num=0]
Epoch 82:  85%|████████▍ | 82/97 [00:13<00:02,  6.25it/s, loss=2.03, v_num=0]
Epoch 82:  85%|████████▍ | 82/97 [00:13<00:02,  6.22it/s, loss=2.03, v_num=0]
Epoch 82:  86%|████████▌ | 83/97 [00:13<00:02,  6.26it/s, loss=2.03, v_num=0]
Epoch 82:  86%|████████▌ | 83/97 [00:13<00:02,  6.24it/s, loss=2.03, v_num=0]
Epoch 82:  87%|████████▋ | 84/97 [00:13<00:02,  6.27it/s, loss=2.03, v_num=0]
Epoch 82:  87%|████████▋ | 84/97 [00:13<00:02,  6.25it/s, loss=2.02, v_num=0]
Epoch 82:  88%|████████▊ | 85/97 [00:13<00:01,  6.28it/s, loss=2.02, v_num=0]
Epoch 82:  88%|████████▊ | 85/97 [00:13<00:01,  6.26it/s, loss=2.03, v_num=0]
Epoch 82:  89%|████████▊ | 86/97 [00:13<00:01,  6.29it/s, loss=2.03, v_num=0]
Epoch 82:  89%|████████▊ | 86/97 [00:13<00:01,  6.27it/s, loss=2.03, v_num=0]
Epoch 82:  90%|████████▉ | 87/97 [00:13<00:01,  6.30it/s, loss=2.03, v_num=0]
Epoch 82:  90%|████████▉ | 87/97 [00:13<00:01,  6.28it/s, loss=2.02, v_num=0]
Epoch 82:  91%|█████████ | 88/97 [00:13<00:01,  6.31it/s, loss=2.02, v_num=0]
Epoch 82:  91%|█████████ | 88/97 [00:13<00:01,  6.29it/s, loss=2.02, v_num=0]
Epoch 82:  92%|█████████▏| 89/97 [00:14<00:01,  6.32it/s, loss=2.02, v_num=0]
Epoch 82:  92%|█████████▏| 89/97 [00:14<00:01,  6.30it/s, loss=2.02, v_num=0]
Epoch 82:  93%|█████████▎| 90/97 [00:14<00:01,  6.33it/s, loss=2.02, v_num=0]
Epoch 82:  93%|█████████▎| 90/97 [00:14<00:01,  6.31it/s, loss=2.02, v_num=0]
Epoch 82:  94%|█████████▍| 91/97 [00:14<00:00,  6.34it/s, loss=2.02, v_num=0]
Epoch 82:  94%|█████████▍| 91/97 [00:14<00:00,  6.32it/s, loss=2.02, v_num=0]
Epoch 82:  95%|█████████▍| 92/97 [00:14<00:00,  6.35it/s, loss=2.02, v_num=0]
Epoch 82:  95%|█████████▍| 92/97 [00:14<00:00,  6.33it/s, loss=2.01, v_num=0]
Epoch 82:  96%|█████████▌| 93/97 [00:14<00:00,  6.36it/s, loss=2.01, v_num=0]
Epoch 82:  96%|█████████▌| 93/97 [00:14<00:00,  6.34it/s, loss=2.01, v_num=0]
Epoch 82:  97%|█████████▋| 94/97 [00:14<00:00,  6.37it/s, loss=2.01, v_num=0]
Epoch 82:  97%|█████████▋| 94/97 [00:14<00:00,  6.34it/s, loss=2.01, v_num=0]
Epoch 82:  98%|█████████▊| 95/97 [00:14<00:00,  6.38it/s, loss=2.01, v_num=0]
Epoch 82:  98%|█████████▊| 95/97 [00:14<00:00,  6.35it/s, loss=2.01, v_num=0]
Epoch 82:  99%|█████████▉| 96/97 [00:15<00:00,  6.39it/s, loss=2.01, v_num=0]
Epoch 82:  99%|█████████▉| 96/97 [00:15<00:00,  6.36it/s, loss=2, v_num=0]
Epoch 82: 100%|██████████| 97/97 [00:15<00:00,  6.39it/s, loss=2, v_num=0]
Epoch 82: 100%|██████████| 97/97 [00:15<00:00,  6.37it/s, loss=2, v_num=0]
Epoch 82: 100%|██████████| 97/97 [00:15<00:00,  6.36it/s, loss=2, v_num=0]
Epoch 82:   0%|          | 0/97 [00:00<?, ?it/s, loss=2, v_num=0]
Epoch 83:   0%|          | 0/97 [00:00<?, ?it/s, loss=2, v_num=0]
Epoch 83:   1%|          | 1/97 [00:01<02:12,  1.38s/it, loss=2, v_num=0]
Epoch 83:   1%|          | 1/97 [00:01<02:18,  1.44s/it, loss=2, v_num=0]
Epoch 83:   2%|▏         | 2/97 [00:01<01:12,  1.31it/s, loss=2, v_num=0]
Epoch 83:   2%|▏         | 2/97 [00:01<01:14,  1.27it/s, loss=2.01, v_num=0]
Epoch 83:   3%|▎         | 3/97 [00:01<00:52,  1.80it/s, loss=2.01, v_num=0]
Epoch 83:   3%|▎         | 3/97 [00:01<00:53,  1.74it/s, loss=2, v_num=0]
Epoch 83:   4%|▍         | 4/97 [00:01<00:41,  2.22it/s, loss=2, v_num=0]
Epoch 83:   4%|▍         | 4/97 [00:01<00:43,  2.15it/s, loss=2.01, v_num=0]
Epoch 83:   5%|▌         | 5/97 [00:01<00:35,  2.57it/s, loss=2.01, v_num=0]
Epoch 83:   5%|▌         | 5/97 [00:02<00:36,  2.50it/s, loss=2.01, v_num=0]
Epoch 83:   6%|▌         | 6/97 [00:02<00:31,  2.88it/s, loss=2.01, v_num=0]
Epoch 83:   6%|▌         | 6/97 [00:02<00:32,  2.80it/s, loss=2.02, v_num=0]
Epoch 83:   7%|▋         | 7/97 [00:02<00:28,  3.15it/s, loss=2.02, v_num=0]
Epoch 83:   7%|▋         | 7/97 [00:02<00:29,  3.08it/s, loss=2.02, v_num=0]
Epoch 83:   8%|▊         | 8/97 [00:02<00:26,  3.39it/s, loss=2.02, v_num=0]
Epoch 83:   8%|▊         | 8/97 [00:02<00:26,  3.32it/s, loss=2.02, v_num=0]
Epoch 83:   9%|▉         | 9/97 [00:02<00:24,  3.61it/s, loss=2.02, v_num=0]
Epoch 83:   9%|▉         | 9/97 [00:02<00:24,  3.53it/s, loss=2.02, v_num=0]
Epoch 83:  10%|█         | 10/97 [00:02<00:22,  3.80it/s, loss=2.02, v_num=0]
Epoch 83:  10%|█         | 10/97 [00:02<00:23,  3.72it/s, loss=2.03, v_num=0]
Epoch 83:  11%|█▏        | 11/97 [00:02<00:21,  3.97it/s, loss=2.03, v_num=0]
Epoch 83:  11%|█▏        | 11/97 [00:02<00:22,  3.89it/s, loss=2.02, v_num=0]
Epoch 83:  12%|█▏        | 12/97 [00:02<00:20,  4.12it/s, loss=2.02, v_num=0]
Epoch 83:  12%|█▏        | 12/97 [00:02<00:21,  4.04it/s, loss=2.02, v_num=0]
Epoch 83:  13%|█▎        | 13/97 [00:03<00:19,  4.27it/s, loss=2.02, v_num=0]
Epoch 83:  13%|█▎        | 13/97 [00:03<00:20,  4.19it/s, loss=2.03, v_num=0]
Epoch 83:  14%|█▍        | 14/97 [00:03<00:18,  4.40it/s, loss=2.03, v_num=0]
Epoch 83:  14%|█▍        | 14/97 [00:03<00:19,  4.32it/s, loss=2.03, v_num=0]
Epoch 83:  15%|█▌        | 15/97 [00:03<00:18,  4.52it/s, loss=2.03, v_num=0]
Epoch 83:  15%|█▌        | 15/97 [00:03<00:18,  4.44it/s, loss=2.03, v_num=0]
Epoch 83:  16%|█▋        | 16/97 [00:03<00:17,  4.62it/s, loss=2.03, v_num=0]
Epoch 83:  16%|█▋        | 16/97 [00:03<00:17,  4.56it/s, loss=2.03, v_num=0]
Epoch 83:  18%|█▊        | 17/97 [00:03<00:16,  4.73it/s, loss=2.03, v_num=0]
Epoch 83:  18%|█▊        | 17/97 [00:03<00:17,  4.66it/s, loss=2.03, v_num=0]
Epoch 83:  19%|█▊        | 18/97 [00:03<00:16,  4.82it/s, loss=2.03, v_num=0]
Epoch 83:  19%|█▊        | 18/97 [00:03<00:16,  4.75it/s, loss=2.04, v_num=0]
Epoch 83:  20%|█▉        | 19/97 [00:03<00:15,  4.91it/s, loss=2.04, v_num=0]
Epoch 83:  20%|█▉        | 19/97 [00:03<00:16,  4.84it/s, loss=2.04, v_num=0]
Epoch 83:  21%|██        | 20/97 [00:04<00:15,  4.99it/s, loss=2.04, v_num=0]
Epoch 83:  21%|██        | 20/97 [00:04<00:15,  4.92it/s, loss=2.03, v_num=0]
Epoch 83:  22%|██▏       | 21/97 [00:04<00:14,  5.07it/s, loss=2.03, v_num=0]
Epoch 83:  22%|██▏       | 21/97 [00:04<00:15,  5.00it/s, loss=2.03, v_num=0]
Epoch 83:  23%|██▎       | 22/97 [00:04<00:14,  5.14it/s, loss=2.03, v_num=0]
Epoch 83:  23%|██▎       | 22/97 [00:04<00:14,  5.08it/s, loss=2.03, v_num=0]
Epoch 83:  24%|██▎       | 23/97 [00:04<00:14,  5.21it/s, loss=2.03, v_num=0]
Epoch 83:  24%|██▎       | 23/97 [00:04<00:14,  5.14it/s, loss=2.03, v_num=0]
Epoch 83:  25%|██▍       | 24/97 [00:04<00:13,  5.27it/s, loss=2.03, v_num=0]
Epoch 83:  25%|██▍       | 24/97 [00:04<00:14,  5.21it/s, loss=2.02, v_num=0]
Epoch 83:  26%|██▌       | 25/97 [00:04<00:13,  5.33it/s, loss=2.02, v_num=0]
Epoch 83:  26%|██▌       | 25/97 [00:04<00:13,  5.26it/s, loss=2.01, v_num=0]
Epoch 83:  27%|██▋       | 26/97 [00:04<00:13,  5.38it/s, loss=2.01, v_num=0]
Epoch 83:  27%|██▋       | 26/97 [00:04<00:13,  5.32it/s, loss=2.01, v_num=0]
Epoch 83:  28%|██▊       | 27/97 [00:04<00:12,  5.43it/s, loss=2.01, v_num=0]
Epoch 83:  28%|██▊       | 27/97 [00:05<00:13,  5.38it/s, loss=2.01, v_num=0]
Epoch 83:  29%|██▉       | 28/97 [00:05<00:12,  5.48it/s, loss=2.01, v_num=0]
Epoch 83:  29%|██▉       | 28/97 [00:05<00:12,  5.43it/s, loss=2.01, v_num=0]
Epoch 83:  30%|██▉       | 29/97 [00:05<00:12,  5.53it/s, loss=2.01, v_num=0]
Epoch 83:  30%|██▉       | 29/97 [00:05<00:12,  5.48it/s, loss=2.01, v_num=0]
Epoch 83:  31%|███       | 30/97 [00:05<00:12,  5.58it/s, loss=2.01, v_num=0]
Epoch 83:  31%|███       | 30/97 [00:05<00:12,  5.52it/s, loss=2.01, v_num=0]
Epoch 83:  32%|███▏      | 31/97 [00:05<00:11,  5.62it/s, loss=2.01, v_num=0]
Epoch 83:  32%|███▏      | 31/97 [00:05<00:11,  5.57it/s, loss=2.02, v_num=0]
Epoch 83:  33%|███▎      | 32/97 [00:05<00:11,  5.66it/s, loss=2.02, v_num=0]
Epoch 83:  33%|███▎      | 32/97 [00:05<00:11,  5.61it/s, loss=2.02, v_num=0]
Epoch 83:  34%|███▍      | 33/97 [00:05<00:11,  5.70it/s, loss=2.02, v_num=0]
Epoch 83:  34%|███▍      | 33/97 [00:05<00:11,  5.65it/s, loss=2.02, v_num=0]
Epoch 83:  35%|███▌      | 34/97 [00:05<00:10,  5.74it/s, loss=2.02, v_num=0]
Epoch 83:  35%|███▌      | 34/97 [00:05<00:11,  5.68it/s, loss=2.01, v_num=0]
Epoch 83:  36%|███▌      | 35/97 [00:06<00:10,  5.77it/s, loss=2.01, v_num=0]
Epoch 83:  36%|███▌      | 35/97 [00:06<00:10,  5.72it/s, loss=2.01, v_num=0]
Epoch 83:  37%|███▋      | 36/97 [00:06<00:10,  5.80it/s, loss=2.01, v_num=0]
Epoch 83:  37%|███▋      | 36/97 [00:06<00:10,  5.75it/s, loss=2.01, v_num=0]
Epoch 83:  38%|███▊      | 37/97 [00:06<00:10,  5.83it/s, loss=2.01, v_num=0]
Epoch 83:  38%|███▊      | 37/97 [00:06<00:10,  5.78it/s, loss=2.01, v_num=0]
Epoch 83:  39%|███▉      | 38/97 [00:06<00:10,  5.86it/s, loss=2.01, v_num=0]
Epoch 83:  39%|███▉      | 38/97 [00:06<00:10,  5.81it/s, loss=2, v_num=0]
Epoch 83:  40%|████      | 39/97 [00:06<00:09,  5.89it/s, loss=2, v_num=0]
Epoch 83:  40%|████      | 39/97 [00:06<00:09,  5.84it/s, loss=2.01, v_num=0]
Epoch 83:  41%|████      | 40/97 [00:06<00:09,  5.92it/s, loss=2.01, v_num=0]
Epoch 83:  41%|████      | 40/97 [00:06<00:09,  5.87it/s, loss=2, v_num=0]
Epoch 83:  42%|████▏     | 41/97 [00:06<00:09,  5.95it/s, loss=2, v_num=0]
Epoch 83:  42%|████▏     | 41/97 [00:06<00:09,  5.90it/s, loss=2.01, v_num=0]
Epoch 83:  43%|████▎     | 42/97 [00:07<00:09,  5.98it/s, loss=2.01, v_num=0]
Epoch 83:  43%|████▎     | 42/97 [00:07<00:09,  5.93it/s, loss=2.01, v_num=0]
Epoch 83:  44%|████▍     | 43/97 [00:07<00:08,  6.00it/s, loss=2.01, v_num=0]
Epoch 83:  44%|████▍     | 43/97 [00:07<00:09,  5.95it/s, loss=2.02, v_num=0]
Epoch 83:  45%|████▌     | 44/97 [00:07<00:08,  6.02it/s, loss=2.02, v_num=0]
Epoch 83:  45%|████▌     | 44/97 [00:07<00:08,  5.98it/s, loss=2.02, v_num=0]
Epoch 83:  46%|████▋     | 45/97 [00:07<00:08,  6.04it/s, loss=2.02, v_num=0]
Epoch 83:  46%|████▋     | 45/97 [00:07<00:08,  6.00it/s, loss=2.02, v_num=0]
Epoch 83:  47%|████▋     | 46/97 [00:07<00:08,  6.06it/s, loss=2.02, v_num=0]
Epoch 83:  47%|████▋     | 46/97 [00:07<00:08,  6.02it/s, loss=2.03, v_num=0]
Epoch 83:  48%|████▊     | 47/97 [00:07<00:08,  6.08it/s, loss=2.03, v_num=0]
Epoch 83:  48%|████▊     | 47/97 [00:07<00:08,  6.04it/s, loss=2.02, v_num=0]
Epoch 83:  49%|████▉     | 48/97 [00:07<00:08,  6.11it/s, loss=2.02, v_num=0]
Epoch 83:  49%|████▉     | 48/97 [00:07<00:08,  6.06it/s, loss=2.01, v_num=0]
Epoch 83:  51%|█████     | 49/97 [00:07<00:07,  6.13it/s, loss=2.01, v_num=0]
Epoch 83:  51%|█████     | 49/97 [00:08<00:07,  6.08it/s, loss=2.01, v_num=0]
Epoch 83:  52%|█████▏    | 50/97 [00:08<00:07,  6.15it/s, loss=2.01, v_num=0]
Epoch 83:  52%|█████▏    | 50/97 [00:08<00:07,  6.10it/s, loss=2.01, v_num=0]
Epoch 83:  53%|█████▎    | 51/97 [00:08<00:07,  6.16it/s, loss=2.01, v_num=0]
Epoch 83:  53%|█████▎    | 51/97 [00:08<00:07,  6.12it/s, loss=2.01, v_num=0]
Epoch 83:  54%|█████▎    | 52/97 [00:08<00:07,  6.18it/s, loss=2.01, v_num=0]
Epoch 83:  54%|█████▎    | 52/97 [00:08<00:07,  6.14it/s, loss=2.01, v_num=0]
Epoch 83:  55%|█████▍    | 53/97 [00:08<00:07,  6.20it/s, loss=2.01, v_num=0]
Epoch 83:  55%|█████▍    | 53/97 [00:08<00:07,  6.16it/s, loss=2.01, v_num=0]
Epoch 83:  56%|█████▌    | 54/97 [00:08<00:06,  6.22it/s, loss=2.01, v_num=0]
Epoch 83:  56%|█████▌    | 54/97 [00:08<00:06,  6.18it/s, loss=2.01, v_num=0]
Epoch 83:  57%|█████▋    | 55/97 [00:08<00:06,  6.24it/s, loss=2.01, v_num=0]
Epoch 83:  57%|█████▋    | 55/97 [00:08<00:06,  6.20it/s, loss=2.02, v_num=0]
Epoch 83:  58%|█████▊    | 56/97 [00:08<00:06,  6.25it/s, loss=2.02, v_num=0]
Epoch 83:  58%|█████▊    | 56/97 [00:09<00:06,  6.21it/s, loss=2.01, v_num=0]
Epoch 83:  59%|█████▉    | 57/97 [00:09<00:06,  6.26it/s, loss=2.01, v_num=0]
Epoch 83:  59%|█████▉    | 57/97 [00:09<00:06,  6.23it/s, loss=2.01, v_num=0]
Epoch 83:  60%|█████▉    | 58/97 [00:09<00:06,  6.28it/s, loss=2.01, v_num=0]
Epoch 83:  60%|█████▉    | 58/97 [00:09<00:06,  6.24it/s, loss=2.01, v_num=0]
Epoch 83:  61%|██████    | 59/97 [00:09<00:06,  6.30it/s, loss=2.01, v_num=0]
Epoch 83:  61%|██████    | 59/97 [00:09<00:06,  6.26it/s, loss=2.01, v_num=0]
Epoch 83:  62%|██████▏   | 60/97 [00:09<00:05,  6.31it/s, loss=2.01, v_num=0]
Epoch 83:  62%|██████▏   | 60/97 [00:09<00:05,  6.28it/s, loss=2.01, v_num=0]
Epoch 83:  63%|██████▎   | 61/97 [00:09<00:05,  6.33it/s, loss=2.01, v_num=0]
Epoch 83:  63%|██████▎   | 61/97 [00:09<00:05,  6.29it/s, loss=1.99, v_num=0]
Epoch 83:  64%|██████▍   | 62/97 [00:09<00:05,  6.34it/s, loss=1.99, v_num=0]
Epoch 83:  64%|██████▍   | 62/97 [00:09<00:05,  6.30it/s, loss=2, v_num=0]
Epoch 83:  65%|██████▍   | 63/97 [00:09<00:05,  6.35it/s, loss=2, v_num=0]
Epoch 83:  65%|██████▍   | 63/97 [00:09<00:05,  6.32it/s, loss=2, v_num=0]
Epoch 83:  66%|██████▌   | 64/97 [00:10<00:05,  6.37it/s, loss=2, v_num=0]
Epoch 83:  66%|██████▌   | 64/97 [00:10<00:05,  6.33it/s, loss=2, v_num=0]
Epoch 83:  67%|██████▋   | 65/97 [00:10<00:05,  6.38it/s, loss=2, v_num=0]
Epoch 83:  67%|██████▋   | 65/97 [00:10<00:05,  6.34it/s, loss=2, v_num=0]
Epoch 83:  68%|██████▊   | 66/97 [00:10<00:04,  6.39it/s, loss=2, v_num=0]
Epoch 83:  68%|██████▊   | 66/97 [00:10<00:04,  6.36it/s, loss=2, v_num=0]
Epoch 83:  69%|██████▉   | 67/97 [00:10<00:04,  6.40it/s, loss=2, v_num=0]
Epoch 83:  69%|██████▉   | 67/97 [00:10<00:04,  6.37it/s, loss=2, v_num=0]
Epoch 83:  70%|███████   | 68/97 [00:10<00:04,  6.42it/s, loss=2, v_num=0]
Epoch 83:  70%|███████   | 68/97 [00:10<00:04,  6.38it/s, loss=2.01, v_num=0]
Epoch 83:  71%|███████   | 69/97 [00:10<00:04,  6.42it/s, loss=2.01, v_num=0]
Epoch 83:  71%|███████   | 69/97 [00:10<00:04,  6.39it/s, loss=2.01, v_num=0]
Epoch 83:  72%|███████▏  | 70/97 [00:10<00:04,  6.44it/s, loss=2.01, v_num=0]
Epoch 83:  72%|███████▏  | 70/97 [00:10<00:04,  6.40it/s, loss=2, v_num=0]
Epoch 83:  73%|███████▎  | 71/97 [00:11<00:04,  6.45it/s, loss=2, v_num=0]
Epoch 83:  73%|███████▎  | 71/97 [00:11<00:04,  6.41it/s, loss=2, v_num=0]
Epoch 83:  74%|███████▍  | 72/97 [00:11<00:03,  6.46it/s, loss=2, v_num=0]
Epoch 83:  74%|███████▍  | 72/97 [00:11<00:03,  6.43it/s, loss=2.01, v_num=0]
Epoch 83:  75%|███████▌  | 73/97 [00:11<00:03,  6.47it/s, loss=2.01, v_num=0]
Epoch 83:  75%|███████▌  | 73/97 [00:11<00:03,  6.44it/s, loss=2, v_num=0]
Epoch 83:  76%|███████▋  | 74/97 [00:11<00:03,  6.48it/s, loss=2, v_num=0]
Epoch 83:  76%|███████▋  | 74/97 [00:11<00:03,  6.45it/s, loss=2, v_num=0]
Epoch 83:  77%|███████▋  | 75/97 [00:11<00:03,  6.49it/s, loss=2, v_num=0]
Epoch 83:  77%|███████▋  | 75/97 [00:11<00:03,  6.46it/s, loss=2, v_num=0]
Epoch 83:  78%|███████▊  | 76/97 [00:11<00:03,  6.50it/s, loss=2, v_num=0]
Epoch 83:  78%|███████▊  | 76/97 [00:11<00:03,  6.47it/s, loss=2.01, v_num=0]
Epoch 83:  79%|███████▉  | 77/97 [00:11<00:03,  6.51it/s, loss=2.01, v_num=0]
Epoch 83:  79%|███████▉  | 77/97 [00:11<00:03,  6.48it/s, loss=2.01, v_num=0]
Epoch 83:  80%|████████  | 78/97 [00:11<00:02,  6.52it/s, loss=2.01, v_num=0]
Epoch 83:  80%|████████  | 78/97 [00:12<00:02,  6.48it/s, loss=2.01, v_num=0]
Epoch 83:  81%|████████▏ | 79/97 [00:12<00:02,  6.52it/s, loss=2.01, v_num=0]
Epoch 83:  81%|████████▏ | 79/97 [00:12<00:02,  6.49it/s, loss=2.01, v_num=0]
Epoch 83:  82%|████████▏ | 80/97 [00:12<00:02,  6.53it/s, loss=2.01, v_num=0]
Epoch 83:  82%|████████▏ | 80/97 [00:12<00:02,  6.50it/s, loss=2.02, v_num=0]
Epoch 83:  84%|████████▎ | 81/97 [00:12<00:02,  6.54it/s, loss=2.02, v_num=0]
Epoch 83:  84%|████████▎ | 81/97 [00:12<00:02,  6.51it/s, loss=2.02, v_num=0]
Epoch 83:  85%|████████▍ | 82/97 [00:12<00:02,  6.54it/s, loss=2.02, v_num=0]
Epoch 83:  85%|████████▍ | 82/97 [00:12<00:02,  6.51it/s, loss=2.02, v_num=0]
Epoch 83:  86%|████████▌ | 83/97 [00:12<00:02,  6.55it/s, loss=2.02, v_num=0]
Epoch 83:  86%|████████▌ | 83/97 [00:12<00:02,  6.52it/s, loss=2.02, v_num=0]
Epoch 83:  87%|████████▋ | 84/97 [00:12<00:01,  6.56it/s, loss=2.02, v_num=0]
Epoch 83:  87%|████████▋ | 84/97 [00:12<00:01,  6.53it/s, loss=2.02, v_num=0]
Epoch 83:  88%|████████▊ | 85/97 [00:12<00:01,  6.57it/s, loss=2.02, v_num=0]
Epoch 83:  88%|████████▊ | 85/97 [00:13<00:01,  6.54it/s, loss=2.03, v_num=0]
Epoch 83:  89%|████████▊ | 86/97 [00:13<00:01,  6.57it/s, loss=2.03, v_num=0]
Epoch 83:  89%|████████▊ | 86/97 [00:13<00:01,  6.55it/s, loss=2.02, v_num=0]
Epoch 83:  90%|████████▉ | 87/97 [00:13<00:01,  6.58it/s, loss=2.02, v_num=0]
Epoch 83:  90%|████████▉ | 87/97 [00:13<00:01,  6.55it/s, loss=2.02, v_num=0]
Epoch 83:  91%|█████████ | 88/97 [00:13<00:01,  6.59it/s, loss=2.02, v_num=0]
Epoch 83:  91%|█████████ | 88/97 [00:13<00:01,  6.56it/s, loss=2.02, v_num=0]
Epoch 83:  92%|█████████▏| 89/97 [00:13<00:01,  6.60it/s, loss=2.02, v_num=0]
Epoch 83:  92%|█████████▏| 89/97 [00:13<00:01,  6.57it/s, loss=2.02, v_num=0]
Epoch 83:  93%|█████████▎| 90/97 [00:13<00:01,  6.60it/s, loss=2.02, v_num=0]
Epoch 83:  93%|█████████▎| 90/97 [00:13<00:01,  6.58it/s, loss=2.03, v_num=0]
Epoch 83:  94%|█████████▍| 91/97 [00:13<00:00,  6.61it/s, loss=2.03, v_num=0]
Epoch 83:  94%|█████████▍| 91/97 [00:13<00:00,  6.58it/s, loss=2.02, v_num=0]
Epoch 83:  95%|█████████▍| 92/97 [00:13<00:00,  6.62it/s, loss=2.02, v_num=0]
Epoch 83:  95%|█████████▍| 92/97 [00:13<00:00,  6.59it/s, loss=2.02, v_num=0]
Epoch 83:  96%|█████████▌| 93/97 [00:14<00:00,  6.63it/s, loss=2.02, v_num=0]
Epoch 83:  96%|█████████▌| 93/97 [00:14<00:00,  6.60it/s, loss=2.02, v_num=0]
Epoch 83:  97%|█████████▋| 94/97 [00:14<00:00,  6.63it/s, loss=2.02, v_num=0]
Epoch 83:  97%|█████████▋| 94/97 [00:14<00:00,  6.60it/s, loss=2.01, v_num=0]
Epoch 83:  98%|█████████▊| 95/97 [00:14<00:00,  6.64it/s, loss=2.01, v_num=0]
Epoch 83:  98%|█████████▊| 95/97 [00:14<00:00,  6.61it/s, loss=2.01, v_num=0]
Epoch 83:  99%|█████████▉| 96/97 [00:14<00:00,  6.64it/s, loss=2.01, v_num=0]
Epoch 83:  99%|█████████▉| 96/97 [00:14<00:00,  6.62it/s, loss=2.01, v_num=0]
Epoch 83: 100%|██████████| 97/97 [00:14<00:00,  6.64it/s, loss=2.01, v_num=0]
Epoch 83: 100%|██████████| 97/97 [00:14<00:00,  6.62it/s, loss=2.01, v_num=0]
Epoch 83: 100%|██████████| 97/97 [00:14<00:00,  6.62it/s, loss=2.01, v_num=0]
Epoch 83:   0%|          | 0/97 [00:00<?, ?it/s, loss=2.01, v_num=0]
Epoch 84:   0%|          | 0/97 [00:00<?, ?it/s, loss=2.01, v_num=0]
Epoch 84:   1%|          | 1/97 [00:01<02:23,  1.49s/it, loss=2.01, v_num=0]
Epoch 84:   1%|          | 1/97 [00:01<02:28,  1.55s/it, loss=2.01, v_num=0]
Epoch 84:   2%|▏         | 2/97 [00:01<01:17,  1.23it/s, loss=2.01, v_num=0]
Epoch 84:   2%|▏         | 2/97 [00:01<01:20,  1.19it/s, loss=2.01, v_num=0]
Epoch 84:   3%|▎         | 3/97 [00:01<00:56,  1.68it/s, loss=2.01, v_num=0]
Epoch 84:   3%|▎         | 3/97 [00:01<00:57,  1.63it/s, loss=2.01, v_num=0]
Epoch 84:   4%|▍         | 4/97 [00:01<00:44,  2.07it/s, loss=2.01, v_num=0]
Epoch 84:   4%|▍         | 4/97 [00:01<00:46,  2.01it/s, loss=2.01, v_num=0]
Epoch 84:   5%|▌         | 5/97 [00:02<00:38,  2.41it/s, loss=2.01, v_num=0]
Epoch 84:   5%|▌         | 5/97 [00:02<00:39,  2.35it/s, loss=2, v_num=0]
Epoch 84:   6%|▌         | 6/97 [00:02<00:33,  2.72it/s, loss=2, v_num=0]
Epoch 84:   6%|▌         | 6/97 [00:02<00:34,  2.65it/s, loss=2.01, v_num=0]
Epoch 84:   7%|▋         | 7/97 [00:02<00:30,  2.98it/s, loss=2.01, v_num=0]
Epoch 84:   7%|▋         | 7/97 [00:02<00:30,  2.91it/s, loss=2, v_num=0]
Epoch 84:   8%|▊         | 8/97 [00:02<00:27,  3.22it/s, loss=2, v_num=0]
Epoch 84:   8%|▊         | 8/97 [00:02<00:28,  3.15it/s, loss=2, v_num=0]
Epoch 84:   9%|▉         | 9/97 [00:02<00:25,  3.42it/s, loss=2, v_num=0]
Epoch 84:   9%|▉         | 9/97 [00:02<00:26,  3.35it/s, loss=2, v_num=0]
Epoch 84:  10%|█         | 10/97 [00:02<00:24,  3.61it/s, loss=2, v_num=0]
Epoch 84:  10%|█         | 10/97 [00:02<00:24,  3.54it/s, loss=2.01, v_num=0]
Epoch 84:  11%|█▏        | 11/97 [00:02<00:22,  3.79it/s, loss=2.01, v_num=0]
Epoch 84:  11%|█▏        | 11/97 [00:02<00:23,  3.71it/s, loss=2.01, v_num=0]
Epoch 84:  12%|█▏        | 12/97 [00:03<00:21,  3.94it/s, loss=2.01, v_num=0]
Epoch 84:  12%|█▏        | 12/97 [00:03<00:21,  3.87it/s, loss=2.01, v_num=0]
Epoch 84:  13%|█▎        | 13/97 [00:03<00:20,  4.09it/s, loss=2.01, v_num=0]
Epoch 84:  13%|█▎        | 13/97 [00:03<00:20,  4.02it/s, loss=2.01, v_num=0]
Epoch 84:  14%|█▍        | 14/97 [00:03<00:19,  4.22it/s, loss=2.01, v_num=0]
Epoch 84:  14%|█▍        | 14/97 [00:03<00:19,  4.15it/s, loss=2.01, v_num=0]
Epoch 84:  15%|█▌        | 15/97 [00:03<00:18,  4.34it/s, loss=2.01, v_num=0]
Epoch 84:  15%|█▌        | 15/97 [00:03<00:19,  4.28it/s, loss=2, v_num=0]
Epoch 84:  16%|█▋        | 16/97 [00:03<00:18,  4.45it/s, loss=2, v_num=0]
Epoch 84:  16%|█▋        | 16/97 [00:03<00:18,  4.39it/s, loss=2, v_num=0]
Epoch 84:  18%|█▊        | 17/97 [00:03<00:17,  4.56it/s, loss=2, v_num=0]
Epoch 84:  18%|█▊        | 17/97 [00:03<00:17,  4.49it/s, loss=2.01, v_num=0]
Epoch 84:  19%|█▊        | 18/97 [00:03<00:17,  4.65it/s, loss=2.01, v_num=0]
Epoch 84:  19%|█▊        | 18/97 [00:03<00:17,  4.58it/s, loss=2.01, v_num=0]
Epoch 84:  20%|█▉        | 19/97 [00:04<00:16,  4.74it/s, loss=2.01, v_num=0]
Epoch 84:  20%|█▉        | 19/97 [00:04<00:16,  4.67it/s, loss=2.01, v_num=0]
Epoch 84:  21%|██        | 20/97 [00:04<00:15,  4.82it/s, loss=2.01, v_num=0]
Epoch 84:  21%|██        | 20/97 [00:04<00:16,  4.75it/s, loss=2.01, v_num=0]
Epoch 84:  22%|██▏       | 21/97 [00:04<00:15,  4.90it/s, loss=2.01, v_num=0]
Epoch 84:  22%|██▏       | 21/97 [00:04<00:15,  4.83it/s, loss=2, v_num=0]
Epoch 84:  23%|██▎       | 22/97 [00:04<00:15,  4.97it/s, loss=2, v_num=0]
Epoch 84:  23%|██▎       | 22/97 [00:04<00:15,  4.91it/s, loss=2.01, v_num=0]
Epoch 84:  24%|██▎       | 23/97 [00:04<00:14,  5.04it/s, loss=2.01, v_num=0]
Epoch 84:  24%|██▎       | 23/97 [00:04<00:14,  4.97it/s, loss=2, v_num=0]
Epoch 84:  25%|██▍       | 24/97 [00:04<00:14,  5.10it/s, loss=2, v_num=0]
Epoch 84:  25%|██▍       | 24/97 [00:04<00:14,  5.04it/s, loss=2.01, v_num=0]
Epoch 84:  26%|██▌       | 25/97 [00:04<00:13,  5.16it/s, loss=2.01, v_num=0]
Epoch 84:  26%|██▌       | 25/97 [00:04<00:14,  5.10it/s, loss=2.01, v_num=0]
Epoch 84:  27%|██▋       | 26/97 [00:04<00:13,  5.22it/s, loss=2.01, v_num=0]
Epoch 84:  27%|██▋       | 26/97 [00:05<00:13,  5.16it/s, loss=2.01, v_num=0]
Epoch 84:  28%|██▊       | 27/97 [00:05<00:13,  5.27it/s, loss=2.01, v_num=0]
Epoch 84:  28%|██▊       | 27/97 [00:05<00:13,  5.21it/s, loss=2.01, v_num=0]
Epoch 84:  29%|██▉       | 28/97 [00:05<00:12,  5.32it/s, loss=2.01, v_num=0]
Epoch 84:  29%|██▉       | 28/97 [00:05<00:13,  5.27it/s, loss=2, v_num=0]
Epoch 84:  30%|██▉       | 29/97 [00:05<00:12,  5.37it/s, loss=2, v_num=0]
Epoch 84:  30%|██▉       | 29/97 [00:05<00:12,  5.32it/s, loss=2.01, v_num=0]
Epoch 84:  31%|███       | 30/97 [00:05<00:12,  5.42it/s, loss=2.01, v_num=0]
Epoch 84:  31%|███       | 30/97 [00:05<00:12,  5.37it/s, loss=2.01, v_num=0]
Epoch 84:  32%|███▏      | 31/97 [00:05<00:12,  5.47it/s, loss=2.01, v_num=0]
Epoch 84:  32%|███▏      | 31/97 [00:05<00:12,  5.41it/s, loss=2, v_num=0]
Epoch 84:  33%|███▎      | 32/97 [00:05<00:11,  5.51it/s, loss=2, v_num=0]
Epoch 84:  33%|███▎      | 32/97 [00:05<00:11,  5.46it/s, loss=2, v_num=0]
Epoch 84:  34%|███▍      | 33/97 [00:05<00:11,  5.55it/s, loss=2, v_num=0]
Epoch 84:  34%|███▍      | 33/97 [00:06<00:11,  5.50it/s, loss=1.99, v_num=0]
Epoch 84:  35%|███▌      | 34/97 [00:06<00:11,  5.59it/s, loss=1.99, v_num=0]
Epoch 84:  35%|███▌      | 34/97 [00:06<00:11,  5.54it/s, loss=1.99, v_num=0]
Epoch 84:  36%|███▌      | 35/97 [00:06<00:11,  5.63it/s, loss=1.99, v_num=0]
Epoch 84:  36%|███▌      | 35/97 [00:06<00:11,  5.58it/s, loss=2, v_num=0]
Epoch 84:  37%|███▋      | 36/97 [00:06<00:10,  5.66it/s, loss=2, v_num=0]
Epoch 84:  37%|███▋      | 36/97 [00:06<00:10,  5.61it/s, loss=1.99, v_num=0]
Epoch 84:  38%|███▊      | 37/97 [00:06<00:10,  5.69it/s, loss=1.99, v_num=0]
Epoch 84:  38%|███▊      | 37/97 [00:06<00:10,  5.65it/s, loss=1.99, v_num=0]
Epoch 84:  39%|███▉      | 38/97 [00:06<00:10,  5.73it/s, loss=1.99, v_num=0]
Epoch 84:  39%|███▉      | 38/97 [00:06<00:10,  5.68it/s, loss=2, v_num=0]
Epoch 84:  40%|████      | 39/97 [00:06<00:10,  5.76it/s, loss=2, v_num=0]
Epoch 84:  40%|████      | 39/97 [00:06<00:10,  5.71it/s, loss=2, v_num=0]
Epoch 84:  41%|████      | 40/97 [00:06<00:09,  5.79it/s, loss=2, v_num=0]
Epoch 84:  41%|████      | 40/97 [00:06<00:09,  5.74it/s, loss=2.01, v_num=0]
Epoch 84:  42%|████▏     | 41/97 [00:07<00:09,  5.81it/s, loss=2.01, v_num=0]
Epoch 84:  42%|████▏     | 41/97 [00:07<00:09,  5.77it/s, loss=2, v_num=0]
Epoch 84:  43%|████▎     | 42/97 [00:07<00:09,  5.84it/s, loss=2, v_num=0]
Epoch 84:  43%|████▎     | 42/97 [00:07<00:09,  5.80it/s, loss=2.01, v_num=0]
Epoch 84:  44%|████▍     | 43/97 [00:07<00:09,  5.87it/s, loss=2.01, v_num=0]
Epoch 84:  44%|████▍     | 43/97 [00:07<00:09,  5.82it/s, loss=2.01, v_num=0]
Epoch 84:  45%|████▌     | 44/97 [00:07<00:08,  5.89it/s, loss=2.01, v_num=0]
Epoch 84:  45%|████▌     | 44/97 [00:07<00:09,  5.85it/s, loss=2.01, v_num=0]
Epoch 84:  46%|████▋     | 45/97 [00:07<00:08,  5.92it/s, loss=2.01, v_num=0]
Epoch 84:  46%|████▋     | 45/97 [00:07<00:08,  5.88it/s, loss=2.01, v_num=0]
Epoch 84:  47%|████▋     | 46/97 [00:07<00:08,  5.95it/s, loss=2.01, v_num=0]
Epoch 84:  47%|████▋     | 46/97 [00:07<00:08,  5.90it/s, loss=2, v_num=0]
Epoch 84:  48%|████▊     | 47/97 [00:07<00:08,  5.97it/s, loss=2, v_num=0]
Epoch 84:  48%|████▊     | 47/97 [00:07<00:08,  5.92it/s, loss=2, v_num=0]
Epoch 84:  49%|████▉     | 48/97 [00:08<00:08,  5.99it/s, loss=2, v_num=0]
Epoch 84:  49%|████▉     | 48/97 [00:08<00:08,  5.95it/s, loss=2, v_num=0]
Epoch 84:  51%|█████     | 49/97 [00:08<00:07,  6.01it/s, loss=2, v_num=0]
Epoch 84:  51%|█████     | 49/97 [00:08<00:08,  5.97it/s, loss=2, v_num=0]
Epoch 84:  52%|█████▏    | 50/97 [00:08<00:07,  6.03it/s, loss=2, v_num=0]
Epoch 84:  52%|█████▏    | 50/97 [00:08<00:07,  5.99it/s, loss=1.99, v_num=0]
Epoch 84:  53%|█████▎    | 51/97 [00:08<00:07,  6.05it/s, loss=1.99, v_num=0]
Epoch 84:  53%|█████▎    | 51/97 [00:08<00:07,  6.01it/s, loss=2, v_num=0]
Epoch 84:  54%|█████▎    | 52/97 [00:08<00:07,  6.07it/s, loss=2, v_num=0]
Epoch 84:  54%|█████▎    | 52/97 [00:08<00:07,  6.03it/s, loss=2.01, v_num=0]
Epoch 84:  55%|█████▍    | 53/97 [00:08<00:07,  6.09it/s, loss=2.01, v_num=0]
Epoch 84:  55%|█████▍    | 53/97 [00:08<00:07,  6.05it/s, loss=2.01, v_num=0]
Epoch 84:  56%|█████▌    | 54/97 [00:08<00:07,  6.11it/s, loss=2.01, v_num=0]
Epoch 84:  56%|█████▌    | 54/97 [00:08<00:07,  6.07it/s, loss=2, v_num=0]
Epoch 84:  57%|█████▋    | 55/97 [00:08<00:06,  6.13it/s, loss=2, v_num=0]
Epoch 84:  57%|█████▋    | 55/97 [00:09<00:06,  6.09it/s, loss=2, v_num=0]
Epoch 84:  58%|█████▊    | 56/97 [00:09<00:06,  6.14it/s, loss=2, v_num=0]
Epoch 84:  58%|█████▊    | 56/97 [00:09<00:06,  6.11it/s, loss=2.01, v_num=0]
Epoch 84:  59%|█████▉    | 57/97 [00:09<00:06,  6.16it/s, loss=2.01, v_num=0]
Epoch 84:  59%|█████▉    | 57/97 [00:09<00:06,  6.12it/s, loss=2, v_num=0]
Epoch 84:  60%|█████▉    | 58/97 [00:09<00:06,  6.18it/s, loss=2, v_num=0]
Epoch 84:  60%|█████▉    | 58/97 [00:09<00:06,  6.14it/s, loss=2, v_num=0]
Epoch 84:  61%|██████    | 59/97 [00:09<00:06,  6.19it/s, loss=2, v_num=0]
Epoch 84:  61%|██████    | 59/97 [00:09<00:06,  6.15it/s, loss=2, v_num=0]
Epoch 84:  62%|██████▏   | 60/97 [00:09<00:05,  6.21it/s, loss=2, v_num=0]
Epoch 84:  62%|██████▏   | 60/97 [00:09<00:05,  6.17it/s, loss=2, v_num=0]
Epoch 84:  63%|██████▎   | 61/97 [00:09<00:05,  6.22it/s, loss=2, v_num=0]
Epoch 84:  63%|██████▎   | 61/97 [00:09<00:05,  6.18it/s, loss=2, v_num=0]
Epoch 84:  64%|██████▍   | 62/97 [00:09<00:05,  6.23it/s, loss=2, v_num=0]
Epoch 84:  64%|██████▍   | 62/97 [00:10<00:05,  6.20it/s, loss=1.99, v_num=0]
Epoch 84:  65%|██████▍   | 63/97 [00:10<00:05,  6.24it/s, loss=1.99, v_num=0]
Epoch 84:  65%|██████▍   | 63/97 [00:10<00:05,  6.21it/s, loss=2, v_num=0]
Epoch 84:  66%|██████▌   | 64/97 [00:10<00:05,  6.26it/s, loss=2, v_num=0]
Epoch 84:  66%|██████▌   | 64/97 [00:10<00:05,  6.22it/s, loss=2, v_num=0]
Epoch 84:  67%|██████▋   | 65/97 [00:10<00:05,  6.27it/s, loss=2, v_num=0]
Epoch 84:  67%|██████▋   | 65/97 [00:10<00:05,  6.24it/s, loss=1.99, v_num=0]
Epoch 84:  68%|██████▊   | 66/97 [00:10<00:04,  6.29it/s, loss=1.99, v_num=0]
Epoch 84:  68%|██████▊   | 66/97 [00:10<00:04,  6.25it/s, loss=2, v_num=0]
Epoch 84:  69%|██████▉   | 67/97 [00:10<00:04,  6.30it/s, loss=2, v_num=0]
Epoch 84:  69%|██████▉   | 67/97 [00:10<00:04,  6.27it/s, loss=1.99, v_num=0]
Epoch 84:  70%|███████   | 68/97 [00:10<00:04,  6.31it/s, loss=1.99, v_num=0]
Epoch 84:  70%|███████   | 68/97 [00:10<00:04,  6.28it/s, loss=1.99, v_num=0]
Epoch 84:  71%|███████   | 69/97 [00:10<00:04,  6.32it/s, loss=1.99, v_num=0]
Epoch 84:  71%|███████   | 69/97 [00:10<00:04,  6.29it/s, loss=2, v_num=0]
Epoch 84:  72%|███████▏  | 70/97 [00:11<00:04,  6.33it/s, loss=2, v_num=0]
Epoch 84:  72%|███████▏  | 70/97 [00:11<00:04,  6.30it/s, loss=2, v_num=0]
Epoch 84:  73%|███████▎  | 71/97 [00:11<00:04,  6.35it/s, loss=2, v_num=0]
Epoch 84:  73%|███████▎  | 71/97 [00:11<00:04,  6.32it/s, loss=1.99, v_num=0]
Epoch 84:  74%|███████▍  | 72/97 [00:11<00:03,  6.36it/s, loss=1.99, v_num=0]
Epoch 84:  74%|███████▍  | 72/97 [00:11<00:03,  6.33it/s, loss=2, v_num=0]
Epoch 84:  75%|███████▌  | 73/97 [00:11<00:03,  6.37it/s, loss=2, v_num=0]
Epoch 84:  75%|███████▌  | 73/97 [00:11<00:03,  6.34it/s, loss=2, v_num=0]
Epoch 84:  76%|███████▋  | 74/97 [00:11<00:03,  6.38it/s, loss=2, v_num=0]
Epoch 84:  76%|███████▋  | 74/97 [00:11<00:03,  6.35it/s, loss=2.01, v_num=0]
Epoch 84:  77%|███████▋  | 75/97 [00:11<00:03,  6.39it/s, loss=2.01, v_num=0]
Epoch 84:  77%|███████▋  | 75/97 [00:11<00:03,  6.36it/s, loss=2.01, v_num=0]
Epoch 84:  78%|███████▊  | 76/97 [00:11<00:03,  6.40it/s, loss=2.01, v_num=0]
Epoch 84:  78%|███████▊  | 76/97 [00:11<00:03,  6.37it/s, loss=2.01, v_num=0]
Epoch 84:  79%|███████▉  | 77/97 [00:12<00:03,  6.41it/s, loss=2.01, v_num=0]
Epoch 84:  79%|███████▉  | 77/97 [00:12<00:03,  6.38it/s, loss=2.02, v_num=0]
Epoch 84:  80%|████████  | 78/97 [00:12<00:02,  6.42it/s, loss=2.02, v_num=0]
Epoch 84:  80%|████████  | 78/97 [00:12<00:02,  6.39it/s, loss=2.02, v_num=0]
Epoch 84:  81%|████████▏ | 79/97 [00:12<00:02,  6.43it/s, loss=2.02, v_num=0]
Epoch 84:  81%|████████▏ | 79/97 [00:12<00:02,  6.40it/s, loss=2.02, v_num=0]
Epoch 84:  82%|████████▏ | 80/97 [00:12<00:02,  6.44it/s, loss=2.02, v_num=0]
Epoch 84:  82%|████████▏ | 80/97 [00:12<00:02,  6.41it/s, loss=2.02, v_num=0]
Epoch 84:  84%|████████▎ | 81/97 [00:12<00:02,  6.45it/s, loss=2.02, v_num=0]
Epoch 84:  84%|████████▎ | 81/97 [00:12<00:02,  6.42it/s, loss=2.02, v_num=0]
Epoch 84:  85%|████████▍ | 82/97 [00:12<00:02,  6.46it/s, loss=2.02, v_num=0]
Epoch 84:  85%|████████▍ | 82/97 [00:12<00:02,  6.43it/s, loss=2.02, v_num=0]
Epoch 84:  86%|████████▌ | 83/97 [00:12<00:02,  6.47it/s, loss=2.02, v_num=0]
Epoch 84:  86%|████████▌ | 83/97 [00:12<00:02,  6.44it/s, loss=2.01, v_num=0]
Epoch 84:  87%|████████▋ | 84/97 [00:12<00:02,  6.47it/s, loss=2.01, v_num=0]
Epoch 84:  87%|████████▋ | 84/97 [00:13<00:02,  6.45it/s, loss=2.02, v_num=0]
Epoch 84:  88%|████████▊ | 85/97 [00:13<00:01,  6.48it/s, loss=2.02, v_num=0]
Epoch 84:  88%|████████▊ | 85/97 [00:13<00:01,  6.46it/s, loss=2.02, v_num=0]
Epoch 84:  89%|████████▊ | 86/97 [00:13<00:01,  6.49it/s, loss=2.02, v_num=0]
Epoch 84:  89%|████████▊ | 86/97 [00:13<00:01,  6.46it/s, loss=2.01, v_num=0]
Epoch 84:  90%|████████▉ | 87/97 [00:13<00:01,  6.50it/s, loss=2.01, v_num=0]
Epoch 84:  90%|████████▉ | 87/97 [00:13<00:01,  6.47it/s, loss=2.02, v_num=0]
Epoch 84:  91%|█████████ | 88/97 [00:13<00:01,  6.51it/s, loss=2.02, v_num=0]
Epoch 84:  91%|█████████ | 88/97 [00:13<00:01,  6.48it/s, loss=2.02, v_num=0]
Epoch 84:  92%|█████████▏| 89/97 [00:13<00:01,  6.52it/s, loss=2.02, v_num=0]
Epoch 84:  92%|█████████▏| 89/97 [00:13<00:01,  6.49it/s, loss=2.02, v_num=0]
Epoch 84:  93%|█████████▎| 90/97 [00:13<00:01,  6.53it/s, loss=2.02, v_num=0]
Epoch 84:  93%|█████████▎| 90/97 [00:13<00:01,  6.50it/s, loss=2.02, v_num=0]
Epoch 84:  94%|█████████▍| 91/97 [00:13<00:00,  6.53it/s, loss=2.02, v_num=0]
Epoch 84:  94%|█████████▍| 91/97 [00:13<00:00,  6.51it/s, loss=2.02, v_num=0]
Epoch 84:  95%|█████████▍| 92/97 [00:14<00:00,  6.54it/s, loss=2.02, v_num=0]
Epoch 84:  95%|█████████▍| 92/97 [00:14<00:00,  6.51it/s, loss=2.03, v_num=0]
Epoch 84:  96%|█████████▌| 93/97 [00:14<00:00,  6.55it/s, loss=2.03, v_num=0]
Epoch 84:  96%|█████████▌| 93/97 [00:14<00:00,  6.52it/s, loss=2.02, v_num=0]
Epoch 84:  97%|█████████▋| 94/97 [00:14<00:00,  6.55it/s, loss=2.02, v_num=0]
Epoch 84:  97%|█████████▋| 94/97 [00:14<00:00,  6.53it/s, loss=2.02, v_num=0]
Epoch 84:  98%|█████████▊| 95/97 [00:14<00:00,  6.56it/s, loss=2.02, v_num=0]
Epoch 84:  98%|█████████▊| 95/97 [00:14<00:00,  6.54it/s, loss=2.01, v_num=0]
Epoch 84:  99%|█████████▉| 96/97 [00:14<00:00,  6.57it/s, loss=2.01, v_num=0]
Epoch 84:  99%|█████████▉| 96/97 [00:14<00:00,  6.54it/s, loss=2.01, v_num=0]
Epoch 84: 100%|██████████| 97/97 [00:14<00:00,  6.58it/s, loss=2.01, v_num=0]
Epoch 84: 100%|██████████| 97/97 [00:14<00:00,  6.55it/s, loss=2.01, v_num=0]
Epoch 84: 100%|██████████| 97/97 [00:14<00:00,  6.55it/s, loss=2.01, v_num=0]
Epoch 84:   0%|          | 0/97 [00:00<?, ?it/s, loss=2.01, v_num=0]
Epoch 85:   0%|          | 0/97 [00:00<?, ?it/s, loss=2.01, v_num=0]
Epoch 85:   1%|          | 1/97 [00:01<02:19,  1.46s/it, loss=2.01, v_num=0]
Epoch 85:   1%|          | 1/97 [00:01<02:24,  1.51s/it, loss=2.01, v_num=0]
Epoch 85:   2%|▏         | 2/97 [00:01<01:15,  1.25it/s, loss=2.01, v_num=0]
Epoch 85:   2%|▏         | 2/97 [00:01<01:18,  1.21it/s, loss=2.01, v_num=0]
Epoch 85:   3%|▎         | 3/97 [00:01<00:54,  1.73it/s, loss=2.01, v_num=0]
Epoch 85:   3%|▎         | 3/97 [00:01<00:56,  1.68it/s, loss=2, v_num=0]
Epoch 85:   4%|▍         | 4/97 [00:01<00:43,  2.14it/s, loss=2, v_num=0]
Epoch 85:   4%|▍         | 4/97 [00:01<00:44,  2.08it/s, loss=2.01, v_num=0]
Epoch 85:   5%|▌         | 5/97 [00:02<00:36,  2.49it/s, loss=2.01, v_num=0]
Epoch 85:   5%|▌         | 5/97 [00:02<00:37,  2.42it/s, loss=2, v_num=0]
Epoch 85:   6%|▌         | 6/97 [00:02<00:32,  2.79it/s, loss=2, v_num=0]
Epoch 85:   6%|▌         | 6/97 [00:02<00:33,  2.72it/s, loss=2, v_num=0]
Epoch 85:   7%|▋         | 7/97 [00:02<00:29,  3.05it/s, loss=2, v_num=0]
Epoch 85:   7%|▋         | 7/97 [00:02<00:30,  2.98it/s, loss=2, v_num=0]
Epoch 85:   8%|▊         | 8/97 [00:02<00:27,  3.29it/s, loss=2, v_num=0]
Epoch 85:   8%|▊         | 8/97 [00:02<00:27,  3.22it/s, loss=1.99, v_num=0]
Epoch 85:   9%|▉         | 9/97 [00:02<00:25,  3.50it/s, loss=1.99, v_num=0]
Epoch 85:   9%|▉         | 9/97 [00:02<00:25,  3.42it/s, loss=2, v_num=0]
Epoch 85:  10%|█         | 10/97 [00:02<00:23,  3.64it/s, loss=2, v_num=0]
Epoch 85:  10%|█         | 10/97 [00:02<00:24,  3.57it/s, loss=2, v_num=0]
Epoch 85:  11%|█▏        | 11/97 [00:02<00:22,  3.80it/s, loss=2, v_num=0]
Epoch 85:  11%|█▏        | 11/97 [00:02<00:23,  3.74it/s, loss=2, v_num=0]
Epoch 85:  12%|█▏        | 12/97 [00:03<00:21,  3.97it/s, loss=2, v_num=0]
Epoch 85:  12%|█▏        | 12/97 [00:03<00:21,  3.89it/s, loss=2, v_num=0]
Epoch 85:  13%|█▎        | 13/97 [00:03<00:20,  4.11it/s, loss=2, v_num=0]
Epoch 85:  13%|█▎        | 13/97 [00:03<00:20,  4.03it/s, loss=2, v_num=0]
Epoch 85:  14%|█▍        | 14/97 [00:03<00:19,  4.23it/s, loss=2, v_num=0]
Epoch 85:  14%|█▍        | 14/97 [00:03<00:19,  4.16it/s, loss=2, v_num=0]
Epoch 85:  15%|█▌        | 15/97 [00:03<00:18,  4.35it/s, loss=2, v_num=0]
Epoch 85:  15%|█▌        | 15/97 [00:03<00:19,  4.28it/s, loss=1.99, v_num=0]
Epoch 85:  16%|█▋        | 16/97 [00:03<00:18,  4.46it/s, loss=1.99, v_num=0]
Epoch 85:  16%|█▋        | 16/97 [00:03<00:18,  4.39it/s, loss=1.99, v_num=0]
Epoch 85:  18%|█▊        | 17/97 [00:03<00:17,  4.54it/s, loss=1.99, v_num=0]
Epoch 85:  18%|█▊        | 17/97 [00:03<00:17,  4.47it/s, loss=2, v_num=0]
Epoch 85:  19%|█▊        | 18/97 [00:03<00:17,  4.62it/s, loss=2, v_num=0]
Epoch 85:  19%|█▊        | 18/97 [00:03<00:17,  4.56it/s, loss=2, v_num=0]
Epoch 85:  20%|█▉        | 19/97 [00:04<00:16,  4.71it/s, loss=2, v_num=0]
Epoch 85:  20%|█▉        | 19/97 [00:04<00:16,  4.64it/s, loss=1.99, v_num=0]
Epoch 85:  21%|██        | 20/97 [00:04<00:16,  4.78it/s, loss=1.99, v_num=0]
Epoch 85:  21%|██        | 20/97 [00:04<00:16,  4.72it/s, loss=1.99, v_num=0]
Epoch 85:  22%|██▏       | 21/97 [00:04<00:15,  4.86it/s, loss=1.99, v_num=0]
Epoch 85:  22%|██▏       | 21/97 [00:04<00:15,  4.80it/s, loss=2, v_num=0]
Epoch 85:  23%|██▎       | 22/97 [00:04<00:15,  4.93it/s, loss=2, v_num=0]
Epoch 85:  23%|██▎       | 22/97 [00:04<00:15,  4.86it/s, loss=2, v_num=0]
Epoch 85:  24%|██▎       | 23/97 [00:04<00:14,  5.00it/s, loss=2, v_num=0]
Epoch 85:  24%|██▎       | 23/97 [00:04<00:14,  4.93it/s, loss=2, v_num=0]
Epoch 85:  25%|██▍       | 24/97 [00:04<00:14,  5.06it/s, loss=2, v_num=0]
Epoch 85:  25%|██▍       | 24/97 [00:04<00:14,  5.00it/s, loss=2, v_num=0]
Epoch 85:  26%|██▌       | 25/97 [00:04<00:14,  5.12it/s, loss=2, v_num=0]
Epoch 85:  26%|██▌       | 25/97 [00:04<00:14,  5.06it/s, loss=2, v_num=0]
Epoch 85:  27%|██▋       | 26/97 [00:05<00:13,  5.18it/s, loss=2, v_num=0]
Epoch 85:  27%|██▋       | 26/97 [00:05<00:13,  5.12it/s, loss=2.01, v_num=0]
Epoch 85:  28%|██▊       | 27/97 [00:05<00:13,  5.24it/s, loss=2.01, v_num=0]
Epoch 85:  28%|██▊       | 27/97 [00:05<00:13,  5.18it/s, loss=2.01, v_num=0]
Epoch 85:  29%|██▉       | 28/97 [00:05<00:13,  5.29it/s, loss=2.01, v_num=0]
Epoch 85:  29%|██▉       | 28/97 [00:05<00:13,  5.23it/s, loss=2.01, v_num=0]
Epoch 85:  30%|██▉       | 29/97 [00:05<00:12,  5.34it/s, loss=2.01, v_num=0]
Epoch 85:  30%|██▉       | 29/97 [00:05<00:12,  5.28it/s, loss=2, v_num=0]
Epoch 85:  31%|███       | 30/97 [00:05<00:12,  5.38it/s, loss=2, v_num=0]
Epoch 85:  31%|███       | 30/97 [00:05<00:12,  5.32it/s, loss=2, v_num=0]
Epoch 85:  32%|███▏      | 31/97 [00:05<00:12,  5.42it/s, loss=2, v_num=0]
Epoch 85:  32%|███▏      | 31/97 [00:05<00:12,  5.37it/s, loss=1.99, v_num=0]
Epoch 85:  33%|███▎      | 32/97 [00:05<00:11,  5.46it/s, loss=1.99, v_num=0]
Epoch 85:  33%|███▎      | 32/97 [00:05<00:12,  5.41it/s, loss=2, v_num=0]
Epoch 85:  34%|███▍      | 33/97 [00:05<00:11,  5.50it/s, loss=2, v_num=0]
Epoch 85:  34%|███▍      | 33/97 [00:06<00:11,  5.45it/s, loss=2, v_num=0]
Epoch 85:  35%|███▌      | 34/97 [00:06<00:11,  5.54it/s, loss=2, v_num=0]
Epoch 85:  35%|███▌      | 34/97 [00:06<00:11,  5.49it/s, loss=2, v_num=0]
Epoch 85:  36%|███▌      | 35/97 [00:06<00:11,  5.58it/s, loss=2, v_num=0]
Epoch 85:  36%|███▌      | 35/97 [00:06<00:11,  5.53it/s, loss=2, v_num=0]
Epoch 85:  37%|███▋      | 36/97 [00:06<00:10,  5.61it/s, loss=2, v_num=0]
Epoch 85:  37%|███▋      | 36/97 [00:06<00:10,  5.56it/s, loss=2, v_num=0]
Epoch 85:  38%|███▊      | 37/97 [00:06<00:10,  5.65it/s, loss=2, v_num=0]
Epoch 85:  38%|███▊      | 37/97 [00:06<00:10,  5.60it/s, loss=2, v_num=0]
Epoch 85:  39%|███▉      | 38/97 [00:06<00:10,  5.67it/s, loss=2, v_num=0]
Epoch 85:  39%|███▉      | 38/97 [00:06<00:10,  5.62it/s, loss=2, v_num=0]
Epoch 85:  40%|████      | 39/97 [00:06<00:10,  5.71it/s, loss=2, v_num=0]
Epoch 85:  40%|████      | 39/97 [00:06<00:10,  5.66it/s, loss=2.01, v_num=0]
Epoch 85:  41%|████      | 40/97 [00:06<00:09,  5.74it/s, loss=2.01, v_num=0]
Epoch 85:  41%|████      | 40/97 [00:07<00:10,  5.69it/s, loss=2.01, v_num=0]
Epoch 85:  42%|████▏     | 41/97 [00:07<00:09,  5.76it/s, loss=2.01, v_num=0]
Epoch 85:  42%|████▏     | 41/97 [00:07<00:09,  5.71it/s, loss=2, v_num=0]
Epoch 85:  43%|████▎     | 42/97 [00:07<00:09,  5.78it/s, loss=2, v_num=0]
Epoch 85:  43%|████▎     | 42/97 [00:07<00:09,  5.74it/s, loss=2, v_num=0]
Epoch 85:  44%|████▍     | 43/97 [00:07<00:09,  5.81it/s, loss=2, v_num=0]
Epoch 85:  44%|████▍     | 43/97 [00:07<00:09,  5.77it/s, loss=2, v_num=0]
Epoch 85:  45%|████▌     | 44/97 [00:07<00:09,  5.83it/s, loss=2, v_num=0]
Epoch 85:  45%|████▌     | 44/97 [00:07<00:09,  5.79it/s, loss=2, v_num=0]
Epoch 85:  46%|████▋     | 45/97 [00:07<00:08,  5.86it/s, loss=2, v_num=0]
Epoch 85:  46%|████▋     | 45/97 [00:07<00:08,  5.81it/s, loss=2, v_num=0]
Epoch 85:  47%|████▋     | 46/97 [00:07<00:08,  5.88it/s, loss=2, v_num=0]
Epoch 85:  47%|████▋     | 46/97 [00:07<00:08,  5.84it/s, loss=2, v_num=0]
Epoch 85:  48%|████▊     | 47/97 [00:07<00:08,  5.90it/s, loss=2, v_num=0]
Epoch 85:  48%|████▊     | 47/97 [00:08<00:08,  5.86it/s, loss=2, v_num=0]
Epoch 85:  49%|████▉     | 48/97 [00:08<00:08,  5.92it/s, loss=2, v_num=0]
Epoch 85:  49%|████▉     | 48/97 [00:08<00:08,  5.88it/s, loss=2, v_num=0]
Epoch 85:  51%|█████     | 49/97 [00:08<00:08,  5.94it/s, loss=2, v_num=0]
Epoch 85:  51%|█████     | 49/97 [00:08<00:08,  5.90it/s, loss=2.01, v_num=0]
Epoch 85:  52%|█████▏    | 50/97 [00:08<00:07,  5.96it/s, loss=2.01, v_num=0]
Epoch 85:  52%|█████▏    | 50/97 [00:08<00:07,  5.92it/s, loss=2.01, v_num=0]
Epoch 85:  53%|█████▎    | 51/97 [00:08<00:07,  5.98it/s, loss=2.01, v_num=0]
Epoch 85:  53%|█████▎    | 51/97 [00:08<00:07,  5.94it/s, loss=2, v_num=0]
Epoch 85:  54%|█████▎    | 52/97 [00:08<00:07,  6.00it/s, loss=2, v_num=0]
Epoch 85:  54%|█████▎    | 52/97 [00:08<00:07,  5.96it/s, loss=2, v_num=0]
Epoch 85:  55%|█████▍    | 53/97 [00:08<00:07,  6.01it/s, loss=2, v_num=0]
Epoch 85:  55%|█████▍    | 53/97 [00:08<00:07,  5.97it/s, loss=1.99, v_num=0]
Epoch 85:  56%|█████▌    | 54/97 [00:08<00:07,  6.03it/s, loss=1.99, v_num=0]
Epoch 85:  56%|█████▌    | 54/97 [00:09<00:07,  5.99it/s, loss=1.99, v_num=0]
Epoch 85:  57%|█████▋    | 55/97 [00:09<00:06,  6.04it/s, loss=1.99, v_num=0]
Epoch 85:  57%|█████▋    | 55/97 [00:09<00:06,  6.01it/s, loss=1.99, v_num=0]
Epoch 85:  58%|█████▊    | 56/97 [00:09<00:06,  6.06it/s, loss=1.99, v_num=0]
Epoch 85:  58%|█████▊    | 56/97 [00:09<00:06,  6.02it/s, loss=1.98, v_num=0]
Epoch 85:  59%|█████▉    | 57/97 [00:09<00:06,  6.08it/s, loss=1.98, v_num=0]
Epoch 85:  59%|█████▉    | 57/97 [00:09<00:06,  6.04it/s, loss=1.98, v_num=0]
Epoch 85:  60%|█████▉    | 58/97 [00:09<00:06,  6.09it/s, loss=1.98, v_num=0]
Epoch 85:  60%|█████▉    | 58/97 [00:09<00:06,  6.06it/s, loss=1.97, v_num=0]
Epoch 85:  61%|██████    | 59/97 [00:09<00:06,  6.11it/s, loss=1.97, v_num=0]
Epoch 85:  61%|██████    | 59/97 [00:09<00:06,  6.08it/s, loss=1.96, v_num=0]
Epoch 85:  62%|██████▏   | 60/97 [00:09<00:06,  6.12it/s, loss=1.96, v_num=0]
Epoch 85:  62%|██████▏   | 60/97 [00:09<00:06,  6.09it/s, loss=1.97, v_num=0]
Epoch 85:  63%|██████▎   | 61/97 [00:09<00:05,  6.13it/s, loss=1.97, v_num=0]
Epoch 85:  63%|██████▎   | 61/97 [00:10<00:05,  6.10it/s, loss=1.97, v_num=0]
Epoch 85:  64%|██████▍   | 62/97 [00:10<00:05,  6.15it/s, loss=1.97, v_num=0]
Epoch 85:  64%|██████▍   | 62/97 [00:10<00:05,  6.12it/s, loss=1.96, v_num=0]
Epoch 85:  65%|██████▍   | 63/97 [00:10<00:05,  6.16it/s, loss=1.96, v_num=0]
Epoch 85:  65%|██████▍   | 63/97 [00:10<00:05,  6.13it/s, loss=1.96, v_num=0]
Epoch 85:  66%|██████▌   | 64/97 [00:10<00:05,  6.18it/s, loss=1.96, v_num=0]
Epoch 85:  66%|██████▌   | 64/97 [00:10<00:05,  6.15it/s, loss=1.97, v_num=0]
Epoch 85:  67%|██████▋   | 65/97 [00:10<00:05,  6.19it/s, loss=1.97, v_num=0]
Epoch 85:  67%|██████▋   | 65/97 [00:10<00:05,  6.16it/s, loss=1.96, v_num=0]
Epoch 85:  68%|██████▊   | 66/97 [00:10<00:04,  6.21it/s, loss=1.96, v_num=0]
Epoch 85:  68%|██████▊   | 66/97 [00:10<00:05,  6.17it/s, loss=1.97, v_num=0]
Epoch 85:  69%|██████▉   | 67/97 [00:10<00:04,  6.22it/s, loss=1.97, v_num=0]
Epoch 85:  69%|██████▉   | 67/97 [00:10<00:04,  6.19it/s, loss=1.97, v_num=0]
Epoch 85:  70%|███████   | 68/97 [00:10<00:04,  6.23it/s, loss=1.97, v_num=0]
Epoch 85:  70%|███████   | 68/97 [00:10<00:04,  6.20it/s, loss=1.97, v_num=0]
Epoch 85:  71%|███████   | 69/97 [00:11<00:04,  6.24it/s, loss=1.97, v_num=0]
Epoch 85:  71%|███████   | 69/97 [00:11<00:04,  6.21it/s, loss=1.96, v_num=0]
Epoch 85:  72%|███████▏  | 70/97 [00:11<00:04,  6.25it/s, loss=1.96, v_num=0]
Epoch 85:  72%|███████▏  | 70/97 [00:11<00:04,  6.22it/s, loss=1.97, v_num=0]
Epoch 85:  73%|███████▎  | 71/97 [00:11<00:04,  6.26it/s, loss=1.97, v_num=0]
Epoch 85:  73%|███████▎  | 71/97 [00:11<00:04,  6.24it/s, loss=1.97, v_num=0]
Epoch 85:  74%|███████▍  | 72/97 [00:11<00:03,  6.28it/s, loss=1.97, v_num=0]
Epoch 85:  74%|███████▍  | 72/97 [00:11<00:04,  6.25it/s, loss=1.98, v_num=0]
Epoch 85:  75%|███████▌  | 73/97 [00:11<00:03,  6.29it/s, loss=1.98, v_num=0]
Epoch 85:  75%|███████▌  | 73/97 [00:11<00:03,  6.26it/s, loss=1.99, v_num=0]
Epoch 85:  76%|███████▋  | 74/97 [00:11<00:03,  6.30it/s, loss=1.99, v_num=0]
Epoch 85:  76%|███████▋  | 74/97 [00:11<00:03,  6.27it/s, loss=1.99, v_num=0]
Epoch 85:  77%|███████▋  | 75/97 [00:11<00:03,  6.31it/s, loss=1.99, v_num=0]
Epoch 85:  77%|███████▋  | 75/97 [00:11<00:03,  6.28it/s, loss=1.99, v_num=0]
Epoch 85:  78%|███████▊  | 76/97 [00:12<00:03,  6.32it/s, loss=1.99, v_num=0]
Epoch 85:  78%|███████▊  | 76/97 [00:12<00:03,  6.30it/s, loss=1.99, v_num=0]
Epoch 85:  79%|███████▉  | 77/97 [00:12<00:03,  6.33it/s, loss=1.99, v_num=0]
Epoch 85:  79%|███████▉  | 77/97 [00:12<00:03,  6.31it/s, loss=2, v_num=0]
Epoch 85:  80%|████████  | 78/97 [00:12<00:02,  6.35it/s, loss=2, v_num=0]
Epoch 85:  80%|████████  | 78/97 [00:12<00:03,  6.32it/s, loss=2, v_num=0]
Epoch 85:  81%|████████▏ | 79/97 [00:12<00:02,  6.36it/s, loss=2, v_num=0]
Epoch 85:  81%|████████▏ | 79/97 [00:12<00:02,  6.33it/s, loss=2, v_num=0]
Epoch 85:  82%|████████▏ | 80/97 [00:12<00:02,  6.36it/s, loss=2, v_num=0]
Epoch 85:  82%|████████▏ | 80/97 [00:12<00:02,  6.34it/s, loss=2, v_num=0]
Epoch 85:  84%|████████▎ | 81/97 [00:12<00:02,  6.37it/s, loss=2, v_num=0]
Epoch 85:  84%|████████▎ | 81/97 [00:12<00:02,  6.35it/s, loss=2, v_num=0]
Epoch 85:  85%|████████▍ | 82/97 [00:12<00:02,  6.38it/s, loss=2, v_num=0]
Epoch 85:  85%|████████▍ | 82/97 [00:12<00:02,  6.35it/s, loss=1.99, v_num=0]
Epoch 85:  86%|████████▌ | 83/97 [00:12<00:02,  6.39it/s, loss=1.99, v_num=0]
Epoch 85:  86%|████████▌ | 83/97 [00:13<00:02,  6.36it/s, loss=1.98, v_num=0]
Epoch 85:  87%|████████▋ | 84/97 [00:13<00:02,  6.40it/s, loss=1.98, v_num=0]
Epoch 85:  87%|████████▋ | 84/97 [00:13<00:02,  6.37it/s, loss=1.98, v_num=0]
Epoch 85:  88%|████████▊ | 85/97 [00:13<00:01,  6.41it/s, loss=1.98, v_num=0]
Epoch 85:  88%|████████▊ | 85/97 [00:13<00:01,  6.38it/s, loss=1.99, v_num=0]
Epoch 85:  89%|████████▊ | 86/97 [00:13<00:01,  6.42it/s, loss=1.99, v_num=0]
Epoch 85:  89%|████████▊ | 86/97 [00:13<00:01,  6.39it/s, loss=1.98, v_num=0]
Epoch 85:  90%|████████▉ | 87/97 [00:13<00:01,  6.43it/s, loss=1.98, v_num=0]
Epoch 85:  90%|████████▉ | 87/97 [00:13<00:01,  6.40it/s, loss=1.98, v_num=0]
Epoch 85:  91%|█████████ | 88/97 [00:13<00:01,  6.43it/s, loss=1.98, v_num=0]
Epoch 85:  91%|█████████ | 88/97 [00:13<00:01,  6.41it/s, loss=1.98, v_num=0]
Epoch 85:  92%|█████████▏| 89/97 [00:13<00:01,  6.44it/s, loss=1.98, v_num=0]
Epoch 85:  92%|█████████▏| 89/97 [00:13<00:01,  6.42it/s, loss=1.98, v_num=0]
Epoch 85:  93%|█████████▎| 90/97 [00:13<00:01,  6.45it/s, loss=1.98, v_num=0]
Epoch 85:  93%|█████████▎| 90/97 [00:14<00:01,  6.43it/s, loss=1.98, v_num=0]
Epoch 85:  94%|█████████▍| 91/97 [00:14<00:00,  6.46it/s, loss=1.98, v_num=0]
Epoch 85:  94%|█████████▍| 91/97 [00:14<00:00,  6.44it/s, loss=1.97, v_num=0]
Epoch 85:  95%|█████████▍| 92/97 [00:14<00:00,  6.47it/s, loss=1.97, v_num=0]
Epoch 85:  95%|█████████▍| 92/97 [00:14<00:00,  6.44it/s, loss=1.97, v_num=0]
Epoch 85:  96%|█████████▌| 93/97 [00:14<00:00,  6.48it/s, loss=1.97, v_num=0]
Epoch 85:  96%|█████████▌| 93/97 [00:14<00:00,  6.45it/s, loss=1.98, v_num=0]
Epoch 85:  97%|█████████▋| 94/97 [00:14<00:00,  6.48it/s, loss=1.98, v_num=0]
Epoch 85:  97%|█████████▋| 94/97 [00:14<00:00,  6.46it/s, loss=1.97, v_num=0]
Epoch 85:  98%|█████████▊| 95/97 [00:14<00:00,  6.49it/s, loss=1.97, v_num=0]
Epoch 85:  98%|█████████▊| 95/97 [00:14<00:00,  6.46it/s, loss=1.98, v_num=0]
Epoch 85:  99%|█████████▉| 96/97 [00:14<00:00,  6.50it/s, loss=1.98, v_num=0]
Epoch 85:  99%|█████████▉| 96/97 [00:14<00:00,  6.47it/s, loss=1.98, v_num=0]
Epoch 85: 100%|██████████| 97/97 [00:14<00:00,  6.50it/s, loss=1.98, v_num=0]
Epoch 85: 100%|██████████| 97/97 [00:14<00:00,  6.48it/s, loss=1.98, v_num=0]
Epoch 85: 100%|██████████| 97/97 [00:14<00:00,  6.48it/s, loss=1.98, v_num=0]
Epoch 85:   0%|          | 0/97 [00:00<?, ?it/s, loss=1.98, v_num=0]
Epoch 86:   0%|          | 0/97 [00:00<?, ?it/s, loss=1.98, v_num=0]
Epoch 86:   1%|          | 1/97 [00:01<02:20,  1.46s/it, loss=1.98, v_num=0]
Epoch 86:   1%|          | 1/97 [00:01<02:25,  1.51s/it, loss=1.98, v_num=0]
Epoch 86:   2%|▏         | 2/97 [00:01<01:15,  1.26it/s, loss=1.98, v_num=0]
Epoch 86:   2%|▏         | 2/97 [00:01<01:18,  1.21it/s, loss=1.98, v_num=0]
Epoch 86:   3%|▎         | 3/97 [00:01<00:54,  1.73it/s, loss=1.98, v_num=0]
Epoch 86:   3%|▎         | 3/97 [00:01<00:55,  1.68it/s, loss=1.98, v_num=0]
Epoch 86:   4%|▍         | 4/97 [00:01<00:43,  2.14it/s, loss=1.98, v_num=0]
Epoch 86:   4%|▍         | 4/97 [00:01<00:44,  2.08it/s, loss=1.99, v_num=0]
Epoch 86:   5%|▌         | 5/97 [00:02<00:36,  2.49it/s, loss=1.99, v_num=0]
Epoch 86:   5%|▌         | 5/97 [00:02<00:37,  2.42it/s, loss=1.99, v_num=0]
Epoch 86:   6%|▌         | 6/97 [00:02<00:32,  2.80it/s, loss=1.99, v_num=0]
Epoch 86:   6%|▌         | 6/97 [00:02<00:33,  2.72it/s, loss=2, v_num=0]
Epoch 86:   7%|▋         | 7/97 [00:02<00:29,  3.07it/s, loss=2, v_num=0]
Epoch 86:   7%|▋         | 7/97 [00:02<00:30,  2.99it/s, loss=2, v_num=0]
Epoch 86:   8%|▊         | 8/97 [00:02<00:26,  3.31it/s, loss=2, v_num=0]
Epoch 86:   8%|▊         | 8/97 [00:02<00:27,  3.23it/s, loss=2, v_num=0]
Epoch 86:   9%|▉         | 9/97 [00:02<00:25,  3.50it/s, loss=2, v_num=0]
Epoch 86:   9%|▉         | 9/97 [00:02<00:25,  3.43it/s, loss=2.01, v_num=0]
Epoch 86:  10%|█         | 10/97 [00:02<00:23,  3.70it/s, loss=2.01, v_num=0]
Epoch 86:  10%|█         | 10/97 [00:02<00:24,  3.62it/s, loss=2.01, v_num=0]
Epoch 86:  11%|█▏        | 11/97 [00:02<00:22,  3.87it/s, loss=2.01, v_num=0]
Epoch 86:  11%|█▏        | 11/97 [00:02<00:22,  3.79it/s, loss=2.02, v_num=0]
Epoch 86:  12%|█▏        | 12/97 [00:02<00:21,  4.03it/s, loss=2.02, v_num=0]
Epoch 86:  12%|█▏        | 12/97 [00:03<00:21,  3.95it/s, loss=2.01, v_num=0]
Epoch 86:  13%|█▎        | 13/97 [00:03<00:20,  4.18it/s, loss=2.01, v_num=0]
Epoch 86:  13%|█▎        | 13/97 [00:03<00:20,  4.10it/s, loss=2, v_num=0]
Epoch 86:  14%|█▍        | 14/97 [00:03<00:19,  4.30it/s, loss=2, v_num=0]
Epoch 86:  14%|█▍        | 14/97 [00:03<00:19,  4.23it/s, loss=2.01, v_num=0]
Epoch 86:  15%|█▌        | 15/97 [00:03<00:18,  4.42it/s, loss=2.01, v_num=0]
Epoch 86:  15%|█▌        | 15/97 [00:03<00:18,  4.35it/s, loss=2.02, v_num=0]
Epoch 86:  16%|█▋        | 16/97 [00:03<00:17,  4.54it/s, loss=2.02, v_num=0]
Epoch 86:  16%|█▋        | 16/97 [00:03<00:18,  4.47it/s, loss=2.01, v_num=0]
Epoch 86:  18%|█▊        | 17/97 [00:03<00:17,  4.64it/s, loss=2.01, v_num=0]
Epoch 86:  18%|█▊        | 17/97 [00:03<00:17,  4.57it/s, loss=2.02, v_num=0]
Epoch 86:  19%|█▊        | 18/97 [00:03<00:16,  4.73it/s, loss=2.02, v_num=0]
Epoch 86:  19%|█▊        | 18/97 [00:03<00:16,  4.67it/s, loss=2.01, v_num=0]
Epoch 86:  20%|█▉        | 19/97 [00:03<00:16,  4.82it/s, loss=2.01, v_num=0]
Epoch 86:  20%|█▉        | 19/97 [00:03<00:16,  4.75it/s, loss=2.01, v_num=0]
Epoch 86:  21%|██        | 20/97 [00:04<00:15,  4.90it/s, loss=2.01, v_num=0]
Epoch 86:  21%|██        | 20/97 [00:04<00:15,  4.84it/s, loss=2.01, v_num=0]
Epoch 86:  22%|██▏       | 21/97 [00:04<00:15,  4.98it/s, loss=2.01, v_num=0]
Epoch 86:  22%|██▏       | 21/97 [00:04<00:15,  4.92it/s, loss=2.01, v_num=0]
Epoch 86:  23%|██▎       | 22/97 [00:04<00:14,  5.06it/s, loss=2.01, v_num=0]
Epoch 86:  23%|██▎       | 22/97 [00:04<00:15,  4.99it/s, loss=2.01, v_num=0]
Epoch 86:  24%|██▎       | 23/97 [00:04<00:14,  5.12it/s, loss=2.01, v_num=0]
Epoch 86:  24%|██▎       | 23/97 [00:04<00:14,  5.06it/s, loss=2.01, v_num=0]
Epoch 86:  25%|██▍       | 24/97 [00:04<00:14,  5.19it/s, loss=2.01, v_num=0]
Epoch 86:  25%|██▍       | 24/97 [00:04<00:14,  5.13it/s, loss=2.01, v_num=0]
Epoch 86:  26%|██▌       | 25/97 [00:04<00:13,  5.25it/s, loss=2.01, v_num=0]
Epoch 86:  26%|██▌       | 25/97 [00:04<00:13,  5.19it/s, loss=2.01, v_num=0]
Epoch 86:  27%|██▋       | 26/97 [00:04<00:13,  5.30it/s, loss=2.01, v_num=0]
Epoch 86:  27%|██▋       | 26/97 [00:04<00:13,  5.25it/s, loss=2.01, v_num=0]
Epoch 86:  28%|██▊       | 27/97 [00:05<00:13,  5.35it/s, loss=2.01, v_num=0]
Epoch 86:  28%|██▊       | 27/97 [00:05<00:13,  5.30it/s, loss=2.02, v_num=0]
Epoch 86:  29%|██▉       | 28/97 [00:05<00:12,  5.40it/s, loss=2.02, v_num=0]
Epoch 86:  29%|██▉       | 28/97 [00:05<00:12,  5.35it/s, loss=2.01, v_num=0]
Epoch 86:  30%|██▉       | 29/97 [00:05<00:12,  5.45it/s, loss=2.01, v_num=0]
Epoch 86:  30%|██▉       | 29/97 [00:05<00:12,  5.39it/s, loss=2.02, v_num=0]
Epoch 86:  31%|███       | 30/97 [00:05<00:12,  5.49it/s, loss=2.02, v_num=0]
Epoch 86:  31%|███       | 30/97 [00:05<00:12,  5.44it/s, loss=2.02, v_num=0]
Epoch 86:  32%|███▏      | 31/97 [00:05<00:11,  5.54it/s, loss=2.02, v_num=0]
Epoch 86:  32%|███▏      | 31/97 [00:05<00:12,  5.48it/s, loss=2.01, v_num=0]
Epoch 86:  33%|███▎      | 32/97 [00:05<00:11,  5.58it/s, loss=2.01, v_num=0]
Epoch 86:  33%|███▎      | 32/97 [00:05<00:11,  5.52it/s, loss=2.01, v_num=0]
Epoch 86:  34%|███▍      | 33/97 [00:05<00:11,  5.62it/s, loss=2.01, v_num=0]
Epoch 86:  34%|███▍      | 33/97 [00:05<00:11,  5.56it/s, loss=2.01, v_num=0]
Epoch 86:  35%|███▌      | 34/97 [00:06<00:11,  5.65it/s, loss=2.01, v_num=0]
Epoch 86:  35%|███▌      | 34/97 [00:06<00:11,  5.60it/s, loss=2, v_num=0]
Epoch 86:  36%|███▌      | 35/97 [00:06<00:10,  5.69it/s, loss=2, v_num=0]
Epoch 86:  36%|███▌      | 35/97 [00:06<00:10,  5.64it/s, loss=2, v_num=0]
Epoch 86:  37%|███▋      | 36/97 [00:06<00:10,  5.72it/s, loss=2, v_num=0]
Epoch 86:  37%|███▋      | 36/97 [00:06<00:10,  5.67it/s, loss=2, v_num=0]
Epoch 86:  38%|███▊      | 37/97 [00:06<00:10,  5.75it/s, loss=2, v_num=0]
Epoch 86:  38%|███▊      | 37/97 [00:06<00:10,  5.70it/s, loss=1.99, v_num=0]
Epoch 86:  39%|███▉      | 38/97 [00:06<00:10,  5.78it/s, loss=1.99, v_num=0]
Epoch 86:  39%|███▉      | 38/97 [00:06<00:10,  5.74it/s, loss=2, v_num=0]
Epoch 86:  40%|████      | 39/97 [00:06<00:09,  5.81it/s, loss=2, v_num=0]
Epoch 86:  40%|████      | 39/97 [00:06<00:10,  5.77it/s, loss=1.99, v_num=0]
Epoch 86:  41%|████      | 40/97 [00:06<00:09,  5.84it/s, loss=1.99, v_num=0]
Epoch 86:  41%|████      | 40/97 [00:06<00:09,  5.79it/s, loss=1.98, v_num=0]
Epoch 86:  42%|████▏     | 41/97 [00:06<00:09,  5.87it/s, loss=1.98, v_num=0]
Epoch 86:  42%|████▏     | 41/97 [00:07<00:09,  5.82it/s, loss=1.98, v_num=0]
Epoch 86:  43%|████▎     | 42/97 [00:07<00:09,  5.89it/s, loss=1.98, v_num=0]
Epoch 86:  43%|████▎     | 42/97 [00:07<00:09,  5.84it/s, loss=1.98, v_num=0]
Epoch 86:  44%|████▍     | 43/97 [00:07<00:09,  5.91it/s, loss=1.98, v_num=0]
Epoch 86:  44%|████▍     | 43/97 [00:07<00:09,  5.87it/s, loss=1.98, v_num=0]
Epoch 86:  45%|████▌     | 44/97 [00:07<00:08,  5.94it/s, loss=1.98, v_num=0]
Epoch 86:  45%|████▌     | 44/97 [00:07<00:08,  5.89it/s, loss=1.98, v_num=0]
Epoch 86:  46%|████▋     | 45/97 [00:07<00:08,  5.96it/s, loss=1.98, v_num=0]
Epoch 86:  46%|████▋     | 45/97 [00:07<00:08,  5.91it/s, loss=1.98, v_num=0]
Epoch 86:  47%|████▋     | 46/97 [00:07<00:08,  5.98it/s, loss=1.98, v_num=0]
Epoch 86:  47%|████▋     | 46/97 [00:07<00:08,  5.93it/s, loss=1.98, v_num=0]
Epoch 86:  48%|████▊     | 47/97 [00:07<00:08,  6.00it/s, loss=1.98, v_num=0]
Epoch 86:  48%|████▊     | 47/97 [00:07<00:08,  5.96it/s, loss=1.97, v_num=0]
Epoch 86:  49%|████▉     | 48/97 [00:07<00:08,  6.02it/s, loss=1.97, v_num=0]
Epoch 86:  49%|████▉     | 48/97 [00:08<00:08,  5.97it/s, loss=1.97, v_num=0]
Epoch 86:  51%|█████     | 49/97 [00:08<00:07,  6.04it/s, loss=1.97, v_num=0]
Epoch 86:  51%|█████     | 49/97 [00:08<00:08,  6.00it/s, loss=1.96, v_num=0]
Epoch 86:  52%|█████▏    | 50/97 [00:08<00:07,  6.06it/s, loss=1.96, v_num=0]
Epoch 86:  52%|█████▏    | 50/97 [00:08<00:07,  6.01it/s, loss=1.96, v_num=0]
Epoch 86:  53%|█████▎    | 51/97 [00:08<00:07,  6.07it/s, loss=1.96, v_num=0]
Epoch 86:  53%|█████▎    | 51/97 [00:08<00:07,  6.03it/s, loss=1.96, v_num=0]
Epoch 86:  54%|█████▎    | 52/97 [00:08<00:07,  6.09it/s, loss=1.96, v_num=0]
Epoch 86:  54%|█████▎    | 52/97 [00:08<00:07,  6.05it/s, loss=1.95, v_num=0]
Epoch 86:  55%|█████▍    | 53/97 [00:08<00:07,  6.11it/s, loss=1.95, v_num=0]
Epoch 86:  55%|█████▍    | 53/97 [00:08<00:07,  6.07it/s, loss=1.96, v_num=0]
Epoch 86:  56%|█████▌    | 54/97 [00:08<00:07,  6.13it/s, loss=1.96, v_num=0]
Epoch 86:  56%|█████▌    | 54/97 [00:08<00:07,  6.09it/s, loss=1.96, v_num=0]
Epoch 86:  57%|█████▋    | 55/97 [00:08<00:06,  6.14it/s, loss=1.96, v_num=0]
Epoch 86:  57%|█████▋    | 55/97 [00:09<00:06,  6.10it/s, loss=1.96, v_num=0]
Epoch 86:  58%|█████▊    | 56/97 [00:09<00:06,  6.16it/s, loss=1.96, v_num=0]
Epoch 86:  58%|█████▊    | 56/97 [00:09<00:06,  6.12it/s, loss=1.96, v_num=0]
Epoch 86:  59%|█████▉    | 57/97 [00:09<00:06,  6.18it/s, loss=1.96, v_num=0]
Epoch 86:  59%|█████▉    | 57/97 [00:09<00:06,  6.14it/s, loss=1.96, v_num=0]
Epoch 86:  60%|█████▉    | 58/97 [00:09<00:06,  6.19it/s, loss=1.96, v_num=0]
Epoch 86:  60%|█████▉    | 58/97 [00:09<00:06,  6.16it/s, loss=1.96, v_num=0]
Epoch 86:  61%|██████    | 59/97 [00:09<00:06,  6.21it/s, loss=1.96, v_num=0]
Epoch 86:  61%|██████    | 59/97 [00:09<00:06,  6.17it/s, loss=1.96, v_num=0]
Epoch 86:  62%|██████▏   | 60/97 [00:09<00:05,  6.22it/s, loss=1.96, v_num=0]
Epoch 86:  62%|██████▏   | 60/97 [00:09<00:05,  6.18it/s, loss=1.97, v_num=0]
Epoch 86:  63%|██████▎   | 61/97 [00:09<00:05,  6.23it/s, loss=1.97, v_num=0]
Epoch 86:  63%|██████▎   | 61/97 [00:09<00:05,  6.19it/s, loss=1.97, v_num=0]
Epoch 86:  64%|██████▍   | 62/97 [00:09<00:05,  6.24it/s, loss=1.97, v_num=0]
Epoch 86:  64%|██████▍   | 62/97 [00:09<00:05,  6.20it/s, loss=1.97, v_num=0]
Epoch 86:  65%|██████▍   | 63/97 [00:10<00:05,  6.25it/s, loss=1.97, v_num=0]
Epoch 86:  65%|██████▍   | 63/97 [00:10<00:05,  6.21it/s, loss=1.97, v_num=0]
Epoch 86:  66%|██████▌   | 64/97 [00:10<00:05,  6.26it/s, loss=1.97, v_num=0]
Epoch 86:  66%|██████▌   | 64/97 [00:10<00:05,  6.22it/s, loss=1.96, v_num=0]
Epoch 86:  67%|██████▋   | 65/97 [00:10<00:05,  6.27it/s, loss=1.96, v_num=0]
Epoch 86:  67%|██████▋   | 65/97 [00:10<00:05,  6.23it/s, loss=1.96, v_num=0]
Epoch 86:  68%|██████▊   | 66/97 [00:10<00:04,  6.27it/s, loss=1.96, v_num=0]
Epoch 86:  68%|██████▊   | 66/97 [00:10<00:04,  6.24it/s, loss=1.96, v_num=0]
Epoch 86:  69%|██████▉   | 67/97 [00:10<00:04,  6.28it/s, loss=1.96, v_num=0]
Epoch 86:  69%|██████▉   | 67/97 [00:10<00:04,  6.25it/s, loss=1.96, v_num=0]
Epoch 86:  70%|███████   | 68/97 [00:10<00:04,  6.29it/s, loss=1.96, v_num=0]
Epoch 86:  70%|███████   | 68/97 [00:10<00:04,  6.26it/s, loss=1.97, v_num=0]
Epoch 86:  71%|███████   | 69/97 [00:10<00:04,  6.30it/s, loss=1.97, v_num=0]
Epoch 86:  71%|███████   | 69/97 [00:11<00:04,  6.27it/s, loss=1.97, v_num=0]
Epoch 86:  72%|███████▏  | 70/97 [00:11<00:04,  6.31it/s, loss=1.97, v_num=0]
Epoch 86:  72%|███████▏  | 70/97 [00:11<00:04,  6.28it/s, loss=1.98, v_num=0]
Epoch 86:  73%|███████▎  | 71/97 [00:11<00:04,  6.32it/s, loss=1.98, v_num=0]
Epoch 86:  73%|███████▎  | 71/97 [00:11<00:04,  6.29it/s, loss=1.98, v_num=0]
Epoch 86:  74%|███████▍  | 72/97 [00:11<00:03,  6.33it/s, loss=1.98, v_num=0]
Epoch 86:  74%|███████▍  | 72/97 [00:11<00:03,  6.30it/s, loss=1.98, v_num=0]
Epoch 86:  75%|███████▌  | 73/97 [00:11<00:03,  6.33it/s, loss=1.98, v_num=0]
Epoch 86:  75%|███████▌  | 73/97 [00:11<00:03,  6.30it/s, loss=1.98, v_num=0]
Epoch 86:  76%|███████▋  | 74/97 [00:11<00:03,  6.34it/s, loss=1.98, v_num=0]
Epoch 86:  76%|███████▋  | 74/97 [00:11<00:03,  6.31it/s, loss=1.98, v_num=0]
Epoch 86:  77%|███████▋  | 75/97 [00:11<00:03,  6.36it/s, loss=1.98, v_num=0]
Epoch 86:  77%|███████▋  | 75/97 [00:11<00:03,  6.32it/s, loss=1.98, v_num=0]
Epoch 86:  78%|███████▊  | 76/97 [00:11<00:03,  6.36it/s, loss=1.98, v_num=0]
Epoch 86:  78%|███████▊  | 76/97 [00:11<00:03,  6.33it/s, loss=1.99, v_num=0]
Epoch 86:  79%|███████▉  | 77/97 [00:12<00:03,  6.37it/s, loss=1.99, v_num=0]
Epoch 86:  79%|███████▉  | 77/97 [00:12<00:03,  6.34it/s, loss=2, v_num=0]
Epoch 86:  80%|████████  | 78/97 [00:12<00:02,  6.38it/s, loss=2, v_num=0]
Epoch 86:  80%|████████  | 78/97 [00:12<00:02,  6.35it/s, loss=1.99, v_num=0]
Epoch 86:  81%|████████▏ | 79/97 [00:12<00:02,  6.39it/s, loss=1.99, v_num=0]
Epoch 86:  81%|████████▏ | 79/97 [00:12<00:02,  6.36it/s, loss=1.99, v_num=0]
Epoch 86:  82%|████████▏ | 80/97 [00:12<00:02,  6.39it/s, loss=1.99, v_num=0]
Epoch 86:  82%|████████▏ | 80/97 [00:12<00:02,  6.36it/s, loss=1.99, v_num=0]
Epoch 86:  84%|████████▎ | 81/97 [00:12<00:02,  6.40it/s, loss=1.99, v_num=0]
Epoch 86:  84%|████████▎ | 81/97 [00:12<00:02,  6.37it/s, loss=1.99, v_num=0]
Epoch 86:  85%|████████▍ | 82/97 [00:12<00:02,  6.40it/s, loss=1.99, v_num=0]
Epoch 86:  85%|████████▍ | 82/97 [00:12<00:02,  6.37it/s, loss=1.99, v_num=0]
Epoch 86:  86%|████████▌ | 83/97 [00:12<00:02,  6.41it/s, loss=1.99, v_num=0]
Epoch 86:  86%|████████▌ | 83/97 [00:13<00:02,  6.38it/s, loss=1.99, v_num=0]
Epoch 86:  87%|████████▋ | 84/97 [00:13<00:02,  6.41it/s, loss=1.99, v_num=0]
Epoch 86:  87%|████████▋ | 84/97 [00:13<00:02,  6.38it/s, loss=1.99, v_num=0]
Epoch 86:  88%|████████▊ | 85/97 [00:13<00:01,  6.42it/s, loss=1.99, v_num=0]
Epoch 86:  88%|████████▊ | 85/97 [00:13<00:01,  6.39it/s, loss=1.99, v_num=0]
Epoch 86:  89%|████████▊ | 86/97 [00:13<00:01,  6.42it/s, loss=1.99, v_num=0]
Epoch 86:  89%|████████▊ | 86/97 [00:13<00:01,  6.40it/s, loss=1.99, v_num=0]
Epoch 86:  90%|████████▉ | 87/97 [00:13<00:01,  6.43it/s, loss=1.99, v_num=0]
Epoch 86:  90%|████████▉ | 87/97 [00:13<00:01,  6.40it/s, loss=2, v_num=0]
Epoch 86:  91%|█████████ | 88/97 [00:13<00:01,  6.44it/s, loss=2, v_num=0]
Epoch 86:  91%|█████████ | 88/97 [00:13<00:01,  6.41it/s, loss=2, v_num=0]
Epoch 86:  92%|█████████▏| 89/97 [00:13<00:01,  6.45it/s, loss=2, v_num=0]
Epoch 86:  92%|█████████▏| 89/97 [00:13<00:01,  6.42it/s, loss=1.99, v_num=0]
Epoch 86:  93%|█████████▎| 90/97 [00:13<00:01,  6.45it/s, loss=1.99, v_num=0]
Epoch 86:  93%|█████████▎| 90/97 [00:14<00:01,  6.43it/s, loss=1.99, v_num=0]
Epoch 86:  94%|█████████▍| 91/97 [00:14<00:00,  6.46it/s, loss=1.99, v_num=0]
Epoch 86:  94%|█████████▍| 91/97 [00:14<00:00,  6.43it/s, loss=2, v_num=0]
Epoch 86:  95%|█████████▍| 92/97 [00:14<00:00,  6.47it/s, loss=2, v_num=0]
Epoch 86:  95%|█████████▍| 92/97 [00:14<00:00,  6.44it/s, loss=2, v_num=0]
Epoch 86:  96%|█████████▌| 93/97 [00:14<00:00,  6.47it/s, loss=2, v_num=0]
Epoch 86:  96%|█████████▌| 93/97 [00:14<00:00,  6.45it/s, loss=1.99, v_num=0]
Epoch 86:  97%|█████████▋| 94/97 [00:14<00:00,  6.48it/s, loss=1.99, v_num=0]
Epoch 86:  97%|█████████▋| 94/97 [00:14<00:00,  6.45it/s, loss=1.98, v_num=0]
Epoch 86:  98%|█████████▊| 95/97 [00:14<00:00,  6.49it/s, loss=1.98, v_num=0]
Epoch 86:  98%|█████████▊| 95/97 [00:14<00:00,  6.46it/s, loss=1.98, v_num=0]
Epoch 86:  99%|█████████▉| 96/97 [00:14<00:00,  6.49it/s, loss=1.98, v_num=0]
Epoch 86:  99%|█████████▉| 96/97 [00:14<00:00,  6.47it/s, loss=1.98, v_num=0]
Epoch 86: 100%|██████████| 97/97 [00:14<00:00,  6.50it/s, loss=1.98, v_num=0]
Epoch 86: 100%|██████████| 97/97 [00:14<00:00,  6.47it/s, loss=1.98, v_num=0]
Epoch 86: 100%|██████████| 97/97 [00:14<00:00,  6.47it/s, loss=1.98, v_num=0]
Epoch 86:   0%|          | 0/97 [00:00<?, ?it/s, loss=1.98, v_num=0]
Epoch 87:   0%|          | 0/97 [00:00<?, ?it/s, loss=1.98, v_num=0]
Epoch 87:   1%|          | 1/97 [00:01<02:31,  1.58s/it, loss=1.98, v_num=0]
Epoch 87:   1%|          | 1/97 [00:01<02:36,  1.63s/it, loss=1.98, v_num=0]
Epoch 87:   2%|▏         | 2/97 [00:01<01:21,  1.16it/s, loss=1.98, v_num=0]
Epoch 87:   2%|▏         | 2/97 [00:01<01:24,  1.12it/s, loss=1.98, v_num=0]
Epoch 87:   3%|▎         | 3/97 [00:01<00:58,  1.61it/s, loss=1.98, v_num=0]
Epoch 87:   3%|▎         | 3/97 [00:01<01:00,  1.56it/s, loss=1.99, v_num=0]
Epoch 87:   4%|▍         | 4/97 [00:02<00:46,  2.00it/s, loss=1.99, v_num=0]
Epoch 87:   4%|▍         | 4/97 [00:02<00:47,  1.94it/s, loss=1.99, v_num=0]
Epoch 87:   5%|▌         | 5/97 [00:02<00:39,  2.33it/s, loss=1.99, v_num=0]
Epoch 87:   5%|▌         | 5/97 [00:02<00:40,  2.27it/s, loss=1.98, v_num=0]
Epoch 87:   6%|▌         | 6/97 [00:02<00:34,  2.62it/s, loss=1.98, v_num=0]
Epoch 87:   6%|▌         | 6/97 [00:02<00:35,  2.56it/s, loss=1.98, v_num=0]
Epoch 87:   7%|▋         | 7/97 [00:02<00:31,  2.89it/s, loss=1.98, v_num=0]
Epoch 87:   7%|▋         | 7/97 [00:02<00:31,  2.82it/s, loss=1.98, v_num=0]
Epoch 87:   8%|▊         | 8/97 [00:02<00:28,  3.12it/s, loss=1.98, v_num=0]
Epoch 87:   8%|▊         | 8/97 [00:02<00:29,  3.05it/s, loss=1.99, v_num=0]
Epoch 87:   9%|▉         | 9/97 [00:02<00:26,  3.33it/s, loss=1.99, v_num=0]
Epoch 87:   9%|▉         | 9/97 [00:02<00:27,  3.26it/s, loss=1.98, v_num=0]
Epoch 87:  10%|█         | 10/97 [00:02<00:24,  3.51it/s, loss=1.98, v_num=0]
Epoch 87:  10%|█         | 10/97 [00:02<00:25,  3.44it/s, loss=1.97, v_num=0]
Epoch 87:  11%|█▏        | 11/97 [00:02<00:23,  3.69it/s, loss=1.97, v_num=0]
Epoch 87:  11%|█▏        | 11/97 [00:03<00:23,  3.62it/s, loss=1.97, v_num=0]
Epoch 87:  12%|█▏        | 12/97 [00:03<00:22,  3.84it/s, loss=1.97, v_num=0]
Epoch 87:  12%|█▏        | 12/97 [00:03<00:22,  3.77it/s, loss=1.97, v_num=0]
Epoch 87:  13%|█▎        | 13/97 [00:03<00:21,  3.99it/s, loss=1.97, v_num=0]
Epoch 87:  13%|█▎        | 13/97 [00:03<00:21,  3.92it/s, loss=1.97, v_num=0]
Epoch 87:  14%|█▍        | 14/97 [00:03<00:20,  4.12it/s, loss=1.97, v_num=0]
Epoch 87:  14%|█▍        | 14/97 [00:03<00:20,  4.06it/s, loss=1.96, v_num=0]
Epoch 87:  15%|█▌        | 15/97 [00:03<00:19,  4.25it/s, loss=1.96, v_num=0]
Epoch 87:  15%|█▌        | 15/97 [00:03<00:19,  4.18it/s, loss=1.97, v_num=0]
Epoch 87:  16%|█▋        | 16/97 [00:03<00:18,  4.36it/s, loss=1.97, v_num=0]
Epoch 87:  16%|█▋        | 16/97 [00:03<00:18,  4.30it/s, loss=1.97, v_num=0]
Epoch 87:  18%|█▊        | 17/97 [00:03<00:17,  4.46it/s, loss=1.97, v_num=0]
Epoch 87:  18%|█▊        | 17/97 [00:03<00:18,  4.40it/s, loss=1.98, v_num=0]
Epoch 87:  19%|█▊        | 18/97 [00:03<00:17,  4.55it/s, loss=1.98, v_num=0]
Epoch 87:  19%|█▊        | 18/97 [00:04<00:17,  4.49it/s, loss=1.98, v_num=0]
Epoch 87:  20%|█▉        | 19/97 [00:04<00:16,  4.64it/s, loss=1.98, v_num=0]
Epoch 87:  20%|█▉        | 19/97 [00:04<00:17,  4.58it/s, loss=1.98, v_num=0]
Epoch 87:  21%|██        | 20/97 [00:04<00:16,  4.73it/s, loss=1.98, v_num=0]
Epoch 87:  21%|██        | 20/97 [00:04<00:16,  4.67it/s, loss=1.98, v_num=0]
Epoch 87:  22%|██▏       | 21/97 [00:04<00:15,  4.81it/s, loss=1.98, v_num=0]
Epoch 87:  22%|██▏       | 21/97 [00:04<00:16,  4.75it/s, loss=1.98, v_num=0]
Epoch 87:  23%|██▎       | 22/97 [00:04<00:15,  4.89it/s, loss=1.98, v_num=0]
Epoch 87:  23%|██▎       | 22/97 [00:04<00:15,  4.83it/s, loss=1.98, v_num=0]
Epoch 87:  24%|██▎       | 23/97 [00:04<00:14,  4.96it/s, loss=1.98, v_num=0]
Epoch 87:  24%|██▎       | 23/97 [00:04<00:15,  4.90it/s, loss=1.97, v_num=0]
Epoch 87:  25%|██▍       | 24/97 [00:04<00:14,  5.02it/s, loss=1.97, v_num=0]
Epoch 87:  25%|██▍       | 24/97 [00:04<00:14,  4.96it/s, loss=1.97, v_num=0]
Epoch 87:  26%|██▌       | 25/97 [00:04<00:14,  5.08it/s, loss=1.97, v_num=0]
Epoch 87:  26%|██▌       | 25/97 [00:04<00:14,  5.03it/s, loss=1.98, v_num=0]
Epoch 87:  27%|██▋       | 26/97 [00:05<00:13,  5.14it/s, loss=1.98, v_num=0]
Epoch 87:  27%|██▋       | 26/97 [00:05<00:13,  5.09it/s, loss=1.98, v_num=0]
Epoch 87:  28%|██▊       | 27/97 [00:05<00:13,  5.20it/s, loss=1.98, v_num=0]
Epoch 87:  28%|██▊       | 27/97 [00:05<00:13,  5.15it/s, loss=1.98, v_num=0]
Epoch 87:  29%|██▉       | 28/97 [00:05<00:13,  5.25it/s, loss=1.98, v_num=0]
Epoch 87:  29%|██▉       | 28/97 [00:05<00:13,  5.20it/s, loss=1.97, v_num=0]
Epoch 87:  30%|██▉       | 29/97 [00:05<00:12,  5.30it/s, loss=1.97, v_num=0]
Epoch 87:  30%|██▉       | 29/97 [00:05<00:12,  5.25it/s, loss=1.98, v_num=0]
Epoch 87:  31%|███       | 30/97 [00:05<00:12,  5.35it/s, loss=1.98, v_num=0]
Epoch 87:  31%|███       | 30/97 [00:05<00:12,  5.30it/s, loss=1.99, v_num=0]
Epoch 87:  32%|███▏      | 31/97 [00:05<00:12,  5.39it/s, loss=1.99, v_num=0]
Epoch 87:  32%|███▏      | 31/97 [00:05<00:12,  5.34it/s, loss=1.99, v_num=0]
Epoch 87:  33%|███▎      | 32/97 [00:05<00:11,  5.44it/s, loss=1.99, v_num=0]
Epoch 87:  33%|███▎      | 32/97 [00:05<00:12,  5.39it/s, loss=1.99, v_num=0]
Epoch 87:  34%|███▍      | 33/97 [00:06<00:11,  5.48it/s, loss=1.99, v_num=0]
Epoch 87:  34%|███▍      | 33/97 [00:06<00:11,  5.43it/s, loss=1.99, v_num=0]
Epoch 87:  35%|███▌      | 34/97 [00:06<00:11,  5.52it/s, loss=1.99, v_num=0]
Epoch 87:  35%|███▌      | 34/97 [00:06<00:11,  5.47it/s, loss=1.99, v_num=0]
Epoch 87:  36%|███▌      | 35/97 [00:06<00:11,  5.54it/s, loss=1.99, v_num=0]
Epoch 87:  36%|███▌      | 35/97 [00:06<00:11,  5.49it/s, loss=1.99, v_num=0]
Epoch 87:  37%|███▋      | 36/97 [00:06<00:10,  5.57it/s, loss=1.99, v_num=0]
Epoch 87:  37%|███▋      | 36/97 [00:06<00:11,  5.52it/s, loss=1.99, v_num=0]
Epoch 87:  38%|███▊      | 37/97 [00:06<00:10,  5.59it/s, loss=1.99, v_num=0]
Epoch 87:  38%|███▊      | 37/97 [00:06<00:10,  5.55it/s, loss=1.99, v_num=0]
Epoch 87:  39%|███▉      | 38/97 [00:06<00:10,  5.63it/s, loss=1.99, v_num=0]
Epoch 87:  39%|███▉      | 38/97 [00:06<00:10,  5.59it/s, loss=1.98, v_num=0]
Epoch 87:  40%|████      | 39/97 [00:06<00:10,  5.65it/s, loss=1.98, v_num=0]
Epoch 87:  40%|████      | 39/97 [00:06<00:10,  5.60it/s, loss=1.97, v_num=0]
Epoch 87:  41%|████      | 40/97 [00:07<00:10,  5.67it/s, loss=1.97, v_num=0]
Epoch 87:  41%|████      | 40/97 [00:07<00:10,  5.62it/s, loss=1.97, v_num=0]
Epoch 87:  42%|████▏     | 41/97 [00:07<00:09,  5.70it/s, loss=1.97, v_num=0]
Epoch 87:  42%|████▏     | 41/97 [00:07<00:09,  5.65it/s, loss=1.96, v_num=0]
Epoch 87:  43%|████▎     | 42/97 [00:07<00:09,  5.73it/s, loss=1.96, v_num=0]
Epoch 87:  43%|████▎     | 42/97 [00:07<00:09,  5.68it/s, loss=1.98, v_num=0]
Epoch 87:  44%|████▍     | 43/97 [00:07<00:09,  5.76it/s, loss=1.98, v_num=0]
Epoch 87:  44%|████▍     | 43/97 [00:07<00:09,  5.71it/s, loss=1.98, v_num=0]
Epoch 87:  45%|████▌     | 44/97 [00:07<00:09,  5.78it/s, loss=1.98, v_num=0]
Epoch 87:  45%|████▌     | 44/97 [00:07<00:09,  5.74it/s, loss=1.98, v_num=0]
Epoch 87:  46%|████▋     | 45/97 [00:07<00:08,  5.81it/s, loss=1.98, v_num=0]
Epoch 87:  46%|████▋     | 45/97 [00:07<00:09,  5.77it/s, loss=1.98, v_num=0]
Epoch 87:  47%|████▋     | 46/97 [00:07<00:08,  5.84it/s, loss=1.98, v_num=0]
Epoch 87:  47%|████▋     | 46/97 [00:07<00:08,  5.80it/s, loss=1.98, v_num=0]
Epoch 87:  48%|████▊     | 47/97 [00:08<00:08,  5.86it/s, loss=1.98, v_num=0]
Epoch 87:  48%|████▊     | 47/97 [00:08<00:08,  5.82it/s, loss=1.97, v_num=0]
Epoch 87:  49%|████▉     | 48/97 [00:08<00:08,  5.88it/s, loss=1.97, v_num=0]
Epoch 87:  49%|████▉     | 48/97 [00:08<00:08,  5.85it/s, loss=1.97, v_num=0]
Epoch 87:  51%|█████     | 49/97 [00:08<00:08,  5.91it/s, loss=1.97, v_num=0]
Epoch 87:  51%|█████     | 49/97 [00:08<00:08,  5.87it/s, loss=1.97, v_num=0]
Epoch 87:  52%|█████▏    | 50/97 [00:08<00:07,  5.93it/s, loss=1.97, v_num=0]
Epoch 87:  52%|█████▏    | 50/97 [00:08<00:07,  5.89it/s, loss=1.97, v_num=0]
Epoch 87:  53%|█████▎    | 51/97 [00:08<00:07,  5.95it/s, loss=1.97, v_num=0]
Epoch 87:  53%|█████▎    | 51/97 [00:08<00:07,  5.91it/s, loss=1.97, v_num=0]
Epoch 87:  54%|█████▎    | 52/97 [00:08<00:07,  5.97it/s, loss=1.97, v_num=0]
Epoch 87:  54%|█████▎    | 52/97 [00:08<00:07,  5.93it/s, loss=1.97, v_num=0]
Epoch 87:  55%|█████▍    | 53/97 [00:08<00:07,  5.99it/s, loss=1.97, v_num=0]
Epoch 87:  55%|█████▍    | 53/97 [00:08<00:07,  5.95it/s, loss=1.98, v_num=0]
Epoch 87:  56%|█████▌    | 54/97 [00:08<00:07,  6.01it/s, loss=1.98, v_num=0]
Epoch 87:  56%|█████▌    | 54/97 [00:09<00:07,  5.98it/s, loss=1.97, v_num=0]
Epoch 87:  57%|█████▋    | 55/97 [00:09<00:06,  6.03it/s, loss=1.97, v_num=0]
Epoch 87:  57%|█████▋    | 55/97 [00:09<00:07,  5.99it/s, loss=1.97, v_num=0]
Epoch 87:  58%|█████▊    | 56/97 [00:09<00:06,  6.04it/s, loss=1.97, v_num=0]
Epoch 87:  58%|█████▊    | 56/97 [00:09<00:06,  6.01it/s, loss=1.97, v_num=0]
Epoch 87:  59%|█████▉    | 57/97 [00:09<00:06,  6.06it/s, loss=1.97, v_num=0]
Epoch 87:  59%|█████▉    | 57/97 [00:09<00:06,  6.03it/s, loss=1.97, v_num=0]
Epoch 87:  60%|█████▉    | 58/97 [00:09<00:06,  6.08it/s, loss=1.97, v_num=0]
Epoch 87:  60%|█████▉    | 58/97 [00:09<00:06,  6.04it/s, loss=1.97, v_num=0]
Epoch 87:  61%|██████    | 59/97 [00:09<00:06,  6.10it/s, loss=1.97, v_num=0]
Epoch 87:  61%|██████    | 59/97 [00:09<00:06,  6.06it/s, loss=1.98, v_num=0]
Epoch 87:  62%|██████▏   | 60/97 [00:09<00:06,  6.12it/s, loss=1.98, v_num=0]
Epoch 87:  62%|██████▏   | 60/97 [00:09<00:06,  6.08it/s, loss=1.98, v_num=0]
Epoch 87:  63%|██████▎   | 61/97 [00:09<00:05,  6.13it/s, loss=1.98, v_num=0]
Epoch 87:  63%|██████▎   | 61/97 [00:10<00:05,  6.10it/s, loss=1.98, v_num=0]
Epoch 87:  64%|██████▍   | 62/97 [00:10<00:05,  6.14it/s, loss=1.98, v_num=0]
Epoch 87:  64%|██████▍   | 62/97 [00:10<00:05,  6.11it/s, loss=1.98, v_num=0]
Epoch 87:  65%|██████▍   | 63/97 [00:10<00:05,  6.16it/s, loss=1.98, v_num=0]
Epoch 87:  65%|██████▍   | 63/97 [00:10<00:05,  6.13it/s, loss=1.98, v_num=0]
Epoch 87:  66%|██████▌   | 64/97 [00:10<00:05,  6.17it/s, loss=1.98, v_num=0]
Epoch 87:  66%|██████▌   | 64/97 [00:10<00:05,  6.14it/s, loss=1.98, v_num=0]
Epoch 87:  67%|██████▋   | 65/97 [00:10<00:05,  6.19it/s, loss=1.98, v_num=0]
Epoch 87:  67%|██████▋   | 65/97 [00:10<00:05,  6.16it/s, loss=1.98, v_num=0]
Epoch 87:  68%|██████▊   | 66/97 [00:10<00:04,  6.20it/s, loss=1.98, v_num=0]
Epoch 87:  68%|██████▊   | 66/97 [00:10<00:05,  6.17it/s, loss=1.98, v_num=0]
Epoch 87:  69%|██████▉   | 67/97 [00:10<00:04,  6.21it/s, loss=1.98, v_num=0]
Epoch 87:  69%|██████▉   | 67/97 [00:10<00:04,  6.18it/s, loss=1.98, v_num=0]
Epoch 87:  70%|███████   | 68/97 [00:10<00:04,  6.23it/s, loss=1.98, v_num=0]
Epoch 87:  70%|███████   | 68/97 [00:10<00:04,  6.20it/s, loss=1.98, v_num=0]
Epoch 87:  71%|███████   | 69/97 [00:11<00:04,  6.24it/s, loss=1.98, v_num=0]
Epoch 87:  71%|███████   | 69/97 [00:11<00:04,  6.21it/s, loss=1.98, v_num=0]
Epoch 87:  72%|███████▏  | 70/97 [00:11<00:04,  6.25it/s, loss=1.98, v_num=0]
Epoch 87:  72%|███████▏  | 70/97 [00:11<00:04,  6.22it/s, loss=1.98, v_num=0]
Epoch 87:  73%|███████▎  | 71/97 [00:11<00:04,  6.26it/s, loss=1.98, v_num=0]
Epoch 87:  73%|███████▎  | 71/97 [00:11<00:04,  6.23it/s, loss=1.98, v_num=0]
Epoch 87:  74%|███████▍  | 72/97 [00:11<00:03,  6.27it/s, loss=1.98, v_num=0]
Epoch 87:  74%|███████▍  | 72/97 [00:11<00:04,  6.24it/s, loss=1.98, v_num=0]
Epoch 87:  75%|███████▌  | 73/97 [00:11<00:03,  6.28it/s, loss=1.98, v_num=0]
Epoch 87:  75%|███████▌  | 73/97 [00:11<00:03,  6.25it/s, loss=1.98, v_num=0]
Epoch 87:  76%|███████▋  | 74/97 [00:11<00:03,  6.29it/s, loss=1.98, v_num=0]
Epoch 87:  76%|███████▋  | 74/97 [00:11<00:03,  6.27it/s, loss=1.98, v_num=0]
Epoch 87:  77%|███████▋  | 75/97 [00:11<00:03,  6.31it/s, loss=1.98, v_num=0]
Epoch 87:  77%|███████▋  | 75/97 [00:11<00:03,  6.28it/s, loss=1.98, v_num=0]
Epoch 87:  78%|███████▊  | 76/97 [00:12<00:03,  6.32it/s, loss=1.98, v_num=0]
Epoch 87:  78%|███████▊  | 76/97 [00:12<00:03,  6.29it/s, loss=1.98, v_num=0]
Epoch 87:  79%|███████▉  | 77/97 [00:12<00:03,  6.33it/s, loss=1.98, v_num=0]
Epoch 87:  79%|███████▉  | 77/97 [00:12<00:03,  6.30it/s, loss=1.98, v_num=0]
Epoch 87:  80%|████████  | 78/97 [00:12<00:02,  6.34it/s, loss=1.98, v_num=0]
Epoch 87:  80%|████████  | 78/97 [00:12<00:03,  6.31it/s, loss=1.98, v_num=0]
Epoch 87:  81%|████████▏ | 79/97 [00:12<00:02,  6.35it/s, loss=1.98, v_num=0]
Epoch 87:  81%|████████▏ | 79/97 [00:12<00:02,  6.32it/s, loss=1.98, v_num=0]
Epoch 87:  82%|████████▏ | 80/97 [00:12<00:02,  6.36it/s, loss=1.98, v_num=0]
Epoch 87:  82%|████████▏ | 80/97 [00:12<00:02,  6.33it/s, loss=1.98, v_num=0]
Epoch 87:  84%|████████▎ | 81/97 [00:12<00:02,  6.37it/s, loss=1.98, v_num=0]
Epoch 87:  84%|████████▎ | 81/97 [00:12<00:02,  6.34it/s, loss=1.98, v_num=0]
Epoch 87:  85%|████████▍ | 82/97 [00:12<00:02,  6.38it/s, loss=1.98, v_num=0]
Epoch 87:  85%|████████▍ | 82/97 [00:12<00:02,  6.35it/s, loss=1.97, v_num=0]
Epoch 87:  86%|████████▌ | 83/97 [00:12<00:02,  6.39it/s, loss=1.97, v_num=0]
Epoch 87:  86%|████████▌ | 83/97 [00:13<00:02,  6.36it/s, loss=1.97, v_num=0]
Epoch 87:  87%|████████▋ | 84/97 [00:13<00:02,  6.40it/s, loss=1.97, v_num=0]
Epoch 87:  87%|████████▋ | 84/97 [00:13<00:02,  6.37it/s, loss=1.97, v_num=0]
Epoch 87:  88%|████████▊ | 85/97 [00:13<00:01,  6.40it/s, loss=1.97, v_num=0]
Epoch 87:  88%|████████▊ | 85/97 [00:13<00:01,  6.38it/s, loss=1.97, v_num=0]
Epoch 87:  89%|████████▊ | 86/97 [00:13<00:01,  6.41it/s, loss=1.97, v_num=0]
Epoch 87:  89%|████████▊ | 86/97 [00:13<00:01,  6.39it/s, loss=1.97, v_num=0]
Epoch 87:  90%|████████▉ | 87/97 [00:13<00:01,  6.42it/s, loss=1.97, v_num=0]
Epoch 87:  90%|████████▉ | 87/97 [00:13<00:01,  6.40it/s, loss=1.97, v_num=0]
Epoch 87:  91%|█████████ | 88/97 [00:13<00:01,  6.43it/s, loss=1.97, v_num=0]
Epoch 87:  91%|█████████ | 88/97 [00:13<00:01,  6.40it/s, loss=1.98, v_num=0]
Epoch 87:  92%|█████████▏| 89/97 [00:13<00:01,  6.44it/s, loss=1.98, v_num=0]
Epoch 87:  92%|█████████▏| 89/97 [00:13<00:01,  6.41it/s, loss=1.97, v_num=0]
Epoch 87:  93%|█████████▎| 90/97 [00:13<00:01,  6.45it/s, loss=1.97, v_num=0]
Epoch 87:  93%|█████████▎| 90/97 [00:14<00:01,  6.42it/s, loss=1.97, v_num=0]
Epoch 87:  94%|█████████▍| 91/97 [00:14<00:00,  6.46it/s, loss=1.97, v_num=0]
Epoch 87:  94%|█████████▍| 91/97 [00:14<00:00,  6.43it/s, loss=1.98, v_num=0]
Epoch 87:  95%|█████████▍| 92/97 [00:14<00:00,  6.46it/s, loss=1.98, v_num=0]
Epoch 87:  95%|█████████▍| 92/97 [00:14<00:00,  6.44it/s, loss=1.99, v_num=0]
Epoch 87:  96%|█████████▌| 93/97 [00:14<00:00,  6.47it/s, loss=1.99, v_num=0]
Epoch 87:  96%|█████████▌| 93/97 [00:14<00:00,  6.45it/s, loss=1.98, v_num=0]
Epoch 87:  97%|█████████▋| 94/97 [00:14<00:00,  6.48it/s, loss=1.98, v_num=0]
Epoch 87:  97%|█████████▋| 94/97 [00:14<00:00,  6.46it/s, loss=1.98, v_num=0]
Epoch 87:  98%|█████████▊| 95/97 [00:14<00:00,  6.49it/s, loss=1.98, v_num=0]
Epoch 87:  98%|█████████▊| 95/97 [00:14<00:00,  6.46it/s, loss=1.99, v_num=0]
Epoch 87:  99%|█████████▉| 96/97 [00:14<00:00,  6.50it/s, loss=1.99, v_num=0]
Epoch 87:  99%|█████████▉| 96/97 [00:14<00:00,  6.47it/s, loss=1.99, v_num=0]
Epoch 87: 100%|██████████| 97/97 [00:14<00:00,  6.50it/s, loss=1.99, v_num=0]
Epoch 87: 100%|██████████| 97/97 [00:14<00:00,  6.48it/s, loss=1.99, v_num=0]
Epoch 87: 100%|██████████| 97/97 [00:14<00:00,  6.48it/s, loss=1.99, v_num=0]
Epoch 87:   0%|          | 0/97 [00:00<?, ?it/s, loss=1.99, v_num=0]
Epoch 88:   0%|          | 0/97 [00:00<?, ?it/s, loss=1.99, v_num=0]
Epoch 88:   1%|          | 1/97 [00:01<02:14,  1.40s/it, loss=1.99, v_num=0]
Epoch 88:   1%|          | 1/97 [00:01<02:20,  1.46s/it, loss=1.99, v_num=0]
Epoch 88:   2%|▏         | 2/97 [00:01<01:13,  1.30it/s, loss=1.99, v_num=0]
Epoch 88:   2%|▏         | 2/97 [00:01<01:15,  1.25it/s, loss=1.99, v_num=0]
Epoch 88:   3%|▎         | 3/97 [00:01<00:52,  1.79it/s, loss=1.99, v_num=0]
Epoch 88:   3%|▎         | 3/97 [00:01<00:54,  1.73it/s, loss=1.99, v_num=0]
Epoch 88:   4%|▍         | 4/97 [00:01<00:42,  2.21it/s, loss=1.99, v_num=0]
Epoch 88:   4%|▍         | 4/97 [00:01<00:43,  2.14it/s, loss=1.99, v_num=0]
Epoch 88:   5%|▌         | 5/97 [00:01<00:35,  2.56it/s, loss=1.99, v_num=0]
Epoch 88:   5%|▌         | 5/97 [00:02<00:36,  2.49it/s, loss=1.99, v_num=0]
Epoch 88:   6%|▌         | 6/97 [00:02<00:31,  2.87it/s, loss=1.99, v_num=0]
Epoch 88:   6%|▌         | 6/97 [00:02<00:32,  2.80it/s, loss=2, v_num=0]
Epoch 88:   7%|▋         | 7/97 [00:02<00:28,  3.15it/s, loss=2, v_num=0]
Epoch 88:   7%|▋         | 7/97 [00:02<00:29,  3.07it/s, loss=2, v_num=0]
Epoch 88:   8%|▊         | 8/97 [00:02<00:26,  3.39it/s, loss=2, v_num=0]
Epoch 88:   8%|▊         | 8/97 [00:02<00:26,  3.31it/s, loss=2.01, v_num=0]
Epoch 88:   9%|▉         | 9/97 [00:02<00:24,  3.60it/s, loss=2.01, v_num=0]
Epoch 88:   9%|▉         | 9/97 [00:02<00:24,  3.52it/s, loss=2.01, v_num=0]
Epoch 88:  10%|█         | 10/97 [00:02<00:22,  3.79it/s, loss=2.01, v_num=0]
Epoch 88:  10%|█         | 10/97 [00:02<00:23,  3.70it/s, loss=2.01, v_num=0]
Epoch 88:  11%|█▏        | 11/97 [00:02<00:21,  3.96it/s, loss=2.01, v_num=0]
Epoch 88:  11%|█▏        | 11/97 [00:02<00:22,  3.88it/s, loss=2.01, v_num=0]
Epoch 88:  12%|█▏        | 12/97 [00:02<00:20,  4.10it/s, loss=2.01, v_num=0]
Epoch 88:  12%|█▏        | 12/97 [00:02<00:21,  4.03it/s, loss=2.01, v_num=0]
Epoch 88:  13%|█▎        | 13/97 [00:03<00:19,  4.25it/s, loss=2.01, v_num=0]
Epoch 88:  13%|█▎        | 13/97 [00:03<00:20,  4.17it/s, loss=2.01, v_num=0]
Epoch 88:  14%|█▍        | 14/97 [00:03<00:18,  4.38it/s, loss=2.01, v_num=0]
Epoch 88:  14%|█▍        | 14/97 [00:03<00:19,  4.31it/s, loss=2, v_num=0]
Epoch 88:  15%|█▌        | 15/97 [00:03<00:18,  4.50it/s, loss=2, v_num=0]
Epoch 88:  15%|█▌        | 15/97 [00:03<00:18,  4.43it/s, loss=1.99, v_num=0]
Epoch 88:  16%|█▋        | 16/97 [00:03<00:17,  4.62it/s, loss=1.99, v_num=0]
Epoch 88:  16%|█▋        | 16/97 [00:03<00:17,  4.54it/s, loss=1.99, v_num=0]
Epoch 88:  18%|█▊        | 17/97 [00:03<00:16,  4.71it/s, loss=1.99, v_num=0]
Epoch 88:  18%|█▊        | 17/97 [00:03<00:17,  4.64it/s, loss=1.99, v_num=0]
Epoch 88:  19%|█▊        | 18/97 [00:03<00:16,  4.81it/s, loss=1.99, v_num=0]
Epoch 88:  19%|█▊        | 18/97 [00:03<00:16,  4.74it/s, loss=1.98, v_num=0]
Epoch 88:  20%|█▉        | 19/97 [00:03<00:15,  4.89it/s, loss=1.98, v_num=0]
Epoch 88:  20%|█▉        | 19/97 [00:03<00:16,  4.82it/s, loss=1.98, v_num=0]
Epoch 88:  21%|██        | 20/97 [00:04<00:15,  4.97it/s, loss=1.98, v_num=0]
Epoch 88:  21%|██        | 20/97 [00:04<00:15,  4.91it/s, loss=1.98, v_num=0]
Epoch 88:  22%|██▏       | 21/97 [00:04<00:15,  5.05it/s, loss=1.98, v_num=0]
Epoch 88:  22%|██▏       | 21/97 [00:04<00:15,  4.99it/s, loss=1.97, v_num=0]
Epoch 88:  23%|██▎       | 22/97 [00:04<00:14,  5.13it/s, loss=1.97, v_num=0]
Epoch 88:  23%|██▎       | 22/97 [00:04<00:14,  5.06it/s, loss=1.98, v_num=0]
Epoch 88:  24%|██▎       | 23/97 [00:04<00:14,  5.19it/s, loss=1.98, v_num=0]
Epoch 88:  24%|██▎       | 23/97 [00:04<00:14,  5.13it/s, loss=1.98, v_num=0]
Epoch 88:  25%|██▍       | 24/97 [00:04<00:13,  5.25it/s, loss=1.98, v_num=0]
Epoch 88:  25%|██▍       | 24/97 [00:04<00:14,  5.19it/s, loss=1.97, v_num=0]
Epoch 88:  26%|██▌       | 25/97 [00:04<00:13,  5.31it/s, loss=1.97, v_num=0]
Epoch 88:  26%|██▌       | 25/97 [00:04<00:13,  5.25it/s, loss=1.98, v_num=0]
Epoch 88:  27%|██▋       | 26/97 [00:04<00:13,  5.37it/s, loss=1.98, v_num=0]
Epoch 88:  27%|██▋       | 26/97 [00:04<00:13,  5.30it/s, loss=1.98, v_num=0]
Epoch 88:  28%|██▊       | 27/97 [00:04<00:12,  5.42it/s, loss=1.98, v_num=0]
Epoch 88:  28%|██▊       | 27/97 [00:05<00:13,  5.36it/s, loss=1.97, v_num=0]
Epoch 88:  29%|██▉       | 28/97 [00:05<00:12,  5.47it/s, loss=1.97, v_num=0]
Epoch 88:  29%|██▉       | 28/97 [00:05<00:12,  5.41it/s, loss=1.97, v_num=0]
Epoch 88:  30%|██▉       | 29/97 [00:05<00:12,  5.50it/s, loss=1.97, v_num=0]
Epoch 88:  30%|██▉       | 29/97 [00:05<00:12,  5.44it/s, loss=1.96, v_num=0]
Epoch 88:  31%|███       | 30/97 [00:05<00:12,  5.54it/s, loss=1.96, v_num=0]
Epoch 88:  31%|███       | 30/97 [00:05<00:12,  5.49it/s, loss=1.96, v_num=0]
Epoch 88:  32%|███▏      | 31/97 [00:05<00:11,  5.58it/s, loss=1.96, v_num=0]
Epoch 88:  32%|███▏      | 31/97 [00:05<00:11,  5.52it/s, loss=1.96, v_num=0]
Epoch 88:  33%|███▎      | 32/97 [00:05<00:11,  5.61it/s, loss=1.96, v_num=0]
Epoch 88:  33%|███▎      | 32/97 [00:05<00:11,  5.56it/s, loss=1.97, v_num=0]
Epoch 88:  34%|███▍      | 33/97 [00:05<00:11,  5.65it/s, loss=1.97, v_num=0]
Epoch 88:  34%|███▍      | 33/97 [00:05<00:11,  5.59it/s, loss=1.96, v_num=0]
Epoch 88:  35%|███▌      | 34/97 [00:05<00:11,  5.68it/s, loss=1.96, v_num=0]
Epoch 88:  35%|███▌      | 34/97 [00:06<00:11,  5.63it/s, loss=1.96, v_num=0]
Epoch 88:  36%|███▌      | 35/97 [00:06<00:10,  5.71it/s, loss=1.96, v_num=0]
Epoch 88:  36%|███▌      | 35/97 [00:06<00:10,  5.66it/s, loss=1.97, v_num=0]
Epoch 88:  37%|███▋      | 36/97 [00:06<00:10,  5.74it/s, loss=1.97, v_num=0]
Epoch 88:  37%|███▋      | 36/97 [00:06<00:10,  5.69it/s, loss=1.97, v_num=0]
Epoch 88:  38%|███▊      | 37/97 [00:06<00:10,  5.76it/s, loss=1.97, v_num=0]
Epoch 88:  38%|███▊      | 37/97 [00:06<00:10,  5.72it/s, loss=1.97, v_num=0]
Epoch 88:  39%|███▉      | 38/97 [00:06<00:10,  5.79it/s, loss=1.97, v_num=0]
Epoch 88:  39%|███▉      | 38/97 [00:06<00:10,  5.74it/s, loss=1.98, v_num=0]
Epoch 88:  40%|████      | 39/97 [00:06<00:09,  5.82it/s, loss=1.98, v_num=0]
Epoch 88:  40%|████      | 39/97 [00:06<00:10,  5.77it/s, loss=1.98, v_num=0]
Epoch 88:  41%|████      | 40/97 [00:06<00:09,  5.84it/s, loss=1.98, v_num=0]
Epoch 88:  41%|████      | 40/97 [00:06<00:09,  5.80it/s, loss=1.99, v_num=0]
Epoch 88:  42%|████▏     | 41/97 [00:06<00:09,  5.86it/s, loss=1.99, v_num=0]
Epoch 88:  42%|████▏     | 41/97 [00:07<00:09,  5.82it/s, loss=1.98, v_num=0]
Epoch 88:  43%|████▎     | 42/97 [00:07<00:09,  5.88it/s, loss=1.98, v_num=0]
Epoch 88:  43%|████▎     | 42/97 [00:07<00:09,  5.84it/s, loss=1.99, v_num=0]
Epoch 88:  44%|████▍     | 43/97 [00:07<00:09,  5.90it/s, loss=1.99, v_num=0]
Epoch 88:  44%|████▍     | 43/97 [00:07<00:09,  5.86it/s, loss=1.98, v_num=0]
Epoch 88:  45%|████▌     | 44/97 [00:07<00:08,  5.92it/s, loss=1.98, v_num=0]
Epoch 88:  45%|████▌     | 44/97 [00:07<00:09,  5.88it/s, loss=1.99, v_num=0]
Epoch 88:  46%|████▋     | 45/97 [00:07<00:08,  5.94it/s, loss=1.99, v_num=0]
Epoch 88:  46%|████▋     | 45/97 [00:07<00:08,  5.90it/s, loss=1.99, v_num=0]
Epoch 88:  47%|████▋     | 46/97 [00:07<00:08,  5.96it/s, loss=1.99, v_num=0]
Epoch 88:  47%|████▋     | 46/97 [00:07<00:08,  5.92it/s, loss=1.98, v_num=0]
Epoch 88:  48%|████▊     | 47/97 [00:07<00:08,  5.98it/s, loss=1.98, v_num=0]
Epoch 88:  48%|████▊     | 47/97 [00:07<00:08,  5.94it/s, loss=1.98, v_num=0]
Epoch 88:  49%|████▉     | 48/97 [00:07<00:08,  6.00it/s, loss=1.98, v_num=0]
Epoch 88:  49%|████▉     | 48/97 [00:08<00:08,  5.96it/s, loss=1.98, v_num=0]
Epoch 88:  51%|█████     | 49/97 [00:08<00:07,  6.03it/s, loss=1.98, v_num=0]
Epoch 88:  51%|█████     | 49/97 [00:08<00:08,  5.98it/s, loss=1.98, v_num=0]
Epoch 88:  52%|█████▏    | 50/97 [00:08<00:07,  6.04it/s, loss=1.98, v_num=0]
Epoch 88:  52%|█████▏    | 50/97 [00:08<00:07,  6.00it/s, loss=1.98, v_num=0]
Epoch 88:  53%|█████▎    | 51/97 [00:08<00:07,  6.06it/s, loss=1.98, v_num=0]
Epoch 88:  53%|█████▎    | 51/97 [00:08<00:07,  6.02it/s, loss=1.99, v_num=0]
Epoch 88:  54%|█████▎    | 52/97 [00:08<00:07,  6.08it/s, loss=1.99, v_num=0]
Epoch 88:  54%|█████▎    | 52/97 [00:08<00:07,  6.04it/s, loss=1.98, v_num=0]
Epoch 88:  55%|█████▍    | 53/97 [00:08<00:07,  6.10it/s, loss=1.98, v_num=0]
Epoch 88:  55%|█████▍    | 53/97 [00:08<00:07,  6.06it/s, loss=1.98, v_num=0]
Epoch 88:  56%|█████▌    | 54/97 [00:08<00:07,  6.11it/s, loss=1.98, v_num=0]
Epoch 88:  56%|█████▌    | 54/97 [00:08<00:07,  6.07it/s, loss=1.98, v_num=0]
Epoch 88:  57%|█████▋    | 55/97 [00:08<00:06,  6.12it/s, loss=1.98, v_num=0]
Epoch 88:  57%|█████▋    | 55/97 [00:09<00:06,  6.09it/s, loss=1.98, v_num=0]
Epoch 88:  58%|█████▊    | 56/97 [00:09<00:06,  6.14it/s, loss=1.98, v_num=0]
Epoch 88:  58%|█████▊    | 56/97 [00:09<00:06,  6.10it/s, loss=1.97, v_num=0]
Epoch 88:  59%|█████▉    | 57/97 [00:09<00:06,  6.15it/s, loss=1.97, v_num=0]
Epoch 88:  59%|█████▉    | 57/97 [00:09<00:06,  6.11it/s, loss=1.98, v_num=0]
Epoch 88:  60%|█████▉    | 58/97 [00:09<00:06,  6.16it/s, loss=1.98, v_num=0]
Epoch 88:  60%|█████▉    | 58/97 [00:09<00:06,  6.13it/s, loss=1.97, v_num=0]
Epoch 88:  61%|██████    | 59/97 [00:09<00:06,  6.18it/s, loss=1.97, v_num=0]
Epoch 88:  61%|██████    | 59/97 [00:09<00:06,  6.14it/s, loss=1.97, v_num=0]
Epoch 88:  62%|██████▏   | 60/97 [00:09<00:05,  6.19it/s, loss=1.97, v_num=0]
Epoch 88:  62%|██████▏   | 60/97 [00:09<00:06,  6.15it/s, loss=1.97, v_num=0]
Epoch 88:  63%|██████▎   | 61/97 [00:09<00:05,  6.20it/s, loss=1.97, v_num=0]
Epoch 88:  63%|██████▎   | 61/97 [00:09<00:05,  6.17it/s, loss=1.97, v_num=0]
Epoch 88:  64%|██████▍   | 62/97 [00:09<00:05,  6.22it/s, loss=1.97, v_num=0]
Epoch 88:  64%|██████▍   | 62/97 [00:10<00:05,  6.18it/s, loss=1.96, v_num=0]
Epoch 88:  65%|██████▍   | 63/97 [00:10<00:05,  6.23it/s, loss=1.96, v_num=0]
Epoch 88:  65%|██████▍   | 63/97 [00:10<00:05,  6.20it/s, loss=1.97, v_num=0]
Epoch 88:  66%|██████▌   | 64/97 [00:10<00:05,  6.24it/s, loss=1.97, v_num=0]
Epoch 88:  66%|██████▌   | 64/97 [00:10<00:05,  6.21it/s, loss=1.97, v_num=0]
Epoch 88:  67%|██████▋   | 65/97 [00:10<00:05,  6.26it/s, loss=1.97, v_num=0]
Epoch 88:  67%|██████▋   | 65/97 [00:10<00:05,  6.22it/s, loss=1.97, v_num=0]
Epoch 88:  68%|██████▊   | 66/97 [00:10<00:04,  6.27it/s, loss=1.97, v_num=0]
Epoch 88:  68%|██████▊   | 66/97 [00:10<00:04,  6.24it/s, loss=1.98, v_num=0]
Epoch 88:  69%|██████▉   | 67/97 [00:10<00:04,  6.28it/s, loss=1.98, v_num=0]
Epoch 88:  69%|██████▉   | 67/97 [00:10<00:04,  6.25it/s, loss=1.98, v_num=0]
Epoch 88:  70%|███████   | 68/97 [00:10<00:04,  6.30it/s, loss=1.98, v_num=0]
Epoch 88:  70%|███████   | 68/97 [00:10<00:04,  6.26it/s, loss=1.98, v_num=0]
Epoch 88:  71%|███████   | 69/97 [00:10<00:04,  6.31it/s, loss=1.98, v_num=0]
Epoch 88:  71%|███████   | 69/97 [00:10<00:04,  6.27it/s, loss=1.98, v_num=0]
Epoch 88:  72%|███████▏  | 70/97 [00:11<00:04,  6.32it/s, loss=1.98, v_num=0]
Epoch 88:  72%|███████▏  | 70/97 [00:11<00:04,  6.29it/s, loss=1.98, v_num=0]
Epoch 88:  73%|███████▎  | 71/97 [00:11<00:04,  6.33it/s, loss=1.98, v_num=0]
Epoch 88:  73%|███████▎  | 71/97 [00:11<00:04,  6.30it/s, loss=1.98, v_num=0]
Epoch 88:  74%|███████▍  | 72/97 [00:11<00:03,  6.34it/s, loss=1.98, v_num=0]
Epoch 88:  74%|███████▍  | 72/97 [00:11<00:03,  6.31it/s, loss=1.98, v_num=0]
Epoch 88:  75%|███████▌  | 73/97 [00:11<00:03,  6.35it/s, loss=1.98, v_num=0]
Epoch 88:  75%|███████▌  | 73/97 [00:11<00:03,  6.32it/s, loss=1.98, v_num=0]
Epoch 88:  76%|███████▋  | 74/97 [00:11<00:03,  6.36it/s, loss=1.98, v_num=0]
Epoch 88:  76%|███████▋  | 74/97 [00:11<00:03,  6.33it/s, loss=1.98, v_num=0]
Epoch 88:  77%|███████▋  | 75/97 [00:11<00:03,  6.37it/s, loss=1.98, v_num=0]
Epoch 88:  77%|███████▋  | 75/97 [00:11<00:03,  6.34it/s, loss=1.98, v_num=0]
Epoch 88:  78%|███████▊  | 76/97 [00:11<00:03,  6.38it/s, loss=1.98, v_num=0]
Epoch 88:  78%|███████▊  | 76/97 [00:11<00:03,  6.35it/s, loss=1.98, v_num=0]
Epoch 88:  79%|███████▉  | 77/97 [00:12<00:03,  6.39it/s, loss=1.98, v_num=0]
Epoch 88:  79%|███████▉  | 77/97 [00:12<00:03,  6.36it/s, loss=1.98, v_num=0]
Epoch 88:  80%|████████  | 78/97 [00:12<00:02,  6.40it/s, loss=1.98, v_num=0]
Epoch 88:  80%|████████  | 78/97 [00:12<00:02,  6.37it/s, loss=1.98, v_num=0]
Epoch 88:  81%|████████▏ | 79/97 [00:12<00:02,  6.40it/s, loss=1.98, v_num=0]
Epoch 88:  81%|████████▏ | 79/97 [00:12<00:02,  6.37it/s, loss=1.99, v_num=0]
Epoch 88:  82%|████████▏ | 80/97 [00:12<00:02,  6.41it/s, loss=1.99, v_num=0]
Epoch 88:  82%|████████▏ | 80/97 [00:12<00:02,  6.38it/s, loss=1.99, v_num=0]
Epoch 88:  84%|████████▎ | 81/97 [00:12<00:02,  6.42it/s, loss=1.99, v_num=0]
Epoch 88:  84%|████████▎ | 81/97 [00:12<00:02,  6.39it/s, loss=1.99, v_num=0]
Epoch 88:  85%|████████▍ | 82/97 [00:12<00:02,  6.42it/s, loss=1.99, v_num=0]
Epoch 88:  85%|████████▍ | 82/97 [00:12<00:02,  6.39it/s, loss=1.99, v_num=0]
Epoch 88:  86%|████████▌ | 83/97 [00:12<00:02,  6.42it/s, loss=1.99, v_num=0]
Epoch 88:  86%|████████▌ | 83/97 [00:12<00:02,  6.40it/s, loss=1.98, v_num=0]
Epoch 88:  87%|████████▋ | 84/97 [00:13<00:02,  6.43it/s, loss=1.98, v_num=0]
Epoch 88:  87%|████████▋ | 84/97 [00:13<00:02,  6.40it/s, loss=1.98, v_num=0]
Epoch 88:  88%|████████▊ | 85/97 [00:13<00:01,  6.44it/s, loss=1.98, v_num=0]
Epoch 88:  88%|████████▊ | 85/97 [00:13<00:01,  6.41it/s, loss=1.97, v_num=0]
Epoch 88:  89%|████████▊ | 86/97 [00:13<00:01,  6.45it/s, loss=1.97, v_num=0]
Epoch 88:  89%|████████▊ | 86/97 [00:13<00:01,  6.42it/s, loss=1.97, v_num=0]
Epoch 88:  90%|████████▉ | 87/97 [00:13<00:01,  6.46it/s, loss=1.97, v_num=0]
Epoch 88:  90%|████████▉ | 87/97 [00:13<00:01,  6.43it/s, loss=1.96, v_num=0]
Epoch 88:  91%|█████████ | 88/97 [00:13<00:01,  6.46it/s, loss=1.96, v_num=0]
Epoch 88:  91%|█████████ | 88/97 [00:13<00:01,  6.44it/s, loss=1.96, v_num=0]
Epoch 88:  92%|█████████▏| 89/97 [00:13<00:01,  6.47it/s, loss=1.96, v_num=0]
Epoch 88:  92%|█████████▏| 89/97 [00:13<00:01,  6.45it/s, loss=1.96, v_num=0]
Epoch 88:  93%|█████████▎| 90/97 [00:13<00:01,  6.48it/s, loss=1.96, v_num=0]
Epoch 88:  93%|█████████▎| 90/97 [00:13<00:01,  6.45it/s, loss=1.96, v_num=0]
Epoch 88:  94%|█████████▍| 91/97 [00:14<00:00,  6.49it/s, loss=1.96, v_num=0]
Epoch 88:  94%|█████████▍| 91/97 [00:14<00:00,  6.46it/s, loss=1.96, v_num=0]
Epoch 88:  95%|█████████▍| 92/97 [00:14<00:00,  6.49it/s, loss=1.96, v_num=0]
Epoch 88:  95%|█████████▍| 92/97 [00:14<00:00,  6.47it/s, loss=1.97, v_num=0]
Epoch 88:  96%|█████████▌| 93/97 [00:14<00:00,  6.50it/s, loss=1.97, v_num=0]
Epoch 88:  96%|█████████▌| 93/97 [00:14<00:00,  6.48it/s, loss=1.97, v_num=0]
Epoch 88:  97%|█████████▋| 94/97 [00:14<00:00,  6.51it/s, loss=1.97, v_num=0]
Epoch 88:  97%|█████████▋| 94/97 [00:14<00:00,  6.48it/s, loss=1.97, v_num=0]
Epoch 88:  98%|█████████▊| 95/97 [00:14<00:00,  6.51it/s, loss=1.97, v_num=0]
Epoch 88:  98%|█████████▊| 95/97 [00:14<00:00,  6.49it/s, loss=1.97, v_num=0]
Epoch 88:  99%|█████████▉| 96/97 [00:14<00:00,  6.52it/s, loss=1.97, v_num=0]
Epoch 88:  99%|█████████▉| 96/97 [00:14<00:00,  6.50it/s, loss=1.97, v_num=0]
Epoch 88: 100%|██████████| 97/97 [00:14<00:00,  6.53it/s, loss=1.97, v_num=0]
Epoch 88: 100%|██████████| 97/97 [00:14<00:00,  6.50it/s, loss=1.97, v_num=0]
Epoch 88: 100%|██████████| 97/97 [00:14<00:00,  6.50it/s, loss=1.97, v_num=0]
Epoch 88:   0%|          | 0/97 [00:00<?, ?it/s, loss=1.97, v_num=0]
Epoch 89:   0%|          | 0/97 [00:00<?, ?it/s, loss=1.97, v_num=0]
Epoch 89:   1%|          | 1/97 [00:02<03:15,  2.03s/it, loss=1.97, v_num=0]
Epoch 89:   1%|          | 1/97 [00:02<03:19,  2.08s/it, loss=1.97, v_num=0]
Epoch 89:   2%|▏         | 2/97 [00:02<01:43,  1.08s/it, loss=1.97, v_num=0]
Epoch 89:   2%|▏         | 2/97 [00:02<01:45,  1.11s/it, loss=1.97, v_num=0]
Epoch 89:   3%|▎         | 3/97 [00:02<01:12,  1.30it/s, loss=1.97, v_num=0]
Epoch 89:   3%|▎         | 3/97 [00:02<01:14,  1.27it/s, loss=1.98, v_num=0]
Epoch 89:   4%|▍         | 4/97 [00:02<00:57,  1.62it/s, loss=1.98, v_num=0]
Epoch 89:   4%|▍         | 4/97 [00:02<00:58,  1.59it/s, loss=1.98, v_num=0]
Epoch 89:   5%|▌         | 5/97 [00:02<00:48,  1.91it/s, loss=1.98, v_num=0]
Epoch 89:   5%|▌         | 5/97 [00:02<00:48,  1.88it/s, loss=1.98, v_num=0]
Epoch 89:   6%|▌         | 6/97 [00:02<00:41,  2.18it/s, loss=1.98, v_num=0]
Epoch 89:   6%|▌         | 6/97 [00:02<00:42,  2.14it/s, loss=1.99, v_num=0]
Epoch 89:   7%|▋         | 7/97 [00:02<00:37,  2.42it/s, loss=1.99, v_num=0]
Epoch 89:   7%|▋         | 7/97 [00:02<00:37,  2.37it/s, loss=1.98, v_num=0]
Epoch 89:   8%|▊         | 8/97 [00:03<00:33,  2.63it/s, loss=1.98, v_num=0]
Epoch 89:   8%|▊         | 8/97 [00:03<00:34,  2.58it/s, loss=1.98, v_num=0]
Epoch 89:   9%|▉         | 9/97 [00:03<00:31,  2.82it/s, loss=1.98, v_num=0]
Epoch 89:   9%|▉         | 9/97 [00:03<00:31,  2.77it/s, loss=1.99, v_num=0]
Epoch 89:  10%|█         | 10/97 [00:03<00:29,  3.00it/s, loss=1.99, v_num=0]
Epoch 89:  10%|█         | 10/97 [00:03<00:29,  2.95it/s, loss=2, v_num=0]
Epoch 89:  11%|█▏        | 11/97 [00:03<00:27,  3.17it/s, loss=2, v_num=0]
Epoch 89:  11%|█▏        | 11/97 [00:03<00:27,  3.12it/s, loss=1.99, v_num=0]
Epoch 89:  12%|█▏        | 12/97 [00:03<00:25,  3.32it/s, loss=1.99, v_num=0]
Epoch 89:  12%|█▏        | 12/97 [00:03<00:25,  3.27it/s, loss=2, v_num=0]
Epoch 89:  13%|█▎        | 13/97 [00:03<00:24,  3.47it/s, loss=2, v_num=0]
Epoch 89:  13%|█▎        | 13/97 [00:03<00:24,  3.41it/s, loss=1.99, v_num=0]
Epoch 89:  14%|█▍        | 14/97 [00:03<00:23,  3.60it/s, loss=1.99, v_num=0]
Epoch 89:  14%|█▍        | 14/97 [00:03<00:23,  3.55it/s, loss=1.99, v_num=0]
Epoch 89:  15%|█▌        | 15/97 [00:04<00:22,  3.72it/s, loss=1.99, v_num=0]
Epoch 89:  15%|█▌        | 15/97 [00:04<00:22,  3.67it/s, loss=1.99, v_num=0]
Epoch 89:  16%|█▋        | 16/97 [00:04<00:21,  3.83it/s, loss=1.99, v_num=0]
Epoch 89:  16%|█▋        | 16/97 [00:04<00:21,  3.78it/s, loss=2, v_num=0]
Epoch 89:  18%|█▊        | 17/97 [00:04<00:20,  3.94it/s, loss=2, v_num=0]
Epoch 89:  18%|█▊        | 17/97 [00:04<00:20,  3.89it/s, loss=1.99, v_num=0]
Epoch 89:  19%|█▊        | 18/97 [00:04<00:19,  4.04it/s, loss=1.99, v_num=0]
Epoch 89:  19%|█▊        | 18/97 [00:04<00:19,  3.99it/s, loss=1.99, v_num=0]
Epoch 89:  20%|█▉        | 19/97 [00:04<00:18,  4.14it/s, loss=1.99, v_num=0]
Epoch 89:  20%|█▉        | 19/97 [00:04<00:19,  4.09it/s, loss=1.99, v_num=0]
Epoch 89:  21%|██        | 20/97 [00:04<00:18,  4.23it/s, loss=1.99, v_num=0]
Epoch 89:  21%|██        | 20/97 [00:04<00:18,  4.18it/s, loss=1.99, v_num=0]
Epoch 89:  22%|██▏       | 21/97 [00:04<00:17,  4.32it/s, loss=1.99, v_num=0]
Epoch 89:  22%|██▏       | 21/97 [00:04<00:17,  4.26it/s, loss=1.99, v_num=0]
Epoch 89:  23%|██▎       | 22/97 [00:05<00:17,  4.38it/s, loss=1.99, v_num=0]
Epoch 89:  23%|██▎       | 22/97 [00:05<00:17,  4.33it/s, loss=1.99, v_num=0]
Epoch 89:  24%|██▎       | 23/97 [00:05<00:16,  4.45it/s, loss=1.99, v_num=0]
Epoch 89:  24%|██▎       | 23/97 [00:05<00:16,  4.40it/s, loss=1.98, v_num=0]
Epoch 89:  25%|██▍       | 24/97 [00:05<00:16,  4.51it/s, loss=1.98, v_num=0]
Epoch 89:  25%|██▍       | 24/97 [00:05<00:16,  4.47it/s, loss=1.98, v_num=0]
Epoch 89:  26%|██▌       | 25/97 [00:05<00:15,  4.57it/s, loss=1.98, v_num=0]
Epoch 89:  26%|██▌       | 25/97 [00:05<00:15,  4.53it/s, loss=1.98, v_num=0]
Epoch 89:  27%|██▋       | 26/97 [00:05<00:15,  4.63it/s, loss=1.98, v_num=0]
Epoch 89:  27%|██▋       | 26/97 [00:05<00:15,  4.59it/s, loss=1.98, v_num=0]
Epoch 89:  28%|██▊       | 27/97 [00:05<00:14,  4.69it/s, loss=1.98, v_num=0]
Epoch 89:  28%|██▊       | 27/97 [00:05<00:15,  4.65it/s, loss=1.97, v_num=0]
Epoch 89:  29%|██▉       | 28/97 [00:05<00:14,  4.74it/s, loss=1.97, v_num=0]
Epoch 89:  29%|██▉       | 28/97 [00:05<00:14,  4.70it/s, loss=1.97, v_num=0]
Epoch 89:  30%|██▉       | 29/97 [00:06<00:14,  4.80it/s, loss=1.97, v_num=0]
Epoch 89:  30%|██▉       | 29/97 [00:06<00:14,  4.75it/s, loss=1.97, v_num=0]
Epoch 89:  31%|███       | 30/97 [00:06<00:13,  4.85it/s, loss=1.97, v_num=0]
Epoch 89:  31%|███       | 30/97 [00:06<00:13,  4.81it/s, loss=1.96, v_num=0]
Epoch 89:  32%|███▏      | 31/97 [00:06<00:13,  4.90it/s, loss=1.96, v_num=0]
Epoch 89:  32%|███▏      | 31/97 [00:06<00:13,  4.86it/s, loss=1.97, v_num=0]
Epoch 89:  33%|███▎      | 32/97 [00:06<00:13,  4.95it/s, loss=1.97, v_num=0]
Epoch 89:  33%|███▎      | 32/97 [00:06<00:13,  4.90it/s, loss=1.96, v_num=0]
Epoch 89:  34%|███▍      | 33/97 [00:06<00:12,  4.99it/s, loss=1.96, v_num=0]
Epoch 89:  34%|███▍      | 33/97 [00:06<00:12,  4.95it/s, loss=1.95, v_num=0]
Epoch 89:  35%|███▌      | 34/97 [00:06<00:12,  5.03it/s, loss=1.95, v_num=0]
Epoch 89:  35%|███▌      | 34/97 [00:06<00:12,  4.99it/s, loss=1.96, v_num=0]
Epoch 89:  36%|███▌      | 35/97 [00:06<00:12,  5.07it/s, loss=1.96, v_num=0]
Epoch 89:  36%|███▌      | 35/97 [00:06<00:12,  5.03it/s, loss=1.96, v_num=0]
Epoch 89:  37%|███▋      | 36/97 [00:07<00:11,  5.11it/s, loss=1.96, v_num=0]
Epoch 89:  37%|███▋      | 36/97 [00:07<00:12,  5.07it/s, loss=1.95, v_num=0]
Epoch 89:  38%|███▊      | 37/97 [00:07<00:11,  5.15it/s, loss=1.95, v_num=0]
Epoch 89:  38%|███▊      | 37/97 [00:07<00:11,  5.11it/s, loss=1.95, v_num=0]
Epoch 89:  39%|███▉      | 38/97 [00:07<00:11,  5.18it/s, loss=1.95, v_num=0]
Epoch 89:  39%|███▉      | 38/97 [00:07<00:11,  5.14it/s, loss=1.96, v_num=0]
Epoch 89:  40%|████      | 39/97 [00:07<00:11,  5.22it/s, loss=1.96, v_num=0]
Epoch 89:  40%|████      | 39/97 [00:07<00:11,  5.18it/s, loss=1.95, v_num=0]
Epoch 89:  41%|████      | 40/97 [00:07<00:10,  5.25it/s, loss=1.95, v_num=0]
Epoch 89:  41%|████      | 40/97 [00:07<00:10,  5.21it/s, loss=1.95, v_num=0]
Epoch 89:  42%|████▏     | 41/97 [00:07<00:10,  5.27it/s, loss=1.95, v_num=0]
Epoch 89:  42%|████▏     | 41/97 [00:07<00:10,  5.24it/s, loss=1.94, v_num=0]
Epoch 89:  43%|████▎     | 42/97 [00:07<00:10,  5.30it/s, loss=1.94, v_num=0]
Epoch 89:  43%|████▎     | 42/97 [00:07<00:10,  5.27it/s, loss=1.95, v_num=0]
Epoch 89:  44%|████▍     | 43/97 [00:08<00:10,  5.33it/s, loss=1.95, v_num=0]
Epoch 89:  44%|████▍     | 43/97 [00:08<00:10,  5.30it/s, loss=1.95, v_num=0]
Epoch 89:  45%|████▌     | 44/97 [00:08<00:09,  5.36it/s, loss=1.95, v_num=0]
Epoch 89:  45%|████▌     | 44/97 [00:08<00:09,  5.33it/s, loss=1.95, v_num=0]
Epoch 89:  46%|████▋     | 45/97 [00:08<00:09,  5.39it/s, loss=1.95, v_num=0]
Epoch 89:  46%|████▋     | 45/97 [00:08<00:09,  5.36it/s, loss=1.96, v_num=0]
Epoch 89:  47%|████▋     | 46/97 [00:08<00:09,  5.42it/s, loss=1.96, v_num=0]
Epoch 89:  47%|████▋     | 46/97 [00:08<00:09,  5.38it/s, loss=1.95, v_num=0]
Epoch 89:  48%|████▊     | 47/97 [00:08<00:09,  5.44it/s, loss=1.95, v_num=0]
Epoch 89:  48%|████▊     | 47/97 [00:08<00:09,  5.41it/s, loss=1.95, v_num=0]
Epoch 89:  49%|████▉     | 48/97 [00:08<00:08,  5.47it/s, loss=1.95, v_num=0]
Epoch 89:  49%|████▉     | 48/97 [00:08<00:09,  5.43it/s, loss=1.95, v_num=0]
Epoch 89:  51%|█████     | 49/97 [00:08<00:08,  5.49it/s, loss=1.95, v_num=0]
Epoch 89:  51%|█████     | 49/97 [00:08<00:08,  5.45it/s, loss=1.95, v_num=0]
Epoch 89:  52%|█████▏    | 50/97 [00:09<00:08,  5.51it/s, loss=1.95, v_num=0]
Epoch 89:  52%|█████▏    | 50/97 [00:09<00:08,  5.48it/s, loss=1.96, v_num=0]
Epoch 89:  53%|█████▎    | 51/97 [00:09<00:08,  5.53it/s, loss=1.96, v_num=0]
Epoch 89:  53%|█████▎    | 51/97 [00:09<00:08,  5.50it/s, loss=1.96, v_num=0]
Epoch 89:  54%|█████▎    | 52/97 [00:09<00:08,  5.55it/s, loss=1.96, v_num=0]
Epoch 89:  54%|█████▎    | 52/97 [00:09<00:08,  5.52it/s, loss=1.96, v_num=0]
Epoch 89:  55%|█████▍    | 53/97 [00:09<00:07,  5.57it/s, loss=1.96, v_num=0]
Epoch 89:  55%|█████▍    | 53/97 [00:09<00:07,  5.54it/s, loss=1.97, v_num=0]
Epoch 89:  56%|█████▌    | 54/97 [00:09<00:07,  5.59it/s, loss=1.97, v_num=0]
Epoch 89:  56%|█████▌    | 54/97 [00:09<00:07,  5.56it/s, loss=1.96, v_num=0]
Epoch 89:  57%|█████▋    | 55/97 [00:09<00:07,  5.61it/s, loss=1.96, v_num=0]
Epoch 89:  57%|█████▋    | 55/97 [00:09<00:07,  5.58it/s, loss=1.96, v_num=0]
Epoch 89:  58%|█████▊    | 56/97 [00:09<00:07,  5.63it/s, loss=1.96, v_num=0]
Epoch 89:  58%|█████▊    | 56/97 [00:09<00:07,  5.60it/s, loss=1.96, v_num=0]
Epoch 89:  59%|█████▉    | 57/97 [00:10<00:07,  5.65it/s, loss=1.96, v_num=0]
Epoch 89:  59%|█████▉    | 57/97 [00:10<00:07,  5.62it/s, loss=1.96, v_num=0]
Epoch 89:  60%|█████▉    | 58/97 [00:10<00:06,  5.67it/s, loss=1.96, v_num=0]
Epoch 89:  60%|█████▉    | 58/97 [00:10<00:06,  5.64it/s, loss=1.97, v_num=0]
Epoch 89:  61%|██████    | 59/97 [00:10<00:06,  5.69it/s, loss=1.97, v_num=0]
Epoch 89:  61%|██████    | 59/97 [00:10<00:06,  5.66it/s, loss=1.97, v_num=0]
Epoch 89:  62%|██████▏   | 60/97 [00:10<00:06,  5.69it/s, loss=1.97, v_num=0]
Epoch 89:  62%|██████▏   | 60/97 [00:10<00:06,  5.66it/s, loss=1.97, v_num=0]
Epoch 89:  63%|██████▎   | 61/97 [00:10<00:06,  5.71it/s, loss=1.97, v_num=0]
Epoch 89:  63%|██████▎   | 61/97 [00:10<00:06,  5.68it/s, loss=1.97, v_num=0]
Epoch 89:  64%|██████▍   | 62/97 [00:10<00:06,  5.73it/s, loss=1.97, v_num=0]
Epoch 89:  64%|██████▍   | 62/97 [00:10<00:06,  5.70it/s, loss=1.98, v_num=0]
Epoch 89:  65%|██████▍   | 63/97 [00:10<00:05,  5.74it/s, loss=1.98, v_num=0]
Epoch 89:  65%|██████▍   | 63/97 [00:11<00:05,  5.71it/s, loss=1.97, v_num=0]
Epoch 89:  66%|██████▌   | 64/97 [00:11<00:05,  5.75it/s, loss=1.97, v_num=0]
Epoch 89:  66%|██████▌   | 64/97 [00:11<00:05,  5.73it/s, loss=1.97, v_num=0]
Epoch 89:  67%|██████▋   | 65/97 [00:11<00:05,  5.77it/s, loss=1.97, v_num=0]
Epoch 89:  67%|██████▋   | 65/97 [00:11<00:05,  5.74it/s, loss=1.96, v_num=0]
Epoch 89:  68%|██████▊   | 66/97 [00:11<00:05,  5.78it/s, loss=1.96, v_num=0]
Epoch 89:  68%|██████▊   | 66/97 [00:11<00:05,  5.76it/s, loss=1.97, v_num=0]
Epoch 89:  69%|██████▉   | 67/97 [00:11<00:05,  5.80it/s, loss=1.97, v_num=0]
Epoch 89:  69%|██████▉   | 67/97 [00:11<00:05,  5.77it/s, loss=1.97, v_num=0]
Epoch 89:  70%|███████   | 68/97 [00:11<00:04,  5.81it/s, loss=1.97, v_num=0]
Epoch 89:  70%|███████   | 68/97 [00:11<00:05,  5.78it/s, loss=1.97, v_num=0]
Epoch 89:  71%|███████   | 69/97 [00:11<00:04,  5.82it/s, loss=1.97, v_num=0]
Epoch 89:  71%|███████   | 69/97 [00:11<00:04,  5.80it/s, loss=1.98, v_num=0]
Epoch 89:  72%|███████▏  | 70/97 [00:11<00:04,  5.84it/s, loss=1.98, v_num=0]
Epoch 89:  72%|███████▏  | 70/97 [00:12<00:04,  5.81it/s, loss=1.98, v_num=0]
Epoch 89:  73%|███████▎  | 71/97 [00:12<00:04,  5.85it/s, loss=1.98, v_num=0]
Epoch 89:  73%|███████▎  | 71/97 [00:12<00:04,  5.82it/s, loss=1.98, v_num=0]
Epoch 89:  74%|███████▍  | 72/97 [00:12<00:04,  5.86it/s, loss=1.98, v_num=0]
Epoch 89:  74%|███████▍  | 72/97 [00:12<00:04,  5.84it/s, loss=1.98, v_num=0]
Epoch 89:  75%|███████▌  | 73/97 [00:12<00:04,  5.88it/s, loss=1.98, v_num=0]
Epoch 89:  75%|███████▌  | 73/97 [00:12<00:04,  5.85it/s, loss=1.98, v_num=0]
Epoch 89:  76%|███████▋  | 74/97 [00:12<00:03,  5.89it/s, loss=1.98, v_num=0]
Epoch 89:  76%|███████▋  | 74/97 [00:12<00:03,  5.86it/s, loss=1.98, v_num=0]
Epoch 89:  77%|███████▋  | 75/97 [00:12<00:03,  5.90it/s, loss=1.98, v_num=0]
Epoch 89:  77%|███████▋  | 75/97 [00:12<00:03,  5.87it/s, loss=1.98, v_num=0]
Epoch 89:  78%|███████▊  | 76/97 [00:12<00:03,  5.91it/s, loss=1.98, v_num=0]
Epoch 89:  78%|███████▊  | 76/97 [00:12<00:03,  5.88it/s, loss=1.98, v_num=0]
Epoch 89:  79%|███████▉  | 77/97 [00:13<00:03,  5.92it/s, loss=1.98, v_num=0]
Epoch 89:  79%|███████▉  | 77/97 [00:13<00:03,  5.90it/s, loss=1.98, v_num=0]
Epoch 89:  80%|████████  | 78/97 [00:13<00:03,  5.93it/s, loss=1.98, v_num=0]
Epoch 89:  80%|████████  | 78/97 [00:13<00:03,  5.90it/s, loss=1.97, v_num=0]
Epoch 89:  81%|████████▏ | 79/97 [00:13<00:03,  5.94it/s, loss=1.97, v_num=0]
Epoch 89:  81%|████████▏ | 79/97 [00:13<00:03,  5.92it/s, loss=1.97, v_num=0]
Epoch 89:  82%|████████▏ | 80/97 [00:13<00:02,  5.95it/s, loss=1.97, v_num=0]
Epoch 89:  82%|████████▏ | 80/97 [00:13<00:02,  5.93it/s, loss=1.97, v_num=0]
Epoch 89:  84%|████████▎ | 81/97 [00:13<00:02,  5.96it/s, loss=1.97, v_num=0]
Epoch 89:  84%|████████▎ | 81/97 [00:13<00:02,  5.94it/s, loss=1.96, v_num=0]
Epoch 89:  85%|████████▍ | 82/97 [00:13<00:02,  5.97it/s, loss=1.96, v_num=0]
Epoch 89:  85%|████████▍ | 82/97 [00:13<00:02,  5.94it/s, loss=1.95, v_num=0]
Epoch 89:  86%|████████▌ | 83/97 [00:13<00:02,  5.97it/s, loss=1.95, v_num=0]
Epoch 89:  86%|████████▌ | 83/97 [00:13<00:02,  5.95it/s, loss=1.95, v_num=0]
Epoch 89:  87%|████████▋ | 84/97 [00:14<00:02,  5.98it/s, loss=1.95, v_num=0]
Epoch 89:  87%|████████▋ | 84/97 [00:14<00:02,  5.96it/s, loss=1.95, v_num=0]
Epoch 89:  88%|████████▊ | 85/97 [00:14<00:02,  6.00it/s, loss=1.95, v_num=0]
Epoch 89:  88%|████████▊ | 85/97 [00:14<00:02,  5.97it/s, loss=1.96, v_num=0]
Epoch 89:  89%|████████▊ | 86/97 [00:14<00:01,  6.00it/s, loss=1.96, v_num=0]
Epoch 89:  89%|████████▊ | 86/97 [00:14<00:01,  5.98it/s, loss=1.96, v_num=0]
Epoch 89:  90%|████████▉ | 87/97 [00:14<00:01,  6.02it/s, loss=1.96, v_num=0]
Epoch 89:  90%|████████▉ | 87/97 [00:14<00:01,  5.99it/s, loss=1.96, v_num=0]
Epoch 89:  91%|█████████ | 88/97 [00:14<00:01,  6.02it/s, loss=1.96, v_num=0]
Epoch 89:  91%|█████████ | 88/97 [00:14<00:01,  6.00it/s, loss=1.96, v_num=0]
Epoch 89:  92%|█████████▏| 89/97 [00:14<00:01,  6.03it/s, loss=1.96, v_num=0]
Epoch 89:  92%|█████████▏| 89/97 [00:14<00:01,  6.01it/s, loss=1.96, v_num=0]
Epoch 89:  93%|█████████▎| 90/97 [00:14<00:01,  6.04it/s, loss=1.96, v_num=0]
Epoch 89:  93%|█████████▎| 90/97 [00:14<00:01,  6.02it/s, loss=1.95, v_num=0]
Epoch 89:  94%|█████████▍| 91/97 [00:15<00:00,  6.05it/s, loss=1.95, v_num=0]
Epoch 89:  94%|█████████▍| 91/97 [00:15<00:00,  6.03it/s, loss=1.95, v_num=0]
Epoch 89:  95%|█████████▍| 92/97 [00:15<00:00,  6.06it/s, loss=1.95, v_num=0]
Epoch 89:  95%|█████████▍| 92/97 [00:15<00:00,  6.04it/s, loss=1.95, v_num=0]
Epoch 89:  96%|█████████▌| 93/97 [00:15<00:00,  6.07it/s, loss=1.95, v_num=0]
Epoch 89:  96%|█████████▌| 93/97 [00:15<00:00,  6.05it/s, loss=1.95, v_num=0]
Epoch 89:  97%|█████████▋| 94/97 [00:15<00:00,  6.08it/s, loss=1.95, v_num=0]
Epoch 89:  97%|█████████▋| 94/97 [00:15<00:00,  6.06it/s, loss=1.96, v_num=0]
Epoch 89:  98%|█████████▊| 95/97 [00:15<00:00,  6.09it/s, loss=1.96, v_num=0]
Epoch 89:  98%|█████████▊| 95/97 [00:15<00:00,  6.07it/s, loss=1.96, v_num=0]
Epoch 89:  99%|█████████▉| 96/97 [00:15<00:00,  6.10it/s, loss=1.96, v_num=0]
Epoch 89:  99%|█████████▉| 96/97 [00:15<00:00,  6.08it/s, loss=1.96, v_num=0]
Epoch 89: 100%|██████████| 97/97 [00:15<00:00,  6.11it/s, loss=1.96, v_num=0]
Epoch 89: 100%|██████████| 97/97 [00:15<00:00,  6.09it/s, loss=1.96, v_num=0]
Epoch 89: 100%|██████████| 97/97 [00:15<00:00,  6.09it/s, loss=1.96, v_num=0]
Epoch 89:   0%|          | 0/97 [00:00<?, ?it/s, loss=1.96, v_num=0]
Epoch 90:   0%|          | 0/97 [00:00<?, ?it/s, loss=1.96, v_num=0]
Epoch 90:   1%|          | 1/97 [00:01<02:14,  1.40s/it, loss=1.96, v_num=0]
Epoch 90:   1%|          | 1/97 [00:01<02:20,  1.46s/it, loss=1.97, v_num=0]
Epoch 90:   2%|▏         | 2/97 [00:01<01:13,  1.30it/s, loss=1.97, v_num=0]
Epoch 90:   2%|▏         | 2/97 [00:01<01:15,  1.25it/s, loss=1.98, v_num=0]
Epoch 90:   3%|▎         | 3/97 [00:01<00:52,  1.79it/s, loss=1.98, v_num=0]
Epoch 90:   3%|▎         | 3/97 [00:01<00:54,  1.73it/s, loss=1.98, v_num=0]
Epoch 90:   4%|▍         | 4/97 [00:01<00:42,  2.21it/s, loss=1.98, v_num=0]
Epoch 90:   4%|▍         | 4/97 [00:01<00:43,  2.14it/s, loss=1.98, v_num=0]
Epoch 90:   5%|▌         | 5/97 [00:01<00:35,  2.56it/s, loss=1.98, v_num=0]
Epoch 90:   5%|▌         | 5/97 [00:02<00:37,  2.48it/s, loss=2, v_num=0]
Epoch 90:   6%|▌         | 6/97 [00:02<00:31,  2.87it/s, loss=2, v_num=0]
Epoch 90:   6%|▌         | 6/97 [00:02<00:32,  2.79it/s, loss=1.99, v_num=0]
Epoch 90:   7%|▋         | 7/97 [00:02<00:28,  3.14it/s, loss=1.99, v_num=0]
Epoch 90:   7%|▋         | 7/97 [00:02<00:29,  3.06it/s, loss=1.99, v_num=0]
Epoch 90:   8%|▊         | 8/97 [00:02<00:26,  3.38it/s, loss=1.99, v_num=0]
Epoch 90:   8%|▊         | 8/97 [00:02<00:26,  3.30it/s, loss=1.99, v_num=0]
Epoch 90:   9%|▉         | 9/97 [00:02<00:24,  3.59it/s, loss=1.99, v_num=0]
Epoch 90:   9%|▉         | 9/97 [00:02<00:25,  3.51it/s, loss=1.98, v_num=0]
Epoch 90:  10%|█         | 10/97 [00:02<00:23,  3.78it/s, loss=1.98, v_num=0]
Epoch 90:  10%|█         | 10/97 [00:02<00:23,  3.70it/s, loss=1.98, v_num=0]
Epoch 90:  11%|█▏        | 11/97 [00:02<00:21,  3.95it/s, loss=1.98, v_num=0]
Epoch 90:  11%|█▏        | 11/97 [00:02<00:22,  3.87it/s, loss=1.98, v_num=0]
Epoch 90:  12%|█▏        | 12/97 [00:02<00:20,  4.11it/s, loss=1.98, v_num=0]
Epoch 90:  12%|█▏        | 12/97 [00:02<00:21,  4.03it/s, loss=1.98, v_num=0]
Epoch 90:  13%|█▎        | 13/97 [00:03<00:19,  4.25it/s, loss=1.98, v_num=0]
Epoch 90:  13%|█▎        | 13/97 [00:03<00:20,  4.18it/s, loss=1.98, v_num=0]
Epoch 90:  14%|█▍        | 14/97 [00:03<00:18,  4.38it/s, loss=1.98, v_num=0]
Epoch 90:  14%|█▍        | 14/97 [00:03<00:19,  4.31it/s, loss=1.99, v_num=0]
Epoch 90:  15%|█▌        | 15/97 [00:03<00:18,  4.50it/s, loss=1.99, v_num=0]
Epoch 90:  15%|█▌        | 15/97 [00:03<00:18,  4.43it/s, loss=1.99, v_num=0]
Epoch 90:  16%|█▋        | 16/97 [00:03<00:17,  4.62it/s, loss=1.99, v_num=0]
Epoch 90:  16%|█▋        | 16/97 [00:03<00:17,  4.54it/s, loss=1.98, v_num=0]
Epoch 90:  18%|█▊        | 17/97 [00:03<00:16,  4.71it/s, loss=1.98, v_num=0]
Epoch 90:  18%|█▊        | 17/97 [00:03<00:17,  4.64it/s, loss=1.98, v_num=0]
Epoch 90:  19%|█▊        | 18/97 [00:03<00:16,  4.81it/s, loss=1.98, v_num=0]
Epoch 90:  19%|█▊        | 18/97 [00:03<00:16,  4.74it/s, loss=1.98, v_num=0]
Epoch 90:  20%|█▉        | 19/97 [00:03<00:15,  4.90it/s, loss=1.98, v_num=0]
Epoch 90:  20%|█▉        | 19/97 [00:03<00:16,  4.83it/s, loss=1.97, v_num=0]
Epoch 90:  21%|██        | 20/97 [00:04<00:15,  4.98it/s, loss=1.97, v_num=0]
Epoch 90:  21%|██        | 20/97 [00:04<00:15,  4.91it/s, loss=1.97, v_num=0]
Epoch 90:  22%|██▏       | 21/97 [00:04<00:15,  5.06it/s, loss=1.97, v_num=0]
Epoch 90:  22%|██▏       | 21/97 [00:04<00:15,  4.99it/s, loss=1.96, v_num=0]
Epoch 90:  23%|██▎       | 22/97 [00:04<00:14,  5.13it/s, loss=1.96, v_num=0]
Epoch 90:  23%|██▎       | 22/97 [00:04<00:14,  5.06it/s, loss=1.96, v_num=0]
Epoch 90:  24%|██▎       | 23/97 [00:04<00:14,  5.19it/s, loss=1.96, v_num=0]
Epoch 90:  24%|██▎       | 23/97 [00:04<00:14,  5.13it/s, loss=1.97, v_num=0]
Epoch 90:  25%|██▍       | 24/97 [00:04<00:13,  5.25it/s, loss=1.97, v_num=0]
Epoch 90:  25%|██▍       | 24/97 [00:04<00:14,  5.19it/s, loss=1.97, v_num=0]
Epoch 90:  26%|██▌       | 25/97 [00:04<00:13,  5.31it/s, loss=1.97, v_num=0]
Epoch 90:  26%|██▌       | 25/97 [00:04<00:13,  5.24it/s, loss=1.96, v_num=0]
Epoch 90:  27%|██▋       | 26/97 [00:04<00:13,  5.37it/s, loss=1.96, v_num=0]
Epoch 90:  27%|██▋       | 26/97 [00:04<00:13,  5.30it/s, loss=1.96, v_num=0]
Epoch 90:  28%|██▊       | 27/97 [00:04<00:12,  5.42it/s, loss=1.96, v_num=0]
Epoch 90:  28%|██▊       | 27/97 [00:05<00:13,  5.36it/s, loss=1.96, v_num=0]
Epoch 90:  29%|██▉       | 28/97 [00:05<00:12,  5.46it/s, loss=1.96, v_num=0]
Epoch 90:  29%|██▉       | 28/97 [00:05<00:12,  5.41it/s, loss=1.96, v_num=0]
Epoch 90:  30%|██▉       | 29/97 [00:05<00:12,  5.51it/s, loss=1.96, v_num=0]
Epoch 90:  30%|██▉       | 29/97 [00:05<00:12,  5.46it/s, loss=1.96, v_num=0]
Epoch 90:  31%|███       | 30/97 [00:05<00:12,  5.56it/s, loss=1.96, v_num=0]
Epoch 90:  31%|███       | 30/97 [00:05<00:12,  5.50it/s, loss=1.97, v_num=0]
Epoch 90:  32%|███▏      | 31/97 [00:05<00:11,  5.60it/s, loss=1.97, v_num=0]
Epoch 90:  32%|███▏      | 31/97 [00:05<00:11,  5.54it/s, loss=1.96, v_num=0]
Epoch 90:  33%|███▎      | 32/97 [00:05<00:11,  5.64it/s, loss=1.96, v_num=0]
Epoch 90:  33%|███▎      | 32/97 [00:05<00:11,  5.58it/s, loss=1.96, v_num=0]
Epoch 90:  34%|███▍      | 33/97 [00:05<00:11,  5.68it/s, loss=1.96, v_num=0]
Epoch 90:  34%|███▍      | 33/97 [00:05<00:11,  5.62it/s, loss=1.96, v_num=0]
Epoch 90:  35%|███▌      | 34/97 [00:05<00:11,  5.72it/s, loss=1.96, v_num=0]
Epoch 90:  35%|███▌      | 34/97 [00:06<00:11,  5.66it/s, loss=1.95, v_num=0]
Epoch 90:  36%|███▌      | 35/97 [00:06<00:10,  5.75it/s, loss=1.95, v_num=0]
Epoch 90:  36%|███▌      | 35/97 [00:06<00:10,  5.70it/s, loss=1.95, v_num=0]
Epoch 90:  37%|███▋      | 36/97 [00:06<00:10,  5.78it/s, loss=1.95, v_num=0]
Epoch 90:  37%|███▋      | 36/97 [00:06<00:10,  5.73it/s, loss=1.95, v_num=0]
Epoch 90:  38%|███▊      | 37/97 [00:06<00:10,  5.82it/s, loss=1.95, v_num=0]
Epoch 90:  38%|███▊      | 37/97 [00:06<00:10,  5.77it/s, loss=1.95, v_num=0]
Epoch 90:  39%|███▉      | 38/97 [00:06<00:10,  5.85it/s, loss=1.95, v_num=0]
Epoch 90:  39%|███▉      | 38/97 [00:06<00:10,  5.80it/s, loss=1.95, v_num=0]
Epoch 90:  40%|████      | 39/97 [00:06<00:09,  5.87it/s, loss=1.95, v_num=0]
Epoch 90:  40%|████      | 39/97 [00:06<00:09,  5.83it/s, loss=1.95, v_num=0]
Epoch 90:  41%|████      | 40/97 [00:06<00:09,  5.90it/s, loss=1.95, v_num=0]
Epoch 90:  41%|████      | 40/97 [00:06<00:09,  5.86it/s, loss=1.95, v_num=0]
Epoch 90:  42%|████▏     | 41/97 [00:06<00:09,  5.93it/s, loss=1.95, v_num=0]
Epoch 90:  42%|████▏     | 41/97 [00:06<00:09,  5.88it/s, loss=1.95, v_num=0]
Epoch 90:  43%|████▎     | 42/97 [00:07<00:09,  5.95it/s, loss=1.95, v_num=0]
Epoch 90:  43%|████▎     | 42/97 [00:07<00:09,  5.91it/s, loss=1.94, v_num=0]
Epoch 90:  44%|████▍     | 43/97 [00:07<00:09,  5.98it/s, loss=1.94, v_num=0]
Epoch 90:  44%|████▍     | 43/97 [00:07<00:09,  5.93it/s, loss=1.94, v_num=0]
Epoch 90:  45%|████▌     | 44/97 [00:07<00:08,  6.01it/s, loss=1.94, v_num=0]
Epoch 90:  45%|████▌     | 44/97 [00:07<00:08,  5.96it/s, loss=1.94, v_num=0]
Epoch 90:  46%|████▋     | 45/97 [00:07<00:08,  6.03it/s, loss=1.94, v_num=0]
Epoch 90:  46%|████▋     | 45/97 [00:07<00:08,  5.98it/s, loss=1.93, v_num=0]
Epoch 90:  47%|████▋     | 46/97 [00:07<00:08,  6.05it/s, loss=1.93, v_num=0]
Epoch 90:  47%|████▋     | 46/97 [00:07<00:08,  6.01it/s, loss=1.93, v_num=0]
Epoch 90:  48%|████▊     | 47/97 [00:07<00:08,  6.07it/s, loss=1.93, v_num=0]
Epoch 90:  48%|████▊     | 47/97 [00:07<00:08,  6.03it/s, loss=1.93, v_num=0]
Epoch 90:  49%|████▉     | 48/97 [00:07<00:08,  6.09it/s, loss=1.93, v_num=0]
Epoch 90:  49%|████▉     | 48/97 [00:07<00:08,  6.05it/s, loss=1.94, v_num=0]
Epoch 90:  51%|█████     | 49/97 [00:08<00:07,  6.11it/s, loss=1.94, v_num=0]
Epoch 90:  51%|█████     | 49/97 [00:08<00:07,  6.07it/s, loss=1.93, v_num=0]
Epoch 90:  52%|█████▏    | 50/97 [00:08<00:07,  6.13it/s, loss=1.93, v_num=0]
Epoch 90:  52%|█████▏    | 50/97 [00:08<00:07,  6.09it/s, loss=1.93, v_num=0]
Epoch 90:  53%|█████▎    | 51/97 [00:08<00:07,  6.14it/s, loss=1.93, v_num=0]
Epoch 90:  53%|█████▎    | 51/97 [00:08<00:07,  6.10it/s, loss=1.93, v_num=0]
Epoch 90:  54%|█████▎    | 52/97 [00:08<00:07,  6.16it/s, loss=1.93, v_num=0]
Epoch 90:  54%|█████▎    | 52/97 [00:08<00:07,  6.12it/s, loss=1.94, v_num=0]
Epoch 90:  55%|█████▍    | 53/97 [00:08<00:07,  6.18it/s, loss=1.94, v_num=0]
Epoch 90:  55%|█████▍    | 53/97 [00:08<00:07,  6.14it/s, loss=1.93, v_num=0]
Epoch 90:  56%|█████▌    | 54/97 [00:08<00:06,  6.20it/s, loss=1.93, v_num=0]
Epoch 90:  56%|█████▌    | 54/97 [00:08<00:06,  6.16it/s, loss=1.94, v_num=0]
Epoch 90:  57%|█████▋    | 55/97 [00:08<00:06,  6.21it/s, loss=1.94, v_num=0]
Epoch 90:  57%|█████▋    | 55/97 [00:08<00:06,  6.17it/s, loss=1.94, v_num=0]
Epoch 90:  58%|█████▊    | 56/97 [00:08<00:06,  6.22it/s, loss=1.94, v_num=0]
Epoch 90:  58%|█████▊    | 56/97 [00:09<00:06,  6.19it/s, loss=1.94, v_num=0]
Epoch 90:  59%|█████▉    | 57/97 [00:09<00:06,  6.24it/s, loss=1.94, v_num=0]
Epoch 90:  59%|█████▉    | 57/97 [00:09<00:06,  6.20it/s, loss=1.94, v_num=0]
Epoch 90:  60%|█████▉    | 58/97 [00:09<00:06,  6.26it/s, loss=1.94, v_num=0]
Epoch 90:  60%|█████▉    | 58/97 [00:09<00:06,  6.22it/s, loss=1.95, v_num=0]
Epoch 90:  61%|██████    | 59/97 [00:09<00:06,  6.27it/s, loss=1.95, v_num=0]
Epoch 90:  61%|██████    | 59/97 [00:09<00:06,  6.23it/s, loss=1.95, v_num=0]
Epoch 90:  62%|██████▏   | 60/97 [00:09<00:05,  6.28it/s, loss=1.95, v_num=0]
Epoch 90:  62%|██████▏   | 60/97 [00:09<00:05,  6.24it/s, loss=1.93, v_num=0]
Epoch 90:  63%|██████▎   | 61/97 [00:09<00:05,  6.29it/s, loss=1.93, v_num=0]
Epoch 90:  63%|██████▎   | 61/97 [00:09<00:05,  6.26it/s, loss=1.94, v_num=0]
Epoch 90:  64%|██████▍   | 62/97 [00:09<00:05,  6.31it/s, loss=1.94, v_num=0]
Epoch 90:  64%|██████▍   | 62/97 [00:09<00:05,  6.27it/s, loss=1.94, v_num=0]
Epoch 90:  65%|██████▍   | 63/97 [00:09<00:05,  6.32it/s, loss=1.94, v_num=0]
Epoch 90:  65%|██████▍   | 63/97 [00:10<00:05,  6.28it/s, loss=1.94, v_num=0]
Epoch 90:  66%|██████▌   | 64/97 [00:10<00:05,  6.33it/s, loss=1.94, v_num=0]
Epoch 90:  66%|██████▌   | 64/97 [00:10<00:05,  6.29it/s, loss=1.94, v_num=0]
Epoch 90:  67%|██████▋   | 65/97 [00:10<00:05,  6.34it/s, loss=1.94, v_num=0]
Epoch 90:  67%|██████▋   | 65/97 [00:10<00:05,  6.31it/s, loss=1.94, v_num=0]
Epoch 90:  68%|██████▊   | 66/97 [00:10<00:04,  6.35it/s, loss=1.94, v_num=0]
Epoch 90:  68%|██████▊   | 66/97 [00:10<00:04,  6.32it/s, loss=1.95, v_num=0]
Epoch 90:  69%|██████▉   | 67/97 [00:10<00:04,  6.36it/s, loss=1.95, v_num=0]
Epoch 90:  69%|██████▉   | 67/97 [00:10<00:04,  6.33it/s, loss=1.95, v_num=0]
Epoch 90:  70%|███████   | 68/97 [00:10<00:04,  6.37it/s, loss=1.95, v_num=0]
Epoch 90:  70%|███████   | 68/97 [00:10<00:04,  6.34it/s, loss=1.95, v_num=0]
Epoch 90:  71%|███████   | 69/97 [00:10<00:04,  6.38it/s, loss=1.95, v_num=0]
Epoch 90:  71%|███████   | 69/97 [00:10<00:04,  6.35it/s, loss=1.94, v_num=0]
Epoch 90:  72%|███████▏  | 70/97 [00:10<00:04,  6.39it/s, loss=1.94, v_num=0]
Epoch 90:  72%|███████▏  | 70/97 [00:11<00:04,  6.36it/s, loss=1.95, v_num=0]
Epoch 90:  73%|███████▎  | 71/97 [00:11<00:04,  6.40it/s, loss=1.95, v_num=0]
Epoch 90:  73%|███████▎  | 71/97 [00:11<00:04,  6.37it/s, loss=1.94, v_num=0]
Epoch 90:  74%|███████▍  | 72/97 [00:11<00:03,  6.41it/s, loss=1.94, v_num=0]
Epoch 90:  74%|███████▍  | 72/97 [00:11<00:03,  6.38it/s, loss=1.94, v_num=0]
Epoch 90:  75%|███████▌  | 73/97 [00:11<00:03,  6.42it/s, loss=1.94, v_num=0]
Epoch 90:  75%|███████▌  | 73/97 [00:11<00:03,  6.39it/s, loss=1.94, v_num=0]
Epoch 90:  76%|███████▋  | 74/97 [00:11<00:03,  6.43it/s, loss=1.94, v_num=0]
Epoch 90:  76%|███████▋  | 74/97 [00:11<00:03,  6.39it/s, loss=1.94, v_num=0]
Epoch 90:  77%|███████▋  | 75/97 [00:11<00:03,  6.43it/s, loss=1.94, v_num=0]
Epoch 90:  77%|███████▋  | 75/97 [00:11<00:03,  6.40it/s, loss=1.95, v_num=0]
Epoch 90:  78%|███████▊  | 76/97 [00:11<00:03,  6.44it/s, loss=1.95, v_num=0]
Epoch 90:  78%|███████▊  | 76/97 [00:11<00:03,  6.41it/s, loss=1.95, v_num=0]
Epoch 90:  79%|███████▉  | 77/97 [00:11<00:03,  6.45it/s, loss=1.95, v_num=0]
Epoch 90:  79%|███████▉  | 77/97 [00:11<00:03,  6.42it/s, loss=1.96, v_num=0]
Epoch 90:  80%|████████  | 78/97 [00:12<00:02,  6.46it/s, loss=1.96, v_num=0]
Epoch 90:  80%|████████  | 78/97 [00:12<00:02,  6.43it/s, loss=1.95, v_num=0]
Epoch 90:  81%|████████▏ | 79/97 [00:12<00:02,  6.46it/s, loss=1.95, v_num=0]
Epoch 90:  81%|████████▏ | 79/97 [00:12<00:02,  6.44it/s, loss=1.95, v_num=0]
Epoch 90:  82%|████████▏ | 80/97 [00:12<00:02,  6.47it/s, loss=1.95, v_num=0]
Epoch 90:  82%|████████▏ | 80/97 [00:12<00:02,  6.44it/s, loss=1.96, v_num=0]
Epoch 90:  84%|████████▎ | 81/97 [00:12<00:02,  6.48it/s, loss=1.96, v_num=0]
Epoch 90:  84%|████████▎ | 81/97 [00:12<00:02,  6.45it/s, loss=1.96, v_num=0]
Epoch 90:  85%|████████▍ | 82/97 [00:12<00:02,  6.48it/s, loss=1.96, v_num=0]
Epoch 90:  85%|████████▍ | 82/97 [00:12<00:02,  6.45it/s, loss=1.96, v_num=0]
Epoch 90:  86%|████████▌ | 83/97 [00:12<00:02,  6.49it/s, loss=1.96, v_num=0]
Epoch 90:  86%|████████▌ | 83/97 [00:12<00:02,  6.46it/s, loss=1.96, v_num=0]
Epoch 90:  87%|████████▋ | 84/97 [00:12<00:02,  6.49it/s, loss=1.96, v_num=0]
Epoch 90:  87%|████████▋ | 84/97 [00:12<00:02,  6.47it/s, loss=1.97, v_num=0]
Epoch 90:  88%|████████▊ | 85/97 [00:13<00:01,  6.50it/s, loss=1.97, v_num=0]
Epoch 90:  88%|████████▊ | 85/97 [00:13<00:01,  6.47it/s, loss=1.97, v_num=0]
Epoch 90:  89%|████████▊ | 86/97 [00:13<00:01,  6.51it/s, loss=1.97, v_num=0]
Epoch 90:  89%|████████▊ | 86/97 [00:13<00:01,  6.48it/s, loss=1.97, v_num=0]
Epoch 90:  90%|████████▉ | 87/97 [00:13<00:01,  6.52it/s, loss=1.97, v_num=0]
Epoch 90:  90%|████████▉ | 87/97 [00:13<00:01,  6.49it/s, loss=1.97, v_num=0]
Epoch 90:  91%|█████████ | 88/97 [00:13<00:01,  6.52it/s, loss=1.97, v_num=0]
Epoch 90:  91%|█████████ | 88/97 [00:13<00:01,  6.50it/s, loss=1.97, v_num=0]
Epoch 90:  92%|█████████▏| 89/97 [00:13<00:01,  6.53it/s, loss=1.97, v_num=0]
Epoch 90:  92%|█████████▏| 89/97 [00:13<00:01,  6.50it/s, loss=1.98, v_num=0]
Epoch 90:  93%|█████████▎| 90/97 [00:13<00:01,  6.54it/s, loss=1.98, v_num=0]
Epoch 90:  93%|█████████▎| 90/97 [00:13<00:01,  6.51it/s, loss=1.97, v_num=0]
Epoch 90:  94%|█████████▍| 91/97 [00:13<00:00,  6.54it/s, loss=1.97, v_num=0]
Epoch 90:  94%|█████████▍| 91/97 [00:13<00:00,  6.52it/s, loss=1.98, v_num=0]
Epoch 90:  95%|█████████▍| 92/97 [00:14<00:00,  6.55it/s, loss=1.98, v_num=0]
Epoch 90:  95%|█████████▍| 92/97 [00:14<00:00,  6.52it/s, loss=1.98, v_num=0]
Epoch 90:  96%|█████████▌| 93/97 [00:14<00:00,  6.56it/s, loss=1.98, v_num=0]
Epoch 90:  96%|█████████▌| 93/97 [00:14<00:00,  6.53it/s, loss=1.97, v_num=0]
Epoch 90:  97%|█████████▋| 94/97 [00:14<00:00,  6.56it/s, loss=1.97, v_num=0]
Epoch 90:  97%|█████████▋| 94/97 [00:14<00:00,  6.54it/s, loss=1.97, v_num=0]
Epoch 90:  98%|█████████▊| 95/97 [00:14<00:00,  6.57it/s, loss=1.97, v_num=0]
Epoch 90:  98%|█████████▊| 95/97 [00:14<00:00,  6.54it/s, loss=1.97, v_num=0]
Epoch 90:  99%|█████████▉| 96/97 [00:14<00:00,  6.57it/s, loss=1.97, v_num=0]
Epoch 90:  99%|█████████▉| 96/97 [00:14<00:00,  6.55it/s, loss=1.98, v_num=0]
Epoch 90: 100%|██████████| 97/97 [00:14<00:00,  6.58it/s, loss=1.98, v_num=0]
Epoch 90: 100%|██████████| 97/97 [00:14<00:00,  6.56it/s, loss=1.98, v_num=0]
Epoch 90: 100%|██████████| 97/97 [00:14<00:00,  6.55it/s, loss=1.98, v_num=0]
Epoch 90:   0%|          | 0/97 [00:00<?, ?it/s, loss=1.98, v_num=0]
Epoch 91:   0%|          | 0/97 [00:00<?, ?it/s, loss=1.98, v_num=0]
Epoch 91:   1%|          | 1/97 [00:01<02:33,  1.60s/it, loss=1.98, v_num=0]
Epoch 91:   1%|          | 1/97 [00:01<02:38,  1.65s/it, loss=1.98, v_num=0]
Epoch 91:   2%|▏         | 2/97 [00:01<01:22,  1.15it/s, loss=1.98, v_num=0]
Epoch 91:   2%|▏         | 2/97 [00:01<01:24,  1.12it/s, loss=1.98, v_num=0]
Epoch 91:   3%|▎         | 3/97 [00:01<00:58,  1.60it/s, loss=1.98, v_num=0]
Epoch 91:   3%|▎         | 3/97 [00:01<01:00,  1.56it/s, loss=1.97, v_num=0]
Epoch 91:   4%|▍         | 4/97 [00:02<00:46,  1.99it/s, loss=1.97, v_num=0]
Epoch 91:   4%|▍         | 4/97 [00:02<00:48,  1.94it/s, loss=1.97, v_num=0]
Epoch 91:   5%|▌         | 5/97 [00:02<00:39,  2.32it/s, loss=1.97, v_num=0]
Epoch 91:   5%|▌         | 5/97 [00:02<00:40,  2.27it/s, loss=1.97, v_num=0]
Epoch 91:   6%|▌         | 6/97 [00:02<00:34,  2.60it/s, loss=1.97, v_num=0]
Epoch 91:   6%|▌         | 6/97 [00:02<00:35,  2.54it/s, loss=1.96, v_num=0]
Epoch 91:   7%|▋         | 7/97 [00:02<00:31,  2.86it/s, loss=1.96, v_num=0]
Epoch 91:   7%|▋         | 7/97 [00:02<00:32,  2.79it/s, loss=1.96, v_num=0]
Epoch 91:   8%|▊         | 8/97 [00:02<00:28,  3.09it/s, loss=1.96, v_num=0]
Epoch 91:   8%|▊         | 8/97 [00:02<00:29,  3.02it/s, loss=1.96, v_num=0]
Epoch 91:   9%|▉         | 9/97 [00:02<00:26,  3.29it/s, loss=1.96, v_num=0]
Epoch 91:   9%|▉         | 9/97 [00:02<00:27,  3.22it/s, loss=1.96, v_num=0]
Epoch 91:  10%|█         | 10/97 [00:02<00:25,  3.48it/s, loss=1.96, v_num=0]
Epoch 91:  10%|█         | 10/97 [00:02<00:25,  3.41it/s, loss=1.96, v_num=0]
Epoch 91:  11%|█▏        | 11/97 [00:03<00:23,  3.65it/s, loss=1.96, v_num=0]
Epoch 91:  11%|█▏        | 11/97 [00:03<00:23,  3.58it/s, loss=1.96, v_num=0]
Epoch 91:  12%|█▏        | 12/97 [00:03<00:22,  3.80it/s, loss=1.96, v_num=0]
Epoch 91:  12%|█▏        | 12/97 [00:03<00:22,  3.74it/s, loss=1.95, v_num=0]
Epoch 91:  13%|█▎        | 13/97 [00:03<00:21,  3.95it/s, loss=1.95, v_num=0]
Epoch 91:  13%|█▎        | 13/97 [00:03<00:21,  3.88it/s, loss=1.96, v_num=0]
Epoch 91:  14%|█▍        | 14/97 [00:03<00:20,  4.08it/s, loss=1.96, v_num=0]
Epoch 91:  14%|█▍        | 14/97 [00:03<00:20,  4.02it/s, loss=1.96, v_num=0]
Epoch 91:  15%|█▌        | 15/97 [00:03<00:19,  4.20it/s, loss=1.96, v_num=0]
Epoch 91:  15%|█▌        | 15/97 [00:03<00:19,  4.14it/s, loss=1.97, v_num=0]
Epoch 91:  16%|█▋        | 16/97 [00:03<00:18,  4.31it/s, loss=1.97, v_num=0]
Epoch 91:  16%|█▋        | 16/97 [00:03<00:19,  4.25it/s, loss=1.97, v_num=0]
Epoch 91:  18%|█▊        | 17/97 [00:03<00:18,  4.42it/s, loss=1.97, v_num=0]
Epoch 91:  18%|█▊        | 17/97 [00:03<00:18,  4.36it/s, loss=1.96, v_num=0]
Epoch 91:  19%|█▊        | 18/97 [00:03<00:17,  4.51it/s, loss=1.96, v_num=0]
Epoch 91:  19%|█▊        | 18/97 [00:04<00:17,  4.45it/s, loss=1.96, v_num=0]
Epoch 91:  20%|█▉        | 19/97 [00:04<00:16,  4.60it/s, loss=1.96, v_num=0]
Epoch 91:  20%|█▉        | 19/97 [00:04<00:17,  4.55it/s, loss=1.95, v_num=0]
Epoch 91:  21%|██        | 20/97 [00:04<00:16,  4.69it/s, loss=1.95, v_num=0]
Epoch 91:  21%|██        | 20/97 [00:04<00:16,  4.63it/s, loss=1.95, v_num=0]
Epoch 91:  22%|██▏       | 21/97 [00:04<00:15,  4.78it/s, loss=1.95, v_num=0]
Epoch 91:  22%|██▏       | 21/97 [00:04<00:16,  4.71it/s, loss=1.95, v_num=0]
Epoch 91:  23%|██▎       | 22/97 [00:04<00:15,  4.85it/s, loss=1.95, v_num=0]
Epoch 91:  23%|██▎       | 22/97 [00:04<00:15,  4.79it/s, loss=1.95, v_num=0]
Epoch 91:  24%|██▎       | 23/97 [00:04<00:15,  4.92it/s, loss=1.95, v_num=0]
Epoch 91:  24%|██▎       | 23/97 [00:04<00:15,  4.86it/s, loss=1.96, v_num=0]
Epoch 91:  25%|██▍       | 24/97 [00:04<00:14,  4.98it/s, loss=1.96, v_num=0]
Epoch 91:  25%|██▍       | 24/97 [00:04<00:14,  4.93it/s, loss=1.96, v_num=0]
Epoch 91:  26%|██▌       | 25/97 [00:04<00:14,  5.05it/s, loss=1.96, v_num=0]
Epoch 91:  26%|██▌       | 25/97 [00:05<00:14,  4.99it/s, loss=1.96, v_num=0]
Epoch 91:  27%|██▋       | 26/97 [00:05<00:13,  5.11it/s, loss=1.96, v_num=0]
Epoch 91:  27%|██▋       | 26/97 [00:05<00:14,  5.05it/s, loss=1.96, v_num=0]
Epoch 91:  28%|██▊       | 27/97 [00:05<00:13,  5.16it/s, loss=1.96, v_num=0]
Epoch 91:  28%|██▊       | 27/97 [00:05<00:13,  5.11it/s, loss=1.96, v_num=0]
Epoch 91:  29%|██▉       | 28/97 [00:05<00:13,  5.22it/s, loss=1.96, v_num=0]
Epoch 91:  29%|██▉       | 28/97 [00:05<00:13,  5.16it/s, loss=1.96, v_num=0]
Epoch 91:  30%|██▉       | 29/97 [00:05<00:12,  5.27it/s, loss=1.96, v_num=0]
Epoch 91:  30%|██▉       | 29/97 [00:05<00:13,  5.21it/s, loss=1.95, v_num=0]
Epoch 91:  31%|███       | 30/97 [00:05<00:12,  5.31it/s, loss=1.95, v_num=0]
Epoch 91:  31%|███       | 30/97 [00:05<00:12,  5.26it/s, loss=1.95, v_num=0]
Epoch 91:  32%|███▏      | 31/97 [00:05<00:12,  5.36it/s, loss=1.95, v_num=0]
Epoch 91:  32%|███▏      | 31/97 [00:05<00:12,  5.31it/s, loss=1.95, v_num=0]
Epoch 91:  33%|███▎      | 32/97 [00:05<00:12,  5.40it/s, loss=1.95, v_num=0]
Epoch 91:  33%|███▎      | 32/97 [00:05<00:12,  5.35it/s, loss=1.96, v_num=0]
Epoch 91:  34%|███▍      | 33/97 [00:06<00:11,  5.44it/s, loss=1.96, v_num=0]
Epoch 91:  34%|███▍      | 33/97 [00:06<00:11,  5.40it/s, loss=1.95, v_num=0]
Epoch 91:  35%|███▌      | 34/97 [00:06<00:11,  5.49it/s, loss=1.95, v_num=0]
Epoch 91:  35%|███▌      | 34/97 [00:06<00:11,  5.44it/s, loss=1.95, v_num=0]
Epoch 91:  36%|███▌      | 35/97 [00:06<00:11,  5.52it/s, loss=1.95, v_num=0]
Epoch 91:  36%|███▌      | 35/97 [00:06<00:11,  5.48it/s, loss=1.95, v_num=0]
Epoch 91:  37%|███▋      | 36/97 [00:06<00:10,  5.56it/s, loss=1.95, v_num=0]
Epoch 91:  37%|███▋      | 36/97 [00:06<00:11,  5.51it/s, loss=1.95, v_num=0]
Epoch 91:  38%|███▊      | 37/97 [00:06<00:10,  5.59it/s, loss=1.95, v_num=0]
Epoch 91:  38%|███▊      | 37/97 [00:06<00:10,  5.55it/s, loss=1.96, v_num=0]
Epoch 91:  39%|███▉      | 38/97 [00:06<00:10,  5.63it/s, loss=1.96, v_num=0]
Epoch 91:  39%|███▉      | 38/97 [00:06<00:10,  5.58it/s, loss=1.96, v_num=0]
Epoch 91:  40%|████      | 39/97 [00:06<00:10,  5.66it/s, loss=1.96, v_num=0]
Epoch 91:  40%|████      | 39/97 [00:06<00:10,  5.62it/s, loss=1.97, v_num=0]
Epoch 91:  41%|████      | 40/97 [00:07<00:10,  5.69it/s, loss=1.97, v_num=0]
Epoch 91:  41%|████      | 40/97 [00:07<00:10,  5.65it/s, loss=1.97, v_num=0]
Epoch 91:  42%|████▏     | 41/97 [00:07<00:09,  5.73it/s, loss=1.97, v_num=0]
Epoch 91:  42%|████▏     | 41/97 [00:07<00:09,  5.68it/s, loss=1.96, v_num=0]
Epoch 91:  43%|████▎     | 42/97 [00:07<00:09,  5.75it/s, loss=1.96, v_num=0]
Epoch 91:  43%|████▎     | 42/97 [00:07<00:09,  5.71it/s, loss=1.96, v_num=0]
Epoch 91:  44%|████▍     | 43/97 [00:07<00:09,  5.78it/s, loss=1.96, v_num=0]
Epoch 91:  44%|████▍     | 43/97 [00:07<00:09,  5.74it/s, loss=1.97, v_num=0]
Epoch 91:  45%|████▌     | 44/97 [00:07<00:09,  5.81it/s, loss=1.97, v_num=0]
Epoch 91:  45%|████▌     | 44/97 [00:07<00:09,  5.77it/s, loss=1.96, v_num=0]
Epoch 91:  46%|████▋     | 45/97 [00:07<00:08,  5.83it/s, loss=1.96, v_num=0]
Epoch 91:  46%|████▋     | 45/97 [00:07<00:08,  5.79it/s, loss=1.96, v_num=0]
Epoch 91:  47%|████▋     | 46/97 [00:07<00:08,  5.86it/s, loss=1.96, v_num=0]
Epoch 91:  47%|████▋     | 46/97 [00:07<00:08,  5.82it/s, loss=1.97, v_num=0]
Epoch 91:  48%|████▊     | 47/97 [00:07<00:08,  5.88it/s, loss=1.97, v_num=0]
Epoch 91:  48%|████▊     | 47/97 [00:08<00:08,  5.84it/s, loss=1.97, v_num=0]
Epoch 91:  49%|████▉     | 48/97 [00:08<00:08,  5.91it/s, loss=1.97, v_num=0]
Epoch 91:  49%|████▉     | 48/97 [00:08<00:08,  5.86it/s, loss=1.97, v_num=0]
Epoch 91:  51%|█████     | 49/97 [00:08<00:08,  5.93it/s, loss=1.97, v_num=0]
Epoch 91:  51%|█████     | 49/97 [00:08<00:08,  5.89it/s, loss=1.97, v_num=0]
Epoch 91:  52%|█████▏    | 50/97 [00:08<00:07,  5.94it/s, loss=1.97, v_num=0]
Epoch 91:  52%|█████▏    | 50/97 [00:08<00:07,  5.91it/s, loss=1.98, v_num=0]
Epoch 91:  53%|█████▎    | 51/97 [00:08<00:07,  5.97it/s, loss=1.98, v_num=0]
Epoch 91:  53%|█████▎    | 51/97 [00:08<00:07,  5.93it/s, loss=1.98, v_num=0]
Epoch 91:  54%|█████▎    | 52/97 [00:08<00:07,  5.97it/s, loss=1.98, v_num=0]
Epoch 91:  54%|█████▎    | 52/97 [00:08<00:07,  5.93it/s, loss=1.98, v_num=0]
Epoch 91:  55%|█████▍    | 53/97 [00:08<00:07,  5.99it/s, loss=1.98, v_num=0]
Epoch 91:  55%|█████▍    | 53/97 [00:08<00:07,  5.95it/s, loss=1.99, v_num=0]
Epoch 91:  56%|█████▌    | 54/97 [00:08<00:07,  6.01it/s, loss=1.99, v_num=0]
Epoch 91:  56%|█████▌    | 54/97 [00:09<00:07,  5.97it/s, loss=1.98, v_num=0]
Epoch 91:  57%|█████▋    | 55/97 [00:09<00:06,  6.02it/s, loss=1.98, v_num=0]
Epoch 91:  57%|█████▋    | 55/97 [00:09<00:07,  5.98it/s, loss=1.98, v_num=0]
Epoch 91:  58%|█████▊    | 56/97 [00:09<00:06,  6.04it/s, loss=1.98, v_num=0]
Epoch 91:  58%|█████▊    | 56/97 [00:09<00:06,  6.00it/s, loss=1.98, v_num=0]
Epoch 91:  59%|█████▉    | 57/97 [00:09<00:06,  6.06it/s, loss=1.98, v_num=0]
Epoch 91:  59%|█████▉    | 57/97 [00:09<00:06,  6.02it/s, loss=1.98, v_num=0]
Epoch 91:  60%|█████▉    | 58/97 [00:09<00:06,  6.07it/s, loss=1.98, v_num=0]
Epoch 91:  60%|█████▉    | 58/97 [00:09<00:06,  6.04it/s, loss=1.98, v_num=0]
Epoch 91:  61%|██████    | 59/97 [00:09<00:06,  6.09it/s, loss=1.98, v_num=0]
Epoch 91:  61%|██████    | 59/97 [00:09<00:06,  6.05it/s, loss=1.98, v_num=0]
Epoch 91:  62%|██████▏   | 60/97 [00:09<00:06,  6.10it/s, loss=1.98, v_num=0]
Epoch 91:  62%|██████▏   | 60/97 [00:09<00:06,  6.07it/s, loss=1.98, v_num=0]
Epoch 91:  63%|██████▎   | 61/97 [00:09<00:05,  6.12it/s, loss=1.98, v_num=0]
Epoch 91:  63%|██████▎   | 61/97 [00:10<00:05,  6.09it/s, loss=1.98, v_num=0]
Epoch 91:  64%|██████▍   | 62/97 [00:10<00:05,  6.14it/s, loss=1.98, v_num=0]
Epoch 91:  64%|██████▍   | 62/97 [00:10<00:05,  6.10it/s, loss=1.98, v_num=0]
Epoch 91:  65%|██████▍   | 63/97 [00:10<00:05,  6.16it/s, loss=1.98, v_num=0]
Epoch 91:  65%|██████▍   | 63/97 [00:10<00:05,  6.12it/s, loss=1.98, v_num=0]
Epoch 91:  66%|██████▌   | 64/97 [00:10<00:05,  6.17it/s, loss=1.98, v_num=0]
Epoch 91:  66%|██████▌   | 64/97 [00:10<00:05,  6.13it/s, loss=1.98, v_num=0]
Epoch 91:  67%|██████▋   | 65/97 [00:10<00:05,  6.19it/s, loss=1.98, v_num=0]
Epoch 91:  67%|██████▋   | 65/97 [00:10<00:05,  6.15it/s, loss=1.98, v_num=0]
Epoch 91:  68%|██████▊   | 66/97 [00:10<00:05,  6.20it/s, loss=1.98, v_num=0]
Epoch 91:  68%|██████▊   | 66/97 [00:10<00:05,  6.16it/s, loss=1.98, v_num=0]
Epoch 91:  69%|██████▉   | 67/97 [00:10<00:04,  6.21it/s, loss=1.98, v_num=0]
Epoch 91:  69%|██████▉   | 67/97 [00:10<00:04,  6.18it/s, loss=1.98, v_num=0]
Epoch 91:  70%|███████   | 68/97 [00:10<00:04,  6.22it/s, loss=1.98, v_num=0]
Epoch 91:  70%|███████   | 68/97 [00:10<00:04,  6.19it/s, loss=1.98, v_num=0]
Epoch 91:  71%|███████   | 69/97 [00:11<00:04,  6.23it/s, loss=1.98, v_num=0]
Epoch 91:  71%|███████   | 69/97 [00:11<00:04,  6.20it/s, loss=1.98, v_num=0]
Epoch 91:  72%|███████▏  | 70/97 [00:11<00:04,  6.24it/s, loss=1.98, v_num=0]
Epoch 91:  72%|███████▏  | 70/97 [00:11<00:04,  6.21it/s, loss=1.98, v_num=0]
Epoch 91:  73%|███████▎  | 71/97 [00:11<00:04,  6.25it/s, loss=1.98, v_num=0]
Epoch 91:  73%|███████▎  | 71/97 [00:11<00:04,  6.22it/s, loss=1.98, v_num=0]
Epoch 91:  74%|███████▍  | 72/97 [00:11<00:03,  6.26it/s, loss=1.98, v_num=0]
Epoch 91:  74%|███████▍  | 72/97 [00:11<00:04,  6.23it/s, loss=1.98, v_num=0]
Epoch 91:  75%|███████▌  | 73/97 [00:11<00:03,  6.28it/s, loss=1.98, v_num=0]
Epoch 91:  75%|███████▌  | 73/97 [00:11<00:03,  6.25it/s, loss=1.97, v_num=0]
Epoch 91:  76%|███████▋  | 74/97 [00:11<00:03,  6.28it/s, loss=1.97, v_num=0]
Epoch 91:  76%|███████▋  | 74/97 [00:11<00:03,  6.25it/s, loss=1.97, v_num=0]
Epoch 91:  77%|███████▋  | 75/97 [00:11<00:03,  6.29it/s, loss=1.97, v_num=0]
Epoch 91:  77%|███████▋  | 75/97 [00:11<00:03,  6.26it/s, loss=1.97, v_num=0]
Epoch 91:  78%|███████▊  | 76/97 [00:12<00:03,  6.29it/s, loss=1.97, v_num=0]
Epoch 91:  78%|███████▊  | 76/97 [00:12<00:03,  6.26it/s, loss=1.98, v_num=0]
Epoch 91:  79%|███████▉  | 77/97 [00:12<00:03,  6.30it/s, loss=1.98, v_num=0]
Epoch 91:  79%|███████▉  | 77/97 [00:12<00:03,  6.27it/s, loss=1.97, v_num=0]
Epoch 91:  80%|████████  | 78/97 [00:12<00:03,  6.31it/s, loss=1.97, v_num=0]
Epoch 91:  80%|████████  | 78/97 [00:12<00:03,  6.28it/s, loss=1.96, v_num=0]
Epoch 91:  81%|████████▏ | 79/97 [00:12<00:02,  6.32it/s, loss=1.96, v_num=0]
Epoch 91:  81%|████████▏ | 79/97 [00:12<00:02,  6.29it/s, loss=1.97, v_num=0]
Epoch 91:  82%|████████▏ | 80/97 [00:12<00:02,  6.33it/s, loss=1.97, v_num=0]
Epoch 91:  82%|████████▏ | 80/97 [00:12<00:02,  6.30it/s, loss=1.97, v_num=0]
Epoch 91:  84%|████████▎ | 81/97 [00:12<00:02,  6.34it/s, loss=1.97, v_num=0]
Epoch 91:  84%|████████▎ | 81/97 [00:12<00:02,  6.31it/s, loss=1.98, v_num=0]
Epoch 91:  85%|████████▍ | 82/97 [00:12<00:02,  6.35it/s, loss=1.98, v_num=0]
Epoch 91:  85%|████████▍ | 82/97 [00:12<00:02,  6.32it/s, loss=1.97, v_num=0]
Epoch 91:  86%|████████▌ | 83/97 [00:13<00:02,  6.35it/s, loss=1.97, v_num=0]
Epoch 91:  86%|████████▌ | 83/97 [00:13<00:02,  6.33it/s, loss=1.97, v_num=0]
Epoch 91:  87%|████████▋ | 84/97 [00:13<00:02,  6.36it/s, loss=1.97, v_num=0]
Epoch 91:  87%|████████▋ | 84/97 [00:13<00:02,  6.34it/s, loss=1.97, v_num=0]
Epoch 91:  88%|████████▊ | 85/97 [00:13<00:01,  6.37it/s, loss=1.97, v_num=0]
Epoch 91:  88%|████████▊ | 85/97 [00:13<00:01,  6.35it/s, loss=1.97, v_num=0]
Epoch 91:  89%|████████▊ | 86/97 [00:13<00:01,  6.38it/s, loss=1.97, v_num=0]
Epoch 91:  89%|████████▊ | 86/97 [00:13<00:01,  6.36it/s, loss=1.97, v_num=0]
Epoch 91:  90%|████████▉ | 87/97 [00:13<00:01,  6.39it/s, loss=1.97, v_num=0]
Epoch 91:  90%|████████▉ | 87/97 [00:13<00:01,  6.37it/s, loss=1.97, v_num=0]
Epoch 91:  91%|█████████ | 88/97 [00:13<00:01,  6.40it/s, loss=1.97, v_num=0]
Epoch 91:  91%|█████████ | 88/97 [00:13<00:01,  6.37it/s, loss=1.97, v_num=0]
Epoch 91:  92%|█████████▏| 89/97 [00:13<00:01,  6.41it/s, loss=1.97, v_num=0]
Epoch 91:  92%|█████████▏| 89/97 [00:13<00:01,  6.38it/s, loss=1.97, v_num=0]
Epoch 91:  93%|█████████▎| 90/97 [00:14<00:01,  6.42it/s, loss=1.97, v_num=0]
Epoch 91:  93%|█████████▎| 90/97 [00:14<00:01,  6.39it/s, loss=1.97, v_num=0]
Epoch 91:  94%|█████████▍| 91/97 [00:14<00:00,  6.43it/s, loss=1.97, v_num=0]
Epoch 91:  94%|█████████▍| 91/97 [00:14<00:00,  6.40it/s, loss=1.97, v_num=0]
Epoch 91:  95%|█████████▍| 92/97 [00:14<00:00,  6.43it/s, loss=1.97, v_num=0]
Epoch 91:  95%|█████████▍| 92/97 [00:14<00:00,  6.41it/s, loss=1.97, v_num=0]
Epoch 91:  96%|█████████▌| 93/97 [00:14<00:00,  6.44it/s, loss=1.97, v_num=0]
Epoch 91:  96%|█████████▌| 93/97 [00:14<00:00,  6.41it/s, loss=1.98, v_num=0]
Epoch 91:  97%|█████████▋| 94/97 [00:14<00:00,  6.45it/s, loss=1.98, v_num=0]
Epoch 91:  97%|█████████▋| 94/97 [00:14<00:00,  6.42it/s, loss=1.98, v_num=0]
Epoch 91:  98%|█████████▊| 95/97 [00:14<00:00,  6.45it/s, loss=1.98, v_num=0]
Epoch 91:  98%|█████████▊| 95/97 [00:14<00:00,  6.43it/s, loss=1.98, v_num=0]
Epoch 91:  99%|█████████▉| 96/97 [00:14<00:00,  6.46it/s, loss=1.98, v_num=0]
Epoch 91:  99%|█████████▉| 96/97 [00:14<00:00,  6.44it/s, loss=1.98, v_num=0]
Epoch 91: 100%|██████████| 97/97 [00:14<00:00,  6.47it/s, loss=1.98, v_num=0]
Epoch 91: 100%|██████████| 97/97 [00:15<00:00,  6.44it/s, loss=1.98, v_num=0]
Epoch 91: 100%|██████████| 97/97 [00:15<00:00,  6.44it/s, loss=1.98, v_num=0]
Epoch 91:   0%|          | 0/97 [00:00<?, ?it/s, loss=1.98, v_num=0]
Epoch 92:   0%|          | 0/97 [00:00<?, ?it/s, loss=1.98, v_num=0]
Epoch 92:   1%|          | 1/97 [00:01<02:28,  1.55s/it, loss=1.98, v_num=0]
Epoch 92:   1%|          | 1/97 [00:01<02:34,  1.61s/it, loss=1.98, v_num=0]
Epoch 92:   2%|▏         | 2/97 [00:01<01:20,  1.18it/s, loss=1.98, v_num=0]
Epoch 92:   2%|▏         | 2/97 [00:01<01:23,  1.14it/s, loss=1.98, v_num=0]
Epoch 92:   3%|▎         | 3/97 [00:01<00:58,  1.61it/s, loss=1.98, v_num=0]
Epoch 92:   3%|▎         | 3/97 [00:01<01:00,  1.57it/s, loss=1.98, v_num=0]
Epoch 92:   4%|▍         | 4/97 [00:02<00:46,  1.99it/s, loss=1.98, v_num=0]
Epoch 92:   4%|▍         | 4/97 [00:02<00:47,  1.94it/s, loss=1.98, v_num=0]
Epoch 92:   5%|▌         | 5/97 [00:02<00:39,  2.31it/s, loss=1.98, v_num=0]
Epoch 92:   5%|▌         | 5/97 [00:02<00:40,  2.26it/s, loss=1.99, v_num=0]
Epoch 92:   6%|▌         | 6/97 [00:02<00:34,  2.60it/s, loss=1.99, v_num=0]
Epoch 92:   6%|▌         | 6/97 [00:02<00:35,  2.54it/s, loss=1.99, v_num=0]
Epoch 92:   7%|▋         | 7/97 [00:02<00:31,  2.86it/s, loss=1.99, v_num=0]
Epoch 92:   7%|▋         | 7/97 [00:02<00:32,  2.80it/s, loss=1.99, v_num=0]
Epoch 92:   8%|▊         | 8/97 [00:02<00:28,  3.09it/s, loss=1.99, v_num=0]
Epoch 92:   8%|▊         | 8/97 [00:02<00:29,  3.02it/s, loss=1.99, v_num=0]
Epoch 92:   9%|▉         | 9/97 [00:02<00:26,  3.29it/s, loss=1.99, v_num=0]
Epoch 92:   9%|▉         | 9/97 [00:02<00:27,  3.23it/s, loss=1.99, v_num=0]
Epoch 92:  10%|█         | 10/97 [00:02<00:25,  3.47it/s, loss=1.99, v_num=0]
Epoch 92:  10%|█         | 10/97 [00:02<00:25,  3.40it/s, loss=1.99, v_num=0]
Epoch 92:  11%|█▏        | 11/97 [00:03<00:23,  3.63it/s, loss=1.99, v_num=0]
Epoch 92:  11%|█▏        | 11/97 [00:03<00:24,  3.57it/s, loss=1.99, v_num=0]
Epoch 92:  12%|█▏        | 12/97 [00:03<00:22,  3.80it/s, loss=1.99, v_num=0]
Epoch 92:  12%|█▏        | 12/97 [00:03<00:22,  3.73it/s, loss=1.99, v_num=0]
Epoch 92:  13%|█▎        | 13/97 [00:03<00:21,  3.94it/s, loss=1.99, v_num=0]
Epoch 92:  13%|█▎        | 13/97 [00:03<00:21,  3.87it/s, loss=1.99, v_num=0]
Epoch 92:  14%|█▍        | 14/97 [00:03<00:20,  4.07it/s, loss=1.99, v_num=0]
Epoch 92:  14%|█▍        | 14/97 [00:03<00:20,  4.01it/s, loss=1.98, v_num=0]
Epoch 92:  15%|█▌        | 15/97 [00:03<00:19,  4.20it/s, loss=1.98, v_num=0]
Epoch 92:  15%|█▌        | 15/97 [00:03<00:19,  4.13it/s, loss=1.98, v_num=0]
Epoch 92:  16%|█▋        | 16/97 [00:03<00:18,  4.31it/s, loss=1.98, v_num=0]
Epoch 92:  16%|█▋        | 16/97 [00:03<00:19,  4.25it/s, loss=1.98, v_num=0]
Epoch 92:  18%|█▊        | 17/97 [00:03<00:18,  4.42it/s, loss=1.98, v_num=0]
Epoch 92:  18%|█▊        | 17/97 [00:03<00:18,  4.35it/s, loss=1.98, v_num=0]
Epoch 92:  19%|█▊        | 18/97 [00:03<00:17,  4.52it/s, loss=1.98, v_num=0]
Epoch 92:  19%|█▊        | 18/97 [00:04<00:17,  4.45it/s, loss=1.97, v_num=0]
Epoch 92:  20%|█▉        | 19/97 [00:04<00:16,  4.61it/s, loss=1.97, v_num=0]
Epoch 92:  20%|█▉        | 19/97 [00:04<00:17,  4.55it/s, loss=1.97, v_num=0]
Epoch 92:  21%|██        | 20/97 [00:04<00:16,  4.70it/s, loss=1.97, v_num=0]
Epoch 92:  21%|██        | 20/97 [00:04<00:16,  4.64it/s, loss=1.97, v_num=0]
Epoch 92:  22%|██▏       | 21/97 [00:04<00:15,  4.78it/s, loss=1.97, v_num=0]
Epoch 92:  22%|██▏       | 21/97 [00:04<00:16,  4.72it/s, loss=1.96, v_num=0]
Epoch 92:  23%|██▎       | 22/97 [00:04<00:15,  4.86it/s, loss=1.96, v_num=0]
Epoch 92:  23%|██▎       | 22/97 [00:04<00:15,  4.80it/s, loss=1.96, v_num=0]
Epoch 92:  24%|██▎       | 23/97 [00:04<00:15,  4.93it/s, loss=1.96, v_num=0]
Epoch 92:  24%|██▎       | 23/97 [00:04<00:15,  4.87it/s, loss=1.96, v_num=0]
Epoch 92:  25%|██▍       | 24/97 [00:04<00:14,  5.00it/s, loss=1.96, v_num=0]
Epoch 92:  25%|██▍       | 24/97 [00:04<00:14,  4.94it/s, loss=1.96, v_num=0]
Epoch 92:  26%|██▌       | 25/97 [00:04<00:14,  5.06it/s, loss=1.96, v_num=0]
Epoch 92:  26%|██▌       | 25/97 [00:04<00:14,  5.00it/s, loss=1.95, v_num=0]
Epoch 92:  27%|██▋       | 26/97 [00:05<00:13,  5.12it/s, loss=1.95, v_num=0]
Epoch 92:  27%|██▋       | 26/97 [00:05<00:14,  5.07it/s, loss=1.95, v_num=0]
Epoch 92:  28%|██▊       | 27/97 [00:05<00:13,  5.18it/s, loss=1.95, v_num=0]
Epoch 92:  28%|██▊       | 27/97 [00:05<00:13,  5.12it/s, loss=1.95, v_num=0]
Epoch 92:  29%|██▉       | 28/97 [00:05<00:13,  5.23it/s, loss=1.95, v_num=0]
Epoch 92:  29%|██▉       | 28/97 [00:05<00:13,  5.18it/s, loss=1.95, v_num=0]
Epoch 92:  30%|██▉       | 29/97 [00:05<00:12,  5.29it/s, loss=1.95, v_num=0]
Epoch 92:  30%|██▉       | 29/97 [00:05<00:12,  5.23it/s, loss=1.95, v_num=0]
Epoch 92:  31%|███       | 30/97 [00:05<00:12,  5.34it/s, loss=1.95, v_num=0]
Epoch 92:  31%|███       | 30/97 [00:05<00:12,  5.28it/s, loss=1.95, v_num=0]
Epoch 92:  32%|███▏      | 31/97 [00:05<00:12,  5.38it/s, loss=1.95, v_num=0]
Epoch 92:  32%|███▏      | 31/97 [00:05<00:12,  5.33it/s, loss=1.95, v_num=0]
Epoch 92:  33%|███▎      | 32/97 [00:05<00:11,  5.43it/s, loss=1.95, v_num=0]
Epoch 92:  33%|███▎      | 32/97 [00:05<00:12,  5.38it/s, loss=1.95, v_num=0]
Epoch 92:  34%|███▍      | 33/97 [00:06<00:11,  5.47it/s, loss=1.95, v_num=0]
Epoch 92:  34%|███▍      | 33/97 [00:06<00:11,  5.42it/s, loss=1.95, v_num=0]
Epoch 92:  35%|███▌      | 34/97 [00:06<00:11,  5.51it/s, loss=1.95, v_num=0]
Epoch 92:  35%|███▌      | 34/97 [00:06<00:11,  5.46it/s, loss=1.94, v_num=0]
Epoch 92:  36%|███▌      | 35/97 [00:06<00:11,  5.55it/s, loss=1.94, v_num=0]
Epoch 92:  36%|███▌      | 35/97 [00:06<00:11,  5.50it/s, loss=1.95, v_num=0]
Epoch 92:  37%|███▋      | 36/97 [00:06<00:10,  5.58it/s, loss=1.95, v_num=0]
Epoch 92:  37%|███▋      | 36/97 [00:06<00:11,  5.54it/s, loss=1.95, v_num=0]
Epoch 92:  38%|███▊      | 37/97 [00:06<00:10,  5.62it/s, loss=1.95, v_num=0]
Epoch 92:  38%|███▊      | 37/97 [00:06<00:10,  5.57it/s, loss=1.94, v_num=0]
Epoch 92:  39%|███▉      | 38/97 [00:06<00:10,  5.65it/s, loss=1.94, v_num=0]
Epoch 92:  39%|███▉      | 38/97 [00:06<00:10,  5.61it/s, loss=1.95, v_num=0]
Epoch 92:  40%|████      | 39/97 [00:06<00:10,  5.68it/s, loss=1.95, v_num=0]
Epoch 92:  40%|████      | 39/97 [00:06<00:10,  5.64it/s, loss=1.95, v_num=0]
Epoch 92:  41%|████      | 40/97 [00:07<00:09,  5.71it/s, loss=1.95, v_num=0]
Epoch 92:  41%|████      | 40/97 [00:07<00:10,  5.67it/s, loss=1.95, v_num=0]
Epoch 92:  42%|████▏     | 41/97 [00:07<00:09,  5.74it/s, loss=1.95, v_num=0]
Epoch 92:  42%|████▏     | 41/97 [00:07<00:09,  5.70it/s, loss=1.95, v_num=0]
Epoch 92:  43%|████▎     | 42/97 [00:07<00:09,  5.77it/s, loss=1.95, v_num=0]
Epoch 92:  43%|████▎     | 42/97 [00:07<00:09,  5.73it/s, loss=1.95, v_num=0]
Epoch 92:  44%|████▍     | 43/97 [00:07<00:09,  5.80it/s, loss=1.95, v_num=0]
Epoch 92:  44%|████▍     | 43/97 [00:07<00:09,  5.76it/s, loss=1.95, v_num=0]
Epoch 92:  45%|████▌     | 44/97 [00:07<00:09,  5.83it/s, loss=1.95, v_num=0]
Epoch 92:  45%|████▌     | 44/97 [00:07<00:09,  5.78it/s, loss=1.94, v_num=0]
Epoch 92:  46%|████▋     | 45/97 [00:07<00:08,  5.86it/s, loss=1.94, v_num=0]
Epoch 92:  46%|████▋     | 45/97 [00:07<00:08,  5.81it/s, loss=1.94, v_num=0]
Epoch 92:  47%|████▋     | 46/97 [00:07<00:08,  5.88it/s, loss=1.94, v_num=0]
Epoch 92:  47%|████▋     | 46/97 [00:07<00:08,  5.84it/s, loss=1.94, v_num=0]
Epoch 92:  48%|████▊     | 47/97 [00:07<00:08,  5.90it/s, loss=1.94, v_num=0]
Epoch 92:  48%|████▊     | 47/97 [00:08<00:08,  5.86it/s, loss=1.94, v_num=0]
Epoch 92:  49%|████▉     | 48/97 [00:08<00:08,  5.93it/s, loss=1.94, v_num=0]
Epoch 92:  49%|████▉     | 48/97 [00:08<00:08,  5.89it/s, loss=1.94, v_num=0]
Epoch 92:  51%|█████     | 49/97 [00:08<00:08,  5.95it/s, loss=1.94, v_num=0]
Epoch 92:  51%|█████     | 49/97 [00:08<00:08,  5.91it/s, loss=1.93, v_num=0]
Epoch 92:  52%|█████▏    | 50/97 [00:08<00:07,  5.97it/s, loss=1.93, v_num=0]
Epoch 92:  52%|█████▏    | 50/97 [00:08<00:07,  5.93it/s, loss=1.93, v_num=0]
Epoch 92:  53%|█████▎    | 51/97 [00:08<00:07,  5.99it/s, loss=1.93, v_num=0]
Epoch 92:  53%|█████▎    | 51/97 [00:08<00:07,  5.95it/s, loss=1.93, v_num=0]
Epoch 92:  54%|█████▎    | 52/97 [00:08<00:07,  6.01it/s, loss=1.93, v_num=0]
Epoch 92:  54%|█████▎    | 52/97 [00:08<00:07,  5.98it/s, loss=1.93, v_num=0]
Epoch 92:  55%|█████▍    | 53/97 [00:08<00:07,  6.03it/s, loss=1.93, v_num=0]
Epoch 92:  55%|█████▍    | 53/97 [00:08<00:07,  6.00it/s, loss=1.94, v_num=0]
Epoch 92:  56%|█████▌    | 54/97 [00:08<00:07,  6.05it/s, loss=1.94, v_num=0]
Epoch 92:  56%|█████▌    | 54/97 [00:08<00:07,  6.02it/s, loss=1.94, v_num=0]
Epoch 92:  57%|█████▋    | 55/97 [00:09<00:06,  6.07it/s, loss=1.94, v_num=0]
Epoch 92:  57%|█████▋    | 55/97 [00:09<00:06,  6.04it/s, loss=1.94, v_num=0]
Epoch 92:  58%|█████▊    | 56/97 [00:09<00:06,  6.09it/s, loss=1.94, v_num=0]
Epoch 92:  58%|█████▊    | 56/97 [00:09<00:06,  6.05it/s, loss=1.94, v_num=0]
Epoch 92:  59%|█████▉    | 57/97 [00:09<00:06,  6.11it/s, loss=1.94, v_num=0]
Epoch 92:  59%|█████▉    | 57/97 [00:09<00:06,  6.07it/s, loss=1.94, v_num=0]
Epoch 92:  60%|█████▉    | 58/97 [00:09<00:06,  6.13it/s, loss=1.94, v_num=0]
Epoch 92:  60%|█████▉    | 58/97 [00:09<00:06,  6.09it/s, loss=1.93, v_num=0]
Epoch 92:  61%|██████    | 59/97 [00:09<00:06,  6.14it/s, loss=1.93, v_num=0]
Epoch 92:  61%|██████    | 59/97 [00:09<00:06,  6.11it/s, loss=1.93, v_num=0]
Epoch 92:  62%|██████▏   | 60/97 [00:09<00:06,  6.16it/s, loss=1.93, v_num=0]
Epoch 92:  62%|██████▏   | 60/97 [00:09<00:06,  6.12it/s, loss=1.93, v_num=0]
Epoch 92:  63%|██████▎   | 61/97 [00:09<00:05,  6.17it/s, loss=1.93, v_num=0]
Epoch 92:  63%|██████▎   | 61/97 [00:09<00:05,  6.14it/s, loss=1.94, v_num=0]
Epoch 92:  64%|██████▍   | 62/97 [00:10<00:05,  6.19it/s, loss=1.94, v_num=0]
Epoch 92:  64%|██████▍   | 62/97 [00:10<00:05,  6.15it/s, loss=1.93, v_num=0]
Epoch 92:  65%|██████▍   | 63/97 [00:10<00:05,  6.20it/s, loss=1.93, v_num=0]
Epoch 92:  65%|██████▍   | 63/97 [00:10<00:05,  6.17it/s, loss=1.94, v_num=0]
Epoch 92:  66%|██████▌   | 64/97 [00:10<00:05,  6.21it/s, loss=1.94, v_num=0]
Epoch 92:  66%|██████▌   | 64/97 [00:10<00:05,  6.18it/s, loss=1.94, v_num=0]
Epoch 92:  67%|██████▋   | 65/97 [00:10<00:05,  6.22it/s, loss=1.94, v_num=0]
Epoch 92:  67%|██████▋   | 65/97 [00:10<00:05,  6.19it/s, loss=1.94, v_num=0]
Epoch 92:  68%|██████▊   | 66/97 [00:10<00:04,  6.24it/s, loss=1.94, v_num=0]
Epoch 92:  68%|██████▊   | 66/97 [00:10<00:04,  6.20it/s, loss=1.94, v_num=0]
Epoch 92:  69%|██████▉   | 67/97 [00:10<00:04,  6.25it/s, loss=1.94, v_num=0]
Epoch 92:  69%|██████▉   | 67/97 [00:10<00:04,  6.22it/s, loss=1.95, v_num=0]
Epoch 92:  70%|███████   | 68/97 [00:10<00:04,  6.26it/s, loss=1.95, v_num=0]
Epoch 92:  70%|███████   | 68/97 [00:10<00:04,  6.23it/s, loss=1.95, v_num=0]
Epoch 92:  71%|███████   | 69/97 [00:11<00:04,  6.27it/s, loss=1.95, v_num=0]
Epoch 92:  71%|███████   | 69/97 [00:11<00:04,  6.24it/s, loss=1.95, v_num=0]
Epoch 92:  72%|███████▏  | 70/97 [00:11<00:04,  6.28it/s, loss=1.95, v_num=0]
Epoch 92:  72%|███████▏  | 70/97 [00:11<00:04,  6.25it/s, loss=1.95, v_num=0]
Epoch 92:  73%|███████▎  | 71/97 [00:11<00:04,  6.29it/s, loss=1.95, v_num=0]
Epoch 92:  73%|███████▎  | 71/97 [00:11<00:04,  6.25it/s, loss=1.96, v_num=0]
Epoch 92:  74%|███████▍  | 72/97 [00:11<00:03,  6.30it/s, loss=1.96, v_num=0]
Epoch 92:  74%|███████▍  | 72/97 [00:11<00:03,  6.27it/s, loss=1.96, v_num=0]
Epoch 92:  75%|███████▌  | 73/97 [00:11<00:03,  6.31it/s, loss=1.96, v_num=0]
Epoch 92:  75%|███████▌  | 73/97 [00:11<00:03,  6.28it/s, loss=1.95, v_num=0]
Epoch 92:  76%|███████▋  | 74/97 [00:11<00:03,  6.32it/s, loss=1.95, v_num=0]
Epoch 92:  76%|███████▋  | 74/97 [00:11<00:03,  6.29it/s, loss=1.96, v_num=0]
Epoch 92:  77%|███████▋  | 75/97 [00:11<00:03,  6.33it/s, loss=1.96, v_num=0]
Epoch 92:  77%|███████▋  | 75/97 [00:11<00:03,  6.30it/s, loss=1.96, v_num=0]
Epoch 92:  78%|███████▊  | 76/97 [00:11<00:03,  6.34it/s, loss=1.96, v_num=0]
Epoch 92:  78%|███████▊  | 76/97 [00:12<00:03,  6.31it/s, loss=1.95, v_num=0]
Epoch 92:  79%|███████▉  | 77/97 [00:12<00:03,  6.33it/s, loss=1.95, v_num=0]
Epoch 92:  79%|███████▉  | 77/97 [00:12<00:03,  6.30it/s, loss=1.96, v_num=0]
Epoch 92:  80%|████████  | 78/97 [00:12<00:02,  6.34it/s, loss=1.96, v_num=0]
Epoch 92:  80%|████████  | 78/97 [00:12<00:03,  6.31it/s, loss=1.96, v_num=0]
Epoch 92:  81%|████████▏ | 79/97 [00:12<00:02,  6.35it/s, loss=1.96, v_num=0]
Epoch 92:  81%|████████▏ | 79/97 [00:12<00:02,  6.32it/s, loss=1.97, v_num=0]
Epoch 92:  82%|████████▏ | 80/97 [00:12<00:02,  6.36it/s, loss=1.97, v_num=0]
Epoch 92:  82%|████████▏ | 80/97 [00:12<00:02,  6.33it/s, loss=1.96, v_num=0]
Epoch 92:  84%|████████▎ | 81/97 [00:12<00:02,  6.36it/s, loss=1.96, v_num=0]
Epoch 92:  84%|████████▎ | 81/97 [00:12<00:02,  6.34it/s, loss=1.97, v_num=0]
Epoch 92:  85%|████████▍ | 82/97 [00:12<00:02,  6.37it/s, loss=1.97, v_num=0]
Epoch 92:  85%|████████▍ | 82/97 [00:12<00:02,  6.34it/s, loss=1.97, v_num=0]
Epoch 92:  86%|████████▌ | 83/97 [00:13<00:02,  6.38it/s, loss=1.97, v_num=0]
Epoch 92:  86%|████████▌ | 83/97 [00:13<00:02,  6.35it/s, loss=1.97, v_num=0]
Epoch 92:  87%|████████▋ | 84/97 [00:13<00:02,  6.38it/s, loss=1.97, v_num=0]
Epoch 92:  87%|████████▋ | 84/97 [00:13<00:02,  6.35it/s, loss=1.97, v_num=0]
Epoch 92:  88%|████████▊ | 85/97 [00:13<00:01,  6.39it/s, loss=1.97, v_num=0]
Epoch 92:  88%|████████▊ | 85/97 [00:13<00:01,  6.36it/s, loss=1.97, v_num=0]
Epoch 92:  89%|████████▊ | 86/97 [00:13<00:01,  6.40it/s, loss=1.97, v_num=0]
Epoch 92:  89%|████████▊ | 86/97 [00:13<00:01,  6.37it/s, loss=1.97, v_num=0]
Epoch 92:  90%|████████▉ | 87/97 [00:13<00:01,  6.41it/s, loss=1.97, v_num=0]
Epoch 92:  90%|████████▉ | 87/97 [00:13<00:01,  6.38it/s, loss=1.97, v_num=0]
Epoch 92:  91%|█████████ | 88/97 [00:13<00:01,  6.41it/s, loss=1.97, v_num=0]
Epoch 92:  91%|█████████ | 88/97 [00:13<00:01,  6.39it/s, loss=1.96, v_num=0]
Epoch 92:  92%|█████████▏| 89/97 [00:13<00:01,  6.42it/s, loss=1.96, v_num=0]
Epoch 92:  92%|█████████▏| 89/97 [00:13<00:01,  6.39it/s, loss=1.96, v_num=0]
Epoch 92:  93%|█████████▎| 90/97 [00:13<00:01,  6.43it/s, loss=1.96, v_num=0]
Epoch 92:  93%|█████████▎| 90/97 [00:14<00:01,  6.40it/s, loss=1.95, v_num=0]
Epoch 92:  94%|█████████▍| 91/97 [00:14<00:00,  6.44it/s, loss=1.95, v_num=0]
Epoch 92:  94%|█████████▍| 91/97 [00:14<00:00,  6.41it/s, loss=1.95, v_num=0]
Epoch 92:  95%|█████████▍| 92/97 [00:14<00:00,  6.45it/s, loss=1.95, v_num=0]
Epoch 92:  95%|█████████▍| 92/97 [00:14<00:00,  6.42it/s, loss=1.95, v_num=0]
Epoch 92:  96%|█████████▌| 93/97 [00:14<00:00,  6.45it/s, loss=1.95, v_num=0]
Epoch 92:  96%|█████████▌| 93/97 [00:14<00:00,  6.43it/s, loss=1.95, v_num=0]
Epoch 92:  97%|█████████▋| 94/97 [00:14<00:00,  6.46it/s, loss=1.95, v_num=0]
Epoch 92:  97%|█████████▋| 94/97 [00:14<00:00,  6.44it/s, loss=1.95, v_num=0]
Epoch 92:  98%|█████████▊| 95/97 [00:14<00:00,  6.47it/s, loss=1.95, v_num=0]
Epoch 92:  98%|█████████▊| 95/97 [00:14<00:00,  6.44it/s, loss=1.95, v_num=0]
Epoch 92:  99%|█████████▉| 96/97 [00:14<00:00,  6.47it/s, loss=1.95, v_num=0]
Epoch 92:  99%|█████████▉| 96/97 [00:14<00:00,  6.45it/s, loss=1.95, v_num=0]
Epoch 92: 100%|██████████| 97/97 [00:14<00:00,  6.48it/s, loss=1.95, v_num=0]
Epoch 92: 100%|██████████| 97/97 [00:15<00:00,  6.46it/s, loss=1.95, v_num=0]
Epoch 92: 100%|██████████| 97/97 [00:15<00:00,  6.46it/s, loss=1.95, v_num=0]
Epoch 92:   0%|          | 0/97 [00:00<?, ?it/s, loss=1.95, v_num=0]
Epoch 93:   0%|          | 0/97 [00:00<?, ?it/s, loss=1.95, v_num=0]
Epoch 93:   1%|          | 1/97 [00:01<02:33,  1.60s/it, loss=1.95, v_num=0]
Epoch 93:   1%|          | 1/97 [00:01<02:38,  1.65s/it, loss=1.95, v_num=0]
Epoch 93:   2%|▏         | 2/97 [00:01<01:22,  1.15it/s, loss=1.95, v_num=0]
Epoch 93:   2%|▏         | 2/97 [00:01<01:25,  1.11it/s, loss=1.95, v_num=0]
Epoch 93:   3%|▎         | 3/97 [00:01<00:59,  1.59it/s, loss=1.95, v_num=0]
Epoch 93:   3%|▎         | 3/97 [00:01<01:00,  1.54it/s, loss=1.95, v_num=0]
Epoch 93:   4%|▍         | 4/97 [00:02<00:47,  1.98it/s, loss=1.95, v_num=0]
Epoch 93:   4%|▍         | 4/97 [00:02<00:48,  1.92it/s, loss=1.95, v_num=0]
Epoch 93:   5%|▌         | 5/97 [00:02<00:39,  2.31it/s, loss=1.95, v_num=0]
Epoch 93:   5%|▌         | 5/97 [00:02<00:40,  2.25it/s, loss=1.95, v_num=0]
Epoch 93:   6%|▌         | 6/97 [00:02<00:34,  2.61it/s, loss=1.95, v_num=0]
Epoch 93:   6%|▌         | 6/97 [00:02<00:35,  2.55it/s, loss=1.95, v_num=0]
Epoch 93:   7%|▋         | 7/97 [00:02<00:31,  2.87it/s, loss=1.95, v_num=0]
Epoch 93:   7%|▋         | 7/97 [00:02<00:32,  2.81it/s, loss=1.95, v_num=0]
Epoch 93:   8%|▊         | 8/97 [00:02<00:28,  3.11it/s, loss=1.95, v_num=0]
Epoch 93:   8%|▊         | 8/97 [00:02<00:29,  3.04it/s, loss=1.95, v_num=0]
Epoch 93:   9%|▉         | 9/97 [00:02<00:26,  3.28it/s, loss=1.95, v_num=0]
Epoch 93:   9%|▉         | 9/97 [00:02<00:27,  3.21it/s, loss=1.95, v_num=0]
Epoch 93:  10%|█         | 10/97 [00:02<00:25,  3.47it/s, loss=1.95, v_num=0]
Epoch 93:  10%|█         | 10/97 [00:02<00:25,  3.40it/s, loss=1.96, v_num=0]
Epoch 93:  11%|█▏        | 11/97 [00:03<00:23,  3.62it/s, loss=1.96, v_num=0]
Epoch 93:  11%|█▏        | 11/97 [00:03<00:24,  3.55it/s, loss=1.96, v_num=0]
Epoch 93:  12%|█▏        | 12/97 [00:03<00:22,  3.78it/s, loss=1.96, v_num=0]
Epoch 93:  12%|█▏        | 12/97 [00:03<00:22,  3.71it/s, loss=1.96, v_num=0]
Epoch 93:  13%|█▎        | 13/97 [00:03<00:21,  3.92it/s, loss=1.96, v_num=0]
Epoch 93:  13%|█▎        | 13/97 [00:03<00:21,  3.86it/s, loss=1.96, v_num=0]
Epoch 93:  14%|█▍        | 14/97 [00:03<00:20,  4.06it/s, loss=1.96, v_num=0]
Epoch 93:  14%|█▍        | 14/97 [00:03<00:20,  3.99it/s, loss=1.96, v_num=0]
Epoch 93:  15%|█▌        | 15/97 [00:03<00:19,  4.18it/s, loss=1.96, v_num=0]
Epoch 93:  15%|█▌        | 15/97 [00:03<00:19,  4.11it/s, loss=1.96, v_num=0]
Epoch 93:  16%|█▋        | 16/97 [00:03<00:18,  4.29it/s, loss=1.96, v_num=0]
Epoch 93:  16%|█▋        | 16/97 [00:03<00:19,  4.23it/s, loss=1.96, v_num=0]
Epoch 93:  18%|█▊        | 17/97 [00:03<00:18,  4.39it/s, loss=1.96, v_num=0]
Epoch 93:  18%|█▊        | 17/97 [00:03<00:18,  4.33it/s, loss=1.95, v_num=0]
Epoch 93:  19%|█▊        | 18/97 [00:04<00:17,  4.50it/s, loss=1.95, v_num=0]
Epoch 93:  19%|█▊        | 18/97 [00:04<00:17,  4.43it/s, loss=1.95, v_num=0]
Epoch 93:  20%|█▉        | 19/97 [00:04<00:17,  4.58it/s, loss=1.95, v_num=0]
Epoch 93:  20%|█▉        | 19/97 [00:04<00:17,  4.53it/s, loss=1.95, v_num=0]
Epoch 93:  21%|██        | 20/97 [00:04<00:16,  4.67it/s, loss=1.95, v_num=0]
Epoch 93:  21%|██        | 20/97 [00:04<00:16,  4.61it/s, loss=1.95, v_num=0]
Epoch 93:  22%|██▏       | 21/97 [00:04<00:15,  4.76it/s, loss=1.95, v_num=0]
Epoch 93:  22%|██▏       | 21/97 [00:04<00:16,  4.70it/s, loss=1.95, v_num=0]
Epoch 93:  23%|██▎       | 22/97 [00:04<00:15,  4.83it/s, loss=1.95, v_num=0]
Epoch 93:  23%|██▎       | 22/97 [00:04<00:15,  4.78it/s, loss=1.95, v_num=0]
Epoch 93:  24%|██▎       | 23/97 [00:04<00:15,  4.91it/s, loss=1.95, v_num=0]
Epoch 93:  24%|██▎       | 23/97 [00:04<00:15,  4.85it/s, loss=1.95, v_num=0]
Epoch 93:  25%|██▍       | 24/97 [00:04<00:14,  4.98it/s, loss=1.95, v_num=0]
Epoch 93:  25%|██▍       | 24/97 [00:04<00:14,  4.92it/s, loss=1.95, v_num=0]
Epoch 93:  26%|██▌       | 25/97 [00:04<00:14,  5.04it/s, loss=1.95, v_num=0]
Epoch 93:  26%|██▌       | 25/97 [00:05<00:14,  4.99it/s, loss=1.94, v_num=0]
Epoch 93:  27%|██▋       | 26/97 [00:05<00:13,  5.11it/s, loss=1.94, v_num=0]
Epoch 93:  27%|██▋       | 26/97 [00:05<00:14,  5.05it/s, loss=1.94, v_num=0]
Epoch 93:  28%|██▊       | 27/97 [00:05<00:13,  5.16it/s, loss=1.94, v_num=0]
Epoch 93:  28%|██▊       | 27/97 [00:05<00:13,  5.11it/s, loss=1.94, v_num=0]
Epoch 93:  29%|██▉       | 28/97 [00:05<00:13,  5.21it/s, loss=1.94, v_num=0]
Epoch 93:  29%|██▉       | 28/97 [00:05<00:13,  5.16it/s, loss=1.94, v_num=0]
Epoch 93:  30%|██▉       | 29/97 [00:05<00:12,  5.27it/s, loss=1.94, v_num=0]
Epoch 93:  30%|██▉       | 29/97 [00:05<00:13,  5.22it/s, loss=1.94, v_num=0]
Epoch 93:  31%|███       | 30/97 [00:05<00:12,  5.32it/s, loss=1.94, v_num=0]
Epoch 93:  31%|███       | 30/97 [00:05<00:12,  5.26it/s, loss=1.94, v_num=0]
Epoch 93:  32%|███▏      | 31/97 [00:05<00:12,  5.36it/s, loss=1.94, v_num=0]
Epoch 93:  32%|███▏      | 31/97 [00:05<00:12,  5.31it/s, loss=1.93, v_num=0]
Epoch 93:  33%|███▎      | 32/97 [00:05<00:12,  5.41it/s, loss=1.93, v_num=0]
Epoch 93:  33%|███▎      | 32/97 [00:05<00:12,  5.36it/s, loss=1.93, v_num=0]
Epoch 93:  34%|███▍      | 33/97 [00:06<00:11,  5.45it/s, loss=1.93, v_num=0]
Epoch 93:  34%|███▍      | 33/97 [00:06<00:11,  5.40it/s, loss=1.94, v_num=0]
Epoch 93:  35%|███▌      | 34/97 [00:06<00:11,  5.49it/s, loss=1.94, v_num=0]
Epoch 93:  35%|███▌      | 34/97 [00:06<00:11,  5.44it/s, loss=1.94, v_num=0]
Epoch 93:  36%|███▌      | 35/97 [00:06<00:11,  5.53it/s, loss=1.94, v_num=0]
Epoch 93:  36%|███▌      | 35/97 [00:06<00:11,  5.48it/s, loss=1.93, v_num=0]
Epoch 93:  37%|███▋      | 36/97 [00:06<00:10,  5.57it/s, loss=1.93, v_num=0]
Epoch 93:  37%|███▋      | 36/97 [00:06<00:11,  5.52it/s, loss=1.94, v_num=0]
Epoch 93:  38%|███▊      | 37/97 [00:06<00:10,  5.60it/s, loss=1.94, v_num=0]
Epoch 93:  38%|███▊      | 37/97 [00:06<00:10,  5.56it/s, loss=1.94, v_num=0]
Epoch 93:  39%|███▉      | 38/97 [00:06<00:10,  5.64it/s, loss=1.94, v_num=0]
Epoch 93:  39%|███▉      | 38/97 [00:06<00:10,  5.59it/s, loss=1.94, v_num=0]
Epoch 93:  40%|████      | 39/97 [00:06<00:10,  5.67it/s, loss=1.94, v_num=0]
Epoch 93:  40%|████      | 39/97 [00:06<00:10,  5.63it/s, loss=1.94, v_num=0]
Epoch 93:  41%|████      | 40/97 [00:07<00:09,  5.70it/s, loss=1.94, v_num=0]
Epoch 93:  41%|████      | 40/97 [00:07<00:10,  5.66it/s, loss=1.95, v_num=0]
Epoch 93:  42%|████▏     | 41/97 [00:07<00:09,  5.73it/s, loss=1.95, v_num=0]
Epoch 93:  42%|████▏     | 41/97 [00:07<00:09,  5.68it/s, loss=1.94, v_num=0]
Epoch 93:  43%|████▎     | 42/97 [00:07<00:09,  5.76it/s, loss=1.94, v_num=0]
Epoch 93:  43%|████▎     | 42/97 [00:07<00:09,  5.71it/s, loss=1.94, v_num=0]
Epoch 93:  44%|████▍     | 43/97 [00:07<00:09,  5.78it/s, loss=1.94, v_num=0]
Epoch 93:  44%|████▍     | 43/97 [00:07<00:09,  5.74it/s, loss=1.93, v_num=0]
Epoch 93:  45%|████▌     | 44/97 [00:07<00:09,  5.81it/s, loss=1.93, v_num=0]
Epoch 93:  45%|████▌     | 44/97 [00:07<00:09,  5.77it/s, loss=1.93, v_num=0]
Epoch 93:  46%|████▋     | 45/97 [00:07<00:08,  5.84it/s, loss=1.93, v_num=0]
Epoch 93:  46%|████▋     | 45/97 [00:07<00:08,  5.79it/s, loss=1.93, v_num=0]
Epoch 93:  47%|████▋     | 46/97 [00:07<00:08,  5.86it/s, loss=1.93, v_num=0]
Epoch 93:  47%|████▋     | 46/97 [00:07<00:08,  5.82it/s, loss=1.93, v_num=0]
Epoch 93:  48%|████▊     | 47/97 [00:07<00:08,  5.88it/s, loss=1.93, v_num=0]
Epoch 93:  48%|████▊     | 47/97 [00:08<00:08,  5.84it/s, loss=1.93, v_num=0]
Epoch 93:  49%|████▉     | 48/97 [00:08<00:08,  5.90it/s, loss=1.93, v_num=0]
Epoch 93:  49%|████▉     | 48/97 [00:08<00:08,  5.86it/s, loss=1.93, v_num=0]
Epoch 93:  51%|█████     | 49/97 [00:08<00:08,  5.92it/s, loss=1.93, v_num=0]
Epoch 93:  51%|█████     | 49/97 [00:08<00:08,  5.88it/s, loss=1.93, v_num=0]
Epoch 93:  52%|█████▏    | 50/97 [00:08<00:07,  5.95it/s, loss=1.93, v_num=0]
Epoch 93:  52%|█████▏    | 50/97 [00:08<00:07,  5.91it/s, loss=1.93, v_num=0]
Epoch 93:  53%|█████▎    | 51/97 [00:08<00:07,  5.96it/s, loss=1.93, v_num=0]
Epoch 93:  53%|█████▎    | 51/97 [00:08<00:07,  5.92it/s, loss=1.93, v_num=0]
Epoch 93:  54%|█████▎    | 52/97 [00:08<00:07,  5.98it/s, loss=1.93, v_num=0]
Epoch 93:  54%|█████▎    | 52/97 [00:08<00:07,  5.94it/s, loss=1.93, v_num=0]
Epoch 93:  55%|█████▍    | 53/97 [00:08<00:07,  6.00it/s, loss=1.93, v_num=0]
Epoch 93:  55%|█████▍    | 53/97 [00:08<00:07,  5.96it/s, loss=1.94, v_num=0]
Epoch 93:  56%|█████▌    | 54/97 [00:08<00:07,  6.02it/s, loss=1.94, v_num=0]
Epoch 93:  56%|█████▌    | 54/97 [00:09<00:07,  5.98it/s, loss=1.93, v_num=0]
Epoch 93:  57%|█████▋    | 55/97 [00:09<00:06,  6.04it/s, loss=1.93, v_num=0]
Epoch 93:  57%|█████▋    | 55/97 [00:09<00:06,  6.00it/s, loss=1.93, v_num=0]
Epoch 93:  58%|█████▊    | 56/97 [00:09<00:06,  6.06it/s, loss=1.93, v_num=0]
Epoch 93:  58%|█████▊    | 56/97 [00:09<00:06,  6.02it/s, loss=1.94, v_num=0]
Epoch 93:  59%|█████▉    | 57/97 [00:09<00:06,  6.07it/s, loss=1.94, v_num=0]
Epoch 93:  59%|█████▉    | 57/97 [00:09<00:06,  6.04it/s, loss=1.93, v_num=0]
Epoch 93:  60%|█████▉    | 58/97 [00:09<00:06,  6.09it/s, loss=1.93, v_num=0]
Epoch 93:  60%|█████▉    | 58/97 [00:09<00:06,  6.05it/s, loss=1.92, v_num=0]
Epoch 93:  61%|██████    | 59/97 [00:09<00:06,  6.11it/s, loss=1.92, v_num=0]
Epoch 93:  61%|██████    | 59/97 [00:09<00:06,  6.07it/s, loss=1.93, v_num=0]
Epoch 93:  62%|██████▏   | 60/97 [00:09<00:06,  6.12it/s, loss=1.93, v_num=0]
Epoch 93:  62%|██████▏   | 60/97 [00:09<00:06,  6.09it/s, loss=1.93, v_num=0]
Epoch 93:  63%|██████▎   | 61/97 [00:09<00:05,  6.14it/s, loss=1.93, v_num=0]
Epoch 93:  63%|██████▎   | 61/97 [00:09<00:05,  6.10it/s, loss=1.93, v_num=0]
Epoch 93:  64%|██████▍   | 62/97 [00:10<00:05,  6.15it/s, loss=1.93, v_num=0]
Epoch 93:  64%|██████▍   | 62/97 [00:10<00:05,  6.12it/s, loss=1.93, v_num=0]
Epoch 93:  65%|██████▍   | 63/97 [00:10<00:05,  6.17it/s, loss=1.93, v_num=0]
Epoch 93:  65%|██████▍   | 63/97 [00:10<00:05,  6.13it/s, loss=1.94, v_num=0]
Epoch 93:  66%|██████▌   | 64/97 [00:10<00:05,  6.18it/s, loss=1.94, v_num=0]
Epoch 93:  66%|██████▌   | 64/97 [00:10<00:05,  6.14it/s, loss=1.94, v_num=0]
Epoch 93:  67%|██████▋   | 65/97 [00:10<00:05,  6.19it/s, loss=1.94, v_num=0]
Epoch 93:  67%|██████▋   | 65/97 [00:10<00:05,  6.16it/s, loss=1.94, v_num=0]
Epoch 93:  68%|██████▊   | 66/97 [00:10<00:04,  6.20it/s, loss=1.94, v_num=0]
Epoch 93:  68%|██████▊   | 66/97 [00:10<00:05,  6.17it/s, loss=1.95, v_num=0]
Epoch 93:  69%|██████▉   | 67/97 [00:10<00:04,  6.21it/s, loss=1.95, v_num=0]
Epoch 93:  69%|██████▉   | 67/97 [00:10<00:04,  6.18it/s, loss=1.95, v_num=0]
Epoch 93:  70%|███████   | 68/97 [00:10<00:04,  6.22it/s, loss=1.95, v_num=0]
Epoch 93:  70%|███████   | 68/97 [00:10<00:04,  6.19it/s, loss=1.95, v_num=0]
Epoch 93:  71%|███████   | 69/97 [00:11<00:04,  6.24it/s, loss=1.95, v_num=0]
Epoch 93:  71%|███████   | 69/97 [00:11<00:04,  6.21it/s, loss=1.95, v_num=0]
Epoch 93:  72%|███████▏  | 70/97 [00:11<00:04,  6.25it/s, loss=1.95, v_num=0]
Epoch 93:  72%|███████▏  | 70/97 [00:11<00:04,  6.22it/s, loss=1.95, v_num=0]
Epoch 93:  73%|███████▎  | 71/97 [00:11<00:04,  6.26it/s, loss=1.95, v_num=0]
Epoch 93:  73%|███████▎  | 71/97 [00:11<00:04,  6.23it/s, loss=1.95, v_num=0]
Epoch 93:  74%|███████▍  | 72/97 [00:11<00:03,  6.27it/s, loss=1.95, v_num=0]
Epoch 93:  74%|███████▍  | 72/97 [00:11<00:04,  6.24it/s, loss=1.95, v_num=0]
Epoch 93:  75%|███████▌  | 73/97 [00:11<00:03,  6.28it/s, loss=1.95, v_num=0]
Epoch 93:  75%|███████▌  | 73/97 [00:11<00:03,  6.25it/s, loss=1.94, v_num=0]
Epoch 93:  76%|███████▋  | 74/97 [00:11<00:03,  6.28it/s, loss=1.94, v_num=0]
Epoch 93:  76%|███████▋  | 74/97 [00:11<00:03,  6.25it/s, loss=1.95, v_num=0]
Epoch 93:  77%|███████▋  | 75/97 [00:11<00:03,  6.29it/s, loss=1.95, v_num=0]
Epoch 93:  77%|███████▋  | 75/97 [00:11<00:03,  6.26it/s, loss=1.95, v_num=0]
Epoch 93:  78%|███████▊  | 76/97 [00:12<00:03,  6.30it/s, loss=1.95, v_num=0]
Epoch 93:  78%|███████▊  | 76/97 [00:12<00:03,  6.27it/s, loss=1.95, v_num=0]
Epoch 93:  79%|███████▉  | 77/97 [00:12<00:03,  6.31it/s, loss=1.95, v_num=0]
Epoch 93:  79%|███████▉  | 77/97 [00:12<00:03,  6.28it/s, loss=1.96, v_num=0]
Epoch 93:  80%|████████  | 78/97 [00:12<00:03,  6.32it/s, loss=1.96, v_num=0]
Epoch 93:  80%|████████  | 78/97 [00:12<00:03,  6.29it/s, loss=1.96, v_num=0]
Epoch 93:  81%|████████▏ | 79/97 [00:12<00:02,  6.33it/s, loss=1.96, v_num=0]
Epoch 93:  81%|████████▏ | 79/97 [00:12<00:02,  6.31it/s, loss=1.96, v_num=0]
Epoch 93:  82%|████████▏ | 80/97 [00:12<00:02,  6.34it/s, loss=1.96, v_num=0]
Epoch 93:  82%|████████▏ | 80/97 [00:12<00:02,  6.32it/s, loss=1.96, v_num=0]
Epoch 93:  84%|████████▎ | 81/97 [00:12<00:02,  6.35it/s, loss=1.96, v_num=0]
Epoch 93:  84%|████████▎ | 81/97 [00:12<00:02,  6.33it/s, loss=1.96, v_num=0]
Epoch 93:  85%|████████▍ | 82/97 [00:12<00:02,  6.36it/s, loss=1.96, v_num=0]
Epoch 93:  85%|████████▍ | 82/97 [00:12<00:02,  6.33it/s, loss=1.97, v_num=0]
Epoch 93:  86%|████████▌ | 83/97 [00:13<00:02,  6.37it/s, loss=1.97, v_num=0]
Epoch 93:  86%|████████▌ | 83/97 [00:13<00:02,  6.34it/s, loss=1.97, v_num=0]
Epoch 93:  87%|████████▋ | 84/97 [00:13<00:02,  6.38it/s, loss=1.97, v_num=0]
Epoch 93:  87%|████████▋ | 84/97 [00:13<00:02,  6.35it/s, loss=1.98, v_num=0]
Epoch 93:  88%|████████▊ | 85/97 [00:13<00:01,  6.39it/s, loss=1.98, v_num=0]
Epoch 93:  88%|████████▊ | 85/97 [00:13<00:01,  6.36it/s, loss=1.98, v_num=0]
Epoch 93:  89%|████████▊ | 86/97 [00:13<00:01,  6.40it/s, loss=1.98, v_num=0]
Epoch 93:  89%|████████▊ | 86/97 [00:13<00:01,  6.37it/s, loss=1.98, v_num=0]
Epoch 93:  90%|████████▉ | 87/97 [00:13<00:01,  6.41it/s, loss=1.98, v_num=0]
Epoch 93:  90%|████████▉ | 87/97 [00:13<00:01,  6.38it/s, loss=1.98, v_num=0]
Epoch 93:  91%|█████████ | 88/97 [00:13<00:01,  6.42it/s, loss=1.98, v_num=0]
Epoch 93:  91%|█████████ | 88/97 [00:13<00:01,  6.39it/s, loss=1.98, v_num=0]
Epoch 93:  92%|█████████▏| 89/97 [00:13<00:01,  6.43it/s, loss=1.98, v_num=0]
Epoch 93:  92%|█████████▏| 89/97 [00:13<00:01,  6.40it/s, loss=1.98, v_num=0]
Epoch 93:  93%|█████████▎| 90/97 [00:13<00:01,  6.43it/s, loss=1.98, v_num=0]
Epoch 93:  93%|█████████▎| 90/97 [00:14<00:01,  6.41it/s, loss=1.98, v_num=0]
Epoch 93:  94%|█████████▍| 91/97 [00:14<00:00,  6.44it/s, loss=1.98, v_num=0]
Epoch 93:  94%|█████████▍| 91/97 [00:14<00:00,  6.42it/s, loss=1.98, v_num=0]
Epoch 93:  95%|█████████▍| 92/97 [00:14<00:00,  6.45it/s, loss=1.98, v_num=0]
Epoch 93:  95%|█████████▍| 92/97 [00:14<00:00,  6.42it/s, loss=1.97, v_num=0]
Epoch 93:  96%|█████████▌| 93/97 [00:14<00:00,  6.46it/s, loss=1.97, v_num=0]
Epoch 93:  96%|█████████▌| 93/97 [00:14<00:00,  6.43it/s, loss=1.98, v_num=0]
Epoch 93:  97%|█████████▋| 94/97 [00:14<00:00,  6.46it/s, loss=1.98, v_num=0]
Epoch 93:  97%|█████████▋| 94/97 [00:14<00:00,  6.44it/s, loss=1.98, v_num=0]
Epoch 93:  98%|█████████▊| 95/97 [00:14<00:00,  6.47it/s, loss=1.98, v_num=0]
Epoch 93:  98%|█████████▊| 95/97 [00:14<00:00,  6.45it/s, loss=1.98, v_num=0]
Epoch 93:  99%|█████████▉| 96/97 [00:14<00:00,  6.48it/s, loss=1.98, v_num=0]
Epoch 93:  99%|█████████▉| 96/97 [00:14<00:00,  6.45it/s, loss=1.98, v_num=0]
Epoch 93: 100%|██████████| 97/97 [00:14<00:00,  6.49it/s, loss=1.98, v_num=0]
Epoch 93: 100%|██████████| 97/97 [00:15<00:00,  6.46it/s, loss=1.97, v_num=0]
Epoch 93: 100%|██████████| 97/97 [00:15<00:00,  6.46it/s, loss=1.97, v_num=0]
Epoch 93:   0%|          | 0/97 [00:00<?, ?it/s, loss=1.97, v_num=0]
Epoch 94:   0%|          | 0/97 [00:00<?, ?it/s, loss=1.97, v_num=0]
Epoch 94:   1%|          | 1/97 [00:01<02:36,  1.63s/it, loss=1.97, v_num=0]
Epoch 94:   1%|          | 1/97 [00:01<02:42,  1.69s/it, loss=1.97, v_num=0]
Epoch 94:   2%|▏         | 2/97 [00:01<01:24,  1.13it/s, loss=1.97, v_num=0]
Epoch 94:   2%|▏         | 2/97 [00:01<01:26,  1.09it/s, loss=1.97, v_num=0]
Epoch 94:   3%|▎         | 3/97 [00:01<01:00,  1.56it/s, loss=1.97, v_num=0]
Epoch 94:   3%|▎         | 3/97 [00:01<01:02,  1.51it/s, loss=1.97, v_num=0]
Epoch 94:   4%|▍         | 4/97 [00:02<00:48,  1.94it/s, loss=1.97, v_num=0]
Epoch 94:   4%|▍         | 4/97 [00:02<00:49,  1.88it/s, loss=1.97, v_num=0]
Epoch 94:   5%|▌         | 5/97 [00:02<00:40,  2.26it/s, loss=1.97, v_num=0]
Epoch 94:   5%|▌         | 5/97 [00:02<00:41,  2.21it/s, loss=1.96, v_num=0]
Epoch 94:   6%|▌         | 6/97 [00:02<00:35,  2.56it/s, loss=1.96, v_num=0]
Epoch 94:   6%|▌         | 6/97 [00:02<00:36,  2.50it/s, loss=1.96, v_num=0]
Epoch 94:   7%|▋         | 7/97 [00:02<00:32,  2.81it/s, loss=1.96, v_num=0]
Epoch 94:   7%|▋         | 7/97 [00:02<00:32,  2.75it/s, loss=1.95, v_num=0]
Epoch 94:   8%|▊         | 8/97 [00:02<00:29,  3.04it/s, loss=1.95, v_num=0]
Epoch 94:   8%|▊         | 8/97 [00:02<00:29,  2.97it/s, loss=1.96, v_num=0]
Epoch 94:   9%|▉         | 9/97 [00:02<00:27,  3.20it/s, loss=1.96, v_num=0]
Epoch 94:   9%|▉         | 9/97 [00:02<00:28,  3.13it/s, loss=1.94, v_num=0]
Epoch 94:  10%|█         | 10/97 [00:02<00:25,  3.37it/s, loss=1.94, v_num=0]
Epoch 94:  10%|█         | 10/97 [00:03<00:26,  3.31it/s, loss=1.94, v_num=0]
Epoch 94:  11%|█▏        | 11/97 [00:03<00:24,  3.51it/s, loss=1.94, v_num=0]
Epoch 94:  11%|█▏        | 11/97 [00:03<00:24,  3.45it/s, loss=1.94, v_num=0]
Epoch 94:  12%|█▏        | 12/97 [00:03<00:23,  3.66it/s, loss=1.94, v_num=0]
Epoch 94:  12%|█▏        | 12/97 [00:03<00:23,  3.60it/s, loss=1.94, v_num=0]
Epoch 94:  13%|█▎        | 13/97 [00:03<00:22,  3.80it/s, loss=1.94, v_num=0]
Epoch 94:  13%|█▎        | 13/97 [00:03<00:22,  3.74it/s, loss=1.94, v_num=0]
Epoch 94:  14%|█▍        | 14/97 [00:03<00:21,  3.93it/s, loss=1.94, v_num=0]
Epoch 94:  14%|█▍        | 14/97 [00:03<00:21,  3.87it/s, loss=1.95, v_num=0]
Epoch 94:  15%|█▌        | 15/97 [00:03<00:20,  4.05it/s, loss=1.95, v_num=0]
Epoch 94:  15%|█▌        | 15/97 [00:03<00:20,  3.99it/s, loss=1.95, v_num=0]
Epoch 94:  16%|█▋        | 16/97 [00:03<00:19,  4.17it/s, loss=1.95, v_num=0]
Epoch 94:  16%|█▋        | 16/97 [00:03<00:19,  4.11it/s, loss=1.94, v_num=0]
Epoch 94:  18%|█▊        | 17/97 [00:03<00:18,  4.28it/s, loss=1.94, v_num=0]
Epoch 94:  18%|█▊        | 17/97 [00:04<00:18,  4.22it/s, loss=1.94, v_num=0]
Epoch 94:  19%|█▊        | 18/97 [00:04<00:18,  4.38it/s, loss=1.94, v_num=0]
Epoch 94:  19%|█▊        | 18/97 [00:04<00:18,  4.32it/s, loss=1.93, v_num=0]
Epoch 94:  20%|█▉        | 19/97 [00:04<00:17,  4.47it/s, loss=1.93, v_num=0]
Epoch 94:  20%|█▉        | 19/97 [00:04<00:17,  4.41it/s, loss=1.93, v_num=0]
Epoch 94:  21%|██        | 20/97 [00:04<00:16,  4.56it/s, loss=1.93, v_num=0]
Epoch 94:  21%|██        | 20/97 [00:04<00:17,  4.50it/s, loss=1.93, v_num=0]
Epoch 94:  22%|██▏       | 21/97 [00:04<00:16,  4.64it/s, loss=1.93, v_num=0]
Epoch 94:  22%|██▏       | 21/97 [00:04<00:16,  4.59it/s, loss=1.93, v_num=0]
Epoch 94:  23%|██▎       | 22/97 [00:04<00:15,  4.72it/s, loss=1.93, v_num=0]
Epoch 94:  23%|██▎       | 22/97 [00:04<00:16,  4.66it/s, loss=1.93, v_num=0]
Epoch 94:  24%|██▎       | 23/97 [00:04<00:15,  4.79it/s, loss=1.93, v_num=0]
Epoch 94:  24%|██▎       | 23/97 [00:04<00:15,  4.74it/s, loss=1.93, v_num=0]
Epoch 94:  25%|██▍       | 24/97 [00:04<00:15,  4.86it/s, loss=1.93, v_num=0]
Epoch 94:  25%|██▍       | 24/97 [00:04<00:15,  4.81it/s, loss=1.93, v_num=0]
Epoch 94:  26%|██▌       | 25/97 [00:05<00:14,  4.93it/s, loss=1.93, v_num=0]
Epoch 94:  26%|██▌       | 25/97 [00:05<00:14,  4.87it/s, loss=1.94, v_num=0]
Epoch 94:  27%|██▋       | 26/97 [00:05<00:14,  4.99it/s, loss=1.94, v_num=0]
Epoch 94:  27%|██▋       | 26/97 [00:05<00:14,  4.94it/s, loss=1.94, v_num=0]
Epoch 94:  28%|██▊       | 27/97 [00:05<00:13,  5.05it/s, loss=1.94, v_num=0]
Epoch 94:  28%|██▊       | 27/97 [00:05<00:14,  5.00it/s, loss=1.93, v_num=0]
Epoch 94:  29%|██▉       | 28/97 [00:05<00:13,  5.11it/s, loss=1.93, v_num=0]
Epoch 94:  29%|██▉       | 28/97 [00:05<00:13,  5.05it/s, loss=1.93, v_num=0]
Epoch 94:  30%|██▉       | 29/97 [00:05<00:13,  5.16it/s, loss=1.93, v_num=0]
Epoch 94:  30%|██▉       | 29/97 [00:05<00:13,  5.11it/s, loss=1.94, v_num=0]
Epoch 94:  31%|███       | 30/97 [00:05<00:12,  5.21it/s, loss=1.94, v_num=0]
Epoch 94:  31%|███       | 30/97 [00:05<00:12,  5.16it/s, loss=1.94, v_num=0]
Epoch 94:  32%|███▏      | 31/97 [00:05<00:12,  5.25it/s, loss=1.94, v_num=0]
Epoch 94:  32%|███▏      | 31/97 [00:05<00:12,  5.20it/s, loss=1.94, v_num=0]
Epoch 94:  33%|███▎      | 32/97 [00:06<00:12,  5.30it/s, loss=1.94, v_num=0]
Epoch 94:  33%|███▎      | 32/97 [00:06<00:12,  5.25it/s, loss=1.93, v_num=0]
Epoch 94:  34%|███▍      | 33/97 [00:06<00:11,  5.34it/s, loss=1.93, v_num=0]
Epoch 94:  34%|███▍      | 33/97 [00:06<00:12,  5.29it/s, loss=1.93, v_num=0]
Epoch 94:  35%|███▌      | 34/97 [00:06<00:11,  5.39it/s, loss=1.93, v_num=0]
Epoch 94:  35%|███▌      | 34/97 [00:06<00:11,  5.34it/s, loss=1.93, v_num=0]
Epoch 94:  36%|███▌      | 35/97 [00:06<00:11,  5.43it/s, loss=1.93, v_num=0]
Epoch 94:  36%|███▌      | 35/97 [00:06<00:11,  5.38it/s, loss=1.93, v_num=0]
Epoch 94:  37%|███▋      | 36/97 [00:06<00:11,  5.47it/s, loss=1.93, v_num=0]
Epoch 94:  37%|███▋      | 36/97 [00:06<00:11,  5.42it/s, loss=1.93, v_num=0]
Epoch 94:  38%|███▊      | 37/97 [00:06<00:10,  5.50it/s, loss=1.93, v_num=0]
Epoch 94:  38%|███▊      | 37/97 [00:06<00:10,  5.46it/s, loss=1.94, v_num=0]
Epoch 94:  39%|███▉      | 38/97 [00:06<00:10,  5.53it/s, loss=1.94, v_num=0]
Epoch 94:  39%|███▉      | 38/97 [00:06<00:10,  5.49it/s, loss=1.93, v_num=0]
Epoch 94:  40%|████      | 39/97 [00:07<00:10,  5.57it/s, loss=1.93, v_num=0]
Epoch 94:  40%|████      | 39/97 [00:07<00:10,  5.52it/s, loss=1.94, v_num=0]
Epoch 94:  41%|████      | 40/97 [00:07<00:10,  5.59it/s, loss=1.94, v_num=0]
Epoch 94:  41%|████      | 40/97 [00:07<00:10,  5.55it/s, loss=1.94, v_num=0]
Epoch 94:  42%|████▏     | 41/97 [00:07<00:09,  5.62it/s, loss=1.94, v_num=0]
Epoch 94:  42%|████▏     | 41/97 [00:07<00:10,  5.58it/s, loss=1.94, v_num=0]
Epoch 94:  43%|████▎     | 42/97 [00:07<00:09,  5.65it/s, loss=1.94, v_num=0]
Epoch 94:  43%|████▎     | 42/97 [00:07<00:09,  5.60it/s, loss=1.94, v_num=0]
Epoch 94:  44%|████▍     | 43/97 [00:07<00:09,  5.67it/s, loss=1.94, v_num=0]
Epoch 94:  44%|████▍     | 43/97 [00:07<00:09,  5.63it/s, loss=1.94, v_num=0]
Epoch 94:  45%|████▌     | 44/97 [00:07<00:09,  5.68it/s, loss=1.94, v_num=0]
Epoch 94:  45%|████▌     | 44/97 [00:07<00:09,  5.64it/s, loss=1.94, v_num=0]
Epoch 94:  46%|████▋     | 45/97 [00:07<00:09,  5.70it/s, loss=1.94, v_num=0]
Epoch 94:  46%|████▋     | 45/97 [00:07<00:09,  5.66it/s, loss=1.94, v_num=0]
Epoch 94:  47%|████▋     | 46/97 [00:08<00:08,  5.73it/s, loss=1.94, v_num=0]
Epoch 94:  47%|████▋     | 46/97 [00:08<00:08,  5.69it/s, loss=1.94, v_num=0]
Epoch 94:  48%|████▊     | 47/97 [00:08<00:08,  5.75it/s, loss=1.94, v_num=0]
Epoch 94:  48%|████▊     | 47/97 [00:08<00:08,  5.71it/s, loss=1.94, v_num=0]
Epoch 94:  49%|████▉     | 48/97 [00:08<00:08,  5.77it/s, loss=1.94, v_num=0]
Epoch 94:  49%|████▉     | 48/97 [00:08<00:08,  5.73it/s, loss=1.94, v_num=0]
Epoch 94:  51%|█████     | 49/97 [00:08<00:08,  5.79it/s, loss=1.94, v_num=0]
Epoch 94:  51%|█████     | 49/97 [00:08<00:08,  5.75it/s, loss=1.94, v_num=0]
Epoch 94:  52%|█████▏    | 50/97 [00:08<00:08,  5.81it/s, loss=1.94, v_num=0]
Epoch 94:  52%|█████▏    | 50/97 [00:08<00:08,  5.77it/s, loss=1.95, v_num=0]
Epoch 94:  53%|█████▎    | 51/97 [00:08<00:07,  5.83it/s, loss=1.95, v_num=0]
Epoch 94:  53%|█████▎    | 51/97 [00:08<00:07,  5.79it/s, loss=1.95, v_num=0]
Epoch 94:  54%|█████▎    | 52/97 [00:08<00:07,  5.84it/s, loss=1.95, v_num=0]
Epoch 94:  54%|█████▎    | 52/97 [00:08<00:07,  5.80it/s, loss=1.96, v_num=0]
Epoch 94:  55%|█████▍    | 53/97 [00:09<00:07,  5.86it/s, loss=1.96, v_num=0]
Epoch 94:  55%|█████▍    | 53/97 [00:09<00:07,  5.82it/s, loss=1.96, v_num=0]
Epoch 94:  56%|█████▌    | 54/97 [00:09<00:07,  5.88it/s, loss=1.96, v_num=0]
Epoch 94:  56%|█████▌    | 54/97 [00:09<00:07,  5.84it/s, loss=1.97, v_num=0]
Epoch 94:  57%|█████▋    | 55/97 [00:09<00:07,  5.90it/s, loss=1.97, v_num=0]
Epoch 94:  57%|█████▋    | 55/97 [00:09<00:07,  5.86it/s, loss=1.96, v_num=0]
Epoch 94:  58%|█████▊    | 56/97 [00:09<00:06,  5.92it/s, loss=1.96, v_num=0]
Epoch 94:  58%|█████▊    | 56/97 [00:09<00:06,  5.88it/s, loss=1.97, v_num=0]
Epoch 94:  59%|█████▉    | 57/97 [00:09<00:06,  5.93it/s, loss=1.97, v_num=0]
Epoch 94:  59%|█████▉    | 57/97 [00:09<00:06,  5.90it/s, loss=1.96, v_num=0]
Epoch 94:  60%|█████▉    | 58/97 [00:09<00:06,  5.95it/s, loss=1.96, v_num=0]
Epoch 94:  60%|█████▉    | 58/97 [00:09<00:06,  5.92it/s, loss=1.96, v_num=0]
Epoch 94:  61%|██████    | 59/97 [00:09<00:06,  5.97it/s, loss=1.96, v_num=0]
Epoch 94:  61%|██████    | 59/97 [00:09<00:06,  5.94it/s, loss=1.96, v_num=0]
Epoch 94:  62%|██████▏   | 60/97 [00:10<00:06,  5.99it/s, loss=1.96, v_num=0]
Epoch 94:  62%|██████▏   | 60/97 [00:10<00:06,  5.95it/s, loss=1.96, v_num=0]
Epoch 94:  63%|██████▎   | 61/97 [00:10<00:05,  6.00it/s, loss=1.96, v_num=0]
Epoch 94:  63%|██████▎   | 61/97 [00:10<00:06,  5.97it/s, loss=1.96, v_num=0]
Epoch 94:  64%|██████▍   | 62/97 [00:10<00:05,  6.02it/s, loss=1.96, v_num=0]
Epoch 94:  64%|██████▍   | 62/97 [00:10<00:05,  5.99it/s, loss=1.96, v_num=0]
Epoch 94:  65%|██████▍   | 63/97 [00:10<00:05,  6.04it/s, loss=1.96, v_num=0]
Epoch 94:  65%|██████▍   | 63/97 [00:10<00:05,  6.00it/s, loss=1.96, v_num=0]
Epoch 94:  66%|██████▌   | 64/97 [00:10<00:05,  6.05it/s, loss=1.96, v_num=0]
Epoch 94:  66%|██████▌   | 64/97 [00:10<00:05,  6.02it/s, loss=1.96, v_num=0]
Epoch 94:  67%|██████▋   | 65/97 [00:10<00:05,  6.07it/s, loss=1.96, v_num=0]
Epoch 94:  67%|██████▋   | 65/97 [00:10<00:05,  6.03it/s, loss=1.95, v_num=0]
Epoch 94:  68%|██████▊   | 66/97 [00:10<00:05,  6.08it/s, loss=1.95, v_num=0]
Epoch 94:  68%|██████▊   | 66/97 [00:10<00:05,  6.05it/s, loss=1.96, v_num=0]
Epoch 94:  69%|██████▉   | 67/97 [00:10<00:04,  6.09it/s, loss=1.96, v_num=0]
Epoch 94:  69%|██████▉   | 67/97 [00:11<00:04,  6.06it/s, loss=1.96, v_num=0]
Epoch 94:  70%|███████   | 68/97 [00:11<00:04,  6.10it/s, loss=1.96, v_num=0]
Epoch 94:  70%|███████   | 68/97 [00:11<00:04,  6.07it/s, loss=1.95, v_num=0]
Epoch 94:  71%|███████   | 69/97 [00:11<00:04,  6.12it/s, loss=1.95, v_num=0]
Epoch 94:  71%|███████   | 69/97 [00:11<00:04,  6.09it/s, loss=1.95, v_num=0]
Epoch 94:  72%|███████▏  | 70/97 [00:11<00:04,  6.13it/s, loss=1.95, v_num=0]
Epoch 94:  72%|███████▏  | 70/97 [00:11<00:04,  6.10it/s, loss=1.95, v_num=0]
Epoch 94:  73%|███████▎  | 71/97 [00:11<00:04,  6.14it/s, loss=1.95, v_num=0]
Epoch 94:  73%|███████▎  | 71/97 [00:11<00:04,  6.11it/s, loss=1.95, v_num=0]
Epoch 94:  74%|███████▍  | 72/97 [00:11<00:04,  6.15it/s, loss=1.95, v_num=0]
Epoch 94:  74%|███████▍  | 72/97 [00:11<00:04,  6.12it/s, loss=1.95, v_num=0]
Epoch 94:  75%|███████▌  | 73/97 [00:11<00:03,  6.16it/s, loss=1.95, v_num=0]
Epoch 94:  75%|███████▌  | 73/97 [00:11<00:03,  6.13it/s, loss=1.94, v_num=0]
Epoch 94:  76%|███████▋  | 74/97 [00:11<00:03,  6.18it/s, loss=1.94, v_num=0]
Epoch 94:  76%|███████▋  | 74/97 [00:12<00:03,  6.15it/s, loss=1.94, v_num=0]
Epoch 94:  77%|███████▋  | 75/97 [00:12<00:03,  6.19it/s, loss=1.94, v_num=0]
Epoch 94:  77%|███████▋  | 75/97 [00:12<00:03,  6.16it/s, loss=1.94, v_num=0]
Epoch 94:  78%|███████▊  | 76/97 [00:12<00:03,  6.20it/s, loss=1.94, v_num=0]
Epoch 94:  78%|███████▊  | 76/97 [00:12<00:03,  6.17it/s, loss=1.94, v_num=0]
Epoch 94:  79%|███████▉  | 77/97 [00:12<00:03,  6.21it/s, loss=1.94, v_num=0]
Epoch 94:  79%|███████▉  | 77/97 [00:12<00:03,  6.18it/s, loss=1.94, v_num=0]
Epoch 94:  80%|████████  | 78/97 [00:12<00:03,  6.22it/s, loss=1.94, v_num=0]
Epoch 94:  80%|████████  | 78/97 [00:12<00:03,  6.20it/s, loss=1.94, v_num=0]
Epoch 94:  81%|████████▏ | 79/97 [00:12<00:02,  6.23it/s, loss=1.94, v_num=0]
Epoch 94:  81%|████████▏ | 79/97 [00:12<00:02,  6.21it/s, loss=1.95, v_num=0]
Epoch 94:  82%|████████▏ | 80/97 [00:12<00:02,  6.24it/s, loss=1.95, v_num=0]
Epoch 94:  82%|████████▏ | 80/97 [00:12<00:02,  6.22it/s, loss=1.94, v_num=0]
Epoch 94:  84%|████████▎ | 81/97 [00:12<00:02,  6.26it/s, loss=1.94, v_num=0]
Epoch 94:  84%|████████▎ | 81/97 [00:13<00:02,  6.23it/s, loss=1.95, v_num=0]
Epoch 94:  85%|████████▍ | 82/97 [00:13<00:02,  6.27it/s, loss=1.95, v_num=0]
Epoch 94:  85%|████████▍ | 82/97 [00:13<00:02,  6.24it/s, loss=1.95, v_num=0]
Epoch 94:  86%|████████▌ | 83/97 [00:13<00:02,  6.28it/s, loss=1.95, v_num=0]
Epoch 94:  86%|████████▌ | 83/97 [00:13<00:02,  6.25it/s, loss=1.94, v_num=0]
Epoch 94:  87%|████████▋ | 84/97 [00:13<00:02,  6.29it/s, loss=1.94, v_num=0]
Epoch 94:  87%|████████▋ | 84/97 [00:13<00:02,  6.26it/s, loss=1.93, v_num=0]
Epoch 94:  88%|████████▊ | 85/97 [00:13<00:01,  6.30it/s, loss=1.93, v_num=0]
Epoch 94:  88%|████████▊ | 85/97 [00:13<00:01,  6.27it/s, loss=1.94, v_num=0]
Epoch 94:  89%|████████▊ | 86/97 [00:13<00:01,  6.31it/s, loss=1.94, v_num=0]
Epoch 94:  89%|████████▊ | 86/97 [00:13<00:01,  6.28it/s, loss=1.94, v_num=0]
Epoch 94:  90%|████████▉ | 87/97 [00:13<00:01,  6.32it/s, loss=1.94, v_num=0]
Epoch 94:  90%|████████▉ | 87/97 [00:13<00:01,  6.29it/s, loss=1.93, v_num=0]
Epoch 94:  91%|█████████ | 88/97 [00:13<00:01,  6.33it/s, loss=1.93, v_num=0]
Epoch 94:  91%|█████████ | 88/97 [00:13<00:01,  6.30it/s, loss=1.94, v_num=0]
Epoch 94:  92%|█████████▏| 89/97 [00:14<00:01,  6.34it/s, loss=1.94, v_num=0]
Epoch 94:  92%|█████████▏| 89/97 [00:14<00:01,  6.31it/s, loss=1.94, v_num=0]
Epoch 94:  93%|█████████▎| 90/97 [00:14<00:01,  6.35it/s, loss=1.94, v_num=0]
Epoch 94:  93%|█████████▎| 90/97 [00:14<00:01,  6.32it/s, loss=1.95, v_num=0]
Epoch 94:  94%|█████████▍| 91/97 [00:14<00:00,  6.35it/s, loss=1.95, v_num=0]
Epoch 94:  94%|█████████▍| 91/97 [00:14<00:00,  6.33it/s, loss=1.94, v_num=0]
Epoch 94:  95%|█████████▍| 92/97 [00:14<00:00,  6.37it/s, loss=1.94, v_num=0]
Epoch 94:  95%|█████████▍| 92/97 [00:14<00:00,  6.34it/s, loss=1.95, v_num=0]
Epoch 94:  96%|█████████▌| 93/97 [00:14<00:00,  6.37it/s, loss=1.95, v_num=0]
Epoch 94:  96%|█████████▌| 93/97 [00:14<00:00,  6.35it/s, loss=1.95, v_num=0]
Epoch 94:  97%|█████████▋| 94/97 [00:14<00:00,  6.38it/s, loss=1.95, v_num=0]
Epoch 94:  97%|█████████▋| 94/97 [00:14<00:00,  6.36it/s, loss=1.96, v_num=0]
Epoch 94:  98%|█████████▊| 95/97 [00:14<00:00,  6.39it/s, loss=1.96, v_num=0]
Epoch 94:  98%|█████████▊| 95/97 [00:14<00:00,  6.37it/s, loss=1.96, v_num=0]
Epoch 94:  99%|█████████▉| 96/97 [00:15<00:00,  6.40it/s, loss=1.96, v_num=0]
Epoch 94:  99%|█████████▉| 96/97 [00:15<00:00,  6.37it/s, loss=1.96, v_num=0]
Epoch 94: 100%|██████████| 97/97 [00:15<00:00,  6.41it/s, loss=1.96, v_num=0]
Epoch 94: 100%|██████████| 97/97 [00:15<00:00,  6.38it/s, loss=1.95, v_num=0]
Epoch 94: 100%|██████████| 97/97 [00:15<00:00,  6.38it/s, loss=1.95, v_num=0]
Epoch 94:   0%|          | 0/97 [00:00<?, ?it/s, loss=1.95, v_num=0]
Epoch 95:   0%|          | 0/97 [00:00<?, ?it/s, loss=1.95, v_num=0]
Epoch 95:   1%|          | 1/97 [00:01<02:29,  1.56s/it, loss=1.95, v_num=0]
Epoch 95:   1%|          | 1/97 [00:01<02:35,  1.62s/it, loss=1.95, v_num=0]
Epoch 95:   2%|▏         | 2/97 [00:01<01:20,  1.18it/s, loss=1.95, v_num=0]
Epoch 95:   2%|▏         | 2/97 [00:01<01:23,  1.14it/s, loss=1.95, v_num=0]
Epoch 95:   3%|▎         | 3/97 [00:01<01:00,  1.56it/s, loss=1.95, v_num=0]
Epoch 95:   3%|▎         | 3/97 [00:01<01:01,  1.52it/s, loss=1.96, v_num=0]
Epoch 95:   4%|▍         | 4/97 [00:02<00:47,  1.94it/s, loss=1.96, v_num=0]
Epoch 95:   4%|▍         | 4/97 [00:02<00:49,  1.89it/s, loss=1.96, v_num=0]
Epoch 95:   5%|▌         | 5/97 [00:02<00:40,  2.27it/s, loss=1.96, v_num=0]
Epoch 95:   5%|▌         | 5/97 [00:02<00:41,  2.21it/s, loss=1.96, v_num=0]
Epoch 95:   6%|▌         | 6/97 [00:02<00:35,  2.55it/s, loss=1.96, v_num=0]
Epoch 95:   6%|▌         | 6/97 [00:02<00:36,  2.49it/s, loss=1.97, v_num=0]
Epoch 95:   7%|▋         | 7/97 [00:02<00:32,  2.81it/s, loss=1.97, v_num=0]
Epoch 95:   7%|▋         | 7/97 [00:02<00:32,  2.75it/s, loss=1.97, v_num=0]
Epoch 95:   8%|▊         | 8/97 [00:02<00:29,  3.04it/s, loss=1.97, v_num=0]
Epoch 95:   8%|▊         | 8/97 [00:02<00:29,  2.98it/s, loss=1.97, v_num=0]
Epoch 95:   9%|▉         | 9/97 [00:02<00:27,  3.25it/s, loss=1.97, v_num=0]
Epoch 95:   9%|▉         | 9/97 [00:02<00:27,  3.19it/s, loss=1.98, v_num=0]
Epoch 95:  10%|█         | 10/97 [00:02<00:25,  3.44it/s, loss=1.98, v_num=0]
Epoch 95:  10%|█         | 10/97 [00:02<00:25,  3.37it/s, loss=1.98, v_num=0]
Epoch 95:  11%|█▏        | 11/97 [00:03<00:23,  3.61it/s, loss=1.98, v_num=0]
Epoch 95:  11%|█▏        | 11/97 [00:03<00:24,  3.54it/s, loss=1.98, v_num=0]
Epoch 95:  12%|█▏        | 12/97 [00:03<00:22,  3.77it/s, loss=1.98, v_num=0]
Epoch 95:  12%|█▏        | 12/97 [00:03<00:22,  3.70it/s, loss=1.97, v_num=0]
Epoch 95:  13%|█▎        | 13/97 [00:03<00:21,  3.91it/s, loss=1.97, v_num=0]
Epoch 95:  13%|█▎        | 13/97 [00:03<00:21,  3.84it/s, loss=1.97, v_num=0]
Epoch 95:  14%|█▍        | 14/97 [00:03<00:20,  4.05it/s, loss=1.97, v_num=0]
Epoch 95:  14%|█▍        | 14/97 [00:03<00:20,  3.98it/s, loss=1.98, v_num=0]
Epoch 95:  15%|█▌        | 15/97 [00:03<00:19,  4.17it/s, loss=1.98, v_num=0]
Epoch 95:  15%|█▌        | 15/97 [00:03<00:19,  4.10it/s, loss=1.97, v_num=0]
Epoch 95:  16%|█▋        | 16/97 [00:03<00:18,  4.28it/s, loss=1.97, v_num=0]
Epoch 95:  16%|█▋        | 16/97 [00:03<00:19,  4.22it/s, loss=1.97, v_num=0]
Epoch 95:  18%|█▊        | 17/97 [00:03<00:18,  4.39it/s, loss=1.97, v_num=0]
Epoch 95:  18%|█▊        | 17/97 [00:03<00:18,  4.33it/s, loss=1.97, v_num=0]
Epoch 95:  19%|█▊        | 18/97 [00:04<00:17,  4.49it/s, loss=1.97, v_num=0]
Epoch 95:  19%|█▊        | 18/97 [00:04<00:17,  4.43it/s, loss=1.97, v_num=0]
Epoch 95:  20%|█▉        | 19/97 [00:04<00:17,  4.58it/s, loss=1.97, v_num=0]
Epoch 95:  20%|█▉        | 19/97 [00:04<00:17,  4.52it/s, loss=1.98, v_num=0]
Epoch 95:  21%|██        | 20/97 [00:04<00:16,  4.67it/s, loss=1.98, v_num=0]
Epoch 95:  21%|██        | 20/97 [00:04<00:16,  4.61it/s, loss=1.97, v_num=0]
Epoch 95:  22%|██▏       | 21/97 [00:04<00:16,  4.75it/s, loss=1.97, v_num=0]
Epoch 95:  22%|██▏       | 21/97 [00:04<00:16,  4.69it/s, loss=1.98, v_num=0]
Epoch 95:  23%|██▎       | 22/97 [00:04<00:15,  4.82it/s, loss=1.98, v_num=0]
Epoch 95:  23%|██▎       | 22/97 [00:04<00:15,  4.76it/s, loss=1.98, v_num=0]
Epoch 95:  24%|██▎       | 23/97 [00:04<00:15,  4.89it/s, loss=1.98, v_num=0]
Epoch 95:  24%|██▎       | 23/97 [00:04<00:15,  4.83it/s, loss=1.97, v_num=0]
Epoch 95:  25%|██▍       | 24/97 [00:04<00:14,  4.95it/s, loss=1.97, v_num=0]
Epoch 95:  25%|██▍       | 24/97 [00:04<00:14,  4.90it/s, loss=1.98, v_num=0]
Epoch 95:  26%|██▌       | 25/97 [00:04<00:14,  5.01it/s, loss=1.98, v_num=0]
Epoch 95:  26%|██▌       | 25/97 [00:05<00:14,  4.96it/s, loss=1.98, v_num=0]
Epoch 95:  27%|██▋       | 26/97 [00:05<00:13,  5.07it/s, loss=1.98, v_num=0]
Epoch 95:  27%|██▋       | 26/97 [00:05<00:14,  5.02it/s, loss=1.97, v_num=0]
Epoch 95:  28%|██▊       | 27/97 [00:05<00:13,  5.13it/s, loss=1.97, v_num=0]
Epoch 95:  28%|██▊       | 27/97 [00:05<00:13,  5.07it/s, loss=1.97, v_num=0]
Epoch 95:  29%|██▉       | 28/97 [00:05<00:13,  5.18it/s, loss=1.97, v_num=0]
Epoch 95:  29%|██▉       | 28/97 [00:05<00:13,  5.12it/s, loss=1.97, v_num=0]
Epoch 95:  30%|██▉       | 29/97 [00:05<00:13,  5.23it/s, loss=1.97, v_num=0]
Epoch 95:  30%|██▉       | 29/97 [00:05<00:13,  5.18it/s, loss=1.97, v_num=0]
Epoch 95:  31%|███       | 30/97 [00:05<00:12,  5.28it/s, loss=1.97, v_num=0]
Epoch 95:  31%|███       | 30/97 [00:05<00:12,  5.22it/s, loss=1.96, v_num=0]
Epoch 95:  32%|███▏      | 31/97 [00:05<00:12,  5.32it/s, loss=1.96, v_num=0]
Epoch 95:  32%|███▏      | 31/97 [00:05<00:12,  5.27it/s, loss=1.97, v_num=0]
Epoch 95:  33%|███▎      | 32/97 [00:05<00:12,  5.36it/s, loss=1.97, v_num=0]
Epoch 95:  33%|███▎      | 32/97 [00:06<00:12,  5.31it/s, loss=1.97, v_num=0]
Epoch 95:  34%|███▍      | 33/97 [00:06<00:11,  5.40it/s, loss=1.97, v_num=0]
Epoch 95:  34%|███▍      | 33/97 [00:06<00:11,  5.35it/s, loss=1.96, v_num=0]
Epoch 95:  35%|███▌      | 34/97 [00:06<00:11,  5.44it/s, loss=1.96, v_num=0]
Epoch 95:  35%|███▌      | 34/97 [00:06<00:11,  5.39it/s, loss=1.95, v_num=0]
Epoch 95:  36%|███▌      | 35/97 [00:06<00:11,  5.47it/s, loss=1.95, v_num=0]
Epoch 95:  36%|███▌      | 35/97 [00:06<00:11,  5.42it/s, loss=1.96, v_num=0]
Epoch 95:  37%|███▋      | 36/97 [00:06<00:11,  5.51it/s, loss=1.96, v_num=0]
Epoch 95:  37%|███▋      | 36/97 [00:06<00:11,  5.46it/s, loss=1.96, v_num=0]
Epoch 95:  38%|███▊      | 37/97 [00:06<00:10,  5.53it/s, loss=1.96, v_num=0]
Epoch 95:  38%|███▊      | 37/97 [00:06<00:10,  5.48it/s, loss=1.96, v_num=0]
Epoch 95:  39%|███▉      | 38/97 [00:06<00:10,  5.56it/s, loss=1.96, v_num=0]
Epoch 95:  39%|███▉      | 38/97 [00:06<00:10,  5.51it/s, loss=1.95, v_num=0]
Epoch 95:  40%|████      | 39/97 [00:06<00:10,  5.59it/s, loss=1.95, v_num=0]
Epoch 95:  40%|████      | 39/97 [00:07<00:10,  5.54it/s, loss=1.95, v_num=0]
Epoch 95:  41%|████      | 40/97 [00:07<00:10,  5.62it/s, loss=1.95, v_num=0]
Epoch 95:  41%|████      | 40/97 [00:07<00:10,  5.58it/s, loss=1.96, v_num=0]
Epoch 95:  42%|████▏     | 41/97 [00:07<00:09,  5.65it/s, loss=1.96, v_num=0]
Epoch 95:  42%|████▏     | 41/97 [00:07<00:09,  5.60it/s, loss=1.96, v_num=0]
Epoch 95:  43%|████▎     | 42/97 [00:07<00:09,  5.67it/s, loss=1.96, v_num=0]
Epoch 95:  43%|████▎     | 42/97 [00:07<00:09,  5.63it/s, loss=1.96, v_num=0]
Epoch 95:  44%|████▍     | 43/97 [00:07<00:09,  5.70it/s, loss=1.96, v_num=0]
Epoch 95:  44%|████▍     | 43/97 [00:07<00:09,  5.66it/s, loss=1.96, v_num=0]
Epoch 95:  45%|████▌     | 44/97 [00:07<00:09,  5.72it/s, loss=1.96, v_num=0]
Epoch 95:  45%|████▌     | 44/97 [00:07<00:09,  5.68it/s, loss=1.95, v_num=0]
Epoch 95:  46%|████▋     | 45/97 [00:07<00:09,  5.75it/s, loss=1.95, v_num=0]
Epoch 95:  46%|████▋     | 45/97 [00:07<00:09,  5.71it/s, loss=1.95, v_num=0]
Epoch 95:  47%|████▋     | 46/97 [00:07<00:08,  5.77it/s, loss=1.95, v_num=0]
Epoch 95:  47%|████▋     | 46/97 [00:08<00:08,  5.73it/s, loss=1.95, v_num=0]
Epoch 95:  48%|████▊     | 47/97 [00:08<00:08,  5.79it/s, loss=1.95, v_num=0]
Epoch 95:  48%|████▊     | 47/97 [00:08<00:08,  5.75it/s, loss=1.95, v_num=0]
Epoch 95:  49%|████▉     | 48/97 [00:08<00:08,  5.82it/s, loss=1.95, v_num=0]
Epoch 95:  49%|████▉     | 48/97 [00:08<00:08,  5.78it/s, loss=1.94, v_num=0]
Epoch 95:  51%|█████     | 49/97 [00:08<00:08,  5.84it/s, loss=1.94, v_num=0]
Epoch 95:  51%|█████     | 49/97 [00:08<00:08,  5.80it/s, loss=1.94, v_num=0]
Epoch 95:  52%|█████▏    | 50/97 [00:08<00:08,  5.86it/s, loss=1.94, v_num=0]
Epoch 95:  52%|█████▏    | 50/97 [00:08<00:08,  5.82it/s, loss=1.94, v_num=0]
Epoch 95:  53%|█████▎    | 51/97 [00:08<00:07,  5.88it/s, loss=1.94, v_num=0]
Epoch 95:  53%|█████▎    | 51/97 [00:08<00:07,  5.84it/s, loss=1.94, v_num=0]
Epoch 95:  54%|█████▎    | 52/97 [00:08<00:07,  5.89it/s, loss=1.94, v_num=0]
Epoch 95:  54%|█████▎    | 52/97 [00:08<00:07,  5.86it/s, loss=1.95, v_num=0]
Epoch 95:  55%|█████▍    | 53/97 [00:08<00:07,  5.91it/s, loss=1.95, v_num=0]
Epoch 95:  55%|█████▍    | 53/97 [00:09<00:07,  5.87it/s, loss=1.95, v_num=0]
Epoch 95:  56%|█████▌    | 54/97 [00:09<00:07,  5.93it/s, loss=1.95, v_num=0]
Epoch 95:  56%|█████▌    | 54/97 [00:09<00:07,  5.89it/s, loss=1.95, v_num=0]
Epoch 95:  57%|█████▋    | 55/97 [00:09<00:07,  5.94it/s, loss=1.95, v_num=0]
Epoch 95:  57%|█████▋    | 55/97 [00:09<00:07,  5.91it/s, loss=1.95, v_num=0]
Epoch 95:  58%|█████▊    | 56/97 [00:09<00:06,  5.96it/s, loss=1.95, v_num=0]
Epoch 95:  58%|█████▊    | 56/97 [00:09<00:06,  5.92it/s, loss=1.95, v_num=0]
Epoch 95:  59%|█████▉    | 57/97 [00:09<00:06,  5.98it/s, loss=1.95, v_num=0]
Epoch 95:  59%|█████▉    | 57/97 [00:09<00:06,  5.94it/s, loss=1.94, v_num=0]
Epoch 95:  60%|█████▉    | 58/97 [00:09<00:06,  5.99it/s, loss=1.94, v_num=0]
Epoch 95:  60%|█████▉    | 58/97 [00:09<00:06,  5.95it/s, loss=1.94, v_num=0]
Epoch 95:  61%|██████    | 59/97 [00:09<00:06,  6.00it/s, loss=1.94, v_num=0]
Epoch 95:  61%|██████    | 59/97 [00:09<00:06,  5.97it/s, loss=1.94, v_num=0]
Epoch 95:  62%|██████▏   | 60/97 [00:09<00:06,  6.02it/s, loss=1.94, v_num=0]
Epoch 95:  62%|██████▏   | 60/97 [00:10<00:06,  5.99it/s, loss=1.94, v_num=0]
Epoch 95:  63%|██████▎   | 61/97 [00:10<00:05,  6.03it/s, loss=1.94, v_num=0]
Epoch 95:  63%|██████▎   | 61/97 [00:10<00:05,  6.00it/s, loss=1.94, v_num=0]
Epoch 95:  64%|██████▍   | 62/97 [00:10<00:05,  6.05it/s, loss=1.94, v_num=0]
Epoch 95:  64%|██████▍   | 62/97 [00:10<00:05,  6.01it/s, loss=1.93, v_num=0]
Epoch 95:  65%|██████▍   | 63/97 [00:10<00:05,  6.06it/s, loss=1.93, v_num=0]
Epoch 95:  65%|██████▍   | 63/97 [00:10<00:05,  6.03it/s, loss=1.92, v_num=0]
Epoch 95:  66%|██████▌   | 64/97 [00:10<00:05,  6.08it/s, loss=1.92, v_num=0]
Epoch 95:  66%|██████▌   | 64/97 [00:10<00:05,  6.05it/s, loss=1.93, v_num=0]
Epoch 95:  67%|██████▋   | 65/97 [00:10<00:05,  6.09it/s, loss=1.93, v_num=0]
Epoch 95:  67%|██████▋   | 65/97 [00:10<00:05,  6.06it/s, loss=1.93, v_num=0]
Epoch 95:  68%|██████▊   | 66/97 [00:10<00:05,  6.11it/s, loss=1.93, v_num=0]
Epoch 95:  68%|██████▊   | 66/97 [00:10<00:05,  6.08it/s, loss=1.94, v_num=0]
Epoch 95:  69%|██████▉   | 67/97 [00:10<00:04,  6.12it/s, loss=1.94, v_num=0]
Epoch 95:  69%|██████▉   | 67/97 [00:10<00:04,  6.09it/s, loss=1.94, v_num=0]
Epoch 95:  70%|███████   | 68/97 [00:11<00:04,  6.14it/s, loss=1.94, v_num=0]
Epoch 95:  70%|███████   | 68/97 [00:11<00:04,  6.11it/s, loss=1.94, v_num=0]
Epoch 95:  71%|███████   | 69/97 [00:11<00:04,  6.15it/s, loss=1.94, v_num=0]
Epoch 95:  71%|███████   | 69/97 [00:11<00:04,  6.12it/s, loss=1.94, v_num=0]
Epoch 95:  72%|███████▏  | 70/97 [00:11<00:04,  6.16it/s, loss=1.94, v_num=0]
Epoch 95:  72%|███████▏  | 70/97 [00:11<00:04,  6.13it/s, loss=1.94, v_num=0]
Epoch 95:  73%|███████▎  | 71/97 [00:11<00:04,  6.18it/s, loss=1.94, v_num=0]
Epoch 95:  73%|███████▎  | 71/97 [00:11<00:04,  6.15it/s, loss=1.93, v_num=0]
Epoch 95:  74%|███████▍  | 72/97 [00:11<00:04,  6.19it/s, loss=1.93, v_num=0]
Epoch 95:  74%|███████▍  | 72/97 [00:11<00:04,  6.16it/s, loss=1.93, v_num=0]
Epoch 95:  75%|███████▌  | 73/97 [00:11<00:03,  6.20it/s, loss=1.93, v_num=0]
Epoch 95:  75%|███████▌  | 73/97 [00:11<00:03,  6.17it/s, loss=1.93, v_num=0]
Epoch 95:  76%|███████▋  | 74/97 [00:11<00:03,  6.22it/s, loss=1.93, v_num=0]
Epoch 95:  76%|███████▋  | 74/97 [00:11<00:03,  6.19it/s, loss=1.94, v_num=0]
Epoch 95:  77%|███████▋  | 75/97 [00:12<00:03,  6.23it/s, loss=1.94, v_num=0]
Epoch 95:  77%|███████▋  | 75/97 [00:12<00:03,  6.20it/s, loss=1.93, v_num=0]
Epoch 95:  78%|███████▊  | 76/97 [00:12<00:03,  6.24it/s, loss=1.93, v_num=0]
Epoch 95:  78%|███████▊  | 76/97 [00:12<00:03,  6.21it/s, loss=1.93, v_num=0]
Epoch 95:  79%|███████▉  | 77/97 [00:12<00:03,  6.25it/s, loss=1.93, v_num=0]
Epoch 95:  79%|███████▉  | 77/97 [00:12<00:03,  6.22it/s, loss=1.93, v_num=0]
Epoch 95:  80%|████████  | 78/97 [00:12<00:03,  6.26it/s, loss=1.93, v_num=0]
Epoch 95:  80%|████████  | 78/97 [00:12<00:03,  6.23it/s, loss=1.93, v_num=0]
Epoch 95:  81%|████████▏ | 79/97 [00:12<00:02,  6.27it/s, loss=1.93, v_num=0]
Epoch 95:  81%|████████▏ | 79/97 [00:12<00:02,  6.25it/s, loss=1.93, v_num=0]
Epoch 95:  82%|████████▏ | 80/97 [00:12<00:02,  6.28it/s, loss=1.93, v_num=0]
Epoch 95:  82%|████████▏ | 80/97 [00:12<00:02,  6.26it/s, loss=1.93, v_num=0]
Epoch 95:  84%|████████▎ | 81/97 [00:12<00:02,  6.29it/s, loss=1.93, v_num=0]
Epoch 95:  84%|████████▎ | 81/97 [00:12<00:02,  6.27it/s, loss=1.93, v_num=0]
Epoch 95:  85%|████████▍ | 82/97 [00:13<00:02,  6.30it/s, loss=1.93, v_num=0]
Epoch 95:  85%|████████▍ | 82/97 [00:13<00:02,  6.27it/s, loss=1.94, v_num=0]
Epoch 95:  86%|████████▌ | 83/97 [00:13<00:02,  6.31it/s, loss=1.94, v_num=0]
Epoch 95:  86%|████████▌ | 83/97 [00:13<00:02,  6.29it/s, loss=1.94, v_num=0]
Epoch 95:  87%|████████▋ | 84/97 [00:13<00:02,  6.32it/s, loss=1.94, v_num=0]
Epoch 95:  87%|████████▋ | 84/97 [00:13<00:02,  6.30it/s, loss=1.94, v_num=0]
Epoch 95:  88%|████████▊ | 85/97 [00:13<00:01,  6.33it/s, loss=1.94, v_num=0]
Epoch 95:  88%|████████▊ | 85/97 [00:13<00:01,  6.31it/s, loss=1.94, v_num=0]
Epoch 95:  89%|████████▊ | 86/97 [00:13<00:01,  6.34it/s, loss=1.94, v_num=0]
Epoch 95:  89%|████████▊ | 86/97 [00:13<00:01,  6.31it/s, loss=1.94, v_num=0]
Epoch 95:  90%|████████▉ | 87/97 [00:13<00:01,  6.35it/s, loss=1.94, v_num=0]
Epoch 95:  90%|████████▉ | 87/97 [00:13<00:01,  6.32it/s, loss=1.94, v_num=0]
Epoch 95:  91%|█████████ | 88/97 [00:13<00:01,  6.36it/s, loss=1.94, v_num=0]
Epoch 95:  91%|█████████ | 88/97 [00:13<00:01,  6.33it/s, loss=1.94, v_num=0]
Epoch 95:  92%|█████████▏| 89/97 [00:13<00:01,  6.37it/s, loss=1.94, v_num=0]
Epoch 95:  92%|█████████▏| 89/97 [00:14<00:01,  6.34it/s, loss=1.94, v_num=0]
Epoch 95:  93%|█████████▎| 90/97 [00:14<00:01,  6.38it/s, loss=1.94, v_num=0]
Epoch 95:  93%|█████████▎| 90/97 [00:14<00:01,  6.35it/s, loss=1.95, v_num=0]
Epoch 95:  94%|█████████▍| 91/97 [00:14<00:00,  6.39it/s, loss=1.95, v_num=0]
Epoch 95:  94%|█████████▍| 91/97 [00:14<00:00,  6.36it/s, loss=1.94, v_num=0]
Epoch 95:  95%|█████████▍| 92/97 [00:14<00:00,  6.39it/s, loss=1.94, v_num=0]
Epoch 95:  95%|█████████▍| 92/97 [00:14<00:00,  6.37it/s, loss=1.94, v_num=0]
Epoch 95:  96%|█████████▌| 93/97 [00:14<00:00,  6.40it/s, loss=1.94, v_num=0]
Epoch 95:  96%|█████████▌| 93/97 [00:14<00:00,  6.38it/s, loss=1.94, v_num=0]
Epoch 95:  97%|█████████▋| 94/97 [00:14<00:00,  6.41it/s, loss=1.94, v_num=0]
Epoch 95:  97%|█████████▋| 94/97 [00:14<00:00,  6.38it/s, loss=1.94, v_num=0]
Epoch 95:  98%|█████████▊| 95/97 [00:14<00:00,  6.41it/s, loss=1.94, v_num=0]
Epoch 95:  98%|█████████▊| 95/97 [00:14<00:00,  6.39it/s, loss=1.94, v_num=0]
Epoch 95:  99%|█████████▉| 96/97 [00:14<00:00,  6.42it/s, loss=1.94, v_num=0]
Epoch 95:  99%|█████████▉| 96/97 [00:15<00:00,  6.40it/s, loss=1.94, v_num=0]
Epoch 95: 100%|██████████| 97/97 [00:15<00:00,  6.43it/s, loss=1.94, v_num=0]
Epoch 95: 100%|██████████| 97/97 [00:15<00:00,  6.40it/s, loss=1.96, v_num=0]
Epoch 95: 100%|██████████| 97/97 [00:15<00:00,  6.40it/s, loss=1.96, v_num=0]
Epoch 95:   0%|          | 0/97 [00:00<?, ?it/s, loss=1.96, v_num=0]
Epoch 96:   0%|          | 0/97 [00:00<?, ?it/s, loss=1.96, v_num=0]
Epoch 96:   1%|          | 1/97 [00:01<02:35,  1.61s/it, loss=1.96, v_num=0]
Epoch 96:   1%|          | 1/97 [00:01<02:40,  1.67s/it, loss=1.95, v_num=0]
Epoch 96:   2%|▏         | 2/97 [00:01<01:23,  1.14it/s, loss=1.95, v_num=0]
Epoch 96:   2%|▏         | 2/97 [00:01<01:26,  1.10it/s, loss=1.96, v_num=0]
Epoch 96:   3%|▎         | 3/97 [00:01<00:59,  1.58it/s, loss=1.96, v_num=0]
Epoch 96:   3%|▎         | 3/97 [00:01<01:01,  1.53it/s, loss=1.96, v_num=0]
Epoch 96:   4%|▍         | 4/97 [00:02<00:47,  1.97it/s, loss=1.96, v_num=0]
Epoch 96:   4%|▍         | 4/97 [00:02<00:48,  1.91it/s, loss=1.96, v_num=0]
Epoch 96:   5%|▌         | 5/97 [00:02<00:40,  2.26it/s, loss=1.96, v_num=0]
Epoch 96:   5%|▌         | 5/97 [00:02<00:41,  2.21it/s, loss=1.97, v_num=0]
Epoch 96:   6%|▌         | 6/97 [00:02<00:35,  2.55it/s, loss=1.97, v_num=0]
Epoch 96:   6%|▌         | 6/97 [00:02<00:36,  2.50it/s, loss=1.97, v_num=0]
Epoch 96:   7%|▋         | 7/97 [00:02<00:32,  2.81it/s, loss=1.97, v_num=0]
Epoch 96:   7%|▋         | 7/97 [00:02<00:32,  2.74it/s, loss=1.96, v_num=0]
Epoch 96:   8%|▊         | 8/97 [00:02<00:29,  3.04it/s, loss=1.96, v_num=0]
Epoch 96:   8%|▊         | 8/97 [00:02<00:29,  2.97it/s, loss=1.97, v_num=0]
Epoch 96:   9%|▉         | 9/97 [00:02<00:27,  3.24it/s, loss=1.97, v_num=0]
Epoch 96:   9%|▉         | 9/97 [00:02<00:27,  3.17it/s, loss=1.96, v_num=0]
Epoch 96:  10%|█         | 10/97 [00:02<00:25,  3.43it/s, loss=1.96, v_num=0]
Epoch 96:  10%|█         | 10/97 [00:02<00:25,  3.36it/s, loss=1.96, v_num=0]
Epoch 96:  11%|█▏        | 11/97 [00:03<00:23,  3.61it/s, loss=1.96, v_num=0]
Epoch 96:  11%|█▏        | 11/97 [00:03<00:24,  3.54it/s, loss=1.96, v_num=0]
Epoch 96:  12%|█▏        | 12/97 [00:03<00:22,  3.76it/s, loss=1.96, v_num=0]
Epoch 96:  12%|█▏        | 12/97 [00:03<00:23,  3.69it/s, loss=1.97, v_num=0]
Epoch 96:  13%|█▎        | 13/97 [00:03<00:21,  3.90it/s, loss=1.97, v_num=0]
Epoch 96:  13%|█▎        | 13/97 [00:03<00:21,  3.83it/s, loss=1.96, v_num=0]
Epoch 96:  14%|█▍        | 14/97 [00:03<00:20,  4.03it/s, loss=1.96, v_num=0]
Epoch 96:  14%|█▍        | 14/97 [00:03<00:20,  3.97it/s, loss=1.97, v_num=0]
Epoch 96:  15%|█▌        | 15/97 [00:03<00:19,  4.16it/s, loss=1.97, v_num=0]
Epoch 96:  15%|█▌        | 15/97 [00:03<00:20,  4.09it/s, loss=1.98, v_num=0]
Epoch 96:  16%|█▋        | 16/97 [00:03<00:18,  4.27it/s, loss=1.98, v_num=0]
Epoch 96:  16%|█▋        | 16/97 [00:03<00:19,  4.21it/s, loss=1.98, v_num=0]
Epoch 96:  18%|█▊        | 17/97 [00:03<00:18,  4.38it/s, loss=1.98, v_num=0]
Epoch 96:  18%|█▊        | 17/97 [00:03<00:18,  4.31it/s, loss=1.97, v_num=0]
Epoch 96:  19%|█▊        | 18/97 [00:04<00:17,  4.48it/s, loss=1.97, v_num=0]
Epoch 96:  19%|█▊        | 18/97 [00:04<00:17,  4.41it/s, loss=1.98, v_num=0]
Epoch 96:  20%|█▉        | 19/97 [00:04<00:17,  4.57it/s, loss=1.98, v_num=0]
Epoch 96:  20%|█▉        | 19/97 [00:04<00:17,  4.51it/s, loss=1.98, v_num=0]
Epoch 96:  21%|██        | 20/97 [00:04<00:16,  4.66it/s, loss=1.98, v_num=0]
Epoch 96:  21%|██        | 20/97 [00:04<00:16,  4.60it/s, loss=1.97, v_num=0]
Epoch 96:  22%|██▏       | 21/97 [00:04<00:16,  4.74it/s, loss=1.97, v_num=0]
Epoch 96:  22%|██▏       | 21/97 [00:04<00:16,  4.68it/s, loss=1.96, v_num=0]
Epoch 96:  23%|██▎       | 22/97 [00:04<00:15,  4.81it/s, loss=1.96, v_num=0]
Epoch 96:  23%|██▎       | 22/97 [00:04<00:15,  4.76it/s, loss=1.96, v_num=0]
Epoch 96:  24%|██▎       | 23/97 [00:04<00:15,  4.88it/s, loss=1.96, v_num=0]
Epoch 96:  24%|██▎       | 23/97 [00:04<00:15,  4.83it/s, loss=1.96, v_num=0]
Epoch 96:  25%|██▍       | 24/97 [00:04<00:14,  4.95it/s, loss=1.96, v_num=0]
Epoch 96:  25%|██▍       | 24/97 [00:04<00:14,  4.90it/s, loss=1.95, v_num=0]
Epoch 96:  26%|██▌       | 25/97 [00:04<00:14,  5.02it/s, loss=1.95, v_num=0]
Epoch 96:  26%|██▌       | 25/97 [00:05<00:14,  4.96it/s, loss=1.95, v_num=0]
Epoch 96:  27%|██▋       | 26/97 [00:05<00:13,  5.08it/s, loss=1.95, v_num=0]
Epoch 96:  27%|██▋       | 26/97 [00:05<00:14,  5.03it/s, loss=1.95, v_num=0]
Epoch 96:  28%|██▊       | 27/97 [00:05<00:13,  5.14it/s, loss=1.95, v_num=0]
Epoch 96:  28%|██▊       | 27/97 [00:05<00:13,  5.08it/s, loss=1.95, v_num=0]
Epoch 96:  29%|██▉       | 28/97 [00:05<00:13,  5.19it/s, loss=1.95, v_num=0]
Epoch 96:  29%|██▉       | 28/97 [00:05<00:13,  5.14it/s, loss=1.94, v_num=0]
Epoch 96:  30%|██▉       | 29/97 [00:05<00:12,  5.24it/s, loss=1.94, v_num=0]
Epoch 96:  30%|██▉       | 29/97 [00:05<00:13,  5.19it/s, loss=1.94, v_num=0]
Epoch 96:  31%|███       | 30/97 [00:05<00:12,  5.29it/s, loss=1.94, v_num=0]
Epoch 96:  31%|███       | 30/97 [00:05<00:12,  5.24it/s, loss=1.94, v_num=0]
Epoch 96:  32%|███▏      | 31/97 [00:05<00:12,  5.33it/s, loss=1.94, v_num=0]
Epoch 96:  32%|███▏      | 31/97 [00:05<00:12,  5.28it/s, loss=1.93, v_num=0]
Epoch 96:  33%|███▎      | 32/97 [00:05<00:12,  5.38it/s, loss=1.93, v_num=0]
Epoch 96:  33%|███▎      | 32/97 [00:06<00:12,  5.33it/s, loss=1.93, v_num=0]
Epoch 96:  34%|███▍      | 33/97 [00:06<00:11,  5.42it/s, loss=1.93, v_num=0]
Epoch 96:  34%|███▍      | 33/97 [00:06<00:11,  5.37it/s, loss=1.93, v_num=0]
Epoch 96:  35%|███▌      | 34/97 [00:06<00:11,  5.47it/s, loss=1.93, v_num=0]
Epoch 96:  35%|███▌      | 34/97 [00:06<00:11,  5.41it/s, loss=1.92, v_num=0]
Epoch 96:  36%|███▌      | 35/97 [00:06<00:11,  5.50it/s, loss=1.92, v_num=0]
Epoch 96:  36%|███▌      | 35/97 [00:06<00:11,  5.45it/s, loss=1.92, v_num=0]
Epoch 96:  37%|███▋      | 36/97 [00:06<00:11,  5.54it/s, loss=1.92, v_num=0]
Epoch 96:  37%|███▋      | 36/97 [00:06<00:11,  5.49it/s, loss=1.91, v_num=0]
Epoch 96:  38%|███▊      | 37/97 [00:06<00:10,  5.57it/s, loss=1.91, v_num=0]
Epoch 96:  38%|███▊      | 37/97 [00:06<00:10,  5.52it/s, loss=1.91, v_num=0]
Epoch 96:  39%|███▉      | 38/97 [00:06<00:10,  5.61it/s, loss=1.91, v_num=0]
Epoch 96:  39%|███▉      | 38/97 [00:06<00:10,  5.56it/s, loss=1.91, v_num=0]
Epoch 96:  40%|████      | 39/97 [00:06<00:10,  5.63it/s, loss=1.91, v_num=0]
Epoch 96:  40%|████      | 39/97 [00:06<00:10,  5.59it/s, loss=1.91, v_num=0]
Epoch 96:  41%|████      | 40/97 [00:07<00:10,  5.67it/s, loss=1.91, v_num=0]
Epoch 96:  41%|████      | 40/97 [00:07<00:10,  5.62it/s, loss=1.91, v_num=0]
Epoch 96:  42%|████▏     | 41/97 [00:07<00:09,  5.70it/s, loss=1.91, v_num=0]
Epoch 96:  42%|████▏     | 41/97 [00:07<00:09,  5.65it/s, loss=1.91, v_num=0]
Epoch 96:  43%|████▎     | 42/97 [00:07<00:09,  5.72it/s, loss=1.91, v_num=0]
Epoch 96:  43%|████▎     | 42/97 [00:07<00:09,  5.68it/s, loss=1.92, v_num=0]
Epoch 96:  44%|████▍     | 43/97 [00:07<00:09,  5.75it/s, loss=1.92, v_num=0]
Epoch 96:  44%|████▍     | 43/97 [00:07<00:09,  5.71it/s, loss=1.92, v_num=0]
Epoch 96:  45%|████▌     | 44/97 [00:07<00:09,  5.78it/s, loss=1.92, v_num=0]
Epoch 96:  45%|████▌     | 44/97 [00:07<00:09,  5.73it/s, loss=1.92, v_num=0]
Epoch 96:  46%|████▋     | 45/97 [00:07<00:08,  5.80it/s, loss=1.92, v_num=0]
Epoch 96:  46%|████▋     | 45/97 [00:07<00:09,  5.76it/s, loss=1.92, v_num=0]
Epoch 96:  47%|████▋     | 46/97 [00:07<00:08,  5.83it/s, loss=1.92, v_num=0]
Epoch 96:  47%|████▋     | 46/97 [00:07<00:08,  5.79it/s, loss=1.91, v_num=0]
Epoch 96:  48%|████▊     | 47/97 [00:08<00:08,  5.85it/s, loss=1.91, v_num=0]
Epoch 96:  48%|████▊     | 47/97 [00:08<00:08,  5.81it/s, loss=1.91, v_num=0]
Epoch 96:  49%|████▉     | 48/97 [00:08<00:08,  5.87it/s, loss=1.91, v_num=0]
Epoch 96:  49%|████▉     | 48/97 [00:08<00:08,  5.83it/s, loss=1.92, v_num=0]
Epoch 96:  51%|█████     | 49/97 [00:08<00:08,  5.89it/s, loss=1.92, v_num=0]
Epoch 96:  51%|█████     | 49/97 [00:08<00:08,  5.85it/s, loss=1.93, v_num=0]
Epoch 96:  52%|█████▏    | 50/97 [00:08<00:07,  5.91it/s, loss=1.93, v_num=0]
Epoch 96:  52%|█████▏    | 50/97 [00:08<00:08,  5.87it/s, loss=1.93, v_num=0]
Epoch 96:  53%|█████▎    | 51/97 [00:08<00:07,  5.93it/s, loss=1.93, v_num=0]
Epoch 96:  53%|█████▎    | 51/97 [00:08<00:07,  5.89it/s, loss=1.93, v_num=0]
Epoch 96:  54%|█████▎    | 52/97 [00:08<00:07,  5.95it/s, loss=1.93, v_num=0]
Epoch 96:  54%|█████▎    | 52/97 [00:08<00:07,  5.91it/s, loss=1.93, v_num=0]
Epoch 96:  55%|█████▍    | 53/97 [00:08<00:07,  5.97it/s, loss=1.93, v_num=0]
Epoch 96:  55%|█████▍    | 53/97 [00:08<00:07,  5.93it/s, loss=1.93, v_num=0]
Epoch 96:  56%|█████▌    | 54/97 [00:09<00:07,  5.99it/s, loss=1.93, v_num=0]
Epoch 96:  56%|█████▌    | 54/97 [00:09<00:07,  5.95it/s, loss=1.94, v_num=0]
Epoch 96:  57%|█████▋    | 55/97 [00:09<00:06,  6.01it/s, loss=1.94, v_num=0]
Epoch 96:  57%|█████▋    | 55/97 [00:09<00:07,  5.97it/s, loss=1.94, v_num=0]
Epoch 96:  58%|█████▊    | 56/97 [00:09<00:06,  6.02it/s, loss=1.94, v_num=0]
Epoch 96:  58%|█████▊    | 56/97 [00:09<00:06,  5.99it/s, loss=1.93, v_num=0]
Epoch 96:  59%|█████▉    | 57/97 [00:09<00:06,  6.04it/s, loss=1.93, v_num=0]
Epoch 96:  59%|█████▉    | 57/97 [00:09<00:06,  6.00it/s, loss=1.94, v_num=0]
Epoch 96:  60%|█████▉    | 58/97 [00:09<00:06,  6.05it/s, loss=1.94, v_num=0]
Epoch 96:  60%|█████▉    | 58/97 [00:09<00:06,  6.01it/s, loss=1.94, v_num=0]
Epoch 96:  61%|██████    | 59/97 [00:09<00:06,  6.07it/s, loss=1.94, v_num=0]
Epoch 96:  61%|██████    | 59/97 [00:09<00:06,  6.03it/s, loss=1.94, v_num=0]
Epoch 96:  62%|██████▏   | 60/97 [00:09<00:06,  6.08it/s, loss=1.94, v_num=0]
Epoch 96:  62%|██████▏   | 60/97 [00:09<00:06,  6.05it/s, loss=1.95, v_num=0]
Epoch 96:  63%|██████▎   | 61/97 [00:10<00:05,  6.09it/s, loss=1.95, v_num=0]
Epoch 96:  63%|██████▎   | 61/97 [00:10<00:05,  6.06it/s, loss=1.94, v_num=0]
Epoch 96:  64%|██████▍   | 62/97 [00:10<00:05,  6.11it/s, loss=1.94, v_num=0]
Epoch 96:  64%|██████▍   | 62/97 [00:10<00:05,  6.07it/s, loss=1.94, v_num=0]
Epoch 96:  65%|██████▍   | 63/97 [00:10<00:05,  6.12it/s, loss=1.94, v_num=0]
Epoch 96:  65%|██████▍   | 63/97 [00:10<00:05,  6.09it/s, loss=1.94, v_num=0]
Epoch 96:  66%|██████▌   | 64/97 [00:10<00:05,  6.13it/s, loss=1.94, v_num=0]
Epoch 96:  66%|██████▌   | 64/97 [00:10<00:05,  6.10it/s, loss=1.94, v_num=0]
Epoch 96:  67%|██████▋   | 65/97 [00:10<00:05,  6.14it/s, loss=1.94, v_num=0]
Epoch 96:  67%|██████▋   | 65/97 [00:10<00:05,  6.11it/s, loss=1.94, v_num=0]
Epoch 96:  68%|██████▊   | 66/97 [00:10<00:05,  6.15it/s, loss=1.94, v_num=0]
Epoch 96:  68%|██████▊   | 66/97 [00:10<00:05,  6.12it/s, loss=1.94, v_num=0]
Epoch 96:  69%|██████▉   | 67/97 [00:10<00:04,  6.17it/s, loss=1.94, v_num=0]
Epoch 96:  69%|██████▉   | 67/97 [00:10<00:04,  6.14it/s, loss=1.94, v_num=0]
Epoch 96:  70%|███████   | 68/97 [00:11<00:04,  6.18it/s, loss=1.94, v_num=0]
Epoch 96:  70%|███████   | 68/97 [00:11<00:04,  6.15it/s, loss=1.93, v_num=0]
Epoch 96:  71%|███████   | 69/97 [00:11<00:04,  6.19it/s, loss=1.93, v_num=0]
Epoch 96:  71%|███████   | 69/97 [00:11<00:04,  6.16it/s, loss=1.93, v_num=0]
Epoch 96:  72%|███████▏  | 70/97 [00:11<00:04,  6.20it/s, loss=1.93, v_num=0]
Epoch 96:  72%|███████▏  | 70/97 [00:11<00:04,  6.17it/s, loss=1.93, v_num=0]
Epoch 96:  73%|███████▎  | 71/97 [00:11<00:04,  6.21it/s, loss=1.93, v_num=0]
Epoch 96:  73%|███████▎  | 71/97 [00:11<00:04,  6.18it/s, loss=1.93, v_num=0]
Epoch 96:  74%|███████▍  | 72/97 [00:11<00:04,  6.22it/s, loss=1.93, v_num=0]
Epoch 96:  74%|███████▍  | 72/97 [00:11<00:04,  6.19it/s, loss=1.93, v_num=0]
Epoch 96:  75%|███████▌  | 73/97 [00:11<00:03,  6.23it/s, loss=1.93, v_num=0]
Epoch 96:  75%|███████▌  | 73/97 [00:11<00:03,  6.20it/s, loss=1.94, v_num=0]
Epoch 96:  76%|███████▋  | 74/97 [00:11<00:03,  6.24it/s, loss=1.94, v_num=0]
Epoch 96:  76%|███████▋  | 74/97 [00:11<00:03,  6.21it/s, loss=1.95, v_num=0]
Epoch 96:  77%|███████▋  | 75/97 [00:11<00:03,  6.25it/s, loss=1.95, v_num=0]
Epoch 96:  77%|███████▋  | 75/97 [00:12<00:03,  6.22it/s, loss=1.95, v_num=0]
Epoch 96:  78%|███████▊  | 76/97 [00:12<00:03,  6.26it/s, loss=1.95, v_num=0]
Epoch 96:  78%|███████▊  | 76/97 [00:12<00:03,  6.23it/s, loss=1.95, v_num=0]
Epoch 96:  79%|███████▉  | 77/97 [00:12<00:03,  6.27it/s, loss=1.95, v_num=0]
Epoch 96:  79%|███████▉  | 77/97 [00:12<00:03,  6.24it/s, loss=1.95, v_num=0]
Epoch 96:  80%|████████  | 78/97 [00:12<00:03,  6.28it/s, loss=1.95, v_num=0]
Epoch 96:  80%|████████  | 78/97 [00:12<00:03,  6.25it/s, loss=1.95, v_num=0]
Epoch 96:  81%|████████▏ | 79/97 [00:12<00:02,  6.29it/s, loss=1.95, v_num=0]
Epoch 96:  81%|████████▏ | 79/97 [00:12<00:02,  6.26it/s, loss=1.95, v_num=0]
Epoch 96:  82%|████████▏ | 80/97 [00:12<00:02,  6.30it/s, loss=1.95, v_num=0]
Epoch 96:  82%|████████▏ | 80/97 [00:12<00:02,  6.27it/s, loss=1.95, v_num=0]
Epoch 96:  84%|████████▎ | 81/97 [00:12<00:02,  6.31it/s, loss=1.95, v_num=0]
Epoch 96:  84%|████████▎ | 81/97 [00:12<00:02,  6.28it/s, loss=1.96, v_num=0]
Epoch 96:  85%|████████▍ | 82/97 [00:12<00:02,  6.31it/s, loss=1.96, v_num=0]
Epoch 96:  85%|████████▍ | 82/97 [00:13<00:02,  6.28it/s, loss=1.96, v_num=0]
Epoch 96:  86%|████████▌ | 83/97 [00:13<00:02,  6.32it/s, loss=1.96, v_num=0]
Epoch 96:  86%|████████▌ | 83/97 [00:13<00:02,  6.29it/s, loss=1.96, v_num=0]
Epoch 96:  87%|████████▋ | 84/97 [00:13<00:02,  6.33it/s, loss=1.96, v_num=0]
Epoch 96:  87%|████████▋ | 84/97 [00:13<00:02,  6.30it/s, loss=1.96, v_num=0]
Epoch 96:  88%|████████▊ | 85/97 [00:13<00:01,  6.34it/s, loss=1.96, v_num=0]
Epoch 96:  88%|████████▊ | 85/97 [00:13<00:01,  6.31it/s, loss=1.97, v_num=0]
Epoch 96:  89%|████████▊ | 86/97 [00:13<00:01,  6.35it/s, loss=1.97, v_num=0]
Epoch 96:  89%|████████▊ | 86/97 [00:13<00:01,  6.32it/s, loss=1.97, v_num=0]
Epoch 96:  90%|████████▉ | 87/97 [00:13<00:01,  6.36it/s, loss=1.97, v_num=0]
Epoch 96:  90%|████████▉ | 87/97 [00:13<00:01,  6.33it/s, loss=1.98, v_num=0]
Epoch 96:  91%|█████████ | 88/97 [00:13<00:01,  6.37it/s, loss=1.98, v_num=0]
Epoch 96:  91%|█████████ | 88/97 [00:13<00:01,  6.34it/s, loss=1.98, v_num=0]
Epoch 96:  92%|█████████▏| 89/97 [00:13<00:01,  6.37it/s, loss=1.98, v_num=0]
Epoch 96:  92%|█████████▏| 89/97 [00:14<00:01,  6.35it/s, loss=1.98, v_num=0]
Epoch 96:  93%|█████████▎| 90/97 [00:14<00:01,  6.38it/s, loss=1.98, v_num=0]
Epoch 96:  93%|█████████▎| 90/97 [00:14<00:01,  6.36it/s, loss=1.98, v_num=0]
Epoch 96:  94%|█████████▍| 91/97 [00:14<00:00,  6.39it/s, loss=1.98, v_num=0]
Epoch 96:  94%|█████████▍| 91/97 [00:14<00:00,  6.37it/s, loss=1.98, v_num=0]
Epoch 96:  95%|█████████▍| 92/97 [00:14<00:00,  6.40it/s, loss=1.98, v_num=0]
Epoch 96:  95%|█████████▍| 92/97 [00:14<00:00,  6.38it/s, loss=1.98, v_num=0]
Epoch 96:  96%|█████████▌| 93/97 [00:14<00:00,  6.41it/s, loss=1.98, v_num=0]
Epoch 96:  96%|█████████▌| 93/97 [00:14<00:00,  6.38it/s, loss=1.97, v_num=0]
Epoch 96:  97%|█████████▋| 94/97 [00:14<00:00,  6.42it/s, loss=1.97, v_num=0]
Epoch 96:  97%|█████████▋| 94/97 [00:14<00:00,  6.39it/s, loss=1.97, v_num=0]
Epoch 96:  98%|█████████▊| 95/97 [00:14<00:00,  6.43it/s, loss=1.97, v_num=0]
Epoch 96:  98%|█████████▊| 95/97 [00:14<00:00,  6.40it/s, loss=1.97, v_num=0]
Epoch 96:  99%|█████████▉| 96/97 [00:14<00:00,  6.43it/s, loss=1.97, v_num=0]
Epoch 96:  99%|█████████▉| 96/97 [00:14<00:00,  6.41it/s, loss=1.97, v_num=0]
Epoch 96: 100%|██████████| 97/97 [00:15<00:00,  6.44it/s, loss=1.97, v_num=0]
Epoch 96: 100%|██████████| 97/97 [00:15<00:00,  6.42it/s, loss=1.97, v_num=0]
Epoch 96: 100%|██████████| 97/97 [00:15<00:00,  6.42it/s, loss=1.97, v_num=0]
Epoch 96:   0%|          | 0/97 [00:00<?, ?it/s, loss=1.97, v_num=0]
Epoch 97:   0%|          | 0/97 [00:00<?, ?it/s, loss=1.97, v_num=0]
Epoch 97:   1%|          | 1/97 [00:01<02:29,  1.56s/it, loss=1.97, v_num=0]
Epoch 97:   1%|          | 1/97 [00:01<02:35,  1.61s/it, loss=1.97, v_num=0]
Epoch 97:   2%|▏         | 2/97 [00:01<01:20,  1.18it/s, loss=1.97, v_num=0]
Epoch 97:   2%|▏         | 2/97 [00:01<01:23,  1.14it/s, loss=1.97, v_num=0]
Epoch 97:   3%|▎         | 3/97 [00:01<00:57,  1.63it/s, loss=1.97, v_num=0]
Epoch 97:   3%|▎         | 3/97 [00:01<00:59,  1.58it/s, loss=1.97, v_num=0]
Epoch 97:   4%|▍         | 4/97 [00:01<00:45,  2.02it/s, loss=1.97, v_num=0]
Epoch 97:   4%|▍         | 4/97 [00:02<00:47,  1.96it/s, loss=1.96, v_num=0]
Epoch 97:   5%|▌         | 5/97 [00:02<00:38,  2.36it/s, loss=1.96, v_num=0]
Epoch 97:   5%|▌         | 5/97 [00:02<00:40,  2.30it/s, loss=1.96, v_num=0]
Epoch 97:   6%|▌         | 6/97 [00:02<00:34,  2.66it/s, loss=1.96, v_num=0]
Epoch 97:   6%|▌         | 6/97 [00:02<00:35,  2.59it/s, loss=1.96, v_num=0]
Epoch 97:   7%|▋         | 7/97 [00:02<00:30,  2.92it/s, loss=1.96, v_num=0]
Epoch 97:   7%|▋         | 7/97 [00:02<00:31,  2.85it/s, loss=1.96, v_num=0]
Epoch 97:   8%|▊         | 8/97 [00:02<00:28,  3.15it/s, loss=1.96, v_num=0]
Epoch 97:   8%|▊         | 8/97 [00:02<00:28,  3.08it/s, loss=1.95, v_num=0]
Epoch 97:   9%|▉         | 9/97 [00:02<00:26,  3.34it/s, loss=1.95, v_num=0]
Epoch 97:   9%|▉         | 9/97 [00:02<00:26,  3.27it/s, loss=1.95, v_num=0]
Epoch 97:  10%|█         | 10/97 [00:02<00:24,  3.51it/s, loss=1.95, v_num=0]
Epoch 97:  10%|█         | 10/97 [00:02<00:25,  3.45it/s, loss=1.95, v_num=0]
Epoch 97:  11%|█▏        | 11/97 [00:02<00:23,  3.68it/s, loss=1.95, v_num=0]
Epoch 97:  11%|█▏        | 11/97 [00:03<00:23,  3.62it/s, loss=1.96, v_num=0]
Epoch 97:  12%|█▏        | 12/97 [00:03<00:22,  3.84it/s, loss=1.96, v_num=0]
Epoch 97:  12%|█▏        | 12/97 [00:03<00:22,  3.77it/s, loss=1.96, v_num=0]
Epoch 97:  13%|█▎        | 13/97 [00:03<00:21,  3.98it/s, loss=1.96, v_num=0]
Epoch 97:  13%|█▎        | 13/97 [00:03<00:21,  3.91it/s, loss=1.97, v_num=0]
Epoch 97:  14%|█▍        | 14/97 [00:03<00:20,  4.11it/s, loss=1.97, v_num=0]
Epoch 97:  14%|█▍        | 14/97 [00:03<00:20,  4.05it/s, loss=1.96, v_num=0]
Epoch 97:  15%|█▌        | 15/97 [00:03<00:19,  4.24it/s, loss=1.96, v_num=0]
Epoch 97:  15%|█▌        | 15/97 [00:03<00:19,  4.17it/s, loss=1.96, v_num=0]
Epoch 97:  16%|█▋        | 16/97 [00:03<00:18,  4.34it/s, loss=1.96, v_num=0]
Epoch 97:  16%|█▋        | 16/97 [00:03<00:18,  4.28it/s, loss=1.97, v_num=0]
Epoch 97:  18%|█▊        | 17/97 [00:03<00:18,  4.43it/s, loss=1.97, v_num=0]
Epoch 97:  18%|█▊        | 17/97 [00:03<00:18,  4.37it/s, loss=1.96, v_num=0]
Epoch 97:  19%|█▊        | 18/97 [00:03<00:17,  4.53it/s, loss=1.96, v_num=0]
Epoch 97:  19%|█▊        | 18/97 [00:04<00:17,  4.46it/s, loss=1.96, v_num=0]
Epoch 97:  20%|█▉        | 19/97 [00:04<00:16,  4.62it/s, loss=1.96, v_num=0]
Epoch 97:  20%|█▉        | 19/97 [00:04<00:17,  4.55it/s, loss=1.97, v_num=0]
Epoch 97:  21%|██        | 20/97 [00:04<00:16,  4.70it/s, loss=1.97, v_num=0]
Epoch 97:  21%|██        | 20/97 [00:04<00:16,  4.64it/s, loss=1.97, v_num=0]
Epoch 97:  22%|██▏       | 21/97 [00:04<00:15,  4.78it/s, loss=1.97, v_num=0]
Epoch 97:  22%|██▏       | 21/97 [00:04<00:16,  4.72it/s, loss=1.97, v_num=0]
Epoch 97:  23%|██▎       | 22/97 [00:04<00:15,  4.85it/s, loss=1.97, v_num=0]
Epoch 97:  23%|██▎       | 22/97 [00:04<00:15,  4.79it/s, loss=1.97, v_num=0]
Epoch 97:  24%|██▎       | 23/97 [00:04<00:15,  4.92it/s, loss=1.97, v_num=0]
Epoch 97:  24%|██▎       | 23/97 [00:04<00:15,  4.86it/s, loss=1.97, v_num=0]
Epoch 97:  25%|██▍       | 24/97 [00:04<00:14,  4.98it/s, loss=1.97, v_num=0]
Epoch 97:  25%|██▍       | 24/97 [00:04<00:14,  4.92it/s, loss=1.97, v_num=0]
Epoch 97:  26%|██▌       | 25/97 [00:04<00:14,  5.04it/s, loss=1.97, v_num=0]
Epoch 97:  26%|██▌       | 25/97 [00:05<00:14,  4.98it/s, loss=1.97, v_num=0]
Epoch 97:  27%|██▋       | 26/97 [00:05<00:13,  5.10it/s, loss=1.97, v_num=0]
Epoch 97:  27%|██▋       | 26/97 [00:05<00:14,  5.04it/s, loss=1.97, v_num=0]
Epoch 97:  28%|██▊       | 27/97 [00:05<00:13,  5.15it/s, loss=1.97, v_num=0]
Epoch 97:  28%|██▊       | 27/97 [00:05<00:13,  5.10it/s, loss=1.97, v_num=0]
Epoch 97:  29%|██▉       | 28/97 [00:05<00:13,  5.21it/s, loss=1.97, v_num=0]
Epoch 97:  29%|██▉       | 28/97 [00:05<00:13,  5.16it/s, loss=1.96, v_num=0]
Epoch 97:  30%|██▉       | 29/97 [00:05<00:12,  5.26it/s, loss=1.96, v_num=0]
Epoch 97:  30%|██▉       | 29/97 [00:05<00:13,  5.21it/s, loss=1.97, v_num=0]
Epoch 97:  31%|███       | 30/97 [00:05<00:12,  5.31it/s, loss=1.97, v_num=0]
Epoch 97:  31%|███       | 30/97 [00:05<00:12,  5.26it/s, loss=1.96, v_num=0]
Epoch 97:  32%|███▏      | 31/97 [00:05<00:12,  5.36it/s, loss=1.96, v_num=0]
Epoch 97:  32%|███▏      | 31/97 [00:05<00:12,  5.31it/s, loss=1.95, v_num=0]
Epoch 97:  33%|███▎      | 32/97 [00:05<00:12,  5.40it/s, loss=1.95, v_num=0]
Epoch 97:  33%|███▎      | 32/97 [00:05<00:12,  5.35it/s, loss=1.94, v_num=0]
Epoch 97:  34%|███▍      | 33/97 [00:06<00:11,  5.44it/s, loss=1.94, v_num=0]
Epoch 97:  34%|███▍      | 33/97 [00:06<00:11,  5.39it/s, loss=1.94, v_num=0]
Epoch 97:  35%|███▌      | 34/97 [00:06<00:11,  5.48it/s, loss=1.94, v_num=0]
Epoch 97:  35%|███▌      | 34/97 [00:06<00:11,  5.43it/s, loss=1.95, v_num=0]
Epoch 97:  36%|███▌      | 35/97 [00:06<00:11,  5.52it/s, loss=1.95, v_num=0]
Epoch 97:  36%|███▌      | 35/97 [00:06<00:11,  5.47it/s, loss=1.94, v_num=0]
Epoch 97:  37%|███▋      | 36/97 [00:06<00:10,  5.56it/s, loss=1.94, v_num=0]
Epoch 97:  37%|███▋      | 36/97 [00:06<00:11,  5.51it/s, loss=1.95, v_num=0]
Epoch 97:  38%|███▊      | 37/97 [00:06<00:10,  5.59it/s, loss=1.95, v_num=0]
Epoch 97:  38%|███▊      | 37/97 [00:06<00:10,  5.55it/s, loss=1.95, v_num=0]
Epoch 97:  39%|███▉      | 38/97 [00:06<00:10,  5.63it/s, loss=1.95, v_num=0]
Epoch 97:  39%|███▉      | 38/97 [00:06<00:10,  5.58it/s, loss=1.94, v_num=0]
Epoch 97:  40%|████      | 39/97 [00:06<00:10,  5.66it/s, loss=1.94, v_num=0]
Epoch 97:  40%|████      | 39/97 [00:06<00:10,  5.61it/s, loss=1.94, v_num=0]
Epoch 97:  41%|████      | 40/97 [00:07<00:10,  5.69it/s, loss=1.94, v_num=0]
Epoch 97:  41%|████      | 40/97 [00:07<00:10,  5.65it/s, loss=1.94, v_num=0]
Epoch 97:  42%|████▏     | 41/97 [00:07<00:09,  5.72it/s, loss=1.94, v_num=0]
Epoch 97:  42%|████▏     | 41/97 [00:07<00:09,  5.68it/s, loss=1.93, v_num=0]
Epoch 97:  43%|████▎     | 42/97 [00:07<00:09,  5.75it/s, loss=1.93, v_num=0]
Epoch 97:  43%|████▎     | 42/97 [00:07<00:09,  5.71it/s, loss=1.92, v_num=0]
Epoch 97:  44%|████▍     | 43/97 [00:07<00:09,  5.78it/s, loss=1.92, v_num=0]
Epoch 97:  44%|████▍     | 43/97 [00:07<00:09,  5.73it/s, loss=1.93, v_num=0]
Epoch 97:  45%|████▌     | 44/97 [00:07<00:09,  5.80it/s, loss=1.93, v_num=0]
Epoch 97:  45%|████▌     | 44/97 [00:07<00:09,  5.76it/s, loss=1.94, v_num=0]
Epoch 97:  46%|████▋     | 45/97 [00:07<00:08,  5.83it/s, loss=1.94, v_num=0]
Epoch 97:  46%|████▋     | 45/97 [00:07<00:08,  5.79it/s, loss=1.93, v_num=0]
Epoch 97:  47%|████▋     | 46/97 [00:07<00:08,  5.85it/s, loss=1.93, v_num=0]
Epoch 97:  47%|████▋     | 46/97 [00:07<00:08,  5.82it/s, loss=1.94, v_num=0]
Epoch 97:  48%|████▊     | 47/97 [00:07<00:08,  5.88it/s, loss=1.94, v_num=0]
Epoch 97:  48%|████▊     | 47/97 [00:08<00:08,  5.84it/s, loss=1.93, v_num=0]
Epoch 97:  49%|████▉     | 48/97 [00:08<00:08,  5.91it/s, loss=1.93, v_num=0]
Epoch 97:  49%|████▉     | 48/97 [00:08<00:08,  5.86it/s, loss=1.93, v_num=0]
Epoch 97:  51%|█████     | 49/97 [00:08<00:08,  5.93it/s, loss=1.93, v_num=0]
Epoch 97:  51%|█████     | 49/97 [00:08<00:08,  5.89it/s, loss=1.94, v_num=0]
Epoch 97:  52%|█████▏    | 50/97 [00:08<00:07,  5.95it/s, loss=1.94, v_num=0]
Epoch 97:  52%|█████▏    | 50/97 [00:08<00:07,  5.91it/s, loss=1.94, v_num=0]
Epoch 97:  53%|█████▎    | 51/97 [00:08<00:07,  5.97it/s, loss=1.94, v_num=0]
Epoch 97:  53%|█████▎    | 51/97 [00:08<00:07,  5.93it/s, loss=1.95, v_num=0]
Epoch 97:  54%|█████▎    | 52/97 [00:08<00:07,  5.99it/s, loss=1.95, v_num=0]
Epoch 97:  54%|█████▎    | 52/97 [00:08<00:07,  5.95it/s, loss=1.95, v_num=0]
Epoch 97:  55%|█████▍    | 53/97 [00:08<00:07,  6.01it/s, loss=1.95, v_num=0]
Epoch 97:  55%|█████▍    | 53/97 [00:08<00:07,  5.97it/s, loss=1.95, v_num=0]
Epoch 97:  56%|█████▌    | 54/97 [00:08<00:07,  6.03it/s, loss=1.95, v_num=0]
Epoch 97:  56%|█████▌    | 54/97 [00:09<00:07,  5.99it/s, loss=1.95, v_num=0]
Epoch 97:  57%|█████▋    | 55/97 [00:09<00:06,  6.05it/s, loss=1.95, v_num=0]
Epoch 97:  57%|█████▋    | 55/97 [00:09<00:06,  6.01it/s, loss=1.95, v_num=0]
Epoch 97:  58%|█████▊    | 56/97 [00:09<00:06,  6.07it/s, loss=1.95, v_num=0]
Epoch 97:  58%|█████▊    | 56/97 [00:09<00:06,  6.03it/s, loss=1.94, v_num=0]
Epoch 97:  59%|█████▉    | 57/97 [00:09<00:06,  6.08it/s, loss=1.94, v_num=0]
Epoch 97:  59%|█████▉    | 57/97 [00:09<00:06,  6.04it/s, loss=1.95, v_num=0]
Epoch 97:  60%|█████▉    | 58/97 [00:09<00:06,  6.10it/s, loss=1.95, v_num=0]
Epoch 97:  60%|█████▉    | 58/97 [00:09<00:06,  6.06it/s, loss=1.95, v_num=0]
Epoch 97:  61%|██████    | 59/97 [00:09<00:06,  6.11it/s, loss=1.95, v_num=0]
Epoch 97:  61%|██████    | 59/97 [00:09<00:06,  6.07it/s, loss=1.95, v_num=0]
Epoch 97:  62%|██████▏   | 60/97 [00:09<00:06,  6.12it/s, loss=1.95, v_num=0]
Epoch 97:  62%|██████▏   | 60/97 [00:09<00:06,  6.09it/s, loss=1.95, v_num=0]
Epoch 97:  63%|██████▎   | 61/97 [00:09<00:05,  6.13it/s, loss=1.95, v_num=0]
Epoch 97:  63%|██████▎   | 61/97 [00:10<00:05,  6.10it/s, loss=1.96, v_num=0]
Epoch 97:  64%|██████▍   | 62/97 [00:10<00:05,  6.14it/s, loss=1.96, v_num=0]
Epoch 97:  64%|██████▍   | 62/97 [00:10<00:05,  6.11it/s, loss=1.96, v_num=0]
Epoch 97:  65%|██████▍   | 63/97 [00:10<00:05,  6.16it/s, loss=1.96, v_num=0]
Epoch 97:  65%|██████▍   | 63/97 [00:10<00:05,  6.12it/s, loss=1.96, v_num=0]
Epoch 97:  66%|██████▌   | 64/97 [00:10<00:05,  6.16it/s, loss=1.96, v_num=0]
Epoch 97:  66%|██████▌   | 64/97 [00:10<00:05,  6.13it/s, loss=1.95, v_num=0]
Epoch 97:  67%|██████▋   | 65/97 [00:10<00:05,  6.17it/s, loss=1.95, v_num=0]
Epoch 97:  67%|██████▋   | 65/97 [00:10<00:05,  6.14it/s, loss=1.96, v_num=0]
Epoch 97:  68%|██████▊   | 66/97 [00:10<00:05,  6.19it/s, loss=1.96, v_num=0]
Epoch 97:  68%|██████▊   | 66/97 [00:10<00:05,  6.15it/s, loss=1.95, v_num=0]
Epoch 97:  69%|██████▉   | 67/97 [00:10<00:04,  6.20it/s, loss=1.95, v_num=0]
Epoch 97:  69%|██████▉   | 67/97 [00:10<00:04,  6.17it/s, loss=1.95, v_num=0]
Epoch 97:  70%|███████   | 68/97 [00:10<00:04,  6.21it/s, loss=1.95, v_num=0]
Epoch 97:  70%|███████   | 68/97 [00:11<00:04,  6.18it/s, loss=1.95, v_num=0]
Epoch 97:  71%|███████   | 69/97 [00:11<00:04,  6.22it/s, loss=1.95, v_num=0]
Epoch 97:  71%|███████   | 69/97 [00:11<00:04,  6.19it/s, loss=1.94, v_num=0]
Epoch 97:  72%|███████▏  | 70/97 [00:11<00:04,  6.23it/s, loss=1.94, v_num=0]
Epoch 97:  72%|███████▏  | 70/97 [00:11<00:04,  6.20it/s, loss=1.94, v_num=0]
Epoch 97:  73%|███████▎  | 71/97 [00:11<00:04,  6.23it/s, loss=1.94, v_num=0]
Epoch 97:  73%|███████▎  | 71/97 [00:11<00:04,  6.20it/s, loss=1.94, v_num=0]
Epoch 97:  74%|███████▍  | 72/97 [00:11<00:04,  6.24it/s, loss=1.94, v_num=0]
Epoch 97:  74%|███████▍  | 72/97 [00:11<00:04,  6.21it/s, loss=1.94, v_num=0]
Epoch 97:  75%|███████▌  | 73/97 [00:11<00:03,  6.25it/s, loss=1.94, v_num=0]
Epoch 97:  75%|███████▌  | 73/97 [00:11<00:03,  6.22it/s, loss=1.93, v_num=0]
Epoch 97:  76%|███████▋  | 74/97 [00:11<00:03,  6.26it/s, loss=1.93, v_num=0]
Epoch 97:  76%|███████▋  | 74/97 [00:11<00:03,  6.23it/s, loss=1.94, v_num=0]
Epoch 97:  77%|███████▋  | 75/97 [00:11<00:03,  6.28it/s, loss=1.94, v_num=0]
Epoch 97:  77%|███████▋  | 75/97 [00:12<00:03,  6.24it/s, loss=1.93, v_num=0]
Epoch 97:  78%|███████▊  | 76/97 [00:12<00:03,  6.29it/s, loss=1.93, v_num=0]
Epoch 97:  78%|███████▊  | 76/97 [00:12<00:03,  6.26it/s, loss=1.94, v_num=0]
Epoch 97:  79%|███████▉  | 77/97 [00:12<00:03,  6.30it/s, loss=1.94, v_num=0]
Epoch 97:  79%|███████▉  | 77/97 [00:12<00:03,  6.27it/s, loss=1.94, v_num=0]
Epoch 97:  80%|████████  | 78/97 [00:12<00:03,  6.31it/s, loss=1.94, v_num=0]
Epoch 97:  80%|████████  | 78/97 [00:12<00:03,  6.28it/s, loss=1.94, v_num=0]
Epoch 97:  81%|████████▏ | 79/97 [00:12<00:02,  6.31it/s, loss=1.94, v_num=0]
Epoch 97:  81%|████████▏ | 79/97 [00:12<00:02,  6.29it/s, loss=1.94, v_num=0]
Epoch 97:  82%|████████▏ | 80/97 [00:12<00:02,  6.32it/s, loss=1.94, v_num=0]
Epoch 97:  82%|████████▏ | 80/97 [00:12<00:02,  6.30it/s, loss=1.95, v_num=0]
Epoch 97:  84%|████████▎ | 81/97 [00:12<00:02,  6.33it/s, loss=1.95, v_num=0]
Epoch 97:  84%|████████▎ | 81/97 [00:12<00:02,  6.30it/s, loss=1.94, v_num=0]
Epoch 97:  85%|████████▍ | 82/97 [00:12<00:02,  6.34it/s, loss=1.94, v_num=0]
Epoch 97:  85%|████████▍ | 82/97 [00:12<00:02,  6.31it/s, loss=1.94, v_num=0]
Epoch 97:  86%|████████▌ | 83/97 [00:13<00:02,  6.35it/s, loss=1.94, v_num=0]
Epoch 97:  86%|████████▌ | 83/97 [00:13<00:02,  6.32it/s, loss=1.94, v_num=0]
Epoch 97:  87%|████████▋ | 84/97 [00:13<00:02,  6.35it/s, loss=1.94, v_num=0]
Epoch 97:  87%|████████▋ | 84/97 [00:13<00:02,  6.33it/s, loss=1.94, v_num=0]
Epoch 97:  88%|████████▊ | 85/97 [00:13<00:01,  6.36it/s, loss=1.94, v_num=0]
Epoch 97:  88%|████████▊ | 85/97 [00:13<00:01,  6.34it/s, loss=1.94, v_num=0]
Epoch 97:  89%|████████▊ | 86/97 [00:13<00:01,  6.37it/s, loss=1.94, v_num=0]
Epoch 97:  89%|████████▊ | 86/97 [00:13<00:01,  6.34it/s, loss=1.95, v_num=0]
Epoch 97:  90%|████████▉ | 87/97 [00:13<00:01,  6.38it/s, loss=1.95, v_num=0]
Epoch 97:  90%|████████▉ | 87/97 [00:13<00:01,  6.35it/s, loss=1.96, v_num=0]
Epoch 97:  91%|█████████ | 88/97 [00:13<00:01,  6.39it/s, loss=1.96, v_num=0]
Epoch 97:  91%|█████████ | 88/97 [00:13<00:01,  6.36it/s, loss=1.96, v_num=0]
Epoch 97:  92%|█████████▏| 89/97 [00:13<00:01,  6.40it/s, loss=1.96, v_num=0]
Epoch 97:  92%|█████████▏| 89/97 [00:13<00:01,  6.37it/s, loss=1.96, v_num=0]
Epoch 97:  93%|█████████▎| 90/97 [00:14<00:01,  6.41it/s, loss=1.96, v_num=0]
Epoch 97:  93%|█████████▎| 90/97 [00:14<00:01,  6.38it/s, loss=1.96, v_num=0]
Epoch 97:  94%|█████████▍| 91/97 [00:14<00:00,  6.41it/s, loss=1.96, v_num=0]
Epoch 97:  94%|█████████▍| 91/97 [00:14<00:00,  6.39it/s, loss=1.96, v_num=0]
Epoch 97:  95%|█████████▍| 92/97 [00:14<00:00,  6.42it/s, loss=1.96, v_num=0]
Epoch 97:  95%|█████████▍| 92/97 [00:14<00:00,  6.39it/s, loss=1.96, v_num=0]
Epoch 97:  96%|█████████▌| 93/97 [00:14<00:00,  6.43it/s, loss=1.96, v_num=0]
Epoch 97:  96%|█████████▌| 93/97 [00:14<00:00,  6.40it/s, loss=1.95, v_num=0]
Epoch 97:  97%|█████████▋| 94/97 [00:14<00:00,  6.44it/s, loss=1.95, v_num=0]
Epoch 97:  97%|█████████▋| 94/97 [00:14<00:00,  6.41it/s, loss=1.95, v_num=0]
Epoch 97:  98%|█████████▊| 95/97 [00:14<00:00,  6.44it/s, loss=1.95, v_num=0]
Epoch 97:  98%|█████████▊| 95/97 [00:14<00:00,  6.42it/s, loss=1.95, v_num=0]
Epoch 97:  99%|█████████▉| 96/97 [00:14<00:00,  6.45it/s, loss=1.95, v_num=0]
Epoch 97:  99%|█████████▉| 96/97 [00:14<00:00,  6.43it/s, loss=1.95, v_num=0]
Epoch 97: 100%|██████████| 97/97 [00:15<00:00,  6.46it/s, loss=1.95, v_num=0]
Epoch 97: 100%|██████████| 97/97 [00:15<00:00,  6.43it/s, loss=1.95, v_num=0]
Epoch 97: 100%|██████████| 97/97 [00:15<00:00,  6.43it/s, loss=1.95, v_num=0]
Epoch 97:   0%|          | 0/97 [00:00<?, ?it/s, loss=1.95, v_num=0]
Epoch 98:   0%|          | 0/97 [00:00<?, ?it/s, loss=1.95, v_num=0]
Epoch 98:   1%|          | 1/97 [00:01<02:38,  1.65s/it, loss=1.95, v_num=0]
Epoch 98:   1%|          | 1/97 [00:01<02:43,  1.70s/it, loss=1.94, v_num=0]
Epoch 98:   2%|▏         | 2/97 [00:01<01:24,  1.12it/s, loss=1.94, v_num=0]
Epoch 98:   2%|▏         | 2/97 [00:01<01:27,  1.08it/s, loss=1.94, v_num=0]
Epoch 98:   3%|▎         | 3/97 [00:01<01:00,  1.56it/s, loss=1.94, v_num=0]
Epoch 98:   3%|▎         | 3/97 [00:01<01:02,  1.51it/s, loss=1.94, v_num=0]
Epoch 98:   4%|▍         | 4/97 [00:02<00:48,  1.93it/s, loss=1.94, v_num=0]
Epoch 98:   4%|▍         | 4/97 [00:02<00:49,  1.88it/s, loss=1.94, v_num=0]
Epoch 98:   5%|▌         | 5/97 [00:02<00:40,  2.26it/s, loss=1.94, v_num=0]
Epoch 98:   5%|▌         | 5/97 [00:02<00:41,  2.20it/s, loss=1.94, v_num=0]
Epoch 98:   6%|▌         | 6/97 [00:02<00:36,  2.52it/s, loss=1.94, v_num=0]
Epoch 98:   6%|▌         | 6/97 [00:02<00:37,  2.46it/s, loss=1.93, v_num=0]
Epoch 98:   7%|▋         | 7/97 [00:02<00:32,  2.76it/s, loss=1.93, v_num=0]
Epoch 98:   7%|▋         | 7/97 [00:02<00:33,  2.71it/s, loss=1.93, v_num=0]
Epoch 98:   8%|▊         | 8/97 [00:02<00:29,  3.00it/s, loss=1.93, v_num=0]
Epoch 98:   8%|▊         | 8/97 [00:02<00:30,  2.94it/s, loss=1.94, v_num=0]
Epoch 98:   9%|▉         | 9/97 [00:02<00:27,  3.21it/s, loss=1.94, v_num=0]
Epoch 98:   9%|▉         | 9/97 [00:02<00:28,  3.14it/s, loss=1.94, v_num=0]
Epoch 98:  10%|█         | 10/97 [00:02<00:25,  3.39it/s, loss=1.94, v_num=0]
Epoch 98:  10%|█         | 10/97 [00:03<00:26,  3.33it/s, loss=1.93, v_num=0]
Epoch 98:  11%|█▏        | 11/97 [00:03<00:24,  3.56it/s, loss=1.93, v_num=0]
Epoch 98:  11%|█▏        | 11/97 [00:03<00:24,  3.50it/s, loss=1.94, v_num=0]
Epoch 98:  12%|█▏        | 12/97 [00:03<00:22,  3.72it/s, loss=1.94, v_num=0]
Epoch 98:  12%|█▏        | 12/97 [00:03<00:23,  3.66it/s, loss=1.95, v_num=0]
Epoch 98:  13%|█▎        | 13/97 [00:03<00:21,  3.86it/s, loss=1.95, v_num=0]
Epoch 98:  13%|█▎        | 13/97 [00:03<00:22,  3.80it/s, loss=1.95, v_num=0]
Epoch 98:  14%|█▍        | 14/97 [00:03<00:20,  4.00it/s, loss=1.95, v_num=0]
Epoch 98:  14%|█▍        | 14/97 [00:03<00:21,  3.94it/s, loss=1.95, v_num=0]
Epoch 98:  15%|█▌        | 15/97 [00:03<00:19,  4.12it/s, loss=1.95, v_num=0]
Epoch 98:  15%|█▌        | 15/97 [00:03<00:20,  4.06it/s, loss=1.95, v_num=0]
Epoch 98:  16%|█▋        | 16/97 [00:03<00:19,  4.24it/s, loss=1.95, v_num=0]
Epoch 98:  16%|█▋        | 16/97 [00:03<00:19,  4.18it/s, loss=1.95, v_num=0]
Epoch 98:  18%|█▊        | 17/97 [00:03<00:18,  4.35it/s, loss=1.95, v_num=0]
Epoch 98:  18%|█▊        | 17/97 [00:03<00:18,  4.29it/s, loss=1.94, v_num=0]
Epoch 98:  19%|█▊        | 18/97 [00:04<00:17,  4.45it/s, loss=1.94, v_num=0]
Epoch 98:  19%|█▊        | 18/97 [00:04<00:18,  4.39it/s, loss=1.94, v_num=0]
Epoch 98:  20%|█▉        | 19/97 [00:04<00:17,  4.54it/s, loss=1.94, v_num=0]
Epoch 98:  20%|█▉        | 19/97 [00:04<00:17,  4.48it/s, loss=1.95, v_num=0]
Epoch 98:  21%|██        | 20/97 [00:04<00:16,  4.63it/s, loss=1.95, v_num=0]
Epoch 98:  21%|██        | 20/97 [00:04<00:16,  4.57it/s, loss=1.94, v_num=0]
Epoch 98:  22%|██▏       | 21/97 [00:04<00:16,  4.71it/s, loss=1.94, v_num=0]
Epoch 98:  22%|██▏       | 21/97 [00:04<00:16,  4.65it/s, loss=1.95, v_num=0]
Epoch 98:  23%|██▎       | 22/97 [00:04<00:15,  4.78it/s, loss=1.95, v_num=0]
Epoch 98:  23%|██▎       | 22/97 [00:04<00:15,  4.72it/s, loss=1.95, v_num=0]
Epoch 98:  24%|██▎       | 23/97 [00:04<00:15,  4.86it/s, loss=1.95, v_num=0]
Epoch 98:  24%|██▎       | 23/97 [00:04<00:15,  4.80it/s, loss=1.95, v_num=0]
Epoch 98:  25%|██▍       | 24/97 [00:04<00:14,  4.92it/s, loss=1.95, v_num=0]
Epoch 98:  25%|██▍       | 24/97 [00:04<00:15,  4.87it/s, loss=1.95, v_num=0]
Epoch 98:  26%|██▌       | 25/97 [00:05<00:14,  4.98it/s, loss=1.95, v_num=0]
Epoch 98:  26%|██▌       | 25/97 [00:05<00:14,  4.93it/s, loss=1.95, v_num=0]
Epoch 98:  27%|██▋       | 26/97 [00:05<00:14,  5.04it/s, loss=1.95, v_num=0]
Epoch 98:  27%|██▋       | 26/97 [00:05<00:14,  4.99it/s, loss=1.95, v_num=0]
Epoch 98:  28%|██▊       | 27/97 [00:05<00:13,  5.10it/s, loss=1.95, v_num=0]
Epoch 98:  28%|██▊       | 27/97 [00:05<00:13,  5.04it/s, loss=1.95, v_num=0]
Epoch 98:  29%|██▉       | 28/97 [00:05<00:13,  5.15it/s, loss=1.95, v_num=0]
Epoch 98:  29%|██▉       | 28/97 [00:05<00:13,  5.10it/s, loss=1.96, v_num=0]
Epoch 98:  30%|██▉       | 29/97 [00:05<00:13,  5.20it/s, loss=1.96, v_num=0]
Epoch 98:  30%|██▉       | 29/97 [00:05<00:13,  5.15it/s, loss=1.96, v_num=0]
Epoch 98:  31%|███       | 30/97 [00:05<00:12,  5.25it/s, loss=1.96, v_num=0]
Epoch 98:  31%|███       | 30/97 [00:05<00:12,  5.20it/s, loss=1.95, v_num=0]
Epoch 98:  32%|███▏      | 31/97 [00:05<00:12,  5.30it/s, loss=1.95, v_num=0]
Epoch 98:  32%|███▏      | 31/97 [00:05<00:12,  5.25it/s, loss=1.95, v_num=0]
Epoch 98:  33%|███▎      | 32/97 [00:05<00:12,  5.34it/s, loss=1.95, v_num=0]
Epoch 98:  33%|███▎      | 32/97 [00:06<00:12,  5.29it/s, loss=1.94, v_num=0]
Epoch 98:  34%|███▍      | 33/97 [00:06<00:11,  5.38it/s, loss=1.94, v_num=0]
Epoch 98:  34%|███▍      | 33/97 [00:06<00:11,  5.33it/s, loss=1.94, v_num=0]
Epoch 98:  35%|███▌      | 34/97 [00:06<00:11,  5.42it/s, loss=1.94, v_num=0]
Epoch 98:  35%|███▌      | 34/97 [00:06<00:11,  5.37it/s, loss=1.94, v_num=0]
Epoch 98:  36%|███▌      | 35/97 [00:06<00:11,  5.45it/s, loss=1.94, v_num=0]
Epoch 98:  36%|███▌      | 35/97 [00:06<00:11,  5.41it/s, loss=1.94, v_num=0]
Epoch 98:  37%|███▋      | 36/97 [00:06<00:11,  5.49it/s, loss=1.94, v_num=0]
Epoch 98:  37%|███▋      | 36/97 [00:06<00:11,  5.45it/s, loss=1.94, v_num=0]
Epoch 98:  38%|███▊      | 37/97 [00:06<00:10,  5.53it/s, loss=1.94, v_num=0]
Epoch 98:  38%|███▊      | 37/97 [00:06<00:10,  5.48it/s, loss=1.94, v_num=0]
Epoch 98:  39%|███▉      | 38/97 [00:06<00:10,  5.56it/s, loss=1.94, v_num=0]
Epoch 98:  39%|███▉      | 38/97 [00:06<00:10,  5.52it/s, loss=1.94, v_num=0]
Epoch 98:  40%|████      | 39/97 [00:06<00:10,  5.60it/s, loss=1.94, v_num=0]
Epoch 98:  40%|████      | 39/97 [00:07<00:10,  5.55it/s, loss=1.95, v_num=0]
Epoch 98:  41%|████      | 40/97 [00:07<00:10,  5.62it/s, loss=1.95, v_num=0]
Epoch 98:  41%|████      | 40/97 [00:07<00:10,  5.58it/s, loss=1.96, v_num=0]
Epoch 98:  42%|████▏     | 41/97 [00:07<00:09,  5.65it/s, loss=1.96, v_num=0]
Epoch 98:  42%|████▏     | 41/97 [00:07<00:09,  5.61it/s, loss=1.95, v_num=0]
Epoch 98:  43%|████▎     | 42/97 [00:07<00:09,  5.68it/s, loss=1.95, v_num=0]
Epoch 98:  43%|████▎     | 42/97 [00:07<00:09,  5.64it/s, loss=1.96, v_num=0]
Epoch 98:  44%|████▍     | 43/97 [00:07<00:09,  5.71it/s, loss=1.96, v_num=0]
Epoch 98:  44%|████▍     | 43/97 [00:07<00:09,  5.66it/s, loss=1.96, v_num=0]
Epoch 98:  45%|████▌     | 44/97 [00:07<00:09,  5.73it/s, loss=1.96, v_num=0]
Epoch 98:  45%|████▌     | 44/97 [00:07<00:09,  5.69it/s, loss=1.96, v_num=0]
Epoch 98:  46%|████▋     | 45/97 [00:07<00:09,  5.75it/s, loss=1.96, v_num=0]
Epoch 98:  46%|████▋     | 45/97 [00:07<00:09,  5.71it/s, loss=1.96, v_num=0]
Epoch 98:  47%|████▋     | 46/97 [00:07<00:08,  5.77it/s, loss=1.96, v_num=0]
Epoch 98:  47%|████▋     | 46/97 [00:08<00:08,  5.73it/s, loss=1.97, v_num=0]
Epoch 98:  48%|████▊     | 47/97 [00:08<00:08,  5.80it/s, loss=1.97, v_num=0]
Epoch 98:  48%|████▊     | 47/97 [00:08<00:08,  5.75it/s, loss=1.97, v_num=0]
Epoch 98:  49%|████▉     | 48/97 [00:08<00:08,  5.82it/s, loss=1.97, v_num=0]
Epoch 98:  49%|████▉     | 48/97 [00:08<00:08,  5.78it/s, loss=1.97, v_num=0]
Epoch 98:  51%|█████     | 49/97 [00:08<00:08,  5.84it/s, loss=1.97, v_num=0]
Epoch 98:  51%|█████     | 49/97 [00:08<00:08,  5.80it/s, loss=1.97, v_num=0]
Epoch 98:  52%|█████▏    | 50/97 [00:08<00:08,  5.86it/s, loss=1.97, v_num=0]
Epoch 98:  52%|█████▏    | 50/97 [00:08<00:08,  5.82it/s, loss=1.97, v_num=0]
Epoch 98:  53%|█████▎    | 51/97 [00:08<00:07,  5.88it/s, loss=1.97, v_num=0]
Epoch 98:  53%|█████▎    | 51/97 [00:08<00:07,  5.85it/s, loss=1.97, v_num=0]
Epoch 98:  54%|█████▎    | 52/97 [00:08<00:07,  5.91it/s, loss=1.97, v_num=0]
Epoch 98:  54%|█████▎    | 52/97 [00:08<00:07,  5.87it/s, loss=1.97, v_num=0]
Epoch 98:  55%|█████▍    | 53/97 [00:08<00:07,  5.92it/s, loss=1.97, v_num=0]
Epoch 98:  55%|█████▍    | 53/97 [00:09<00:07,  5.89it/s, loss=1.97, v_num=0]
Epoch 98:  56%|█████▌    | 54/97 [00:09<00:07,  5.94it/s, loss=1.97, v_num=0]
Epoch 98:  56%|█████▌    | 54/97 [00:09<00:07,  5.90it/s, loss=1.96, v_num=0]
Epoch 98:  57%|█████▋    | 55/97 [00:09<00:07,  5.96it/s, loss=1.96, v_num=0]
Epoch 98:  57%|█████▋    | 55/97 [00:09<00:07,  5.92it/s, loss=1.97, v_num=0]
Epoch 98:  58%|█████▊    | 56/97 [00:09<00:06,  5.98it/s, loss=1.97, v_num=0]
Epoch 98:  58%|█████▊    | 56/97 [00:09<00:06,  5.94it/s, loss=1.97, v_num=0]
Epoch 98:  59%|█████▉    | 57/97 [00:09<00:06,  6.00it/s, loss=1.97, v_num=0]
Epoch 98:  59%|█████▉    | 57/97 [00:09<00:06,  5.96it/s, loss=1.97, v_num=0]
Epoch 98:  60%|█████▉    | 58/97 [00:09<00:06,  6.01it/s, loss=1.97, v_num=0]
Epoch 98:  60%|█████▉    | 58/97 [00:09<00:06,  5.98it/s, loss=1.97, v_num=0]
Epoch 98:  61%|██████    | 59/97 [00:09<00:06,  6.02it/s, loss=1.97, v_num=0]
Epoch 98:  61%|██████    | 59/97 [00:09<00:06,  5.99it/s, loss=1.96, v_num=0]
Epoch 98:  62%|██████▏   | 60/97 [00:09<00:06,  6.04it/s, loss=1.96, v_num=0]
Epoch 98:  62%|██████▏   | 60/97 [00:09<00:06,  6.01it/s, loss=1.96, v_num=0]
Epoch 98:  63%|██████▎   | 61/97 [00:10<00:05,  6.05it/s, loss=1.96, v_num=0]
Epoch 98:  63%|██████▎   | 61/97 [00:10<00:05,  6.02it/s, loss=1.95, v_num=0]
Epoch 98:  64%|██████▍   | 62/97 [00:10<00:05,  6.07it/s, loss=1.95, v_num=0]
Epoch 98:  64%|██████▍   | 62/97 [00:10<00:05,  6.03it/s, loss=1.96, v_num=0]
Epoch 98:  65%|██████▍   | 63/97 [00:10<00:05,  6.09it/s, loss=1.96, v_num=0]
Epoch 98:  65%|██████▍   | 63/97 [00:10<00:05,  6.05it/s, loss=1.96, v_num=0]
Epoch 98:  66%|██████▌   | 64/97 [00:10<00:05,  6.10it/s, loss=1.96, v_num=0]
Epoch 98:  66%|██████▌   | 64/97 [00:10<00:05,  6.07it/s, loss=1.96, v_num=0]
Epoch 98:  67%|██████▋   | 65/97 [00:10<00:05,  6.11it/s, loss=1.96, v_num=0]
Epoch 98:  67%|██████▋   | 65/97 [00:10<00:05,  6.08it/s, loss=1.95, v_num=0]
Epoch 98:  68%|██████▊   | 66/97 [00:10<00:05,  6.13it/s, loss=1.95, v_num=0]
Epoch 98:  68%|██████▊   | 66/97 [00:10<00:05,  6.10it/s, loss=1.95, v_num=0]
Epoch 98:  69%|██████▉   | 67/97 [00:10<00:04,  6.14it/s, loss=1.95, v_num=0]
Epoch 98:  69%|██████▉   | 67/97 [00:10<00:04,  6.11it/s, loss=1.95, v_num=0]
Epoch 98:  70%|███████   | 68/97 [00:11<00:04,  6.16it/s, loss=1.95, v_num=0]
Epoch 98:  70%|███████   | 68/97 [00:11<00:04,  6.13it/s, loss=1.95, v_num=0]
Epoch 98:  71%|███████   | 69/97 [00:11<00:04,  6.17it/s, loss=1.95, v_num=0]
Epoch 98:  71%|███████   | 69/97 [00:11<00:04,  6.14it/s, loss=1.94, v_num=0]
Epoch 98:  72%|███████▏  | 70/97 [00:11<00:04,  6.18it/s, loss=1.94, v_num=0]
Epoch 98:  72%|███████▏  | 70/97 [00:11<00:04,  6.15it/s, loss=1.94, v_num=0]
Epoch 98:  73%|███████▎  | 71/97 [00:11<00:04,  6.19it/s, loss=1.94, v_num=0]
Epoch 98:  73%|███████▎  | 71/97 [00:11<00:04,  6.16it/s, loss=1.94, v_num=0]
Epoch 98:  74%|███████▍  | 72/97 [00:11<00:04,  6.21it/s, loss=1.94, v_num=0]
Epoch 98:  74%|███████▍  | 72/97 [00:11<00:04,  6.18it/s, loss=1.94, v_num=0]
Epoch 98:  75%|███████▌  | 73/97 [00:11<00:03,  6.22it/s, loss=1.94, v_num=0]
Epoch 98:  75%|███████▌  | 73/97 [00:11<00:03,  6.19it/s, loss=1.94, v_num=0]
Epoch 98:  76%|███████▋  | 74/97 [00:11<00:03,  6.23it/s, loss=1.94, v_num=0]
Epoch 98:  76%|███████▋  | 74/97 [00:11<00:03,  6.20it/s, loss=1.94, v_num=0]
Epoch 98:  77%|███████▋  | 75/97 [00:12<00:03,  6.24it/s, loss=1.94, v_num=0]
Epoch 98:  77%|███████▋  | 75/97 [00:12<00:03,  6.21it/s, loss=1.94, v_num=0]
Epoch 98:  78%|███████▊  | 76/97 [00:12<00:03,  6.25it/s, loss=1.94, v_num=0]
Epoch 98:  78%|███████▊  | 76/97 [00:12<00:03,  6.22it/s, loss=1.93, v_num=0]
Epoch 98:  79%|███████▉  | 77/97 [00:12<00:03,  6.26it/s, loss=1.93, v_num=0]
Epoch 98:  79%|███████▉  | 77/97 [00:12<00:03,  6.24it/s, loss=1.93, v_num=0]
Epoch 98:  80%|████████  | 78/97 [00:12<00:03,  6.27it/s, loss=1.93, v_num=0]
Epoch 98:  80%|████████  | 78/97 [00:12<00:03,  6.25it/s, loss=1.93, v_num=0]
Epoch 98:  81%|████████▏ | 79/97 [00:12<00:02,  6.29it/s, loss=1.93, v_num=0]
Epoch 98:  81%|████████▏ | 79/97 [00:12<00:02,  6.26it/s, loss=1.94, v_num=0]
Epoch 98:  82%|████████▏ | 80/97 [00:12<00:02,  6.29it/s, loss=1.94, v_num=0]
Epoch 98:  82%|████████▏ | 80/97 [00:12<00:02,  6.27it/s, loss=1.94, v_num=0]
Epoch 98:  84%|████████▎ | 81/97 [00:12<00:02,  6.30it/s, loss=1.94, v_num=0]
Epoch 98:  84%|████████▎ | 81/97 [00:12<00:02,  6.28it/s, loss=1.95, v_num=0]
Epoch 98:  85%|████████▍ | 82/97 [00:12<00:02,  6.31it/s, loss=1.95, v_num=0]
Epoch 98:  85%|████████▍ | 82/97 [00:13<00:02,  6.29it/s, loss=1.95, v_num=0]
Epoch 98:  86%|████████▌ | 83/97 [00:13<00:02,  6.33it/s, loss=1.95, v_num=0]
Epoch 98:  86%|████████▌ | 83/97 [00:13<00:02,  6.30it/s, loss=1.94, v_num=0]
Epoch 98:  87%|████████▋ | 84/97 [00:13<00:02,  6.33it/s, loss=1.94, v_num=0]
Epoch 98:  87%|████████▋ | 84/97 [00:13<00:02,  6.31it/s, loss=1.95, v_num=0]
Epoch 98:  88%|████████▊ | 85/97 [00:13<00:01,  6.34it/s, loss=1.95, v_num=0]
Epoch 98:  88%|████████▊ | 85/97 [00:13<00:01,  6.32it/s, loss=1.94, v_num=0]
Epoch 98:  89%|████████▊ | 86/97 [00:13<00:01,  6.35it/s, loss=1.94, v_num=0]
Epoch 98:  89%|████████▊ | 86/97 [00:13<00:01,  6.33it/s, loss=1.94, v_num=0]
Epoch 98:  90%|████████▉ | 87/97 [00:13<00:01,  6.36it/s, loss=1.94, v_num=0]
Epoch 98:  90%|████████▉ | 87/97 [00:13<00:01,  6.34it/s, loss=1.94, v_num=0]
Epoch 98:  91%|█████████ | 88/97 [00:13<00:01,  6.37it/s, loss=1.94, v_num=0]
Epoch 98:  91%|█████████ | 88/97 [00:13<00:01,  6.35it/s, loss=1.94, v_num=0]
Epoch 98:  92%|█████████▏| 89/97 [00:13<00:01,  6.38it/s, loss=1.94, v_num=0]
Epoch 98:  92%|█████████▏| 89/97 [00:14<00:01,  6.36it/s, loss=1.94, v_num=0]
Epoch 98:  93%|█████████▎| 90/97 [00:14<00:01,  6.39it/s, loss=1.94, v_num=0]
Epoch 98:  93%|█████████▎| 90/97 [00:14<00:01,  6.36it/s, loss=1.94, v_num=0]
Epoch 98:  94%|█████████▍| 91/97 [00:14<00:00,  6.40it/s, loss=1.94, v_num=0]
Epoch 98:  94%|█████████▍| 91/97 [00:14<00:00,  6.37it/s, loss=1.93, v_num=0]
Epoch 98:  95%|█████████▍| 92/97 [00:14<00:00,  6.41it/s, loss=1.93, v_num=0]
Epoch 98:  95%|█████████▍| 92/97 [00:14<00:00,  6.38it/s, loss=1.93, v_num=0]
Epoch 98:  96%|█████████▌| 93/97 [00:14<00:00,  6.41it/s, loss=1.93, v_num=0]
Epoch 98:  96%|█████████▌| 93/97 [00:14<00:00,  6.39it/s, loss=1.94, v_num=0]
Epoch 98:  97%|█████████▋| 94/97 [00:14<00:00,  6.42it/s, loss=1.94, v_num=0]
Epoch 98:  97%|█████████▋| 94/97 [00:14<00:00,  6.40it/s, loss=1.94, v_num=0]
Epoch 98:  98%|█████████▊| 95/97 [00:14<00:00,  6.43it/s, loss=1.94, v_num=0]
Epoch 98:  98%|█████████▊| 95/97 [00:14<00:00,  6.40it/s, loss=1.94, v_num=0]
Epoch 98:  99%|█████████▉| 96/97 [00:14<00:00,  6.44it/s, loss=1.94, v_num=0]
Epoch 98:  99%|█████████▉| 96/97 [00:14<00:00,  6.41it/s, loss=1.94, v_num=0]
Epoch 98: 100%|██████████| 97/97 [00:15<00:00,  6.44it/s, loss=1.94, v_num=0]
Epoch 98: 100%|██████████| 97/97 [00:15<00:00,  6.42it/s, loss=1.94, v_num=0]
Epoch 98: 100%|██████████| 97/97 [00:15<00:00,  6.42it/s, loss=1.94, v_num=0]
Epoch 98:   0%|          | 0/97 [00:00<?, ?it/s, loss=1.94, v_num=0]
Epoch 99:   0%|          | 0/97 [00:00<?, ?it/s, loss=1.94, v_num=0]
Epoch 99:   1%|          | 1/97 [00:01<02:28,  1.54s/it, loss=1.94, v_num=0]
Epoch 99:   1%|          | 1/97 [00:01<02:33,  1.60s/it, loss=1.94, v_num=0]
Epoch 99:   2%|▏         | 2/97 [00:01<01:19,  1.19it/s, loss=1.94, v_num=0]
Epoch 99:   2%|▏         | 2/97 [00:01<01:22,  1.15it/s, loss=1.94, v_num=0]
Epoch 99:   3%|▎         | 3/97 [00:01<00:58,  1.62it/s, loss=1.94, v_num=0]
Epoch 99:   3%|▎         | 3/97 [00:01<00:59,  1.57it/s, loss=1.93, v_num=0]
Epoch 99:   4%|▍         | 4/97 [00:02<00:47,  1.95it/s, loss=1.93, v_num=0]
Epoch 99:   4%|▍         | 4/97 [00:02<00:48,  1.91it/s, loss=1.93, v_num=0]
Epoch 99:   5%|▌         | 5/97 [00:02<00:40,  2.28it/s, loss=1.93, v_num=0]
Epoch 99:   5%|▌         | 5/97 [00:02<00:41,  2.23it/s, loss=1.93, v_num=0]
Epoch 99:   6%|▌         | 6/97 [00:02<00:35,  2.57it/s, loss=1.93, v_num=0]
Epoch 99:   6%|▌         | 6/97 [00:02<00:36,  2.51it/s, loss=1.93, v_num=0]
Epoch 99:   7%|▋         | 7/97 [00:02<00:31,  2.84it/s, loss=1.93, v_num=0]
Epoch 99:   7%|▋         | 7/97 [00:02<00:32,  2.77it/s, loss=1.92, v_num=0]
Epoch 99:   8%|▊         | 8/97 [00:02<00:29,  3.07it/s, loss=1.92, v_num=0]
Epoch 99:   8%|▊         | 8/97 [00:02<00:29,  3.00it/s, loss=1.93, v_num=0]
Epoch 99:   9%|▉         | 9/97 [00:02<00:26,  3.27it/s, loss=1.93, v_num=0]
Epoch 99:   9%|▉         | 9/97 [00:02<00:27,  3.21it/s, loss=1.93, v_num=0]
Epoch 99:  10%|█         | 10/97 [00:02<00:25,  3.46it/s, loss=1.93, v_num=0]
Epoch 99:  10%|█         | 10/97 [00:02<00:25,  3.40it/s, loss=1.94, v_num=0]
Epoch 99:  11%|█▏        | 11/97 [00:03<00:23,  3.63it/s, loss=1.94, v_num=0]
Epoch 99:  11%|█▏        | 11/97 [00:03<00:24,  3.57it/s, loss=1.93, v_num=0]
Epoch 99:  12%|█▏        | 12/97 [00:03<00:22,  3.79it/s, loss=1.93, v_num=0]
Epoch 99:  12%|█▏        | 12/97 [00:03<00:22,  3.72it/s, loss=1.93, v_num=0]
Epoch 99:  13%|█▎        | 13/97 [00:03<00:21,  3.94it/s, loss=1.93, v_num=0]
Epoch 99:  13%|█▎        | 13/97 [00:03<00:21,  3.87it/s, loss=1.94, v_num=0]
Epoch 99:  14%|█▍        | 14/97 [00:03<00:20,  4.07it/s, loss=1.94, v_num=0]
Epoch 99:  14%|█▍        | 14/97 [00:03<00:20,  4.01it/s, loss=1.95, v_num=0]
Epoch 99:  15%|█▌        | 15/97 [00:03<00:19,  4.20it/s, loss=1.95, v_num=0]
Epoch 99:  15%|█▌        | 15/97 [00:03<00:19,  4.13it/s, loss=1.95, v_num=0]
Epoch 99:  16%|█▋        | 16/97 [00:03<00:18,  4.31it/s, loss=1.95, v_num=0]
Epoch 99:  16%|█▋        | 16/97 [00:03<00:19,  4.25it/s, loss=1.95, v_num=0]
Epoch 99:  18%|█▊        | 17/97 [00:03<00:18,  4.41it/s, loss=1.95, v_num=0]
Epoch 99:  18%|█▊        | 17/97 [00:03<00:18,  4.35it/s, loss=1.94, v_num=0]
Epoch 99:  19%|█▊        | 18/97 [00:03<00:17,  4.51it/s, loss=1.94, v_num=0]
Epoch 99:  19%|█▊        | 18/97 [00:04<00:17,  4.45it/s, loss=1.94, v_num=0]
Epoch 99:  20%|█▉        | 19/97 [00:04<00:16,  4.61it/s, loss=1.94, v_num=0]
Epoch 99:  20%|█▉        | 19/97 [00:04<00:17,  4.55it/s, loss=1.95, v_num=0]
Epoch 99:  21%|██        | 20/97 [00:04<00:16,  4.69it/s, loss=1.95, v_num=0]
Epoch 99:  21%|██        | 20/97 [00:04<00:16,  4.63it/s, loss=1.95, v_num=0]
Epoch 99:  22%|██▏       | 21/97 [00:04<00:15,  4.77it/s, loss=1.95, v_num=0]
Epoch 99:  22%|██▏       | 21/97 [00:04<00:16,  4.72it/s, loss=1.95, v_num=0]
Epoch 99:  23%|██▎       | 22/97 [00:04<00:15,  4.85it/s, loss=1.95, v_num=0]
Epoch 99:  23%|██▎       | 22/97 [00:04<00:15,  4.79it/s, loss=1.95, v_num=0]
Epoch 99:  24%|██▎       | 23/97 [00:04<00:15,  4.92it/s, loss=1.95, v_num=0]
Epoch 99:  24%|██▎       | 23/97 [00:04<00:15,  4.87it/s, loss=1.95, v_num=0]
Epoch 99:  25%|██▍       | 24/97 [00:04<00:14,  5.00it/s, loss=1.95, v_num=0]
Epoch 99:  25%|██▍       | 24/97 [00:04<00:14,  4.94it/s, loss=1.95, v_num=0]
Epoch 99:  26%|██▌       | 25/97 [00:04<00:14,  5.06it/s, loss=1.95, v_num=0]
Epoch 99:  26%|██▌       | 25/97 [00:04<00:14,  5.00it/s, loss=1.95, v_num=0]
Epoch 99:  27%|██▋       | 26/97 [00:05<00:13,  5.12it/s, loss=1.95, v_num=0]
Epoch 99:  27%|██▋       | 26/97 [00:05<00:14,  5.06it/s, loss=1.95, v_num=0]
Epoch 99:  28%|██▊       | 27/97 [00:05<00:13,  5.18it/s, loss=1.95, v_num=0]
Epoch 99:  28%|██▊       | 27/97 [00:05<00:13,  5.12it/s, loss=1.95, v_num=0]
Epoch 99:  29%|██▉       | 28/97 [00:05<00:13,  5.23it/s, loss=1.95, v_num=0]
Epoch 99:  29%|██▉       | 28/97 [00:05<00:13,  5.18it/s, loss=1.95, v_num=0]
Epoch 99:  30%|██▉       | 29/97 [00:05<00:12,  5.28it/s, loss=1.95, v_num=0]
Epoch 99:  30%|██▉       | 29/97 [00:05<00:13,  5.23it/s, loss=1.95, v_num=0]
Epoch 99:  31%|███       | 30/97 [00:05<00:12,  5.33it/s, loss=1.95, v_num=0]
Epoch 99:  31%|███       | 30/97 [00:05<00:12,  5.28it/s, loss=1.94, v_num=0]
Epoch 99:  32%|███▏      | 31/97 [00:05<00:12,  5.38it/s, loss=1.94, v_num=0]
Epoch 99:  32%|███▏      | 31/97 [00:05<00:12,  5.33it/s, loss=1.94, v_num=0]
Epoch 99:  33%|███▎      | 32/97 [00:05<00:11,  5.42it/s, loss=1.94, v_num=0]
Epoch 99:  33%|███▎      | 32/97 [00:05<00:12,  5.37it/s, loss=1.95, v_num=0]
Epoch 99:  34%|███▍      | 33/97 [00:06<00:11,  5.47it/s, loss=1.95, v_num=0]
Epoch 99:  34%|███▍      | 33/97 [00:06<00:11,  5.42it/s, loss=1.94, v_num=0]
Epoch 99:  35%|███▌      | 34/97 [00:06<00:11,  5.51it/s, loss=1.94, v_num=0]
Epoch 99:  35%|███▌      | 34/97 [00:06<00:11,  5.46it/s, loss=1.94, v_num=0]
Epoch 99:  36%|███▌      | 35/97 [00:06<00:11,  5.55it/s, loss=1.94, v_num=0]
Epoch 99:  36%|███▌      | 35/97 [00:06<00:11,  5.50it/s, loss=1.94, v_num=0]
Epoch 99:  37%|███▋      | 36/97 [00:06<00:10,  5.58it/s, loss=1.94, v_num=0]
Epoch 99:  37%|███▋      | 36/97 [00:06<00:11,  5.53it/s, loss=1.93, v_num=0]
Epoch 99:  38%|███▊      | 37/97 [00:06<00:10,  5.61it/s, loss=1.93, v_num=0]
Epoch 99:  38%|███▊      | 37/97 [00:06<00:10,  5.56it/s, loss=1.94, v_num=0]
Epoch 99:  39%|███▉      | 38/97 [00:06<00:10,  5.64it/s, loss=1.94, v_num=0]
Epoch 99:  39%|███▉      | 38/97 [00:06<00:10,  5.59it/s, loss=1.94, v_num=0]
Epoch 99:  40%|████      | 39/97 [00:06<00:10,  5.67it/s, loss=1.94, v_num=0]
Epoch 99:  40%|████      | 39/97 [00:06<00:10,  5.63it/s, loss=1.94, v_num=0]
Epoch 99:  41%|████      | 40/97 [00:07<00:10,  5.69it/s, loss=1.94, v_num=0]
Epoch 99:  41%|████      | 40/97 [00:07<00:10,  5.65it/s, loss=1.93, v_num=0]
Epoch 99:  42%|████▏     | 41/97 [00:07<00:09,  5.72it/s, loss=1.93, v_num=0]
Epoch 99:  42%|████▏     | 41/97 [00:07<00:09,  5.68it/s, loss=1.93, v_num=0]
Epoch 99:  43%|████▎     | 42/97 [00:07<00:09,  5.75it/s, loss=1.93, v_num=0]
Epoch 99:  43%|████▎     | 42/97 [00:07<00:09,  5.71it/s, loss=1.94, v_num=0]
Epoch 99:  44%|████▍     | 43/97 [00:07<00:09,  5.77it/s, loss=1.94, v_num=0]
Epoch 99:  44%|████▍     | 43/97 [00:07<00:09,  5.73it/s, loss=1.93, v_num=0]
Epoch 99:  45%|████▌     | 44/97 [00:07<00:09,  5.80it/s, loss=1.93, v_num=0]
Epoch 99:  45%|████▌     | 44/97 [00:07<00:09,  5.76it/s, loss=1.93, v_num=0]
Epoch 99:  46%|████▋     | 45/97 [00:07<00:08,  5.83it/s, loss=1.93, v_num=0]
Epoch 99:  46%|████▋     | 45/97 [00:07<00:08,  5.78it/s, loss=1.93, v_num=0]
Epoch 99:  47%|████▋     | 46/97 [00:07<00:08,  5.85it/s, loss=1.93, v_num=0]
Epoch 99:  47%|████▋     | 46/97 [00:07<00:08,  5.81it/s, loss=1.93, v_num=0]
Epoch 99:  48%|████▊     | 47/97 [00:07<00:08,  5.88it/s, loss=1.93, v_num=0]
Epoch 99:  48%|████▊     | 47/97 [00:08<00:08,  5.83it/s, loss=1.93, v_num=0]
Epoch 99:  49%|████▉     | 48/97 [00:08<00:08,  5.90it/s, loss=1.93, v_num=0]
Epoch 99:  49%|████▉     | 48/97 [00:08<00:08,  5.86it/s, loss=1.93, v_num=0]
Epoch 99:  51%|█████     | 49/97 [00:08<00:08,  5.92it/s, loss=1.93, v_num=0]
Epoch 99:  51%|█████     | 49/97 [00:08<00:08,  5.88it/s, loss=1.94, v_num=0]
Epoch 99:  52%|█████▏    | 50/97 [00:08<00:07,  5.94it/s, loss=1.94, v_num=0]
Epoch 99:  52%|█████▏    | 50/97 [00:08<00:07,  5.90it/s, loss=1.94, v_num=0]
Epoch 99:  53%|█████▎    | 51/97 [00:08<00:07,  5.96it/s, loss=1.94, v_num=0]
Epoch 99:  53%|█████▎    | 51/97 [00:08<00:07,  5.92it/s, loss=1.94, v_num=0]
Epoch 99:  54%|█████▎    | 52/97 [00:08<00:07,  5.98it/s, loss=1.94, v_num=0]
Epoch 99:  54%|█████▎    | 52/97 [00:08<00:07,  5.94it/s, loss=1.93, v_num=0]
Epoch 99:  55%|█████▍    | 53/97 [00:08<00:07,  6.00it/s, loss=1.93, v_num=0]
Epoch 99:  55%|█████▍    | 53/97 [00:08<00:07,  5.96it/s, loss=1.93, v_num=0]
Epoch 99:  56%|█████▌    | 54/97 [00:08<00:07,  6.02it/s, loss=1.93, v_num=0]
Epoch 99:  56%|█████▌    | 54/97 [00:09<00:07,  5.98it/s, loss=1.93, v_num=0]
Epoch 99:  57%|█████▋    | 55/97 [00:09<00:06,  6.03it/s, loss=1.93, v_num=0]
Epoch 99:  57%|█████▋    | 55/97 [00:09<00:07,  6.00it/s, loss=1.93, v_num=0]
Epoch 99:  58%|█████▊    | 56/97 [00:09<00:06,  6.05it/s, loss=1.93, v_num=0]
Epoch 99:  58%|█████▊    | 56/97 [00:09<00:06,  6.01it/s, loss=1.93, v_num=0]
Epoch 99:  59%|█████▉    | 57/97 [00:09<00:06,  6.06it/s, loss=1.93, v_num=0]
Epoch 99:  59%|█████▉    | 57/97 [00:09<00:06,  6.03it/s, loss=1.93, v_num=0]
Epoch 99:  60%|█████▉    | 58/97 [00:09<00:06,  6.08it/s, loss=1.93, v_num=0]
Epoch 99:  60%|█████▉    | 58/97 [00:09<00:06,  6.04it/s, loss=1.92, v_num=0]
Epoch 99:  61%|██████    | 59/97 [00:09<00:06,  6.09it/s, loss=1.92, v_num=0]
Epoch 99:  61%|██████    | 59/97 [00:09<00:06,  6.05it/s, loss=1.92, v_num=0]
Epoch 99:  62%|██████▏   | 60/97 [00:09<00:06,  6.10it/s, loss=1.92, v_num=0]
Epoch 99:  62%|██████▏   | 60/97 [00:09<00:06,  6.06it/s, loss=1.93, v_num=0]
Epoch 99:  63%|██████▎   | 61/97 [00:09<00:05,  6.11it/s, loss=1.93, v_num=0]
Epoch 99:  63%|██████▎   | 61/97 [00:10<00:05,  6.08it/s, loss=1.94, v_num=0]
Epoch 99:  64%|██████▍   | 62/97 [00:10<00:05,  6.13it/s, loss=1.94, v_num=0]
Epoch 99:  64%|██████▍   | 62/97 [00:10<00:05,  6.09it/s, loss=1.93, v_num=0]
Epoch 99:  65%|██████▍   | 63/97 [00:10<00:05,  6.14it/s, loss=1.93, v_num=0]
Epoch 99:  65%|██████▍   | 63/97 [00:10<00:05,  6.11it/s, loss=1.94, v_num=0]
Epoch 99:  66%|██████▌   | 64/97 [00:10<00:05,  6.15it/s, loss=1.94, v_num=0]
Epoch 99:  66%|██████▌   | 64/97 [00:10<00:05,  6.12it/s, loss=1.94, v_num=0]
Epoch 99:  67%|██████▋   | 65/97 [00:10<00:05,  6.17it/s, loss=1.94, v_num=0]
Epoch 99:  67%|██████▋   | 65/97 [00:10<00:05,  6.13it/s, loss=1.94, v_num=0]
Epoch 99:  68%|██████▊   | 66/97 [00:10<00:05,  6.18it/s, loss=1.94, v_num=0]
Epoch 99:  68%|██████▊   | 66/97 [00:10<00:05,  6.15it/s, loss=1.93, v_num=0]
Epoch 99:  69%|██████▉   | 67/97 [00:10<00:04,  6.19it/s, loss=1.93, v_num=0]
Epoch 99:  69%|██████▉   | 67/97 [00:10<00:04,  6.16it/s, loss=1.93, v_num=0]
Epoch 99:  70%|███████   | 68/97 [00:10<00:04,  6.20it/s, loss=1.93, v_num=0]
Epoch 99:  70%|███████   | 68/97 [00:11<00:04,  6.17it/s, loss=1.93, v_num=0]
Epoch 99:  71%|███████   | 69/97 [00:11<00:04,  6.22it/s, loss=1.93, v_num=0]
Epoch 99:  71%|███████   | 69/97 [00:11<00:04,  6.18it/s, loss=1.92, v_num=0]
Epoch 99:  72%|███████▏  | 70/97 [00:11<00:04,  6.23it/s, loss=1.92, v_num=0]
Epoch 99:  72%|███████▏  | 70/97 [00:11<00:04,  6.20it/s, loss=1.92, v_num=0]
Epoch 99:  73%|███████▎  | 71/97 [00:11<00:04,  6.24it/s, loss=1.92, v_num=0]
Epoch 99:  73%|███████▎  | 71/97 [00:11<00:04,  6.21it/s, loss=1.92, v_num=0]
Epoch 99:  74%|███████▍  | 72/97 [00:11<00:03,  6.25it/s, loss=1.92, v_num=0]
Epoch 99:  74%|███████▍  | 72/97 [00:11<00:04,  6.22it/s, loss=1.93, v_num=0]
Epoch 99:  75%|███████▌  | 73/97 [00:11<00:03,  6.27it/s, loss=1.93, v_num=0]
Epoch 99:  75%|███████▌  | 73/97 [00:11<00:03,  6.24it/s, loss=1.93, v_num=0]
Epoch 99:  76%|███████▋  | 74/97 [00:11<00:03,  6.28it/s, loss=1.93, v_num=0]
Epoch 99:  76%|███████▋  | 74/97 [00:11<00:03,  6.25it/s, loss=1.93, v_num=0]
Epoch 99:  77%|███████▋  | 75/97 [00:11<00:03,  6.29it/s, loss=1.93, v_num=0]
Epoch 99:  77%|███████▋  | 75/97 [00:11<00:03,  6.26it/s, loss=1.94, v_num=0]
Epoch 99:  78%|███████▊  | 76/97 [00:12<00:03,  6.30it/s, loss=1.94, v_num=0]
Epoch 99:  78%|███████▊  | 76/97 [00:12<00:03,  6.27it/s, loss=1.95, v_num=0]
Epoch 99:  79%|███████▉  | 77/97 [00:12<00:03,  6.31it/s, loss=1.95, v_num=0]
Epoch 99:  79%|███████▉  | 77/97 [00:12<00:03,  6.28it/s, loss=1.95, v_num=0]
Epoch 99:  80%|████████  | 78/97 [00:12<00:03,  6.32it/s, loss=1.95, v_num=0]
Epoch 99:  80%|████████  | 78/97 [00:12<00:03,  6.29it/s, loss=1.95, v_num=0]
Epoch 99:  81%|████████▏ | 79/97 [00:12<00:02,  6.33it/s, loss=1.95, v_num=0]
Epoch 99:  81%|████████▏ | 79/97 [00:12<00:02,  6.30it/s, loss=1.95, v_num=0]
Epoch 99:  82%|████████▏ | 80/97 [00:12<00:02,  6.34it/s, loss=1.95, v_num=0]
Epoch 99:  82%|████████▏ | 80/97 [00:12<00:02,  6.31it/s, loss=1.95, v_num=0]
Epoch 99:  84%|████████▎ | 81/97 [00:12<00:02,  6.35it/s, loss=1.95, v_num=0]
Epoch 99:  84%|████████▎ | 81/97 [00:12<00:02,  6.32it/s, loss=1.93, v_num=0]
Epoch 99:  85%|████████▍ | 82/97 [00:12<00:02,  6.36it/s, loss=1.93, v_num=0]
Epoch 99:  85%|████████▍ | 82/97 [00:12<00:02,  6.33it/s, loss=1.93, v_num=0]
Epoch 99:  86%|████████▌ | 83/97 [00:13<00:02,  6.37it/s, loss=1.93, v_num=0]
Epoch 99:  86%|████████▌ | 83/97 [00:13<00:02,  6.34it/s, loss=1.93, v_num=0]
Epoch 99:  87%|████████▋ | 84/97 [00:13<00:02,  6.38it/s, loss=1.93, v_num=0]
Epoch 99:  87%|████████▋ | 84/97 [00:13<00:02,  6.35it/s, loss=1.94, v_num=0]
Epoch 99:  88%|████████▊ | 85/97 [00:13<00:01,  6.39it/s, loss=1.94, v_num=0]
Epoch 99:  88%|████████▊ | 85/97 [00:13<00:01,  6.36it/s, loss=1.94, v_num=0]
Epoch 99:  89%|████████▊ | 86/97 [00:13<00:01,  6.40it/s, loss=1.94, v_num=0]
Epoch 99:  89%|████████▊ | 86/97 [00:13<00:01,  6.37it/s, loss=1.95, v_num=0]
Epoch 99:  90%|████████▉ | 87/97 [00:13<00:01,  6.40it/s, loss=1.95, v_num=0]
Epoch 99:  90%|████████▉ | 87/97 [00:13<00:01,  6.38it/s, loss=1.95, v_num=0]
Epoch 99:  91%|█████████ | 88/97 [00:13<00:01,  6.41it/s, loss=1.95, v_num=0]
Epoch 99:  91%|█████████ | 88/97 [00:13<00:01,  6.39it/s, loss=1.95, v_num=0]
Epoch 99:  92%|█████████▏| 89/97 [00:13<00:01,  6.42it/s, loss=1.95, v_num=0]
Epoch 99:  92%|█████████▏| 89/97 [00:13<00:01,  6.39it/s, loss=1.95, v_num=0]
Epoch 99:  93%|█████████▎| 90/97 [00:13<00:01,  6.43it/s, loss=1.95, v_num=0]
Epoch 99:  93%|█████████▎| 90/97 [00:14<00:01,  6.40it/s, loss=1.95, v_num=0]
Epoch 99:  94%|█████████▍| 91/97 [00:14<00:00,  6.44it/s, loss=1.95, v_num=0]
Epoch 99:  94%|█████████▍| 91/97 [00:14<00:00,  6.41it/s, loss=1.94, v_num=0]
Epoch 99:  95%|█████████▍| 92/97 [00:14<00:00,  6.44it/s, loss=1.94, v_num=0]
Epoch 99:  95%|█████████▍| 92/97 [00:14<00:00,  6.42it/s, loss=1.94, v_num=0]
Epoch 99:  96%|█████████▌| 93/97 [00:14<00:00,  6.45it/s, loss=1.94, v_num=0]
Epoch 99:  96%|█████████▌| 93/97 [00:14<00:00,  6.42it/s, loss=1.94, v_num=0]
Epoch 99:  97%|█████████▋| 94/97 [00:14<00:00,  6.46it/s, loss=1.94, v_num=0]
Epoch 99:  97%|█████████▋| 94/97 [00:14<00:00,  6.43it/s, loss=1.94, v_num=0]
Epoch 99:  98%|█████████▊| 95/97 [00:14<00:00,  6.46it/s, loss=1.94, v_num=0]
Epoch 99:  98%|█████████▊| 95/97 [00:14<00:00,  6.44it/s, loss=1.94, v_num=0]
Epoch 99:  99%|█████████▉| 96/97 [00:14<00:00,  6.47it/s, loss=1.94, v_num=0]
Epoch 99:  99%|█████████▉| 96/97 [00:14<00:00,  6.45it/s, loss=1.94, v_num=0]
Epoch 99: 100%|██████████| 97/97 [00:14<00:00,  6.48it/s, loss=1.94, v_num=0]
Epoch 99: 100%|██████████| 97/97 [00:15<00:00,  6.45it/s, loss=1.94, v_num=0]
Epoch 99: 100%|██████████| 97/97 [00:15<00:00,  6.45it/s, loss=1.94, v_num=0]
Epoch 99: 100%|██████████| 97/97 [00:17<00:00,  5.61it/s, loss=1.94, v_num=0]

Train the Classifier

model.eval()
classifier = Classifier(model.backbone)
trainer = pl.Trainer(max_epochs=max_epochs, devices=1, accelerator="gpu")
trainer.fit(classifier, dataloader_train_classifier, dataloader_test)
Sanity Checking: 0it [00:00, ?it/s]
Sanity Checking:   0%|          | 0/2 [00:00<?, ?it/s]
Sanity Checking DataLoader 0:   0%|          | 0/2 [00:00<?, ?it/s]
Sanity Checking DataLoader 0:  50%|█████     | 1/2 [00:00<00:00, 122.87it/s]
Sanity Checking DataLoader 0: 100%|██████████| 2/2 [00:00<00:00, 52.49it/s]


Training: 0it [00:00, ?it/s]
Training:   0%|          | 0/117 [00:00<?, ?it/s]
Epoch 0:   0%|          | 0/117 [00:00<?, ?it/s]
Epoch 0:   1%|          | 1/117 [00:00<01:20,  1.44it/s]
Epoch 0:   1%|          | 1/117 [00:00<01:23,  1.39it/s, loss=2.31, v_num=1]
Epoch 0:   2%|▏         | 2/117 [00:00<00:42,  2.71it/s, loss=2.31, v_num=1]
Epoch 0:   2%|▏         | 2/117 [00:00<00:43,  2.63it/s, loss=3.78, v_num=1]
Epoch 0:   3%|▎         | 3/117 [00:00<00:29,  3.90it/s, loss=3.78, v_num=1]
Epoch 0:   3%|▎         | 3/117 [00:00<00:30,  3.78it/s, loss=8.62, v_num=1]
Epoch 0:   3%|▎         | 4/117 [00:00<00:22,  4.99it/s, loss=8.62, v_num=1]
Epoch 0:   3%|▎         | 4/117 [00:00<00:23,  4.83it/s, loss=12.3, v_num=1]
Epoch 0:   4%|▍         | 5/117 [00:00<00:18,  5.98it/s, loss=12.3, v_num=1]
Epoch 0:   4%|▍         | 5/117 [00:00<00:19,  5.81it/s, loss=15.9, v_num=1]
Epoch 0:   5%|▌         | 6/117 [00:00<00:16,  6.90it/s, loss=15.9, v_num=1]
Epoch 0:   5%|▌         | 6/117 [00:00<00:16,  6.71it/s, loss=18.9, v_num=1]
Epoch 0:   6%|▌         | 7/117 [00:00<00:14,  7.75it/s, loss=18.9, v_num=1]
Epoch 0:   6%|▌         | 7/117 [00:00<00:14,  7.54it/s, loss=20.2, v_num=1]
Epoch 0:   7%|▋         | 8/117 [00:00<00:12,  8.54it/s, loss=20.2, v_num=1]
Epoch 0:   7%|▋         | 8/117 [00:00<00:13,  8.32it/s, loss=21.3, v_num=1]
Epoch 0:   8%|▊         | 9/117 [00:00<00:11,  9.26it/s, loss=21.3, v_num=1]
Epoch 0:   8%|▊         | 9/117 [00:00<00:11,  9.03it/s, loss=22, v_num=1]
Epoch 0:   9%|▊         | 10/117 [00:01<00:10,  9.88it/s, loss=22, v_num=1]
Epoch 0:   9%|▊         | 10/117 [00:01<00:11,  9.64it/s, loss=23, v_num=1]
Epoch 0:   9%|▉         | 11/117 [00:01<00:10, 10.51it/s, loss=23, v_num=1]
Epoch 0:   9%|▉         | 11/117 [00:01<00:10, 10.27it/s, loss=23.5, v_num=1]
Epoch 0:  10%|█         | 12/117 [00:01<00:09, 11.12it/s, loss=23.5, v_num=1]
Epoch 0:  10%|█         | 12/117 [00:01<00:09, 10.86it/s, loss=23.2, v_num=1]
Epoch 0:  11%|█         | 13/117 [00:01<00:08, 11.66it/s, loss=23.2, v_num=1]
Epoch 0:  11%|█         | 13/117 [00:01<00:09, 11.40it/s, loss=22.7, v_num=1]
Epoch 0:  12%|█▏        | 14/117 [00:01<00:08, 12.19it/s, loss=22.7, v_num=1]
Epoch 0:  12%|█▏        | 14/117 [00:01<00:08, 11.93it/s, loss=22.5, v_num=1]
Epoch 0:  13%|█▎        | 15/117 [00:01<00:08, 12.69it/s, loss=22.5, v_num=1]
Epoch 0:  13%|█▎        | 15/117 [00:01<00:08, 12.42it/s, loss=22.4, v_num=1]
Epoch 0:  14%|█▎        | 16/117 [00:01<00:07, 13.16it/s, loss=22.4, v_num=1]
Epoch 0:  14%|█▎        | 16/117 [00:01<00:07, 12.89it/s, loss=22.7, v_num=1]
Epoch 0:  15%|█▍        | 17/117 [00:01<00:07, 13.60it/s, loss=22.7, v_num=1]
Epoch 0:  15%|█▍        | 17/117 [00:01<00:07, 13.33it/s, loss=22.8, v_num=1]
Epoch 0:  15%|█▌        | 18/117 [00:01<00:07, 14.01it/s, loss=22.8, v_num=1]
Epoch 0:  15%|█▌        | 18/117 [00:01<00:07, 13.74it/s, loss=22.5, v_num=1]
Epoch 0:  16%|█▌        | 19/117 [00:01<00:06, 14.41it/s, loss=22.5, v_num=1]
Epoch 0:  16%|█▌        | 19/117 [00:01<00:06, 14.14it/s, loss=22, v_num=1]
Epoch 0:  17%|█▋        | 20/117 [00:01<00:06, 14.78it/s, loss=22, v_num=1]
Epoch 0:  17%|█▋        | 20/117 [00:01<00:06, 14.51it/s, loss=21.3, v_num=1]
Epoch 0:  18%|█▊        | 21/117 [00:01<00:06, 15.13it/s, loss=21.3, v_num=1]
Epoch 0:  18%|█▊        | 21/117 [00:01<00:06, 14.86it/s, loss=21.6, v_num=1]
Epoch 0:  19%|█▉        | 22/117 [00:01<00:06, 15.48it/s, loss=21.6, v_num=1]
Epoch 0:  19%|█▉        | 22/117 [00:01<00:06, 15.20it/s, loss=21.8, v_num=1]
Epoch 0:  20%|█▉        | 23/117 [00:01<00:05, 15.80it/s, loss=21.8, v_num=1]
Epoch 0:  20%|█▉        | 23/117 [00:01<00:06, 15.53it/s, loss=21.2, v_num=1]
Epoch 0:  21%|██        | 24/117 [00:01<00:05, 16.10it/s, loss=21.2, v_num=1]
Epoch 0:  21%|██        | 24/117 [00:01<00:05, 15.84it/s, loss=20.4, v_num=1]
Epoch 0:  21%|██▏       | 25/117 [00:01<00:05, 16.40it/s, loss=20.4, v_num=1]
Epoch 0:  21%|██▏       | 25/117 [00:01<00:05, 16.13it/s, loss=19.2, v_num=1]
Epoch 0:  22%|██▏       | 26/117 [00:01<00:05, 16.68it/s, loss=19.2, v_num=1]
Epoch 0:  22%|██▏       | 26/117 [00:01<00:05, 16.41it/s, loss=17.9, v_num=1]
Epoch 0:  23%|██▎       | 27/117 [00:01<00:05, 16.95it/s, loss=17.9, v_num=1]
Epoch 0:  23%|██▎       | 27/117 [00:01<00:05, 16.68it/s, loss=16.8, v_num=1]
Epoch 0:  24%|██▍       | 28/117 [00:01<00:05, 17.20it/s, loss=16.8, v_num=1]
Epoch 0:  24%|██▍       | 28/117 [00:01<00:05, 16.94it/s, loss=15.7, v_num=1]
Epoch 0:  25%|██▍       | 29/117 [00:01<00:05, 17.45it/s, loss=15.7, v_num=1]
Epoch 0:  25%|██▍       | 29/117 [00:01<00:05, 17.19it/s, loss=14.5, v_num=1]
Epoch 0:  26%|██▌       | 30/117 [00:01<00:04, 17.69it/s, loss=14.5, v_num=1]
Epoch 0:  26%|██▌       | 30/117 [00:01<00:04, 17.43it/s, loss=13.3, v_num=1]
Epoch 0:  26%|██▋       | 31/117 [00:01<00:04, 17.91it/s, loss=13.3, v_num=1]
Epoch 0:  26%|██▋       | 31/117 [00:01<00:04, 17.66it/s, loss=12.2, v_num=1]
Epoch 0:  27%|██▋       | 32/117 [00:01<00:04, 18.13it/s, loss=12.2, v_num=1]
Epoch 0:  27%|██▋       | 32/117 [00:01<00:04, 17.88it/s, loss=11.5, v_num=1]
Epoch 0:  28%|██▊       | 33/117 [00:01<00:04, 18.34it/s, loss=11.5, v_num=1]
Epoch 0:  28%|██▊       | 33/117 [00:01<00:04, 18.09it/s, loss=10.9, v_num=1]
Epoch 0:  29%|██▉       | 34/117 [00:01<00:04, 18.54it/s, loss=10.9, v_num=1]
Epoch 0:  29%|██▉       | 34/117 [00:01<00:04, 18.29it/s, loss=10.3, v_num=1]
Epoch 0:  30%|██▉       | 35/117 [00:01<00:04, 18.70it/s, loss=10.3, v_num=1]
Epoch 0:  30%|██▉       | 35/117 [00:01<00:04, 18.47it/s, loss=9.58, v_num=1]
Epoch 0:  31%|███       | 36/117 [00:01<00:04, 18.90it/s, loss=9.58, v_num=1]
Epoch 0:  31%|███       | 36/117 [00:01<00:04, 18.65it/s, loss=8.58, v_num=1]
Epoch 0:  32%|███▏      | 37/117 [00:01<00:04, 19.08it/s, loss=8.58, v_num=1]
Epoch 0:  32%|███▏      | 37/117 [00:01<00:04, 18.84it/s, loss=7.76, v_num=1]
Epoch 0:  32%|███▏      | 38/117 [00:01<00:04, 19.24it/s, loss=7.76, v_num=1]
Epoch 0:  32%|███▏      | 38/117 [00:01<00:04, 19.00it/s, loss=7.12, v_num=1]
Epoch 0:  33%|███▎      | 39/117 [00:02<00:04, 19.42it/s, loss=7.12, v_num=1]
Epoch 0:  33%|███▎      | 39/117 [00:02<00:04, 19.18it/s, loss=6.76, v_num=1]
Epoch 0:  34%|███▍      | 40/117 [00:02<00:03, 19.58it/s, loss=6.76, v_num=1]
Epoch 0:  34%|███▍      | 40/117 [00:02<00:03, 19.34it/s, loss=6.53, v_num=1]
Epoch 0:  35%|███▌      | 41/117 [00:02<00:03, 19.74it/s, loss=6.53, v_num=1]
Epoch 0:  35%|███▌      | 41/117 [00:02<00:03, 19.50it/s, loss=6.45, v_num=1]
Epoch 0:  36%|███▌      | 42/117 [00:02<00:03, 19.88it/s, loss=6.45, v_num=1]
Epoch 0:  36%|███▌      | 42/117 [00:02<00:03, 19.65it/s, loss=6.31, v_num=1]
Epoch 0:  37%|███▋      | 43/117 [00:02<00:03, 20.03it/s, loss=6.31, v_num=1]
Epoch 0:  37%|███▋      | 43/117 [00:02<00:03, 19.80it/s, loss=6.27, v_num=1]
Epoch 0:  38%|███▊      | 44/117 [00:02<00:03, 20.17it/s, loss=6.27, v_num=1]
Epoch 0:  38%|███▊      | 44/117 [00:02<00:03, 19.94it/s, loss=6.2, v_num=1]
Epoch 0:  38%|███▊      | 45/117 [00:02<00:03, 20.31it/s, loss=6.2, v_num=1]
Epoch 0:  38%|███▊      | 45/117 [00:02<00:03, 20.08it/s, loss=6.16, v_num=1]
Epoch 0:  39%|███▉      | 46/117 [00:02<00:03, 20.45it/s, loss=6.16, v_num=1]
Epoch 0:  39%|███▉      | 46/117 [00:02<00:03, 20.22it/s, loss=6.2, v_num=1]
Epoch 0:  40%|████      | 47/117 [00:02<00:03, 20.57it/s, loss=6.2, v_num=1]
Epoch 0:  40%|████      | 47/117 [00:02<00:03, 20.35it/s, loss=6.16, v_num=1]
Epoch 0:  41%|████      | 48/117 [00:02<00:03, 20.70it/s, loss=6.16, v_num=1]
Epoch 0:  41%|████      | 48/117 [00:02<00:03, 20.48it/s, loss=6.04, v_num=1]
Epoch 0:  42%|████▏     | 49/117 [00:02<00:03, 20.82it/s, loss=6.04, v_num=1]
Epoch 0:  42%|████▏     | 49/117 [00:02<00:03, 20.60it/s, loss=6.08, v_num=1]
Epoch 0:  43%|████▎     | 50/117 [00:02<00:03, 20.94it/s, loss=6.08, v_num=1]
Epoch 0:  43%|████▎     | 50/117 [00:02<00:03, 20.72it/s, loss=6.1, v_num=1]
Epoch 0:  44%|████▎     | 51/117 [00:02<00:03, 21.05it/s, loss=6.1, v_num=1]
Epoch 0:  44%|████▎     | 51/117 [00:02<00:03, 20.83it/s, loss=6.17, v_num=1]
Epoch 0:  44%|████▍     | 52/117 [00:02<00:03, 21.17it/s, loss=6.17, v_num=1]
Epoch 0:  44%|████▍     | 52/117 [00:02<00:03, 20.95it/s, loss=6.14, v_num=1]
Epoch 0:  45%|████▌     | 53/117 [00:02<00:03, 21.28it/s, loss=6.14, v_num=1]
Epoch 0:  45%|████▌     | 53/117 [00:02<00:03, 21.06it/s, loss=6.18, v_num=1]
Epoch 0:  46%|████▌     | 54/117 [00:02<00:02, 21.38it/s, loss=6.18, v_num=1]
Epoch 0:  46%|████▌     | 54/117 [00:02<00:02, 21.17it/s, loss=6.16, v_num=1]
Epoch 0:  47%|████▋     | 55/117 [00:02<00:02, 21.49it/s, loss=6.16, v_num=1]
Epoch 0:  47%|████▋     | 55/117 [00:02<00:02, 21.28it/s, loss=6.04, v_num=1]
Epoch 0:  48%|████▊     | 56/117 [00:02<00:02, 21.59it/s, loss=6.04, v_num=1]
Epoch 0:  48%|████▊     | 56/117 [00:02<00:02, 21.38it/s, loss=6.06, v_num=1]
Epoch 0:  49%|████▊     | 57/117 [00:02<00:02, 21.69it/s, loss=6.06, v_num=1]
Epoch 0:  49%|████▊     | 57/117 [00:02<00:02, 21.48it/s, loss=6.13, v_num=1]
Epoch 0:  50%|████▉     | 58/117 [00:02<00:02, 21.78it/s, loss=6.13, v_num=1]
Epoch 0:  50%|████▉     | 58/117 [00:02<00:02, 21.58it/s, loss=6.22, v_num=1]
Epoch 0:  50%|█████     | 59/117 [00:02<00:02, 21.87it/s, loss=6.22, v_num=1]
Epoch 0:  50%|█████     | 59/117 [00:02<00:02, 21.67it/s, loss=6.3, v_num=1]
Epoch 0:  51%|█████▏    | 60/117 [00:02<00:02, 21.97it/s, loss=6.3, v_num=1]
Epoch 0:  51%|█████▏    | 60/117 [00:02<00:02, 21.77it/s, loss=6.33, v_num=1]
Epoch 0:  52%|█████▏    | 61/117 [00:02<00:02, 22.06it/s, loss=6.33, v_num=1]
Epoch 0:  52%|█████▏    | 61/117 [00:02<00:02, 21.86it/s, loss=6.29, v_num=1]
Epoch 0:  53%|█████▎    | 62/117 [00:02<00:02, 22.14it/s, loss=6.29, v_num=1]
Epoch 0:  53%|█████▎    | 62/117 [00:02<00:02, 21.94it/s, loss=6.24, v_num=1]
Epoch 0:  54%|█████▍    | 63/117 [00:02<00:02, 22.23it/s, loss=6.24, v_num=1]
Epoch 0:  54%|█████▍    | 63/117 [00:02<00:02, 22.03it/s, loss=6.18, v_num=1]
Epoch 0:  55%|█████▍    | 64/117 [00:02<00:02, 22.31it/s, loss=6.18, v_num=1]
Epoch 0:  55%|█████▍    | 64/117 [00:02<00:02, 22.11it/s, loss=6.18, v_num=1]
Epoch 0:  56%|█████▌    | 65/117 [00:02<00:02, 22.34it/s, loss=6.18, v_num=1]
Epoch 0:  56%|█████▌    | 65/117 [00:02<00:02, 22.19it/s, loss=6.16, v_num=1]
Epoch 0:  56%|█████▋    | 66/117 [00:02<00:02, 22.41it/s, loss=6.16, v_num=1]
Epoch 0:  56%|█████▋    | 66/117 [00:02<00:02, 22.26it/s, loss=5.95, v_num=1]
Epoch 0:  57%|█████▋    | 67/117 [00:02<00:02, 22.49it/s, loss=5.95, v_num=1]
Epoch 0:  57%|█████▋    | 67/117 [00:03<00:02, 22.33it/s, loss=5.8, v_num=1]
Epoch 0:  58%|█████▊    | 68/117 [00:03<00:02, 22.55it/s, loss=5.8, v_num=1]
Epoch 0:  58%|█████▊    | 68/117 [00:03<00:02, 22.40it/s, loss=5.84, v_num=1]
Epoch 0:  59%|█████▉    | 69/117 [00:03<00:02, 22.61it/s, loss=5.84, v_num=1]
Epoch 0:  59%|█████▉    | 69/117 [00:03<00:02, 22.46it/s, loss=5.9, v_num=1]
Epoch 0:  60%|█████▉    | 70/117 [00:03<00:02, 22.68it/s, loss=5.9, v_num=1]
Epoch 0:  60%|█████▉    | 70/117 [00:03<00:02, 22.51it/s, loss=5.74, v_num=1]
Epoch 0:  61%|██████    | 71/117 [00:03<00:02, 22.75it/s, loss=5.74, v_num=1]
Epoch 0:  61%|██████    | 71/117 [00:03<00:02, 22.57it/s, loss=5.55, v_num=1]
Epoch 0:  62%|██████▏   | 72/117 [00:03<00:01, 22.80it/s, loss=5.55, v_num=1]
Epoch 0:  62%|██████▏   | 72/117 [00:03<00:01, 22.64it/s, loss=5.4, v_num=1]
Epoch 0:  62%|██████▏   | 73/117 [00:03<00:01, 22.87it/s, loss=5.4, v_num=1]
Epoch 0:  62%|██████▏   | 73/117 [00:03<00:01, 22.70it/s, loss=5.22, v_num=1]
Epoch 0:  63%|██████▎   | 74/117 [00:03<00:01, 22.92it/s, loss=5.22, v_num=1]
Epoch 0:  63%|██████▎   | 74/117 [00:03<00:01, 22.76it/s, loss=5.03, v_num=1]
Epoch 0:  64%|██████▍   | 75/117 [00:03<00:01, 22.97it/s, loss=5.03, v_num=1]
Epoch 0:  64%|██████▍   | 75/117 [00:03<00:01, 22.82it/s, loss=4.9, v_num=1]
Epoch 0:  65%|██████▍   | 76/117 [00:03<00:01, 23.02it/s, loss=4.9, v_num=1]
Epoch 0:  65%|██████▍   | 76/117 [00:03<00:01, 22.88it/s, loss=4.75, v_num=1]
Epoch 0:  66%|██████▌   | 77/117 [00:03<00:01, 23.10it/s, loss=4.75, v_num=1]
Epoch 0:  66%|██████▌   | 77/117 [00:03<00:01, 22.94it/s, loss=4.56, v_num=1]
Epoch 0:  67%|██████▋   | 78/117 [00:03<00:01, 23.15it/s, loss=4.56, v_num=1]
Epoch 0:  67%|██████▋   | 78/117 [00:03<00:01, 22.99it/s, loss=4.46, v_num=1]
Epoch 0:  68%|██████▊   | 79/117 [00:03<00:01, 23.20it/s, loss=4.46, v_num=1]
Epoch 0:  68%|██████▊   | 79/117 [00:03<00:01, 23.05it/s, loss=4.38, v_num=1]
Epoch 0:  68%|██████▊   | 80/117 [00:03<00:01, 23.25it/s, loss=4.38, v_num=1]
Epoch 0:  68%|██████▊   | 80/117 [00:03<00:01, 23.10it/s, loss=4.4, v_num=1]
Epoch 0:  69%|██████▉   | 81/117 [00:03<00:01, 23.32it/s, loss=4.4, v_num=1]
Epoch 0:  69%|██████▉   | 81/117 [00:03<00:01, 23.16it/s, loss=4.47, v_num=1]
Epoch 0:  70%|███████   | 82/117 [00:03<00:01, 23.26it/s, loss=4.47, v_num=1]
Epoch 0:  70%|███████   | 82/117 [00:03<00:01, 23.13it/s, loss=4.6, v_num=1]
Epoch 0:  71%|███████   | 83/117 [00:03<00:01, 23.34it/s, loss=4.6, v_num=1]
Epoch 0:  71%|███████   | 83/117 [00:03<00:01, 23.17it/s, loss=4.57, v_num=1]
Epoch 0:  72%|███████▏  | 84/117 [00:03<00:01, 23.39it/s, loss=4.57, v_num=1]
Epoch 0:  72%|███████▏  | 84/117 [00:03<00:01, 23.23it/s, loss=4.5, v_num=1]
Epoch 0:  73%|███████▎  | 85/117 [00:03<00:01, 23.43it/s, loss=4.5, v_num=1]
Epoch 0:  73%|███████▎  | 85/117 [00:03<00:01, 23.27it/s, loss=4.39, v_num=1]
Epoch 0:  74%|███████▎  | 86/117 [00:03<00:01, 23.48it/s, loss=4.39, v_num=1]
Epoch 0:  74%|███████▎  | 86/117 [00:03<00:01, 23.32it/s, loss=4.36, v_num=1]
Epoch 0:  74%|███████▍  | 87/117 [00:03<00:01, 23.53it/s, loss=4.36, v_num=1]
Epoch 0:  74%|███████▍  | 87/117 [00:03<00:01, 23.37it/s, loss=4.43, v_num=1]
Epoch 0:  75%|███████▌  | 88/117 [00:03<00:01, 23.57it/s, loss=4.43, v_num=1]
Epoch 0:  75%|███████▌  | 88/117 [00:03<00:01, 23.41it/s, loss=4.42, v_num=1]
Epoch 0:  76%|███████▌  | 89/117 [00:03<00:01, 23.61it/s, loss=4.42, v_num=1]
Epoch 0:  76%|███████▌  | 89/117 [00:03<00:01, 23.46it/s, loss=4.3, v_num=1]
Epoch 0:  77%|███████▋  | 90/117 [00:03<00:01, 23.66it/s, loss=4.3, v_num=1]
Epoch 0:  77%|███████▋  | 90/117 [00:03<00:01, 23.50it/s, loss=4.27, v_num=1]
Epoch 0:  78%|███████▊  | 91/117 [00:03<00:01, 23.70it/s, loss=4.27, v_num=1]
Epoch 0:  78%|███████▊  | 91/117 [00:03<00:01, 23.54it/s, loss=4.33, v_num=1]
Epoch 0:  79%|███████▊  | 92/117 [00:03<00:01, 23.73it/s, loss=4.33, v_num=1]
Epoch 0:  79%|███████▊  | 92/117 [00:03<00:01, 23.58it/s, loss=4.31, v_num=1]
Epoch 0:  79%|███████▉  | 93/117 [00:03<00:01, 23.78it/s, loss=4.31, v_num=1]
Epoch 0:  79%|███████▉  | 93/117 [00:03<00:01, 23.63it/s, loss=4.35, v_num=1]
Epoch 0:  80%|████████  | 94/117 [00:03<00:00, 23.82it/s, loss=4.35, v_num=1]
Epoch 0:  80%|████████  | 94/117 [00:03<00:00, 23.67it/s, loss=4.5, v_num=1]
Epoch 0:  81%|████████  | 95/117 [00:03<00:00, 23.86it/s, loss=4.5, v_num=1]
Epoch 0:  81%|████████  | 95/117 [00:04<00:00, 23.71it/s, loss=4.61, v_num=1]
Epoch 0:  82%|████████▏ | 96/117 [00:04<00:00, 23.89it/s, loss=4.61, v_num=1]
Epoch 0:  82%|████████▏ | 96/117 [00:04<00:00, 23.75it/s, loss=4.55, v_num=1]
Epoch 0:  83%|████████▎ | 97/117 [00:04<00:00, 23.93it/s, loss=4.55, v_num=1]
Epoch 0:  83%|████████▎ | 97/117 [00:04<00:00, 23.78it/s, loss=4.43, v_num=1]

Validation: 0it [00:00, ?it/s]

Validation:   0%|          | 0/20 [00:00<?, ?it/s]

Validation DataLoader 0:   0%|          | 0/20 [00:00<?, ?it/s]

Validation DataLoader 0:   5%|▌         | 1/20 [00:00<00:00, 171.95it/s]
Epoch 0:  84%|████████▍ | 98/117 [00:05<00:00, 19.32it/s, loss=4.43, v_num=1]

Validation DataLoader 0:  10%|█         | 2/20 [00:00<00:00, 53.74it/s]
Epoch 0:  85%|████████▍ | 99/117 [00:05<00:00, 19.39it/s, loss=4.43, v_num=1]

Validation DataLoader 0:  15%|█▌        | 3/20 [00:00<00:00, 42.96it/s]
Epoch 0:  85%|████████▌ | 100/117 [00:05<00:00, 19.47it/s, loss=4.43, v_num=1]

Validation DataLoader 0:  20%|██        | 4/20 [00:00<00:00, 37.60it/s]
Epoch 0:  86%|████████▋ | 101/117 [00:05<00:00, 19.52it/s, loss=4.43, v_num=1]

Validation DataLoader 0:  25%|██▌       | 5/20 [00:00<00:00, 36.95it/s]
Epoch 0:  87%|████████▋ | 102/117 [00:05<00:00, 19.60it/s, loss=4.43, v_num=1]

Validation DataLoader 0:  30%|███       | 6/20 [00:00<00:00, 35.76it/s]
Epoch 0:  88%|████████▊ | 103/117 [00:05<00:00, 19.67it/s, loss=4.43, v_num=1]

Validation DataLoader 0:  35%|███▌      | 7/20 [00:00<00:00, 34.86it/s]
Epoch 0:  89%|████████▉ | 104/117 [00:05<00:00, 19.74it/s, loss=4.43, v_num=1]

Validation DataLoader 0:  40%|████      | 8/20 [00:00<00:00, 34.39it/s]
Epoch 0:  90%|████████▉ | 105/117 [00:05<00:00, 19.81it/s, loss=4.43, v_num=1]

Validation DataLoader 0:  45%|████▌     | 9/20 [00:00<00:00, 33.86it/s]
Epoch 0:  91%|█████████ | 106/117 [00:05<00:00, 19.88it/s, loss=4.43, v_num=1]

Validation DataLoader 0:  50%|█████     | 10/20 [00:00<00:00, 33.62it/s]
Epoch 0:  91%|█████████▏| 107/117 [00:05<00:00, 19.94it/s, loss=4.43, v_num=1]

Validation DataLoader 0:  55%|█████▌    | 11/20 [00:00<00:00, 33.34it/s]
Epoch 0:  92%|█████████▏| 108/117 [00:05<00:00, 20.01it/s, loss=4.43, v_num=1]

Validation DataLoader 0:  60%|██████    | 12/20 [00:00<00:00, 33.09it/s]
Epoch 0:  93%|█████████▎| 109/117 [00:05<00:00, 20.07it/s, loss=4.43, v_num=1]

Validation DataLoader 0:  65%|██████▌   | 13/20 [00:00<00:00, 32.91it/s]
Epoch 0:  94%|█████████▍| 110/117 [00:05<00:00, 20.14it/s, loss=4.43, v_num=1]

Validation DataLoader 0:  70%|███████   | 14/20 [00:00<00:00, 32.77it/s]
Epoch 0:  95%|█████████▍| 111/117 [00:05<00:00, 20.20it/s, loss=4.43, v_num=1]

Validation DataLoader 0:  75%|███████▌  | 15/20 [00:00<00:00, 32.64it/s]
Epoch 0:  96%|█████████▌| 112/117 [00:05<00:00, 20.26it/s, loss=4.43, v_num=1]

Validation DataLoader 0:  80%|████████  | 16/20 [00:00<00:00, 32.54it/s]
Epoch 0:  97%|█████████▋| 113/117 [00:05<00:00, 20.33it/s, loss=4.43, v_num=1]

Validation DataLoader 0:  85%|████████▌ | 17/20 [00:00<00:00, 32.42it/s]
Epoch 0:  97%|█████████▋| 114/117 [00:05<00:00, 20.39it/s, loss=4.43, v_num=1]

Validation DataLoader 0:  90%|█████████ | 18/20 [00:00<00:00, 32.34it/s]
Epoch 0:  98%|█████████▊| 115/117 [00:05<00:00, 20.45it/s, loss=4.43, v_num=1]

Validation DataLoader 0:  95%|█████████▌| 19/20 [00:00<00:00, 32.25it/s]
Epoch 0:  99%|█████████▉| 116/117 [00:05<00:00, 20.51it/s, loss=4.43, v_num=1]

Validation DataLoader 0: 100%|██████████| 20/20 [00:00<00:00, 32.13it/s]
Epoch 0: 100%|██████████| 117/117 [00:05<00:00, 20.56it/s, loss=4.43, v_num=1]
Epoch 0: 100%|██████████| 117/117 [00:05<00:00, 20.49it/s, loss=4.43, v_num=1, val_acc=0.651]


Epoch 0: 100%|██████████| 117/117 [00:05<00:00, 20.49it/s, loss=4.43, v_num=1, val_acc=0.651]
Epoch 0:   0%|          | 0/117 [00:00<?, ?it/s, loss=4.43, v_num=1, val_acc=0.651]
Epoch 1:   0%|          | 0/117 [00:00<?, ?it/s, loss=4.43, v_num=1, val_acc=0.651]
Epoch 1:   1%|          | 1/117 [00:00<01:47,  1.08it/s, loss=4.43, v_num=1, val_acc=0.651]
Epoch 1:   1%|          | 1/117 [00:00<01:49,  1.06it/s, loss=4.33, v_num=1, val_acc=0.651]
Epoch 1:   2%|▏         | 2/117 [00:00<00:54,  2.09it/s, loss=4.33, v_num=1, val_acc=0.651]
Epoch 1:   2%|▏         | 2/117 [00:00<00:56,  2.04it/s, loss=4.25, v_num=1, val_acc=0.651]
Epoch 1:   3%|▎         | 3/117 [00:00<00:37,  3.03it/s, loss=4.25, v_num=1, val_acc=0.651]
Epoch 1:   3%|▎         | 3/117 [00:01<00:38,  2.95it/s, loss=4.15, v_num=1, val_acc=0.651]
Epoch 1:   3%|▎         | 4/117 [00:01<00:29,  3.89it/s, loss=4.15, v_num=1, val_acc=0.651]
Epoch 1:   3%|▎         | 4/117 [00:01<00:29,  3.80it/s, loss=4.01, v_num=1, val_acc=0.651]
Epoch 1:   4%|▍         | 5/117 [00:01<00:23,  4.69it/s, loss=4.01, v_num=1, val_acc=0.651]
Epoch 1:   4%|▍         | 5/117 [00:01<00:24,  4.58it/s, loss=3.86, v_num=1, val_acc=0.651]
Epoch 1:   5%|▌         | 6/117 [00:01<00:20,  5.46it/s, loss=3.86, v_num=1, val_acc=0.651]
Epoch 1:   5%|▌         | 6/117 [00:01<00:20,  5.34it/s, loss=3.87, v_num=1, val_acc=0.651]
Epoch 1:   6%|▌         | 7/117 [00:01<00:17,  6.18it/s, loss=3.87, v_num=1, val_acc=0.651]
Epoch 1:   6%|▌         | 7/117 [00:01<00:18,  6.04it/s, loss=3.97, v_num=1, val_acc=0.651]
Epoch 1:   7%|▋         | 8/117 [00:01<00:15,  6.86it/s, loss=3.97, v_num=1, val_acc=0.651]
Epoch 1:   7%|▋         | 8/117 [00:01<00:16,  6.71it/s, loss=4.14, v_num=1, val_acc=0.651]
Epoch 1:   8%|▊         | 9/117 [00:01<00:14,  7.48it/s, loss=4.14, v_num=1, val_acc=0.651]
Epoch 1:   8%|▊         | 9/117 [00:01<00:14,  7.33it/s, loss=4.39, v_num=1, val_acc=0.651]
Epoch 1:   9%|▊         | 10/117 [00:01<00:13,  8.03it/s, loss=4.39, v_num=1, val_acc=0.651]
Epoch 1:   9%|▊         | 10/117 [00:01<00:13,  7.89it/s, loss=4.58, v_num=1, val_acc=0.651]
Epoch 1:   9%|▉         | 11/117 [00:01<00:12,  8.62it/s, loss=4.58, v_num=1, val_acc=0.651]
Epoch 1:   9%|▉         | 11/117 [00:01<00:12,  8.45it/s, loss=4.69, v_num=1, val_acc=0.651]
Epoch 1:  10%|█         | 12/117 [00:01<00:11,  9.16it/s, loss=4.69, v_num=1, val_acc=0.651]
Epoch 1:  10%|█         | 12/117 [00:01<00:11,  8.98it/s, loss=4.77, v_num=1, val_acc=0.651]
Epoch 1:  11%|█         | 13/117 [00:01<00:10,  9.65it/s, loss=4.77, v_num=1, val_acc=0.651]
Epoch 1:  11%|█         | 13/117 [00:01<00:10,  9.48it/s, loss=4.92, v_num=1, val_acc=0.651]
Epoch 1:  12%|█▏        | 14/117 [00:01<00:10, 10.15it/s, loss=4.92, v_num=1, val_acc=0.651]
Epoch 1:  12%|█▏        | 14/117 [00:01<00:10,  9.97it/s, loss=5.01, v_num=1, val_acc=0.651]
Epoch 1:  13%|█▎        | 15/117 [00:01<00:09, 10.61it/s, loss=5.01, v_num=1, val_acc=0.651]
Epoch 1:  13%|█▎        | 15/117 [00:01<00:09, 10.43it/s, loss=5.17, v_num=1, val_acc=0.651]
Epoch 1:  14%|█▎        | 16/117 [00:01<00:09, 11.06it/s, loss=5.17, v_num=1, val_acc=0.651]
Epoch 1:  14%|█▎        | 16/117 [00:01<00:09, 10.86it/s, loss=5.24, v_num=1, val_acc=0.651]
Epoch 1:  15%|█▍        | 17/117 [00:01<00:08, 11.46it/s, loss=5.24, v_num=1, val_acc=0.651]
Epoch 1:  15%|█▍        | 17/117 [00:01<00:08, 11.26it/s, loss=5.19, v_num=1, val_acc=0.651]
Epoch 1:  15%|█▌        | 18/117 [00:01<00:08, 11.86it/s, loss=5.19, v_num=1, val_acc=0.651]
Epoch 1:  15%|█▌        | 18/117 [00:01<00:08, 11.67it/s, loss=5.05, v_num=1, val_acc=0.651]
Epoch 1:  16%|█▌        | 19/117 [00:01<00:08, 12.25it/s, loss=5.05, v_num=1, val_acc=0.651]
Epoch 1:  16%|█▌        | 19/117 [00:01<00:08, 12.05it/s, loss=4.99, v_num=1, val_acc=0.651]
Epoch 1:  17%|█▋        | 20/117 [00:01<00:07, 12.62it/s, loss=4.99, v_num=1, val_acc=0.651]
Epoch 1:  17%|█▋        | 20/117 [00:01<00:07, 12.42it/s, loss=4.96, v_num=1, val_acc=0.651]
Epoch 1:  18%|█▊        | 21/117 [00:01<00:07, 12.96it/s, loss=4.96, v_num=1, val_acc=0.651]
Epoch 1:  18%|█▊        | 21/117 [00:01<00:07, 12.77it/s, loss=5.05, v_num=1, val_acc=0.651]
Epoch 1:  19%|█▉        | 22/117 [00:01<00:07, 13.30it/s, loss=5.05, v_num=1, val_acc=0.651]
Epoch 1:  19%|█▉        | 22/117 [00:01<00:07, 13.10it/s, loss=5.07, v_num=1, val_acc=0.651]
Epoch 1:  20%|█▉        | 23/117 [00:01<00:06, 13.62it/s, loss=5.07, v_num=1, val_acc=0.651]
Epoch 1:  20%|█▉        | 23/117 [00:01<00:07, 13.42it/s, loss=5.17, v_num=1, val_acc=0.651]
Epoch 1:  21%|██        | 24/117 [00:01<00:06, 13.93it/s, loss=5.17, v_num=1, val_acc=0.651]
Epoch 1:  21%|██        | 24/117 [00:01<00:06, 13.73it/s, loss=5.27, v_num=1, val_acc=0.651]
Epoch 1:  21%|██▏       | 25/117 [00:01<00:06, 14.22it/s, loss=5.27, v_num=1, val_acc=0.651]
Epoch 1:  21%|██▏       | 25/117 [00:01<00:06, 14.02it/s, loss=5.22, v_num=1, val_acc=0.651]
Epoch 1:  22%|██▏       | 26/117 [00:01<00:06, 14.51it/s, loss=5.22, v_num=1, val_acc=0.651]
Epoch 1:  22%|██▏       | 26/117 [00:01<00:06, 14.30it/s, loss=5.22, v_num=1, val_acc=0.651]
Epoch 1:  23%|██▎       | 27/117 [00:01<00:06, 14.78it/s, loss=5.22, v_num=1, val_acc=0.651]
Epoch 1:  23%|██▎       | 27/117 [00:01<00:06, 14.57it/s, loss=5.2, v_num=1, val_acc=0.651]
Epoch 1:  24%|██▍       | 28/117 [00:01<00:05, 15.04it/s, loss=5.2, v_num=1, val_acc=0.651]
Epoch 1:  24%|██▍       | 28/117 [00:01<00:05, 14.84it/s, loss=5.09, v_num=1, val_acc=0.651]
Epoch 1:  25%|██▍       | 29/117 [00:01<00:05, 15.29it/s, loss=5.09, v_num=1, val_acc=0.651]
Epoch 1:  25%|██▍       | 29/117 [00:01<00:05, 15.09it/s, loss=4.98, v_num=1, val_acc=0.651]
Epoch 1:  26%|██▌       | 30/117 [00:01<00:05, 15.54it/s, loss=4.98, v_num=1, val_acc=0.651]
Epoch 1:  26%|██▌       | 30/117 [00:01<00:05, 15.34it/s, loss=4.8, v_num=1, val_acc=0.651]
Epoch 1:  26%|██▋       | 31/117 [00:01<00:05, 15.77it/s, loss=4.8, v_num=1, val_acc=0.651]
Epoch 1:  26%|██▋       | 31/117 [00:01<00:05, 15.57it/s, loss=4.71, v_num=1, val_acc=0.651]
Epoch 1:  27%|██▋       | 32/117 [00:01<00:05, 16.00it/s, loss=4.71, v_num=1, val_acc=0.651]
Epoch 1:  27%|██▋       | 32/117 [00:02<00:05, 15.80it/s, loss=4.59, v_num=1, val_acc=0.651]
Epoch 1:  28%|██▊       | 33/117 [00:02<00:05, 16.22it/s, loss=4.59, v_num=1, val_acc=0.651]
Epoch 1:  28%|██▊       | 33/117 [00:02<00:05, 16.02it/s, loss=4.33, v_num=1, val_acc=0.651]
Epoch 1:  29%|██▉       | 34/117 [00:02<00:05, 16.43it/s, loss=4.33, v_num=1, val_acc=0.651]
Epoch 1:  29%|██▉       | 34/117 [00:02<00:05, 16.24it/s, loss=4.13, v_num=1, val_acc=0.651]
Epoch 1:  30%|██▉       | 35/117 [00:02<00:04, 16.64it/s, loss=4.13, v_num=1, val_acc=0.651]
Epoch 1:  30%|██▉       | 35/117 [00:02<00:04, 16.44it/s, loss=4, v_num=1, val_acc=0.651]
Epoch 1:  31%|███       | 36/117 [00:02<00:04, 16.84it/s, loss=4, v_num=1, val_acc=0.651]
Epoch 1:  31%|███       | 36/117 [00:02<00:04, 16.64it/s, loss=3.99, v_num=1, val_acc=0.651]
Epoch 1:  32%|███▏      | 37/117 [00:02<00:04, 17.03it/s, loss=3.99, v_num=1, val_acc=0.651]
Epoch 1:  32%|███▏      | 37/117 [00:02<00:04, 16.83it/s, loss=4.03, v_num=1, val_acc=0.651]
Epoch 1:  32%|███▏      | 38/117 [00:02<00:04, 17.22it/s, loss=4.03, v_num=1, val_acc=0.651]
Epoch 1:  32%|███▏      | 38/117 [00:02<00:04, 17.02it/s, loss=4.08, v_num=1, val_acc=0.651]
Epoch 1:  33%|███▎      | 39/117 [00:02<00:04, 17.35it/s, loss=4.08, v_num=1, val_acc=0.651]
Epoch 1:  33%|███▎      | 39/117 [00:02<00:04, 17.17it/s, loss=4.13, v_num=1, val_acc=0.651]
Epoch 1:  34%|███▍      | 40/117 [00:02<00:04, 17.54it/s, loss=4.13, v_num=1, val_acc=0.651]
Epoch 1:  34%|███▍      | 40/117 [00:02<00:04, 17.35it/s, loss=4.16, v_num=1, val_acc=0.651]
Epoch 1:  35%|███▌      | 41/117 [00:02<00:04, 17.71it/s, loss=4.16, v_num=1, val_acc=0.651]
Epoch 1:  35%|███▌      | 41/117 [00:02<00:04, 17.52it/s, loss=4.1, v_num=1, val_acc=0.651]
Epoch 1:  36%|███▌      | 42/117 [00:02<00:04, 17.88it/s, loss=4.1, v_num=1, val_acc=0.651]
Epoch 1:  36%|███▌      | 42/117 [00:02<00:04, 17.69it/s, loss=4.09, v_num=1, val_acc=0.651]
Epoch 1:  37%|███▋      | 43/117 [00:02<00:04, 18.04it/s, loss=4.09, v_num=1, val_acc=0.651]
Epoch 1:  37%|███▋      | 43/117 [00:02<00:04, 17.85it/s, loss=4.05, v_num=1, val_acc=0.651]
Epoch 1:  38%|███▊      | 44/117 [00:02<00:04, 18.19it/s, loss=4.05, v_num=1, val_acc=0.651]
Epoch 1:  38%|███▊      | 44/117 [00:02<00:04, 18.01it/s, loss=4, v_num=1, val_acc=0.651]
Epoch 1:  38%|███▊      | 45/117 [00:02<00:03, 18.34it/s, loss=4, v_num=1, val_acc=0.651]
Epoch 1:  38%|███▊      | 45/117 [00:02<00:03, 18.16it/s, loss=4.05, v_num=1, val_acc=0.651]
Epoch 1:  39%|███▉      | 46/117 [00:02<00:03, 18.49it/s, loss=4.05, v_num=1, val_acc=0.651]
Epoch 1:  39%|███▉      | 46/117 [00:02<00:03, 18.30it/s, loss=4.13, v_num=1, val_acc=0.651]
Epoch 1:  40%|████      | 47/117 [00:02<00:03, 18.63it/s, loss=4.13, v_num=1, val_acc=0.651]
Epoch 1:  40%|████      | 47/117 [00:02<00:03, 18.45it/s, loss=4.15, v_num=1, val_acc=0.651]
Epoch 1:  41%|████      | 48/117 [00:02<00:03, 18.77it/s, loss=4.15, v_num=1, val_acc=0.651]
Epoch 1:  41%|████      | 48/117 [00:02<00:03, 18.59it/s, loss=4.38, v_num=1, val_acc=0.651]
Epoch 1:  42%|████▏     | 49/117 [00:02<00:03, 18.91it/s, loss=4.38, v_num=1, val_acc=0.651]
Epoch 1:  42%|████▏     | 49/117 [00:02<00:03, 18.73it/s, loss=4.35, v_num=1, val_acc=0.651]
Epoch 1:  43%|████▎     | 50/117 [00:02<00:03, 19.04it/s, loss=4.35, v_num=1, val_acc=0.651]
Epoch 1:  43%|████▎     | 50/117 [00:02<00:03, 18.86it/s, loss=4.28, v_num=1, val_acc=0.651]
Epoch 1:  44%|████▎     | 51/117 [00:02<00:03, 19.17it/s, loss=4.28, v_num=1, val_acc=0.651]
Epoch 1:  44%|████▎     | 51/117 [00:02<00:03, 18.99it/s, loss=4.21, v_num=1, val_acc=0.651]
Epoch 1:  44%|████▍     | 52/117 [00:02<00:03, 19.25it/s, loss=4.21, v_num=1, val_acc=0.651]
Epoch 1:  44%|████▍     | 52/117 [00:02<00:03, 19.11it/s, loss=4.32, v_num=1, val_acc=0.651]
Epoch 1:  45%|████▌     | 53/117 [00:02<00:03, 19.38it/s, loss=4.32, v_num=1, val_acc=0.651]
Epoch 1:  45%|████▌     | 53/117 [00:02<00:03, 19.22it/s, loss=4.46, v_num=1, val_acc=0.651]
Epoch 1:  46%|████▌     | 54/117 [00:02<00:03, 19.33it/s, loss=4.46, v_num=1, val_acc=0.651]
Epoch 1:  46%|████▌     | 54/117 [00:02<00:03, 19.19it/s, loss=4.48, v_num=1, val_acc=0.651]
Epoch 1:  47%|████▋     | 55/117 [00:02<00:03, 19.36it/s, loss=4.48, v_num=1, val_acc=0.651]
Epoch 1:  47%|████▋     | 55/117 [00:02<00:03, 19.24it/s, loss=4.46, v_num=1, val_acc=0.651]
Epoch 1:  48%|████▊     | 56/117 [00:02<00:03, 19.43it/s, loss=4.46, v_num=1, val_acc=0.651]
Epoch 1:  48%|████▊     | 56/117 [00:02<00:03, 19.33it/s, loss=4.36, v_num=1, val_acc=0.651]
Epoch 1:  49%|████▊     | 57/117 [00:02<00:03, 19.56it/s, loss=4.36, v_num=1, val_acc=0.651]
Epoch 1:  49%|████▊     | 57/117 [00:02<00:03, 19.40it/s, loss=4.25, v_num=1, val_acc=0.651]
Epoch 1:  50%|████▉     | 58/117 [00:02<00:03, 19.67it/s, loss=4.25, v_num=1, val_acc=0.651]
Epoch 1:  50%|████▉     | 58/117 [00:02<00:03, 19.50it/s, loss=4.26, v_num=1, val_acc=0.651]
Epoch 1:  50%|█████     | 59/117 [00:02<00:02, 19.77it/s, loss=4.26, v_num=1, val_acc=0.651]
Epoch 1:  50%|█████     | 59/117 [00:03<00:02, 19.61it/s, loss=4.35, v_num=1, val_acc=0.651]
Epoch 1:  51%|█████▏    | 60/117 [00:03<00:02, 19.87it/s, loss=4.35, v_num=1, val_acc=0.651]
Epoch 1:  51%|█████▏    | 60/117 [00:03<00:02, 19.71it/s, loss=4.47, v_num=1, val_acc=0.651]
Epoch 1:  52%|█████▏    | 61/117 [00:03<00:02, 19.97it/s, loss=4.47, v_num=1, val_acc=0.651]
Epoch 1:  52%|█████▏    | 61/117 [00:03<00:02, 19.81it/s, loss=4.53, v_num=1, val_acc=0.651]
Epoch 1:  53%|█████▎    | 62/117 [00:03<00:02, 20.02it/s, loss=4.53, v_num=1, val_acc=0.651]
Epoch 1:  53%|█████▎    | 62/117 [00:03<00:02, 19.89it/s, loss=4.53, v_num=1, val_acc=0.651]
Epoch 1:  54%|█████▍    | 63/117 [00:03<00:02, 20.06it/s, loss=4.53, v_num=1, val_acc=0.651]
Epoch 1:  54%|█████▍    | 63/117 [00:03<00:02, 19.92it/s, loss=4.46, v_num=1, val_acc=0.651]
Epoch 1:  55%|█████▍    | 64/117 [00:03<00:02, 20.09it/s, loss=4.46, v_num=1, val_acc=0.651]
Epoch 1:  55%|█████▍    | 64/117 [00:03<00:02, 19.98it/s, loss=4.35, v_num=1, val_acc=0.651]
Epoch 1:  56%|█████▌    | 65/117 [00:03<00:02, 20.20it/s, loss=4.35, v_num=1, val_acc=0.651]
Epoch 1:  56%|█████▌    | 65/117 [00:03<00:02, 20.06it/s, loss=4.4, v_num=1, val_acc=0.651]
Epoch 1:  56%|█████▋    | 66/117 [00:03<00:02, 20.29it/s, loss=4.4, v_num=1, val_acc=0.651]
Epoch 1:  56%|█████▋    | 66/117 [00:03<00:02, 20.15it/s, loss=4.42, v_num=1, val_acc=0.651]
Epoch 1:  57%|█████▋    | 67/117 [00:03<00:02, 20.37it/s, loss=4.42, v_num=1, val_acc=0.651]
Epoch 1:  57%|█████▋    | 67/117 [00:03<00:02, 20.23it/s, loss=4.45, v_num=1, val_acc=0.651]
Epoch 1:  58%|█████▊    | 68/117 [00:03<00:02, 20.43it/s, loss=4.45, v_num=1, val_acc=0.651]
Epoch 1:  58%|█████▊    | 68/117 [00:03<00:02, 20.31it/s, loss=4.32, v_num=1, val_acc=0.651]
Epoch 1:  59%|█████▉    | 69/117 [00:03<00:02, 20.48it/s, loss=4.32, v_num=1, val_acc=0.651]
Epoch 1:  59%|█████▉    | 69/117 [00:03<00:02, 20.38it/s, loss=4.3, v_num=1, val_acc=0.651]
Epoch 1:  60%|█████▉    | 70/117 [00:03<00:02, 20.60it/s, loss=4.3, v_num=1, val_acc=0.651]
Epoch 1:  60%|█████▉    | 70/117 [00:03<00:02, 20.46it/s, loss=4.44, v_num=1, val_acc=0.651]
Epoch 1:  61%|██████    | 71/117 [00:03<00:02, 20.68it/s, loss=4.44, v_num=1, val_acc=0.651]
Epoch 1:  61%|██████    | 71/117 [00:03<00:02, 20.53it/s, loss=4.46, v_num=1, val_acc=0.651]
Epoch 1:  62%|██████▏   | 72/117 [00:03<00:02, 20.74it/s, loss=4.46, v_num=1, val_acc=0.651]
Epoch 1:  62%|██████▏   | 72/117 [00:03<00:02, 20.60it/s, loss=4.38, v_num=1, val_acc=0.651]
Epoch 1:  62%|██████▏   | 73/117 [00:03<00:02, 20.82it/s, loss=4.38, v_num=1, val_acc=0.651]
Epoch 1:  62%|██████▏   | 73/117 [00:03<00:02, 20.67it/s, loss=4.27, v_num=1, val_acc=0.651]
Epoch 1:  63%|██████▎   | 74/117 [00:03<00:02, 20.88it/s, loss=4.27, v_num=1, val_acc=0.651]
Epoch 1:  63%|██████▎   | 74/117 [00:03<00:02, 20.73it/s, loss=4.3, v_num=1, val_acc=0.651]
Epoch 1:  64%|██████▍   | 75/117 [00:03<00:02, 20.94it/s, loss=4.3, v_num=1, val_acc=0.651]
Epoch 1:  64%|██████▍   | 75/117 [00:03<00:02, 20.80it/s, loss=4.35, v_num=1, val_acc=0.651]
Epoch 1:  65%|██████▍   | 76/117 [00:03<00:01, 21.01it/s, loss=4.35, v_num=1, val_acc=0.651]
Epoch 1:  65%|██████▍   | 76/117 [00:03<00:01, 20.87it/s, loss=4.44, v_num=1, val_acc=0.651]
Epoch 1:  66%|██████▌   | 77/117 [00:03<00:01, 21.07it/s, loss=4.44, v_num=1, val_acc=0.651]
Epoch 1:  66%|██████▌   | 77/117 [00:03<00:01, 20.93it/s, loss=4.5, v_num=1, val_acc=0.651]
Epoch 1:  67%|██████▋   | 78/117 [00:03<00:01, 21.13it/s, loss=4.5, v_num=1, val_acc=0.651]
Epoch 1:  67%|██████▋   | 78/117 [00:03<00:01, 20.99it/s, loss=4.54, v_num=1, val_acc=0.651]
Epoch 1:  68%|██████▊   | 79/117 [00:03<00:01, 21.20it/s, loss=4.54, v_num=1, val_acc=0.651]
Epoch 1:  68%|██████▊   | 79/117 [00:03<00:01, 21.06it/s, loss=4.62, v_num=1, val_acc=0.651]
Epoch 1:  68%|██████▊   | 80/117 [00:03<00:01, 21.19it/s, loss=4.62, v_num=1, val_acc=0.651]
Epoch 1:  68%|██████▊   | 80/117 [00:03<00:01, 21.09it/s, loss=4.62, v_num=1, val_acc=0.651]
Epoch 1:  69%|██████▉   | 81/117 [00:03<00:01, 21.29it/s, loss=4.62, v_num=1, val_acc=0.651]
Epoch 1:  69%|██████▉   | 81/117 [00:03<00:01, 21.15it/s, loss=4.63, v_num=1, val_acc=0.651]
Epoch 1:  70%|███████   | 82/117 [00:03<00:01, 21.29it/s, loss=4.63, v_num=1, val_acc=0.651]
Epoch 1:  70%|███████   | 82/117 [00:03<00:01, 21.17it/s, loss=4.61, v_num=1, val_acc=0.651]
Epoch 1:  71%|███████   | 83/117 [00:03<00:01, 21.36it/s, loss=4.61, v_num=1, val_acc=0.651]
Epoch 1:  71%|███████   | 83/117 [00:03<00:01, 21.23it/s, loss=4.72, v_num=1, val_acc=0.651]
Epoch 1:  72%|███████▏  | 84/117 [00:03<00:01, 21.40it/s, loss=4.72, v_num=1, val_acc=0.651]
Epoch 1:  72%|███████▏  | 84/117 [00:03<00:01, 21.28it/s, loss=4.79, v_num=1, val_acc=0.651]
Epoch 1:  73%|███████▎  | 85/117 [00:03<00:01, 21.45it/s, loss=4.79, v_num=1, val_acc=0.651]
Epoch 1:  73%|███████▎  | 85/117 [00:03<00:01, 21.33it/s, loss=4.68, v_num=1, val_acc=0.651]
Epoch 1:  74%|███████▎  | 86/117 [00:03<00:01, 21.52it/s, loss=4.68, v_num=1, val_acc=0.651]
Epoch 1:  74%|███████▎  | 86/117 [00:04<00:01, 21.39it/s, loss=4.5, v_num=1, val_acc=0.651]
Epoch 1:  74%|███████▍  | 87/117 [00:04<00:01, 21.58it/s, loss=4.5, v_num=1, val_acc=0.651]
Epoch 1:  74%|███████▍  | 87/117 [00:04<00:01, 21.45it/s, loss=4.38, v_num=1, val_acc=0.651]
Epoch 1:  75%|███████▌  | 88/117 [00:04<00:01, 21.64it/s, loss=4.38, v_num=1, val_acc=0.651]
Epoch 1:  75%|███████▌  | 88/117 [00:04<00:01, 21.51it/s, loss=4.29, v_num=1, val_acc=0.651]
Epoch 1:  76%|███████▌  | 89/117 [00:04<00:01, 21.70it/s, loss=4.29, v_num=1, val_acc=0.651]
Epoch 1:  76%|███████▌  | 89/117 [00:04<00:01, 21.57it/s, loss=4.3, v_num=1, val_acc=0.651]
Epoch 1:  77%|███████▋  | 90/117 [00:04<00:01, 21.76it/s, loss=4.3, v_num=1, val_acc=0.651]
Epoch 1:  77%|███████▋  | 90/117 [00:04<00:01, 21.63it/s, loss=4.19, v_num=1, val_acc=0.651]
Epoch 1:  78%|███████▊  | 91/117 [00:04<00:01, 21.81it/s, loss=4.19, v_num=1, val_acc=0.651]
Epoch 1:  78%|███████▊  | 91/117 [00:04<00:01, 21.68it/s, loss=4.14, v_num=1, val_acc=0.651]
Epoch 1:  79%|███████▊  | 92/117 [00:04<00:01, 21.87it/s, loss=4.14, v_num=1, val_acc=0.651]
Epoch 1:  79%|███████▊  | 92/117 [00:04<00:01, 21.74it/s, loss=4.11, v_num=1, val_acc=0.651]
Epoch 1:  79%|███████▉  | 93/117 [00:04<00:01, 21.92it/s, loss=4.11, v_num=1, val_acc=0.651]
Epoch 1:  79%|███████▉  | 93/117 [00:04<00:01, 21.79it/s, loss=4.14, v_num=1, val_acc=0.651]
Epoch 1:  80%|████████  | 94/117 [00:04<00:01, 21.97it/s, loss=4.14, v_num=1, val_acc=0.651]
Epoch 1:  80%|████████  | 94/117 [00:04<00:01, 21.84it/s, loss=4.18, v_num=1, val_acc=0.651]
Epoch 1:  81%|████████  | 95/117 [00:04<00:00, 22.02it/s, loss=4.18, v_num=1, val_acc=0.651]
Epoch 1:  81%|████████  | 95/117 [00:04<00:01, 21.90it/s, loss=4.09, v_num=1, val_acc=0.651]
Epoch 1:  82%|████████▏ | 96/117 [00:04<00:00, 22.07it/s, loss=4.09, v_num=1, val_acc=0.651]
Epoch 1:  82%|████████▏ | 96/117 [00:04<00:00, 21.95it/s, loss=3.97, v_num=1, val_acc=0.651]
Epoch 1:  83%|████████▎ | 97/117 [00:04<00:00, 22.12it/s, loss=3.97, v_num=1, val_acc=0.651]
Epoch 1:  83%|████████▎ | 97/117 [00:04<00:00, 22.00it/s, loss=3.92, v_num=1, val_acc=0.651]

Validation: 0it [00:00, ?it/s]

Validation:   0%|          | 0/20 [00:00<?, ?it/s]

Validation DataLoader 0:   0%|          | 0/20 [00:00<?, ?it/s]

Validation DataLoader 0:   5%|▌         | 1/20 [00:00<00:00, 100.51it/s]
Epoch 1:  84%|████████▍ | 98/117 [00:05<00:01, 18.21it/s, loss=3.92, v_num=1, val_acc=0.651]

Validation DataLoader 0:  10%|█         | 2/20 [00:00<00:00, 47.08it/s]
Epoch 1:  85%|████████▍ | 99/117 [00:05<00:00, 18.29it/s, loss=3.92, v_num=1, val_acc=0.651]

Validation DataLoader 0:  15%|█▌        | 3/20 [00:00<00:00, 39.22it/s]
Epoch 1:  85%|████████▌ | 100/117 [00:05<00:00, 18.36it/s, loss=3.92, v_num=1, val_acc=0.651]

Validation DataLoader 0:  20%|██        | 4/20 [00:00<00:00, 36.24it/s]
Epoch 1:  86%|████████▋ | 101/117 [00:05<00:00, 18.43it/s, loss=3.92, v_num=1, val_acc=0.651]

Validation DataLoader 0:  25%|██▌       | 5/20 [00:00<00:00, 35.32it/s]
Epoch 1:  87%|████████▋ | 102/117 [00:05<00:00, 18.51it/s, loss=3.92, v_num=1, val_acc=0.651]

Validation DataLoader 0:  30%|███       | 6/20 [00:00<00:00, 34.34it/s]
Epoch 1:  88%|████████▊ | 103/117 [00:05<00:00, 18.58it/s, loss=3.92, v_num=1, val_acc=0.651]

Validation DataLoader 0:  35%|███▌      | 7/20 [00:00<00:00, 33.83it/s]
Epoch 1:  89%|████████▉ | 104/117 [00:05<00:00, 18.65it/s, loss=3.92, v_num=1, val_acc=0.651]

Validation DataLoader 0:  40%|████      | 8/20 [00:00<00:00, 33.45it/s]
Epoch 1:  90%|████████▉ | 105/117 [00:05<00:00, 18.72it/s, loss=3.92, v_num=1, val_acc=0.651]

Validation DataLoader 0:  45%|████▌     | 9/20 [00:00<00:00, 33.05it/s]
Epoch 1:  91%|█████████ | 106/117 [00:05<00:00, 18.79it/s, loss=3.92, v_num=1, val_acc=0.651]

Validation DataLoader 0:  50%|█████     | 10/20 [00:00<00:00, 32.88it/s]
Epoch 1:  91%|█████████▏| 107/117 [00:05<00:00, 18.86it/s, loss=3.92, v_num=1, val_acc=0.651]

Validation DataLoader 0:  55%|█████▌    | 11/20 [00:00<00:00, 32.73it/s]
Epoch 1:  92%|█████████▏| 108/117 [00:05<00:00, 18.93it/s, loss=3.92, v_num=1, val_acc=0.651]

Validation DataLoader 0:  60%|██████    | 12/20 [00:00<00:00, 32.52it/s]
Epoch 1:  93%|█████████▎| 109/117 [00:05<00:00, 18.99it/s, loss=3.92, v_num=1, val_acc=0.651]

Validation DataLoader 0:  65%|██████▌   | 13/20 [00:00<00:00, 32.42it/s]
Epoch 1:  94%|█████████▍| 110/117 [00:05<00:00, 19.06it/s, loss=3.92, v_num=1, val_acc=0.651]

Validation DataLoader 0:  70%|███████   | 14/20 [00:00<00:00, 32.30it/s]
Epoch 1:  95%|█████████▍| 111/117 [00:05<00:00, 19.13it/s, loss=3.92, v_num=1, val_acc=0.651]

Validation DataLoader 0:  75%|███████▌  | 15/20 [00:00<00:00, 32.20it/s]
Epoch 1:  96%|█████████▌| 112/117 [00:05<00:00, 19.19it/s, loss=3.92, v_num=1, val_acc=0.651]

Validation DataLoader 0:  80%|████████  | 16/20 [00:00<00:00, 32.11it/s]
Epoch 1:  97%|█████████▋| 113/117 [00:05<00:00, 19.26it/s, loss=3.92, v_num=1, val_acc=0.651]

Validation DataLoader 0:  85%|████████▌ | 17/20 [00:00<00:00, 32.03it/s]
Epoch 1:  97%|█████████▋| 114/117 [00:05<00:00, 19.32it/s, loss=3.92, v_num=1, val_acc=0.651]

Validation DataLoader 0:  90%|█████████ | 18/20 [00:00<00:00, 31.98it/s]
Epoch 1:  98%|█████████▊| 115/117 [00:05<00:00, 19.38it/s, loss=3.92, v_num=1, val_acc=0.651]

Validation DataLoader 0:  95%|█████████▌| 19/20 [00:00<00:00, 31.92it/s]
Epoch 1:  99%|█████████▉| 116/117 [00:05<00:00, 19.45it/s, loss=3.92, v_num=1, val_acc=0.651]

Validation DataLoader 0: 100%|██████████| 20/20 [00:00<00:00, 31.94it/s]
Epoch 1: 100%|██████████| 117/117 [00:05<00:00, 19.51it/s, loss=3.92, v_num=1, val_acc=0.651]
Epoch 1: 100%|██████████| 117/117 [00:06<00:00, 19.43it/s, loss=3.92, v_num=1, val_acc=0.587]


Epoch 1: 100%|██████████| 117/117 [00:06<00:00, 19.43it/s, loss=3.92, v_num=1, val_acc=0.587]
Epoch 1:   0%|          | 0/117 [00:00<?, ?it/s, loss=3.92, v_num=1, val_acc=0.587]
Epoch 2:   0%|          | 0/117 [00:00<?, ?it/s, loss=3.92, v_num=1, val_acc=0.587]
Epoch 2:   1%|          | 1/117 [00:00<01:54,  1.01it/s, loss=3.92, v_num=1, val_acc=0.587]
Epoch 2:   1%|          | 1/117 [00:01<01:57,  1.01s/it, loss=3.87, v_num=1, val_acc=0.587]
Epoch 2:   2%|▏         | 2/117 [00:01<00:58,  1.95it/s, loss=3.87, v_num=1, val_acc=0.587]
Epoch 2:   2%|▏         | 2/117 [00:01<01:00,  1.91it/s, loss=3.76, v_num=1, val_acc=0.587]
Epoch 2:   3%|▎         | 3/117 [00:01<00:40,  2.84it/s, loss=3.76, v_num=1, val_acc=0.587]
Epoch 2:   3%|▎         | 3/117 [00:01<00:41,  2.77it/s, loss=3.65, v_num=1, val_acc=0.587]
Epoch 2:   3%|▎         | 4/117 [00:01<00:32,  3.50it/s, loss=3.65, v_num=1, val_acc=0.587]
Epoch 2:   3%|▎         | 4/117 [00:01<00:32,  3.44it/s, loss=3.63, v_num=1, val_acc=0.587]
Epoch 2:   4%|▍         | 5/117 [00:01<00:26,  4.25it/s, loss=3.63, v_num=1, val_acc=0.587]
Epoch 2:   4%|▍         | 5/117 [00:01<00:26,  4.18it/s, loss=3.64, v_num=1, val_acc=0.587]
Epoch 2:   5%|▌         | 6/117 [00:01<00:22,  4.96it/s, loss=3.64, v_num=1, val_acc=0.587]
Epoch 2:   5%|▌         | 6/117 [00:01<00:22,  4.86it/s, loss=3.55, v_num=1, val_acc=0.587]
Epoch 2:   6%|▌         | 7/117 [00:01<00:19,  5.62it/s, loss=3.55, v_num=1, val_acc=0.587]
Epoch 2:   6%|▌         | 7/117 [00:01<00:19,  5.51it/s, loss=3.45, v_num=1, val_acc=0.587]
Epoch 2:   7%|▋         | 8/117 [00:01<00:17,  6.26it/s, loss=3.45, v_num=1, val_acc=0.587]
Epoch 2:   7%|▋         | 8/117 [00:01<00:17,  6.14it/s, loss=3.52, v_num=1, val_acc=0.587]
Epoch 2:   8%|▊         | 9/117 [00:01<00:15,  6.85it/s, loss=3.52, v_num=1, val_acc=0.587]
Epoch 2:   8%|▊         | 9/117 [00:01<00:16,  6.72it/s, loss=3.55, v_num=1, val_acc=0.587]
Epoch 2:   9%|▊         | 10/117 [00:01<00:14,  7.38it/s, loss=3.55, v_num=1, val_acc=0.587]
Epoch 2:   9%|▊         | 10/117 [00:01<00:14,  7.25it/s, loss=3.55, v_num=1, val_acc=0.587]
Epoch 2:   9%|▉         | 11/117 [00:01<00:13,  7.93it/s, loss=3.55, v_num=1, val_acc=0.587]
Epoch 2:   9%|▉         | 11/117 [00:01<00:13,  7.79it/s, loss=3.61, v_num=1, val_acc=0.587]
Epoch 2:  10%|█         | 12/117 [00:01<00:12,  8.44it/s, loss=3.61, v_num=1, val_acc=0.587]
Epoch 2:  10%|█         | 12/117 [00:01<00:12,  8.30it/s, loss=3.62, v_num=1, val_acc=0.587]
Epoch 2:  11%|█         | 13/117 [00:01<00:11,  8.94it/s, loss=3.62, v_num=1, val_acc=0.587]
Epoch 2:  11%|█         | 13/117 [00:01<00:11,  8.78it/s, loss=3.73, v_num=1, val_acc=0.587]
Epoch 2:  12%|█▏        | 14/117 [00:01<00:10,  9.41it/s, loss=3.73, v_num=1, val_acc=0.587]
Epoch 2:  12%|█▏        | 14/117 [00:01<00:11,  9.25it/s, loss=3.91, v_num=1, val_acc=0.587]
Epoch 2:  13%|█▎        | 15/117 [00:01<00:10,  9.85it/s, loss=3.91, v_num=1, val_acc=0.587]
Epoch 2:  13%|█▎        | 15/117 [00:01<00:10,  9.69it/s, loss=4.09, v_num=1, val_acc=0.587]
Epoch 2:  14%|█▎        | 16/117 [00:01<00:09, 10.28it/s, loss=4.09, v_num=1, val_acc=0.587]
Epoch 2:  14%|█▎        | 16/117 [00:01<00:09, 10.12it/s, loss=4.22, v_num=1, val_acc=0.587]
Epoch 2:  15%|█▍        | 17/117 [00:01<00:09, 10.68it/s, loss=4.22, v_num=1, val_acc=0.587]
Epoch 2:  15%|█▍        | 17/117 [00:01<00:09, 10.52it/s, loss=4.22, v_num=1, val_acc=0.587]
Epoch 2:  15%|█▌        | 18/117 [00:01<00:08, 11.05it/s, loss=4.22, v_num=1, val_acc=0.587]
Epoch 2:  15%|█▌        | 18/117 [00:01<00:09, 10.88it/s, loss=4.28, v_num=1, val_acc=0.587]
Epoch 2:  16%|█▌        | 19/117 [00:01<00:08, 11.42it/s, loss=4.28, v_num=1, val_acc=0.587]
Epoch 2:  16%|█▌        | 19/117 [00:01<00:08, 11.26it/s, loss=4.42, v_num=1, val_acc=0.587]
Epoch 2:  17%|█▋        | 20/117 [00:01<00:08, 11.79it/s, loss=4.42, v_num=1, val_acc=0.587]
Epoch 2:  17%|█▋        | 20/117 [00:01<00:08, 11.61it/s, loss=4.43, v_num=1, val_acc=0.587]
Epoch 2:  18%|█▊        | 21/117 [00:01<00:07, 12.11it/s, loss=4.43, v_num=1, val_acc=0.587]
Epoch 2:  18%|█▊        | 21/117 [00:01<00:08, 11.94it/s, loss=4.43, v_num=1, val_acc=0.587]
Epoch 2:  19%|█▉        | 22/117 [00:01<00:07, 12.45it/s, loss=4.43, v_num=1, val_acc=0.587]
Epoch 2:  19%|█▉        | 22/117 [00:01<00:07, 12.28it/s, loss=4.49, v_num=1, val_acc=0.587]
Epoch 2:  20%|█▉        | 23/117 [00:01<00:07, 12.76it/s, loss=4.49, v_num=1, val_acc=0.587]
Epoch 2:  20%|█▉        | 23/117 [00:01<00:07, 12.59it/s, loss=4.53, v_num=1, val_acc=0.587]
Epoch 2:  21%|██        | 24/117 [00:01<00:07, 13.06it/s, loss=4.53, v_num=1, val_acc=0.587]
Epoch 2:  21%|██        | 24/117 [00:01<00:07, 12.89it/s, loss=4.54, v_num=1, val_acc=0.587]
Epoch 2:  21%|██▏       | 25/117 [00:01<00:06, 13.35it/s, loss=4.54, v_num=1, val_acc=0.587]
Epoch 2:  21%|██▏       | 25/117 [00:01<00:06, 13.18it/s, loss=4.5, v_num=1, val_acc=0.587]
Epoch 2:  22%|██▏       | 26/117 [00:01<00:06, 13.62it/s, loss=4.5, v_num=1, val_acc=0.587]
Epoch 2:  22%|██▏       | 26/117 [00:01<00:06, 13.45it/s, loss=4.51, v_num=1, val_acc=0.587]
Epoch 2:  23%|██▎       | 27/117 [00:01<00:06, 13.90it/s, loss=4.51, v_num=1, val_acc=0.587]
Epoch 2:  23%|██▎       | 27/117 [00:01<00:06, 13.73it/s, loss=4.58, v_num=1, val_acc=0.587]
Epoch 2:  24%|██▍       | 28/117 [00:01<00:06, 14.17it/s, loss=4.58, v_num=1, val_acc=0.587]
Epoch 2:  24%|██▍       | 28/117 [00:02<00:06, 13.99it/s, loss=4.46, v_num=1, val_acc=0.587]
Epoch 2:  25%|██▍       | 29/117 [00:02<00:06, 14.42it/s, loss=4.46, v_num=1, val_acc=0.587]
Epoch 2:  25%|██▍       | 29/117 [00:02<00:06, 14.24it/s, loss=4.4, v_num=1, val_acc=0.587]
Epoch 2:  26%|██▌       | 30/117 [00:02<00:05, 14.66it/s, loss=4.4, v_num=1, val_acc=0.587]
Epoch 2:  26%|██▌       | 30/117 [00:02<00:06, 14.48it/s, loss=4.33, v_num=1, val_acc=0.587]
Epoch 2:  26%|██▋       | 31/117 [00:02<00:05, 14.90it/s, loss=4.33, v_num=1, val_acc=0.587]
Epoch 2:  26%|██▋       | 31/117 [00:02<00:05, 14.72it/s, loss=4.2, v_num=1, val_acc=0.587]
Epoch 2:  27%|██▋       | 32/117 [00:02<00:05, 15.12it/s, loss=4.2, v_num=1, val_acc=0.587]
Epoch 2:  27%|██▋       | 32/117 [00:02<00:05, 14.94it/s, loss=4.05, v_num=1, val_acc=0.587]
Epoch 2:  28%|██▊       | 33/117 [00:02<00:05, 15.34it/s, loss=4.05, v_num=1, val_acc=0.587]
Epoch 2:  28%|██▊       | 33/117 [00:02<00:05, 15.17it/s, loss=3.95, v_num=1, val_acc=0.587]
Epoch 2:  29%|██▉       | 34/117 [00:02<00:05, 15.56it/s, loss=3.95, v_num=1, val_acc=0.587]
Epoch 2:  29%|██▉       | 34/117 [00:02<00:05, 15.38it/s, loss=3.79, v_num=1, val_acc=0.587]
Epoch 2:  30%|██▉       | 35/117 [00:02<00:05, 15.77it/s, loss=3.79, v_num=1, val_acc=0.587]
Epoch 2:  30%|██▉       | 35/117 [00:02<00:05, 15.59it/s, loss=3.64, v_num=1, val_acc=0.587]
Epoch 2:  31%|███       | 36/117 [00:02<00:05, 15.97it/s, loss=3.64, v_num=1, val_acc=0.587]
Epoch 2:  31%|███       | 36/117 [00:02<00:05, 15.79it/s, loss=3.64, v_num=1, val_acc=0.587]
Epoch 2:  32%|███▏      | 37/117 [00:02<00:04, 16.16it/s, loss=3.64, v_num=1, val_acc=0.587]
Epoch 2:  32%|███▏      | 37/117 [00:02<00:05, 15.99it/s, loss=3.68, v_num=1, val_acc=0.587]
Epoch 2:  32%|███▏      | 38/117 [00:02<00:04, 16.35it/s, loss=3.68, v_num=1, val_acc=0.587]
Epoch 2:  32%|███▏      | 38/117 [00:02<00:04, 16.18it/s, loss=3.7, v_num=1, val_acc=0.587]
Epoch 2:  33%|███▎      | 39/117 [00:02<00:04, 16.53it/s, loss=3.7, v_num=1, val_acc=0.587]
Epoch 2:  33%|███▎      | 39/117 [00:02<00:04, 16.36it/s, loss=3.71, v_num=1, val_acc=0.587]
Epoch 2:  34%|███▍      | 40/117 [00:02<00:04, 16.71it/s, loss=3.71, v_num=1, val_acc=0.587]
Epoch 2:  34%|███▍      | 40/117 [00:02<00:04, 16.54it/s, loss=3.76, v_num=1, val_acc=0.587]
Epoch 2:  35%|███▌      | 41/117 [00:02<00:04, 16.88it/s, loss=3.76, v_num=1, val_acc=0.587]
Epoch 2:  35%|███▌      | 41/117 [00:02<00:04, 16.71it/s, loss=3.77, v_num=1, val_acc=0.587]
Epoch 2:  36%|███▌      | 42/117 [00:02<00:04, 17.04it/s, loss=3.77, v_num=1, val_acc=0.587]
Epoch 2:  36%|███▌      | 42/117 [00:02<00:04, 16.88it/s, loss=3.81, v_num=1, val_acc=0.587]
Epoch 2:  37%|███▋      | 43/117 [00:02<00:04, 17.21it/s, loss=3.81, v_num=1, val_acc=0.587]
Epoch 2:  37%|███▋      | 43/117 [00:02<00:04, 17.04it/s, loss=3.96, v_num=1, val_acc=0.587]
Epoch 2:  38%|███▊      | 44/117 [00:02<00:04, 17.37it/s, loss=3.96, v_num=1, val_acc=0.587]
Epoch 2:  38%|███▊      | 44/117 [00:02<00:04, 17.20it/s, loss=4.1, v_num=1, val_acc=0.587]
Epoch 2:  38%|███▊      | 45/117 [00:02<00:04, 17.53it/s, loss=4.1, v_num=1, val_acc=0.587]
Epoch 2:  38%|███▊      | 45/117 [00:02<00:04, 17.36it/s, loss=4.18, v_num=1, val_acc=0.587]
Epoch 2:  39%|███▉      | 46/117 [00:02<00:04, 17.67it/s, loss=4.18, v_num=1, val_acc=0.587]
Epoch 2:  39%|███▉      | 46/117 [00:02<00:04, 17.51it/s, loss=4.17, v_num=1, val_acc=0.587]
Epoch 2:  40%|████      | 47/117 [00:02<00:03, 17.79it/s, loss=4.17, v_num=1, val_acc=0.587]
Epoch 2:  40%|████      | 47/117 [00:02<00:03, 17.64it/s, loss=4.15, v_num=1, val_acc=0.587]
Epoch 2:  41%|████      | 48/117 [00:02<00:03, 17.95it/s, loss=4.15, v_num=1, val_acc=0.587]
Epoch 2:  41%|████      | 48/117 [00:02<00:03, 17.78it/s, loss=4.27, v_num=1, val_acc=0.587]
Epoch 2:  42%|████▏     | 49/117 [00:02<00:03, 18.08it/s, loss=4.27, v_num=1, val_acc=0.587]
Epoch 2:  42%|████▏     | 49/117 [00:02<00:03, 17.91it/s, loss=4.35, v_num=1, val_acc=0.587]
Epoch 2:  43%|████▎     | 50/117 [00:02<00:03, 18.21it/s, loss=4.35, v_num=1, val_acc=0.587]
Epoch 2:  43%|████▎     | 50/117 [00:02<00:03, 18.05it/s, loss=4.34, v_num=1, val_acc=0.587]
Epoch 2:  44%|████▎     | 51/117 [00:02<00:03, 18.34it/s, loss=4.34, v_num=1, val_acc=0.587]
Epoch 2:  44%|████▎     | 51/117 [00:02<00:03, 18.17it/s, loss=4.43, v_num=1, val_acc=0.587]
Epoch 2:  44%|████▍     | 52/117 [00:02<00:03, 18.44it/s, loss=4.43, v_num=1, val_acc=0.587]
Epoch 2:  44%|████▍     | 52/117 [00:02<00:03, 18.28it/s, loss=4.49, v_num=1, val_acc=0.587]
Epoch 2:  45%|████▌     | 53/117 [00:02<00:03, 18.55it/s, loss=4.49, v_num=1, val_acc=0.587]
Epoch 2:  45%|████▌     | 53/117 [00:02<00:03, 18.39it/s, loss=4.5, v_num=1, val_acc=0.587]
Epoch 2:  46%|████▌     | 54/117 [00:02<00:03, 18.67it/s, loss=4.5, v_num=1, val_acc=0.587]
Epoch 2:  46%|████▌     | 54/117 [00:02<00:03, 18.51it/s, loss=4.46, v_num=1, val_acc=0.587]
Epoch 2:  47%|████▋     | 55/117 [00:02<00:03, 18.79it/s, loss=4.46, v_num=1, val_acc=0.587]
Epoch 2:  47%|████▋     | 55/117 [00:02<00:03, 18.63it/s, loss=4.43, v_num=1, val_acc=0.587]
Epoch 2:  48%|████▊     | 56/117 [00:02<00:03, 18.90it/s, loss=4.43, v_num=1, val_acc=0.587]
Epoch 2:  48%|████▊     | 56/117 [00:02<00:03, 18.75it/s, loss=4.29, v_num=1, val_acc=0.587]
Epoch 2:  49%|████▊     | 57/117 [00:02<00:03, 19.01it/s, loss=4.29, v_num=1, val_acc=0.587]
Epoch 2:  49%|████▊     | 57/117 [00:03<00:03, 18.86it/s, loss=4.28, v_num=1, val_acc=0.587]
Epoch 2:  50%|████▉     | 58/117 [00:03<00:03, 19.12it/s, loss=4.28, v_num=1, val_acc=0.587]
Epoch 2:  50%|████▉     | 58/117 [00:03<00:03, 18.97it/s, loss=4.24, v_num=1, val_acc=0.587]
Epoch 2:  50%|█████     | 59/117 [00:03<00:03, 19.23it/s, loss=4.24, v_num=1, val_acc=0.587]
Epoch 2:  50%|█████     | 59/117 [00:03<00:03, 19.08it/s, loss=4.24, v_num=1, val_acc=0.587]
Epoch 2:  51%|█████▏    | 60/117 [00:03<00:02, 19.34it/s, loss=4.24, v_num=1, val_acc=0.587]
Epoch 2:  51%|█████▏    | 60/117 [00:03<00:02, 19.19it/s, loss=4.22, v_num=1, val_acc=0.587]
Epoch 2:  52%|█████▏    | 61/117 [00:03<00:02, 19.45it/s, loss=4.22, v_num=1, val_acc=0.587]
Epoch 2:  52%|█████▏    | 61/117 [00:03<00:02, 19.29it/s, loss=4.21, v_num=1, val_acc=0.587]
Epoch 2:  53%|█████▎    | 62/117 [00:03<00:02, 19.55it/s, loss=4.21, v_num=1, val_acc=0.587]
Epoch 2:  53%|█████▎    | 62/117 [00:03<00:02, 19.40it/s, loss=4.12, v_num=1, val_acc=0.587]
Epoch 2:  54%|█████▍    | 63/117 [00:03<00:02, 19.65it/s, loss=4.12, v_num=1, val_acc=0.587]
Epoch 2:  54%|█████▍    | 63/117 [00:03<00:02, 19.50it/s, loss=3.98, v_num=1, val_acc=0.587]
Epoch 2:  55%|█████▍    | 64/117 [00:03<00:02, 19.75it/s, loss=3.98, v_num=1, val_acc=0.587]
Epoch 2:  55%|█████▍    | 64/117 [00:03<00:02, 19.60it/s, loss=3.74, v_num=1, val_acc=0.587]
Epoch 2:  56%|█████▌    | 65/117 [00:03<00:02, 19.85it/s, loss=3.74, v_num=1, val_acc=0.587]
Epoch 2:  56%|█████▌    | 65/117 [00:03<00:02, 19.70it/s, loss=3.61, v_num=1, val_acc=0.587]
Epoch 2:  56%|█████▋    | 66/117 [00:03<00:02, 19.95it/s, loss=3.61, v_num=1, val_acc=0.587]
Epoch 2:  56%|█████▋    | 66/117 [00:03<00:02, 19.80it/s, loss=3.6, v_num=1, val_acc=0.587]
Epoch 2:  57%|█████▋    | 67/117 [00:03<00:02, 20.04it/s, loss=3.6, v_num=1, val_acc=0.587]
Epoch 2:  57%|█████▋    | 67/117 [00:03<00:02, 19.89it/s, loss=3.52, v_num=1, val_acc=0.587]
Epoch 2:  58%|█████▊    | 68/117 [00:03<00:02, 20.13it/s, loss=3.52, v_num=1, val_acc=0.587]
Epoch 2:  58%|█████▊    | 68/117 [00:03<00:02, 19.98it/s, loss=3.46, v_num=1, val_acc=0.587]
Epoch 2:  59%|█████▉    | 69/117 [00:03<00:02, 20.22it/s, loss=3.46, v_num=1, val_acc=0.587]
Epoch 2:  59%|█████▉    | 69/117 [00:03<00:02, 20.07it/s, loss=3.47, v_num=1, val_acc=0.587]
Epoch 2:  60%|█████▉    | 70/117 [00:03<00:02, 20.31it/s, loss=3.47, v_num=1, val_acc=0.587]
Epoch 2:  60%|█████▉    | 70/117 [00:03<00:02, 20.16it/s, loss=3.54, v_num=1, val_acc=0.587]
Epoch 2:  61%|██████    | 71/117 [00:03<00:02, 20.40it/s, loss=3.54, v_num=1, val_acc=0.587]
Epoch 2:  61%|██████    | 71/117 [00:03<00:02, 20.25it/s, loss=3.49, v_num=1, val_acc=0.587]
Epoch 2:  62%|██████▏   | 72/117 [00:03<00:02, 20.48it/s, loss=3.49, v_num=1, val_acc=0.587]
Epoch 2:  62%|██████▏   | 72/117 [00:03<00:02, 20.33it/s, loss=3.42, v_num=1, val_acc=0.587]
Epoch 2:  62%|██████▏   | 73/117 [00:03<00:02, 20.56it/s, loss=3.42, v_num=1, val_acc=0.587]
Epoch 2:  62%|██████▏   | 73/117 [00:03<00:02, 20.42it/s, loss=3.32, v_num=1, val_acc=0.587]
Epoch 2:  63%|██████▎   | 74/117 [00:03<00:02, 20.64it/s, loss=3.32, v_num=1, val_acc=0.587]
Epoch 2:  63%|██████▎   | 74/117 [00:03<00:02, 20.50it/s, loss=3.32, v_num=1, val_acc=0.587]
Epoch 2:  64%|██████▍   | 75/117 [00:03<00:02, 20.72it/s, loss=3.32, v_num=1, val_acc=0.587]
Epoch 2:  64%|██████▍   | 75/117 [00:03<00:02, 20.58it/s, loss=3.38, v_num=1, val_acc=0.587]
Epoch 2:  65%|██████▍   | 76/117 [00:03<00:01, 20.80it/s, loss=3.38, v_num=1, val_acc=0.587]
Epoch 2:  65%|██████▍   | 76/117 [00:03<00:01, 20.66it/s, loss=3.39, v_num=1, val_acc=0.587]
Epoch 2:  66%|██████▌   | 77/117 [00:03<00:01, 20.88it/s, loss=3.39, v_num=1, val_acc=0.587]
Epoch 2:  66%|██████▌   | 77/117 [00:03<00:01, 20.74it/s, loss=3.34, v_num=1, val_acc=0.587]
Epoch 2:  67%|██████▋   | 78/117 [00:03<00:01, 20.95it/s, loss=3.34, v_num=1, val_acc=0.587]
Epoch 2:  67%|██████▋   | 78/117 [00:03<00:01, 20.81it/s, loss=3.44, v_num=1, val_acc=0.587]
Epoch 2:  68%|██████▊   | 79/117 [00:03<00:01, 21.03it/s, loss=3.44, v_num=1, val_acc=0.587]
Epoch 2:  68%|██████▊   | 79/117 [00:03<00:01, 20.89it/s, loss=3.38, v_num=1, val_acc=0.587]
Epoch 2:  68%|██████▊   | 80/117 [00:03<00:01, 21.10it/s, loss=3.38, v_num=1, val_acc=0.587]
Epoch 2:  68%|██████▊   | 80/117 [00:03<00:01, 20.96it/s, loss=3.41, v_num=1, val_acc=0.587]
Epoch 2:  69%|██████▉   | 81/117 [00:03<00:01, 21.17it/s, loss=3.41, v_num=1, val_acc=0.587]
Epoch 2:  69%|██████▉   | 81/117 [00:03<00:01, 21.03it/s, loss=3.38, v_num=1, val_acc=0.587]
Epoch 2:  70%|███████   | 82/117 [00:03<00:01, 21.19it/s, loss=3.38, v_num=1, val_acc=0.587]
Epoch 2:  70%|███████   | 82/117 [00:03<00:01, 21.05it/s, loss=3.36, v_num=1, val_acc=0.587]
Epoch 2:  71%|███████   | 83/117 [00:03<00:01, 21.26it/s, loss=3.36, v_num=1, val_acc=0.587]
Epoch 2:  71%|███████   | 83/117 [00:03<00:01, 21.12it/s, loss=3.39, v_num=1, val_acc=0.587]
Epoch 2:  72%|███████▏  | 84/117 [00:03<00:01, 21.33it/s, loss=3.39, v_num=1, val_acc=0.587]
Epoch 2:  72%|███████▏  | 84/117 [00:03<00:01, 21.19it/s, loss=3.53, v_num=1, val_acc=0.587]
Epoch 2:  73%|███████▎  | 85/117 [00:03<00:01, 21.40it/s, loss=3.53, v_num=1, val_acc=0.587]
Epoch 2:  73%|███████▎  | 85/117 [00:03<00:01, 21.26it/s, loss=3.56, v_num=1, val_acc=0.587]
Epoch 2:  74%|███████▎  | 86/117 [00:04<00:01, 21.46it/s, loss=3.56, v_num=1, val_acc=0.587]
Epoch 2:  74%|███████▎  | 86/117 [00:04<00:01, 21.33it/s, loss=3.56, v_num=1, val_acc=0.587]
Epoch 2:  74%|███████▍  | 87/117 [00:04<00:01, 21.53it/s, loss=3.56, v_num=1, val_acc=0.587]
Epoch 2:  74%|███████▍  | 87/117 [00:04<00:01, 21.39it/s, loss=3.61, v_num=1, val_acc=0.587]
Epoch 2:  75%|███████▌  | 88/117 [00:04<00:01, 21.59it/s, loss=3.61, v_num=1, val_acc=0.587]
Epoch 2:  75%|███████▌  | 88/117 [00:04<00:01, 21.46it/s, loss=3.59, v_num=1, val_acc=0.587]
Epoch 2:  76%|███████▌  | 89/117 [00:04<00:01, 21.66it/s, loss=3.59, v_num=1, val_acc=0.587]
Epoch 2:  76%|███████▌  | 89/117 [00:04<00:01, 21.52it/s, loss=3.57, v_num=1, val_acc=0.587]
Epoch 2:  77%|███████▋  | 90/117 [00:04<00:01, 21.72it/s, loss=3.57, v_num=1, val_acc=0.587]
Epoch 2:  77%|███████▋  | 90/117 [00:04<00:01, 21.59it/s, loss=3.56, v_num=1, val_acc=0.587]
Epoch 2:  78%|███████▊  | 91/117 [00:04<00:01, 21.78it/s, loss=3.56, v_num=1, val_acc=0.587]
Epoch 2:  78%|███████▊  | 91/117 [00:04<00:01, 21.65it/s, loss=3.59, v_num=1, val_acc=0.587]
Epoch 2:  79%|███████▊  | 92/117 [00:04<00:01, 21.84it/s, loss=3.59, v_num=1, val_acc=0.587]
Epoch 2:  79%|███████▊  | 92/117 [00:04<00:01, 21.71it/s, loss=3.72, v_num=1, val_acc=0.587]
Epoch 2:  79%|███████▉  | 93/117 [00:04<00:01, 21.90it/s, loss=3.72, v_num=1, val_acc=0.587]
Epoch 2:  79%|███████▉  | 93/117 [00:04<00:01, 21.77it/s, loss=3.79, v_num=1, val_acc=0.587]
Epoch 2:  80%|████████  | 94/117 [00:04<00:01, 21.96it/s, loss=3.79, v_num=1, val_acc=0.587]
Epoch 2:  80%|████████  | 94/117 [00:04<00:01, 21.83it/s, loss=3.86, v_num=1, val_acc=0.587]
Epoch 2:  81%|████████  | 95/117 [00:04<00:00, 22.01it/s, loss=3.86, v_num=1, val_acc=0.587]
Epoch 2:  81%|████████  | 95/117 [00:04<00:01, 21.88it/s, loss=3.91, v_num=1, val_acc=0.587]
Epoch 2:  82%|████████▏ | 96/117 [00:04<00:00, 22.07it/s, loss=3.91, v_num=1, val_acc=0.587]
Epoch 2:  82%|████████▏ | 96/117 [00:04<00:00, 21.94it/s, loss=3.98, v_num=1, val_acc=0.587]
Epoch 2:  83%|████████▎ | 97/117 [00:04<00:00, 22.12it/s, loss=3.98, v_num=1, val_acc=0.587]
Epoch 2:  83%|████████▎ | 97/117 [00:04<00:00, 22.00it/s, loss=4, v_num=1, val_acc=0.587]

Validation: 0it [00:00, ?it/s]

Validation:   0%|          | 0/20 [00:00<?, ?it/s]

Validation DataLoader 0:   0%|          | 0/20 [00:00<?, ?it/s]

Validation DataLoader 0:   5%|▌         | 1/20 [00:00<00:00, 150.31it/s]
Epoch 2:  84%|████████▍ | 98/117 [00:05<00:01, 18.62it/s, loss=4, v_num=1, val_acc=0.587]

Validation DataLoader 0:  10%|█         | 2/20 [00:00<00:00, 55.66it/s]
Epoch 2:  85%|████████▍ | 99/117 [00:05<00:00, 18.71it/s, loss=4, v_num=1, val_acc=0.587]

Validation DataLoader 0:  15%|█▌        | 3/20 [00:00<00:00, 44.22it/s]
Epoch 2:  85%|████████▌ | 100/117 [00:05<00:00, 18.79it/s, loss=4, v_num=1, val_acc=0.587]

Validation DataLoader 0:  20%|██        | 4/20 [00:00<00:00, 40.17it/s]
Epoch 2:  86%|████████▋ | 101/117 [00:05<00:00, 18.86it/s, loss=4, v_num=1, val_acc=0.587]

Validation DataLoader 0:  25%|██▌       | 5/20 [00:00<00:00, 38.10it/s]
Epoch 2:  87%|████████▋ | 102/117 [00:05<00:00, 18.94it/s, loss=4, v_num=1, val_acc=0.587]

Validation DataLoader 0:  30%|███       | 6/20 [00:00<00:00, 36.84it/s]
Epoch 2:  88%|████████▊ | 103/117 [00:05<00:00, 19.01it/s, loss=4, v_num=1, val_acc=0.587]

Validation DataLoader 0:  35%|███▌      | 7/20 [00:00<00:00, 35.93it/s]
Epoch 2:  89%|████████▉ | 104/117 [00:05<00:00, 19.08it/s, loss=4, v_num=1, val_acc=0.587]

Validation DataLoader 0:  40%|████      | 8/20 [00:00<00:00, 35.30it/s]
Epoch 2:  90%|████████▉ | 105/117 [00:05<00:00, 19.15it/s, loss=4, v_num=1, val_acc=0.587]

Validation DataLoader 0:  45%|████▌     | 9/20 [00:00<00:00, 34.84it/s]
Epoch 2:  91%|█████████ | 106/117 [00:05<00:00, 19.23it/s, loss=4, v_num=1, val_acc=0.587]

Validation DataLoader 0:  50%|█████     | 10/20 [00:00<00:00, 34.53it/s]
Epoch 2:  91%|█████████▏| 107/117 [00:05<00:00, 19.30it/s, loss=4, v_num=1, val_acc=0.587]

Validation DataLoader 0:  55%|█████▌    | 11/20 [00:00<00:00, 34.19it/s]
Epoch 2:  92%|█████████▏| 108/117 [00:05<00:00, 19.37it/s, loss=4, v_num=1, val_acc=0.587]

Validation DataLoader 0:  60%|██████    | 12/20 [00:00<00:00, 33.99it/s]
Epoch 2:  93%|█████████▎| 109/117 [00:05<00:00, 19.44it/s, loss=4, v_num=1, val_acc=0.587]

Validation DataLoader 0:  65%|██████▌   | 13/20 [00:00<00:00, 33.80it/s]
Epoch 2:  94%|█████████▍| 110/117 [00:05<00:00, 19.50it/s, loss=4, v_num=1, val_acc=0.587]

Validation DataLoader 0:  70%|███████   | 14/20 [00:00<00:00, 33.63it/s]
Epoch 2:  95%|█████████▍| 111/117 [00:05<00:00, 19.57it/s, loss=4, v_num=1, val_acc=0.587]

Validation DataLoader 0:  75%|███████▌  | 15/20 [00:00<00:00, 33.49it/s]
Epoch 2:  96%|█████████▌| 112/117 [00:05<00:00, 19.64it/s, loss=4, v_num=1, val_acc=0.587]

Validation DataLoader 0:  80%|████████  | 16/20 [00:00<00:00, 33.37it/s]
Epoch 2:  97%|█████████▋| 113/117 [00:05<00:00, 19.70it/s, loss=4, v_num=1, val_acc=0.587]

Validation DataLoader 0:  85%|████████▌ | 17/20 [00:00<00:00, 33.11it/s]
Epoch 2:  97%|█████████▋| 114/117 [00:05<00:00, 19.76it/s, loss=4, v_num=1, val_acc=0.587]

Validation DataLoader 0:  90%|█████████ | 18/20 [00:00<00:00, 33.13it/s]
Epoch 2:  98%|█████████▊| 115/117 [00:05<00:00, 19.83it/s, loss=4, v_num=1, val_acc=0.587]

Validation DataLoader 0:  95%|█████████▌| 19/20 [00:00<00:00, 33.04it/s]
Epoch 2:  99%|█████████▉| 116/117 [00:05<00:00, 19.90it/s, loss=4, v_num=1, val_acc=0.587]

Validation DataLoader 0: 100%|██████████| 20/20 [00:00<00:00, 33.04it/s]
Epoch 2: 100%|██████████| 117/117 [00:05<00:00, 19.96it/s, loss=4, v_num=1, val_acc=0.587]
Epoch 2: 100%|██████████| 117/117 [00:05<00:00, 19.90it/s, loss=4, v_num=1, val_acc=0.583]


Epoch 2: 100%|██████████| 117/117 [00:05<00:00, 19.89it/s, loss=4, v_num=1, val_acc=0.583]
Epoch 2:   0%|          | 0/117 [00:00<?, ?it/s, loss=4, v_num=1, val_acc=0.583]
Epoch 3:   0%|          | 0/117 [00:00<?, ?it/s, loss=4, v_num=1, val_acc=0.583]
Epoch 3:   1%|          | 1/117 [00:00<01:46,  1.09it/s, loss=4, v_num=1, val_acc=0.583]
Epoch 3:   1%|          | 1/117 [00:00<01:48,  1.07it/s, loss=4.04, v_num=1, val_acc=0.583]
Epoch 3:   2%|▏         | 2/117 [00:00<00:54,  2.11it/s, loss=4.04, v_num=1, val_acc=0.583]
Epoch 3:   2%|▏         | 2/117 [00:00<00:55,  2.06it/s, loss=4.05, v_num=1, val_acc=0.583]
Epoch 3:   3%|▎         | 3/117 [00:00<00:37,  3.05it/s, loss=4.05, v_num=1, val_acc=0.583]
Epoch 3:   3%|▎         | 3/117 [00:01<00:38,  2.97it/s, loss=4.05, v_num=1, val_acc=0.583]
Epoch 3:   3%|▎         | 4/117 [00:01<00:28,  3.92it/s, loss=4.05, v_num=1, val_acc=0.583]
Epoch 3:   3%|▎         | 4/117 [00:01<00:29,  3.82it/s, loss=4.14, v_num=1, val_acc=0.583]
Epoch 3:   4%|▍         | 5/117 [00:01<00:23,  4.74it/s, loss=4.14, v_num=1, val_acc=0.583]
Epoch 3:   4%|▍         | 5/117 [00:01<00:24,  4.63it/s, loss=4.12, v_num=1, val_acc=0.583]
Epoch 3:   5%|▌         | 6/117 [00:01<00:20,  5.51it/s, loss=4.12, v_num=1, val_acc=0.583]
Epoch 3:   5%|▌         | 6/117 [00:01<00:20,  5.39it/s, loss=4, v_num=1, val_acc=0.583]
Epoch 3:   6%|▌         | 7/117 [00:01<00:17,  6.24it/s, loss=4, v_num=1, val_acc=0.583]
Epoch 3:   6%|▌         | 7/117 [00:01<00:18,  6.10it/s, loss=3.91, v_num=1, val_acc=0.583]
Epoch 3:   7%|▋         | 8/117 [00:01<00:15,  6.93it/s, loss=3.91, v_num=1, val_acc=0.583]
Epoch 3:   7%|▋         | 8/117 [00:01<00:16,  6.78it/s, loss=3.92, v_num=1, val_acc=0.583]
Epoch 3:   8%|▊         | 9/117 [00:01<00:14,  7.56it/s, loss=3.92, v_num=1, val_acc=0.583]
Epoch 3:   8%|▊         | 9/117 [00:01<00:14,  7.41it/s, loss=4, v_num=1, val_acc=0.583]
Epoch 3:   9%|▊         | 10/117 [00:01<00:13,  8.16it/s, loss=4, v_num=1, val_acc=0.583]
Epoch 3:   9%|▊         | 10/117 [00:01<00:13,  8.00it/s, loss=4.06, v_num=1, val_acc=0.583]
Epoch 3:   9%|▉         | 11/117 [00:01<00:12,  8.71it/s, loss=4.06, v_num=1, val_acc=0.583]
Epoch 3:   9%|▉         | 11/117 [00:01<00:12,  8.54it/s, loss=4.13, v_num=1, val_acc=0.583]
Epoch 3:  10%|█         | 12/117 [00:01<00:11,  9.25it/s, loss=4.13, v_num=1, val_acc=0.583]
Epoch 3:  10%|█         | 12/117 [00:01<00:11,  9.07it/s, loss=4.22, v_num=1, val_acc=0.583]
Epoch 3:  11%|█         | 13/117 [00:01<00:10,  9.77it/s, loss=4.22, v_num=1, val_acc=0.583]
Epoch 3:  11%|█         | 13/117 [00:01<00:10,  9.59it/s, loss=4.26, v_num=1, val_acc=0.583]
Epoch 3:  12%|█▏        | 14/117 [00:01<00:10, 10.26it/s, loss=4.26, v_num=1, val_acc=0.583]
Epoch 3:  12%|█▏        | 14/117 [00:01<00:10, 10.07it/s, loss=4.25, v_num=1, val_acc=0.583]
Epoch 3:  13%|█▎        | 15/117 [00:01<00:09, 10.73it/s, loss=4.25, v_num=1, val_acc=0.583]
Epoch 3:  13%|█▎        | 15/117 [00:01<00:09, 10.54it/s, loss=4.21, v_num=1, val_acc=0.583]
Epoch 3:  14%|█▎        | 16/117 [00:01<00:09, 11.18it/s, loss=4.21, v_num=1, val_acc=0.583]
Epoch 3:  14%|█▎        | 16/117 [00:01<00:09, 10.98it/s, loss=4.3, v_num=1, val_acc=0.583]
Epoch 3:  15%|█▍        | 17/117 [00:01<00:08, 11.58it/s, loss=4.3, v_num=1, val_acc=0.583]
Epoch 3:  15%|█▍        | 17/117 [00:01<00:08, 11.39it/s, loss=4.32, v_num=1, val_acc=0.583]
Epoch 3:  15%|█▌        | 18/117 [00:01<00:08, 11.99it/s, loss=4.32, v_num=1, val_acc=0.583]
Epoch 3:  15%|█▌        | 18/117 [00:01<00:08, 11.79it/s, loss=4.25, v_num=1, val_acc=0.583]
Epoch 3:  16%|█▌        | 19/117 [00:01<00:07, 12.37it/s, loss=4.25, v_num=1, val_acc=0.583]
Epoch 3:  16%|█▌        | 19/117 [00:01<00:08, 12.17it/s, loss=4.21, v_num=1, val_acc=0.583]
Epoch 3:  17%|█▋        | 20/117 [00:01<00:07, 12.73it/s, loss=4.21, v_num=1, val_acc=0.583]
Epoch 3:  17%|█▋        | 20/117 [00:01<00:07, 12.53it/s, loss=4.14, v_num=1, val_acc=0.583]
Epoch 3:  18%|█▊        | 21/117 [00:01<00:07, 13.09it/s, loss=4.14, v_num=1, val_acc=0.583]
Epoch 3:  18%|█▊        | 21/117 [00:01<00:07, 12.88it/s, loss=4.03, v_num=1, val_acc=0.583]
Epoch 3:  19%|█▉        | 22/117 [00:01<00:07, 13.43it/s, loss=4.03, v_num=1, val_acc=0.583]
Epoch 3:  19%|█▉        | 22/117 [00:01<00:07, 13.23it/s, loss=4.04, v_num=1, val_acc=0.583]
Epoch 3:  20%|█▉        | 23/117 [00:01<00:06, 13.75it/s, loss=4.04, v_num=1, val_acc=0.583]
Epoch 3:  20%|█▉        | 23/117 [00:01<00:06, 13.55it/s, loss=3.98, v_num=1, val_acc=0.583]
Epoch 3:  21%|██        | 24/117 [00:01<00:06, 14.06it/s, loss=3.98, v_num=1, val_acc=0.583]
Epoch 3:  21%|██        | 24/117 [00:01<00:06, 13.86it/s, loss=3.85, v_num=1, val_acc=0.583]
Epoch 3:  21%|██▏       | 25/117 [00:01<00:06, 14.36it/s, loss=3.85, v_num=1, val_acc=0.583]
Epoch 3:  21%|██▏       | 25/117 [00:01<00:06, 14.15it/s, loss=3.84, v_num=1, val_acc=0.583]
Epoch 3:  22%|██▏       | 26/117 [00:01<00:06, 14.64it/s, loss=3.84, v_num=1, val_acc=0.583]
Epoch 3:  22%|██▏       | 26/117 [00:01<00:06, 14.44it/s, loss=3.84, v_num=1, val_acc=0.583]
Epoch 3:  23%|██▎       | 27/117 [00:01<00:06, 14.92it/s, loss=3.84, v_num=1, val_acc=0.583]
Epoch 3:  23%|██▎       | 27/117 [00:01<00:06, 14.71it/s, loss=3.86, v_num=1, val_acc=0.583]
Epoch 3:  24%|██▍       | 28/117 [00:01<00:05, 15.18it/s, loss=3.86, v_num=1, val_acc=0.583]
Epoch 3:  24%|██▍       | 28/117 [00:01<00:05, 14.98it/s, loss=3.91, v_num=1, val_acc=0.583]
Epoch 3:  25%|██▍       | 29/117 [00:01<00:05, 15.43it/s, loss=3.91, v_num=1, val_acc=0.583]
Epoch 3:  25%|██▍       | 29/117 [00:01<00:05, 15.23it/s, loss=3.83, v_num=1, val_acc=0.583]
Epoch 3:  26%|██▌       | 30/117 [00:01<00:05, 15.68it/s, loss=3.83, v_num=1, val_acc=0.583]
Epoch 3:  26%|██▌       | 30/117 [00:01<00:05, 15.47it/s, loss=3.75, v_num=1, val_acc=0.583]
Epoch 3:  26%|██▋       | 31/117 [00:01<00:05, 15.91it/s, loss=3.75, v_num=1, val_acc=0.583]
Epoch 3:  26%|██▋       | 31/117 [00:01<00:05, 15.71it/s, loss=3.72, v_num=1, val_acc=0.583]
Epoch 3:  27%|██▋       | 32/117 [00:01<00:05, 16.14it/s, loss=3.72, v_num=1, val_acc=0.583]
Epoch 3:  27%|██▋       | 32/117 [00:02<00:05, 15.94it/s, loss=3.59, v_num=1, val_acc=0.583]
Epoch 3:  28%|██▊       | 33/117 [00:02<00:05, 16.36it/s, loss=3.59, v_num=1, val_acc=0.583]
Epoch 3:  28%|██▊       | 33/117 [00:02<00:05, 16.16it/s, loss=3.5, v_num=1, val_acc=0.583]
Epoch 3:  29%|██▉       | 34/117 [00:02<00:05, 16.58it/s, loss=3.5, v_num=1, val_acc=0.583]
Epoch 3:  29%|██▉       | 34/117 [00:02<00:05, 16.38it/s, loss=3.53, v_num=1, val_acc=0.583]
Epoch 3:  30%|██▉       | 35/117 [00:02<00:04, 16.79it/s, loss=3.53, v_num=1, val_acc=0.583]
Epoch 3:  30%|██▉       | 35/117 [00:02<00:04, 16.58it/s, loss=3.45, v_num=1, val_acc=0.583]
Epoch 3:  31%|███       | 36/117 [00:02<00:04, 16.98it/s, loss=3.45, v_num=1, val_acc=0.583]
Epoch 3:  31%|███       | 36/117 [00:02<00:04, 16.78it/s, loss=3.36, v_num=1, val_acc=0.583]
Epoch 3:  32%|███▏      | 37/117 [00:02<00:04, 17.14it/s, loss=3.36, v_num=1, val_acc=0.583]
Epoch 3:  32%|███▏      | 37/117 [00:02<00:04, 16.96it/s, loss=3.43, v_num=1, val_acc=0.583]
Epoch 3:  32%|███▏      | 38/117 [00:02<00:04, 17.34it/s, loss=3.43, v_num=1, val_acc=0.583]
Epoch 3:  32%|███▏      | 38/117 [00:02<00:04, 17.15it/s, loss=3.44, v_num=1, val_acc=0.583]
Epoch 3:  33%|███▎      | 39/117 [00:02<00:04, 17.52it/s, loss=3.44, v_num=1, val_acc=0.583]
Epoch 3:  33%|███▎      | 39/117 [00:02<00:04, 17.33it/s, loss=3.48, v_num=1, val_acc=0.583]
Epoch 3:  34%|███▍      | 40/117 [00:02<00:04, 17.70it/s, loss=3.48, v_num=1, val_acc=0.583]
Epoch 3:  34%|███▍      | 40/117 [00:02<00:04, 17.50it/s, loss=3.54, v_num=1, val_acc=0.583]
Epoch 3:  35%|███▌      | 41/117 [00:02<00:04, 17.87it/s, loss=3.54, v_num=1, val_acc=0.583]
Epoch 3:  35%|███▌      | 41/117 [00:02<00:04, 17.68it/s, loss=3.54, v_num=1, val_acc=0.583]
Epoch 3:  36%|███▌      | 42/117 [00:02<00:04, 18.04it/s, loss=3.54, v_num=1, val_acc=0.583]
Epoch 3:  36%|███▌      | 42/117 [00:02<00:04, 17.84it/s, loss=3.65, v_num=1, val_acc=0.583]
Epoch 3:  37%|███▋      | 43/117 [00:02<00:04, 18.20it/s, loss=3.65, v_num=1, val_acc=0.583]
Epoch 3:  37%|███▋      | 43/117 [00:02<00:04, 18.01it/s, loss=3.64, v_num=1, val_acc=0.583]
Epoch 3:  38%|███▊      | 44/117 [00:02<00:03, 18.35it/s, loss=3.64, v_num=1, val_acc=0.583]
Epoch 3:  38%|███▊      | 44/117 [00:02<00:04, 18.16it/s, loss=3.69, v_num=1, val_acc=0.583]
Epoch 3:  38%|███▊      | 45/117 [00:02<00:03, 18.50it/s, loss=3.69, v_num=1, val_acc=0.583]
Epoch 3:  38%|███▊      | 45/117 [00:02<00:03, 18.31it/s, loss=3.78, v_num=1, val_acc=0.583]
Epoch 3:  39%|███▉      | 46/117 [00:02<00:03, 18.65it/s, loss=3.78, v_num=1, val_acc=0.583]
Epoch 3:  39%|███▉      | 46/117 [00:02<00:03, 18.46it/s, loss=3.87, v_num=1, val_acc=0.583]
Epoch 3:  40%|████      | 47/117 [00:02<00:03, 18.80it/s, loss=3.87, v_num=1, val_acc=0.583]
Epoch 3:  40%|████      | 47/117 [00:02<00:03, 18.61it/s, loss=3.99, v_num=1, val_acc=0.583]
Epoch 3:  41%|████      | 48/117 [00:02<00:03, 18.94it/s, loss=3.99, v_num=1, val_acc=0.583]
Epoch 3:  41%|████      | 48/117 [00:02<00:03, 18.75it/s, loss=4.07, v_num=1, val_acc=0.583]
Epoch 3:  42%|████▏     | 49/117 [00:02<00:03, 19.07it/s, loss=4.07, v_num=1, val_acc=0.583]
Epoch 3:  42%|████▏     | 49/117 [00:02<00:03, 18.89it/s, loss=4.13, v_num=1, val_acc=0.583]
Epoch 3:  43%|████▎     | 50/117 [00:02<00:03, 19.21it/s, loss=4.13, v_num=1, val_acc=0.583]
Epoch 3:  43%|████▎     | 50/117 [00:02<00:03, 19.02it/s, loss=4.21, v_num=1, val_acc=0.583]
Epoch 3:  44%|████▎     | 51/117 [00:02<00:03, 19.34it/s, loss=4.21, v_num=1, val_acc=0.583]
Epoch 3:  44%|████▎     | 51/117 [00:02<00:03, 19.15it/s, loss=4.19, v_num=1, val_acc=0.583]
Epoch 3:  44%|████▍     | 52/117 [00:02<00:03, 19.46it/s, loss=4.19, v_num=1, val_acc=0.583]
Epoch 3:  44%|████▍     | 52/117 [00:02<00:03, 19.28it/s, loss=4.2, v_num=1, val_acc=0.583]
Epoch 3:  45%|████▌     | 53/117 [00:02<00:03, 19.58it/s, loss=4.2, v_num=1, val_acc=0.583]
Epoch 3:  45%|████▌     | 53/117 [00:02<00:03, 19.40it/s, loss=4.2, v_num=1, val_acc=0.583]
Epoch 3:  46%|████▌     | 54/117 [00:02<00:03, 19.70it/s, loss=4.2, v_num=1, val_acc=0.583]
Epoch 3:  46%|████▌     | 54/117 [00:02<00:03, 19.52it/s, loss=4.13, v_num=1, val_acc=0.583]
Epoch 3:  47%|████▋     | 55/117 [00:02<00:03, 19.82it/s, loss=4.13, v_num=1, val_acc=0.583]
Epoch 3:  47%|████▋     | 55/117 [00:02<00:03, 19.64it/s, loss=4.17, v_num=1, val_acc=0.583]
Epoch 3:  48%|████▊     | 56/117 [00:02<00:03, 19.93it/s, loss=4.17, v_num=1, val_acc=0.583]
Epoch 3:  48%|████▊     | 56/117 [00:02<00:03, 19.76it/s, loss=4.17, v_num=1, val_acc=0.583]
Epoch 3:  49%|████▊     | 57/117 [00:02<00:02, 20.05it/s, loss=4.17, v_num=1, val_acc=0.583]
Epoch 3:  49%|████▊     | 57/117 [00:02<00:03, 19.87it/s, loss=3.98, v_num=1, val_acc=0.583]
Epoch 3:  50%|████▉     | 58/117 [00:02<00:02, 20.15it/s, loss=3.98, v_num=1, val_acc=0.583]
Epoch 3:  50%|████▉     | 58/117 [00:02<00:02, 19.98it/s, loss=3.91, v_num=1, val_acc=0.583]
Epoch 3:  50%|█████     | 59/117 [00:02<00:02, 20.26it/s, loss=3.91, v_num=1, val_acc=0.583]
Epoch 3:  50%|█████     | 59/117 [00:02<00:02, 20.08it/s, loss=3.79, v_num=1, val_acc=0.583]
Epoch 3:  51%|█████▏    | 60/117 [00:02<00:02, 20.36it/s, loss=3.79, v_num=1, val_acc=0.583]
Epoch 3:  51%|█████▏    | 60/117 [00:02<00:02, 20.19it/s, loss=3.72, v_num=1, val_acc=0.583]
Epoch 3:  52%|█████▏    | 61/117 [00:02<00:02, 20.46it/s, loss=3.72, v_num=1, val_acc=0.583]
Epoch 3:  52%|█████▏    | 61/117 [00:03<00:02, 20.29it/s, loss=3.7, v_num=1, val_acc=0.583]
Epoch 3:  53%|█████▎    | 62/117 [00:03<00:02, 20.56it/s, loss=3.7, v_num=1, val_acc=0.583]
Epoch 3:  53%|█████▎    | 62/117 [00:03<00:02, 20.39it/s, loss=3.55, v_num=1, val_acc=0.583]
Epoch 3:  54%|█████▍    | 63/117 [00:03<00:02, 20.65it/s, loss=3.55, v_num=1, val_acc=0.583]
Epoch 3:  54%|█████▍    | 63/117 [00:03<00:02, 20.48it/s, loss=3.6, v_num=1, val_acc=0.583]
Epoch 3:  55%|█████▍    | 64/117 [00:03<00:02, 20.75it/s, loss=3.6, v_num=1, val_acc=0.583]
Epoch 3:  55%|█████▍    | 64/117 [00:03<00:02, 20.58it/s, loss=3.62, v_num=1, val_acc=0.583]
Epoch 3:  56%|█████▌    | 65/117 [00:03<00:02, 20.84it/s, loss=3.62, v_num=1, val_acc=0.583]
Epoch 3:  56%|█████▌    | 65/117 [00:03<00:02, 20.67it/s, loss=3.61, v_num=1, val_acc=0.583]
Epoch 3:  56%|█████▋    | 66/117 [00:03<00:02, 20.93it/s, loss=3.61, v_num=1, val_acc=0.583]
Epoch 3:  56%|█████▋    | 66/117 [00:03<00:02, 20.76it/s, loss=3.74, v_num=1, val_acc=0.583]
Epoch 3:  57%|█████▋    | 67/117 [00:03<00:02, 21.02it/s, loss=3.74, v_num=1, val_acc=0.583]
Epoch 3:  57%|█████▋    | 67/117 [00:03<00:02, 20.85it/s, loss=3.77, v_num=1, val_acc=0.583]
Epoch 3:  58%|█████▊    | 68/117 [00:03<00:02, 21.10it/s, loss=3.77, v_num=1, val_acc=0.583]
Epoch 3:  58%|█████▊    | 68/117 [00:03<00:02, 20.94it/s, loss=3.85, v_num=1, val_acc=0.583]
Epoch 3:  59%|█████▉    | 69/117 [00:03<00:02, 21.19it/s, loss=3.85, v_num=1, val_acc=0.583]
Epoch 3:  59%|█████▉    | 69/117 [00:03<00:02, 21.03it/s, loss=3.8, v_num=1, val_acc=0.583]
Epoch 3:  60%|█████▉    | 70/117 [00:03<00:02, 21.27it/s, loss=3.8, v_num=1, val_acc=0.583]
Epoch 3:  60%|█████▉    | 70/117 [00:03<00:02, 21.11it/s, loss=3.72, v_num=1, val_acc=0.583]
Epoch 3:  61%|██████    | 71/117 [00:03<00:02, 21.35it/s, loss=3.72, v_num=1, val_acc=0.583]
Epoch 3:  61%|██████    | 71/117 [00:03<00:02, 21.19it/s, loss=3.76, v_num=1, val_acc=0.583]
Epoch 3:  62%|██████▏   | 72/117 [00:03<00:02, 21.43it/s, loss=3.76, v_num=1, val_acc=0.583]
Epoch 3:  62%|██████▏   | 72/117 [00:03<00:02, 21.27it/s, loss=3.79, v_num=1, val_acc=0.583]
Epoch 3:  62%|██████▏   | 73/117 [00:03<00:02, 21.51it/s, loss=3.79, v_num=1, val_acc=0.583]
Epoch 3:  62%|██████▏   | 73/117 [00:03<00:02, 21.35it/s, loss=3.84, v_num=1, val_acc=0.583]
Epoch 3:  63%|██████▎   | 74/117 [00:03<00:01, 21.58it/s, loss=3.84, v_num=1, val_acc=0.583]
Epoch 3:  63%|██████▎   | 74/117 [00:03<00:02, 21.43it/s, loss=3.85, v_num=1, val_acc=0.583]
Epoch 3:  64%|██████▍   | 75/117 [00:03<00:01, 21.66it/s, loss=3.85, v_num=1, val_acc=0.583]
Epoch 3:  64%|██████▍   | 75/117 [00:03<00:01, 21.50it/s, loss=3.93, v_num=1, val_acc=0.583]
Epoch 3:  65%|██████▍   | 76/117 [00:03<00:01, 21.73it/s, loss=3.93, v_num=1, val_acc=0.583]
Epoch 3:  65%|██████▍   | 76/117 [00:03<00:01, 21.58it/s, loss=3.96, v_num=1, val_acc=0.583]
Epoch 3:  66%|██████▌   | 77/117 [00:03<00:01, 21.80it/s, loss=3.96, v_num=1, val_acc=0.583]
Epoch 3:  66%|██████▌   | 77/117 [00:03<00:01, 21.65it/s, loss=4, v_num=1, val_acc=0.583]
Epoch 3:  67%|██████▋   | 78/117 [00:03<00:01, 21.87it/s, loss=4, v_num=1, val_acc=0.583]
Epoch 3:  67%|██████▋   | 78/117 [00:03<00:01, 21.72it/s, loss=4.05, v_num=1, val_acc=0.583]
Epoch 3:  68%|██████▊   | 79/117 [00:03<00:01, 21.94it/s, loss=4.05, v_num=1, val_acc=0.583]
Epoch 3:  68%|██████▊   | 79/117 [00:03<00:01, 21.79it/s, loss=4.08, v_num=1, val_acc=0.583]
Epoch 3:  68%|██████▊   | 80/117 [00:03<00:01, 22.01it/s, loss=4.08, v_num=1, val_acc=0.583]
Epoch 3:  68%|██████▊   | 80/117 [00:03<00:01, 21.86it/s, loss=4.14, v_num=1, val_acc=0.583]
Epoch 3:  69%|██████▉   | 81/117 [00:03<00:01, 22.08it/s, loss=4.14, v_num=1, val_acc=0.583]
Epoch 3:  69%|██████▉   | 81/117 [00:03<00:01, 21.93it/s, loss=4.08, v_num=1, val_acc=0.583]
Epoch 3:  70%|███████   | 82/117 [00:03<00:01, 22.12it/s, loss=4.08, v_num=1, val_acc=0.583]
Epoch 3:  70%|███████   | 82/117 [00:03<00:01, 21.97it/s, loss=4.07, v_num=1, val_acc=0.583]
Epoch 3:  71%|███████   | 83/117 [00:03<00:01, 22.18it/s, loss=4.07, v_num=1, val_acc=0.583]
Epoch 3:  71%|███████   | 83/117 [00:03<00:01, 22.03it/s, loss=4.05, v_num=1, val_acc=0.583]
Epoch 3:  72%|███████▏  | 84/117 [00:03<00:01, 22.25it/s, loss=4.05, v_num=1, val_acc=0.583]
Epoch 3:  72%|███████▏  | 84/117 [00:03<00:01, 22.10it/s, loss=4.06, v_num=1, val_acc=0.583]
Epoch 3:  73%|███████▎  | 85/117 [00:03<00:01, 22.31it/s, loss=4.06, v_num=1, val_acc=0.583]
Epoch 3:  73%|███████▎  | 85/117 [00:03<00:01, 22.16it/s, loss=3.98, v_num=1, val_acc=0.583]
Epoch 3:  74%|███████▎  | 86/117 [00:03<00:01, 22.37it/s, loss=3.98, v_num=1, val_acc=0.583]
Epoch 3:  74%|███████▎  | 86/117 [00:03<00:01, 22.22it/s, loss=3.83, v_num=1, val_acc=0.583]
Epoch 3:  74%|███████▍  | 87/117 [00:03<00:01, 22.43it/s, loss=3.83, v_num=1, val_acc=0.583]
Epoch 3:  74%|███████▍  | 87/117 [00:03<00:01, 22.29it/s, loss=3.74, v_num=1, val_acc=0.583]
Epoch 3:  75%|███████▌  | 88/117 [00:03<00:01, 22.49it/s, loss=3.74, v_num=1, val_acc=0.583]
Epoch 3:  75%|███████▌  | 88/117 [00:03<00:01, 22.35it/s, loss=3.6, v_num=1, val_acc=0.583]
Epoch 3:  76%|███████▌  | 89/117 [00:03<00:01, 22.55it/s, loss=3.6, v_num=1, val_acc=0.583]
Epoch 3:  76%|███████▌  | 89/117 [00:03<00:01, 22.41it/s, loss=3.64, v_num=1, val_acc=0.583]
Epoch 3:  77%|███████▋  | 90/117 [00:03<00:01, 22.61it/s, loss=3.64, v_num=1, val_acc=0.583]
Epoch 3:  77%|███████▋  | 90/117 [00:04<00:01, 22.46it/s, loss=3.61, v_num=1, val_acc=0.583]
Epoch 3:  78%|███████▊  | 91/117 [00:04<00:01, 22.67it/s, loss=3.61, v_num=1, val_acc=0.583]
Epoch 3:  78%|███████▊  | 91/117 [00:04<00:01, 22.52it/s, loss=3.54, v_num=1, val_acc=0.583]
Epoch 3:  79%|███████▊  | 92/117 [00:04<00:01, 22.72it/s, loss=3.54, v_num=1, val_acc=0.583]
Epoch 3:  79%|███████▊  | 92/117 [00:04<00:01, 22.58it/s, loss=3.54, v_num=1, val_acc=0.583]
Epoch 3:  79%|███████▉  | 93/117 [00:04<00:01, 22.77it/s, loss=3.54, v_num=1, val_acc=0.583]
Epoch 3:  79%|███████▉  | 93/117 [00:04<00:01, 22.63it/s, loss=3.5, v_num=1, val_acc=0.583]
Epoch 3:  80%|████████  | 94/117 [00:04<00:01, 22.82it/s, loss=3.5, v_num=1, val_acc=0.583]
Epoch 3:  80%|████████  | 94/117 [00:04<00:01, 22.68it/s, loss=3.58, v_num=1, val_acc=0.583]
Epoch 3:  81%|████████  | 95/117 [00:04<00:00, 22.87it/s, loss=3.58, v_num=1, val_acc=0.583]
Epoch 3:  81%|████████  | 95/117 [00:04<00:00, 22.73it/s, loss=3.6, v_num=1, val_acc=0.583]
Epoch 3:  82%|████████▏ | 96/117 [00:04<00:00, 22.93it/s, loss=3.6, v_num=1, val_acc=0.583]
Epoch 3:  82%|████████▏ | 96/117 [00:04<00:00, 22.79it/s, loss=3.75, v_num=1, val_acc=0.583]
Epoch 3:  83%|████████▎ | 97/117 [00:04<00:00, 22.98it/s, loss=3.75, v_num=1, val_acc=0.583]
Epoch 3:  83%|████████▎ | 97/117 [00:04<00:00, 22.84it/s, loss=3.9, v_num=1, val_acc=0.583]

Validation: 0it [00:00, ?it/s]

Validation:   0%|          | 0/20 [00:00<?, ?it/s]

Validation DataLoader 0:   0%|          | 0/20 [00:00<?, ?it/s]

Validation DataLoader 0:   5%|▌         | 1/20 [00:00<00:00, 149.75it/s]
Epoch 3:  84%|████████▍ | 98/117 [00:05<00:00, 19.23it/s, loss=3.9, v_num=1, val_acc=0.583]

Validation DataLoader 0:  10%|█         | 2/20 [00:00<00:00, 54.72it/s]
Epoch 3:  85%|████████▍ | 99/117 [00:05<00:00, 19.31it/s, loss=3.9, v_num=1, val_acc=0.583]

Validation DataLoader 0:  15%|█▌        | 3/20 [00:00<00:00, 44.05it/s]
Epoch 3:  85%|████████▌ | 100/117 [00:05<00:00, 19.39it/s, loss=3.9, v_num=1, val_acc=0.583]

Validation DataLoader 0:  20%|██        | 4/20 [00:00<00:00, 40.03it/s]
Epoch 3:  86%|████████▋ | 101/117 [00:05<00:00, 19.46it/s, loss=3.9, v_num=1, val_acc=0.583]

Validation DataLoader 0:  25%|██▌       | 5/20 [00:00<00:00, 37.75it/s]
Epoch 3:  87%|████████▋ | 102/117 [00:05<00:00, 19.53it/s, loss=3.9, v_num=1, val_acc=0.583]

Validation DataLoader 0:  30%|███       | 6/20 [00:00<00:00, 36.68it/s]
Epoch 3:  88%|████████▊ | 103/117 [00:05<00:00, 19.61it/s, loss=3.9, v_num=1, val_acc=0.583]

Validation DataLoader 0:  35%|███▌      | 7/20 [00:00<00:00, 35.83it/s]
Epoch 3:  89%|████████▉ | 104/117 [00:05<00:00, 19.68it/s, loss=3.9, v_num=1, val_acc=0.583]

Validation DataLoader 0:  40%|████      | 8/20 [00:00<00:00, 35.25it/s]
Epoch 3:  90%|████████▉ | 105/117 [00:05<00:00, 19.75it/s, loss=3.9, v_num=1, val_acc=0.583]

Validation DataLoader 0:  45%|████▌     | 9/20 [00:00<00:00, 34.78it/s]
Epoch 3:  91%|█████████ | 106/117 [00:05<00:00, 19.82it/s, loss=3.9, v_num=1, val_acc=0.583]

Validation DataLoader 0:  50%|█████     | 10/20 [00:00<00:00, 34.48it/s]
Epoch 3:  91%|█████████▏| 107/117 [00:05<00:00, 19.89it/s, loss=3.9, v_num=1, val_acc=0.583]

Validation DataLoader 0:  55%|█████▌    | 11/20 [00:00<00:00, 34.21it/s]
Epoch 3:  92%|█████████▏| 108/117 [00:05<00:00, 19.96it/s, loss=3.9, v_num=1, val_acc=0.583]

Validation DataLoader 0:  60%|██████    | 12/20 [00:00<00:00, 33.98it/s]
Epoch 3:  93%|█████████▎| 109/117 [00:05<00:00, 20.03it/s, loss=3.9, v_num=1, val_acc=0.583]

Validation DataLoader 0:  65%|██████▌   | 13/20 [00:00<00:00, 33.80it/s]
Epoch 3:  94%|█████████▍| 110/117 [00:05<00:00, 20.09it/s, loss=3.9, v_num=1, val_acc=0.583]

Validation DataLoader 0:  70%|███████   | 14/20 [00:00<00:00, 33.63it/s]
Epoch 3:  95%|█████████▍| 111/117 [00:05<00:00, 20.16it/s, loss=3.9, v_num=1, val_acc=0.583]

Validation DataLoader 0:  75%|███████▌  | 15/20 [00:00<00:00, 33.50it/s]
Epoch 3:  96%|█████████▌| 112/117 [00:05<00:00, 20.23it/s, loss=3.9, v_num=1, val_acc=0.583]

Validation DataLoader 0:  80%|████████  | 16/20 [00:00<00:00, 33.37it/s]
Epoch 3:  97%|█████████▋| 113/117 [00:05<00:00, 20.29it/s, loss=3.9, v_num=1, val_acc=0.583]

Validation DataLoader 0:  85%|████████▌ | 17/20 [00:00<00:00, 33.26it/s]
Epoch 3:  97%|█████████▋| 114/117 [00:05<00:00, 20.35it/s, loss=3.9, v_num=1, val_acc=0.583]

Validation DataLoader 0:  90%|█████████ | 18/20 [00:00<00:00, 33.17it/s]
Epoch 3:  98%|█████████▊| 115/117 [00:05<00:00, 20.42it/s, loss=3.9, v_num=1, val_acc=0.583]

Validation DataLoader 0:  95%|█████████▌| 19/20 [00:00<00:00, 32.95it/s]
Epoch 3:  99%|█████████▉| 116/117 [00:05<00:00, 20.47it/s, loss=3.9, v_num=1, val_acc=0.583]

Validation DataLoader 0: 100%|██████████| 20/20 [00:00<00:00, 32.44it/s]
Epoch 3: 100%|██████████| 117/117 [00:05<00:00, 20.50it/s, loss=3.9, v_num=1, val_acc=0.583]
Epoch 3: 100%|██████████| 117/117 [00:05<00:00, 20.45it/s, loss=3.9, v_num=1, val_acc=0.438]


Epoch 3: 100%|██████████| 117/117 [00:05<00:00, 20.45it/s, loss=3.9, v_num=1, val_acc=0.438]
Epoch 3:   0%|          | 0/117 [00:00<?, ?it/s, loss=3.9, v_num=1, val_acc=0.438]
Epoch 4:   0%|          | 0/117 [00:00<?, ?it/s, loss=3.9, v_num=1, val_acc=0.438]
Epoch 4:   1%|          | 1/117 [00:00<01:46,  1.09it/s, loss=3.9, v_num=1, val_acc=0.438]
Epoch 4:   1%|          | 1/117 [00:00<01:49,  1.06it/s, loss=4.03, v_num=1, val_acc=0.438]
Epoch 4:   2%|▏         | 2/117 [00:00<00:55,  2.08it/s, loss=4.03, v_num=1, val_acc=0.438]
Epoch 4:   2%|▏         | 2/117 [00:00<00:56,  2.04it/s, loss=4.27, v_num=1, val_acc=0.438]
Epoch 4:   3%|▎         | 3/117 [00:00<00:37,  3.02it/s, loss=4.27, v_num=1, val_acc=0.438]
Epoch 4:   3%|▎         | 3/117 [00:01<00:38,  2.95it/s, loss=4.46, v_num=1, val_acc=0.438]
Epoch 4:   3%|▎         | 4/117 [00:01<00:28,  3.90it/s, loss=4.46, v_num=1, val_acc=0.438]
Epoch 4:   3%|▎         | 4/117 [00:01<00:29,  3.81it/s, loss=4.74, v_num=1, val_acc=0.438]
Epoch 4:   4%|▍         | 5/117 [00:01<00:23,  4.72it/s, loss=4.74, v_num=1, val_acc=0.438]
Epoch 4:   4%|▍         | 5/117 [00:01<00:24,  4.61it/s, loss=4.93, v_num=1, val_acc=0.438]
Epoch 4:   5%|▌         | 6/117 [00:01<00:20,  5.49it/s, loss=4.93, v_num=1, val_acc=0.438]
Epoch 4:   5%|▌         | 6/117 [00:01<00:20,  5.36it/s, loss=4.94, v_num=1, val_acc=0.438]
Epoch 4:   6%|▌         | 7/117 [00:01<00:17,  6.21it/s, loss=4.94, v_num=1, val_acc=0.438]
Epoch 4:   6%|▌         | 7/117 [00:01<00:18,  6.07it/s, loss=4.88, v_num=1, val_acc=0.438]
Epoch 4:   7%|▋         | 8/117 [00:01<00:15,  6.89it/s, loss=4.88, v_num=1, val_acc=0.438]
Epoch 4:   7%|▋         | 8/117 [00:01<00:16,  6.75it/s, loss=4.88, v_num=1, val_acc=0.438]
Epoch 4:   8%|▊         | 9/117 [00:01<00:14,  7.53it/s, loss=4.88, v_num=1, val_acc=0.438]
Epoch 4:   8%|▊         | 9/117 [00:01<00:14,  7.37it/s, loss=4.89, v_num=1, val_acc=0.438]
Epoch 4:   9%|▊         | 10/117 [00:01<00:13,  8.10it/s, loss=4.89, v_num=1, val_acc=0.438]
Epoch 4:   9%|▊         | 10/117 [00:01<00:13,  7.94it/s, loss=4.82, v_num=1, val_acc=0.438]
Epoch 4:   9%|▉         | 11/117 [00:01<00:12,  8.67it/s, loss=4.82, v_num=1, val_acc=0.438]
Epoch 4:   9%|▉         | 11/117 [00:01<00:12,  8.50it/s, loss=4.73, v_num=1, val_acc=0.438]
Epoch 4:  10%|█         | 12/117 [00:01<00:11,  9.22it/s, loss=4.73, v_num=1, val_acc=0.438]
Epoch 4:  10%|█         | 12/117 [00:01<00:11,  9.04it/s, loss=4.66, v_num=1, val_acc=0.438]
Epoch 4:  11%|█         | 13/117 [00:01<00:10,  9.72it/s, loss=4.66, v_num=1, val_acc=0.438]
Epoch 4:  11%|█         | 13/117 [00:01<00:10,  9.54it/s, loss=4.62, v_num=1, val_acc=0.438]
Epoch 4:  12%|█▏        | 14/117 [00:01<00:10, 10.22it/s, loss=4.62, v_num=1, val_acc=0.438]
Epoch 4:  12%|█▏        | 14/117 [00:01<00:10, 10.03it/s, loss=4.62, v_num=1, val_acc=0.438]
Epoch 4:  13%|█▎        | 15/117 [00:01<00:09, 10.68it/s, loss=4.62, v_num=1, val_acc=0.438]
Epoch 4:  13%|█▎        | 15/117 [00:01<00:09, 10.49it/s, loss=4.55, v_num=1, val_acc=0.438]
Epoch 4:  14%|█▎        | 16/117 [00:01<00:09, 11.13it/s, loss=4.55, v_num=1, val_acc=0.438]
Epoch 4:  14%|█▎        | 16/117 [00:01<00:09, 10.94it/s, loss=4.51, v_num=1, val_acc=0.438]
Epoch 4:  15%|█▍        | 17/117 [00:01<00:08, 11.55it/s, loss=4.51, v_num=1, val_acc=0.438]
Epoch 4:  15%|█▍        | 17/117 [00:01<00:08, 11.35it/s, loss=4.44, v_num=1, val_acc=0.438]
Epoch 4:  15%|█▌        | 18/117 [00:01<00:08, 11.94it/s, loss=4.44, v_num=1, val_acc=0.438]
Epoch 4:  15%|█▌        | 18/117 [00:01<00:08, 11.74it/s, loss=4.35, v_num=1, val_acc=0.438]
Epoch 4:  16%|█▌        | 19/117 [00:01<00:07, 12.31it/s, loss=4.35, v_num=1, val_acc=0.438]
Epoch 4:  16%|█▌        | 19/117 [00:01<00:08, 12.12it/s, loss=4.06, v_num=1, val_acc=0.438]
Epoch 4:  17%|█▋        | 20/117 [00:01<00:07, 12.68it/s, loss=4.06, v_num=1, val_acc=0.438]
Epoch 4:  17%|█▋        | 20/117 [00:01<00:07, 12.48it/s, loss=3.96, v_num=1, val_acc=0.438]
Epoch 4:  18%|█▊        | 21/117 [00:01<00:07, 13.04it/s, loss=3.96, v_num=1, val_acc=0.438]
Epoch 4:  18%|█▊        | 21/117 [00:01<00:07, 12.84it/s, loss=3.85, v_num=1, val_acc=0.438]
Epoch 4:  19%|█▉        | 22/117 [00:01<00:07, 13.38it/s, loss=3.85, v_num=1, val_acc=0.438]
Epoch 4:  19%|█▉        | 22/117 [00:01<00:07, 13.17it/s, loss=3.59, v_num=1, val_acc=0.438]
Epoch 4:  20%|█▉        | 23/117 [00:01<00:06, 13.69it/s, loss=3.59, v_num=1, val_acc=0.438]
Epoch 4:  20%|█▉        | 23/117 [00:01<00:06, 13.49it/s, loss=3.45, v_num=1, val_acc=0.438]
Epoch 4:  21%|██        | 24/117 [00:01<00:06, 14.00it/s, loss=3.45, v_num=1, val_acc=0.438]
Epoch 4:  21%|██        | 24/117 [00:01<00:06, 13.79it/s, loss=3.3, v_num=1, val_acc=0.438]
Epoch 4:  21%|██▏       | 25/117 [00:01<00:06, 14.29it/s, loss=3.3, v_num=1, val_acc=0.438]
Epoch 4:  21%|██▏       | 25/117 [00:01<00:06, 14.09it/s, loss=3.22, v_num=1, val_acc=0.438]
Epoch 4:  22%|██▏       | 26/117 [00:01<00:06, 14.57it/s, loss=3.22, v_num=1, val_acc=0.438]
Epoch 4:  22%|██▏       | 26/117 [00:01<00:06, 14.37it/s, loss=3.22, v_num=1, val_acc=0.438]
Epoch 4:  23%|██▎       | 27/117 [00:01<00:06, 14.83it/s, loss=3.22, v_num=1, val_acc=0.438]
Epoch 4:  23%|██▎       | 27/117 [00:01<00:06, 14.63it/s, loss=3.24, v_num=1, val_acc=0.438]
Epoch 4:  24%|██▍       | 28/117 [00:01<00:05, 15.10it/s, loss=3.24, v_num=1, val_acc=0.438]
Epoch 4:  24%|██▍       | 28/117 [00:01<00:05, 14.90it/s, loss=3.33, v_num=1, val_acc=0.438]
Epoch 4:  25%|██▍       | 29/117 [00:01<00:05, 15.36it/s, loss=3.33, v_num=1, val_acc=0.438]
Epoch 4:  25%|██▍       | 29/117 [00:01<00:05, 15.16it/s, loss=3.37, v_num=1, val_acc=0.438]
Epoch 4:  26%|██▌       | 30/117 [00:01<00:05, 15.60it/s, loss=3.37, v_num=1, val_acc=0.438]
Epoch 4:  26%|██▌       | 30/117 [00:01<00:05, 15.40it/s, loss=3.39, v_num=1, val_acc=0.438]
Epoch 4:  26%|██▋       | 31/117 [00:01<00:05, 15.83it/s, loss=3.39, v_num=1, val_acc=0.438]
Epoch 4:  26%|██▋       | 31/117 [00:01<00:05, 15.63it/s, loss=3.47, v_num=1, val_acc=0.438]
Epoch 4:  27%|██▋       | 32/117 [00:01<00:05, 16.06it/s, loss=3.47, v_num=1, val_acc=0.438]
Epoch 4:  27%|██▋       | 32/117 [00:02<00:05, 15.86it/s, loss=3.61, v_num=1, val_acc=0.438]
Epoch 4:  28%|██▊       | 33/117 [00:02<00:05, 16.29it/s, loss=3.61, v_num=1, val_acc=0.438]
Epoch 4:  28%|██▊       | 33/117 [00:02<00:05, 16.08it/s, loss=3.7, v_num=1, val_acc=0.438]
Epoch 4:  29%|██▉       | 34/117 [00:02<00:05, 16.50it/s, loss=3.7, v_num=1, val_acc=0.438]
Epoch 4:  29%|██▉       | 34/117 [00:02<00:05, 16.30it/s, loss=3.71, v_num=1, val_acc=0.438]
Epoch 4:  30%|██▉       | 35/117 [00:02<00:04, 16.70it/s, loss=3.71, v_num=1, val_acc=0.438]
Epoch 4:  30%|██▉       | 35/117 [00:02<00:04, 16.50it/s, loss=3.79, v_num=1, val_acc=0.438]
Epoch 4:  31%|███       | 36/117 [00:02<00:04, 16.90it/s, loss=3.79, v_num=1, val_acc=0.438]
Epoch 4:  31%|███       | 36/117 [00:02<00:04, 16.70it/s, loss=3.87, v_num=1, val_acc=0.438]
Epoch 4:  32%|███▏      | 37/117 [00:02<00:04, 17.09it/s, loss=3.87, v_num=1, val_acc=0.438]
Epoch 4:  32%|███▏      | 37/117 [00:02<00:04, 16.90it/s, loss=3.88, v_num=1, val_acc=0.438]
Epoch 4:  32%|███▏      | 38/117 [00:02<00:04, 17.24it/s, loss=3.88, v_num=1, val_acc=0.438]
Epoch 4:  32%|███▏      | 38/117 [00:02<00:04, 17.06it/s, loss=3.95, v_num=1, val_acc=0.438]
Epoch 4:  33%|███▎      | 39/117 [00:02<00:04, 17.43it/s, loss=3.95, v_num=1, val_acc=0.438]
Epoch 4:  33%|███▎      | 39/117 [00:02<00:04, 17.24it/s, loss=4.04, v_num=1, val_acc=0.438]
Epoch 4:  34%|███▍      | 40/117 [00:02<00:04, 17.59it/s, loss=4.04, v_num=1, val_acc=0.438]
Epoch 4:  34%|███▍      | 40/117 [00:02<00:04, 17.40it/s, loss=4.01, v_num=1, val_acc=0.438]
Epoch 4:  35%|███▌      | 41/117 [00:02<00:04, 17.77it/s, loss=4.01, v_num=1, val_acc=0.438]
Epoch 4:  35%|███▌      | 41/117 [00:02<00:04, 17.58it/s, loss=3.93, v_num=1, val_acc=0.438]
Epoch 4:  36%|███▌      | 42/117 [00:02<00:04, 17.92it/s, loss=3.93, v_num=1, val_acc=0.438]
Epoch 4:  36%|███▌      | 42/117 [00:02<00:04, 17.73it/s, loss=3.93, v_num=1, val_acc=0.438]
Epoch 4:  37%|███▋      | 43/117 [00:02<00:04, 18.07it/s, loss=3.93, v_num=1, val_acc=0.438]
Epoch 4:  37%|███▋      | 43/117 [00:02<00:04, 17.88it/s, loss=3.88, v_num=1, val_acc=0.438]
Epoch 4:  38%|███▊      | 44/117 [00:02<00:04, 18.23it/s, loss=3.88, v_num=1, val_acc=0.438]
Epoch 4:  38%|███▊      | 44/117 [00:02<00:04, 18.04it/s, loss=3.79, v_num=1, val_acc=0.438]
Epoch 4:  38%|███▊      | 45/117 [00:02<00:03, 18.38it/s, loss=3.79, v_num=1, val_acc=0.438]
Epoch 4:  38%|███▊      | 45/117 [00:02<00:03, 18.19it/s, loss=3.72, v_num=1, val_acc=0.438]
Epoch 4:  39%|███▉      | 46/117 [00:02<00:03, 18.52it/s, loss=3.72, v_num=1, val_acc=0.438]
Epoch 4:  39%|███▉      | 46/117 [00:02<00:03, 18.34it/s, loss=3.63, v_num=1, val_acc=0.438]
Epoch 4:  40%|████      | 47/117 [00:02<00:03, 18.66it/s, loss=3.63, v_num=1, val_acc=0.438]
Epoch 4:  40%|████      | 47/117 [00:02<00:03, 18.48it/s, loss=3.66, v_num=1, val_acc=0.438]
Epoch 4:  41%|████      | 48/117 [00:02<00:03, 18.80it/s, loss=3.66, v_num=1, val_acc=0.438]
Epoch 4:  41%|████      | 48/117 [00:02<00:03, 18.61it/s, loss=3.54, v_num=1, val_acc=0.438]
Epoch 4:  42%|████▏     | 49/117 [00:02<00:03, 18.91it/s, loss=3.54, v_num=1, val_acc=0.438]
Epoch 4:  42%|████▏     | 49/117 [00:02<00:03, 18.74it/s, loss=3.44, v_num=1, val_acc=0.438]
Epoch 4:  43%|████▎     | 50/117 [00:02<00:03, 19.06it/s, loss=3.44, v_num=1, val_acc=0.438]
Epoch 4:  43%|████▎     | 50/117 [00:02<00:03, 18.88it/s, loss=3.52, v_num=1, val_acc=0.438]
Epoch 4:  44%|████▎     | 51/117 [00:02<00:03, 19.17it/s, loss=3.52, v_num=1, val_acc=0.438]
Epoch 4:  44%|████▎     | 51/117 [00:02<00:03, 19.01it/s, loss=3.54, v_num=1, val_acc=0.438]
Epoch 4:  44%|████▍     | 52/117 [00:02<00:03, 19.31it/s, loss=3.54, v_num=1, val_acc=0.438]
Epoch 4:  44%|████▍     | 52/117 [00:02<00:03, 19.13it/s, loss=3.53, v_num=1, val_acc=0.438]
Epoch 4:  45%|████▌     | 53/117 [00:02<00:03, 19.43it/s, loss=3.53, v_num=1, val_acc=0.438]
Epoch 4:  45%|████▌     | 53/117 [00:02<00:03, 19.25it/s, loss=3.58, v_num=1, val_acc=0.438]
Epoch 4:  46%|████▌     | 54/117 [00:02<00:03, 19.55it/s, loss=3.58, v_num=1, val_acc=0.438]
Epoch 4:  46%|████▌     | 54/117 [00:02<00:03, 19.37it/s, loss=3.69, v_num=1, val_acc=0.438]
Epoch 4:  47%|████▋     | 55/117 [00:02<00:03, 19.66it/s, loss=3.69, v_num=1, val_acc=0.438]
Epoch 4:  47%|████▋     | 55/117 [00:02<00:03, 19.49it/s, loss=3.67, v_num=1, val_acc=0.438]
Epoch 4:  48%|████▊     | 56/117 [00:02<00:03, 19.77it/s, loss=3.67, v_num=1, val_acc=0.438]
Epoch 4:  48%|████▊     | 56/117 [00:02<00:03, 19.60it/s, loss=3.59, v_num=1, val_acc=0.438]
Epoch 4:  49%|████▊     | 57/117 [00:02<00:03, 19.89it/s, loss=3.59, v_num=1, val_acc=0.438]
Epoch 4:  49%|████▊     | 57/117 [00:02<00:03, 19.71it/s, loss=3.52, v_num=1, val_acc=0.438]
Epoch 4:  50%|████▉     | 58/117 [00:02<00:02, 20.00it/s, loss=3.52, v_num=1, val_acc=0.438]
Epoch 4:  50%|████▉     | 58/117 [00:02<00:02, 19.82it/s, loss=3.42, v_num=1, val_acc=0.438]
Epoch 4:  50%|█████     | 59/117 [00:02<00:02, 20.10it/s, loss=3.42, v_num=1, val_acc=0.438]
Epoch 4:  50%|█████     | 59/117 [00:02<00:02, 19.93it/s, loss=3.38, v_num=1, val_acc=0.438]
Epoch 4:  51%|█████▏    | 60/117 [00:02<00:02, 20.20it/s, loss=3.38, v_num=1, val_acc=0.438]
Epoch 4:  51%|█████▏    | 60/117 [00:02<00:02, 20.03it/s, loss=3.33, v_num=1, val_acc=0.438]
Epoch 4:  52%|█████▏    | 61/117 [00:03<00:02, 20.30it/s, loss=3.33, v_num=1, val_acc=0.438]
Epoch 4:  52%|█████▏    | 61/117 [00:03<00:02, 20.13it/s, loss=3.28, v_num=1, val_acc=0.438]
Epoch 4:  53%|█████▎    | 62/117 [00:03<00:02, 20.40it/s, loss=3.28, v_num=1, val_acc=0.438]
Epoch 4:  53%|█████▎    | 62/117 [00:03<00:02, 20.23it/s, loss=3.25, v_num=1, val_acc=0.438]
Epoch 4:  54%|█████▍    | 63/117 [00:03<00:02, 20.49it/s, loss=3.25, v_num=1, val_acc=0.438]
Epoch 4:  54%|█████▍    | 63/117 [00:03<00:02, 20.32it/s, loss=3.24, v_num=1, val_acc=0.438]
Epoch 4:  55%|█████▍    | 64/117 [00:03<00:02, 20.58it/s, loss=3.24, v_num=1, val_acc=0.438]
Epoch 4:  55%|█████▍    | 64/117 [00:03<00:02, 20.41it/s, loss=3.29, v_num=1, val_acc=0.438]
Epoch 4:  56%|█████▌    | 65/117 [00:03<00:02, 20.66it/s, loss=3.29, v_num=1, val_acc=0.438]
Epoch 4:  56%|█████▌    | 65/117 [00:03<00:02, 20.50it/s, loss=3.36, v_num=1, val_acc=0.438]
Epoch 4:  56%|█████▋    | 66/117 [00:03<00:02, 20.75it/s, loss=3.36, v_num=1, val_acc=0.438]
Epoch 4:  56%|█████▋    | 66/117 [00:03<00:02, 20.59it/s, loss=3.57, v_num=1, val_acc=0.438]
Epoch 4:  57%|█████▋    | 67/117 [00:03<00:02, 20.84it/s, loss=3.57, v_num=1, val_acc=0.438]
Epoch 4:  57%|█████▋    | 67/117 [00:03<00:02, 20.68it/s, loss=3.63, v_num=1, val_acc=0.438]
Epoch 4:  58%|█████▊    | 68/117 [00:03<00:02, 20.92it/s, loss=3.63, v_num=1, val_acc=0.438]
Epoch 4:  58%|█████▊    | 68/117 [00:03<00:02, 20.76it/s, loss=3.83, v_num=1, val_acc=0.438]
Epoch 4:  59%|█████▉    | 69/117 [00:03<00:02, 21.01it/s, loss=3.83, v_num=1, val_acc=0.438]
Epoch 4:  59%|█████▉    | 69/117 [00:03<00:02, 20.85it/s, loss=3.88, v_num=1, val_acc=0.438]
Epoch 4:  60%|█████▉    | 70/117 [00:03<00:02, 21.09it/s, loss=3.88, v_num=1, val_acc=0.438]
Epoch 4:  60%|█████▉    | 70/117 [00:03<00:02, 20.93it/s, loss=3.8, v_num=1, val_acc=0.438]
Epoch 4:  61%|██████    | 71/117 [00:03<00:02, 21.17it/s, loss=3.8, v_num=1, val_acc=0.438]
Epoch 4:  61%|██████    | 71/117 [00:03<00:02, 21.01it/s, loss=3.71, v_num=1, val_acc=0.438]
Epoch 4:  62%|██████▏   | 72/117 [00:03<00:02, 21.25it/s, loss=3.71, v_num=1, val_acc=0.438]
Epoch 4:  62%|██████▏   | 72/117 [00:03<00:02, 21.10it/s, loss=3.61, v_num=1, val_acc=0.438]
Epoch 4:  62%|██████▏   | 73/117 [00:03<00:02, 21.33it/s, loss=3.61, v_num=1, val_acc=0.438]
Epoch 4:  62%|██████▏   | 73/117 [00:03<00:02, 21.17it/s, loss=3.48, v_num=1, val_acc=0.438]
Epoch 4:  63%|██████▎   | 74/117 [00:03<00:02, 21.41it/s, loss=3.48, v_num=1, val_acc=0.438]
Epoch 4:  63%|██████▎   | 74/117 [00:03<00:02, 21.25it/s, loss=3.37, v_num=1, val_acc=0.438]
Epoch 4:  64%|██████▍   | 75/117 [00:03<00:01, 21.46it/s, loss=3.37, v_num=1, val_acc=0.438]
Epoch 4:  64%|██████▍   | 75/117 [00:03<00:01, 21.31it/s, loss=3.32, v_num=1, val_acc=0.438]
Epoch 4:  65%|██████▍   | 76/117 [00:03<00:01, 21.54it/s, loss=3.32, v_num=1, val_acc=0.438]
Epoch 4:  65%|██████▍   | 76/117 [00:03<00:01, 21.38it/s, loss=3.34, v_num=1, val_acc=0.438]
Epoch 4:  66%|██████▌   | 77/117 [00:03<00:01, 21.61it/s, loss=3.34, v_num=1, val_acc=0.438]
Epoch 4:  66%|██████▌   | 77/117 [00:03<00:01, 21.46it/s, loss=3.34, v_num=1, val_acc=0.438]
Epoch 4:  67%|██████▋   | 78/117 [00:03<00:01, 21.68it/s, loss=3.34, v_num=1, val_acc=0.438]
Epoch 4:  67%|██████▋   | 78/117 [00:03<00:01, 21.53it/s, loss=3.29, v_num=1, val_acc=0.438]
Epoch 4:  68%|██████▊   | 79/117 [00:03<00:01, 21.75it/s, loss=3.29, v_num=1, val_acc=0.438]
Epoch 4:  68%|██████▊   | 79/117 [00:03<00:01, 21.60it/s, loss=3.27, v_num=1, val_acc=0.438]
Epoch 4:  68%|██████▊   | 80/117 [00:03<00:01, 21.82it/s, loss=3.27, v_num=1, val_acc=0.438]
Epoch 4:  68%|██████▊   | 80/117 [00:03<00:01, 21.67it/s, loss=3.31, v_num=1, val_acc=0.438]
Epoch 4:  69%|██████▉   | 81/117 [00:03<00:01, 21.89it/s, loss=3.31, v_num=1, val_acc=0.438]
Epoch 4:  69%|██████▉   | 81/117 [00:03<00:01, 21.74it/s, loss=3.46, v_num=1, val_acc=0.438]
Epoch 4:  70%|███████   | 82/117 [00:03<00:01, 21.93it/s, loss=3.46, v_num=1, val_acc=0.438]
Epoch 4:  70%|███████   | 82/117 [00:03<00:01, 21.79it/s, loss=3.51, v_num=1, val_acc=0.438]
Epoch 4:  71%|███████   | 83/117 [00:03<00:01, 22.00it/s, loss=3.51, v_num=1, val_acc=0.438]
Epoch 4:  71%|███████   | 83/117 [00:03<00:01, 21.85it/s, loss=3.47, v_num=1, val_acc=0.438]
Epoch 4:  72%|███████▏  | 84/117 [00:03<00:01, 22.06it/s, loss=3.47, v_num=1, val_acc=0.438]
Epoch 4:  72%|███████▏  | 84/117 [00:03<00:01, 21.92it/s, loss=3.4, v_num=1, val_acc=0.438]
Epoch 4:  73%|███████▎  | 85/117 [00:03<00:01, 22.11it/s, loss=3.4, v_num=1, val_acc=0.438]
Epoch 4:  73%|███████▎  | 85/117 [00:03<00:01, 21.97it/s, loss=3.32, v_num=1, val_acc=0.438]
Epoch 4:  74%|███████▎  | 86/117 [00:03<00:01, 22.18it/s, loss=3.32, v_num=1, val_acc=0.438]
Epoch 4:  74%|███████▎  | 86/117 [00:03<00:01, 22.03it/s, loss=3.14, v_num=1, val_acc=0.438]
Epoch 4:  74%|███████▍  | 87/117 [00:03<00:01, 22.24it/s, loss=3.14, v_num=1, val_acc=0.438]
Epoch 4:  74%|███████▍  | 87/117 [00:03<00:01, 22.09it/s, loss=2.98, v_num=1, val_acc=0.438]
Epoch 4:  75%|███████▌  | 88/117 [00:03<00:01, 22.30it/s, loss=2.98, v_num=1, val_acc=0.438]
Epoch 4:  75%|███████▌  | 88/117 [00:03<00:01, 22.15it/s, loss=2.78, v_num=1, val_acc=0.438]
Epoch 4:  76%|███████▌  | 89/117 [00:03<00:01, 22.35it/s, loss=2.78, v_num=1, val_acc=0.438]
Epoch 4:  76%|███████▌  | 89/117 [00:04<00:01, 22.21it/s, loss=2.75, v_num=1, val_acc=0.438]
Epoch 4:  77%|███████▋  | 90/117 [00:04<00:01, 22.41it/s, loss=2.75, v_num=1, val_acc=0.438]
Epoch 4:  77%|███████▋  | 90/117 [00:04<00:01, 22.27it/s, loss=2.84, v_num=1, val_acc=0.438]
Epoch 4:  78%|███████▊  | 91/117 [00:04<00:01, 22.47it/s, loss=2.84, v_num=1, val_acc=0.438]
Epoch 4:  78%|███████▊  | 91/117 [00:04<00:01, 22.33it/s, loss=2.93, v_num=1, val_acc=0.438]
Epoch 4:  79%|███████▊  | 92/117 [00:04<00:01, 22.52it/s, loss=2.93, v_num=1, val_acc=0.438]
Epoch 4:  79%|███████▊  | 92/117 [00:04<00:01, 22.39it/s, loss=3, v_num=1, val_acc=0.438]
Epoch 4:  79%|███████▉  | 93/117 [00:04<00:01, 22.58it/s, loss=3, v_num=1, val_acc=0.438]
Epoch 4:  79%|███████▉  | 93/117 [00:04<00:01, 22.44it/s, loss=3.15, v_num=1, val_acc=0.438]
Epoch 4:  80%|████████  | 94/117 [00:04<00:01, 22.63it/s, loss=3.15, v_num=1, val_acc=0.438]
Epoch 4:  80%|████████  | 94/117 [00:04<00:01, 22.50it/s, loss=3.24, v_num=1, val_acc=0.438]
Epoch 4:  81%|████████  | 95/117 [00:04<00:00, 22.69it/s, loss=3.24, v_num=1, val_acc=0.438]
Epoch 4:  81%|████████  | 95/117 [00:04<00:00, 22.55it/s, loss=3.26, v_num=1, val_acc=0.438]
Epoch 4:  82%|████████▏ | 96/117 [00:04<00:00, 22.74it/s, loss=3.26, v_num=1, val_acc=0.438]
Epoch 4:  82%|████████▏ | 96/117 [00:04<00:00, 22.60it/s, loss=3.28, v_num=1, val_acc=0.438]
Epoch 4:  83%|████████▎ | 97/117 [00:04<00:00, 22.79it/s, loss=3.28, v_num=1, val_acc=0.438]
Epoch 4:  83%|████████▎ | 97/117 [00:04<00:00, 22.65it/s, loss=3.36, v_num=1, val_acc=0.438]

Validation: 0it [00:00, ?it/s]

Validation:   0%|          | 0/20 [00:00<?, ?it/s]

Validation DataLoader 0:   0%|          | 0/20 [00:00<?, ?it/s]

Validation DataLoader 0:   5%|▌         | 1/20 [00:00<00:00, 176.57it/s]
Epoch 4:  84%|████████▍ | 98/117 [00:05<00:00, 19.12it/s, loss=3.36, v_num=1, val_acc=0.438]

Validation DataLoader 0:  10%|█         | 2/20 [00:00<00:00, 55.17it/s]
Epoch 4:  85%|████████▍ | 99/117 [00:05<00:00, 19.20it/s, loss=3.36, v_num=1, val_acc=0.438]

Validation DataLoader 0:  15%|█▌        | 3/20 [00:00<00:00, 43.93it/s]
Epoch 4:  85%|████████▌ | 100/117 [00:05<00:00, 19.28it/s, loss=3.36, v_num=1, val_acc=0.438]

Validation DataLoader 0:  20%|██        | 4/20 [00:00<00:00, 39.98it/s]
Epoch 4:  86%|████████▋ | 101/117 [00:05<00:00, 19.35it/s, loss=3.36, v_num=1, val_acc=0.438]

Validation DataLoader 0:  25%|██▌       | 5/20 [00:00<00:00, 37.74it/s]
Epoch 4:  87%|████████▋ | 102/117 [00:05<00:00, 19.42it/s, loss=3.36, v_num=1, val_acc=0.438]

Validation DataLoader 0:  30%|███       | 6/20 [00:00<00:00, 36.57it/s]
Epoch 4:  88%|████████▊ | 103/117 [00:05<00:00, 19.49it/s, loss=3.36, v_num=1, val_acc=0.438]

Validation DataLoader 0:  35%|███▌      | 7/20 [00:00<00:00, 35.65it/s]
Epoch 4:  89%|████████▉ | 104/117 [00:05<00:00, 19.56it/s, loss=3.36, v_num=1, val_acc=0.438]

Validation DataLoader 0:  40%|████      | 8/20 [00:00<00:00, 35.11it/s]
Epoch 4:  90%|████████▉ | 105/117 [00:05<00:00, 19.63it/s, loss=3.36, v_num=1, val_acc=0.438]

Validation DataLoader 0:  45%|████▌     | 9/20 [00:00<00:00, 34.44it/s]
Epoch 4:  91%|█████████ | 106/117 [00:05<00:00, 19.70it/s, loss=3.36, v_num=1, val_acc=0.438]

Validation DataLoader 0:  50%|█████     | 10/20 [00:00<00:00, 34.15it/s]
Epoch 4:  91%|█████████▏| 107/117 [00:05<00:00, 19.77it/s, loss=3.36, v_num=1, val_acc=0.438]

Validation DataLoader 0:  55%|█████▌    | 11/20 [00:00<00:00, 33.87it/s]
Epoch 4:  92%|█████████▏| 108/117 [00:05<00:00, 19.84it/s, loss=3.36, v_num=1, val_acc=0.438]

Validation DataLoader 0:  60%|██████    | 12/20 [00:00<00:00, 33.56it/s]
Epoch 4:  93%|█████████▎| 109/117 [00:05<00:00, 19.90it/s, loss=3.36, v_num=1, val_acc=0.438]

Validation DataLoader 0:  65%|██████▌   | 13/20 [00:00<00:00, 33.34it/s]
Epoch 4:  94%|█████████▍| 110/117 [00:05<00:00, 19.96it/s, loss=3.36, v_num=1, val_acc=0.438]

Validation DataLoader 0:  70%|███████   | 14/20 [00:00<00:00, 33.25it/s]
Epoch 4:  95%|█████████▍| 111/117 [00:05<00:00, 20.03it/s, loss=3.36, v_num=1, val_acc=0.438]

Validation DataLoader 0:  75%|███████▌  | 15/20 [00:00<00:00, 33.11it/s]
Epoch 4:  96%|█████████▌| 112/117 [00:05<00:00, 20.10it/s, loss=3.36, v_num=1, val_acc=0.438]

Validation DataLoader 0:  80%|████████  | 16/20 [00:00<00:00, 33.01it/s]
Epoch 4:  97%|█████████▋| 113/117 [00:05<00:00, 20.16it/s, loss=3.36, v_num=1, val_acc=0.438]

Validation DataLoader 0:  85%|████████▌ | 17/20 [00:00<00:00, 32.92it/s]
Epoch 4:  97%|█████████▋| 114/117 [00:05<00:00, 20.23it/s, loss=3.36, v_num=1, val_acc=0.438]

Validation DataLoader 0:  90%|█████████ | 18/20 [00:00<00:00, 32.85it/s]
Epoch 4:  98%|█████████▊| 115/117 [00:05<00:00, 20.29it/s, loss=3.36, v_num=1, val_acc=0.438]

Validation DataLoader 0:  95%|█████████▌| 19/20 [00:00<00:00, 32.79it/s]
Epoch 4:  99%|█████████▉| 116/117 [00:05<00:00, 20.35it/s, loss=3.36, v_num=1, val_acc=0.438]

Validation DataLoader 0: 100%|██████████| 20/20 [00:00<00:00, 32.79it/s]
Epoch 4: 100%|██████████| 117/117 [00:05<00:00, 20.42it/s, loss=3.36, v_num=1, val_acc=0.438]
Epoch 4: 100%|██████████| 117/117 [00:05<00:00, 20.35it/s, loss=3.36, v_num=1, val_acc=0.599]


Epoch 4: 100%|██████████| 117/117 [00:05<00:00, 20.35it/s, loss=3.36, v_num=1, val_acc=0.599]
Epoch 4:   0%|          | 0/117 [00:00<?, ?it/s, loss=3.36, v_num=1, val_acc=0.599]
Epoch 5:   0%|          | 0/117 [00:00<?, ?it/s, loss=3.36, v_num=1, val_acc=0.599]
Epoch 5:   1%|          | 1/117 [00:00<01:46,  1.09it/s, loss=3.36, v_num=1, val_acc=0.599]
Epoch 5:   1%|          | 1/117 [00:00<01:49,  1.06it/s, loss=3.45, v_num=1, val_acc=0.599]
Epoch 5:   2%|▏         | 2/117 [00:00<00:54,  2.10it/s, loss=3.45, v_num=1, val_acc=0.599]
Epoch 5:   2%|▏         | 2/117 [00:00<00:56,  2.05it/s, loss=3.5, v_num=1, val_acc=0.599]
Epoch 5:   3%|▎         | 3/117 [00:00<00:37,  3.04it/s, loss=3.5, v_num=1, val_acc=0.599]
Epoch 5:   3%|▎         | 3/117 [00:01<00:38,  2.97it/s, loss=3.47, v_num=1, val_acc=0.599]
Epoch 5:   3%|▎         | 4/117 [00:01<00:28,  3.92it/s, loss=3.47, v_num=1, val_acc=0.599]
Epoch 5:   3%|▎         | 4/117 [00:01<00:29,  3.83it/s, loss=3.38, v_num=1, val_acc=0.599]
Epoch 5:   4%|▍         | 5/117 [00:01<00:23,  4.74it/s, loss=3.38, v_num=1, val_acc=0.599]
Epoch 5:   4%|▍         | 5/117 [00:01<00:24,  4.63it/s, loss=3.35, v_num=1, val_acc=0.599]
Epoch 5:   5%|▌         | 6/117 [00:01<00:20,  5.50it/s, loss=3.35, v_num=1, val_acc=0.599]
Epoch 5:   5%|▌         | 6/117 [00:01<00:20,  5.38it/s, loss=3.4, v_num=1, val_acc=0.599]
Epoch 5:   6%|▌         | 7/117 [00:01<00:17,  6.22it/s, loss=3.4, v_num=1, val_acc=0.599]
Epoch 5:   6%|▌         | 7/117 [00:01<00:18,  6.08it/s, loss=3.52, v_num=1, val_acc=0.599]
Epoch 5:   7%|▋         | 8/117 [00:01<00:15,  6.89it/s, loss=3.52, v_num=1, val_acc=0.599]
Epoch 5:   7%|▋         | 8/117 [00:01<00:16,  6.75it/s, loss=3.52, v_num=1, val_acc=0.599]
Epoch 5:   8%|▊         | 9/117 [00:01<00:14,  7.50it/s, loss=3.52, v_num=1, val_acc=0.599]
Epoch 5:   8%|▊         | 9/117 [00:01<00:14,  7.34it/s, loss=3.56, v_num=1, val_acc=0.599]
Epoch 5:   9%|▊         | 10/117 [00:01<00:13,  8.08it/s, loss=3.56, v_num=1, val_acc=0.599]
Epoch 5:   9%|▊         | 10/117 [00:01<00:13,  7.93it/s, loss=3.62, v_num=1, val_acc=0.599]
Epoch 5:   9%|▉         | 11/117 [00:01<00:12,  8.66it/s, loss=3.62, v_num=1, val_acc=0.599]
Epoch 5:   9%|▉         | 11/117 [00:01<00:12,  8.49it/s, loss=3.73, v_num=1, val_acc=0.599]
Epoch 5:  10%|█         | 12/117 [00:01<00:11,  9.20it/s, loss=3.73, v_num=1, val_acc=0.599]
Epoch 5:  10%|█         | 12/117 [00:01<00:11,  9.02it/s, loss=3.69, v_num=1, val_acc=0.599]
Epoch 5:  11%|█         | 13/117 [00:01<00:10,  9.70it/s, loss=3.69, v_num=1, val_acc=0.599]
Epoch 5:  11%|█         | 13/117 [00:01<00:10,  9.52it/s, loss=3.6, v_num=1, val_acc=0.599]
Epoch 5:  12%|█▏        | 14/117 [00:01<00:10, 10.19it/s, loss=3.6, v_num=1, val_acc=0.599]
Epoch 5:  12%|█▏        | 14/117 [00:01<00:10, 10.00it/s, loss=3.55, v_num=1, val_acc=0.599]
Epoch 5:  13%|█▎        | 15/117 [00:01<00:09, 10.65it/s, loss=3.55, v_num=1, val_acc=0.599]
Epoch 5:  13%|█▎        | 15/117 [00:01<00:09, 10.46it/s, loss=3.48, v_num=1, val_acc=0.599]
Epoch 5:  14%|█▎        | 16/117 [00:01<00:09, 11.07it/s, loss=3.48, v_num=1, val_acc=0.599]
Epoch 5:  14%|█▎        | 16/117 [00:01<00:09, 10.88it/s, loss=3.39, v_num=1, val_acc=0.599]
Epoch 5:  15%|█▍        | 17/117 [00:01<00:08, 11.40it/s, loss=3.39, v_num=1, val_acc=0.599]
Epoch 5:  15%|█▍        | 17/117 [00:01<00:08, 11.21it/s, loss=3.31, v_num=1, val_acc=0.599]
Epoch 5:  15%|█▌        | 18/117 [00:01<00:08, 11.80it/s, loss=3.31, v_num=1, val_acc=0.599]
Epoch 5:  15%|█▌        | 18/117 [00:01<00:08, 11.61it/s, loss=3.35, v_num=1, val_acc=0.599]
Epoch 5:  16%|█▌        | 19/117 [00:01<00:08, 12.14it/s, loss=3.35, v_num=1, val_acc=0.599]
Epoch 5:  16%|█▌        | 19/117 [00:01<00:08, 11.99it/s, loss=3.41, v_num=1, val_acc=0.599]
Epoch 5:  17%|█▋        | 20/117 [00:01<00:07, 12.55it/s, loss=3.41, v_num=1, val_acc=0.599]
Epoch 5:  17%|█▋        | 20/117 [00:01<00:07, 12.36it/s, loss=3.4, v_num=1, val_acc=0.599]
Epoch 5:  18%|█▊        | 21/117 [00:01<00:07, 12.89it/s, loss=3.4, v_num=1, val_acc=0.599]
Epoch 5:  18%|█▊        | 21/117 [00:01<00:07, 12.70it/s, loss=3.48, v_num=1, val_acc=0.599]
Epoch 5:  19%|█▉        | 22/117 [00:01<00:07, 13.18it/s, loss=3.48, v_num=1, val_acc=0.599]
Epoch 5:  19%|█▉        | 22/117 [00:01<00:07, 12.99it/s, loss=3.56, v_num=1, val_acc=0.599]
Epoch 5:  20%|█▉        | 23/117 [00:01<00:07, 13.35it/s, loss=3.56, v_num=1, val_acc=0.599]
Epoch 5:  20%|█▉        | 23/117 [00:01<00:07, 13.16it/s, loss=3.83, v_num=1, val_acc=0.599]
Epoch 5:  21%|██        | 24/117 [00:01<00:06, 13.66it/s, loss=3.83, v_num=1, val_acc=0.599]
Epoch 5:  21%|██        | 24/117 [00:01<00:06, 13.47it/s, loss=4.03, v_num=1, val_acc=0.599]
Epoch 5:  21%|██▏       | 25/117 [00:01<00:06, 13.96it/s, loss=4.03, v_num=1, val_acc=0.599]
Epoch 5:  21%|██▏       | 25/117 [00:01<00:06, 13.77it/s, loss=4.13, v_num=1, val_acc=0.599]
Epoch 5:  22%|██▏       | 26/117 [00:01<00:06, 14.25it/s, loss=4.13, v_num=1, val_acc=0.599]
Epoch 5:  22%|██▏       | 26/117 [00:01<00:06, 14.06it/s, loss=4.15, v_num=1, val_acc=0.599]
Epoch 5:  23%|██▎       | 27/117 [00:01<00:06, 14.52it/s, loss=4.15, v_num=1, val_acc=0.599]
Epoch 5:  23%|██▎       | 27/117 [00:01<00:06, 14.33it/s, loss=4.11, v_num=1, val_acc=0.599]
Epoch 5:  24%|██▍       | 28/117 [00:01<00:06, 14.73it/s, loss=4.11, v_num=1, val_acc=0.599]
Epoch 5:  24%|██▍       | 28/117 [00:01<00:06, 14.56it/s, loss=4.16, v_num=1, val_acc=0.599]
Epoch 5:  25%|██▍       | 29/117 [00:01<00:05, 14.97it/s, loss=4.16, v_num=1, val_acc=0.599]
Epoch 5:  25%|██▍       | 29/117 [00:01<00:05, 14.81it/s, loss=4.08, v_num=1, val_acc=0.599]
Epoch 5:  26%|██▌       | 30/117 [00:01<00:05, 15.25it/s, loss=4.08, v_num=1, val_acc=0.599]
Epoch 5:  26%|██▌       | 30/117 [00:01<00:05, 15.05it/s, loss=4.05, v_num=1, val_acc=0.599]
Epoch 5:  26%|██▋       | 31/117 [00:02<00:05, 15.46it/s, loss=4.05, v_num=1, val_acc=0.599]
Epoch 5:  26%|██▋       | 31/117 [00:02<00:05, 15.27it/s, loss=3.91, v_num=1, val_acc=0.599]
Epoch 5:  27%|██▋       | 32/117 [00:02<00:05, 15.67it/s, loss=3.91, v_num=1, val_acc=0.599]
Epoch 5:  27%|██▋       | 32/117 [00:02<00:05, 15.49it/s, loss=3.9, v_num=1, val_acc=0.599]
Epoch 5:  28%|██▊       | 33/117 [00:02<00:05, 15.88it/s, loss=3.9, v_num=1, val_acc=0.599]
Epoch 5:  28%|██▊       | 33/117 [00:02<00:05, 15.70it/s, loss=3.92, v_num=1, val_acc=0.599]
Epoch 5:  29%|██▉       | 34/117 [00:02<00:05, 16.10it/s, loss=3.92, v_num=1, val_acc=0.599]
Epoch 5:  29%|██▉       | 34/117 [00:02<00:05, 15.92it/s, loss=4, v_num=1, val_acc=0.599]
Epoch 5:  30%|██▉       | 35/117 [00:02<00:05, 16.31it/s, loss=4, v_num=1, val_acc=0.599]
Epoch 5:  30%|██▉       | 35/117 [00:02<00:05, 16.12it/s, loss=3.94, v_num=1, val_acc=0.599]
Epoch 5:  31%|███       | 36/117 [00:02<00:04, 16.51it/s, loss=3.94, v_num=1, val_acc=0.599]
Epoch 5:  31%|███       | 36/117 [00:02<00:04, 16.32it/s, loss=3.91, v_num=1, val_acc=0.599]
Epoch 5:  32%|███▏      | 37/117 [00:02<00:04, 16.70it/s, loss=3.91, v_num=1, val_acc=0.599]
Epoch 5:  32%|███▏      | 37/117 [00:02<00:04, 16.51it/s, loss=3.95, v_num=1, val_acc=0.599]
Epoch 5:  32%|███▏      | 38/117 [00:02<00:04, 16.88it/s, loss=3.95, v_num=1, val_acc=0.599]
Epoch 5:  32%|███▏      | 38/117 [00:02<00:04, 16.70it/s, loss=3.98, v_num=1, val_acc=0.599]
Epoch 5:  33%|███▎      | 39/117 [00:02<00:04, 17.06it/s, loss=3.98, v_num=1, val_acc=0.599]
Epoch 5:  33%|███▎      | 39/117 [00:02<00:04, 16.88it/s, loss=4.02, v_num=1, val_acc=0.599]
Epoch 5:  34%|███▍      | 40/117 [00:02<00:04, 17.25it/s, loss=4.02, v_num=1, val_acc=0.599]
Epoch 5:  34%|███▍      | 40/117 [00:02<00:04, 17.06it/s, loss=4.07, v_num=1, val_acc=0.599]
Epoch 5:  35%|███▌      | 41/117 [00:02<00:04, 17.42it/s, loss=4.07, v_num=1, val_acc=0.599]
Epoch 5:  35%|███▌      | 41/117 [00:02<00:04, 17.24it/s, loss=4.08, v_num=1, val_acc=0.599]
Epoch 5:  36%|███▌      | 42/117 [00:02<00:04, 17.59it/s, loss=4.08, v_num=1, val_acc=0.599]
Epoch 5:  36%|███▌      | 42/117 [00:02<00:04, 17.40it/s, loss=4.09, v_num=1, val_acc=0.599]
Epoch 5:  37%|███▋      | 43/117 [00:02<00:04, 17.75it/s, loss=4.09, v_num=1, val_acc=0.599]
Epoch 5:  37%|███▋      | 43/117 [00:02<00:04, 17.57it/s, loss=3.89, v_num=1, val_acc=0.599]
Epoch 5:  38%|███▊      | 44/117 [00:02<00:04, 17.91it/s, loss=3.89, v_num=1, val_acc=0.599]
Epoch 5:  38%|███▊      | 44/117 [00:02<00:04, 17.72it/s, loss=3.73, v_num=1, val_acc=0.599]
Epoch 5:  38%|███▊      | 45/117 [00:02<00:03, 18.06it/s, loss=3.73, v_num=1, val_acc=0.599]
Epoch 5:  38%|███▊      | 45/117 [00:02<00:04, 17.88it/s, loss=3.7, v_num=1, val_acc=0.599]
Epoch 5:  39%|███▉      | 46/117 [00:02<00:03, 18.20it/s, loss=3.7, v_num=1, val_acc=0.599]
Epoch 5:  39%|███▉      | 46/117 [00:02<00:03, 18.02it/s, loss=3.76, v_num=1, val_acc=0.599]
Epoch 5:  40%|████      | 47/117 [00:02<00:03, 18.35it/s, loss=3.76, v_num=1, val_acc=0.599]
Epoch 5:  40%|████      | 47/117 [00:02<00:03, 18.17it/s, loss=3.81, v_num=1, val_acc=0.599]
Epoch 5:  41%|████      | 48/117 [00:02<00:03, 18.48it/s, loss=3.81, v_num=1, val_acc=0.599]
Epoch 5:  41%|████      | 48/117 [00:02<00:03, 18.31it/s, loss=3.81, v_num=1, val_acc=0.599]
Epoch 5:  42%|████▏     | 49/117 [00:02<00:03, 18.62it/s, loss=3.81, v_num=1, val_acc=0.599]
Epoch 5:  42%|████▏     | 49/117 [00:02<00:03, 18.45it/s, loss=3.91, v_num=1, val_acc=0.599]
Epoch 5:  43%|████▎     | 50/117 [00:02<00:03, 18.76it/s, loss=3.91, v_num=1, val_acc=0.599]
Epoch 5:  43%|████▎     | 50/117 [00:02<00:03, 18.58it/s, loss=3.94, v_num=1, val_acc=0.599]
Epoch 5:  44%|████▎     | 51/117 [00:02<00:03, 18.88it/s, loss=3.94, v_num=1, val_acc=0.599]
Epoch 5:  44%|████▎     | 51/117 [00:02<00:03, 18.71it/s, loss=3.96, v_num=1, val_acc=0.599]
Epoch 5:  44%|████▍     | 52/117 [00:02<00:03, 19.01it/s, loss=3.96, v_num=1, val_acc=0.599]
Epoch 5:  44%|████▍     | 52/117 [00:02<00:03, 18.84it/s, loss=4.02, v_num=1, val_acc=0.599]
Epoch 5:  45%|████▌     | 53/117 [00:02<00:03, 19.13it/s, loss=4.02, v_num=1, val_acc=0.599]
Epoch 5:  45%|████▌     | 53/117 [00:02<00:03, 18.96it/s, loss=4.07, v_num=1, val_acc=0.599]
Epoch 5:  46%|████▌     | 54/117 [00:02<00:03, 19.25it/s, loss=4.07, v_num=1, val_acc=0.599]
Epoch 5:  46%|████▌     | 54/117 [00:02<00:03, 19.08it/s, loss=3.94, v_num=1, val_acc=0.599]
Epoch 5:  47%|████▋     | 55/117 [00:02<00:03, 19.37it/s, loss=3.94, v_num=1, val_acc=0.599]
Epoch 5:  47%|████▋     | 55/117 [00:02<00:03, 19.20it/s, loss=3.97, v_num=1, val_acc=0.599]
Epoch 5:  48%|████▊     | 56/117 [00:02<00:03, 19.49it/s, loss=3.97, v_num=1, val_acc=0.599]
Epoch 5:  48%|████▊     | 56/117 [00:02<00:03, 19.32it/s, loss=3.98, v_num=1, val_acc=0.599]
Epoch 5:  49%|████▊     | 57/117 [00:02<00:03, 19.60it/s, loss=3.98, v_num=1, val_acc=0.599]
Epoch 5:  49%|████▊     | 57/117 [00:02<00:03, 19.43it/s, loss=3.93, v_num=1, val_acc=0.599]
Epoch 5:  50%|████▉     | 58/117 [00:02<00:02, 19.71it/s, loss=3.93, v_num=1, val_acc=0.599]
Epoch 5:  50%|████▉     | 58/117 [00:02<00:03, 19.54it/s, loss=3.94, v_num=1, val_acc=0.599]
Epoch 5:  50%|█████     | 59/117 [00:02<00:02, 19.82it/s, loss=3.94, v_num=1, val_acc=0.599]
Epoch 5:  50%|█████     | 59/117 [00:03<00:02, 19.65it/s, loss=3.86, v_num=1, val_acc=0.599]
Epoch 5:  51%|█████▏    | 60/117 [00:03<00:02, 19.92it/s, loss=3.86, v_num=1, val_acc=0.599]
Epoch 5:  51%|█████▏    | 60/117 [00:03<00:02, 19.76it/s, loss=3.89, v_num=1, val_acc=0.599]
Epoch 5:  52%|█████▏    | 61/117 [00:03<00:02, 20.02it/s, loss=3.89, v_num=1, val_acc=0.599]
Epoch 5:  52%|█████▏    | 61/117 [00:03<00:02, 19.86it/s, loss=3.91, v_num=1, val_acc=0.599]
Epoch 5:  53%|█████▎    | 62/117 [00:03<00:02, 20.11it/s, loss=3.91, v_num=1, val_acc=0.599]
Epoch 5:  53%|█████▎    | 62/117 [00:03<00:02, 19.95it/s, loss=3.82, v_num=1, val_acc=0.599]
Epoch 5:  54%|█████▍    | 63/117 [00:03<00:02, 20.21it/s, loss=3.82, v_num=1, val_acc=0.599]
Epoch 5:  54%|█████▍    | 63/117 [00:03<00:02, 20.05it/s, loss=3.8, v_num=1, val_acc=0.599]
Epoch 5:  55%|█████▍    | 64/117 [00:03<00:02, 20.29it/s, loss=3.8, v_num=1, val_acc=0.599]
Epoch 5:  55%|█████▍    | 64/117 [00:03<00:02, 20.13it/s, loss=3.82, v_num=1, val_acc=0.599]
Epoch 5:  56%|█████▌    | 65/117 [00:03<00:02, 20.38it/s, loss=3.82, v_num=1, val_acc=0.599]
Epoch 5:  56%|█████▌    | 65/117 [00:03<00:02, 20.22it/s, loss=3.79, v_num=1, val_acc=0.599]
Epoch 5:  56%|█████▋    | 66/117 [00:03<00:02, 20.44it/s, loss=3.79, v_num=1, val_acc=0.599]
Epoch 5:  56%|█████▋    | 66/117 [00:03<00:02, 20.31it/s, loss=3.75, v_num=1, val_acc=0.599]
Epoch 5:  57%|█████▋    | 67/117 [00:03<00:02, 20.55it/s, loss=3.75, v_num=1, val_acc=0.599]
Epoch 5:  57%|█████▋    | 67/117 [00:03<00:02, 20.40it/s, loss=3.66, v_num=1, val_acc=0.599]
Epoch 5:  58%|█████▊    | 68/117 [00:03<00:02, 20.64it/s, loss=3.66, v_num=1, val_acc=0.599]
Epoch 5:  58%|█████▊    | 68/117 [00:03<00:02, 20.49it/s, loss=3.62, v_num=1, val_acc=0.599]
Epoch 5:  59%|█████▉    | 69/117 [00:03<00:02, 20.73it/s, loss=3.62, v_num=1, val_acc=0.599]
Epoch 5:  59%|█████▉    | 69/117 [00:03<00:02, 20.57it/s, loss=3.53, v_num=1, val_acc=0.599]
Epoch 5:  60%|█████▉    | 70/117 [00:03<00:02, 20.81it/s, loss=3.53, v_num=1, val_acc=0.599]
Epoch 5:  60%|█████▉    | 70/117 [00:03<00:02, 20.66it/s, loss=3.5, v_num=1, val_acc=0.599]
Epoch 5:  61%|██████    | 71/117 [00:03<00:02, 20.90it/s, loss=3.5, v_num=1, val_acc=0.599]
Epoch 5:  61%|██████    | 71/117 [00:03<00:02, 20.74it/s, loss=3.58, v_num=1, val_acc=0.599]
Epoch 5:  62%|██████▏   | 72/117 [00:03<00:02, 20.98it/s, loss=3.58, v_num=1, val_acc=0.599]
Epoch 5:  62%|██████▏   | 72/117 [00:03<00:02, 20.82it/s, loss=3.64, v_num=1, val_acc=0.599]
Epoch 5:  62%|██████▏   | 73/117 [00:03<00:02, 21.06it/s, loss=3.64, v_num=1, val_acc=0.599]
Epoch 5:  62%|██████▏   | 73/117 [00:03<00:02, 20.91it/s, loss=3.57, v_num=1, val_acc=0.599]
Epoch 5:  63%|██████▎   | 74/117 [00:03<00:02, 21.13it/s, loss=3.57, v_num=1, val_acc=0.599]
Epoch 5:  63%|██████▎   | 74/117 [00:03<00:02, 20.98it/s, loss=3.57, v_num=1, val_acc=0.599]
Epoch 5:  64%|██████▍   | 75/117 [00:03<00:01, 21.21it/s, loss=3.57, v_num=1, val_acc=0.599]
Epoch 5:  64%|██████▍   | 75/117 [00:03<00:01, 21.06it/s, loss=3.58, v_num=1, val_acc=0.599]
Epoch 5:  65%|██████▍   | 76/117 [00:03<00:01, 21.29it/s, loss=3.58, v_num=1, val_acc=0.599]
Epoch 5:  65%|██████▍   | 76/117 [00:03<00:01, 21.14it/s, loss=3.61, v_num=1, val_acc=0.599]
Epoch 5:  66%|██████▌   | 77/117 [00:03<00:01, 21.33it/s, loss=3.61, v_num=1, val_acc=0.599]
Epoch 5:  66%|██████▌   | 77/117 [00:03<00:01, 21.18it/s, loss=3.6, v_num=1, val_acc=0.599]
Epoch 5:  67%|██████▋   | 78/117 [00:03<00:01, 21.40it/s, loss=3.6, v_num=1, val_acc=0.599]
Epoch 5:  67%|██████▋   | 78/117 [00:03<00:01, 21.26it/s, loss=3.54, v_num=1, val_acc=0.599]
Epoch 5:  68%|██████▊   | 79/117 [00:03<00:01, 21.44it/s, loss=3.54, v_num=1, val_acc=0.599]
Epoch 5:  68%|██████▊   | 79/117 [00:03<00:01, 21.31it/s, loss=3.52, v_num=1, val_acc=0.599]
Epoch 5:  68%|██████▊   | 80/117 [00:03<00:01, 21.53it/s, loss=3.52, v_num=1, val_acc=0.599]
Epoch 5:  68%|██████▊   | 80/117 [00:03<00:01, 21.38it/s, loss=3.42, v_num=1, val_acc=0.599]
Epoch 5:  69%|██████▉   | 81/117 [00:03<00:01, 21.59it/s, loss=3.42, v_num=1, val_acc=0.599]
Epoch 5:  69%|██████▉   | 81/117 [00:03<00:01, 21.45it/s, loss=3.23, v_num=1, val_acc=0.599]
Epoch 5:  70%|███████   | 82/117 [00:03<00:01, 21.60it/s, loss=3.23, v_num=1, val_acc=0.599]
Epoch 5:  70%|███████   | 82/117 [00:03<00:01, 21.46it/s, loss=3.19, v_num=1, val_acc=0.599]
Epoch 5:  71%|███████   | 83/117 [00:03<00:01, 21.67it/s, loss=3.19, v_num=1, val_acc=0.599]
Epoch 5:  71%|███████   | 83/117 [00:03<00:01, 21.53it/s, loss=3.18, v_num=1, val_acc=0.599]
Epoch 5:  72%|███████▏  | 84/117 [00:03<00:01, 21.73it/s, loss=3.18, v_num=1, val_acc=0.599]
Epoch 5:  72%|███████▏  | 84/117 [00:03<00:01, 21.59it/s, loss=3.17, v_num=1, val_acc=0.599]
Epoch 5:  73%|███████▎  | 85/117 [00:03<00:01, 21.80it/s, loss=3.17, v_num=1, val_acc=0.599]
Epoch 5:  73%|███████▎  | 85/117 [00:03<00:01, 21.66it/s, loss=3.25, v_num=1, val_acc=0.599]
Epoch 5:  74%|███████▎  | 86/117 [00:03<00:01, 21.86it/s, loss=3.25, v_num=1, val_acc=0.599]
Epoch 5:  74%|███████▎  | 86/117 [00:03<00:01, 21.72it/s, loss=3.28, v_num=1, val_acc=0.599]
Epoch 5:  74%|███████▍  | 87/117 [00:03<00:01, 21.92it/s, loss=3.28, v_num=1, val_acc=0.599]
Epoch 5:  74%|███████▍  | 87/117 [00:03<00:01, 21.79it/s, loss=3.27, v_num=1, val_acc=0.599]
Epoch 5:  75%|███████▌  | 88/117 [00:04<00:01, 21.99it/s, loss=3.27, v_num=1, val_acc=0.599]
Epoch 5:  75%|███████▌  | 88/117 [00:04<00:01, 21.85it/s, loss=3.28, v_num=1, val_acc=0.599]
Epoch 5:  76%|███████▌  | 89/117 [00:04<00:01, 22.05it/s, loss=3.28, v_num=1, val_acc=0.599]
Epoch 5:  76%|███████▌  | 89/117 [00:04<00:01, 21.91it/s, loss=3.34, v_num=1, val_acc=0.599]
Epoch 5:  77%|███████▋  | 90/117 [00:04<00:01, 22.10it/s, loss=3.34, v_num=1, val_acc=0.599]
Epoch 5:  77%|███████▋  | 90/117 [00:04<00:01, 21.97it/s, loss=3.32, v_num=1, val_acc=0.599]
Epoch 5:  78%|███████▊  | 91/117 [00:04<00:01, 22.16it/s, loss=3.32, v_num=1, val_acc=0.599]
Epoch 5:  78%|███████▊  | 91/117 [00:04<00:01, 22.03it/s, loss=3.28, v_num=1, val_acc=0.599]
Epoch 5:  79%|███████▊  | 92/117 [00:04<00:01, 22.22it/s, loss=3.28, v_num=1, val_acc=0.599]
Epoch 5:  79%|███████▊  | 92/117 [00:04<00:01, 22.09it/s, loss=3.13, v_num=1, val_acc=0.599]
Epoch 5:  79%|███████▉  | 93/117 [00:04<00:01, 22.28it/s, loss=3.13, v_num=1, val_acc=0.599]
Epoch 5:  79%|███████▉  | 93/117 [00:04<00:01, 22.15it/s, loss=3.08, v_num=1, val_acc=0.599]
Epoch 5:  80%|████████  | 94/117 [00:04<00:01, 22.34it/s, loss=3.08, v_num=1, val_acc=0.599]
Epoch 5:  80%|████████  | 94/117 [00:04<00:01, 22.20it/s, loss=3.09, v_num=1, val_acc=0.599]
Epoch 5:  81%|████████  | 95/117 [00:04<00:00, 22.39it/s, loss=3.09, v_num=1, val_acc=0.599]
Epoch 5:  81%|████████  | 95/117 [00:04<00:00, 22.26it/s, loss=3.04, v_num=1, val_acc=0.599]
Epoch 5:  82%|████████▏ | 96/117 [00:04<00:00, 22.44it/s, loss=3.04, v_num=1, val_acc=0.599]
Epoch 5:  82%|████████▏ | 96/117 [00:04<00:00, 22.31it/s, loss=2.98, v_num=1, val_acc=0.599]
Epoch 5:  83%|████████▎ | 97/117 [00:04<00:00, 22.50it/s, loss=2.98, v_num=1, val_acc=0.599]
Epoch 5:  83%|████████▎ | 97/117 [00:04<00:00, 22.36it/s, loss=2.97, v_num=1, val_acc=0.599]

Validation: 0it [00:00, ?it/s]

Validation:   0%|          | 0/20 [00:00<?, ?it/s]

Validation DataLoader 0:   0%|          | 0/20 [00:00<?, ?it/s]

Validation DataLoader 0:   5%|▌         | 1/20 [00:00<00:00, 170.56it/s]
Epoch 5:  84%|████████▍ | 98/117 [00:05<00:01, 18.89it/s, loss=2.97, v_num=1, val_acc=0.599]

Validation DataLoader 0:  10%|█         | 2/20 [00:00<00:00, 55.37it/s]
Epoch 5:  85%|████████▍ | 99/117 [00:05<00:00, 18.98it/s, loss=2.97, v_num=1, val_acc=0.599]

Validation DataLoader 0:  15%|█▌        | 3/20 [00:00<00:00, 44.30it/s]
Epoch 5:  85%|████████▌ | 100/117 [00:05<00:00, 19.05it/s, loss=2.97, v_num=1, val_acc=0.599]

Validation DataLoader 0:  20%|██        | 4/20 [00:00<00:00, 39.97it/s]
Epoch 5:  86%|████████▋ | 101/117 [00:05<00:00, 19.12it/s, loss=2.97, v_num=1, val_acc=0.599]

Validation DataLoader 0:  25%|██▌       | 5/20 [00:00<00:00, 37.68it/s]
Epoch 5:  87%|████████▋ | 102/117 [00:05<00:00, 19.20it/s, loss=2.97, v_num=1, val_acc=0.599]

Validation DataLoader 0:  30%|███       | 6/20 [00:00<00:00, 36.43it/s]
Epoch 5:  88%|████████▊ | 103/117 [00:05<00:00, 19.27it/s, loss=2.97, v_num=1, val_acc=0.599]

Validation DataLoader 0:  35%|███▌      | 7/20 [00:00<00:00, 35.55it/s]
Epoch 5:  89%|████████▉ | 104/117 [00:05<00:00, 19.34it/s, loss=2.97, v_num=1, val_acc=0.599]

Validation DataLoader 0:  40%|████      | 8/20 [00:00<00:00, 34.93it/s]
Epoch 5:  90%|████████▉ | 105/117 [00:05<00:00, 19.41it/s, loss=2.97, v_num=1, val_acc=0.599]

Validation DataLoader 0:  45%|████▌     | 9/20 [00:00<00:00, 34.49it/s]
Epoch 5:  91%|█████████ | 106/117 [00:05<00:00, 19.48it/s, loss=2.97, v_num=1, val_acc=0.599]

Validation DataLoader 0:  50%|█████     | 10/20 [00:00<00:00, 33.84it/s]
Epoch 5:  91%|█████████▏| 107/117 [00:05<00:00, 19.54it/s, loss=2.97, v_num=1, val_acc=0.599]

Validation DataLoader 0:  55%|█████▌    | 11/20 [00:00<00:00, 33.71it/s]
Epoch 5:  92%|█████████▏| 108/117 [00:05<00:00, 19.61it/s, loss=2.97, v_num=1, val_acc=0.599]

Validation DataLoader 0:  60%|██████    | 12/20 [00:00<00:00, 33.54it/s]
Epoch 5:  93%|█████████▎| 109/117 [00:05<00:00, 19.68it/s, loss=2.97, v_num=1, val_acc=0.599]

Validation DataLoader 0:  65%|██████▌   | 13/20 [00:00<00:00, 33.40it/s]
Epoch 5:  94%|█████████▍| 110/117 [00:05<00:00, 19.75it/s, loss=2.97, v_num=1, val_acc=0.599]

Validation DataLoader 0:  70%|███████   | 14/20 [00:00<00:00, 33.25it/s]
Epoch 5:  95%|█████████▍| 111/117 [00:05<00:00, 19.81it/s, loss=2.97, v_num=1, val_acc=0.599]

Validation DataLoader 0:  75%|███████▌  | 15/20 [00:00<00:00, 33.14it/s]
Epoch 5:  96%|█████████▌| 112/117 [00:05<00:00, 19.88it/s, loss=2.97, v_num=1, val_acc=0.599]

Validation DataLoader 0:  80%|████████  | 16/20 [00:00<00:00, 33.03it/s]
Epoch 5:  97%|█████████▋| 113/117 [00:05<00:00, 19.95it/s, loss=2.97, v_num=1, val_acc=0.599]

Validation DataLoader 0:  85%|████████▌ | 17/20 [00:00<00:00, 32.92it/s]
Epoch 5:  97%|█████████▋| 114/117 [00:05<00:00, 20.01it/s, loss=2.97, v_num=1, val_acc=0.599]

Validation DataLoader 0:  90%|█████████ | 18/20 [00:00<00:00, 32.86it/s]
Epoch 5:  98%|█████████▊| 115/117 [00:05<00:00, 20.07it/s, loss=2.97, v_num=1, val_acc=0.599]

Validation DataLoader 0:  95%|█████████▌| 19/20 [00:00<00:00, 32.79it/s]
Epoch 5:  99%|█████████▉| 116/117 [00:05<00:00, 20.14it/s, loss=2.97, v_num=1, val_acc=0.599]

Validation DataLoader 0: 100%|██████████| 20/20 [00:00<00:00, 32.79it/s]
Epoch 5: 100%|██████████| 117/117 [00:05<00:00, 20.20it/s, loss=2.97, v_num=1, val_acc=0.599]
Epoch 5: 100%|██████████| 117/117 [00:05<00:00, 20.14it/s, loss=2.97, v_num=1, val_acc=0.621]


Epoch 5: 100%|██████████| 117/117 [00:05<00:00, 20.13it/s, loss=2.97, v_num=1, val_acc=0.621]
Epoch 5:   0%|          | 0/117 [00:00<?, ?it/s, loss=2.97, v_num=1, val_acc=0.621]
Epoch 6:   0%|          | 0/117 [00:00<?, ?it/s, loss=2.97, v_num=1, val_acc=0.621]
Epoch 6:   1%|          | 1/117 [00:00<01:45,  1.10it/s, loss=2.97, v_num=1, val_acc=0.621]
Epoch 6:   1%|          | 1/117 [00:00<01:47,  1.07it/s, loss=3, v_num=1, val_acc=0.621]
Epoch 6:   2%|▏         | 2/117 [00:00<00:54,  2.13it/s, loss=3, v_num=1, val_acc=0.621]
Epoch 6:   2%|▏         | 2/117 [00:00<00:55,  2.07it/s, loss=2.98, v_num=1, val_acc=0.621]
Epoch 6:   3%|▎         | 3/117 [00:00<00:37,  3.07it/s, loss=2.98, v_num=1, val_acc=0.621]
Epoch 6:   3%|▎         | 3/117 [00:01<00:38,  2.99it/s, loss=2.99, v_num=1, val_acc=0.621]
Epoch 6:   3%|▎         | 4/117 [00:01<00:28,  3.94it/s, loss=2.99, v_num=1, val_acc=0.621]
Epoch 6:   3%|▎         | 4/117 [00:01<00:29,  3.85it/s, loss=3.08, v_num=1, val_acc=0.621]
Epoch 6:   4%|▍         | 5/117 [00:01<00:23,  4.77it/s, loss=3.08, v_num=1, val_acc=0.621]
Epoch 6:   4%|▍         | 5/117 [00:01<00:24,  4.66it/s, loss=3.12, v_num=1, val_acc=0.621]
Epoch 6:   5%|▌         | 6/117 [00:01<00:20,  5.54it/s, loss=3.12, v_num=1, val_acc=0.621]
Epoch 6:   5%|▌         | 6/117 [00:01<00:20,  5.42it/s, loss=3.06, v_num=1, val_acc=0.621]
Epoch 6:   6%|▌         | 7/117 [00:01<00:17,  6.27it/s, loss=3.06, v_num=1, val_acc=0.621]
Epoch 6:   6%|▌         | 7/117 [00:01<00:17,  6.13it/s, loss=3.03, v_num=1, val_acc=0.621]
Epoch 6:   7%|▋         | 8/117 [00:01<00:15,  6.96it/s, loss=3.03, v_num=1, val_acc=0.621]
Epoch 6:   7%|▋         | 8/117 [00:01<00:16,  6.81it/s, loss=2.9, v_num=1, val_acc=0.621]
Epoch 6:   8%|▊         | 9/117 [00:01<00:14,  7.60it/s, loss=2.9, v_num=1, val_acc=0.621]
Epoch 6:   8%|▊         | 9/117 [00:01<00:14,  7.44it/s, loss=2.84, v_num=1, val_acc=0.621]
Epoch 6:   9%|▊         | 10/117 [00:01<00:13,  8.20it/s, loss=2.84, v_num=1, val_acc=0.621]
Epoch 6:   9%|▊         | 10/117 [00:01<00:13,  8.04it/s, loss=2.95, v_num=1, val_acc=0.621]
Epoch 6:   9%|▉         | 11/117 [00:01<00:12,  8.76it/s, loss=2.95, v_num=1, val_acc=0.621]
Epoch 6:   9%|▉         | 11/117 [00:01<00:12,  8.59it/s, loss=3.02, v_num=1, val_acc=0.621]
Epoch 6:  10%|█         | 12/117 [00:01<00:11,  9.30it/s, loss=3.02, v_num=1, val_acc=0.621]
Epoch 6:  10%|█         | 12/117 [00:01<00:11,  9.12it/s, loss=3.06, v_num=1, val_acc=0.621]
Epoch 6:  11%|█         | 13/117 [00:01<00:10,  9.81it/s, loss=3.06, v_num=1, val_acc=0.621]
Epoch 6:  11%|█         | 13/117 [00:01<00:10,  9.63it/s, loss=3.19, v_num=1, val_acc=0.621]
Epoch 6:  12%|█▏        | 14/117 [00:01<00:09, 10.30it/s, loss=3.19, v_num=1, val_acc=0.621]
Epoch 6:  12%|█▏        | 14/117 [00:01<00:10, 10.12it/s, loss=3.26, v_num=1, val_acc=0.621]
Epoch 6:  13%|█▎        | 15/117 [00:01<00:09, 10.77it/s, loss=3.26, v_num=1, val_acc=0.621]
Epoch 6:  13%|█▎        | 15/117 [00:01<00:09, 10.58it/s, loss=3.36, v_num=1, val_acc=0.621]
Epoch 6:  14%|█▎        | 16/117 [00:01<00:09, 11.20it/s, loss=3.36, v_num=1, val_acc=0.621]
Epoch 6:  14%|█▎        | 16/117 [00:01<00:09, 11.01it/s, loss=3.46, v_num=1, val_acc=0.621]
Epoch 6:  15%|█▍        | 17/117 [00:01<00:08, 11.63it/s, loss=3.46, v_num=1, val_acc=0.621]
Epoch 6:  15%|█▍        | 17/117 [00:01<00:08, 11.43it/s, loss=3.54, v_num=1, val_acc=0.621]
Epoch 6:  15%|█▌        | 18/117 [00:01<00:08, 12.02it/s, loss=3.54, v_num=1, val_acc=0.621]
Epoch 6:  15%|█▌        | 18/117 [00:01<00:08, 11.82it/s, loss=3.62, v_num=1, val_acc=0.621]
Epoch 6:  16%|█▌        | 19/117 [00:01<00:07, 12.35it/s, loss=3.62, v_num=1, val_acc=0.621]
Epoch 6:  16%|█▌        | 19/117 [00:01<00:08, 12.17it/s, loss=3.7, v_num=1, val_acc=0.621]
Epoch 6:  17%|█▋        | 20/117 [00:01<00:07, 12.70it/s, loss=3.7, v_num=1, val_acc=0.621]
Epoch 6:  17%|█▋        | 20/117 [00:01<00:07, 12.52it/s, loss=3.74, v_num=1, val_acc=0.621]
Epoch 6:  18%|█▊        | 21/117 [00:01<00:07, 13.03it/s, loss=3.74, v_num=1, val_acc=0.621]
Epoch 6:  18%|█▊        | 21/117 [00:01<00:07, 12.85it/s, loss=3.74, v_num=1, val_acc=0.621]
Epoch 6:  19%|█▉        | 22/117 [00:01<00:07, 13.36it/s, loss=3.74, v_num=1, val_acc=0.621]
Epoch 6:  19%|█▉        | 22/117 [00:01<00:07, 13.18it/s, loss=3.74, v_num=1, val_acc=0.621]
Epoch 6:  20%|█▉        | 23/117 [00:01<00:06, 13.69it/s, loss=3.74, v_num=1, val_acc=0.621]
Epoch 6:  20%|█▉        | 23/117 [00:01<00:06, 13.49it/s, loss=3.71, v_num=1, val_acc=0.621]
Epoch 6:  21%|██        | 24/117 [00:01<00:06, 14.00it/s, loss=3.71, v_num=1, val_acc=0.621]
Epoch 6:  21%|██        | 24/117 [00:01<00:06, 13.80it/s, loss=3.65, v_num=1, val_acc=0.621]
Epoch 6:  21%|██▏       | 25/117 [00:01<00:06, 14.30it/s, loss=3.65, v_num=1, val_acc=0.621]
Epoch 6:  21%|██▏       | 25/117 [00:01<00:06, 14.10it/s, loss=3.67, v_num=1, val_acc=0.621]
Epoch 6:  22%|██▏       | 26/117 [00:01<00:06, 14.58it/s, loss=3.67, v_num=1, val_acc=0.621]
Epoch 6:  22%|██▏       | 26/117 [00:01<00:06, 14.38it/s, loss=3.8, v_num=1, val_acc=0.621]
Epoch 6:  23%|██▎       | 27/117 [00:01<00:06, 14.86it/s, loss=3.8, v_num=1, val_acc=0.621]
Epoch 6:  23%|██▎       | 27/117 [00:01<00:06, 14.65it/s, loss=3.8, v_num=1, val_acc=0.621]
Epoch 6:  24%|██▍       | 28/117 [00:01<00:05, 15.11it/s, loss=3.8, v_num=1, val_acc=0.621]
Epoch 6:  24%|██▍       | 28/117 [00:01<00:05, 14.91it/s, loss=3.82, v_num=1, val_acc=0.621]
Epoch 6:  25%|██▍       | 29/117 [00:01<00:05, 15.37it/s, loss=3.82, v_num=1, val_acc=0.621]
Epoch 6:  25%|██▍       | 29/117 [00:01<00:05, 15.16it/s, loss=3.76, v_num=1, val_acc=0.621]
Epoch 6:  26%|██▌       | 30/117 [00:01<00:05, 15.60it/s, loss=3.76, v_num=1, val_acc=0.621]
Epoch 6:  26%|██▌       | 30/117 [00:01<00:05, 15.40it/s, loss=3.61, v_num=1, val_acc=0.621]
Epoch 6:  26%|██▋       | 31/117 [00:01<00:05, 15.84it/s, loss=3.61, v_num=1, val_acc=0.621]
Epoch 6:  26%|██▋       | 31/117 [00:01<00:05, 15.64it/s, loss=3.48, v_num=1, val_acc=0.621]
Epoch 6:  27%|██▋       | 32/117 [00:01<00:05, 16.07it/s, loss=3.48, v_num=1, val_acc=0.621]
Epoch 6:  27%|██▋       | 32/117 [00:02<00:05, 15.87it/s, loss=3.39, v_num=1, val_acc=0.621]
Epoch 6:  28%|██▊       | 33/117 [00:02<00:05, 16.29it/s, loss=3.39, v_num=1, val_acc=0.621]
Epoch 6:  28%|██▊       | 33/117 [00:02<00:05, 16.09it/s, loss=3.37, v_num=1, val_acc=0.621]
Epoch 6:  29%|██▉       | 34/117 [00:02<00:05, 16.46it/s, loss=3.37, v_num=1, val_acc=0.621]
Epoch 6:  29%|██▉       | 34/117 [00:02<00:05, 16.29it/s, loss=3.32, v_num=1, val_acc=0.621]
Epoch 6:  30%|██▉       | 35/117 [00:02<00:04, 16.69it/s, loss=3.32, v_num=1, val_acc=0.621]
Epoch 6:  30%|██▉       | 35/117 [00:02<00:04, 16.49it/s, loss=3.25, v_num=1, val_acc=0.621]
Epoch 6:  31%|███       | 36/117 [00:02<00:04, 16.89it/s, loss=3.25, v_num=1, val_acc=0.621]
Epoch 6:  31%|███       | 36/117 [00:02<00:04, 16.69it/s, loss=3.16, v_num=1, val_acc=0.621]
Epoch 6:  32%|███▏      | 37/117 [00:02<00:04, 17.09it/s, loss=3.16, v_num=1, val_acc=0.621]
Epoch 6:  32%|███▏      | 37/117 [00:02<00:04, 16.89it/s, loss=3.09, v_num=1, val_acc=0.621]
Epoch 6:  32%|███▏      | 38/117 [00:02<00:04, 17.27it/s, loss=3.09, v_num=1, val_acc=0.621]
Epoch 6:  32%|███▏      | 38/117 [00:02<00:04, 17.08it/s, loss=3.08, v_num=1, val_acc=0.621]
Epoch 6:  33%|███▎      | 39/117 [00:02<00:04, 17.46it/s, loss=3.08, v_num=1, val_acc=0.621]
Epoch 6:  33%|███▎      | 39/117 [00:02<00:04, 17.26it/s, loss=3.19, v_num=1, val_acc=0.621]
Epoch 6:  34%|███▍      | 40/117 [00:02<00:04, 17.64it/s, loss=3.19, v_num=1, val_acc=0.621]
Epoch 6:  34%|███▍      | 40/117 [00:02<00:04, 17.44it/s, loss=3.25, v_num=1, val_acc=0.621]
Epoch 6:  35%|███▌      | 41/117 [00:02<00:04, 17.81it/s, loss=3.25, v_num=1, val_acc=0.621]
Epoch 6:  35%|███▌      | 41/117 [00:02<00:04, 17.61it/s, loss=3.29, v_num=1, val_acc=0.621]
Epoch 6:  36%|███▌      | 42/117 [00:02<00:04, 17.97it/s, loss=3.29, v_num=1, val_acc=0.621]
Epoch 6:  36%|███▌      | 42/117 [00:02<00:04, 17.78it/s, loss=3.38, v_num=1, val_acc=0.621]
Epoch 6:  37%|███▋      | 43/117 [00:02<00:04, 18.14it/s, loss=3.38, v_num=1, val_acc=0.621]
Epoch 6:  37%|███▋      | 43/117 [00:02<00:04, 17.94it/s, loss=3.34, v_num=1, val_acc=0.621]
Epoch 6:  38%|███▊      | 44/117 [00:02<00:03, 18.29it/s, loss=3.34, v_num=1, val_acc=0.621]
Epoch 6:  38%|███▊      | 44/117 [00:02<00:04, 18.10it/s, loss=3.32, v_num=1, val_acc=0.621]
Epoch 6:  38%|███▊      | 45/117 [00:02<00:03, 18.44it/s, loss=3.32, v_num=1, val_acc=0.621]
Epoch 6:  38%|███▊      | 45/117 [00:02<00:03, 18.26it/s, loss=3.26, v_num=1, val_acc=0.621]
Epoch 6:  39%|███▉      | 46/117 [00:02<00:03, 18.60it/s, loss=3.26, v_num=1, val_acc=0.621]
Epoch 6:  39%|███▉      | 46/117 [00:02<00:03, 18.41it/s, loss=3.14, v_num=1, val_acc=0.621]
Epoch 6:  40%|████      | 47/117 [00:02<00:03, 18.74it/s, loss=3.14, v_num=1, val_acc=0.621]
Epoch 6:  40%|████      | 47/117 [00:02<00:03, 18.55it/s, loss=3.13, v_num=1, val_acc=0.621]
Epoch 6:  41%|████      | 48/117 [00:02<00:03, 18.88it/s, loss=3.13, v_num=1, val_acc=0.621]
Epoch 6:  41%|████      | 48/117 [00:02<00:03, 18.69it/s, loss=3.15, v_num=1, val_acc=0.621]
Epoch 6:  42%|████▏     | 49/117 [00:02<00:03, 19.01it/s, loss=3.15, v_num=1, val_acc=0.621]
Epoch 6:  42%|████▏     | 49/117 [00:02<00:03, 18.83it/s, loss=3.28, v_num=1, val_acc=0.621]
Epoch 6:  43%|████▎     | 50/117 [00:02<00:03, 19.15it/s, loss=3.28, v_num=1, val_acc=0.621]
Epoch 6:  43%|████▎     | 50/117 [00:02<00:03, 18.96it/s, loss=3.31, v_num=1, val_acc=0.621]
Epoch 6:  44%|████▎     | 51/117 [00:02<00:03, 19.28it/s, loss=3.31, v_num=1, val_acc=0.621]
Epoch 6:  44%|████▎     | 51/117 [00:02<00:03, 19.09it/s, loss=3.34, v_num=1, val_acc=0.621]
Epoch 6:  44%|████▍     | 52/117 [00:02<00:03, 19.40it/s, loss=3.34, v_num=1, val_acc=0.621]
Epoch 6:  44%|████▍     | 52/117 [00:02<00:03, 19.22it/s, loss=3.34, v_num=1, val_acc=0.621]
Epoch 6:  45%|████▌     | 53/117 [00:02<00:03, 19.52it/s, loss=3.34, v_num=1, val_acc=0.621]
Epoch 6:  45%|████▌     | 53/117 [00:02<00:03, 19.34it/s, loss=3.25, v_num=1, val_acc=0.621]
Epoch 6:  46%|████▌     | 54/117 [00:02<00:03, 19.64it/s, loss=3.25, v_num=1, val_acc=0.621]
Epoch 6:  46%|████▌     | 54/117 [00:02<00:03, 19.46it/s, loss=3.19, v_num=1, val_acc=0.621]
Epoch 6:  47%|████▋     | 55/117 [00:02<00:03, 19.75it/s, loss=3.19, v_num=1, val_acc=0.621]
Epoch 6:  47%|████▋     | 55/117 [00:02<00:03, 19.58it/s, loss=3.22, v_num=1, val_acc=0.621]
Epoch 6:  48%|████▊     | 56/117 [00:02<00:03, 19.87it/s, loss=3.22, v_num=1, val_acc=0.621]
Epoch 6:  48%|████▊     | 56/117 [00:02<00:03, 19.69it/s, loss=3.25, v_num=1, val_acc=0.621]
Epoch 6:  49%|████▊     | 57/117 [00:02<00:03, 19.98it/s, loss=3.25, v_num=1, val_acc=0.621]
Epoch 6:  49%|████▊     | 57/117 [00:02<00:03, 19.81it/s, loss=3.32, v_num=1, val_acc=0.621]
Epoch 6:  50%|████▉     | 58/117 [00:02<00:02, 20.09it/s, loss=3.32, v_num=1, val_acc=0.621]
Epoch 6:  50%|████▉     | 58/117 [00:02<00:02, 19.92it/s, loss=3.32, v_num=1, val_acc=0.621]
Epoch 6:  50%|█████     | 59/117 [00:02<00:02, 20.19it/s, loss=3.32, v_num=1, val_acc=0.621]
Epoch 6:  50%|█████     | 59/117 [00:02<00:02, 20.02it/s, loss=3.25, v_num=1, val_acc=0.621]
Epoch 6:  51%|█████▏    | 60/117 [00:02<00:02, 20.30it/s, loss=3.25, v_num=1, val_acc=0.621]
Epoch 6:  51%|█████▏    | 60/117 [00:02<00:02, 20.13it/s, loss=3.14, v_num=1, val_acc=0.621]
Epoch 6:  52%|█████▏    | 61/117 [00:02<00:02, 20.40it/s, loss=3.14, v_num=1, val_acc=0.621]
Epoch 6:  52%|█████▏    | 61/117 [00:03<00:02, 20.23it/s, loss=3.15, v_num=1, val_acc=0.621]
Epoch 6:  53%|█████▎    | 62/117 [00:03<00:02, 20.50it/s, loss=3.15, v_num=1, val_acc=0.621]
Epoch 6:  53%|█████▎    | 62/117 [00:03<00:02, 20.33it/s, loss=3.12, v_num=1, val_acc=0.621]
Epoch 6:  54%|█████▍    | 63/117 [00:03<00:02, 20.59it/s, loss=3.12, v_num=1, val_acc=0.621]
Epoch 6:  54%|█████▍    | 63/117 [00:03<00:02, 20.43it/s, loss=3.16, v_num=1, val_acc=0.621]
Epoch 6:  55%|█████▍    | 64/117 [00:03<00:02, 20.67it/s, loss=3.16, v_num=1, val_acc=0.621]
Epoch 6:  55%|█████▍    | 64/117 [00:03<00:02, 20.52it/s, loss=3.18, v_num=1, val_acc=0.621]
Epoch 6:  56%|█████▌    | 65/117 [00:03<00:02, 20.78it/s, loss=3.18, v_num=1, val_acc=0.621]
Epoch 6:  56%|█████▌    | 65/117 [00:03<00:02, 20.61it/s, loss=3.14, v_num=1, val_acc=0.621]
Epoch 6:  56%|█████▋    | 66/117 [00:03<00:02, 20.86it/s, loss=3.14, v_num=1, val_acc=0.621]
Epoch 6:  56%|█████▋    | 66/117 [00:03<00:02, 20.70it/s, loss=3.17, v_num=1, val_acc=0.621]
Epoch 6:  57%|█████▋    | 67/117 [00:03<00:02, 20.95it/s, loss=3.17, v_num=1, val_acc=0.621]
Epoch 6:  57%|█████▋    | 67/117 [00:03<00:02, 20.79it/s, loss=3.31, v_num=1, val_acc=0.621]
Epoch 6:  58%|█████▊    | 68/117 [00:03<00:02, 21.04it/s, loss=3.31, v_num=1, val_acc=0.621]
Epoch 6:  58%|█████▊    | 68/117 [00:03<00:02, 20.88it/s, loss=3.28, v_num=1, val_acc=0.621]
Epoch 6:  59%|█████▉    | 69/117 [00:03<00:02, 21.08it/s, loss=3.28, v_num=1, val_acc=0.621]
Epoch 6:  59%|█████▉    | 69/117 [00:03<00:02, 20.93it/s, loss=3.2, v_num=1, val_acc=0.621]
Epoch 6:  60%|█████▉    | 70/117 [00:03<00:02, 21.16it/s, loss=3.2, v_num=1, val_acc=0.621]
Epoch 6:  60%|█████▉    | 70/117 [00:03<00:02, 21.01it/s, loss=3.17, v_num=1, val_acc=0.621]
Epoch 6:  61%|██████    | 71/117 [00:03<00:02, 21.25it/s, loss=3.17, v_num=1, val_acc=0.621]
Epoch 6:  61%|██████    | 71/117 [00:03<00:02, 21.09it/s, loss=3.16, v_num=1, val_acc=0.621]
Epoch 6:  62%|██████▏   | 72/117 [00:03<00:02, 21.33it/s, loss=3.16, v_num=1, val_acc=0.621]
Epoch 6:  62%|██████▏   | 72/117 [00:03<00:02, 21.17it/s, loss=3.21, v_num=1, val_acc=0.621]
Epoch 6:  62%|██████▏   | 73/117 [00:03<00:02, 21.41it/s, loss=3.21, v_num=1, val_acc=0.621]
Epoch 6:  62%|██████▏   | 73/117 [00:03<00:02, 21.25it/s, loss=3.19, v_num=1, val_acc=0.621]
Epoch 6:  63%|██████▎   | 74/117 [00:03<00:02, 21.48it/s, loss=3.19, v_num=1, val_acc=0.621]
Epoch 6:  63%|██████▎   | 74/117 [00:03<00:02, 21.33it/s, loss=3.17, v_num=1, val_acc=0.621]
Epoch 6:  64%|██████▍   | 75/117 [00:03<00:01, 21.56it/s, loss=3.17, v_num=1, val_acc=0.621]
Epoch 6:  64%|██████▍   | 75/117 [00:03<00:01, 21.40it/s, loss=3.12, v_num=1, val_acc=0.621]
Epoch 6:  65%|██████▍   | 76/117 [00:03<00:01, 21.63it/s, loss=3.12, v_num=1, val_acc=0.621]
Epoch 6:  65%|██████▍   | 76/117 [00:03<00:01, 21.48it/s, loss=3.13, v_num=1, val_acc=0.621]
Epoch 6:  66%|██████▌   | 77/117 [00:03<00:01, 21.70it/s, loss=3.13, v_num=1, val_acc=0.621]
Epoch 6:  66%|██████▌   | 77/117 [00:03<00:01, 21.55it/s, loss=3.11, v_num=1, val_acc=0.621]
Epoch 6:  67%|██████▋   | 78/117 [00:03<00:01, 21.77it/s, loss=3.11, v_num=1, val_acc=0.621]
Epoch 6:  67%|██████▋   | 78/117 [00:03<00:01, 21.62it/s, loss=3.17, v_num=1, val_acc=0.621]
Epoch 6:  68%|██████▊   | 79/117 [00:03<00:01, 21.84it/s, loss=3.17, v_num=1, val_acc=0.621]
Epoch 6:  68%|██████▊   | 79/117 [00:03<00:01, 21.69it/s, loss=3.17, v_num=1, val_acc=0.621]
Epoch 6:  68%|██████▊   | 80/117 [00:03<00:01, 21.91it/s, loss=3.17, v_num=1, val_acc=0.621]
Epoch 6:  68%|██████▊   | 80/117 [00:03<00:01, 21.76it/s, loss=3.17, v_num=1, val_acc=0.621]
Epoch 6:  69%|██████▉   | 81/117 [00:03<00:01, 21.98it/s, loss=3.17, v_num=1, val_acc=0.621]
Epoch 6:  69%|██████▉   | 81/117 [00:03<00:01, 21.83it/s, loss=3.07, v_num=1, val_acc=0.621]
Epoch 6:  70%|███████   | 82/117 [00:03<00:01, 22.02it/s, loss=3.07, v_num=1, val_acc=0.621]
Epoch 6:  70%|███████   | 82/117 [00:03<00:01, 21.87it/s, loss=3.02, v_num=1, val_acc=0.621]
Epoch 6:  71%|███████   | 83/117 [00:03<00:01, 22.09it/s, loss=3.02, v_num=1, val_acc=0.621]
Epoch 6:  71%|███████   | 83/117 [00:03<00:01, 21.94it/s, loss=3.07, v_num=1, val_acc=0.621]
Epoch 6:  72%|███████▏  | 84/117 [00:03<00:01, 22.15it/s, loss=3.07, v_num=1, val_acc=0.621]
Epoch 6:  72%|███████▏  | 84/117 [00:03<00:01, 22.00it/s, loss=3.13, v_num=1, val_acc=0.621]
Epoch 6:  73%|███████▎  | 85/117 [00:03<00:01, 22.21it/s, loss=3.13, v_num=1, val_acc=0.621]
Epoch 6:  73%|███████▎  | 85/117 [00:03<00:01, 22.07it/s, loss=3.27, v_num=1, val_acc=0.621]
Epoch 6:  74%|███████▎  | 86/117 [00:03<00:01, 22.27it/s, loss=3.27, v_num=1, val_acc=0.621]
Epoch 6:  74%|███████▎  | 86/117 [00:03<00:01, 22.13it/s, loss=3.28, v_num=1, val_acc=0.621]
Epoch 6:  74%|███████▍  | 87/117 [00:03<00:01, 22.33it/s, loss=3.28, v_num=1, val_acc=0.621]
Epoch 6:  74%|███████▍  | 87/117 [00:03<00:01, 22.19it/s, loss=3.13, v_num=1, val_acc=0.621]
Epoch 6:  75%|███████▌  | 88/117 [00:03<00:01, 22.39it/s, loss=3.13, v_num=1, val_acc=0.621]
Epoch 6:  75%|███████▌  | 88/117 [00:03<00:01, 22.25it/s, loss=3.13, v_num=1, val_acc=0.621]
Epoch 6:  76%|███████▌  | 89/117 [00:03<00:01, 22.45it/s, loss=3.13, v_num=1, val_acc=0.621]
Epoch 6:  76%|███████▌  | 89/117 [00:03<00:01, 22.31it/s, loss=3.15, v_num=1, val_acc=0.621]
Epoch 6:  77%|███████▋  | 90/117 [00:03<00:01, 22.51it/s, loss=3.15, v_num=1, val_acc=0.621]
Epoch 6:  77%|███████▋  | 90/117 [00:04<00:01, 22.37it/s, loss=3.18, v_num=1, val_acc=0.621]
Epoch 6:  78%|███████▊  | 91/117 [00:04<00:01, 22.54it/s, loss=3.18, v_num=1, val_acc=0.621]
Epoch 6:  78%|███████▊  | 91/117 [00:04<00:01, 22.41it/s, loss=3.13, v_num=1, val_acc=0.621]
Epoch 6:  79%|███████▊  | 92/117 [00:04<00:01, 22.60it/s, loss=3.13, v_num=1, val_acc=0.621]
Epoch 6:  79%|███████▊  | 92/117 [00:04<00:01, 22.46it/s, loss=3.07, v_num=1, val_acc=0.621]
Epoch 6:  79%|███████▉  | 93/117 [00:04<00:01, 22.66it/s, loss=3.07, v_num=1, val_acc=0.621]
Epoch 6:  79%|███████▉  | 93/117 [00:04<00:01, 22.52it/s, loss=3.05, v_num=1, val_acc=0.621]
Epoch 6:  80%|████████  | 94/117 [00:04<00:01, 22.71it/s, loss=3.05, v_num=1, val_acc=0.621]
Epoch 6:  80%|████████  | 94/117 [00:04<00:01, 22.57it/s, loss=3.13, v_num=1, val_acc=0.621]
Epoch 6:  81%|████████  | 95/117 [00:04<00:00, 22.76it/s, loss=3.13, v_num=1, val_acc=0.621]
Epoch 6:  81%|████████  | 95/117 [00:04<00:00, 22.63it/s, loss=3.23, v_num=1, val_acc=0.621]
Epoch 6:  82%|████████▏ | 96/117 [00:04<00:00, 22.82it/s, loss=3.23, v_num=1, val_acc=0.621]
Epoch 6:  82%|████████▏ | 96/117 [00:04<00:00, 22.68it/s, loss=3.29, v_num=1, val_acc=0.621]
Epoch 6:  83%|████████▎ | 97/117 [00:04<00:00, 22.87it/s, loss=3.29, v_num=1, val_acc=0.621]
Epoch 6:  83%|████████▎ | 97/117 [00:04<00:00, 22.73it/s, loss=3.27, v_num=1, val_acc=0.621]

Validation: 0it [00:00, ?it/s]

Validation:   0%|          | 0/20 [00:00<?, ?it/s]

Validation DataLoader 0:   0%|          | 0/20 [00:00<?, ?it/s]

Validation DataLoader 0:   5%|▌         | 1/20 [00:00<00:00, 144.39it/s]
Epoch 6:  84%|████████▍ | 98/117 [00:05<00:00, 19.17it/s, loss=3.27, v_num=1, val_acc=0.621]

Validation DataLoader 0:  10%|█         | 2/20 [00:00<00:00, 54.97it/s]
Epoch 6:  85%|████████▍ | 99/117 [00:05<00:00, 19.26it/s, loss=3.27, v_num=1, val_acc=0.621]

Validation DataLoader 0:  15%|█▌        | 3/20 [00:00<00:00, 44.15it/s]
Epoch 6:  85%|████████▌ | 100/117 [00:05<00:00, 19.33it/s, loss=3.27, v_num=1, val_acc=0.621]

Validation DataLoader 0:  20%|██        | 4/20 [00:00<00:00, 40.07it/s]
Epoch 6:  86%|████████▋ | 101/117 [00:05<00:00, 19.41it/s, loss=3.27, v_num=1, val_acc=0.621]

Validation DataLoader 0:  25%|██▌       | 5/20 [00:00<00:00, 37.84it/s]
Epoch 6:  87%|████████▋ | 102/117 [00:05<00:00, 19.48it/s, loss=3.27, v_num=1, val_acc=0.621]

Validation DataLoader 0:  30%|███       | 6/20 [00:00<00:00, 36.63it/s]
Epoch 6:  88%|████████▊ | 103/117 [00:05<00:00, 19.55it/s, loss=3.27, v_num=1, val_acc=0.621]

Validation DataLoader 0:  35%|███▌      | 7/20 [00:00<00:00, 35.85it/s]
Epoch 6:  89%|████████▉ | 104/117 [00:05<00:00, 19.62it/s, loss=3.27, v_num=1, val_acc=0.621]

Validation DataLoader 0:  40%|████      | 8/20 [00:00<00:00, 35.29it/s]
Epoch 6:  90%|████████▉ | 105/117 [00:05<00:00, 19.70it/s, loss=3.27, v_num=1, val_acc=0.621]

Validation DataLoader 0:  45%|████▌     | 9/20 [00:00<00:00, 34.82it/s]
Epoch 6:  91%|█████████ | 106/117 [00:05<00:00, 19.77it/s, loss=3.27, v_num=1, val_acc=0.621]

Validation DataLoader 0:  50%|█████     | 10/20 [00:00<00:00, 34.48it/s]
Epoch 6:  91%|█████████▏| 107/117 [00:05<00:00, 19.84it/s, loss=3.27, v_num=1, val_acc=0.621]

Validation DataLoader 0:  55%|█████▌    | 11/20 [00:00<00:00, 34.21it/s]
Epoch 6:  92%|█████████▏| 108/117 [00:05<00:00, 19.90it/s, loss=3.27, v_num=1, val_acc=0.621]

Validation DataLoader 0:  60%|██████    | 12/20 [00:00<00:00, 33.99it/s]
Epoch 6:  93%|█████████▎| 109/117 [00:05<00:00, 19.97it/s, loss=3.27, v_num=1, val_acc=0.621]

Validation DataLoader 0:  65%|██████▌   | 13/20 [00:00<00:00, 33.78it/s]
Epoch 6:  94%|█████████▍| 110/117 [00:05<00:00, 20.04it/s, loss=3.27, v_num=1, val_acc=0.621]

Validation DataLoader 0:  70%|███████   | 14/20 [00:00<00:00, 33.62it/s]
Epoch 6:  95%|█████████▍| 111/117 [00:05<00:00, 20.11it/s, loss=3.27, v_num=1, val_acc=0.621]

Validation DataLoader 0:  75%|███████▌  | 15/20 [00:00<00:00, 33.49it/s]
Epoch 6:  96%|█████████▌| 112/117 [00:05<00:00, 20.17it/s, loss=3.27, v_num=1, val_acc=0.621]

Validation DataLoader 0:  80%|████████  | 16/20 [00:00<00:00, 33.36it/s]
Epoch 6:  97%|█████████▋| 113/117 [00:05<00:00, 20.24it/s, loss=3.27, v_num=1, val_acc=0.621]

Validation DataLoader 0:  85%|████████▌ | 17/20 [00:00<00:00, 33.24it/s]
Epoch 6:  97%|█████████▋| 114/117 [00:05<00:00, 20.30it/s, loss=3.27, v_num=1, val_acc=0.621]

Validation DataLoader 0:  90%|█████████ | 18/20 [00:00<00:00, 33.16it/s]
Epoch 6:  98%|█████████▊| 115/117 [00:05<00:00, 20.36it/s, loss=3.27, v_num=1, val_acc=0.621]

Validation DataLoader 0:  95%|█████████▌| 19/20 [00:00<00:00, 33.07it/s]
Epoch 6:  99%|█████████▉| 116/117 [00:05<00:00, 20.43it/s, loss=3.27, v_num=1, val_acc=0.621]

Validation DataLoader 0: 100%|██████████| 20/20 [00:00<00:00, 33.06it/s]
Epoch 6: 100%|██████████| 117/117 [00:05<00:00, 20.49it/s, loss=3.27, v_num=1, val_acc=0.621]
Epoch 6: 100%|██████████| 117/117 [00:05<00:00, 20.42it/s, loss=3.27, v_num=1, val_acc=0.644]


Epoch 6: 100%|██████████| 117/117 [00:05<00:00, 20.42it/s, loss=3.27, v_num=1, val_acc=0.644]
Epoch 6:   0%|          | 0/117 [00:00<?, ?it/s, loss=3.27, v_num=1, val_acc=0.644]
Epoch 7:   0%|          | 0/117 [00:00<?, ?it/s, loss=3.27, v_num=1, val_acc=0.644]
Epoch 7:   1%|          | 1/117 [00:00<01:46,  1.09it/s, loss=3.27, v_num=1, val_acc=0.644]
Epoch 7:   1%|          | 1/117 [00:00<01:48,  1.07it/s, loss=3.15, v_num=1, val_acc=0.644]
Epoch 7:   2%|▏         | 2/117 [00:00<00:54,  2.11it/s, loss=3.15, v_num=1, val_acc=0.644]
Epoch 7:   2%|▏         | 2/117 [00:00<00:56,  2.05it/s, loss=3.08, v_num=1, val_acc=0.644]
Epoch 7:   3%|▎         | 3/117 [00:00<00:37,  3.05it/s, loss=3.08, v_num=1, val_acc=0.644]
Epoch 7:   3%|▎         | 3/117 [00:01<00:38,  2.98it/s, loss=3.18, v_num=1, val_acc=0.644]
Epoch 7:   3%|▎         | 4/117 [00:01<00:28,  3.92it/s, loss=3.18, v_num=1, val_acc=0.644]
Epoch 7:   3%|▎         | 4/117 [00:01<00:29,  3.83it/s, loss=3.28, v_num=1, val_acc=0.644]
Epoch 7:   4%|▍         | 5/117 [00:01<00:23,  4.74it/s, loss=3.28, v_num=1, val_acc=0.644]
Epoch 7:   4%|▍         | 5/117 [00:01<00:24,  4.63it/s, loss=3.33, v_num=1, val_acc=0.644]
Epoch 7:   5%|▌         | 6/117 [00:01<00:20,  5.51it/s, loss=3.33, v_num=1, val_acc=0.644]
Epoch 7:   5%|▌         | 6/117 [00:01<00:20,  5.38it/s, loss=3.24, v_num=1, val_acc=0.644]
Epoch 7:   6%|▌         | 7/117 [00:01<00:17,  6.23it/s, loss=3.24, v_num=1, val_acc=0.644]
Epoch 7:   6%|▌         | 7/117 [00:01<00:18,  6.10it/s, loss=3.21, v_num=1, val_acc=0.644]
Epoch 7:   7%|▋         | 8/117 [00:01<00:15,  6.91it/s, loss=3.21, v_num=1, val_acc=0.644]
Epoch 7:   7%|▋         | 8/117 [00:01<00:16,  6.77it/s, loss=3.15, v_num=1, val_acc=0.644]
Epoch 7:   8%|▊         | 9/117 [00:01<00:14,  7.54it/s, loss=3.15, v_num=1, val_acc=0.644]
Epoch 7:   8%|▊         | 9/117 [00:01<00:14,  7.39it/s, loss=3.13, v_num=1, val_acc=0.644]
Epoch 7:   9%|▊         | 10/117 [00:01<00:13,  8.12it/s, loss=3.13, v_num=1, val_acc=0.644]
Epoch 7:   9%|▊         | 10/117 [00:01<00:13,  7.96it/s, loss=3.16, v_num=1, val_acc=0.644]
Epoch 7:   9%|▉         | 11/117 [00:01<00:12,  8.68it/s, loss=3.16, v_num=1, val_acc=0.644]
Epoch 7:   9%|▉         | 11/117 [00:01<00:12,  8.52it/s, loss=3.21, v_num=1, val_acc=0.644]
Epoch 7:  10%|█         | 12/117 [00:01<00:11,  9.22it/s, loss=3.21, v_num=1, val_acc=0.644]
Epoch 7:  10%|█         | 12/117 [00:01<00:11,  9.05it/s, loss=3.19, v_num=1, val_acc=0.644]
Epoch 7:  11%|█         | 13/117 [00:01<00:10,  9.73it/s, loss=3.19, v_num=1, val_acc=0.644]
Epoch 7:  11%|█         | 13/117 [00:01<00:10,  9.55it/s, loss=3.18, v_num=1, val_acc=0.644]
Epoch 7:  12%|█▏        | 14/117 [00:01<00:10, 10.22it/s, loss=3.18, v_num=1, val_acc=0.644]
Epoch 7:  12%|█▏        | 14/117 [00:01<00:10, 10.04it/s, loss=3.23, v_num=1, val_acc=0.644]
Epoch 7:  13%|█▎        | 15/117 [00:01<00:09, 10.68it/s, loss=3.23, v_num=1, val_acc=0.644]
Epoch 7:  13%|█▎        | 15/117 [00:01<00:09, 10.49it/s, loss=3.23, v_num=1, val_acc=0.644]
Epoch 7:  14%|█▎        | 16/117 [00:01<00:09, 11.13it/s, loss=3.23, v_num=1, val_acc=0.644]
Epoch 7:  14%|█▎        | 16/117 [00:01<00:09, 10.93it/s, loss=3.25, v_num=1, val_acc=0.644]
Epoch 7:  15%|█▍        | 17/117 [00:01<00:08, 11.54it/s, loss=3.25, v_num=1, val_acc=0.644]
Epoch 7:  15%|█▍        | 17/117 [00:01<00:08, 11.35it/s, loss=3.28, v_num=1, val_acc=0.644]
Epoch 7:  15%|█▌        | 18/117 [00:01<00:08, 11.93it/s, loss=3.28, v_num=1, val_acc=0.644]
Epoch 7:  15%|█▌        | 18/117 [00:01<00:08, 11.73it/s, loss=3.22, v_num=1, val_acc=0.644]
Epoch 7:  16%|█▌        | 19/117 [00:01<00:07, 12.29it/s, loss=3.22, v_num=1, val_acc=0.644]
Epoch 7:  16%|█▌        | 19/117 [00:01<00:08, 12.11it/s, loss=3.19, v_num=1, val_acc=0.644]
Epoch 7:  17%|█▋        | 20/117 [00:01<00:07, 12.68it/s, loss=3.19, v_num=1, val_acc=0.644]
Epoch 7:  17%|█▋        | 20/117 [00:01<00:07, 12.48it/s, loss=3.14, v_num=1, val_acc=0.644]
Epoch 7:  18%|█▊        | 21/117 [00:01<00:07, 13.03it/s, loss=3.14, v_num=1, val_acc=0.644]
Epoch 7:  18%|█▊        | 21/117 [00:01<00:07, 12.83it/s, loss=3.19, v_num=1, val_acc=0.644]
Epoch 7:  19%|█▉        | 22/117 [00:01<00:07, 13.36it/s, loss=3.19, v_num=1, val_acc=0.644]
Epoch 7:  19%|█▉        | 22/117 [00:01<00:07, 13.16it/s, loss=3.23, v_num=1, val_acc=0.644]
Epoch 7:  20%|█▉        | 23/117 [00:01<00:06, 13.67it/s, loss=3.23, v_num=1, val_acc=0.644]
Epoch 7:  20%|█▉        | 23/117 [00:01<00:06, 13.47it/s, loss=3.22, v_num=1, val_acc=0.644]
Epoch 7:  21%|██        | 24/117 [00:01<00:06, 13.98it/s, loss=3.22, v_num=1, val_acc=0.644]
Epoch 7:  21%|██        | 24/117 [00:01<00:06, 13.78it/s, loss=3.1, v_num=1, val_acc=0.644]
Epoch 7:  21%|██▏       | 25/117 [00:01<00:06, 14.27it/s, loss=3.1, v_num=1, val_acc=0.644]
Epoch 7:  21%|██▏       | 25/117 [00:01<00:06, 14.07it/s, loss=3.02, v_num=1, val_acc=0.644]
Epoch 7:  22%|██▏       | 26/117 [00:01<00:06, 14.54it/s, loss=3.02, v_num=1, val_acc=0.644]
Epoch 7:  22%|██▏       | 26/117 [00:01<00:06, 14.34it/s, loss=3.04, v_num=1, val_acc=0.644]
Epoch 7:  23%|██▎       | 27/117 [00:01<00:06, 14.83it/s, loss=3.04, v_num=1, val_acc=0.644]
Epoch 7:  23%|██▎       | 27/117 [00:01<00:06, 14.62it/s, loss=3.01, v_num=1, val_acc=0.644]
Epoch 7:  24%|██▍       | 28/117 [00:01<00:05, 15.09it/s, loss=3.01, v_num=1, val_acc=0.644]
Epoch 7:  24%|██▍       | 28/117 [00:01<00:05, 14.89it/s, loss=3.01, v_num=1, val_acc=0.644]
Epoch 7:  25%|██▍       | 29/117 [00:01<00:05, 15.34it/s, loss=3.01, v_num=1, val_acc=0.644]
Epoch 7:  25%|██▍       | 29/117 [00:01<00:05, 15.14it/s, loss=3.07, v_num=1, val_acc=0.644]
Epoch 7:  26%|██▌       | 30/117 [00:01<00:05, 15.58it/s, loss=3.07, v_num=1, val_acc=0.644]
Epoch 7:  26%|██▌       | 30/117 [00:01<00:05, 15.38it/s, loss=3.06, v_num=1, val_acc=0.644]
Epoch 7:  26%|██▋       | 31/117 [00:01<00:05, 15.82it/s, loss=3.06, v_num=1, val_acc=0.644]
Epoch 7:  26%|██▋       | 31/117 [00:01<00:05, 15.62it/s, loss=3.01, v_num=1, val_acc=0.644]
Epoch 7:  27%|██▋       | 32/117 [00:01<00:05, 16.05it/s, loss=3.01, v_num=1, val_acc=0.644]
Epoch 7:  27%|██▋       | 32/117 [00:02<00:05, 15.85it/s, loss=2.95, v_num=1, val_acc=0.644]
Epoch 7:  28%|██▊       | 33/117 [00:02<00:05, 16.27it/s, loss=2.95, v_num=1, val_acc=0.644]
Epoch 7:  28%|██▊       | 33/117 [00:02<00:05, 16.07it/s, loss=2.92, v_num=1, val_acc=0.644]
Epoch 7:  29%|██▉       | 34/117 [00:02<00:05, 16.48it/s, loss=2.92, v_num=1, val_acc=0.644]
Epoch 7:  29%|██▉       | 34/117 [00:02<00:05, 16.28it/s, loss=2.94, v_num=1, val_acc=0.644]
Epoch 7:  30%|██▉       | 35/117 [00:02<00:04, 16.69it/s, loss=2.94, v_num=1, val_acc=0.644]
Epoch 7:  30%|██▉       | 35/117 [00:02<00:04, 16.49it/s, loss=3.09, v_num=1, val_acc=0.644]
Epoch 7:  31%|███       | 36/117 [00:02<00:04, 16.89it/s, loss=3.09, v_num=1, val_acc=0.644]
Epoch 7:  31%|███       | 36/117 [00:02<00:04, 16.69it/s, loss=3.1, v_num=1, val_acc=0.644]
Epoch 7:  32%|███▏      | 37/117 [00:02<00:04, 17.08it/s, loss=3.1, v_num=1, val_acc=0.644]
Epoch 7:  32%|███▏      | 37/117 [00:02<00:04, 16.88it/s, loss=3.04, v_num=1, val_acc=0.644]
Epoch 7:  32%|███▏      | 38/117 [00:02<00:04, 17.26it/s, loss=3.04, v_num=1, val_acc=0.644]
Epoch 7:  32%|███▏      | 38/117 [00:02<00:04, 17.07it/s, loss=3.05, v_num=1, val_acc=0.644]
Epoch 7:  33%|███▎      | 39/117 [00:02<00:04, 17.44it/s, loss=3.05, v_num=1, val_acc=0.644]
Epoch 7:  33%|███▎      | 39/117 [00:02<00:04, 17.25it/s, loss=3.06, v_num=1, val_acc=0.644]
Epoch 7:  34%|███▍      | 40/117 [00:02<00:04, 17.62it/s, loss=3.06, v_num=1, val_acc=0.644]
Epoch 7:  34%|███▍      | 40/117 [00:02<00:04, 17.42it/s, loss=3.09, v_num=1, val_acc=0.644]
Epoch 7:  35%|███▌      | 41/117 [00:02<00:04, 17.79it/s, loss=3.09, v_num=1, val_acc=0.644]
Epoch 7:  35%|███▌      | 41/117 [00:02<00:04, 17.60it/s, loss=3.16, v_num=1, val_acc=0.644]
Epoch 7:  36%|███▌      | 42/117 [00:02<00:04, 17.96it/s, loss=3.16, v_num=1, val_acc=0.644]
Epoch 7:  36%|███▌      | 42/117 [00:02<00:04, 17.76it/s, loss=3.16, v_num=1, val_acc=0.644]
Epoch 7:  37%|███▋      | 43/117 [00:02<00:04, 18.12it/s, loss=3.16, v_num=1, val_acc=0.644]
Epoch 7:  37%|███▋      | 43/117 [00:02<00:04, 17.92it/s, loss=3.11, v_num=1, val_acc=0.644]
Epoch 7:  38%|███▊      | 44/117 [00:02<00:03, 18.27it/s, loss=3.11, v_num=1, val_acc=0.644]
Epoch 7:  38%|███▊      | 44/117 [00:02<00:04, 18.08it/s, loss=3.18, v_num=1, val_acc=0.644]
Epoch 7:  38%|███▊      | 45/117 [00:02<00:03, 18.42it/s, loss=3.18, v_num=1, val_acc=0.644]
Epoch 7:  38%|███▊      | 45/117 [00:02<00:03, 18.23it/s, loss=3.3, v_num=1, val_acc=0.644]
Epoch 7:  39%|███▉      | 46/117 [00:02<00:03, 18.57it/s, loss=3.3, v_num=1, val_acc=0.644]
Epoch 7:  39%|███▉      | 46/117 [00:02<00:03, 18.38it/s, loss=3.33, v_num=1, val_acc=0.644]
Epoch 7:  40%|████      | 47/117 [00:02<00:03, 18.71it/s, loss=3.33, v_num=1, val_acc=0.644]
Epoch 7:  40%|████      | 47/117 [00:02<00:03, 18.52it/s, loss=3.4, v_num=1, val_acc=0.644]
Epoch 7:  41%|████      | 48/117 [00:02<00:03, 18.85it/s, loss=3.4, v_num=1, val_acc=0.644]
Epoch 7:  41%|████      | 48/117 [00:02<00:03, 18.66it/s, loss=3.41, v_num=1, val_acc=0.644]
Epoch 7:  42%|████▏     | 49/117 [00:02<00:03, 18.98it/s, loss=3.41, v_num=1, val_acc=0.644]
Epoch 7:  42%|████▏     | 49/117 [00:02<00:03, 18.80it/s, loss=3.45, v_num=1, val_acc=0.644]
Epoch 7:  43%|████▎     | 50/117 [00:02<00:03, 19.12it/s, loss=3.45, v_num=1, val_acc=0.644]
Epoch 7:  43%|████▎     | 50/117 [00:02<00:03, 18.93it/s, loss=3.43, v_num=1, val_acc=0.644]
Epoch 7:  44%|████▎     | 51/117 [00:02<00:03, 19.24it/s, loss=3.43, v_num=1, val_acc=0.644]
Epoch 7:  44%|████▎     | 51/117 [00:02<00:03, 19.06it/s, loss=3.41, v_num=1, val_acc=0.644]
Epoch 7:  44%|████▍     | 52/117 [00:02<00:03, 19.37it/s, loss=3.41, v_num=1, val_acc=0.644]
Epoch 7:  44%|████▍     | 52/117 [00:02<00:03, 19.19it/s, loss=3.43, v_num=1, val_acc=0.644]
Epoch 7:  45%|████▌     | 53/117 [00:02<00:03, 19.49it/s, loss=3.43, v_num=1, val_acc=0.644]
Epoch 7:  45%|████▌     | 53/117 [00:02<00:03, 19.31it/s, loss=3.48, v_num=1, val_acc=0.644]
Epoch 7:  46%|████▌     | 54/117 [00:02<00:03, 19.61it/s, loss=3.48, v_num=1, val_acc=0.644]
Epoch 7:  46%|████▌     | 54/117 [00:02<00:03, 19.43it/s, loss=3.53, v_num=1, val_acc=0.644]
Epoch 7:  47%|████▋     | 55/117 [00:02<00:03, 19.73it/s, loss=3.53, v_num=1, val_acc=0.644]
Epoch 7:  47%|████▋     | 55/117 [00:02<00:03, 19.55it/s, loss=3.48, v_num=1, val_acc=0.644]
Epoch 7:  48%|████▊     | 56/117 [00:02<00:03, 19.84it/s, loss=3.48, v_num=1, val_acc=0.644]
Epoch 7:  48%|████▊     | 56/117 [00:02<00:03, 19.66it/s, loss=3.51, v_num=1, val_acc=0.644]
Epoch 7:  49%|████▊     | 57/117 [00:02<00:03, 19.92it/s, loss=3.51, v_num=1, val_acc=0.644]
Epoch 7:  49%|████▊     | 57/117 [00:02<00:03, 19.76it/s, loss=3.53, v_num=1, val_acc=0.644]
Epoch 7:  50%|████▉     | 58/117 [00:02<00:02, 20.04it/s, loss=3.53, v_num=1, val_acc=0.644]
Epoch 7:  50%|████▉     | 58/117 [00:02<00:02, 19.87it/s, loss=3.61, v_num=1, val_acc=0.644]
Epoch 7:  50%|█████     | 59/117 [00:02<00:02, 20.15it/s, loss=3.61, v_num=1, val_acc=0.644]
Epoch 7:  50%|█████     | 59/117 [00:02<00:02, 19.98it/s, loss=3.64, v_num=1, val_acc=0.644]
Epoch 7:  51%|█████▏    | 60/117 [00:02<00:02, 20.25it/s, loss=3.64, v_num=1, val_acc=0.644]
Epoch 7:  51%|█████▏    | 60/117 [00:02<00:02, 20.08it/s, loss=3.67, v_num=1, val_acc=0.644]
Epoch 7:  52%|█████▏    | 61/117 [00:02<00:02, 20.35it/s, loss=3.67, v_num=1, val_acc=0.644]
Epoch 7:  52%|█████▏    | 61/117 [00:03<00:02, 20.18it/s, loss=3.59, v_num=1, val_acc=0.644]
Epoch 7:  53%|█████▎    | 62/117 [00:03<00:02, 20.45it/s, loss=3.59, v_num=1, val_acc=0.644]
Epoch 7:  53%|█████▎    | 62/117 [00:03<00:02, 20.28it/s, loss=3.52, v_num=1, val_acc=0.644]
Epoch 7:  54%|█████▍    | 63/117 [00:03<00:02, 20.53it/s, loss=3.52, v_num=1, val_acc=0.644]
Epoch 7:  54%|█████▍    | 63/117 [00:03<00:02, 20.37it/s, loss=3.47, v_num=1, val_acc=0.644]
Epoch 7:  55%|█████▍    | 64/117 [00:03<00:02, 20.63it/s, loss=3.47, v_num=1, val_acc=0.644]
Epoch 7:  55%|█████▍    | 64/117 [00:03<00:02, 20.46it/s, loss=3.52, v_num=1, val_acc=0.644]
Epoch 7:  56%|█████▌    | 65/117 [00:03<00:02, 20.71it/s, loss=3.52, v_num=1, val_acc=0.644]
Epoch 7:  56%|█████▌    | 65/117 [00:03<00:02, 20.55it/s, loss=3.46, v_num=1, val_acc=0.644]
Epoch 7:  56%|█████▋    | 66/117 [00:03<00:02, 20.81it/s, loss=3.46, v_num=1, val_acc=0.644]
Epoch 7:  56%|█████▋    | 66/117 [00:03<00:02, 20.64it/s, loss=3.5, v_num=1, val_acc=0.644]
Epoch 7:  57%|█████▋    | 67/117 [00:03<00:02, 20.89it/s, loss=3.5, v_num=1, val_acc=0.644]
Epoch 7:  57%|█████▋    | 67/117 [00:03<00:02, 20.73it/s, loss=3.5, v_num=1, val_acc=0.644]
Epoch 7:  58%|█████▊    | 68/117 [00:03<00:02, 20.94it/s, loss=3.5, v_num=1, val_acc=0.644]
Epoch 7:  58%|█████▊    | 68/117 [00:03<00:02, 20.79it/s, loss=3.51, v_num=1, val_acc=0.644]
Epoch 7:  59%|█████▉    | 69/117 [00:03<00:02, 20.97it/s, loss=3.51, v_num=1, val_acc=0.644]
Epoch 7:  59%|█████▉    | 69/117 [00:03<00:02, 20.87it/s, loss=3.45, v_num=1, val_acc=0.644]
Epoch 7:  60%|█████▉    | 70/117 [00:03<00:02, 21.04it/s, loss=3.45, v_num=1, val_acc=0.644]
Epoch 7:  60%|█████▉    | 70/117 [00:03<00:02, 20.94it/s, loss=3.55, v_num=1, val_acc=0.644]
Epoch 7:  61%|██████    | 71/117 [00:03<00:02, 21.17it/s, loss=3.55, v_num=1, val_acc=0.644]
Epoch 7:  61%|██████    | 71/117 [00:03<00:02, 21.02it/s, loss=3.77, v_num=1, val_acc=0.644]
Epoch 7:  62%|██████▏   | 72/117 [00:03<00:02, 21.21it/s, loss=3.77, v_num=1, val_acc=0.644]
Epoch 7:  62%|██████▏   | 72/117 [00:03<00:02, 21.08it/s, loss=3.95, v_num=1, val_acc=0.644]
Epoch 7:  62%|██████▏   | 73/117 [00:03<00:02, 21.28it/s, loss=3.95, v_num=1, val_acc=0.644]
Epoch 7:  62%|██████▏   | 73/117 [00:03<00:02, 21.15it/s, loss=3.89, v_num=1, val_acc=0.644]
Epoch 7:  63%|██████▎   | 74/117 [00:03<00:02, 21.35it/s, loss=3.89, v_num=1, val_acc=0.644]
Epoch 7:  63%|██████▎   | 74/117 [00:03<00:02, 21.22it/s, loss=3.8, v_num=1, val_acc=0.644]
Epoch 7:  64%|██████▍   | 75/117 [00:03<00:01, 21.43it/s, loss=3.8, v_num=1, val_acc=0.644]
Epoch 7:  64%|██████▍   | 75/117 [00:03<00:01, 21.28it/s, loss=3.76, v_num=1, val_acc=0.644]
Epoch 7:  65%|██████▍   | 76/117 [00:03<00:01, 21.48it/s, loss=3.76, v_num=1, val_acc=0.644]
Epoch 7:  65%|██████▍   | 76/117 [00:03<00:01, 21.35it/s, loss=3.7, v_num=1, val_acc=0.644]
Epoch 7:  66%|██████▌   | 77/117 [00:03<00:01, 21.56it/s, loss=3.7, v_num=1, val_acc=0.644]
Epoch 7:  66%|██████▌   | 77/117 [00:03<00:01, 21.42it/s, loss=3.65, v_num=1, val_acc=0.644]
Epoch 7:  67%|██████▋   | 78/117 [00:03<00:01, 21.62it/s, loss=3.65, v_num=1, val_acc=0.644]
Epoch 7:  67%|██████▋   | 78/117 [00:03<00:01, 21.49it/s, loss=3.52, v_num=1, val_acc=0.644]
Epoch 7:  68%|██████▊   | 79/117 [00:03<00:01, 21.67it/s, loss=3.52, v_num=1, val_acc=0.644]
Epoch 7:  68%|██████▊   | 79/117 [00:03<00:01, 21.55it/s, loss=3.41, v_num=1, val_acc=0.644]
Epoch 7:  68%|██████▊   | 80/117 [00:03<00:01, 21.73it/s, loss=3.41, v_num=1, val_acc=0.644]
Epoch 7:  68%|██████▊   | 80/117 [00:03<00:01, 21.61it/s, loss=3.38, v_num=1, val_acc=0.644]
Epoch 7:  69%|██████▉   | 81/117 [00:03<00:01, 21.81it/s, loss=3.38, v_num=1, val_acc=0.644]
Epoch 7:  69%|██████▉   | 81/117 [00:03<00:01, 21.67it/s, loss=3.38, v_num=1, val_acc=0.644]
Epoch 7:  70%|███████   | 82/117 [00:03<00:01, 21.81it/s, loss=3.38, v_num=1, val_acc=0.644]
Epoch 7:  70%|███████   | 82/117 [00:03<00:01, 21.67it/s, loss=3.37, v_num=1, val_acc=0.644]
Epoch 7:  71%|███████   | 83/117 [00:03<00:01, 21.87it/s, loss=3.37, v_num=1, val_acc=0.644]
Epoch 7:  71%|███████   | 83/117 [00:03<00:01, 21.73it/s, loss=3.45, v_num=1, val_acc=0.644]
Epoch 7:  72%|███████▏  | 84/117 [00:03<00:01, 21.90it/s, loss=3.45, v_num=1, val_acc=0.644]
Epoch 7:  72%|███████▏  | 84/117 [00:03<00:01, 21.80it/s, loss=3.45, v_num=1, val_acc=0.644]
Epoch 7:  73%|███████▎  | 85/117 [00:03<00:01, 22.00it/s, loss=3.45, v_num=1, val_acc=0.644]
Epoch 7:  73%|███████▎  | 85/117 [00:03<00:01, 21.86it/s, loss=3.44, v_num=1, val_acc=0.644]
Epoch 7:  74%|███████▎  | 86/117 [00:03<00:01, 22.06it/s, loss=3.44, v_num=1, val_acc=0.644]
Epoch 7:  74%|███████▎  | 86/117 [00:03<00:01, 21.93it/s, loss=3.37, v_num=1, val_acc=0.644]
Epoch 7:  74%|███████▍  | 87/117 [00:03<00:01, 22.13it/s, loss=3.37, v_num=1, val_acc=0.644]
Epoch 7:  74%|███████▍  | 87/117 [00:03<00:01, 21.99it/s, loss=3.34, v_num=1, val_acc=0.644]
Epoch 7:  75%|███████▌  | 88/117 [00:03<00:01, 22.19it/s, loss=3.34, v_num=1, val_acc=0.644]
Epoch 7:  75%|███████▌  | 88/117 [00:03<00:01, 22.05it/s, loss=3.26, v_num=1, val_acc=0.644]
Epoch 7:  76%|███████▌  | 89/117 [00:04<00:01, 22.22it/s, loss=3.26, v_num=1, val_acc=0.644]
Epoch 7:  76%|███████▌  | 89/117 [00:04<00:01, 22.08it/s, loss=3.22, v_num=1, val_acc=0.644]
Epoch 7:  77%|███████▋  | 90/117 [00:04<00:01, 22.28it/s, loss=3.22, v_num=1, val_acc=0.644]
Epoch 7:  77%|███████▋  | 90/117 [00:04<00:01, 22.14it/s, loss=3.12, v_num=1, val_acc=0.644]
Epoch 7:  78%|███████▊  | 91/117 [00:04<00:01, 22.33it/s, loss=3.12, v_num=1, val_acc=0.644]
Epoch 7:  78%|███████▊  | 91/117 [00:04<00:01, 22.20it/s, loss=2.89, v_num=1, val_acc=0.644]
Epoch 7:  79%|███████▊  | 92/117 [00:04<00:01, 22.39it/s, loss=2.89, v_num=1, val_acc=0.644]
Epoch 7:  79%|███████▊  | 92/117 [00:04<00:01, 22.25it/s, loss=2.76, v_num=1, val_acc=0.644]
Epoch 7:  79%|███████▉  | 93/117 [00:04<00:01, 22.44it/s, loss=2.76, v_num=1, val_acc=0.644]
Epoch 7:  79%|███████▉  | 93/117 [00:04<00:01, 22.31it/s, loss=2.81, v_num=1, val_acc=0.644]
Epoch 7:  80%|████████  | 94/117 [00:04<00:01, 22.49it/s, loss=2.81, v_num=1, val_acc=0.644]
Epoch 7:  80%|████████  | 94/117 [00:04<00:01, 22.36it/s, loss=2.91, v_num=1, val_acc=0.644]
Epoch 7:  81%|████████  | 95/117 [00:04<00:00, 22.54it/s, loss=2.91, v_num=1, val_acc=0.644]
Epoch 7:  81%|████████  | 95/117 [00:04<00:00, 22.41it/s, loss=2.9, v_num=1, val_acc=0.644]
Epoch 7:  82%|████████▏ | 96/117 [00:04<00:00, 22.59it/s, loss=2.9, v_num=1, val_acc=0.644]
Epoch 7:  82%|████████▏ | 96/117 [00:04<00:00, 22.46it/s, loss=2.99, v_num=1, val_acc=0.644]
Epoch 7:  83%|████████▎ | 97/117 [00:04<00:00, 22.63it/s, loss=2.99, v_num=1, val_acc=0.644]
Epoch 7:  83%|████████▎ | 97/117 [00:04<00:00, 22.50it/s, loss=3.09, v_num=1, val_acc=0.644]

Validation: 0it [00:00, ?it/s]

Validation:   0%|          | 0/20 [00:00<?, ?it/s]

Validation DataLoader 0:   0%|          | 0/20 [00:00<?, ?it/s]

Validation DataLoader 0:   5%|▌         | 1/20 [00:00<00:00, 162.49it/s]
Epoch 7:  84%|████████▍ | 98/117 [00:05<00:01, 18.21it/s, loss=3.09, v_num=1, val_acc=0.644]

Validation DataLoader 0:  10%|█         | 2/20 [00:00<00:00, 52.70it/s]
Epoch 7:  85%|████████▍ | 99/117 [00:05<00:00, 18.29it/s, loss=3.09, v_num=1, val_acc=0.644]

Validation DataLoader 0:  15%|█▌        | 3/20 [00:00<00:00, 42.38it/s]
Epoch 7:  85%|████████▌ | 100/117 [00:05<00:00, 18.36it/s, loss=3.09, v_num=1, val_acc=0.644]

Validation DataLoader 0:  20%|██        | 4/20 [00:00<00:00, 38.59it/s]
Epoch 7:  86%|████████▋ | 101/117 [00:05<00:00, 18.43it/s, loss=3.09, v_num=1, val_acc=0.644]

Validation DataLoader 0:  25%|██▌       | 5/20 [00:00<00:00, 36.86it/s]
Epoch 7:  87%|████████▋ | 102/117 [00:05<00:00, 18.51it/s, loss=3.09, v_num=1, val_acc=0.644]

Validation DataLoader 0:  30%|███       | 6/20 [00:00<00:00, 35.67it/s]
Epoch 7:  88%|████████▊ | 103/117 [00:05<00:00, 18.58it/s, loss=3.09, v_num=1, val_acc=0.644]

Validation DataLoader 0:  35%|███▌      | 7/20 [00:00<00:00, 34.74it/s]
Epoch 7:  89%|████████▉ | 104/117 [00:05<00:00, 18.65it/s, loss=3.09, v_num=1, val_acc=0.644]

Validation DataLoader 0:  40%|████      | 8/20 [00:00<00:00, 34.31it/s]
Epoch 7:  90%|████████▉ | 105/117 [00:05<00:00, 18.72it/s, loss=3.09, v_num=1, val_acc=0.644]

Validation DataLoader 0:  45%|████▌     | 9/20 [00:00<00:00, 33.74it/s]
Epoch 7:  91%|█████████ | 106/117 [00:05<00:00, 18.79it/s, loss=3.09, v_num=1, val_acc=0.644]

Validation DataLoader 0:  50%|█████     | 10/20 [00:00<00:00, 33.27it/s]
Epoch 7:  91%|█████████▏| 107/117 [00:05<00:00, 18.85it/s, loss=3.09, v_num=1, val_acc=0.644]

Validation DataLoader 0:  55%|█████▌    | 11/20 [00:00<00:00, 32.99it/s]
Epoch 7:  92%|█████████▏| 108/117 [00:05<00:00, 18.92it/s, loss=3.09, v_num=1, val_acc=0.644]

Validation DataLoader 0:  60%|██████    | 12/20 [00:00<00:00, 32.92it/s]
Epoch 7:  93%|█████████▎| 109/117 [00:05<00:00, 18.99it/s, loss=3.09, v_num=1, val_acc=0.644]

Validation DataLoader 0:  65%|██████▌   | 13/20 [00:00<00:00, 32.82it/s]
Epoch 7:  94%|█████████▍| 110/117 [00:05<00:00, 19.06it/s, loss=3.09, v_num=1, val_acc=0.644]

Validation DataLoader 0:  70%|███████   | 14/20 [00:00<00:00, 32.73it/s]
Epoch 7:  95%|█████████▍| 111/117 [00:05<00:00, 19.13it/s, loss=3.09, v_num=1, val_acc=0.644]

Validation DataLoader 0:  75%|███████▌  | 15/20 [00:00<00:00, 32.65it/s]
Epoch 7:  96%|█████████▌| 112/117 [00:05<00:00, 19.19it/s, loss=3.09, v_num=1, val_acc=0.644]

Validation DataLoader 0:  80%|████████  | 16/20 [00:00<00:00, 32.58it/s]
Epoch 7:  97%|█████████▋| 113/117 [00:05<00:00, 19.26it/s, loss=3.09, v_num=1, val_acc=0.644]

Validation DataLoader 0:  85%|████████▌ | 17/20 [00:00<00:00, 32.52it/s]
Epoch 7:  97%|█████████▋| 114/117 [00:05<00:00, 19.33it/s, loss=3.09, v_num=1, val_acc=0.644]

Validation DataLoader 0:  90%|█████████ | 18/20 [00:00<00:00, 32.46it/s]
Epoch 7:  98%|█████████▊| 115/117 [00:05<00:00, 19.39it/s, loss=3.09, v_num=1, val_acc=0.644]

Validation DataLoader 0:  95%|█████████▌| 19/20 [00:00<00:00, 32.42it/s]
Epoch 7:  99%|█████████▉| 116/117 [00:05<00:00, 19.46it/s, loss=3.09, v_num=1, val_acc=0.644]

Validation DataLoader 0: 100%|██████████| 20/20 [00:00<00:00, 32.45it/s]
Epoch 7: 100%|██████████| 117/117 [00:05<00:00, 19.53it/s, loss=3.09, v_num=1, val_acc=0.644]
Epoch 7: 100%|██████████| 117/117 [00:06<00:00, 19.46it/s, loss=3.09, v_num=1, val_acc=0.631]


Epoch 7: 100%|██████████| 117/117 [00:06<00:00, 19.46it/s, loss=3.09, v_num=1, val_acc=0.631]
Epoch 7:   0%|          | 0/117 [00:00<?, ?it/s, loss=3.09, v_num=1, val_acc=0.631]
Epoch 8:   0%|          | 0/117 [00:00<?, ?it/s, loss=3.09, v_num=1, val_acc=0.631]
Epoch 8:   1%|          | 1/117 [00:00<01:47,  1.08it/s, loss=3.09, v_num=1, val_acc=0.631]
Epoch 8:   1%|          | 1/117 [00:00<01:49,  1.06it/s, loss=3.2, v_num=1, val_acc=0.631]
Epoch 8:   2%|▏         | 2/117 [00:00<00:54,  2.09it/s, loss=3.2, v_num=1, val_acc=0.631]
Epoch 8:   2%|▏         | 2/117 [00:00<00:56,  2.04it/s, loss=3.32, v_num=1, val_acc=0.631]
Epoch 8:   3%|▎         | 3/117 [00:00<00:37,  3.03it/s, loss=3.32, v_num=1, val_acc=0.631]
Epoch 8:   3%|▎         | 3/117 [00:01<00:38,  2.96it/s, loss=3.34, v_num=1, val_acc=0.631]
Epoch 8:   3%|▎         | 4/117 [00:01<00:28,  3.90it/s, loss=3.34, v_num=1, val_acc=0.631]
Epoch 8:   3%|▎         | 4/117 [00:01<00:29,  3.81it/s, loss=3.33, v_num=1, val_acc=0.631]
Epoch 8:   4%|▍         | 5/117 [00:01<00:23,  4.72it/s, loss=3.33, v_num=1, val_acc=0.631]
Epoch 8:   4%|▍         | 5/117 [00:01<00:24,  4.62it/s, loss=3.38, v_num=1, val_acc=0.631]
Epoch 8:   5%|▌         | 6/117 [00:01<00:20,  5.48it/s, loss=3.38, v_num=1, val_acc=0.631]
Epoch 8:   5%|▌         | 6/117 [00:01<00:20,  5.37it/s, loss=3.3, v_num=1, val_acc=0.631]
Epoch 8:   6%|▌         | 7/117 [00:01<00:17,  6.21it/s, loss=3.3, v_num=1, val_acc=0.631]
Epoch 8:   6%|▌         | 7/117 [00:01<00:18,  6.08it/s, loss=3.24, v_num=1, val_acc=0.631]
Epoch 8:   7%|▋         | 8/117 [00:01<00:15,  6.90it/s, loss=3.24, v_num=1, val_acc=0.631]
Epoch 8:   7%|▋         | 8/117 [00:01<00:16,  6.75it/s, loss=3.24, v_num=1, val_acc=0.631]
Epoch 8:   8%|▊         | 9/117 [00:01<00:14,  7.50it/s, loss=3.24, v_num=1, val_acc=0.631]
Epoch 8:   8%|▊         | 9/117 [00:01<00:14,  7.35it/s, loss=3.29, v_num=1, val_acc=0.631]
Epoch 8:   9%|▊         | 10/117 [00:01<00:13,  8.10it/s, loss=3.29, v_num=1, val_acc=0.631]
Epoch 8:   9%|▊         | 10/117 [00:01<00:13,  7.94it/s, loss=3.32, v_num=1, val_acc=0.631]
Epoch 8:   9%|▉         | 11/117 [00:01<00:12,  8.67it/s, loss=3.32, v_num=1, val_acc=0.631]
Epoch 8:   9%|▉         | 11/117 [00:01<00:12,  8.50it/s, loss=3.37, v_num=1, val_acc=0.631]
Epoch 8:  10%|█         | 12/117 [00:01<00:11,  9.21it/s, loss=3.37, v_num=1, val_acc=0.631]
Epoch 8:  10%|█         | 12/117 [00:01<00:11,  9.04it/s, loss=3.41, v_num=1, val_acc=0.631]
Epoch 8:  11%|█         | 13/117 [00:01<00:10,  9.73it/s, loss=3.41, v_num=1, val_acc=0.631]
Epoch 8:  11%|█         | 13/117 [00:01<00:10,  9.55it/s, loss=3.48, v_num=1, val_acc=0.631]
Epoch 8:  12%|█▏        | 14/117 [00:01<00:10, 10.22it/s, loss=3.48, v_num=1, val_acc=0.631]
Epoch 8:  12%|█▏        | 14/117 [00:01<00:10, 10.03it/s, loss=3.55, v_num=1, val_acc=0.631]
Epoch 8:  13%|█▎        | 15/117 [00:01<00:09, 10.68it/s, loss=3.55, v_num=1, val_acc=0.631]
Epoch 8:  13%|█▎        | 15/117 [00:01<00:09, 10.49it/s, loss=3.5, v_num=1, val_acc=0.631]
Epoch 8:  14%|█▎        | 16/117 [00:01<00:09, 11.12it/s, loss=3.5, v_num=1, val_acc=0.631]
Epoch 8:  14%|█▎        | 16/117 [00:01<00:09, 10.93it/s, loss=3.48, v_num=1, val_acc=0.631]
Epoch 8:  15%|█▍        | 17/117 [00:01<00:08, 11.52it/s, loss=3.48, v_num=1, val_acc=0.631]
Epoch 8:  15%|█▍        | 17/117 [00:01<00:08, 11.33it/s, loss=3.45, v_num=1, val_acc=0.631]
Epoch 8:  15%|█▌        | 18/117 [00:01<00:08, 11.92it/s, loss=3.45, v_num=1, val_acc=0.631]
Epoch 8:  15%|█▌        | 18/117 [00:01<00:08, 11.73it/s, loss=3.52, v_num=1, val_acc=0.631]
Epoch 8:  16%|█▌        | 19/117 [00:01<00:07, 12.31it/s, loss=3.52, v_num=1, val_acc=0.631]
Epoch 8:  16%|█▌        | 19/117 [00:01<00:08, 12.11it/s, loss=3.44, v_num=1, val_acc=0.631]
Epoch 8:  17%|█▋        | 20/117 [00:01<00:07, 12.67it/s, loss=3.44, v_num=1, val_acc=0.631]
Epoch 8:  17%|█▋        | 20/117 [00:01<00:07, 12.48it/s, loss=3.42, v_num=1, val_acc=0.631]
Epoch 8:  18%|█▊        | 21/117 [00:01<00:07, 13.03it/s, loss=3.42, v_num=1, val_acc=0.631]
Epoch 8:  18%|█▊        | 21/117 [00:01<00:07, 12.83it/s, loss=3.35, v_num=1, val_acc=0.631]
Epoch 8:  19%|█▉        | 22/117 [00:01<00:07, 13.37it/s, loss=3.35, v_num=1, val_acc=0.631]
Epoch 8:  19%|█▉        | 22/117 [00:01<00:07, 13.17it/s, loss=3.24, v_num=1, val_acc=0.631]
Epoch 8:  20%|█▉        | 23/117 [00:01<00:06, 13.69it/s, loss=3.24, v_num=1, val_acc=0.631]
Epoch 8:  20%|█▉        | 23/117 [00:01<00:06, 13.49it/s, loss=3.21, v_num=1, val_acc=0.631]
Epoch 8:  21%|██        | 24/117 [00:01<00:06, 14.00it/s, loss=3.21, v_num=1, val_acc=0.631]
Epoch 8:  21%|██        | 24/117 [00:01<00:06, 13.80it/s, loss=3.21, v_num=1, val_acc=0.631]
Epoch 8:  21%|██▏       | 25/117 [00:01<00:06, 14.29it/s, loss=3.21, v_num=1, val_acc=0.631]
Epoch 8:  21%|██▏       | 25/117 [00:01<00:06, 14.09it/s, loss=3.2, v_num=1, val_acc=0.631]
Epoch 8:  22%|██▏       | 26/117 [00:01<00:06, 14.57it/s, loss=3.2, v_num=1, val_acc=0.631]
Epoch 8:  22%|██▏       | 26/117 [00:01<00:06, 14.37it/s, loss=3.22, v_num=1, val_acc=0.631]
Epoch 8:  23%|██▎       | 27/117 [00:01<00:06, 14.85it/s, loss=3.22, v_num=1, val_acc=0.631]
Epoch 8:  23%|██▎       | 27/117 [00:01<00:06, 14.64it/s, loss=3.25, v_num=1, val_acc=0.631]
Epoch 8:  24%|██▍       | 28/117 [00:01<00:05, 15.11it/s, loss=3.25, v_num=1, val_acc=0.631]
Epoch 8:  24%|██▍       | 28/117 [00:01<00:05, 14.91it/s, loss=3.22, v_num=1, val_acc=0.631]
Epoch 8:  25%|██▍       | 29/117 [00:01<00:05, 15.36it/s, loss=3.22, v_num=1, val_acc=0.631]
Epoch 8:  25%|██▍       | 29/117 [00:01<00:05, 15.16it/s, loss=3.26, v_num=1, val_acc=0.631]
Epoch 8:  26%|██▌       | 30/117 [00:01<00:05, 15.61it/s, loss=3.26, v_num=1, val_acc=0.631]
Epoch 8:  26%|██▌       | 30/117 [00:01<00:05, 15.41it/s, loss=3.2, v_num=1, val_acc=0.631]
Epoch 8:  26%|██▋       | 31/117 [00:01<00:05, 15.84it/s, loss=3.2, v_num=1, val_acc=0.631]
Epoch 8:  26%|██▋       | 31/117 [00:01<00:05, 15.64it/s, loss=3.18, v_num=1, val_acc=0.631]
Epoch 8:  27%|██▋       | 32/117 [00:01<00:05, 16.07it/s, loss=3.18, v_num=1, val_acc=0.631]
Epoch 8:  27%|██▋       | 32/117 [00:02<00:05, 15.87it/s, loss=3.14, v_num=1, val_acc=0.631]
Epoch 8:  28%|██▊       | 33/117 [00:02<00:05, 16.29it/s, loss=3.14, v_num=1, val_acc=0.631]
Epoch 8:  28%|██▊       | 33/117 [00:02<00:05, 16.09it/s, loss=3.13, v_num=1, val_acc=0.631]
Epoch 8:  29%|██▉       | 34/117 [00:02<00:05, 16.51it/s, loss=3.13, v_num=1, val_acc=0.631]
Epoch 8:  29%|██▉       | 34/117 [00:02<00:05, 16.31it/s, loss=3.1, v_num=1, val_acc=0.631]
Epoch 8:  30%|██▉       | 35/117 [00:02<00:04, 16.71it/s, loss=3.1, v_num=1, val_acc=0.631]
Epoch 8:  30%|██▉       | 35/117 [00:02<00:04, 16.51it/s, loss=3.15, v_num=1, val_acc=0.631]
Epoch 8:  31%|███       | 36/117 [00:02<00:04, 16.91it/s, loss=3.15, v_num=1, val_acc=0.631]
Epoch 8:  31%|███       | 36/117 [00:02<00:04, 16.71it/s, loss=3.22, v_num=1, val_acc=0.631]
Epoch 8:  32%|███▏      | 37/117 [00:02<00:04, 17.10it/s, loss=3.22, v_num=1, val_acc=0.631]
Epoch 8:  32%|███▏      | 37/117 [00:02<00:04, 16.91it/s, loss=3.13, v_num=1, val_acc=0.631]
Epoch 8:  32%|███▏      | 38/117 [00:02<00:04, 17.29it/s, loss=3.13, v_num=1, val_acc=0.631]
Epoch 8:  32%|███▏      | 38/117 [00:02<00:04, 17.09it/s, loss=3, v_num=1, val_acc=0.631]
Epoch 8:  33%|███▎      | 39/117 [00:02<00:04, 17.43it/s, loss=3, v_num=1, val_acc=0.631]
Epoch 8:  33%|███▎      | 39/117 [00:02<00:04, 17.26it/s, loss=2.99, v_num=1, val_acc=0.631]
Epoch 8:  34%|███▍      | 40/117 [00:02<00:04, 17.62it/s, loss=2.99, v_num=1, val_acc=0.631]
Epoch 8:  34%|███▍      | 40/117 [00:02<00:04, 17.43it/s, loss=2.96, v_num=1, val_acc=0.631]
Epoch 8:  35%|███▌      | 41/117 [00:02<00:04, 17.79it/s, loss=2.96, v_num=1, val_acc=0.631]
Epoch 8:  35%|███▌      | 41/117 [00:02<00:04, 17.60it/s, loss=2.94, v_num=1, val_acc=0.631]
Epoch 8:  36%|███▌      | 42/117 [00:02<00:04, 17.96it/s, loss=2.94, v_num=1, val_acc=0.631]
Epoch 8:  36%|███▌      | 42/117 [00:02<00:04, 17.77it/s, loss=2.92, v_num=1, val_acc=0.631]
Epoch 8:  37%|███▋      | 43/117 [00:02<00:04, 18.09it/s, loss=2.92, v_num=1, val_acc=0.631]
Epoch 8:  37%|███▋      | 43/117 [00:02<00:04, 17.92it/s, loss=2.87, v_num=1, val_acc=0.631]
Epoch 8:  38%|███▊      | 44/117 [00:02<00:03, 18.25it/s, loss=2.87, v_num=1, val_acc=0.631]
Epoch 8:  38%|███▊      | 44/117 [00:02<00:04, 18.06it/s, loss=2.87, v_num=1, val_acc=0.631]
Epoch 8:  38%|███▊      | 45/117 [00:02<00:03, 18.40it/s, loss=2.87, v_num=1, val_acc=0.631]
Epoch 8:  38%|███▊      | 45/117 [00:02<00:03, 18.22it/s, loss=2.87, v_num=1, val_acc=0.631]
Epoch 8:  39%|███▉      | 46/117 [00:02<00:03, 18.55it/s, loss=2.87, v_num=1, val_acc=0.631]
Epoch 8:  39%|███▉      | 46/117 [00:02<00:03, 18.36it/s, loss=2.89, v_num=1, val_acc=0.631]
Epoch 8:  40%|████      | 47/117 [00:02<00:03, 18.69it/s, loss=2.89, v_num=1, val_acc=0.631]
Epoch 8:  40%|████      | 47/117 [00:02<00:03, 18.50it/s, loss=2.89, v_num=1, val_acc=0.631]
Epoch 8:  41%|████      | 48/117 [00:02<00:03, 18.82it/s, loss=2.89, v_num=1, val_acc=0.631]
Epoch 8:  41%|████      | 48/117 [00:02<00:03, 18.64it/s, loss=2.91, v_num=1, val_acc=0.631]
Epoch 8:  42%|████▏     | 49/117 [00:02<00:03, 18.96it/s, loss=2.91, v_num=1, val_acc=0.631]
Epoch 8:  42%|████▏     | 49/117 [00:02<00:03, 18.78it/s, loss=2.79, v_num=1, val_acc=0.631]
Epoch 8:  43%|████▎     | 50/117 [00:02<00:03, 19.09it/s, loss=2.79, v_num=1, val_acc=0.631]
Epoch 8:  43%|████▎     | 50/117 [00:02<00:03, 18.91it/s, loss=2.77, v_num=1, val_acc=0.631]
Epoch 8:  44%|████▎     | 51/117 [00:02<00:03, 19.22it/s, loss=2.77, v_num=1, val_acc=0.631]
Epoch 8:  44%|████▎     | 51/117 [00:02<00:03, 19.04it/s, loss=2.75, v_num=1, val_acc=0.631]
Epoch 8:  44%|████▍     | 52/117 [00:02<00:03, 19.35it/s, loss=2.75, v_num=1, val_acc=0.631]
Epoch 8:  44%|████▍     | 52/117 [00:02<00:03, 19.17it/s, loss=2.73, v_num=1, val_acc=0.631]
Epoch 8:  45%|████▌     | 53/117 [00:02<00:03, 19.47it/s, loss=2.73, v_num=1, val_acc=0.631]
Epoch 8:  45%|████▌     | 53/117 [00:02<00:03, 19.29it/s, loss=2.74, v_num=1, val_acc=0.631]
Epoch 8:  46%|████▌     | 54/117 [00:02<00:03, 19.58it/s, loss=2.74, v_num=1, val_acc=0.631]
Epoch 8:  46%|████▌     | 54/117 [00:02<00:03, 19.41it/s, loss=2.71, v_num=1, val_acc=0.631]
Epoch 8:  47%|████▋     | 55/117 [00:02<00:03, 19.70it/s, loss=2.71, v_num=1, val_acc=0.631]
Epoch 8:  47%|████▋     | 55/117 [00:02<00:03, 19.52it/s, loss=2.66, v_num=1, val_acc=0.631]
Epoch 8:  48%|████▊     | 56/117 [00:02<00:03, 19.81it/s, loss=2.66, v_num=1, val_acc=0.631]
Epoch 8:  48%|████▊     | 56/117 [00:02<00:03, 19.63it/s, loss=2.59, v_num=1, val_acc=0.631]
Epoch 8:  49%|████▊     | 57/117 [00:02<00:03, 19.92it/s, loss=2.59, v_num=1, val_acc=0.631]
Epoch 8:  49%|████▊     | 57/117 [00:02<00:03, 19.75it/s, loss=2.64, v_num=1, val_acc=0.631]
Epoch 8:  50%|████▉     | 58/117 [00:02<00:02, 20.02it/s, loss=2.64, v_num=1, val_acc=0.631]
Epoch 8:  50%|████▉     | 58/117 [00:02<00:02, 19.85it/s, loss=2.79, v_num=1, val_acc=0.631]
Epoch 8:  50%|█████     | 59/117 [00:02<00:02, 20.13it/s, loss=2.79, v_num=1, val_acc=0.631]
Epoch 8:  50%|█████     | 59/117 [00:02<00:02, 19.96it/s, loss=2.95, v_num=1, val_acc=0.631]
Epoch 8:  51%|█████▏    | 60/117 [00:02<00:02, 20.23it/s, loss=2.95, v_num=1, val_acc=0.631]
Epoch 8:  51%|█████▏    | 60/117 [00:02<00:02, 20.06it/s, loss=3.11, v_num=1, val_acc=0.631]
Epoch 8:  52%|█████▏    | 61/117 [00:02<00:02, 20.34it/s, loss=3.11, v_num=1, val_acc=0.631]
Epoch 8:  52%|█████▏    | 61/117 [00:03<00:02, 20.17it/s, loss=3.32, v_num=1, val_acc=0.631]
Epoch 8:  53%|█████▎    | 62/117 [00:03<00:02, 20.43it/s, loss=3.32, v_num=1, val_acc=0.631]
Epoch 8:  53%|█████▎    | 62/117 [00:03<00:02, 20.26it/s, loss=3.38, v_num=1, val_acc=0.631]
Epoch 8:  54%|█████▍    | 63/117 [00:03<00:02, 20.52it/s, loss=3.38, v_num=1, val_acc=0.631]
Epoch 8:  54%|█████▍    | 63/117 [00:03<00:02, 20.36it/s, loss=3.45, v_num=1, val_acc=0.631]
Epoch 8:  55%|█████▍    | 64/117 [00:03<00:02, 20.62it/s, loss=3.45, v_num=1, val_acc=0.631]
Epoch 8:  55%|█████▍    | 64/117 [00:03<00:02, 20.45it/s, loss=3.48, v_num=1, val_acc=0.631]
Epoch 8:  56%|█████▌    | 65/117 [00:03<00:02, 20.71it/s, loss=3.48, v_num=1, val_acc=0.631]
Epoch 8:  56%|█████▌    | 65/117 [00:03<00:02, 20.54it/s, loss=3.51, v_num=1, val_acc=0.631]
Epoch 8:  56%|█████▋    | 66/117 [00:03<00:02, 20.79it/s, loss=3.51, v_num=1, val_acc=0.631]
Epoch 8:  56%|█████▋    | 66/117 [00:03<00:02, 20.63it/s, loss=3.48, v_num=1, val_acc=0.631]
Epoch 8:  57%|█████▋    | 67/117 [00:03<00:02, 20.88it/s, loss=3.48, v_num=1, val_acc=0.631]
Epoch 8:  57%|█████▋    | 67/117 [00:03<00:02, 20.72it/s, loss=3.45, v_num=1, val_acc=0.631]
Epoch 8:  58%|█████▊    | 68/117 [00:03<00:02, 20.97it/s, loss=3.45, v_num=1, val_acc=0.631]
Epoch 8:  58%|█████▊    | 68/117 [00:03<00:02, 20.81it/s, loss=3.45, v_num=1, val_acc=0.631]
Epoch 8:  59%|█████▉    | 69/117 [00:03<00:02, 21.05it/s, loss=3.45, v_num=1, val_acc=0.631]
Epoch 8:  59%|█████▉    | 69/117 [00:03<00:02, 20.89it/s, loss=3.54, v_num=1, val_acc=0.631]
Epoch 8:  60%|█████▉    | 70/117 [00:03<00:02, 21.13it/s, loss=3.54, v_num=1, val_acc=0.631]
Epoch 8:  60%|█████▉    | 70/117 [00:03<00:02, 20.98it/s, loss=3.61, v_num=1, val_acc=0.631]
Epoch 8:  61%|██████    | 71/117 [00:03<00:02, 21.21it/s, loss=3.61, v_num=1, val_acc=0.631]
Epoch 8:  61%|██████    | 71/117 [00:03<00:02, 21.05it/s, loss=3.61, v_num=1, val_acc=0.631]
Epoch 8:  62%|██████▏   | 72/117 [00:03<00:02, 21.26it/s, loss=3.61, v_num=1, val_acc=0.631]
Epoch 8:  62%|██████▏   | 72/117 [00:03<00:02, 21.11it/s, loss=3.6, v_num=1, val_acc=0.631]
Epoch 8:  62%|██████▏   | 73/117 [00:03<00:02, 21.34it/s, loss=3.6, v_num=1, val_acc=0.631]
Epoch 8:  62%|██████▏   | 73/117 [00:03<00:02, 21.18it/s, loss=3.52, v_num=1, val_acc=0.631]
Epoch 8:  63%|██████▎   | 74/117 [00:03<00:02, 21.41it/s, loss=3.52, v_num=1, val_acc=0.631]
Epoch 8:  63%|██████▎   | 74/117 [00:03<00:02, 21.26it/s, loss=3.56, v_num=1, val_acc=0.631]
Epoch 8:  64%|██████▍   | 75/117 [00:03<00:01, 21.48it/s, loss=3.56, v_num=1, val_acc=0.631]
Epoch 8:  64%|██████▍   | 75/117 [00:03<00:01, 21.33it/s, loss=3.69, v_num=1, val_acc=0.631]
Epoch 8:  65%|██████▍   | 76/117 [00:03<00:01, 21.55it/s, loss=3.69, v_num=1, val_acc=0.631]
Epoch 8:  65%|██████▍   | 76/117 [00:03<00:01, 21.40it/s, loss=3.77, v_num=1, val_acc=0.631]
Epoch 8:  66%|██████▌   | 77/117 [00:03<00:01, 21.62it/s, loss=3.77, v_num=1, val_acc=0.631]
Epoch 8:  66%|██████▌   | 77/117 [00:03<00:01, 21.47it/s, loss=3.84, v_num=1, val_acc=0.631]
Epoch 8:  67%|██████▋   | 78/117 [00:03<00:01, 21.69it/s, loss=3.84, v_num=1, val_acc=0.631]
Epoch 8:  67%|██████▋   | 78/117 [00:03<00:01, 21.54it/s, loss=3.81, v_num=1, val_acc=0.631]
Epoch 8:  68%|██████▊   | 79/117 [00:03<00:01, 21.76it/s, loss=3.81, v_num=1, val_acc=0.631]
Epoch 8:  68%|██████▊   | 79/117 [00:03<00:01, 21.61it/s, loss=3.75, v_num=1, val_acc=0.631]
Epoch 8:  68%|██████▊   | 80/117 [00:03<00:01, 21.83it/s, loss=3.75, v_num=1, val_acc=0.631]
Epoch 8:  68%|██████▊   | 80/117 [00:03<00:01, 21.68it/s, loss=3.61, v_num=1, val_acc=0.631]
Epoch 8:  69%|██████▉   | 81/117 [00:03<00:01, 21.90it/s, loss=3.61, v_num=1, val_acc=0.631]
Epoch 8:  69%|██████▉   | 81/117 [00:03<00:01, 21.75it/s, loss=3.4, v_num=1, val_acc=0.631]
Epoch 8:  70%|███████   | 82/117 [00:03<00:01, 21.93it/s, loss=3.4, v_num=1, val_acc=0.631]
Epoch 8:  70%|███████   | 82/117 [00:03<00:01, 21.79it/s, loss=3.32, v_num=1, val_acc=0.631]
Epoch 8:  71%|███████   | 83/117 [00:03<00:01, 22.00it/s, loss=3.32, v_num=1, val_acc=0.631]
Epoch 8:  71%|███████   | 83/117 [00:03<00:01, 21.85it/s, loss=3.26, v_num=1, val_acc=0.631]
Epoch 8:  72%|███████▏  | 84/117 [00:03<00:01, 22.06it/s, loss=3.26, v_num=1, val_acc=0.631]
Epoch 8:  72%|███████▏  | 84/117 [00:03<00:01, 21.92it/s, loss=3.2, v_num=1, val_acc=0.631]
Epoch 8:  73%|███████▎  | 85/117 [00:03<00:01, 22.13it/s, loss=3.2, v_num=1, val_acc=0.631]
Epoch 8:  73%|███████▎  | 85/117 [00:03<00:01, 21.98it/s, loss=3.24, v_num=1, val_acc=0.631]
Epoch 8:  74%|███████▎  | 86/117 [00:03<00:01, 22.19it/s, loss=3.24, v_num=1, val_acc=0.631]
Epoch 8:  74%|███████▎  | 86/117 [00:03<00:01, 22.05it/s, loss=3.24, v_num=1, val_acc=0.631]
Epoch 8:  74%|███████▍  | 87/117 [00:03<00:01, 22.26it/s, loss=3.24, v_num=1, val_acc=0.631]
Epoch 8:  74%|███████▍  | 87/117 [00:03<00:01, 22.11it/s, loss=3.29, v_num=1, val_acc=0.631]
Epoch 8:  75%|███████▌  | 88/117 [00:03<00:01, 22.32it/s, loss=3.29, v_num=1, val_acc=0.631]
Epoch 8:  75%|███████▌  | 88/117 [00:03<00:01, 22.17it/s, loss=3.23, v_num=1, val_acc=0.631]
Epoch 8:  76%|███████▌  | 89/117 [00:03<00:01, 22.38it/s, loss=3.23, v_num=1, val_acc=0.631]
Epoch 8:  76%|███████▌  | 89/117 [00:04<00:01, 22.23it/s, loss=3.11, v_num=1, val_acc=0.631]
Epoch 8:  77%|███████▋  | 90/117 [00:04<00:01, 22.43it/s, loss=3.11, v_num=1, val_acc=0.631]
Epoch 8:  77%|███████▋  | 90/117 [00:04<00:01, 22.29it/s, loss=3.05, v_num=1, val_acc=0.631]
Epoch 8:  78%|███████▊  | 91/117 [00:04<00:01, 22.49it/s, loss=3.05, v_num=1, val_acc=0.631]
Epoch 8:  78%|███████▊  | 91/117 [00:04<00:01, 22.35it/s, loss=3.12, v_num=1, val_acc=0.631]
Epoch 8:  79%|███████▊  | 92/117 [00:04<00:01, 22.55it/s, loss=3.12, v_num=1, val_acc=0.631]
Epoch 8:  79%|███████▊  | 92/117 [00:04<00:01, 22.41it/s, loss=3.16, v_num=1, val_acc=0.631]
Epoch 8:  79%|███████▉  | 93/117 [00:04<00:01, 22.60it/s, loss=3.16, v_num=1, val_acc=0.631]
Epoch 8:  79%|███████▉  | 93/117 [00:04<00:01, 22.47it/s, loss=3.29, v_num=1, val_acc=0.631]
Epoch 8:  80%|████████  | 94/117 [00:04<00:01, 22.66it/s, loss=3.29, v_num=1, val_acc=0.631]
Epoch 8:  80%|████████  | 94/117 [00:04<00:01, 22.52it/s, loss=3.38, v_num=1, val_acc=0.631]
Epoch 8:  81%|████████  | 95/117 [00:04<00:00, 22.71it/s, loss=3.38, v_num=1, val_acc=0.631]
Epoch 8:  81%|████████  | 95/117 [00:04<00:00, 22.58it/s, loss=3.25, v_num=1, val_acc=0.631]
Epoch 8:  82%|████████▏ | 96/117 [00:04<00:00, 22.77it/s, loss=3.25, v_num=1, val_acc=0.631]
Epoch 8:  82%|████████▏ | 96/117 [00:04<00:00, 22.63it/s, loss=3.2, v_num=1, val_acc=0.631]
Epoch 8:  83%|████████▎ | 97/117 [00:04<00:00, 22.82it/s, loss=3.2, v_num=1, val_acc=0.631]
Epoch 8:  83%|████████▎ | 97/117 [00:04<00:00, 22.68it/s, loss=3.14, v_num=1, val_acc=0.631]

Validation: 0it [00:00, ?it/s]

Validation:   0%|          | 0/20 [00:00<?, ?it/s]

Validation DataLoader 0:   0%|          | 0/20 [00:00<?, ?it/s]

Validation DataLoader 0:   5%|▌         | 1/20 [00:00<00:00, 159.45it/s]
Epoch 8:  84%|████████▍ | 98/117 [00:05<00:00, 19.10it/s, loss=3.14, v_num=1, val_acc=0.631]

Validation DataLoader 0:  10%|█         | 2/20 [00:00<00:00, 54.41it/s]
Epoch 8:  85%|████████▍ | 99/117 [00:05<00:00, 19.18it/s, loss=3.14, v_num=1, val_acc=0.631]

Validation DataLoader 0:  15%|█▌        | 3/20 [00:00<00:00, 43.76it/s]
Epoch 8:  85%|████████▌ | 100/117 [00:05<00:00, 19.25it/s, loss=3.14, v_num=1, val_acc=0.631]

Validation DataLoader 0:  20%|██        | 4/20 [00:00<00:00, 39.91it/s]
Epoch 8:  86%|████████▋ | 101/117 [00:05<00:00, 19.33it/s, loss=3.14, v_num=1, val_acc=0.631]

Validation DataLoader 0:  25%|██▌       | 5/20 [00:00<00:00, 37.77it/s]
Epoch 8:  87%|████████▋ | 102/117 [00:05<00:00, 19.40it/s, loss=3.14, v_num=1, val_acc=0.631]

Validation DataLoader 0:  30%|███       | 6/20 [00:00<00:00, 36.57it/s]
Epoch 8:  88%|████████▊ | 103/117 [00:05<00:00, 19.47it/s, loss=3.14, v_num=1, val_acc=0.631]

Validation DataLoader 0:  35%|███▌      | 7/20 [00:00<00:00, 35.76it/s]
Epoch 8:  89%|████████▉ | 104/117 [00:05<00:00, 19.54it/s, loss=3.14, v_num=1, val_acc=0.631]

Validation DataLoader 0:  40%|████      | 8/20 [00:00<00:00, 35.18it/s]
Epoch 8:  90%|████████▉ | 105/117 [00:05<00:00, 19.62it/s, loss=3.14, v_num=1, val_acc=0.631]

Validation DataLoader 0:  45%|████▌     | 9/20 [00:00<00:00, 34.68it/s]
Epoch 8:  91%|█████████ | 106/117 [00:05<00:00, 19.68it/s, loss=3.14, v_num=1, val_acc=0.631]

Validation DataLoader 0:  50%|█████     | 10/20 [00:00<00:00, 34.42it/s]
Epoch 8:  91%|█████████▏| 107/117 [00:05<00:00, 19.76it/s, loss=3.14, v_num=1, val_acc=0.631]

Validation DataLoader 0:  55%|█████▌    | 11/20 [00:00<00:00, 34.14it/s]
Epoch 8:  92%|█████████▏| 108/117 [00:05<00:00, 19.82it/s, loss=3.14, v_num=1, val_acc=0.631]

Validation DataLoader 0:  60%|██████    | 12/20 [00:00<00:00, 33.80it/s]
Epoch 8:  93%|█████████▎| 109/117 [00:05<00:00, 19.89it/s, loss=3.14, v_num=1, val_acc=0.631]

Validation DataLoader 0:  65%|██████▌   | 13/20 [00:00<00:00, 33.65it/s]
Epoch 8:  94%|█████████▍| 110/117 [00:05<00:00, 19.96it/s, loss=3.14, v_num=1, val_acc=0.631]

Validation DataLoader 0:  70%|███████   | 14/20 [00:00<00:00, 33.50it/s]
Epoch 8:  95%|█████████▍| 111/117 [00:05<00:00, 20.02it/s, loss=3.14, v_num=1, val_acc=0.631]

Validation DataLoader 0:  75%|███████▌  | 15/20 [00:00<00:00, 33.36it/s]
Epoch 8:  96%|█████████▌| 112/117 [00:05<00:00, 20.09it/s, loss=3.14, v_num=1, val_acc=0.631]

Validation DataLoader 0:  80%|████████  | 16/20 [00:00<00:00, 33.24it/s]
Epoch 8:  97%|█████████▋| 113/117 [00:05<00:00, 20.15it/s, loss=3.14, v_num=1, val_acc=0.631]

Validation DataLoader 0:  85%|████████▌ | 17/20 [00:00<00:00, 33.14it/s]
Epoch 8:  97%|█████████▋| 114/117 [00:05<00:00, 20.22it/s, loss=3.14, v_num=1, val_acc=0.631]

Validation DataLoader 0:  90%|█████████ | 18/20 [00:00<00:00, 33.05it/s]
Epoch 8:  98%|█████████▊| 115/117 [00:05<00:00, 20.28it/s, loss=3.14, v_num=1, val_acc=0.631]

Validation DataLoader 0:  95%|█████████▌| 19/20 [00:00<00:00, 32.97it/s]
Epoch 8:  99%|█████████▉| 116/117 [00:05<00:00, 20.34it/s, loss=3.14, v_num=1, val_acc=0.631]

Validation DataLoader 0: 100%|██████████| 20/20 [00:00<00:00, 32.97it/s]
Epoch 8: 100%|██████████| 117/117 [00:05<00:00, 20.41it/s, loss=3.14, v_num=1, val_acc=0.631]
Epoch 8: 100%|██████████| 117/117 [00:05<00:00, 20.34it/s, loss=3.14, v_num=1, val_acc=0.653]


Epoch 8: 100%|██████████| 117/117 [00:05<00:00, 20.34it/s, loss=3.14, v_num=1, val_acc=0.653]
Epoch 8:   0%|          | 0/117 [00:00<?, ?it/s, loss=3.14, v_num=1, val_acc=0.653]
Epoch 9:   0%|          | 0/117 [00:00<?, ?it/s, loss=3.14, v_num=1, val_acc=0.653]
Epoch 9:   1%|          | 1/117 [00:00<01:44,  1.11it/s, loss=3.14, v_num=1, val_acc=0.653]
Epoch 9:   1%|          | 1/117 [00:00<01:47,  1.08it/s, loss=3.07, v_num=1, val_acc=0.653]
Epoch 9:   2%|▏         | 2/117 [00:00<00:53,  2.13it/s, loss=3.07, v_num=1, val_acc=0.653]
Epoch 9:   2%|▏         | 2/117 [00:00<00:55,  2.08it/s, loss=2.97, v_num=1, val_acc=0.653]
Epoch 9:   3%|▎         | 3/117 [00:00<00:37,  3.08it/s, loss=2.97, v_num=1, val_acc=0.653]
Epoch 9:   3%|▎         | 3/117 [00:00<00:37,  3.00it/s, loss=2.92, v_num=1, val_acc=0.653]
Epoch 9:   3%|▎         | 4/117 [00:01<00:28,  3.97it/s, loss=2.92, v_num=1, val_acc=0.653]
Epoch 9:   3%|▎         | 4/117 [00:01<00:29,  3.87it/s, loss=2.95, v_num=1, val_acc=0.653]
Epoch 9:   4%|▍         | 5/117 [00:01<00:23,  4.79it/s, loss=2.95, v_num=1, val_acc=0.653]
Epoch 9:   4%|▍         | 5/117 [00:01<00:23,  4.68it/s, loss=3.01, v_num=1, val_acc=0.653]
Epoch 9:   5%|▌         | 6/117 [00:01<00:19,  5.56it/s, loss=3.01, v_num=1, val_acc=0.653]
Epoch 9:   5%|▌         | 6/117 [00:01<00:20,  5.44it/s, loss=3.06, v_num=1, val_acc=0.653]
Epoch 9:   6%|▌         | 7/117 [00:01<00:17,  6.30it/s, loss=3.06, v_num=1, val_acc=0.653]
Epoch 9:   6%|▌         | 7/117 [00:01<00:17,  6.16it/s, loss=3.11, v_num=1, val_acc=0.653]
Epoch 9:   7%|▋         | 8/117 [00:01<00:15,  6.98it/s, loss=3.11, v_num=1, val_acc=0.653]
Epoch 9:   7%|▋         | 8/117 [00:01<00:15,  6.83it/s, loss=3.02, v_num=1, val_acc=0.653]
Epoch 9:   8%|▊         | 9/117 [00:01<00:14,  7.63it/s, loss=3.02, v_num=1, val_acc=0.653]
Epoch 9:   8%|▊         | 9/117 [00:01<00:14,  7.47it/s, loss=3.05, v_num=1, val_acc=0.653]
Epoch 9:   9%|▊         | 10/117 [00:01<00:13,  8.19it/s, loss=3.05, v_num=1, val_acc=0.653]
Epoch 9:   9%|▊         | 10/117 [00:01<00:13,  8.03it/s, loss=3.05, v_num=1, val_acc=0.653]
Epoch 9:   9%|▉         | 11/117 [00:01<00:12,  8.72it/s, loss=3.05, v_num=1, val_acc=0.653]
Epoch 9:   9%|▉         | 11/117 [00:01<00:12,  8.57it/s, loss=3.14, v_num=1, val_acc=0.653]
Epoch 9:  10%|█         | 12/117 [00:01<00:11,  9.29it/s, loss=3.14, v_num=1, val_acc=0.653]
Epoch 9:  10%|█         | 12/117 [00:01<00:11,  9.11it/s, loss=3.29, v_num=1, val_acc=0.653]
Epoch 9:  11%|█         | 13/117 [00:01<00:10,  9.80it/s, loss=3.29, v_num=1, val_acc=0.653]
Epoch 9:  11%|█         | 13/117 [00:01<00:10,  9.61it/s, loss=3.3, v_num=1, val_acc=0.653]
Epoch 9:  12%|█▏        | 14/117 [00:01<00:10, 10.29it/s, loss=3.3, v_num=1, val_acc=0.653]
Epoch 9:  12%|█▏        | 14/117 [00:01<00:10, 10.10it/s, loss=3.22, v_num=1, val_acc=0.653]
Epoch 9:  13%|█▎        | 15/117 [00:01<00:09, 10.76it/s, loss=3.22, v_num=1, val_acc=0.653]
Epoch 9:  13%|█▎        | 15/117 [00:01<00:09, 10.57it/s, loss=3.16, v_num=1, val_acc=0.653]
Epoch 9:  14%|█▎        | 16/117 [00:01<00:09, 11.21it/s, loss=3.16, v_num=1, val_acc=0.653]
Epoch 9:  14%|█▎        | 16/117 [00:01<00:09, 11.01it/s, loss=3.04, v_num=1, val_acc=0.653]
Epoch 9:  15%|█▍        | 17/117 [00:01<00:08, 11.63it/s, loss=3.04, v_num=1, val_acc=0.653]
Epoch 9:  15%|█▍        | 17/117 [00:01<00:08, 11.43it/s, loss=2.89, v_num=1, val_acc=0.653]
Epoch 9:  15%|█▌        | 18/117 [00:01<00:08, 12.03it/s, loss=2.89, v_num=1, val_acc=0.653]
Epoch 9:  15%|█▌        | 18/117 [00:01<00:08, 11.83it/s, loss=2.89, v_num=1, val_acc=0.653]
Epoch 9:  16%|█▌        | 19/117 [00:01<00:07, 12.41it/s, loss=2.89, v_num=1, val_acc=0.653]
Epoch 9:  16%|█▌        | 19/117 [00:01<00:08, 12.21it/s, loss=2.91, v_num=1, val_acc=0.653]
Epoch 9:  17%|█▋        | 20/117 [00:01<00:07, 12.77it/s, loss=2.91, v_num=1, val_acc=0.653]
Epoch 9:  17%|█▋        | 20/117 [00:01<00:07, 12.56it/s, loss=2.92, v_num=1, val_acc=0.653]
Epoch 9:  18%|█▊        | 21/117 [00:01<00:07, 13.11it/s, loss=2.92, v_num=1, val_acc=0.653]
Epoch 9:  18%|█▊        | 21/117 [00:01<00:07, 12.91it/s, loss=2.94, v_num=1, val_acc=0.653]
Epoch 9:  19%|█▉        | 22/117 [00:01<00:07, 13.46it/s, loss=2.94, v_num=1, val_acc=0.653]
Epoch 9:  19%|█▉        | 22/117 [00:01<00:07, 13.25it/s, loss=3.13, v_num=1, val_acc=0.653]
Epoch 9:  20%|█▉        | 23/117 [00:01<00:06, 13.78it/s, loss=3.13, v_num=1, val_acc=0.653]
Epoch 9:  20%|█▉        | 23/117 [00:01<00:06, 13.57it/s, loss=3.32, v_num=1, val_acc=0.653]
Epoch 9:  21%|██        | 24/117 [00:01<00:06, 14.08it/s, loss=3.32, v_num=1, val_acc=0.653]
Epoch 9:  21%|██        | 24/117 [00:01<00:06, 13.88it/s, loss=3.4, v_num=1, val_acc=0.653]
Epoch 9:  21%|██▏       | 25/117 [00:01<00:06, 14.38it/s, loss=3.4, v_num=1, val_acc=0.653]
Epoch 9:  21%|██▏       | 25/117 [00:01<00:06, 14.17it/s, loss=3.38, v_num=1, val_acc=0.653]
Epoch 9:  22%|██▏       | 26/117 [00:01<00:06, 14.67it/s, loss=3.38, v_num=1, val_acc=0.653]
Epoch 9:  22%|██▏       | 26/117 [00:01<00:06, 14.46it/s, loss=3.43, v_num=1, val_acc=0.653]
Epoch 9:  23%|██▎       | 27/117 [00:01<00:06, 14.94it/s, loss=3.43, v_num=1, val_acc=0.653]
Epoch 9:  23%|██▎       | 27/117 [00:01<00:06, 14.74it/s, loss=3.5, v_num=1, val_acc=0.653]
Epoch 9:  24%|██▍       | 28/117 [00:01<00:05, 15.20it/s, loss=3.5, v_num=1, val_acc=0.653]
Epoch 9:  24%|██▍       | 28/117 [00:01<00:05, 14.99it/s, loss=3.63, v_num=1, val_acc=0.653]
Epoch 9:  25%|██▍       | 29/117 [00:01<00:05, 15.45it/s, loss=3.63, v_num=1, val_acc=0.653]
Epoch 9:  25%|██▍       | 29/117 [00:01<00:05, 15.25it/s, loss=3.67, v_num=1, val_acc=0.653]
Epoch 9:  26%|██▌       | 30/117 [00:01<00:05, 15.69it/s, loss=3.67, v_num=1, val_acc=0.653]
Epoch 9:  26%|██▌       | 30/117 [00:01<00:05, 15.49it/s, loss=3.67, v_num=1, val_acc=0.653]
Epoch 9:  26%|██▋       | 31/117 [00:01<00:05, 15.93it/s, loss=3.67, v_num=1, val_acc=0.653]
Epoch 9:  26%|██▋       | 31/117 [00:01<00:05, 15.73it/s, loss=3.66, v_num=1, val_acc=0.653]
Epoch 9:  27%|██▋       | 32/117 [00:01<00:05, 16.15it/s, loss=3.66, v_num=1, val_acc=0.653]
Epoch 9:  27%|██▋       | 32/117 [00:02<00:05, 15.95it/s, loss=3.59, v_num=1, val_acc=0.653]
Epoch 9:  28%|██▊       | 33/117 [00:02<00:05, 16.37it/s, loss=3.59, v_num=1, val_acc=0.653]
Epoch 9:  28%|██▊       | 33/117 [00:02<00:05, 16.17it/s, loss=3.65, v_num=1, val_acc=0.653]
Epoch 9:  29%|██▉       | 34/117 [00:02<00:05, 16.59it/s, loss=3.65, v_num=1, val_acc=0.653]
Epoch 9:  29%|██▉       | 34/117 [00:02<00:05, 16.39it/s, loss=3.73, v_num=1, val_acc=0.653]
Epoch 9:  30%|██▉       | 35/117 [00:02<00:04, 16.79it/s, loss=3.73, v_num=1, val_acc=0.653]
Epoch 9:  30%|██▉       | 35/117 [00:02<00:04, 16.59it/s, loss=3.73, v_num=1, val_acc=0.653]
Epoch 9:  31%|███       | 36/117 [00:02<00:04, 16.99it/s, loss=3.73, v_num=1, val_acc=0.653]
Epoch 9:  31%|███       | 36/117 [00:02<00:04, 16.79it/s, loss=3.71, v_num=1, val_acc=0.653]
Epoch 9:  32%|███▏      | 37/117 [00:02<00:04, 17.19it/s, loss=3.71, v_num=1, val_acc=0.653]
Epoch 9:  32%|███▏      | 37/117 [00:02<00:04, 16.99it/s, loss=3.74, v_num=1, val_acc=0.653]
Epoch 9:  32%|███▏      | 38/117 [00:02<00:04, 17.37it/s, loss=3.74, v_num=1, val_acc=0.653]
Epoch 9:  32%|███▏      | 38/117 [00:02<00:04, 17.17it/s, loss=3.75, v_num=1, val_acc=0.653]
Epoch 9:  33%|███▎      | 39/117 [00:02<00:04, 17.55it/s, loss=3.75, v_num=1, val_acc=0.653]
Epoch 9:  33%|███▎      | 39/117 [00:02<00:04, 17.35it/s, loss=3.74, v_num=1, val_acc=0.653]
Epoch 9:  34%|███▍      | 40/117 [00:02<00:04, 17.72it/s, loss=3.74, v_num=1, val_acc=0.653]
Epoch 9:  34%|███▍      | 40/117 [00:02<00:04, 17.53it/s, loss=3.77, v_num=1, val_acc=0.653]
Epoch 9:  35%|███▌      | 41/117 [00:02<00:04, 17.89it/s, loss=3.77, v_num=1, val_acc=0.653]
Epoch 9:  35%|███▌      | 41/117 [00:02<00:04, 17.70it/s, loss=3.73, v_num=1, val_acc=0.653]
Epoch 9:  36%|███▌      | 42/117 [00:02<00:04, 18.05it/s, loss=3.73, v_num=1, val_acc=0.653]
Epoch 9:  36%|███▌      | 42/117 [00:02<00:04, 17.86it/s, loss=3.57, v_num=1, val_acc=0.653]
Epoch 9:  37%|███▋      | 43/117 [00:02<00:04, 18.21it/s, loss=3.57, v_num=1, val_acc=0.653]
Epoch 9:  37%|███▋      | 43/117 [00:02<00:04, 18.02it/s, loss=3.38, v_num=1, val_acc=0.653]
Epoch 9:  38%|███▊      | 44/117 [00:02<00:03, 18.37it/s, loss=3.38, v_num=1, val_acc=0.653]
Epoch 9:  38%|███▊      | 44/117 [00:02<00:04, 18.18it/s, loss=3.25, v_num=1, val_acc=0.653]
Epoch 9:  38%|███▊      | 45/117 [00:02<00:03, 18.52it/s, loss=3.25, v_num=1, val_acc=0.653]
Epoch 9:  38%|███▊      | 45/117 [00:02<00:03, 18.33it/s, loss=3.25, v_num=1, val_acc=0.653]
Epoch 9:  39%|███▉      | 46/117 [00:02<00:03, 18.67it/s, loss=3.25, v_num=1, val_acc=0.653]
Epoch 9:  39%|███▉      | 46/117 [00:02<00:03, 18.48it/s, loss=3.14, v_num=1, val_acc=0.653]
Epoch 9:  40%|████      | 47/117 [00:02<00:03, 18.81it/s, loss=3.14, v_num=1, val_acc=0.653]
Epoch 9:  40%|████      | 47/117 [00:02<00:03, 18.62it/s, loss=3.04, v_num=1, val_acc=0.653]
Epoch 9:  41%|████      | 48/117 [00:02<00:03, 18.95it/s, loss=3.04, v_num=1, val_acc=0.653]
Epoch 9:  41%|████      | 48/117 [00:02<00:03, 18.76it/s, loss=2.95, v_num=1, val_acc=0.653]
Epoch 9:  42%|████▏     | 49/117 [00:02<00:03, 19.08it/s, loss=2.95, v_num=1, val_acc=0.653]
Epoch 9:  42%|████▏     | 49/117 [00:02<00:03, 18.89it/s, loss=2.9, v_num=1, val_acc=0.653]
Epoch 9:  43%|████▎     | 50/117 [00:02<00:03, 19.21it/s, loss=2.9, v_num=1, val_acc=0.653]
Epoch 9:  43%|████▎     | 50/117 [00:02<00:03, 19.02it/s, loss=2.83, v_num=1, val_acc=0.653]
Epoch 9:  44%|████▎     | 51/117 [00:02<00:03, 19.34it/s, loss=2.83, v_num=1, val_acc=0.653]
Epoch 9:  44%|████▎     | 51/117 [00:02<00:03, 19.15it/s, loss=2.8, v_num=1, val_acc=0.653]
Epoch 9:  44%|████▍     | 52/117 [00:02<00:03, 19.46it/s, loss=2.8, v_num=1, val_acc=0.653]
Epoch 9:  44%|████▍     | 52/117 [00:02<00:03, 19.28it/s, loss=2.76, v_num=1, val_acc=0.653]
Epoch 9:  45%|████▌     | 53/117 [00:02<00:03, 19.58it/s, loss=2.76, v_num=1, val_acc=0.653]
Epoch 9:  45%|████▌     | 53/117 [00:02<00:03, 19.40it/s, loss=2.68, v_num=1, val_acc=0.653]
Epoch 9:  46%|████▌     | 54/117 [00:02<00:03, 19.70it/s, loss=2.68, v_num=1, val_acc=0.653]
Epoch 9:  46%|████▌     | 54/117 [00:02<00:03, 19.52it/s, loss=2.64, v_num=1, val_acc=0.653]
Epoch 9:  47%|████▋     | 55/117 [00:02<00:03, 19.81it/s, loss=2.64, v_num=1, val_acc=0.653]
Epoch 9:  47%|████▋     | 55/117 [00:02<00:03, 19.64it/s, loss=2.68, v_num=1, val_acc=0.653]
Epoch 9:  48%|████▊     | 56/117 [00:02<00:03, 19.93it/s, loss=2.68, v_num=1, val_acc=0.653]
Epoch 9:  48%|████▊     | 56/117 [00:02<00:03, 19.75it/s, loss=2.75, v_num=1, val_acc=0.653]
Epoch 9:  49%|████▊     | 57/117 [00:02<00:02, 20.04it/s, loss=2.75, v_num=1, val_acc=0.653]
Epoch 9:  49%|████▊     | 57/117 [00:02<00:03, 19.86it/s, loss=2.77, v_num=1, val_acc=0.653]
Epoch 9:  50%|████▉     | 58/117 [00:02<00:02, 20.14it/s, loss=2.77, v_num=1, val_acc=0.653]
Epoch 9:  50%|████▉     | 58/117 [00:02<00:02, 19.97it/s, loss=2.84, v_num=1, val_acc=0.653]
Epoch 9:  50%|█████     | 59/117 [00:02<00:02, 20.25it/s, loss=2.84, v_num=1, val_acc=0.653]
Epoch 9:  50%|█████     | 59/117 [00:02<00:02, 20.08it/s, loss=2.95, v_num=1, val_acc=0.653]
Epoch 9:  51%|█████▏    | 60/117 [00:02<00:02, 20.35it/s, loss=2.95, v_num=1, val_acc=0.653]
Epoch 9:  51%|█████▏    | 60/117 [00:02<00:02, 20.18it/s, loss=2.98, v_num=1, val_acc=0.653]
Epoch 9:  52%|█████▏    | 61/117 [00:02<00:02, 20.45it/s, loss=2.98, v_num=1, val_acc=0.653]
Epoch 9:  52%|█████▏    | 61/117 [00:03<00:02, 20.28it/s, loss=3.01, v_num=1, val_acc=0.653]
Epoch 9:  53%|█████▎    | 62/117 [00:03<00:02, 20.55it/s, loss=3.01, v_num=1, val_acc=0.653]
Epoch 9:  53%|█████▎    | 62/117 [00:03<00:02, 20.38it/s, loss=3.02, v_num=1, val_acc=0.653]
Epoch 9:  54%|█████▍    | 63/117 [00:03<00:02, 20.64it/s, loss=3.02, v_num=1, val_acc=0.653]
Epoch 9:  54%|█████▍    | 63/117 [00:03<00:02, 20.47it/s, loss=3.13, v_num=1, val_acc=0.653]
Epoch 9:  55%|█████▍    | 64/117 [00:03<00:02, 20.74it/s, loss=3.13, v_num=1, val_acc=0.653]
Epoch 9:  55%|█████▍    | 64/117 [00:03<00:02, 20.57it/s, loss=3.15, v_num=1, val_acc=0.653]
Epoch 9:  56%|█████▌    | 65/117 [00:03<00:02, 20.82it/s, loss=3.15, v_num=1, val_acc=0.653]
Epoch 9:  56%|█████▌    | 65/117 [00:03<00:02, 20.66it/s, loss=3.12, v_num=1, val_acc=0.653]
Epoch 9:  56%|█████▋    | 66/117 [00:03<00:02, 20.91it/s, loss=3.12, v_num=1, val_acc=0.653]
Epoch 9:  56%|█████▋    | 66/117 [00:03<00:02, 20.75it/s, loss=3.13, v_num=1, val_acc=0.653]
Epoch 9:  57%|█████▋    | 67/117 [00:03<00:02, 21.00it/s, loss=3.13, v_num=1, val_acc=0.653]
Epoch 9:  57%|█████▋    | 67/117 [00:03<00:02, 20.83it/s, loss=3.15, v_num=1, val_acc=0.653]
Epoch 9:  58%|█████▊    | 68/117 [00:03<00:02, 21.09it/s, loss=3.15, v_num=1, val_acc=0.653]
Epoch 9:  58%|█████▊    | 68/117 [00:03<00:02, 20.92it/s, loss=3.29, v_num=1, val_acc=0.653]
Epoch 9:  59%|█████▉    | 69/117 [00:03<00:02, 21.17it/s, loss=3.29, v_num=1, val_acc=0.653]
Epoch 9:  59%|█████▉    | 69/117 [00:03<00:02, 21.01it/s, loss=3.38, v_num=1, val_acc=0.653]
Epoch 9:  60%|█████▉    | 70/117 [00:03<00:02, 21.25it/s, loss=3.38, v_num=1, val_acc=0.653]
Epoch 9:  60%|█████▉    | 70/117 [00:03<00:02, 21.09it/s, loss=3.5, v_num=1, val_acc=0.653]
Epoch 9:  61%|██████    | 71/117 [00:03<00:02, 21.33it/s, loss=3.5, v_num=1, val_acc=0.653]
Epoch 9:  61%|██████    | 71/117 [00:03<00:02, 21.17it/s, loss=3.52, v_num=1, val_acc=0.653]
Epoch 9:  62%|██████▏   | 72/117 [00:03<00:02, 21.38it/s, loss=3.52, v_num=1, val_acc=0.653]
Epoch 9:  62%|██████▏   | 72/117 [00:03<00:02, 21.23it/s, loss=3.52, v_num=1, val_acc=0.653]
Epoch 9:  62%|██████▏   | 73/117 [00:03<00:02, 21.47it/s, loss=3.52, v_num=1, val_acc=0.653]
Epoch 9:  62%|██████▏   | 73/117 [00:03<00:02, 21.31it/s, loss=3.51, v_num=1, val_acc=0.653]
Epoch 9:  63%|██████▎   | 74/117 [00:03<00:01, 21.54it/s, loss=3.51, v_num=1, val_acc=0.653]
Epoch 9:  63%|██████▎   | 74/117 [00:03<00:02, 21.38it/s, loss=3.49, v_num=1, val_acc=0.653]
Epoch 9:  64%|██████▍   | 75/117 [00:03<00:01, 21.61it/s, loss=3.49, v_num=1, val_acc=0.653]
Epoch 9:  64%|██████▍   | 75/117 [00:03<00:01, 21.46it/s, loss=3.55, v_num=1, val_acc=0.653]
Epoch 9:  65%|██████▍   | 76/117 [00:03<00:01, 21.69it/s, loss=3.55, v_num=1, val_acc=0.653]
Epoch 9:  65%|██████▍   | 76/117 [00:03<00:01, 21.53it/s, loss=3.58, v_num=1, val_acc=0.653]
Epoch 9:  66%|██████▌   | 77/117 [00:03<00:01, 21.72it/s, loss=3.58, v_num=1, val_acc=0.653]
Epoch 9:  66%|██████▌   | 77/117 [00:03<00:01, 21.59it/s, loss=3.59, v_num=1, val_acc=0.653]
Epoch 9:  67%|██████▋   | 78/117 [00:03<00:01, 21.80it/s, loss=3.59, v_num=1, val_acc=0.653]
Epoch 9:  67%|██████▋   | 78/117 [00:03<00:01, 21.65it/s, loss=3.62, v_num=1, val_acc=0.653]
Epoch 9:  68%|██████▊   | 79/117 [00:03<00:01, 21.87it/s, loss=3.62, v_num=1, val_acc=0.653]
Epoch 9:  68%|██████▊   | 79/117 [00:03<00:01, 21.72it/s, loss=3.5, v_num=1, val_acc=0.653]
Epoch 9:  68%|██████▊   | 80/117 [00:03<00:01, 21.94it/s, loss=3.5, v_num=1, val_acc=0.653]
Epoch 9:  68%|██████▊   | 80/117 [00:03<00:01, 21.78it/s, loss=3.51, v_num=1, val_acc=0.653]
Epoch 9:  69%|██████▉   | 81/117 [00:03<00:01, 21.98it/s, loss=3.51, v_num=1, val_acc=0.653]
Epoch 9:  69%|██████▉   | 81/117 [00:03<00:01, 21.84it/s, loss=3.53, v_num=1, val_acc=0.653]
Epoch 9:  70%|███████   | 82/117 [00:03<00:01, 22.03it/s, loss=3.53, v_num=1, val_acc=0.653]
Epoch 9:  70%|███████   | 82/117 [00:03<00:01, 21.89it/s, loss=3.59, v_num=1, val_acc=0.653]
Epoch 9:  71%|███████   | 83/117 [00:03<00:01, 22.10it/s, loss=3.59, v_num=1, val_acc=0.653]
Epoch 9:  71%|███████   | 83/117 [00:03<00:01, 21.95it/s, loss=3.53, v_num=1, val_acc=0.653]
Epoch 9:  72%|███████▏  | 84/117 [00:03<00:01, 22.15it/s, loss=3.53, v_num=1, val_acc=0.653]
Epoch 9:  72%|███████▏  | 84/117 [00:03<00:01, 22.01it/s, loss=3.57, v_num=1, val_acc=0.653]
Epoch 9:  73%|███████▎  | 85/117 [00:03<00:01, 22.22it/s, loss=3.57, v_num=1, val_acc=0.653]
Epoch 9:  73%|███████▎  | 85/117 [00:03<00:01, 22.07it/s, loss=3.53, v_num=1, val_acc=0.653]
Epoch 9:  74%|███████▎  | 86/117 [00:03<00:01, 22.28it/s, loss=3.53, v_num=1, val_acc=0.653]
Epoch 9:  74%|███████▎  | 86/117 [00:03<00:01, 22.14it/s, loss=3.54, v_num=1, val_acc=0.653]
Epoch 9:  74%|███████▍  | 87/117 [00:03<00:01, 22.34it/s, loss=3.54, v_num=1, val_acc=0.653]
Epoch 9:  74%|███████▍  | 87/117 [00:03<00:01, 22.20it/s, loss=3.54, v_num=1, val_acc=0.653]
Epoch 9:  75%|███████▌  | 88/117 [00:03<00:01, 22.40it/s, loss=3.54, v_num=1, val_acc=0.653]
Epoch 9:  75%|███████▌  | 88/117 [00:03<00:01, 22.26it/s, loss=3.33, v_num=1, val_acc=0.653]
Epoch 9:  76%|███████▌  | 89/117 [00:03<00:01, 22.46it/s, loss=3.33, v_num=1, val_acc=0.653]
Epoch 9:  76%|███████▌  | 89/117 [00:03<00:01, 22.32it/s, loss=3.22, v_num=1, val_acc=0.653]
Epoch 9:  77%|███████▋  | 90/117 [00:03<00:01, 22.52it/s, loss=3.22, v_num=1, val_acc=0.653]
Epoch 9:  77%|███████▋  | 90/117 [00:04<00:01, 22.38it/s, loss=3.13, v_num=1, val_acc=0.653]
Epoch 9:  78%|███████▊  | 91/117 [00:04<00:01, 22.58it/s, loss=3.13, v_num=1, val_acc=0.653]
Epoch 9:  78%|███████▊  | 91/117 [00:04<00:01, 22.44it/s, loss=3.19, v_num=1, val_acc=0.653]
Epoch 9:  79%|███████▊  | 92/117 [00:04<00:01, 22.63it/s, loss=3.19, v_num=1, val_acc=0.653]
Epoch 9:  79%|███████▊  | 92/117 [00:04<00:01, 22.49it/s, loss=3.19, v_num=1, val_acc=0.653]
Epoch 9:  79%|███████▉  | 93/117 [00:04<00:01, 22.69it/s, loss=3.19, v_num=1, val_acc=0.653]
Epoch 9:  79%|███████▉  | 93/117 [00:04<00:01, 22.55it/s, loss=3.22, v_num=1, val_acc=0.653]
Epoch 9:  80%|████████  | 94/117 [00:04<00:01, 22.74it/s, loss=3.22, v_num=1, val_acc=0.653]
Epoch 9:  80%|████████  | 94/117 [00:04<00:01, 22.60it/s, loss=3.17, v_num=1, val_acc=0.653]
Epoch 9:  81%|████████  | 95/117 [00:04<00:00, 22.79it/s, loss=3.17, v_num=1, val_acc=0.653]
Epoch 9:  81%|████████  | 95/117 [00:04<00:00, 22.66it/s, loss=3.14, v_num=1, val_acc=0.653]
Epoch 9:  82%|████████▏ | 96/117 [00:04<00:00, 22.85it/s, loss=3.14, v_num=1, val_acc=0.653]
Epoch 9:  82%|████████▏ | 96/117 [00:04<00:00, 22.71it/s, loss=3.09, v_num=1, val_acc=0.653]
Epoch 9:  83%|████████▎ | 97/117 [00:04<00:00, 22.90it/s, loss=3.09, v_num=1, val_acc=0.653]
Epoch 9:  83%|████████▎ | 97/117 [00:04<00:00, 22.76it/s, loss=3.08, v_num=1, val_acc=0.653]

Validation: 0it [00:00, ?it/s]

Validation:   0%|          | 0/20 [00:00<?, ?it/s]

Validation DataLoader 0:   0%|          | 0/20 [00:00<?, ?it/s]

Validation DataLoader 0:   5%|▌         | 1/20 [00:00<00:00, 150.63it/s]
Epoch 9:  84%|████████▍ | 98/117 [00:05<00:00, 19.22it/s, loss=3.08, v_num=1, val_acc=0.653]

Validation DataLoader 0:  10%|█         | 2/20 [00:00<00:00, 54.43it/s]
Epoch 9:  85%|████████▍ | 99/117 [00:05<00:00, 19.30it/s, loss=3.08, v_num=1, val_acc=0.653]

Validation DataLoader 0:  15%|█▌        | 3/20 [00:00<00:00, 44.04it/s]
Epoch 9:  85%|████████▌ | 100/117 [00:05<00:00, 19.38it/s, loss=3.08, v_num=1, val_acc=0.653]

Validation DataLoader 0:  20%|██        | 4/20 [00:00<00:00, 40.12it/s]
Epoch 9:  86%|████████▋ | 101/117 [00:05<00:00, 19.45it/s, loss=3.08, v_num=1, val_acc=0.653]

Validation DataLoader 0:  25%|██▌       | 5/20 [00:00<00:00, 38.04it/s]
Epoch 9:  87%|████████▋ | 102/117 [00:05<00:00, 19.53it/s, loss=3.08, v_num=1, val_acc=0.653]

Validation DataLoader 0:  30%|███       | 6/20 [00:00<00:00, 36.83it/s]
Epoch 9:  88%|████████▊ | 103/117 [00:05<00:00, 19.60it/s, loss=3.08, v_num=1, val_acc=0.653]

Validation DataLoader 0:  35%|███▌      | 7/20 [00:00<00:00, 35.99it/s]
Epoch 9:  89%|████████▉ | 104/117 [00:05<00:00, 19.67it/s, loss=3.08, v_num=1, val_acc=0.653]

Validation DataLoader 0:  40%|████      | 8/20 [00:00<00:00, 35.37it/s]
Epoch 9:  90%|████████▉ | 105/117 [00:05<00:00, 19.74it/s, loss=3.08, v_num=1, val_acc=0.653]

Validation DataLoader 0:  45%|████▌     | 9/20 [00:00<00:00, 34.88it/s]
Epoch 9:  91%|█████████ | 106/117 [00:05<00:00, 19.81it/s, loss=3.08, v_num=1, val_acc=0.653]

Validation DataLoader 0:  50%|█████     | 10/20 [00:00<00:00, 34.56it/s]
Epoch 9:  91%|█████████▏| 107/117 [00:05<00:00, 19.88it/s, loss=3.08, v_num=1, val_acc=0.653]

Validation DataLoader 0:  55%|█████▌    | 11/20 [00:00<00:00, 34.27it/s]
Epoch 9:  92%|█████████▏| 108/117 [00:05<00:00, 19.95it/s, loss=3.08, v_num=1, val_acc=0.653]

Validation DataLoader 0:  60%|██████    | 12/20 [00:00<00:00, 34.03it/s]
Epoch 9:  93%|█████████▎| 109/117 [00:05<00:00, 20.02it/s, loss=3.08, v_num=1, val_acc=0.653]

Validation DataLoader 0:  65%|██████▌   | 13/20 [00:00<00:00, 33.84it/s]
Epoch 9:  94%|█████████▍| 110/117 [00:05<00:00, 20.09it/s, loss=3.08, v_num=1, val_acc=0.653]

Validation DataLoader 0:  70%|███████   | 14/20 [00:00<00:00, 33.67it/s]
Epoch 9:  95%|█████████▍| 111/117 [00:05<00:00, 20.15it/s, loss=3.08, v_num=1, val_acc=0.653]

Validation DataLoader 0:  75%|███████▌  | 15/20 [00:00<00:00, 33.51it/s]
Epoch 9:  96%|█████████▌| 112/117 [00:05<00:00, 20.22it/s, loss=3.08, v_num=1, val_acc=0.653]

Validation DataLoader 0:  80%|████████  | 16/20 [00:00<00:00, 33.38it/s]
Epoch 9:  97%|█████████▋| 113/117 [00:05<00:00, 20.28it/s, loss=3.08, v_num=1, val_acc=0.653]

Validation DataLoader 0:  85%|████████▌ | 17/20 [00:00<00:00, 33.27it/s]
Epoch 9:  97%|█████████▋| 114/117 [00:05<00:00, 20.34it/s, loss=3.08, v_num=1, val_acc=0.653]

Validation DataLoader 0:  90%|█████████ | 18/20 [00:00<00:00, 33.18it/s]
Epoch 9:  98%|█████████▊| 115/117 [00:05<00:00, 20.41it/s, loss=3.08, v_num=1, val_acc=0.653]

Validation DataLoader 0:  95%|█████████▌| 19/20 [00:00<00:00, 33.10it/s]
Epoch 9:  99%|█████████▉| 116/117 [00:05<00:00, 20.47it/s, loss=3.08, v_num=1, val_acc=0.653]

Validation DataLoader 0: 100%|██████████| 20/20 [00:00<00:00, 33.09it/s]
Epoch 9: 100%|██████████| 117/117 [00:05<00:00, 20.54it/s, loss=3.08, v_num=1, val_acc=0.653]
Epoch 9: 100%|██████████| 117/117 [00:05<00:00, 20.47it/s, loss=3.08, v_num=1, val_acc=0.667]


Epoch 9: 100%|██████████| 117/117 [00:05<00:00, 20.46it/s, loss=3.08, v_num=1, val_acc=0.667]
Epoch 9:   0%|          | 0/117 [00:00<?, ?it/s, loss=3.08, v_num=1, val_acc=0.667]
Epoch 10:   0%|          | 0/117 [00:00<?, ?it/s, loss=3.08, v_num=1, val_acc=0.667]
Epoch 10:   1%|          | 1/117 [00:00<01:46,  1.09it/s, loss=3.08, v_num=1, val_acc=0.667]
Epoch 10:   1%|          | 1/117 [00:00<01:49,  1.06it/s, loss=2.96, v_num=1, val_acc=0.667]
Epoch 10:   2%|▏         | 2/117 [00:00<00:54,  2.10it/s, loss=2.96, v_num=1, val_acc=0.667]
Epoch 10:   2%|▏         | 2/117 [00:00<00:56,  2.05it/s, loss=2.92, v_num=1, val_acc=0.667]
Epoch 10:   3%|▎         | 3/117 [00:00<00:37,  3.04it/s, loss=2.92, v_num=1, val_acc=0.667]
Epoch 10:   3%|▎         | 3/117 [00:01<00:38,  2.97it/s, loss=2.8, v_num=1, val_acc=0.667]
Epoch 10:   3%|▎         | 4/117 [00:01<00:28,  3.90it/s, loss=2.8, v_num=1, val_acc=0.667]
Epoch 10:   3%|▎         | 4/117 [00:01<00:29,  3.81it/s, loss=2.7, v_num=1, val_acc=0.667]
Epoch 10:   4%|▍         | 5/117 [00:01<00:23,  4.73it/s, loss=2.7, v_num=1, val_acc=0.667]
Epoch 10:   4%|▍         | 5/117 [00:01<00:24,  4.62it/s, loss=2.58, v_num=1, val_acc=0.667]
Epoch 10:   5%|▌         | 6/117 [00:01<00:20,  5.50it/s, loss=2.58, v_num=1, val_acc=0.667]
Epoch 10:   5%|▌         | 6/117 [00:01<00:20,  5.37it/s, loss=2.56, v_num=1, val_acc=0.667]
Epoch 10:   6%|▌         | 7/117 [00:01<00:17,  6.23it/s, loss=2.56, v_num=1, val_acc=0.667]
Epoch 10:   6%|▌         | 7/117 [00:01<00:18,  6.09it/s, loss=2.53, v_num=1, val_acc=0.667]
Epoch 10:   7%|▋         | 8/117 [00:01<00:15,  6.90it/s, loss=2.53, v_num=1, val_acc=0.667]
Epoch 10:   7%|▋         | 8/117 [00:01<00:16,  6.75it/s, loss=2.62, v_num=1, val_acc=0.667]
Epoch 10:   8%|▊         | 9/117 [00:01<00:14,  7.52it/s, loss=2.62, v_num=1, val_acc=0.667]
Epoch 10:   8%|▊         | 9/117 [00:01<00:14,  7.36it/s, loss=2.62, v_num=1, val_acc=0.667]
Epoch 10:   9%|▊         | 10/117 [00:01<00:13,  8.12it/s, loss=2.62, v_num=1, val_acc=0.667]
Epoch 10:   9%|▊         | 10/117 [00:01<00:13,  7.96it/s, loss=2.62, v_num=1, val_acc=0.667]
Epoch 10:   9%|▉         | 11/117 [00:01<00:12,  8.69it/s, loss=2.62, v_num=1, val_acc=0.667]
Epoch 10:   9%|▉         | 11/117 [00:01<00:12,  8.52it/s, loss=2.71, v_num=1, val_acc=0.667]
Epoch 10:  10%|█         | 12/117 [00:01<00:11,  9.23it/s, loss=2.71, v_num=1, val_acc=0.667]
Epoch 10:  10%|█         | 12/117 [00:01<00:11,  9.05it/s, loss=2.78, v_num=1, val_acc=0.667]
Epoch 10:  11%|█         | 13/117 [00:01<00:10,  9.75it/s, loss=2.78, v_num=1, val_acc=0.667]
Epoch 10:  11%|█         | 13/117 [00:01<00:10,  9.57it/s, loss=2.79, v_num=1, val_acc=0.667]
Epoch 10:  12%|█▏        | 14/117 [00:01<00:10, 10.24it/s, loss=2.79, v_num=1, val_acc=0.667]
Epoch 10:  12%|█▏        | 14/117 [00:01<00:10, 10.05it/s, loss=2.65, v_num=1, val_acc=0.667]
Epoch 10:  13%|█▎        | 15/117 [00:01<00:09, 10.71it/s, loss=2.65, v_num=1, val_acc=0.667]
Epoch 10:  13%|█▎        | 15/117 [00:01<00:09, 10.52it/s, loss=2.67, v_num=1, val_acc=0.667]
Epoch 10:  14%|█▎        | 16/117 [00:01<00:09, 11.16it/s, loss=2.67, v_num=1, val_acc=0.667]
Epoch 10:  14%|█▎        | 16/117 [00:01<00:09, 10.96it/s, loss=2.65, v_num=1, val_acc=0.667]
Epoch 10:  15%|█▍        | 17/117 [00:01<00:08, 11.56it/s, loss=2.65, v_num=1, val_acc=0.667]
Epoch 10:  15%|█▍        | 17/117 [00:01<00:08, 11.37it/s, loss=2.68, v_num=1, val_acc=0.667]
Epoch 10:  15%|█▌        | 18/117 [00:01<00:08, 11.97it/s, loss=2.68, v_num=1, val_acc=0.667]
Epoch 10:  15%|█▌        | 18/117 [00:01<00:08, 11.77it/s, loss=2.67, v_num=1, val_acc=0.667]
Epoch 10:  16%|█▌        | 19/117 [00:01<00:07, 12.35it/s, loss=2.67, v_num=1, val_acc=0.667]
Epoch 10:  16%|█▌        | 19/117 [00:01<00:08, 12.15it/s, loss=2.69, v_num=1, val_acc=0.667]
Epoch 10:  17%|█▋        | 20/117 [00:01<00:07, 12.72it/s, loss=2.69, v_num=1, val_acc=0.667]
Epoch 10:  17%|█▋        | 20/117 [00:01<00:07, 12.52it/s, loss=2.67, v_num=1, val_acc=0.667]
Epoch 10:  18%|█▊        | 21/117 [00:01<00:07, 13.08it/s, loss=2.67, v_num=1, val_acc=0.667]
Epoch 10:  18%|█▊        | 21/117 [00:01<00:07, 12.87it/s, loss=2.66, v_num=1, val_acc=0.667]
Epoch 10:  19%|█▉        | 22/117 [00:01<00:07, 13.41it/s, loss=2.66, v_num=1, val_acc=0.667]
Epoch 10:  19%|█▉        | 22/117 [00:01<00:07, 13.21it/s, loss=2.65, v_num=1, val_acc=0.667]
Epoch 10:  20%|█▉        | 23/117 [00:01<00:06, 13.73it/s, loss=2.65, v_num=1, val_acc=0.667]
Epoch 10:  20%|█▉        | 23/117 [00:01<00:06, 13.53it/s, loss=2.62, v_num=1, val_acc=0.667]
Epoch 10:  21%|██        | 24/117 [00:01<00:06, 13.96it/s, loss=2.62, v_num=1, val_acc=0.667]
Epoch 10:  21%|██        | 24/117 [00:01<00:06, 13.78it/s, loss=2.65, v_num=1, val_acc=0.667]
Epoch 10:  21%|██▏       | 25/117 [00:01<00:06, 14.27it/s, loss=2.65, v_num=1, val_acc=0.667]
Epoch 10:  21%|██▏       | 25/117 [00:01<00:06, 14.07it/s, loss=2.71, v_num=1, val_acc=0.667]
Epoch 10:  22%|██▏       | 26/117 [00:01<00:06, 14.55it/s, loss=2.71, v_num=1, val_acc=0.667]
Epoch 10:  22%|██▏       | 26/117 [00:01<00:06, 14.35it/s, loss=2.77, v_num=1, val_acc=0.667]
Epoch 10:  23%|██▎       | 27/117 [00:01<00:06, 14.82it/s, loss=2.77, v_num=1, val_acc=0.667]
Epoch 10:  23%|██▎       | 27/117 [00:01<00:06, 14.62it/s, loss=2.9, v_num=1, val_acc=0.667]
Epoch 10:  24%|██▍       | 28/117 [00:01<00:05, 15.09it/s, loss=2.9, v_num=1, val_acc=0.667]
Epoch 10:  24%|██▍       | 28/117 [00:01<00:05, 14.89it/s, loss=2.89, v_num=1, val_acc=0.667]
Epoch 10:  25%|██▍       | 29/117 [00:01<00:05, 15.34it/s, loss=2.89, v_num=1, val_acc=0.667]
Epoch 10:  25%|██▍       | 29/117 [00:01<00:05, 15.14it/s, loss=2.96, v_num=1, val_acc=0.667]
Epoch 10:  26%|██▌       | 30/117 [00:01<00:05, 15.58it/s, loss=2.96, v_num=1, val_acc=0.667]
Epoch 10:  26%|██▌       | 30/117 [00:01<00:05, 15.38it/s, loss=3.02, v_num=1, val_acc=0.667]
Epoch 10:  26%|██▋       | 31/117 [00:01<00:05, 15.80it/s, loss=3.02, v_num=1, val_acc=0.667]
Epoch 10:  26%|██▋       | 31/117 [00:01<00:05, 15.60it/s, loss=3.16, v_num=1, val_acc=0.667]
Epoch 10:  27%|██▋       | 32/117 [00:01<00:05, 16.02it/s, loss=3.16, v_num=1, val_acc=0.667]
Epoch 10:  27%|██▋       | 32/117 [00:02<00:05, 15.82it/s, loss=3.19, v_num=1, val_acc=0.667]
Epoch 10:  28%|██▊       | 33/117 [00:02<00:05, 16.24it/s, loss=3.19, v_num=1, val_acc=0.667]
Epoch 10:  28%|██▊       | 33/117 [00:02<00:05, 16.04it/s, loss=3.17, v_num=1, val_acc=0.667]
Epoch 10:  29%|██▉       | 34/117 [00:02<00:05, 16.45it/s, loss=3.17, v_num=1, val_acc=0.667]
Epoch 10:  29%|██▉       | 34/117 [00:02<00:05, 16.25it/s, loss=3.23, v_num=1, val_acc=0.667]
Epoch 10:  30%|██▉       | 35/117 [00:02<00:04, 16.64it/s, loss=3.23, v_num=1, val_acc=0.667]
Epoch 10:  30%|██▉       | 35/117 [00:02<00:04, 16.44it/s, loss=3.24, v_num=1, val_acc=0.667]
Epoch 10:  31%|███       | 36/117 [00:02<00:04, 16.84it/s, loss=3.24, v_num=1, val_acc=0.667]
Epoch 10:  31%|███       | 36/117 [00:02<00:04, 16.64it/s, loss=3.28, v_num=1, val_acc=0.667]
Epoch 10:  32%|███▏      | 37/117 [00:02<00:04, 17.03it/s, loss=3.28, v_num=1, val_acc=0.667]
Epoch 10:  32%|███▏      | 37/117 [00:02<00:04, 16.84it/s, loss=3.38, v_num=1, val_acc=0.667]
Epoch 10:  32%|███▏      | 38/117 [00:02<00:04, 17.22it/s, loss=3.38, v_num=1, val_acc=0.667]
Epoch 10:  32%|███▏      | 38/117 [00:02<00:04, 17.03it/s, loss=3.51, v_num=1, val_acc=0.667]
Epoch 10:  33%|███▎      | 39/117 [00:02<00:04, 17.40it/s, loss=3.51, v_num=1, val_acc=0.667]
Epoch 10:  33%|███▎      | 39/117 [00:02<00:04, 17.21it/s, loss=3.57, v_num=1, val_acc=0.667]
Epoch 10:  34%|███▍      | 40/117 [00:02<00:04, 17.57it/s, loss=3.57, v_num=1, val_acc=0.667]
Epoch 10:  34%|███▍      | 40/117 [00:02<00:04, 17.38it/s, loss=3.73, v_num=1, val_acc=0.667]
Epoch 10:  35%|███▌      | 41/117 [00:02<00:04, 17.74it/s, loss=3.73, v_num=1, val_acc=0.667]
Epoch 10:  35%|███▌      | 41/117 [00:02<00:04, 17.55it/s, loss=3.86, v_num=1, val_acc=0.667]
Epoch 10:  36%|███▌      | 42/117 [00:02<00:04, 17.86it/s, loss=3.86, v_num=1, val_acc=0.667]
Epoch 10:  36%|███▌      | 42/117 [00:02<00:04, 17.68it/s, loss=3.89, v_num=1, val_acc=0.667]
Epoch 10:  37%|███▋      | 43/117 [00:02<00:04, 18.03it/s, loss=3.89, v_num=1, val_acc=0.667]
Epoch 10:  37%|███▋      | 43/117 [00:02<00:04, 17.85it/s, loss=3.92, v_num=1, val_acc=0.667]
Epoch 10:  38%|███▊      | 44/117 [00:02<00:04, 18.19it/s, loss=3.92, v_num=1, val_acc=0.667]
Epoch 10:  38%|███▊      | 44/117 [00:02<00:04, 18.00it/s, loss=3.92, v_num=1, val_acc=0.667]
Epoch 10:  38%|███▊      | 45/117 [00:02<00:03, 18.35it/s, loss=3.92, v_num=1, val_acc=0.667]
Epoch 10:  38%|███▊      | 45/117 [00:02<00:03, 18.16it/s, loss=3.9, v_num=1, val_acc=0.667]
Epoch 10:  39%|███▉      | 46/117 [00:02<00:03, 18.49it/s, loss=3.9, v_num=1, val_acc=0.667]
Epoch 10:  39%|███▉      | 46/117 [00:02<00:03, 18.31it/s, loss=3.9, v_num=1, val_acc=0.667]
Epoch 10:  40%|████      | 47/117 [00:02<00:03, 18.64it/s, loss=3.9, v_num=1, val_acc=0.667]
Epoch 10:  40%|████      | 47/117 [00:02<00:03, 18.45it/s, loss=3.79, v_num=1, val_acc=0.667]
Epoch 10:  41%|████      | 48/117 [00:02<00:03, 18.78it/s, loss=3.79, v_num=1, val_acc=0.667]
Epoch 10:  41%|████      | 48/117 [00:02<00:03, 18.59it/s, loss=3.74, v_num=1, val_acc=0.667]
Epoch 10:  42%|████▏     | 49/117 [00:02<00:03, 18.91it/s, loss=3.74, v_num=1, val_acc=0.667]
Epoch 10:  42%|████▏     | 49/117 [00:02<00:03, 18.73it/s, loss=3.72, v_num=1, val_acc=0.667]
Epoch 10:  43%|████▎     | 50/117 [00:02<00:03, 19.05it/s, loss=3.72, v_num=1, val_acc=0.667]
Epoch 10:  43%|████▎     | 50/117 [00:02<00:03, 18.87it/s, loss=3.78, v_num=1, val_acc=0.667]
Epoch 10:  44%|████▎     | 51/117 [00:02<00:03, 19.18it/s, loss=3.78, v_num=1, val_acc=0.667]
Epoch 10:  44%|████▎     | 51/117 [00:02<00:03, 19.00it/s, loss=3.69, v_num=1, val_acc=0.667]
Epoch 10:  44%|████▍     | 52/117 [00:02<00:03, 19.28it/s, loss=3.69, v_num=1, val_acc=0.667]
Epoch 10:  44%|████▍     | 52/117 [00:02<00:03, 19.11it/s, loss=3.67, v_num=1, val_acc=0.667]
Epoch 10:  45%|████▌     | 53/117 [00:02<00:03, 19.41it/s, loss=3.67, v_num=1, val_acc=0.667]
Epoch 10:  45%|████▌     | 53/117 [00:02<00:03, 19.23it/s, loss=3.75, v_num=1, val_acc=0.667]
Epoch 10:  46%|████▌     | 54/117 [00:02<00:03, 19.53it/s, loss=3.75, v_num=1, val_acc=0.667]
Epoch 10:  46%|████▌     | 54/117 [00:02<00:03, 19.35it/s, loss=3.72, v_num=1, val_acc=0.667]
Epoch 10:  47%|████▋     | 55/117 [00:02<00:03, 19.65it/s, loss=3.72, v_num=1, val_acc=0.667]
Epoch 10:  47%|████▋     | 55/117 [00:02<00:03, 19.47it/s, loss=3.69, v_num=1, val_acc=0.667]
Epoch 10:  48%|████▊     | 56/117 [00:02<00:03, 19.76it/s, loss=3.69, v_num=1, val_acc=0.667]
Epoch 10:  48%|████▊     | 56/117 [00:02<00:03, 19.58it/s, loss=3.62, v_num=1, val_acc=0.667]
Epoch 10:  49%|████▊     | 57/117 [00:02<00:03, 19.87it/s, loss=3.62, v_num=1, val_acc=0.667]
Epoch 10:  49%|████▊     | 57/117 [00:02<00:03, 19.70it/s, loss=3.51, v_num=1, val_acc=0.667]
Epoch 10:  50%|████▉     | 58/117 [00:02<00:02, 19.98it/s, loss=3.51, v_num=1, val_acc=0.667]
Epoch 10:  50%|████▉     | 58/117 [00:02<00:02, 19.81it/s, loss=3.39, v_num=1, val_acc=0.667]
Epoch 10:  50%|█████     | 59/117 [00:02<00:02, 20.09it/s, loss=3.39, v_num=1, val_acc=0.667]
Epoch 10:  50%|█████     | 59/117 [00:02<00:02, 19.92it/s, loss=3.33, v_num=1, val_acc=0.667]
Epoch 10:  51%|█████▏    | 60/117 [00:02<00:02, 20.19it/s, loss=3.33, v_num=1, val_acc=0.667]
Epoch 10:  51%|█████▏    | 60/117 [00:02<00:02, 20.02it/s, loss=3.21, v_num=1, val_acc=0.667]
Epoch 10:  52%|█████▏    | 61/117 [00:03<00:02, 20.29it/s, loss=3.21, v_num=1, val_acc=0.667]
Epoch 10:  52%|█████▏    | 61/117 [00:03<00:02, 20.13it/s, loss=3.16, v_num=1, val_acc=0.667]
Epoch 10:  53%|█████▎    | 62/117 [00:03<00:02, 20.40it/s, loss=3.16, v_num=1, val_acc=0.667]
Epoch 10:  53%|█████▎    | 62/117 [00:03<00:02, 20.23it/s, loss=3.14, v_num=1, val_acc=0.667]
Epoch 10:  54%|█████▍    | 63/117 [00:03<00:02, 20.48it/s, loss=3.14, v_num=1, val_acc=0.667]
Epoch 10:  54%|█████▍    | 63/117 [00:03<00:02, 20.31it/s, loss=3.19, v_num=1, val_acc=0.667]
Epoch 10:  55%|█████▍    | 64/117 [00:03<00:02, 20.58it/s, loss=3.19, v_num=1, val_acc=0.667]
Epoch 10:  55%|█████▍    | 64/117 [00:03<00:02, 20.41it/s, loss=3.26, v_num=1, val_acc=0.667]
Epoch 10:  56%|█████▌    | 65/117 [00:03<00:02, 20.67it/s, loss=3.26, v_num=1, val_acc=0.667]
Epoch 10:  56%|█████▌    | 65/117 [00:03<00:02, 20.50it/s, loss=3.29, v_num=1, val_acc=0.667]
Epoch 10:  56%|█████▋    | 66/117 [00:03<00:02, 20.76it/s, loss=3.29, v_num=1, val_acc=0.667]
Epoch 10:  56%|█████▋    | 66/117 [00:03<00:02, 20.60it/s, loss=3.18, v_num=1, val_acc=0.667]
Epoch 10:  57%|█████▋    | 67/117 [00:03<00:02, 20.85it/s, loss=3.18, v_num=1, val_acc=0.667]
Epoch 10:  57%|█████▋    | 67/117 [00:03<00:02, 20.69it/s, loss=3.12, v_num=1, val_acc=0.667]
Epoch 10:  58%|█████▊    | 68/117 [00:03<00:02, 20.94it/s, loss=3.12, v_num=1, val_acc=0.667]
Epoch 10:  58%|█████▊    | 68/117 [00:03<00:02, 20.77it/s, loss=3.09, v_num=1, val_acc=0.667]
Epoch 10:  59%|█████▉    | 69/117 [00:03<00:02, 21.02it/s, loss=3.09, v_num=1, val_acc=0.667]
Epoch 10:  59%|█████▉    | 69/117 [00:03<00:02, 20.86it/s, loss=3.03, v_num=1, val_acc=0.667]
Epoch 10:  60%|█████▉    | 70/117 [00:03<00:02, 21.11it/s, loss=3.03, v_num=1, val_acc=0.667]
Epoch 10:  60%|█████▉    | 70/117 [00:03<00:02, 20.95it/s, loss=2.88, v_num=1, val_acc=0.667]
Epoch 10:  61%|██████    | 71/117 [00:03<00:02, 21.19it/s, loss=2.88, v_num=1, val_acc=0.667]
Epoch 10:  61%|██████    | 71/117 [00:03<00:02, 21.03it/s, loss=2.8, v_num=1, val_acc=0.667]
Epoch 10:  62%|██████▏   | 72/117 [00:03<00:02, 21.27it/s, loss=2.8, v_num=1, val_acc=0.667]
Epoch 10:  62%|██████▏   | 72/117 [00:03<00:02, 21.11it/s, loss=2.69, v_num=1, val_acc=0.667]
Epoch 10:  62%|██████▏   | 73/117 [00:03<00:02, 21.35it/s, loss=2.69, v_num=1, val_acc=0.667]
Epoch 10:  62%|██████▏   | 73/117 [00:03<00:02, 21.19it/s, loss=2.63, v_num=1, val_acc=0.667]
Epoch 10:  63%|██████▎   | 74/117 [00:03<00:02, 21.42it/s, loss=2.63, v_num=1, val_acc=0.667]
Epoch 10:  63%|██████▎   | 74/117 [00:03<00:02, 21.27it/s, loss=2.71, v_num=1, val_acc=0.667]
Epoch 10:  64%|██████▍   | 75/117 [00:03<00:01, 21.50it/s, loss=2.71, v_num=1, val_acc=0.667]
Epoch 10:  64%|██████▍   | 75/117 [00:03<00:01, 21.34it/s, loss=2.79, v_num=1, val_acc=0.667]
Epoch 10:  65%|██████▍   | 76/117 [00:03<00:01, 21.57it/s, loss=2.79, v_num=1, val_acc=0.667]
Epoch 10:  65%|██████▍   | 76/117 [00:03<00:01, 21.42it/s, loss=2.86, v_num=1, val_acc=0.667]
Epoch 10:  66%|██████▌   | 77/117 [00:03<00:01, 21.65it/s, loss=2.86, v_num=1, val_acc=0.667]
Epoch 10:  66%|██████▌   | 77/117 [00:03<00:01, 21.49it/s, loss=2.99, v_num=1, val_acc=0.667]
Epoch 10:  67%|██████▋   | 78/117 [00:03<00:01, 21.72it/s, loss=2.99, v_num=1, val_acc=0.667]
Epoch 10:  67%|██████▋   | 78/117 [00:03<00:01, 21.57it/s, loss=3.1, v_num=1, val_acc=0.667]
Epoch 10:  68%|██████▊   | 79/117 [00:03<00:01, 21.79it/s, loss=3.1, v_num=1, val_acc=0.667]
Epoch 10:  68%|██████▊   | 79/117 [00:03<00:01, 21.64it/s, loss=3.11, v_num=1, val_acc=0.667]
Epoch 10:  68%|██████▊   | 80/117 [00:03<00:01, 21.86it/s, loss=3.11, v_num=1, val_acc=0.667]
Epoch 10:  68%|██████▊   | 80/117 [00:03<00:01, 21.71it/s, loss=3.08, v_num=1, val_acc=0.667]
Epoch 10:  69%|██████▉   | 81/117 [00:03<00:01, 21.92it/s, loss=3.08, v_num=1, val_acc=0.667]
Epoch 10:  69%|██████▉   | 81/117 [00:03<00:01, 21.77it/s, loss=3.03, v_num=1, val_acc=0.667]
Epoch 10:  70%|███████   | 82/117 [00:03<00:01, 21.97it/s, loss=3.03, v_num=1, val_acc=0.667]
Epoch 10:  70%|███████   | 82/117 [00:03<00:01, 21.82it/s, loss=3.04, v_num=1, val_acc=0.667]
Epoch 10:  71%|███████   | 83/117 [00:03<00:01, 22.04it/s, loss=3.04, v_num=1, val_acc=0.667]
Epoch 10:  71%|███████   | 83/117 [00:03<00:01, 21.89it/s, loss=3.08, v_num=1, val_acc=0.667]
Epoch 10:  72%|███████▏  | 84/117 [00:03<00:01, 22.10it/s, loss=3.08, v_num=1, val_acc=0.667]
Epoch 10:  72%|███████▏  | 84/117 [00:03<00:01, 21.96it/s, loss=3.13, v_num=1, val_acc=0.667]
Epoch 10:  73%|███████▎  | 85/117 [00:03<00:01, 22.17it/s, loss=3.13, v_num=1, val_acc=0.667]
Epoch 10:  73%|███████▎  | 85/117 [00:03<00:01, 22.02it/s, loss=3.27, v_num=1, val_acc=0.667]
Epoch 10:  74%|███████▎  | 86/117 [00:03<00:01, 22.23it/s, loss=3.27, v_num=1, val_acc=0.667]
Epoch 10:  74%|███████▎  | 86/117 [00:03<00:01, 22.08it/s, loss=3.43, v_num=1, val_acc=0.667]
Epoch 10:  74%|███████▍  | 87/117 [00:03<00:01, 22.29it/s, loss=3.43, v_num=1, val_acc=0.667]
Epoch 10:  74%|███████▍  | 87/117 [00:03<00:01, 22.15it/s, loss=3.53, v_num=1, val_acc=0.667]
Epoch 10:  75%|███████▌  | 88/117 [00:03<00:01, 22.35it/s, loss=3.53, v_num=1, val_acc=0.667]
Epoch 10:  75%|███████▌  | 88/117 [00:03<00:01, 22.21it/s, loss=3.55, v_num=1, val_acc=0.667]
Epoch 10:  76%|███████▌  | 89/117 [00:03<00:01, 22.41it/s, loss=3.55, v_num=1, val_acc=0.667]
Epoch 10:  76%|███████▌  | 89/117 [00:03<00:01, 22.27it/s, loss=3.57, v_num=1, val_acc=0.667]
Epoch 10:  77%|███████▋  | 90/117 [00:04<00:01, 22.47it/s, loss=3.57, v_num=1, val_acc=0.667]
Epoch 10:  77%|███████▋  | 90/117 [00:04<00:01, 22.33it/s, loss=3.58, v_num=1, val_acc=0.667]
Epoch 10:  78%|███████▊  | 91/117 [00:04<00:01, 22.53it/s, loss=3.58, v_num=1, val_acc=0.667]
Epoch 10:  78%|███████▊  | 91/117 [00:04<00:01, 22.39it/s, loss=3.63, v_num=1, val_acc=0.667]
Epoch 10:  79%|███████▊  | 92/117 [00:04<00:01, 22.58it/s, loss=3.63, v_num=1, val_acc=0.667]
Epoch 10:  79%|███████▊  | 92/117 [00:04<00:01, 22.44it/s, loss=3.66, v_num=1, val_acc=0.667]
Epoch 10:  79%|███████▉  | 93/117 [00:04<00:01, 22.64it/s, loss=3.66, v_num=1, val_acc=0.667]
Epoch 10:  79%|███████▉  | 93/117 [00:04<00:01, 22.50it/s, loss=3.66, v_num=1, val_acc=0.667]
Epoch 10:  80%|████████  | 94/117 [00:04<00:01, 22.69it/s, loss=3.66, v_num=1, val_acc=0.667]
Epoch 10:  80%|████████  | 94/117 [00:04<00:01, 22.56it/s, loss=3.62, v_num=1, val_acc=0.667]
Epoch 10:  81%|████████  | 95/117 [00:04<00:00, 22.74it/s, loss=3.62, v_num=1, val_acc=0.667]
Epoch 10:  81%|████████  | 95/117 [00:04<00:00, 22.61it/s, loss=3.62, v_num=1, val_acc=0.667]
Epoch 10:  82%|████████▏ | 96/117 [00:04<00:00, 22.80it/s, loss=3.62, v_num=1, val_acc=0.667]
Epoch 10:  82%|████████▏ | 96/117 [00:04<00:00, 22.66it/s, loss=3.6, v_num=1, val_acc=0.667]
Epoch 10:  83%|████████▎ | 97/117 [00:04<00:00, 22.85it/s, loss=3.6, v_num=1, val_acc=0.667]
Epoch 10:  83%|████████▎ | 97/117 [00:04<00:00, 22.71it/s, loss=3.5, v_num=1, val_acc=0.667]

Validation: 0it [00:00, ?it/s]

Validation:   0%|          | 0/20 [00:00<?, ?it/s]

Validation DataLoader 0:   0%|          | 0/20 [00:00<?, ?it/s]

Validation DataLoader 0:   5%|▌         | 1/20 [00:00<00:00, 180.53it/s]
Epoch 10:  84%|████████▍ | 98/117 [00:05<00:00, 19.24it/s, loss=3.5, v_num=1, val_acc=0.667]

Validation DataLoader 0:  10%|█         | 2/20 [00:00<00:00, 55.53it/s]
Epoch 10:  85%|████████▍ | 99/117 [00:05<00:00, 19.32it/s, loss=3.5, v_num=1, val_acc=0.667]

Validation DataLoader 0:  15%|█▌        | 3/20 [00:00<00:00, 44.51it/s]
Epoch 10:  85%|████████▌ | 100/117 [00:05<00:00, 19.40it/s, loss=3.5, v_num=1, val_acc=0.667]

Validation DataLoader 0:  20%|██        | 4/20 [00:00<00:00, 40.41it/s]
Epoch 10:  86%|████████▋ | 101/117 [00:05<00:00, 19.47it/s, loss=3.5, v_num=1, val_acc=0.667]

Validation DataLoader 0:  25%|██▌       | 5/20 [00:00<00:00, 38.20it/s]
Epoch 10:  87%|████████▋ | 102/117 [00:05<00:00, 19.54it/s, loss=3.5, v_num=1, val_acc=0.667]

Validation DataLoader 0:  30%|███       | 6/20 [00:00<00:00, 36.91it/s]
Epoch 10:  88%|████████▊ | 103/117 [00:05<00:00, 19.62it/s, loss=3.5, v_num=1, val_acc=0.667]

Validation DataLoader 0:  35%|███▌      | 7/20 [00:00<00:00, 36.07it/s]
Epoch 10:  89%|████████▉ | 104/117 [00:05<00:00, 19.69it/s, loss=3.5, v_num=1, val_acc=0.667]

Validation DataLoader 0:  40%|████      | 8/20 [00:00<00:00, 35.47it/s]
Epoch 10:  90%|████████▉ | 105/117 [00:05<00:00, 19.76it/s, loss=3.5, v_num=1, val_acc=0.667]

Validation DataLoader 0:  45%|████▌     | 9/20 [00:00<00:00, 34.97it/s]
Epoch 10:  91%|█████████ | 106/117 [00:05<00:00, 19.83it/s, loss=3.5, v_num=1, val_acc=0.667]

Validation DataLoader 0:  50%|█████     | 10/20 [00:00<00:00, 34.59it/s]
Epoch 10:  91%|█████████▏| 107/117 [00:05<00:00, 19.90it/s, loss=3.5, v_num=1, val_acc=0.667]

Validation DataLoader 0:  55%|█████▌    | 11/20 [00:00<00:00, 34.33it/s]
Epoch 10:  92%|█████████▏| 108/117 [00:05<00:00, 19.97it/s, loss=3.5, v_num=1, val_acc=0.667]

Validation DataLoader 0:  60%|██████    | 12/20 [00:00<00:00, 34.08it/s]
Epoch 10:  93%|█████████▎| 109/117 [00:05<00:00, 20.04it/s, loss=3.5, v_num=1, val_acc=0.667]

Validation DataLoader 0:  65%|██████▌   | 13/20 [00:00<00:00, 33.87it/s]
Epoch 10:  94%|█████████▍| 110/117 [00:05<00:00, 20.10it/s, loss=3.5, v_num=1, val_acc=0.667]

Validation DataLoader 0:  70%|███████   | 14/20 [00:00<00:00, 33.68it/s]
Epoch 10:  95%|█████████▍| 111/117 [00:05<00:00, 20.17it/s, loss=3.5, v_num=1, val_acc=0.667]

Validation DataLoader 0:  75%|███████▌  | 15/20 [00:00<00:00, 33.55it/s]
Epoch 10:  96%|█████████▌| 112/117 [00:05<00:00, 20.23it/s, loss=3.5, v_num=1, val_acc=0.667]

Validation DataLoader 0:  80%|████████  | 16/20 [00:00<00:00, 33.41it/s]
Epoch 10:  97%|█████████▋| 113/117 [00:05<00:00, 20.30it/s, loss=3.5, v_num=1, val_acc=0.667]

Validation DataLoader 0:  85%|████████▌ | 17/20 [00:00<00:00, 33.30it/s]
Epoch 10:  97%|█████████▋| 114/117 [00:05<00:00, 20.36it/s, loss=3.5, v_num=1, val_acc=0.667]

Validation DataLoader 0:  90%|█████████ | 18/20 [00:00<00:00, 33.19it/s]
Epoch 10:  98%|█████████▊| 115/117 [00:05<00:00, 20.43it/s, loss=3.5, v_num=1, val_acc=0.667]

Validation DataLoader 0:  95%|█████████▌| 19/20 [00:00<00:00, 33.10it/s]
Epoch 10:  99%|█████████▉| 116/117 [00:05<00:00, 20.49it/s, loss=3.5, v_num=1, val_acc=0.667]

Validation DataLoader 0: 100%|██████████| 20/20 [00:00<00:00, 33.09it/s]
Epoch 10: 100%|██████████| 117/117 [00:05<00:00, 20.55it/s, loss=3.5, v_num=1, val_acc=0.667]
Epoch 10: 100%|██████████| 117/117 [00:05<00:00, 20.48it/s, loss=3.5, v_num=1, val_acc=0.694]


Epoch 10: 100%|██████████| 117/117 [00:05<00:00, 20.48it/s, loss=3.5, v_num=1, val_acc=0.694]
Epoch 10:   0%|          | 0/117 [00:00<?, ?it/s, loss=3.5, v_num=1, val_acc=0.694]
Epoch 11:   0%|          | 0/117 [00:00<?, ?it/s, loss=3.5, v_num=1, val_acc=0.694]
Epoch 11:   1%|          | 1/117 [00:00<01:44,  1.11it/s, loss=3.5, v_num=1, val_acc=0.694]
Epoch 11:   1%|          | 1/117 [00:00<01:47,  1.08it/s, loss=3.32, v_num=1, val_acc=0.694]
Epoch 11:   2%|▏         | 2/117 [00:00<00:53,  2.14it/s, loss=3.32, v_num=1, val_acc=0.694]
Epoch 11:   2%|▏         | 2/117 [00:00<00:55,  2.08it/s, loss=3.3, v_num=1, val_acc=0.694]
Epoch 11:   3%|▎         | 3/117 [00:00<00:36,  3.09it/s, loss=3.3, v_num=1, val_acc=0.694]
Epoch 11:   3%|▎         | 3/117 [00:00<00:37,  3.01it/s, loss=3.41, v_num=1, val_acc=0.694]
Epoch 11:   3%|▎         | 4/117 [00:01<00:28,  3.96it/s, loss=3.41, v_num=1, val_acc=0.694]
Epoch 11:   3%|▎         | 4/117 [00:01<00:29,  3.87it/s, loss=3.4, v_num=1, val_acc=0.694]
Epoch 11:   4%|▍         | 5/117 [00:01<00:23,  4.79it/s, loss=3.4, v_num=1, val_acc=0.694]
Epoch 11:   4%|▍         | 5/117 [00:01<00:23,  4.68it/s, loss=3.38, v_num=1, val_acc=0.694]
Epoch 11:   5%|▌         | 6/117 [00:01<00:19,  5.57it/s, loss=3.38, v_num=1, val_acc=0.694]
Epoch 11:   5%|▌         | 6/117 [00:01<00:20,  5.44it/s, loss=3.31, v_num=1, val_acc=0.694]
Epoch 11:   6%|▌         | 7/117 [00:01<00:17,  6.30it/s, loss=3.31, v_num=1, val_acc=0.694]
Epoch 11:   6%|▌         | 7/117 [00:01<00:17,  6.16it/s, loss=3.23, v_num=1, val_acc=0.694]
Epoch 11:   7%|▋         | 8/117 [00:01<00:15,  6.99it/s, loss=3.23, v_num=1, val_acc=0.694]
Epoch 11:   7%|▋         | 8/117 [00:01<00:15,  6.84it/s, loss=3.11, v_num=1, val_acc=0.694]
Epoch 11:   8%|▊         | 9/117 [00:01<00:14,  7.63it/s, loss=3.11, v_num=1, val_acc=0.694]
Epoch 11:   8%|▊         | 9/117 [00:01<00:14,  7.47it/s, loss=3.02, v_num=1, val_acc=0.694]
Epoch 11:   9%|▊         | 10/117 [00:01<00:13,  8.19it/s, loss=3.02, v_num=1, val_acc=0.694]
Epoch 11:   9%|▊         | 10/117 [00:01<00:13,  8.04it/s, loss=3.02, v_num=1, val_acc=0.694]
Epoch 11:   9%|▉         | 11/117 [00:01<00:12,  8.78it/s, loss=3.02, v_num=1, val_acc=0.694]
Epoch 11:   9%|▉         | 11/117 [00:01<00:12,  8.60it/s, loss=3, v_num=1, val_acc=0.694]
Epoch 11:  10%|█         | 12/117 [00:01<00:11,  9.33it/s, loss=3, v_num=1, val_acc=0.694]
Epoch 11:  10%|█         | 12/117 [00:01<00:11,  9.15it/s, loss=2.97, v_num=1, val_acc=0.694]
Epoch 11:  11%|█         | 13/117 [00:01<00:10,  9.85it/s, loss=2.97, v_num=1, val_acc=0.694]
Epoch 11:  11%|█         | 13/117 [00:01<00:10,  9.66it/s, loss=2.95, v_num=1, val_acc=0.694]
Epoch 11:  12%|█▏        | 14/117 [00:01<00:09, 10.34it/s, loss=2.95, v_num=1, val_acc=0.694]
Epoch 11:  12%|█▏        | 14/117 [00:01<00:10, 10.15it/s, loss=2.9, v_num=1, val_acc=0.694]
Epoch 11:  13%|█▎        | 15/117 [00:01<00:09, 10.81it/s, loss=2.9, v_num=1, val_acc=0.694]
Epoch 11:  13%|█▎        | 15/117 [00:01<00:09, 10.62it/s, loss=2.99, v_num=1, val_acc=0.694]
Epoch 11:  14%|█▎        | 16/117 [00:01<00:08, 11.26it/s, loss=2.99, v_num=1, val_acc=0.694]
Epoch 11:  14%|█▎        | 16/117 [00:01<00:09, 11.06it/s, loss=2.97, v_num=1, val_acc=0.694]
Epoch 11:  15%|█▍        | 17/117 [00:01<00:08, 11.64it/s, loss=2.97, v_num=1, val_acc=0.694]
Epoch 11:  15%|█▍        | 17/117 [00:01<00:08, 11.47it/s, loss=2.95, v_num=1, val_acc=0.694]
Epoch 11:  15%|█▌        | 18/117 [00:01<00:08, 12.06it/s, loss=2.95, v_num=1, val_acc=0.694]
Epoch 11:  15%|█▌        | 18/117 [00:01<00:08, 11.86it/s, loss=2.88, v_num=1, val_acc=0.694]
Epoch 11:  16%|█▌        | 19/117 [00:01<00:07, 12.45it/s, loss=2.88, v_num=1, val_acc=0.694]
Epoch 11:  16%|█▌        | 19/117 [00:01<00:08, 12.24it/s, loss=2.83, v_num=1, val_acc=0.694]
Epoch 11:  17%|█▋        | 20/117 [00:01<00:07, 12.82it/s, loss=2.83, v_num=1, val_acc=0.694]
Epoch 11:  17%|█▋        | 20/117 [00:01<00:07, 12.61it/s, loss=2.87, v_num=1, val_acc=0.694]
Epoch 11:  18%|█▊        | 21/117 [00:01<00:07, 13.17it/s, loss=2.87, v_num=1, val_acc=0.694]
Epoch 11:  18%|█▊        | 21/117 [00:01<00:07, 12.97it/s, loss=2.89, v_num=1, val_acc=0.694]
Epoch 11:  19%|█▉        | 22/117 [00:01<00:07, 13.50it/s, loss=2.89, v_num=1, val_acc=0.694]
Epoch 11:  19%|█▉        | 22/117 [00:01<00:07, 13.30it/s, loss=2.89, v_num=1, val_acc=0.694]
Epoch 11:  20%|█▉        | 23/117 [00:01<00:06, 13.82it/s, loss=2.89, v_num=1, val_acc=0.694]
Epoch 11:  20%|█▉        | 23/117 [00:01<00:06, 13.62it/s, loss=2.85, v_num=1, val_acc=0.694]
Epoch 11:  21%|██        | 24/117 [00:01<00:06, 14.09it/s, loss=2.85, v_num=1, val_acc=0.694]
Epoch 11:  21%|██        | 24/117 [00:01<00:06, 13.90it/s, loss=2.86, v_num=1, val_acc=0.694]
Epoch 11:  21%|██▏       | 25/117 [00:01<00:06, 14.38it/s, loss=2.86, v_num=1, val_acc=0.694]
Epoch 11:  21%|██▏       | 25/117 [00:01<00:06, 14.18it/s, loss=2.88, v_num=1, val_acc=0.694]
Epoch 11:  22%|██▏       | 26/117 [00:01<00:06, 14.66it/s, loss=2.88, v_num=1, val_acc=0.694]
Epoch 11:  22%|██▏       | 26/117 [00:01<00:06, 14.45it/s, loss=2.87, v_num=1, val_acc=0.694]
Epoch 11:  23%|██▎       | 27/117 [00:01<00:06, 14.94it/s, loss=2.87, v_num=1, val_acc=0.694]
Epoch 11:  23%|██▎       | 27/117 [00:01<00:06, 14.73it/s, loss=2.8, v_num=1, val_acc=0.694]
Epoch 11:  24%|██▍       | 28/117 [00:01<00:05, 15.21it/s, loss=2.8, v_num=1, val_acc=0.694]
Epoch 11:  24%|██▍       | 28/117 [00:01<00:05, 15.00it/s, loss=2.73, v_num=1, val_acc=0.694]
Epoch 11:  25%|██▍       | 29/117 [00:01<00:05, 15.46it/s, loss=2.73, v_num=1, val_acc=0.694]
Epoch 11:  25%|██▍       | 29/117 [00:01<00:05, 15.25it/s, loss=2.7, v_num=1, val_acc=0.694]
Epoch 11:  26%|██▌       | 30/117 [00:01<00:05, 15.69it/s, loss=2.7, v_num=1, val_acc=0.694]
Epoch 11:  26%|██▌       | 30/117 [00:01<00:05, 15.49it/s, loss=2.72, v_num=1, val_acc=0.694]
Epoch 11:  26%|██▋       | 31/117 [00:01<00:05, 15.93it/s, loss=2.72, v_num=1, val_acc=0.694]
Epoch 11:  26%|██▋       | 31/117 [00:01<00:05, 15.73it/s, loss=2.88, v_num=1, val_acc=0.694]
Epoch 11:  27%|██▋       | 32/117 [00:01<00:05, 16.16it/s, loss=2.88, v_num=1, val_acc=0.694]
Epoch 11:  27%|██▋       | 32/117 [00:02<00:05, 15.95it/s, loss=2.93, v_num=1, val_acc=0.694]
Epoch 11:  28%|██▊       | 33/117 [00:02<00:05, 16.37it/s, loss=2.93, v_num=1, val_acc=0.694]
Epoch 11:  28%|██▊       | 33/117 [00:02<00:05, 16.17it/s, loss=2.93, v_num=1, val_acc=0.694]
Epoch 11:  29%|██▉       | 34/117 [00:02<00:05, 16.53it/s, loss=2.93, v_num=1, val_acc=0.694]
Epoch 11:  29%|██▉       | 34/117 [00:02<00:05, 16.35it/s, loss=2.88, v_num=1, val_acc=0.694]
Epoch 11:  30%|██▉       | 35/117 [00:02<00:04, 16.76it/s, loss=2.88, v_num=1, val_acc=0.694]
Epoch 11:  30%|██▉       | 35/117 [00:02<00:04, 16.56it/s, loss=2.72, v_num=1, val_acc=0.694]
Epoch 11:  31%|███       | 36/117 [00:02<00:04, 16.96it/s, loss=2.72, v_num=1, val_acc=0.694]
Epoch 11:  31%|███       | 36/117 [00:02<00:04, 16.76it/s, loss=2.67, v_num=1, val_acc=0.694]
Epoch 11:  32%|███▏      | 37/117 [00:02<00:04, 17.16it/s, loss=2.67, v_num=1, val_acc=0.694]
Epoch 11:  32%|███▏      | 37/117 [00:02<00:04, 16.96it/s, loss=2.63, v_num=1, val_acc=0.694]
Epoch 11:  32%|███▏      | 38/117 [00:02<00:04, 17.34it/s, loss=2.63, v_num=1, val_acc=0.694]
Epoch 11:  32%|███▏      | 38/117 [00:02<00:04, 17.14it/s, loss=2.69, v_num=1, val_acc=0.694]
Epoch 11:  33%|███▎      | 39/117 [00:02<00:04, 17.52it/s, loss=2.69, v_num=1, val_acc=0.694]
Epoch 11:  33%|███▎      | 39/117 [00:02<00:04, 17.32it/s, loss=2.77, v_num=1, val_acc=0.694]
Epoch 11:  34%|███▍      | 40/117 [00:02<00:04, 17.69it/s, loss=2.77, v_num=1, val_acc=0.694]
Epoch 11:  34%|███▍      | 40/117 [00:02<00:04, 17.50it/s, loss=2.77, v_num=1, val_acc=0.694]
Epoch 11:  35%|███▌      | 41/117 [00:02<00:04, 17.86it/s, loss=2.77, v_num=1, val_acc=0.694]
Epoch 11:  35%|███▌      | 41/117 [00:02<00:04, 17.67it/s, loss=2.9, v_num=1, val_acc=0.694]
Epoch 11:  36%|███▌      | 42/117 [00:02<00:04, 18.02it/s, loss=2.9, v_num=1, val_acc=0.694]
Epoch 11:  36%|███▌      | 42/117 [00:02<00:04, 17.83it/s, loss=2.92, v_num=1, val_acc=0.694]
Epoch 11:  37%|███▋      | 43/117 [00:02<00:04, 18.17it/s, loss=2.92, v_num=1, val_acc=0.694]
Epoch 11:  37%|███▋      | 43/117 [00:02<00:04, 17.98it/s, loss=2.97, v_num=1, val_acc=0.694]
Epoch 11:  38%|███▊      | 44/117 [00:02<00:03, 18.33it/s, loss=2.97, v_num=1, val_acc=0.694]
Epoch 11:  38%|███▊      | 44/117 [00:02<00:04, 18.14it/s, loss=3.11, v_num=1, val_acc=0.694]
Epoch 11:  38%|███▊      | 45/117 [00:02<00:03, 18.49it/s, loss=3.11, v_num=1, val_acc=0.694]
Epoch 11:  38%|███▊      | 45/117 [00:02<00:03, 18.30it/s, loss=3.11, v_num=1, val_acc=0.694]
Epoch 11:  39%|███▉      | 46/117 [00:02<00:03, 18.63it/s, loss=3.11, v_num=1, val_acc=0.694]
Epoch 11:  39%|███▉      | 46/117 [00:02<00:03, 18.44it/s, loss=3.09, v_num=1, val_acc=0.694]
Epoch 11:  40%|████      | 47/117 [00:02<00:03, 18.77it/s, loss=3.09, v_num=1, val_acc=0.694]
Epoch 11:  40%|████      | 47/117 [00:02<00:03, 18.59it/s, loss=3.13, v_num=1, val_acc=0.694]
Epoch 11:  41%|████      | 48/117 [00:02<00:03, 18.91it/s, loss=3.13, v_num=1, val_acc=0.694]
Epoch 11:  41%|████      | 48/117 [00:02<00:03, 18.73it/s, loss=3.13, v_num=1, val_acc=0.694]
Epoch 11:  42%|████▏     | 49/117 [00:02<00:03, 19.04it/s, loss=3.13, v_num=1, val_acc=0.694]
Epoch 11:  42%|████▏     | 49/117 [00:02<00:03, 18.86it/s, loss=3.16, v_num=1, val_acc=0.694]
Epoch 11:  43%|████▎     | 50/117 [00:02<00:03, 19.17it/s, loss=3.16, v_num=1, val_acc=0.694]
Epoch 11:  43%|████▎     | 50/117 [00:02<00:03, 18.99it/s, loss=3.07, v_num=1, val_acc=0.694]
Epoch 11:  44%|████▎     | 51/117 [00:02<00:03, 19.28it/s, loss=3.07, v_num=1, val_acc=0.694]
Epoch 11:  44%|████▎     | 51/117 [00:02<00:03, 19.11it/s, loss=2.92, v_num=1, val_acc=0.694]
Epoch 11:  44%|████▍     | 52/117 [00:02<00:03, 19.42it/s, loss=2.92, v_num=1, val_acc=0.694]
Epoch 11:  44%|████▍     | 52/117 [00:02<00:03, 19.23it/s, loss=2.86, v_num=1, val_acc=0.694]
Epoch 11:  45%|████▌     | 53/117 [00:02<00:03, 19.54it/s, loss=2.86, v_num=1, val_acc=0.694]
Epoch 11:  45%|████▌     | 53/117 [00:02<00:03, 19.36it/s, loss=2.85, v_num=1, val_acc=0.694]
Epoch 11:  46%|████▌     | 54/117 [00:02<00:03, 19.66it/s, loss=2.85, v_num=1, val_acc=0.694]
Epoch 11:  46%|████▌     | 54/117 [00:02<00:03, 19.48it/s, loss=2.84, v_num=1, val_acc=0.694]
Epoch 11:  47%|████▋     | 55/117 [00:02<00:03, 19.77it/s, loss=2.84, v_num=1, val_acc=0.694]
Epoch 11:  47%|████▋     | 55/117 [00:02<00:03, 19.60it/s, loss=2.87, v_num=1, val_acc=0.694]
Epoch 11:  48%|████▊     | 56/117 [00:02<00:03, 19.89it/s, loss=2.87, v_num=1, val_acc=0.694]
Epoch 11:  48%|████▊     | 56/117 [00:02<00:03, 19.71it/s, loss=2.9, v_num=1, val_acc=0.694]
Epoch 11:  49%|████▊     | 57/117 [00:02<00:03, 20.00it/s, loss=2.9, v_num=1, val_acc=0.694]
Epoch 11:  49%|████▊     | 57/117 [00:02<00:03, 19.82it/s, loss=2.93, v_num=1, val_acc=0.694]
Epoch 11:  50%|████▉     | 58/117 [00:02<00:02, 20.11it/s, loss=2.93, v_num=1, val_acc=0.694]
Epoch 11:  50%|████▉     | 58/117 [00:02<00:02, 19.93it/s, loss=2.89, v_num=1, val_acc=0.694]
Epoch 11:  50%|█████     | 59/117 [00:02<00:02, 20.21it/s, loss=2.89, v_num=1, val_acc=0.694]
Epoch 11:  50%|█████     | 59/117 [00:02<00:02, 20.04it/s, loss=2.9, v_num=1, val_acc=0.694]
Epoch 11:  51%|█████▏    | 60/117 [00:02<00:02, 20.32it/s, loss=2.9, v_num=1, val_acc=0.694]
Epoch 11:  51%|█████▏    | 60/117 [00:02<00:02, 20.14it/s, loss=2.9, v_num=1, val_acc=0.694]
Epoch 11:  52%|█████▏    | 61/117 [00:02<00:02, 20.42it/s, loss=2.9, v_num=1, val_acc=0.694]
Epoch 11:  52%|█████▏    | 61/117 [00:03<00:02, 20.25it/s, loss=2.83, v_num=1, val_acc=0.694]
Epoch 11:  53%|█████▎    | 62/117 [00:03<00:02, 20.52it/s, loss=2.83, v_num=1, val_acc=0.694]
Epoch 11:  53%|█████▎    | 62/117 [00:03<00:02, 20.35it/s, loss=2.78, v_num=1, val_acc=0.694]
Epoch 11:  54%|█████▍    | 63/117 [00:03<00:02, 20.61it/s, loss=2.78, v_num=1, val_acc=0.694]
Epoch 11:  54%|█████▍    | 63/117 [00:03<00:02, 20.44it/s, loss=2.71, v_num=1, val_acc=0.694]
Epoch 11:  55%|█████▍    | 64/117 [00:03<00:02, 20.70it/s, loss=2.71, v_num=1, val_acc=0.694]
Epoch 11:  55%|█████▍    | 64/117 [00:03<00:02, 20.54it/s, loss=2.58, v_num=1, val_acc=0.694]
Epoch 11:  56%|█████▌    | 65/117 [00:03<00:02, 20.79it/s, loss=2.58, v_num=1, val_acc=0.694]
Epoch 11:  56%|█████▌    | 65/117 [00:03<00:02, 20.63it/s, loss=2.62, v_num=1, val_acc=0.694]
Epoch 11:  56%|█████▋    | 66/117 [00:03<00:02, 20.88it/s, loss=2.62, v_num=1, val_acc=0.694]
Epoch 11:  56%|█████▋    | 66/117 [00:03<00:02, 20.72it/s, loss=2.66, v_num=1, val_acc=0.694]
Epoch 11:  57%|█████▋    | 67/117 [00:03<00:02, 20.96it/s, loss=2.66, v_num=1, val_acc=0.694]
Epoch 11:  57%|█████▋    | 67/117 [00:03<00:02, 20.80it/s, loss=2.68, v_num=1, val_acc=0.694]
Epoch 11:  58%|█████▊    | 68/117 [00:03<00:02, 21.05it/s, loss=2.68, v_num=1, val_acc=0.694]
Epoch 11:  58%|█████▊    | 68/117 [00:03<00:02, 20.89it/s, loss=2.73, v_num=1, val_acc=0.694]
Epoch 11:  59%|█████▉    | 69/117 [00:03<00:02, 21.14it/s, loss=2.73, v_num=1, val_acc=0.694]
Epoch 11:  59%|█████▉    | 69/117 [00:03<00:02, 20.98it/s, loss=2.71, v_num=1, val_acc=0.694]
Epoch 11:  60%|█████▉    | 70/117 [00:03<00:02, 21.22it/s, loss=2.71, v_num=1, val_acc=0.694]
Epoch 11:  60%|█████▉    | 70/117 [00:03<00:02, 21.06it/s, loss=2.7, v_num=1, val_acc=0.694]
Epoch 11:  61%|██████    | 71/117 [00:03<00:02, 21.30it/s, loss=2.7, v_num=1, val_acc=0.694]
Epoch 11:  61%|██████    | 71/117 [00:03<00:02, 21.14it/s, loss=2.81, v_num=1, val_acc=0.694]
Epoch 11:  62%|██████▏   | 72/117 [00:03<00:02, 21.38it/s, loss=2.81, v_num=1, val_acc=0.694]
Epoch 11:  62%|██████▏   | 72/117 [00:03<00:02, 21.22it/s, loss=2.82, v_num=1, val_acc=0.694]
Epoch 11:  62%|██████▏   | 73/117 [00:03<00:02, 21.45it/s, loss=2.82, v_num=1, val_acc=0.694]
Epoch 11:  62%|██████▏   | 73/117 [00:03<00:02, 21.30it/s, loss=2.82, v_num=1, val_acc=0.694]
Epoch 11:  63%|██████▎   | 74/117 [00:03<00:01, 21.52it/s, loss=2.82, v_num=1, val_acc=0.694]
Epoch 11:  63%|██████▎   | 74/117 [00:03<00:02, 21.37it/s, loss=2.88, v_num=1, val_acc=0.694]
Epoch 11:  64%|██████▍   | 75/117 [00:03<00:01, 21.60it/s, loss=2.88, v_num=1, val_acc=0.694]
Epoch 11:  64%|██████▍   | 75/117 [00:03<00:01, 21.44it/s, loss=2.98, v_num=1, val_acc=0.694]
Epoch 11:  65%|██████▍   | 76/117 [00:03<00:01, 21.67it/s, loss=2.98, v_num=1, val_acc=0.694]
Epoch 11:  65%|██████▍   | 76/117 [00:03<00:01, 21.51it/s, loss=2.97, v_num=1, val_acc=0.694]
Epoch 11:  66%|██████▌   | 77/117 [00:03<00:01, 21.74it/s, loss=2.97, v_num=1, val_acc=0.694]
Epoch 11:  66%|██████▌   | 77/117 [00:03<00:01, 21.59it/s, loss=2.95, v_num=1, val_acc=0.694]
Epoch 11:  67%|██████▋   | 78/117 [00:03<00:01, 21.81it/s, loss=2.95, v_num=1, val_acc=0.694]
Epoch 11:  67%|██████▋   | 78/117 [00:03<00:01, 21.66it/s, loss=2.95, v_num=1, val_acc=0.694]
Epoch 11:  68%|██████▊   | 79/117 [00:03<00:01, 21.87it/s, loss=2.95, v_num=1, val_acc=0.694]
Epoch 11:  68%|██████▊   | 79/117 [00:03<00:01, 21.72it/s, loss=2.98, v_num=1, val_acc=0.694]
Epoch 11:  68%|██████▊   | 80/117 [00:03<00:01, 21.94it/s, loss=2.98, v_num=1, val_acc=0.694]
Epoch 11:  68%|██████▊   | 80/117 [00:03<00:01, 21.79it/s, loss=2.98, v_num=1, val_acc=0.694]
Epoch 11:  69%|██████▉   | 81/117 [00:03<00:01, 22.01it/s, loss=2.98, v_num=1, val_acc=0.694]
Epoch 11:  69%|██████▉   | 81/117 [00:03<00:01, 21.86it/s, loss=2.95, v_num=1, val_acc=0.694]
Epoch 11:  70%|███████   | 82/117 [00:03<00:01, 22.04it/s, loss=2.95, v_num=1, val_acc=0.694]
Epoch 11:  70%|███████   | 82/117 [00:03<00:01, 21.89it/s, loss=2.92, v_num=1, val_acc=0.694]
Epoch 11:  71%|███████   | 83/117 [00:03<00:01, 22.10it/s, loss=2.92, v_num=1, val_acc=0.694]
Epoch 11:  71%|███████   | 83/117 [00:03<00:01, 21.95it/s, loss=2.91, v_num=1, val_acc=0.694]
Epoch 11:  72%|███████▏  | 84/117 [00:03<00:01, 22.16it/s, loss=2.91, v_num=1, val_acc=0.694]
Epoch 11:  72%|███████▏  | 84/117 [00:03<00:01, 22.01it/s, loss=2.91, v_num=1, val_acc=0.694]
Epoch 11:  73%|███████▎  | 85/117 [00:03<00:01, 22.23it/s, loss=2.91, v_num=1, val_acc=0.694]
Epoch 11:  73%|███████▎  | 85/117 [00:03<00:01, 22.08it/s, loss=2.91, v_num=1, val_acc=0.694]
Epoch 11:  74%|███████▎  | 86/117 [00:03<00:01, 22.29it/s, loss=2.91, v_num=1, val_acc=0.694]
Epoch 11:  74%|███████▎  | 86/117 [00:03<00:01, 22.14it/s, loss=2.85, v_num=1, val_acc=0.694]
Epoch 11:  74%|███████▍  | 87/117 [00:03<00:01, 22.35it/s, loss=2.85, v_num=1, val_acc=0.694]
Epoch 11:  74%|███████▍  | 87/117 [00:03<00:01, 22.20it/s, loss=2.81, v_num=1, val_acc=0.694]
Epoch 11:  75%|███████▌  | 88/117 [00:03<00:01, 22.41it/s, loss=2.81, v_num=1, val_acc=0.694]
Epoch 11:  75%|███████▌  | 88/117 [00:03<00:01, 22.27it/s, loss=2.74, v_num=1, val_acc=0.694]
Epoch 11:  76%|███████▌  | 89/117 [00:03<00:01, 22.47it/s, loss=2.74, v_num=1, val_acc=0.694]
Epoch 11:  76%|███████▌  | 89/117 [00:03<00:01, 22.33it/s, loss=2.73, v_num=1, val_acc=0.694]
Epoch 11:  77%|███████▋  | 90/117 [00:03<00:01, 22.53it/s, loss=2.73, v_num=1, val_acc=0.694]
Epoch 11:  77%|███████▋  | 90/117 [00:04<00:01, 22.39it/s, loss=2.82, v_num=1, val_acc=0.694]
Epoch 11:  78%|███████▊  | 91/117 [00:04<00:01, 22.58it/s, loss=2.82, v_num=1, val_acc=0.694]
Epoch 11:  78%|███████▊  | 91/117 [00:04<00:01, 22.44it/s, loss=2.8, v_num=1, val_acc=0.694]
Epoch 11:  79%|███████▊  | 92/117 [00:04<00:01, 22.64it/s, loss=2.8, v_num=1, val_acc=0.694]
Epoch 11:  79%|███████▊  | 92/117 [00:04<00:01, 22.50it/s, loss=2.86, v_num=1, val_acc=0.694]
Epoch 11:  79%|███████▉  | 93/117 [00:04<00:01, 22.70it/s, loss=2.86, v_num=1, val_acc=0.694]
Epoch 11:  79%|███████▉  | 93/117 [00:04<00:01, 22.56it/s, loss=2.88, v_num=1, val_acc=0.694]
Epoch 11:  80%|████████  | 94/117 [00:04<00:01, 22.75it/s, loss=2.88, v_num=1, val_acc=0.694]
Epoch 11:  80%|████████  | 94/117 [00:04<00:01, 22.61it/s, loss=2.84, v_num=1, val_acc=0.694]
Epoch 11:  81%|████████  | 95/117 [00:04<00:00, 22.80it/s, loss=2.84, v_num=1, val_acc=0.694]
Epoch 11:  81%|████████  | 95/117 [00:04<00:00, 22.67it/s, loss=2.71, v_num=1, val_acc=0.694]
Epoch 11:  82%|████████▏ | 96/117 [00:04<00:00, 22.86it/s, loss=2.71, v_num=1, val_acc=0.694]
Epoch 11:  82%|████████▏ | 96/117 [00:04<00:00, 22.72it/s, loss=2.71, v_num=1, val_acc=0.694]
Epoch 11:  83%|████████▎ | 97/117 [00:04<00:00, 22.91it/s, loss=2.71, v_num=1, val_acc=0.694]
Epoch 11:  83%|████████▎ | 97/117 [00:04<00:00, 22.77it/s, loss=2.76, v_num=1, val_acc=0.694]

Validation: 0it [00:00, ?it/s]

Validation:   0%|          | 0/20 [00:00<?, ?it/s]

Validation DataLoader 0:   0%|          | 0/20 [00:00<?, ?it/s]

Validation DataLoader 0:   5%|▌         | 1/20 [00:00<00:00, 160.03it/s]
Epoch 11:  84%|████████▍ | 98/117 [00:05<00:00, 19.10it/s, loss=2.76, v_num=1, val_acc=0.694]

Validation DataLoader 0:  10%|█         | 2/20 [00:00<00:00, 54.72it/s]
Epoch 11:  85%|████████▍ | 99/117 [00:05<00:00, 19.18it/s, loss=2.76, v_num=1, val_acc=0.694]

Validation DataLoader 0:  15%|█▌        | 3/20 [00:00<00:00, 44.03it/s]
Epoch 11:  85%|████████▌ | 100/117 [00:05<00:00, 19.25it/s, loss=2.76, v_num=1, val_acc=0.694]

Validation DataLoader 0:  20%|██        | 4/20 [00:00<00:00, 40.19it/s]
Epoch 11:  86%|████████▋ | 101/117 [00:05<00:00, 19.33it/s, loss=2.76, v_num=1, val_acc=0.694]

Validation DataLoader 0:  25%|██▌       | 5/20 [00:00<00:00, 38.10it/s]
Epoch 11:  87%|████████▋ | 102/117 [00:05<00:00, 19.40it/s, loss=2.76, v_num=1, val_acc=0.694]

Validation DataLoader 0:  30%|███       | 6/20 [00:00<00:00, 36.85it/s]
Epoch 11:  88%|████████▊ | 103/117 [00:05<00:00, 19.48it/s, loss=2.76, v_num=1, val_acc=0.694]

Validation DataLoader 0:  35%|███▌      | 7/20 [00:00<00:00, 35.93it/s]
Epoch 11:  89%|████████▉ | 104/117 [00:05<00:00, 19.55it/s, loss=2.76, v_num=1, val_acc=0.694]

Validation DataLoader 0:  40%|████      | 8/20 [00:00<00:00, 35.39it/s]
Epoch 11:  90%|████████▉ | 105/117 [00:05<00:00, 19.62it/s, loss=2.76, v_num=1, val_acc=0.694]

Validation DataLoader 0:  45%|████▌     | 9/20 [00:00<00:00, 34.89it/s]
Epoch 11:  91%|█████████ | 106/117 [00:05<00:00, 19.69it/s, loss=2.76, v_num=1, val_acc=0.694]

Validation DataLoader 0:  50%|█████     | 10/20 [00:00<00:00, 34.41it/s]
Epoch 11:  91%|█████████▏| 107/117 [00:05<00:00, 19.75it/s, loss=2.76, v_num=1, val_acc=0.694]

Validation DataLoader 0:  55%|█████▌    | 11/20 [00:00<00:00, 34.18it/s]
Epoch 11:  92%|█████████▏| 108/117 [00:05<00:00, 19.82it/s, loss=2.76, v_num=1, val_acc=0.694]

Validation DataLoader 0:  60%|██████    | 12/20 [00:00<00:00, 33.96it/s]
Epoch 11:  93%|█████████▎| 109/117 [00:05<00:00, 19.89it/s, loss=2.76, v_num=1, val_acc=0.694]

Validation DataLoader 0:  65%|██████▌   | 13/20 [00:00<00:00, 33.78it/s]
Epoch 11:  94%|█████████▍| 110/117 [00:05<00:00, 19.96it/s, loss=2.76, v_num=1, val_acc=0.694]

Validation DataLoader 0:  70%|███████   | 14/20 [00:00<00:00, 33.63it/s]
Epoch 11:  95%|█████████▍| 111/117 [00:05<00:00, 20.03it/s, loss=2.76, v_num=1, val_acc=0.694]

Validation DataLoader 0:  75%|███████▌  | 15/20 [00:00<00:00, 33.47it/s]
Epoch 11:  96%|█████████▌| 112/117 [00:05<00:00, 20.09it/s, loss=2.76, v_num=1, val_acc=0.694]

Validation DataLoader 0:  80%|████████  | 16/20 [00:00<00:00, 33.36it/s]
Epoch 11:  97%|█████████▋| 113/117 [00:05<00:00, 20.16it/s, loss=2.76, v_num=1, val_acc=0.694]

Validation DataLoader 0:  85%|████████▌ | 17/20 [00:00<00:00, 33.21it/s]
Epoch 11:  97%|█████████▋| 114/117 [00:05<00:00, 20.22it/s, loss=2.76, v_num=1, val_acc=0.694]

Validation DataLoader 0:  90%|█████████ | 18/20 [00:00<00:00, 33.13it/s]
Epoch 11:  98%|█████████▊| 115/117 [00:05<00:00, 20.28it/s, loss=2.76, v_num=1, val_acc=0.694]

Validation DataLoader 0:  95%|█████████▌| 19/20 [00:00<00:00, 33.05it/s]
Epoch 11:  99%|█████████▉| 116/117 [00:05<00:00, 20.35it/s, loss=2.76, v_num=1, val_acc=0.694]

Validation DataLoader 0: 100%|██████████| 20/20 [00:00<00:00, 33.04it/s]
Epoch 11: 100%|██████████| 117/117 [00:05<00:00, 20.41it/s, loss=2.76, v_num=1, val_acc=0.694]
Epoch 11: 100%|██████████| 117/117 [00:05<00:00, 20.34it/s, loss=2.76, v_num=1, val_acc=0.685]


Epoch 11: 100%|██████████| 117/117 [00:05<00:00, 20.34it/s, loss=2.76, v_num=1, val_acc=0.685]
Epoch 11:   0%|          | 0/117 [00:00<?, ?it/s, loss=2.76, v_num=1, val_acc=0.685]
Epoch 12:   0%|          | 0/117 [00:00<?, ?it/s, loss=2.76, v_num=1, val_acc=0.685]
Epoch 12:   1%|          | 1/117 [00:00<01:47,  1.08it/s, loss=2.76, v_num=1, val_acc=0.685]
Epoch 12:   1%|          | 1/117 [00:00<01:49,  1.06it/s, loss=2.83, v_num=1, val_acc=0.685]
Epoch 12:   2%|▏         | 2/117 [00:00<00:54,  2.10it/s, loss=2.83, v_num=1, val_acc=0.685]
Epoch 12:   2%|▏         | 2/117 [00:00<00:56,  2.04it/s, loss=2.77, v_num=1, val_acc=0.685]
Epoch 12:   3%|▎         | 3/117 [00:00<00:37,  3.04it/s, loss=2.77, v_num=1, val_acc=0.685]
Epoch 12:   3%|▎         | 3/117 [00:01<00:38,  2.96it/s, loss=2.69, v_num=1, val_acc=0.685]
Epoch 12:   3%|▎         | 4/117 [00:01<00:28,  3.91it/s, loss=2.69, v_num=1, val_acc=0.685]
Epoch 12:   3%|▎         | 4/117 [00:01<00:29,  3.81it/s, loss=2.66, v_num=1, val_acc=0.685]
Epoch 12:   4%|▍         | 5/117 [00:01<00:23,  4.73it/s, loss=2.66, v_num=1, val_acc=0.685]
Epoch 12:   4%|▍         | 5/117 [00:01<00:24,  4.62it/s, loss=2.68, v_num=1, val_acc=0.685]
Epoch 12:   5%|▌         | 6/117 [00:01<00:20,  5.50it/s, loss=2.68, v_num=1, val_acc=0.685]
Epoch 12:   5%|▌         | 6/117 [00:01<00:20,  5.37it/s, loss=2.63, v_num=1, val_acc=0.685]
Epoch 12:   6%|▌         | 7/117 [00:01<00:17,  6.22it/s, loss=2.63, v_num=1, val_acc=0.685]
Epoch 12:   6%|▌         | 7/117 [00:01<00:18,  6.09it/s, loss=2.59, v_num=1, val_acc=0.685]
Epoch 12:   7%|▋         | 8/117 [00:01<00:15,  6.91it/s, loss=2.59, v_num=1, val_acc=0.685]
Epoch 12:   7%|▋         | 8/117 [00:01<00:16,  6.76it/s, loss=2.51, v_num=1, val_acc=0.685]
Epoch 12:   8%|▊         | 9/117 [00:01<00:14,  7.51it/s, loss=2.51, v_num=1, val_acc=0.685]
Epoch 12:   8%|▊         | 9/117 [00:01<00:14,  7.35it/s, loss=2.52, v_num=1, val_acc=0.685]
Epoch 12:   9%|▊         | 10/117 [00:01<00:13,  8.11it/s, loss=2.52, v_num=1, val_acc=0.685]
Epoch 12:   9%|▊         | 10/117 [00:01<00:13,  7.95it/s, loss=2.59, v_num=1, val_acc=0.685]
Epoch 12:   9%|▉         | 11/117 [00:01<00:12,  8.69it/s, loss=2.59, v_num=1, val_acc=0.685]
Epoch 12:   9%|▉         | 11/117 [00:01<00:12,  8.52it/s, loss=2.68, v_num=1, val_acc=0.685]
Epoch 12:  10%|█         | 12/117 [00:01<00:11,  9.23it/s, loss=2.68, v_num=1, val_acc=0.685]
Epoch 12:  10%|█         | 12/117 [00:01<00:11,  9.06it/s, loss=2.76, v_num=1, val_acc=0.685]
Epoch 12:  11%|█         | 13/117 [00:01<00:10,  9.75it/s, loss=2.76, v_num=1, val_acc=0.685]
Epoch 12:  11%|█         | 13/117 [00:01<00:10,  9.57it/s, loss=2.72, v_num=1, val_acc=0.685]
Epoch 12:  12%|█▏        | 14/117 [00:01<00:10, 10.24it/s, loss=2.72, v_num=1, val_acc=0.685]
Epoch 12:  12%|█▏        | 14/117 [00:01<00:10, 10.05it/s, loss=2.76, v_num=1, val_acc=0.685]
Epoch 12:  13%|█▎        | 15/117 [00:01<00:09, 10.71it/s, loss=2.76, v_num=1, val_acc=0.685]
Epoch 12:  13%|█▎        | 15/117 [00:01<00:09, 10.52it/s, loss=2.87, v_num=1, val_acc=0.685]
Epoch 12:  14%|█▎        | 16/117 [00:01<00:09, 11.16it/s, loss=2.87, v_num=1, val_acc=0.685]
Epoch 12:  14%|█▎        | 16/117 [00:01<00:09, 10.96it/s, loss=2.89, v_num=1, val_acc=0.685]
Epoch 12:  15%|█▍        | 17/117 [00:01<00:08, 11.55it/s, loss=2.89, v_num=1, val_acc=0.685]
Epoch 12:  15%|█▍        | 17/117 [00:01<00:08, 11.36it/s, loss=3.05, v_num=1, val_acc=0.685]
Epoch 12:  15%|█▌        | 18/117 [00:01<00:08, 11.96it/s, loss=3.05, v_num=1, val_acc=0.685]
Epoch 12:  15%|█▌        | 18/117 [00:01<00:08, 11.76it/s, loss=3.27, v_num=1, val_acc=0.685]
Epoch 12:  16%|█▌        | 19/117 [00:01<00:07, 12.35it/s, loss=3.27, v_num=1, val_acc=0.685]
Epoch 12:  16%|█▌        | 19/117 [00:01<00:08, 12.15it/s, loss=3.37, v_num=1, val_acc=0.685]
Epoch 12:  17%|█▋        | 20/117 [00:01<00:07, 12.72it/s, loss=3.37, v_num=1, val_acc=0.685]
Epoch 12:  17%|█▋        | 20/117 [00:01<00:07, 12.52it/s, loss=3.37, v_num=1, val_acc=0.685]
Epoch 12:  18%|█▊        | 21/117 [00:01<00:07, 13.07it/s, loss=3.37, v_num=1, val_acc=0.685]
Epoch 12:  18%|█▊        | 21/117 [00:01<00:07, 12.87it/s, loss=3.28, v_num=1, val_acc=0.685]
Epoch 12:  19%|█▉        | 22/117 [00:01<00:07, 13.41it/s, loss=3.28, v_num=1, val_acc=0.685]
Epoch 12:  19%|█▉        | 22/117 [00:01<00:07, 13.21it/s, loss=3.25, v_num=1, val_acc=0.685]
Epoch 12:  20%|█▉        | 23/117 [00:01<00:06, 13.73it/s, loss=3.25, v_num=1, val_acc=0.685]
Epoch 12:  20%|█▉        | 23/117 [00:01<00:06, 13.53it/s, loss=3.3, v_num=1, val_acc=0.685]
Epoch 12:  21%|██        | 24/117 [00:01<00:06, 14.04it/s, loss=3.3, v_num=1, val_acc=0.685]
Epoch 12:  21%|██        | 24/117 [00:01<00:06, 13.84it/s, loss=3.44, v_num=1, val_acc=0.685]
Epoch 12:  21%|██▏       | 25/117 [00:01<00:06, 14.32it/s, loss=3.44, v_num=1, val_acc=0.685]
Epoch 12:  21%|██▏       | 25/117 [00:01<00:06, 14.12it/s, loss=3.45, v_num=1, val_acc=0.685]
Epoch 12:  22%|██▏       | 26/117 [00:01<00:06, 14.61it/s, loss=3.45, v_num=1, val_acc=0.685]
Epoch 12:  22%|██▏       | 26/117 [00:01<00:06, 14.41it/s, loss=3.58, v_num=1, val_acc=0.685]
Epoch 12:  23%|██▎       | 27/117 [00:01<00:06, 14.89it/s, loss=3.58, v_num=1, val_acc=0.685]
Epoch 12:  23%|██▎       | 27/117 [00:01<00:06, 14.69it/s, loss=3.67, v_num=1, val_acc=0.685]
Epoch 12:  24%|██▍       | 28/117 [00:01<00:05, 15.16it/s, loss=3.67, v_num=1, val_acc=0.685]
Epoch 12:  24%|██▍       | 28/117 [00:01<00:05, 14.96it/s, loss=3.82, v_num=1, val_acc=0.685]
Epoch 12:  25%|██▍       | 29/117 [00:01<00:05, 15.42it/s, loss=3.82, v_num=1, val_acc=0.685]
Epoch 12:  25%|██▍       | 29/117 [00:01<00:05, 15.21it/s, loss=3.93, v_num=1, val_acc=0.685]
Epoch 12:  26%|██▌       | 30/117 [00:01<00:05, 15.66it/s, loss=3.93, v_num=1, val_acc=0.685]
Epoch 12:  26%|██▌       | 30/117 [00:01<00:05, 15.46it/s, loss=3.93, v_num=1, val_acc=0.685]
Epoch 12:  26%|██▋       | 31/117 [00:01<00:05, 15.90it/s, loss=3.93, v_num=1, val_acc=0.685]
Epoch 12:  26%|██▋       | 31/117 [00:01<00:05, 15.70it/s, loss=3.92, v_num=1, val_acc=0.685]
Epoch 12:  27%|██▋       | 32/117 [00:01<00:05, 16.13it/s, loss=3.92, v_num=1, val_acc=0.685]
Epoch 12:  27%|██▋       | 32/117 [00:02<00:05, 15.93it/s, loss=3.94, v_num=1, val_acc=0.685]
Epoch 12:  28%|██▊       | 33/117 [00:02<00:05, 16.34it/s, loss=3.94, v_num=1, val_acc=0.685]
Epoch 12:  28%|██▊       | 33/117 [00:02<00:05, 16.14it/s, loss=3.95, v_num=1, val_acc=0.685]
Epoch 12:  29%|██▉       | 34/117 [00:02<00:05, 16.56it/s, loss=3.95, v_num=1, val_acc=0.685]
Epoch 12:  29%|██▉       | 34/117 [00:02<00:05, 16.35it/s, loss=3.82, v_num=1, val_acc=0.685]
Epoch 12:  30%|██▉       | 35/117 [00:02<00:04, 16.77it/s, loss=3.82, v_num=1, val_acc=0.685]
Epoch 12:  30%|██▉       | 35/117 [00:02<00:04, 16.57it/s, loss=3.66, v_num=1, val_acc=0.685]
Epoch 12:  31%|███       | 36/117 [00:02<00:04, 16.97it/s, loss=3.66, v_num=1, val_acc=0.685]
Epoch 12:  31%|███       | 36/117 [00:02<00:04, 16.77it/s, loss=3.6, v_num=1, val_acc=0.685]
Epoch 12:  32%|███▏      | 37/117 [00:02<00:04, 17.09it/s, loss=3.6, v_num=1, val_acc=0.685]
Epoch 12:  32%|███▏      | 37/117 [00:02<00:04, 16.90it/s, loss=3.48, v_num=1, val_acc=0.685]
Epoch 12:  32%|███▏      | 38/117 [00:02<00:04, 17.29it/s, loss=3.48, v_num=1, val_acc=0.685]
Epoch 12:  32%|███▏      | 38/117 [00:02<00:04, 17.09it/s, loss=3.38, v_num=1, val_acc=0.685]
Epoch 12:  33%|███▎      | 39/117 [00:02<00:04, 17.47it/s, loss=3.38, v_num=1, val_acc=0.685]
Epoch 12:  33%|███▎      | 39/117 [00:02<00:04, 17.27it/s, loss=3.36, v_num=1, val_acc=0.685]
Epoch 12:  34%|███▍      | 40/117 [00:02<00:04, 17.64it/s, loss=3.36, v_num=1, val_acc=0.685]
Epoch 12:  34%|███▍      | 40/117 [00:02<00:04, 17.45it/s, loss=3.41, v_num=1, val_acc=0.685]
Epoch 12:  35%|███▌      | 41/117 [00:02<00:04, 17.81it/s, loss=3.41, v_num=1, val_acc=0.685]
Epoch 12:  35%|███▌      | 41/117 [00:02<00:04, 17.61it/s, loss=3.42, v_num=1, val_acc=0.685]
Epoch 12:  36%|███▌      | 42/117 [00:02<00:04, 17.98it/s, loss=3.42, v_num=1, val_acc=0.685]
Epoch 12:  36%|███▌      | 42/117 [00:02<00:04, 17.79it/s, loss=3.39, v_num=1, val_acc=0.685]
Epoch 12:  37%|███▋      | 43/117 [00:02<00:04, 18.14it/s, loss=3.39, v_num=1, val_acc=0.685]
Epoch 12:  37%|███▋      | 43/117 [00:02<00:04, 17.95it/s, loss=3.42, v_num=1, val_acc=0.685]
Epoch 12:  38%|███▊      | 44/117 [00:02<00:03, 18.29it/s, loss=3.42, v_num=1, val_acc=0.685]
Epoch 12:  38%|███▊      | 44/117 [00:02<00:04, 18.11it/s, loss=3.33, v_num=1, val_acc=0.685]
Epoch 12:  38%|███▊      | 45/117 [00:02<00:03, 18.44it/s, loss=3.33, v_num=1, val_acc=0.685]
Epoch 12:  38%|███▊      | 45/117 [00:02<00:03, 18.25it/s, loss=3.33, v_num=1, val_acc=0.685]
Epoch 12:  39%|███▉      | 46/117 [00:02<00:03, 18.59it/s, loss=3.33, v_num=1, val_acc=0.685]
Epoch 12:  39%|███▉      | 46/117 [00:02<00:03, 18.40it/s, loss=3.25, v_num=1, val_acc=0.685]
Epoch 12:  40%|████      | 47/117 [00:02<00:03, 18.72it/s, loss=3.25, v_num=1, val_acc=0.685]
Epoch 12:  40%|████      | 47/117 [00:02<00:03, 18.54it/s, loss=3.14, v_num=1, val_acc=0.685]
Epoch 12:  41%|████      | 48/117 [00:02<00:03, 18.86it/s, loss=3.14, v_num=1, val_acc=0.685]
Epoch 12:  41%|████      | 48/117 [00:02<00:03, 18.68it/s, loss=3.02, v_num=1, val_acc=0.685]
Epoch 12:  42%|████▏     | 49/117 [00:02<00:03, 19.00it/s, loss=3.02, v_num=1, val_acc=0.685]
Epoch 12:  42%|████▏     | 49/117 [00:02<00:03, 18.82it/s, loss=2.97, v_num=1, val_acc=0.685]
Epoch 12:  43%|████▎     | 50/117 [00:02<00:03, 19.13it/s, loss=2.97, v_num=1, val_acc=0.685]
Epoch 12:  43%|████▎     | 50/117 [00:02<00:03, 18.95it/s, loss=2.93, v_num=1, val_acc=0.685]
Epoch 12:  44%|████▎     | 51/117 [00:02<00:03, 19.26it/s, loss=2.93, v_num=1, val_acc=0.685]
Epoch 12:  44%|████▎     | 51/117 [00:02<00:03, 19.08it/s, loss=2.86, v_num=1, val_acc=0.685]
Epoch 12:  44%|████▍     | 52/117 [00:02<00:03, 19.39it/s, loss=2.86, v_num=1, val_acc=0.685]
Epoch 12:  44%|████▍     | 52/117 [00:02<00:03, 19.21it/s, loss=2.76, v_num=1, val_acc=0.685]
Epoch 12:  45%|████▌     | 53/117 [00:02<00:03, 19.50it/s, loss=2.76, v_num=1, val_acc=0.685]
Epoch 12:  45%|████▌     | 53/117 [00:02<00:03, 19.32it/s, loss=2.74, v_num=1, val_acc=0.685]
Epoch 12:  46%|████▌     | 54/117 [00:02<00:03, 19.62it/s, loss=2.74, v_num=1, val_acc=0.685]
Epoch 12:  46%|████▌     | 54/117 [00:02<00:03, 19.45it/s, loss=2.94, v_num=1, val_acc=0.685]
Epoch 12:  47%|████▋     | 55/117 [00:02<00:03, 19.74it/s, loss=2.94, v_num=1, val_acc=0.685]
Epoch 12:  47%|████▋     | 55/117 [00:02<00:03, 19.56it/s, loss=3.02, v_num=1, val_acc=0.685]
Epoch 12:  48%|████▊     | 56/117 [00:02<00:03, 19.86it/s, loss=3.02, v_num=1, val_acc=0.685]
Epoch 12:  48%|████▊     | 56/117 [00:02<00:03, 19.68it/s, loss=3.06, v_num=1, val_acc=0.685]
Epoch 12:  49%|████▊     | 57/117 [00:02<00:03, 19.97it/s, loss=3.06, v_num=1, val_acc=0.685]
Epoch 12:  49%|████▊     | 57/117 [00:02<00:03, 19.79it/s, loss=3.08, v_num=1, val_acc=0.685]
Epoch 12:  50%|████▉     | 58/117 [00:02<00:02, 20.07it/s, loss=3.08, v_num=1, val_acc=0.685]
Epoch 12:  50%|████▉     | 58/117 [00:02<00:02, 19.90it/s, loss=3.08, v_num=1, val_acc=0.685]
Epoch 12:  50%|█████     | 59/117 [00:02<00:02, 20.18it/s, loss=3.08, v_num=1, val_acc=0.685]
Epoch 12:  50%|█████     | 59/117 [00:02<00:02, 20.01it/s, loss=3.02, v_num=1, val_acc=0.685]
Epoch 12:  51%|█████▏    | 60/117 [00:02<00:02, 20.28it/s, loss=3.02, v_num=1, val_acc=0.685]
Epoch 12:  51%|█████▏    | 60/117 [00:02<00:02, 20.11it/s, loss=2.91, v_num=1, val_acc=0.685]
Epoch 12:  52%|█████▏    | 61/117 [00:02<00:02, 20.39it/s, loss=2.91, v_num=1, val_acc=0.685]
Epoch 12:  52%|█████▏    | 61/117 [00:03<00:02, 20.21it/s, loss=2.96, v_num=1, val_acc=0.685]
Epoch 12:  53%|█████▎    | 62/117 [00:03<00:02, 20.48it/s, loss=2.96, v_num=1, val_acc=0.685]
Epoch 12:  53%|█████▎    | 62/117 [00:03<00:02, 20.31it/s, loss=3.02, v_num=1, val_acc=0.685]
Epoch 12:  54%|█████▍    | 63/117 [00:03<00:02, 20.58it/s, loss=3.02, v_num=1, val_acc=0.685]
Epoch 12:  54%|█████▍    | 63/117 [00:03<00:02, 20.41it/s, loss=3.1, v_num=1, val_acc=0.685]
Epoch 12:  55%|█████▍    | 64/117 [00:03<00:02, 20.68it/s, loss=3.1, v_num=1, val_acc=0.685]
Epoch 12:  55%|█████▍    | 64/117 [00:03<00:02, 20.51it/s, loss=3.12, v_num=1, val_acc=0.685]
Epoch 12:  56%|█████▌    | 65/117 [00:03<00:02, 20.77it/s, loss=3.12, v_num=1, val_acc=0.685]
Epoch 12:  56%|█████▌    | 65/117 [00:03<00:02, 20.60it/s, loss=3.13, v_num=1, val_acc=0.685]
Epoch 12:  56%|█████▋    | 66/117 [00:03<00:02, 20.86it/s, loss=3.13, v_num=1, val_acc=0.685]
Epoch 12:  56%|█████▋    | 66/117 [00:03<00:02, 20.69it/s, loss=3.16, v_num=1, val_acc=0.685]
Epoch 12:  57%|█████▋    | 67/117 [00:03<00:02, 20.95it/s, loss=3.16, v_num=1, val_acc=0.685]
Epoch 12:  57%|█████▋    | 67/117 [00:03<00:02, 20.78it/s, loss=3.24, v_num=1, val_acc=0.685]
Epoch 12:  58%|█████▊    | 68/117 [00:03<00:02, 21.03it/s, loss=3.24, v_num=1, val_acc=0.685]
Epoch 12:  58%|█████▊    | 68/117 [00:03<00:02, 20.87it/s, loss=3.33, v_num=1, val_acc=0.685]
Epoch 12:  59%|█████▉    | 69/117 [00:03<00:02, 21.12it/s, loss=3.33, v_num=1, val_acc=0.685]
Epoch 12:  59%|█████▉    | 69/117 [00:03<00:02, 20.95it/s, loss=3.34, v_num=1, val_acc=0.685]
Epoch 12:  60%|█████▉    | 70/117 [00:03<00:02, 21.20it/s, loss=3.34, v_num=1, val_acc=0.685]
Epoch 12:  60%|█████▉    | 70/117 [00:03<00:02, 21.04it/s, loss=3.38, v_num=1, val_acc=0.685]
Epoch 12:  61%|██████    | 71/117 [00:03<00:02, 21.28it/s, loss=3.38, v_num=1, val_acc=0.685]
Epoch 12:  61%|██████    | 71/117 [00:03<00:02, 21.12it/s, loss=3.42, v_num=1, val_acc=0.685]
Epoch 12:  62%|██████▏   | 72/117 [00:03<00:02, 21.36it/s, loss=3.42, v_num=1, val_acc=0.685]
Epoch 12:  62%|██████▏   | 72/117 [00:03<00:02, 21.20it/s, loss=3.39, v_num=1, val_acc=0.685]
Epoch 12:  62%|██████▏   | 73/117 [00:03<00:02, 21.44it/s, loss=3.39, v_num=1, val_acc=0.685]
Epoch 12:  62%|██████▏   | 73/117 [00:03<00:02, 21.28it/s, loss=3.31, v_num=1, val_acc=0.685]
Epoch 12:  63%|██████▎   | 74/117 [00:03<00:01, 21.52it/s, loss=3.31, v_num=1, val_acc=0.685]
Epoch 12:  63%|██████▎   | 74/117 [00:03<00:02, 21.36it/s, loss=3.12, v_num=1, val_acc=0.685]
Epoch 12:  64%|██████▍   | 75/117 [00:03<00:01, 21.59it/s, loss=3.12, v_num=1, val_acc=0.685]
Epoch 12:  64%|██████▍   | 75/117 [00:03<00:01, 21.43it/s, loss=3.03, v_num=1, val_acc=0.685]
Epoch 12:  65%|██████▍   | 76/117 [00:03<00:01, 21.66it/s, loss=3.03, v_num=1, val_acc=0.685]
Epoch 12:  65%|██████▍   | 76/117 [00:03<00:01, 21.51it/s, loss=2.97, v_num=1, val_acc=0.685]
Epoch 12:  66%|██████▌   | 77/117 [00:03<00:01, 21.73it/s, loss=2.97, v_num=1, val_acc=0.685]
Epoch 12:  66%|██████▌   | 77/117 [00:03<00:01, 21.58it/s, loss=2.92, v_num=1, val_acc=0.685]
Epoch 12:  67%|██████▋   | 78/117 [00:03<00:01, 21.80it/s, loss=2.92, v_num=1, val_acc=0.685]
Epoch 12:  67%|██████▋   | 78/117 [00:03<00:01, 21.65it/s, loss=2.88, v_num=1, val_acc=0.685]
Epoch 12:  68%|██████▊   | 79/117 [00:03<00:01, 21.87it/s, loss=2.88, v_num=1, val_acc=0.685]
Epoch 12:  68%|██████▊   | 79/117 [00:03<00:01, 21.72it/s, loss=3, v_num=1, val_acc=0.685]
Epoch 12:  68%|██████▊   | 80/117 [00:03<00:01, 21.94it/s, loss=3, v_num=1, val_acc=0.685]
Epoch 12:  68%|██████▊   | 80/117 [00:03<00:01, 21.79it/s, loss=3.06, v_num=1, val_acc=0.685]
Epoch 12:  69%|██████▉   | 81/117 [00:03<00:01, 22.01it/s, loss=3.06, v_num=1, val_acc=0.685]
Epoch 12:  69%|██████▉   | 81/117 [00:03<00:01, 21.86it/s, loss=3.04, v_num=1, val_acc=0.685]
Epoch 12:  70%|███████   | 82/117 [00:03<00:01, 22.05it/s, loss=3.04, v_num=1, val_acc=0.685]
Epoch 12:  70%|███████   | 82/117 [00:03<00:01, 21.90it/s, loss=2.97, v_num=1, val_acc=0.685]
Epoch 12:  71%|███████   | 83/117 [00:03<00:01, 22.12it/s, loss=2.97, v_num=1, val_acc=0.685]
Epoch 12:  71%|███████   | 83/117 [00:03<00:01, 21.97it/s, loss=2.87, v_num=1, val_acc=0.685]
Epoch 12:  72%|███████▏  | 84/117 [00:03<00:01, 22.18it/s, loss=2.87, v_num=1, val_acc=0.685]
Epoch 12:  72%|███████▏  | 84/117 [00:03<00:01, 22.03it/s, loss=2.89, v_num=1, val_acc=0.685]
Epoch 12:  73%|███████▎  | 85/117 [00:03<00:01, 22.25it/s, loss=2.89, v_num=1, val_acc=0.685]
Epoch 12:  73%|███████▎  | 85/117 [00:03<00:01, 22.10it/s, loss=2.85, v_num=1, val_acc=0.685]
Epoch 12:  74%|███████▎  | 86/117 [00:03<00:01, 22.31it/s, loss=2.85, v_num=1, val_acc=0.685]
Epoch 12:  74%|███████▎  | 86/117 [00:03<00:01, 22.16it/s, loss=2.79, v_num=1, val_acc=0.685]
Epoch 12:  74%|███████▍  | 87/117 [00:03<00:01, 22.36it/s, loss=2.79, v_num=1, val_acc=0.685]
Epoch 12:  74%|███████▍  | 87/117 [00:03<00:01, 22.22it/s, loss=2.73, v_num=1, val_acc=0.685]
Epoch 12:  75%|███████▌  | 88/117 [00:03<00:01, 22.42it/s, loss=2.73, v_num=1, val_acc=0.685]
Epoch 12:  75%|███████▌  | 88/117 [00:03<00:01, 22.28it/s, loss=2.66, v_num=1, val_acc=0.685]
Epoch 12:  76%|███████▌  | 89/117 [00:03<00:01, 22.48it/s, loss=2.66, v_num=1, val_acc=0.685]
Epoch 12:  76%|███████▌  | 89/117 [00:03<00:01, 22.34it/s, loss=2.68, v_num=1, val_acc=0.685]
Epoch 12:  77%|███████▋  | 90/117 [00:03<00:01, 22.54it/s, loss=2.68, v_num=1, val_acc=0.685]
Epoch 12:  77%|███████▋  | 90/117 [00:04<00:01, 22.40it/s, loss=2.64, v_num=1, val_acc=0.685]
Epoch 12:  78%|███████▊  | 91/117 [00:04<00:01, 22.60it/s, loss=2.64, v_num=1, val_acc=0.685]
Epoch 12:  78%|███████▊  | 91/117 [00:04<00:01, 22.46it/s, loss=2.64, v_num=1, val_acc=0.685]
Epoch 12:  79%|███████▊  | 92/117 [00:04<00:01, 22.65it/s, loss=2.64, v_num=1, val_acc=0.685]
Epoch 12:  79%|███████▊  | 92/117 [00:04<00:01, 22.51it/s, loss=2.68, v_num=1, val_acc=0.685]
Epoch 12:  79%|███████▉  | 93/117 [00:04<00:01, 22.71it/s, loss=2.68, v_num=1, val_acc=0.685]
Epoch 12:  79%|███████▉  | 93/117 [00:04<00:01, 22.57it/s, loss=2.71, v_num=1, val_acc=0.685]
Epoch 12:  80%|████████  | 94/117 [00:04<00:01, 22.76it/s, loss=2.71, v_num=1, val_acc=0.685]
Epoch 12:  80%|████████  | 94/117 [00:04<00:01, 22.62it/s, loss=2.74, v_num=1, val_acc=0.685]
Epoch 12:  81%|████████  | 95/117 [00:04<00:00, 22.81it/s, loss=2.74, v_num=1, val_acc=0.685]
Epoch 12:  81%|████████  | 95/117 [00:04<00:00, 22.67it/s, loss=2.79, v_num=1, val_acc=0.685]
Epoch 12:  82%|████████▏ | 96/117 [00:04<00:00, 22.86it/s, loss=2.79, v_num=1, val_acc=0.685]
Epoch 12:  82%|████████▏ | 96/117 [00:04<00:00, 22.73it/s, loss=2.9, v_num=1, val_acc=0.685]
Epoch 12:  83%|████████▎ | 97/117 [00:04<00:00, 22.91it/s, loss=2.9, v_num=1, val_acc=0.685]
Epoch 12:  83%|████████▎ | 97/117 [00:04<00:00, 22.78it/s, loss=2.94, v_num=1, val_acc=0.685]

Validation: 0it [00:00, ?it/s]

Validation:   0%|          | 0/20 [00:00<?, ?it/s]

Validation DataLoader 0:   0%|          | 0/20 [00:00<?, ?it/s]

Validation DataLoader 0:   5%|▌         | 1/20 [00:00<00:00, 177.03it/s]
Epoch 12:  84%|████████▍ | 98/117 [00:05<00:00, 19.14it/s, loss=2.94, v_num=1, val_acc=0.685]

Validation DataLoader 0:  10%|█         | 2/20 [00:00<00:00, 55.55it/s]
Epoch 12:  85%|████████▍ | 99/117 [00:05<00:00, 19.22it/s, loss=2.94, v_num=1, val_acc=0.685]

Validation DataLoader 0:  15%|█▌        | 3/20 [00:00<00:00, 44.50it/s]
Epoch 12:  85%|████████▌ | 100/117 [00:05<00:00, 19.29it/s, loss=2.94, v_num=1, val_acc=0.685]

Validation DataLoader 0:  20%|██        | 4/20 [00:00<00:00, 40.38it/s]
Epoch 12:  86%|████████▋ | 101/117 [00:05<00:00, 19.37it/s, loss=2.94, v_num=1, val_acc=0.685]

Validation DataLoader 0:  25%|██▌       | 5/20 [00:00<00:00, 38.14it/s]
Epoch 12:  87%|████████▋ | 102/117 [00:05<00:00, 19.44it/s, loss=2.94, v_num=1, val_acc=0.685]

Validation DataLoader 0:  30%|███       | 6/20 [00:00<00:00, 36.90it/s]
Epoch 12:  88%|████████▊ | 103/117 [00:05<00:00, 19.51it/s, loss=2.94, v_num=1, val_acc=0.685]

Validation DataLoader 0:  35%|███▌      | 7/20 [00:00<00:00, 35.82it/s]
Epoch 12:  89%|████████▉ | 104/117 [00:05<00:00, 19.58it/s, loss=2.94, v_num=1, val_acc=0.685]

Validation DataLoader 0:  40%|████      | 8/20 [00:00<00:00, 35.39it/s]
Epoch 12:  90%|████████▉ | 105/117 [00:05<00:00, 19.66it/s, loss=2.94, v_num=1, val_acc=0.685]

Validation DataLoader 0:  45%|████▌     | 9/20 [00:00<00:00, 34.94it/s]
Epoch 12:  91%|█████████ | 106/117 [00:05<00:00, 19.73it/s, loss=2.94, v_num=1, val_acc=0.685]

Validation DataLoader 0:  50%|█████     | 10/20 [00:00<00:00, 34.56it/s]
Epoch 12:  91%|█████████▏| 107/117 [00:05<00:00, 19.80it/s, loss=2.94, v_num=1, val_acc=0.685]

Validation DataLoader 0:  55%|█████▌    | 11/20 [00:00<00:00, 34.30it/s]
Epoch 12:  92%|█████████▏| 108/117 [00:05<00:00, 19.87it/s, loss=2.94, v_num=1, val_acc=0.685]

Validation DataLoader 0:  60%|██████    | 12/20 [00:00<00:00, 34.07it/s]
Epoch 12:  93%|█████████▎| 109/117 [00:05<00:00, 19.93it/s, loss=2.94, v_num=1, val_acc=0.685]

Validation DataLoader 0:  65%|██████▌   | 13/20 [00:00<00:00, 33.88it/s]
Epoch 12:  94%|█████████▍| 110/117 [00:05<00:00, 20.00it/s, loss=2.94, v_num=1, val_acc=0.685]

Validation DataLoader 0:  70%|███████   | 14/20 [00:00<00:00, 33.70it/s]
Epoch 12:  95%|█████████▍| 111/117 [00:05<00:00, 20.07it/s, loss=2.94, v_num=1, val_acc=0.685]

Validation DataLoader 0:  75%|███████▌  | 15/20 [00:00<00:00, 33.57it/s]
Epoch 12:  96%|█████████▌| 112/117 [00:05<00:00, 20.13it/s, loss=2.94, v_num=1, val_acc=0.685]

Validation DataLoader 0:  80%|████████  | 16/20 [00:00<00:00, 33.43it/s]
Epoch 12:  97%|█████████▋| 113/117 [00:05<00:00, 20.20it/s, loss=2.94, v_num=1, val_acc=0.685]

Validation DataLoader 0:  85%|████████▌ | 17/20 [00:00<00:00, 33.31it/s]
Epoch 12:  97%|█████████▋| 114/117 [00:05<00:00, 20.26it/s, loss=2.94, v_num=1, val_acc=0.685]

Validation DataLoader 0:  90%|█████████ | 18/20 [00:00<00:00, 33.21it/s]
Epoch 12:  98%|█████████▊| 115/117 [00:05<00:00, 20.33it/s, loss=2.94, v_num=1, val_acc=0.685]

Validation DataLoader 0:  95%|█████████▌| 19/20 [00:00<00:00, 33.13it/s]
Epoch 12:  99%|█████████▉| 116/117 [00:05<00:00, 20.39it/s, loss=2.94, v_num=1, val_acc=0.685]

Validation DataLoader 0: 100%|██████████| 20/20 [00:00<00:00, 33.12it/s]
Epoch 12: 100%|██████████| 117/117 [00:05<00:00, 20.46it/s, loss=2.94, v_num=1, val_acc=0.685]
Epoch 12: 100%|██████████| 117/117 [00:05<00:00, 20.38it/s, loss=2.94, v_num=1, val_acc=0.671]


Epoch 12: 100%|██████████| 117/117 [00:05<00:00, 20.38it/s, loss=2.94, v_num=1, val_acc=0.671]
Epoch 12:   0%|          | 0/117 [00:00<?, ?it/s, loss=2.94, v_num=1, val_acc=0.671]
Epoch 13:   0%|          | 0/117 [00:00<?, ?it/s, loss=2.94, v_num=1, val_acc=0.671]
Epoch 13:   1%|          | 1/117 [00:00<01:45,  1.10it/s, loss=2.94, v_num=1, val_acc=0.671]
Epoch 13:   1%|          | 1/117 [00:00<01:48,  1.07it/s, loss=2.92, v_num=1, val_acc=0.671]
Epoch 13:   2%|▏         | 2/117 [00:00<00:55,  2.09it/s, loss=2.92, v_num=1, val_acc=0.671]
Epoch 13:   2%|▏         | 2/117 [00:00<00:56,  2.04it/s, loss=2.83, v_num=1, val_acc=0.671]
Epoch 13:   3%|▎         | 3/117 [00:00<00:37,  3.03it/s, loss=2.83, v_num=1, val_acc=0.671]
Epoch 13:   3%|▎         | 3/117 [00:01<00:38,  2.95it/s, loss=2.86, v_num=1, val_acc=0.671]
Epoch 13:   3%|▎         | 4/117 [00:01<00:28,  3.90it/s, loss=2.86, v_num=1, val_acc=0.671]
Epoch 13:   3%|▎         | 4/117 [00:01<00:29,  3.81it/s, loss=2.87, v_num=1, val_acc=0.671]
Epoch 13:   4%|▍         | 5/117 [00:01<00:23,  4.72it/s, loss=2.87, v_num=1, val_acc=0.671]
Epoch 13:   4%|▍         | 5/117 [00:01<00:24,  4.61it/s, loss=3, v_num=1, val_acc=0.671]
Epoch 13:   5%|▌         | 6/117 [00:01<00:20,  5.49it/s, loss=3, v_num=1, val_acc=0.671]
Epoch 13:   5%|▌         | 6/117 [00:01<00:20,  5.37it/s, loss=3.03, v_num=1, val_acc=0.671]
Epoch 13:   6%|▌         | 7/117 [00:01<00:17,  6.22it/s, loss=3.03, v_num=1, val_acc=0.671]
Epoch 13:   6%|▌         | 7/117 [00:01<00:18,  6.08it/s, loss=3.11, v_num=1, val_acc=0.671]
Epoch 13:   7%|▋         | 8/117 [00:01<00:15,  6.90it/s, loss=3.11, v_num=1, val_acc=0.671]
Epoch 13:   7%|▋         | 8/117 [00:01<00:16,  6.75it/s, loss=3.26, v_num=1, val_acc=0.671]
Epoch 13:   8%|▊         | 9/117 [00:01<00:14,  7.53it/s, loss=3.26, v_num=1, val_acc=0.671]
Epoch 13:   8%|▊         | 9/117 [00:01<00:14,  7.38it/s, loss=3.36, v_num=1, val_acc=0.671]
Epoch 13:   9%|▊         | 10/117 [00:01<00:13,  8.10it/s, loss=3.36, v_num=1, val_acc=0.671]
Epoch 13:   9%|▊         | 10/117 [00:01<00:13,  7.94it/s, loss=3.4, v_num=1, val_acc=0.671]
Epoch 13:   9%|▉         | 11/117 [00:01<00:12,  8.68it/s, loss=3.4, v_num=1, val_acc=0.671]
Epoch 13:   9%|▉         | 11/117 [00:01<00:12,  8.51it/s, loss=3.42, v_num=1, val_acc=0.671]
Epoch 13:  10%|█         | 12/117 [00:01<00:11,  9.22it/s, loss=3.42, v_num=1, val_acc=0.671]
Epoch 13:  10%|█         | 12/117 [00:01<00:11,  9.04it/s, loss=3.44, v_num=1, val_acc=0.671]
Epoch 13:  11%|█         | 13/117 [00:01<00:10,  9.74it/s, loss=3.44, v_num=1, val_acc=0.671]
Epoch 13:  11%|█         | 13/117 [00:01<00:10,  9.55it/s, loss=3.6, v_num=1, val_acc=0.671]
Epoch 13:  12%|█▏        | 14/117 [00:01<00:10, 10.22it/s, loss=3.6, v_num=1, val_acc=0.671]
Epoch 13:  12%|█▏        | 14/117 [00:01<00:10, 10.04it/s, loss=3.62, v_num=1, val_acc=0.671]
Epoch 13:  13%|█▎        | 15/117 [00:01<00:09, 10.69it/s, loss=3.62, v_num=1, val_acc=0.671]
Epoch 13:  13%|█▎        | 15/117 [00:01<00:09, 10.50it/s, loss=3.6, v_num=1, val_acc=0.671]
Epoch 13:  14%|█▎        | 16/117 [00:01<00:09, 11.13it/s, loss=3.6, v_num=1, val_acc=0.671]
Epoch 13:  14%|█▎        | 16/117 [00:01<00:09, 10.94it/s, loss=3.58, v_num=1, val_acc=0.671]
Epoch 13:  15%|█▍        | 17/117 [00:01<00:08, 11.54it/s, loss=3.58, v_num=1, val_acc=0.671]
Epoch 13:  15%|█▍        | 17/117 [00:01<00:08, 11.34it/s, loss=3.56, v_num=1, val_acc=0.671]
Epoch 13:  15%|█▌        | 18/117 [00:01<00:08, 11.92it/s, loss=3.56, v_num=1, val_acc=0.671]
Epoch 13:  15%|█▌        | 18/117 [00:01<00:08, 11.73it/s, loss=3.55, v_num=1, val_acc=0.671]
Epoch 13:  16%|█▌        | 19/117 [00:01<00:07, 12.31it/s, loss=3.55, v_num=1, val_acc=0.671]
Epoch 13:  16%|█▌        | 19/117 [00:01<00:08, 12.11it/s, loss=3.46, v_num=1, val_acc=0.671]
Epoch 13:  17%|█▋        | 20/117 [00:01<00:07, 12.68it/s, loss=3.46, v_num=1, val_acc=0.671]
Epoch 13:  17%|█▋        | 20/117 [00:01<00:07, 12.48it/s, loss=3.46, v_num=1, val_acc=0.671]
Epoch 13:  18%|█▊        | 21/117 [00:01<00:07, 13.04it/s, loss=3.46, v_num=1, val_acc=0.671]
Epoch 13:  18%|█▊        | 21/117 [00:01<00:07, 12.84it/s, loss=3.49, v_num=1, val_acc=0.671]
Epoch 13:  19%|█▉        | 22/117 [00:01<00:07, 13.38it/s, loss=3.49, v_num=1, val_acc=0.671]
Epoch 13:  19%|█▉        | 22/117 [00:01<00:07, 13.17it/s, loss=3.5, v_num=1, val_acc=0.671]
Epoch 13:  20%|█▉        | 23/117 [00:01<00:06, 13.70it/s, loss=3.5, v_num=1, val_acc=0.671]
Epoch 13:  20%|█▉        | 23/117 [00:01<00:06, 13.49it/s, loss=3.42, v_num=1, val_acc=0.671]
Epoch 13:  21%|██        | 24/117 [00:01<00:06, 14.00it/s, loss=3.42, v_num=1, val_acc=0.671]
Epoch 13:  21%|██        | 24/117 [00:01<00:06, 13.80it/s, loss=3.35, v_num=1, val_acc=0.671]
Epoch 13:  21%|██▏       | 25/117 [00:01<00:06, 14.29it/s, loss=3.35, v_num=1, val_acc=0.671]
Epoch 13:  21%|██▏       | 25/117 [00:01<00:06, 14.09it/s, loss=3.24, v_num=1, val_acc=0.671]
Epoch 13:  22%|██▏       | 26/117 [00:01<00:06, 14.57it/s, loss=3.24, v_num=1, val_acc=0.671]
Epoch 13:  22%|██▏       | 26/117 [00:01<00:06, 14.37it/s, loss=3.2, v_num=1, val_acc=0.671]
Epoch 13:  23%|██▎       | 27/117 [00:01<00:06, 14.85it/s, loss=3.2, v_num=1, val_acc=0.671]
Epoch 13:  23%|██▎       | 27/117 [00:01<00:06, 14.65it/s, loss=3.12, v_num=1, val_acc=0.671]
Epoch 13:  24%|██▍       | 28/117 [00:01<00:05, 15.12it/s, loss=3.12, v_num=1, val_acc=0.671]
Epoch 13:  24%|██▍       | 28/117 [00:01<00:05, 14.92it/s, loss=2.99, v_num=1, val_acc=0.671]
Epoch 13:  25%|██▍       | 29/117 [00:01<00:05, 15.38it/s, loss=2.99, v_num=1, val_acc=0.671]
Epoch 13:  25%|██▍       | 29/117 [00:01<00:05, 15.17it/s, loss=2.9, v_num=1, val_acc=0.671]
Epoch 13:  26%|██▌       | 30/117 [00:01<00:05, 15.62it/s, loss=2.9, v_num=1, val_acc=0.671]
Epoch 13:  26%|██▌       | 30/117 [00:01<00:05, 15.42it/s, loss=2.87, v_num=1, val_acc=0.671]
Epoch 13:  26%|██▋       | 31/117 [00:01<00:05, 15.85it/s, loss=2.87, v_num=1, val_acc=0.671]
Epoch 13:  26%|██▋       | 31/117 [00:01<00:05, 15.65it/s, loss=2.85, v_num=1, val_acc=0.671]
Epoch 13:  27%|██▋       | 32/117 [00:01<00:05, 16.08it/s, loss=2.85, v_num=1, val_acc=0.671]
Epoch 13:  27%|██▋       | 32/117 [00:02<00:05, 15.88it/s, loss=2.82, v_num=1, val_acc=0.671]
Epoch 13:  28%|██▊       | 33/117 [00:02<00:05, 16.29it/s, loss=2.82, v_num=1, val_acc=0.671]
Epoch 13:  28%|██▊       | 33/117 [00:02<00:05, 16.09it/s, loss=2.66, v_num=1, val_acc=0.671]
Epoch 13:  29%|██▉       | 34/117 [00:02<00:05, 16.49it/s, loss=2.66, v_num=1, val_acc=0.671]
Epoch 13:  29%|██▉       | 34/117 [00:02<00:05, 16.30it/s, loss=2.6, v_num=1, val_acc=0.671]
Epoch 13:  30%|██▉       | 35/117 [00:02<00:04, 16.71it/s, loss=2.6, v_num=1, val_acc=0.671]
Epoch 13:  30%|██▉       | 35/117 [00:02<00:04, 16.51it/s, loss=2.62, v_num=1, val_acc=0.671]
Epoch 13:  31%|███       | 36/117 [00:02<00:04, 16.91it/s, loss=2.62, v_num=1, val_acc=0.671]
Epoch 13:  31%|███       | 36/117 [00:02<00:04, 16.71it/s, loss=2.68, v_num=1, val_acc=0.671]
Epoch 13:  32%|███▏      | 37/117 [00:02<00:04, 17.10it/s, loss=2.68, v_num=1, val_acc=0.671]
Epoch 13:  32%|███▏      | 37/117 [00:02<00:04, 16.90it/s, loss=2.75, v_num=1, val_acc=0.671]
Epoch 13:  32%|███▏      | 38/117 [00:02<00:04, 17.28it/s, loss=2.75, v_num=1, val_acc=0.671]
Epoch 13:  32%|███▏      | 38/117 [00:02<00:04, 17.09it/s, loss=2.83, v_num=1, val_acc=0.671]
Epoch 13:  33%|███▎      | 39/117 [00:02<00:04, 17.46it/s, loss=2.83, v_num=1, val_acc=0.671]
Epoch 13:  33%|███▎      | 39/117 [00:02<00:04, 17.27it/s, loss=2.97, v_num=1, val_acc=0.671]
Epoch 13:  34%|███▍      | 40/117 [00:02<00:04, 17.62it/s, loss=2.97, v_num=1, val_acc=0.671]
Epoch 13:  34%|███▍      | 40/117 [00:02<00:04, 17.43it/s, loss=3.05, v_num=1, val_acc=0.671]
Epoch 13:  35%|███▌      | 41/117 [00:02<00:04, 17.79it/s, loss=3.05, v_num=1, val_acc=0.671]
Epoch 13:  35%|███▌      | 41/117 [00:02<00:04, 17.60it/s, loss=3.1, v_num=1, val_acc=0.671]
Epoch 13:  36%|███▌      | 42/117 [00:02<00:04, 17.95it/s, loss=3.1, v_num=1, val_acc=0.671]
Epoch 13:  36%|███▌      | 42/117 [00:02<00:04, 17.76it/s, loss=3.03, v_num=1, val_acc=0.671]
Epoch 13:  37%|███▋      | 43/117 [00:02<00:04, 18.12it/s, loss=3.03, v_num=1, val_acc=0.671]
Epoch 13:  37%|███▋      | 43/117 [00:02<00:04, 17.92it/s, loss=3.01, v_num=1, val_acc=0.671]
Epoch 13:  38%|███▊      | 44/117 [00:02<00:03, 18.27it/s, loss=3.01, v_num=1, val_acc=0.671]
Epoch 13:  38%|███▊      | 44/117 [00:02<00:04, 18.08it/s, loss=3.02, v_num=1, val_acc=0.671]
Epoch 13:  38%|███▊      | 45/117 [00:02<00:03, 18.42it/s, loss=3.02, v_num=1, val_acc=0.671]
Epoch 13:  38%|███▊      | 45/117 [00:02<00:03, 18.23it/s, loss=3.03, v_num=1, val_acc=0.671]
Epoch 13:  39%|███▉      | 46/117 [00:02<00:03, 18.57it/s, loss=3.03, v_num=1, val_acc=0.671]
Epoch 13:  39%|███▉      | 46/117 [00:02<00:03, 18.38it/s, loss=3.1, v_num=1, val_acc=0.671]
Epoch 13:  40%|████      | 47/117 [00:02<00:03, 18.71it/s, loss=3.1, v_num=1, val_acc=0.671]
Epoch 13:  40%|████      | 47/117 [00:02<00:03, 18.52it/s, loss=3.06, v_num=1, val_acc=0.671]
Epoch 13:  41%|████      | 48/117 [00:02<00:03, 18.85it/s, loss=3.06, v_num=1, val_acc=0.671]
Epoch 13:  41%|████      | 48/117 [00:02<00:03, 18.66it/s, loss=3.06, v_num=1, val_acc=0.671]
Epoch 13:  42%|████▏     | 49/117 [00:02<00:03, 18.98it/s, loss=3.06, v_num=1, val_acc=0.671]
Epoch 13:  42%|████▏     | 49/117 [00:02<00:03, 18.80it/s, loss=3.09, v_num=1, val_acc=0.671]
Epoch 13:  43%|████▎     | 50/117 [00:02<00:03, 19.11it/s, loss=3.09, v_num=1, val_acc=0.671]
Epoch 13:  43%|████▎     | 50/117 [00:02<00:03, 18.93it/s, loss=3.06, v_num=1, val_acc=0.671]
Epoch 13:  44%|████▎     | 51/117 [00:02<00:03, 19.24it/s, loss=3.06, v_num=1, val_acc=0.671]
Epoch 13:  44%|████▎     | 51/117 [00:02<00:03, 19.06it/s, loss=3.03, v_num=1, val_acc=0.671]
Epoch 13:  44%|████▍     | 52/117 [00:02<00:03, 19.37it/s, loss=3.03, v_num=1, val_acc=0.671]
Epoch 13:  44%|████▍     | 52/117 [00:02<00:03, 19.19it/s, loss=3.01, v_num=1, val_acc=0.671]
Epoch 13:  45%|████▌     | 53/117 [00:02<00:03, 19.49it/s, loss=3.01, v_num=1, val_acc=0.671]
Epoch 13:  45%|████▌     | 53/117 [00:02<00:03, 19.31it/s, loss=3.11, v_num=1, val_acc=0.671]
Epoch 13:  46%|████▌     | 54/117 [00:02<00:03, 19.61it/s, loss=3.11, v_num=1, val_acc=0.671]
Epoch 13:  46%|████▌     | 54/117 [00:02<00:03, 19.43it/s, loss=3.21, v_num=1, val_acc=0.671]
Epoch 13:  47%|████▋     | 55/117 [00:02<00:03, 19.72it/s, loss=3.21, v_num=1, val_acc=0.671]
Epoch 13:  47%|████▋     | 55/117 [00:02<00:03, 19.54it/s, loss=3.25, v_num=1, val_acc=0.671]
Epoch 13:  48%|████▊     | 56/117 [00:02<00:03, 19.83it/s, loss=3.25, v_num=1, val_acc=0.671]
Epoch 13:  48%|████▊     | 56/117 [00:02<00:03, 19.66it/s, loss=3.29, v_num=1, val_acc=0.671]
Epoch 13:  49%|████▊     | 57/117 [00:02<00:03, 19.94it/s, loss=3.29, v_num=1, val_acc=0.671]
Epoch 13:  49%|████▊     | 57/117 [00:02<00:03, 19.77it/s, loss=3.29, v_num=1, val_acc=0.671]
Epoch 13:  50%|████▉     | 58/117 [00:02<00:02, 20.05it/s, loss=3.29, v_num=1, val_acc=0.671]
Epoch 13:  50%|████▉     | 58/117 [00:02<00:02, 19.88it/s, loss=3.2, v_num=1, val_acc=0.671]
Epoch 13:  50%|█████     | 59/117 [00:02<00:02, 20.16it/s, loss=3.2, v_num=1, val_acc=0.671]
Epoch 13:  50%|█████     | 59/117 [00:02<00:02, 19.99it/s, loss=3.12, v_num=1, val_acc=0.671]
Epoch 13:  51%|█████▏    | 60/117 [00:02<00:02, 20.26it/s, loss=3.12, v_num=1, val_acc=0.671]
Epoch 13:  51%|█████▏    | 60/117 [00:02<00:02, 20.09it/s, loss=3.11, v_num=1, val_acc=0.671]
Epoch 13:  52%|█████▏    | 61/117 [00:02<00:02, 20.36it/s, loss=3.11, v_num=1, val_acc=0.671]
Epoch 13:  52%|█████▏    | 61/117 [00:03<00:02, 20.19it/s, loss=3.03, v_num=1, val_acc=0.671]
Epoch 13:  53%|█████▎    | 62/117 [00:03<00:02, 20.45it/s, loss=3.03, v_num=1, val_acc=0.671]
Epoch 13:  53%|█████▎    | 62/117 [00:03<00:02, 20.29it/s, loss=3.06, v_num=1, val_acc=0.671]
Epoch 13:  54%|█████▍    | 63/117 [00:03<00:02, 20.55it/s, loss=3.06, v_num=1, val_acc=0.671]
Epoch 13:  54%|█████▍    | 63/117 [00:03<00:02, 20.38it/s, loss=3.08, v_num=1, val_acc=0.671]
Epoch 13:  55%|█████▍    | 64/117 [00:03<00:02, 20.64it/s, loss=3.08, v_num=1, val_acc=0.671]
Epoch 13:  55%|█████▍    | 64/117 [00:03<00:02, 20.48it/s, loss=3.09, v_num=1, val_acc=0.671]
Epoch 13:  56%|█████▌    | 65/117 [00:03<00:02, 20.73it/s, loss=3.09, v_num=1, val_acc=0.671]
Epoch 13:  56%|█████▌    | 65/117 [00:03<00:02, 20.57it/s, loss=3.09, v_num=1, val_acc=0.671]
Epoch 13:  56%|█████▋    | 66/117 [00:03<00:02, 20.82it/s, loss=3.09, v_num=1, val_acc=0.671]
Epoch 13:  56%|█████▋    | 66/117 [00:03<00:02, 20.65it/s, loss=3.04, v_num=1, val_acc=0.671]
Epoch 13:  57%|█████▋    | 67/117 [00:03<00:02, 20.91it/s, loss=3.04, v_num=1, val_acc=0.671]
Epoch 13:  57%|█████▋    | 67/117 [00:03<00:02, 20.74it/s, loss=3.04, v_num=1, val_acc=0.671]
Epoch 13:  58%|█████▊    | 68/117 [00:03<00:02, 20.99it/s, loss=3.04, v_num=1, val_acc=0.671]
Epoch 13:  58%|█████▊    | 68/117 [00:03<00:02, 20.83it/s, loss=3.08, v_num=1, val_acc=0.671]
Epoch 13:  59%|█████▉    | 69/117 [00:03<00:02, 21.08it/s, loss=3.08, v_num=1, val_acc=0.671]
Epoch 13:  59%|█████▉    | 69/117 [00:03<00:02, 20.92it/s, loss=3.04, v_num=1, val_acc=0.671]
Epoch 13:  60%|█████▉    | 70/117 [00:03<00:02, 21.16it/s, loss=3.04, v_num=1, val_acc=0.671]
Epoch 13:  60%|█████▉    | 70/117 [00:03<00:02, 21.00it/s, loss=3, v_num=1, val_acc=0.671]
Epoch 13:  61%|██████    | 71/117 [00:03<00:02, 21.24it/s, loss=3, v_num=1, val_acc=0.671]
Epoch 13:  61%|██████    | 71/117 [00:03<00:02, 21.08it/s, loss=3.01, v_num=1, val_acc=0.671]
Epoch 13:  62%|██████▏   | 72/117 [00:03<00:02, 21.32it/s, loss=3.01, v_num=1, val_acc=0.671]
Epoch 13:  62%|██████▏   | 72/117 [00:03<00:02, 21.16it/s, loss=2.95, v_num=1, val_acc=0.671]
Epoch 13:  62%|██████▏   | 73/117 [00:03<00:02, 21.39it/s, loss=2.95, v_num=1, val_acc=0.671]
Epoch 13:  62%|██████▏   | 73/117 [00:03<00:02, 21.24it/s, loss=2.84, v_num=1, val_acc=0.671]
Epoch 13:  63%|██████▎   | 74/117 [00:03<00:02, 21.47it/s, loss=2.84, v_num=1, val_acc=0.671]
Epoch 13:  63%|██████▎   | 74/117 [00:03<00:02, 21.31it/s, loss=2.71, v_num=1, val_acc=0.671]
Epoch 13:  64%|██████▍   | 75/117 [00:03<00:01, 21.54it/s, loss=2.71, v_num=1, val_acc=0.671]
Epoch 13:  64%|██████▍   | 75/117 [00:03<00:01, 21.39it/s, loss=2.62, v_num=1, val_acc=0.671]
Epoch 13:  65%|██████▍   | 76/117 [00:03<00:01, 21.62it/s, loss=2.62, v_num=1, val_acc=0.671]
Epoch 13:  65%|██████▍   | 76/117 [00:03<00:01, 21.46it/s, loss=2.53, v_num=1, val_acc=0.671]
Epoch 13:  66%|██████▌   | 77/117 [00:03<00:01, 21.69it/s, loss=2.53, v_num=1, val_acc=0.671]
Epoch 13:  66%|██████▌   | 77/117 [00:03<00:01, 21.54it/s, loss=2.49, v_num=1, val_acc=0.671]
Epoch 13:  67%|██████▋   | 78/117 [00:03<00:01, 21.76it/s, loss=2.49, v_num=1, val_acc=0.671]
Epoch 13:  67%|██████▋   | 78/117 [00:03<00:01, 21.61it/s, loss=2.55, v_num=1, val_acc=0.671]
Epoch 13:  68%|██████▊   | 79/117 [00:03<00:01, 21.82it/s, loss=2.55, v_num=1, val_acc=0.671]
Epoch 13:  68%|██████▊   | 79/117 [00:03<00:01, 21.68it/s, loss=2.72, v_num=1, val_acc=0.671]
Epoch 13:  68%|██████▊   | 80/117 [00:03<00:01, 21.89it/s, loss=2.72, v_num=1, val_acc=0.671]
Epoch 13:  68%|██████▊   | 80/117 [00:03<00:01, 21.74it/s, loss=2.79, v_num=1, val_acc=0.671]
Epoch 13:  69%|██████▉   | 81/117 [00:03<00:01, 21.96it/s, loss=2.79, v_num=1, val_acc=0.671]
Epoch 13:  69%|██████▉   | 81/117 [00:03<00:01, 21.81it/s, loss=2.93, v_num=1, val_acc=0.671]
Epoch 13:  70%|███████   | 82/117 [00:03<00:01, 21.99it/s, loss=2.93, v_num=1, val_acc=0.671]
Epoch 13:  70%|███████   | 82/117 [00:03<00:01, 21.84it/s, loss=2.96, v_num=1, val_acc=0.671]
Epoch 13:  71%|███████   | 83/117 [00:03<00:01, 22.06it/s, loss=2.96, v_num=1, val_acc=0.671]
Epoch 13:  71%|███████   | 83/117 [00:03<00:01, 21.91it/s, loss=2.98, v_num=1, val_acc=0.671]
Epoch 13:  72%|███████▏  | 84/117 [00:03<00:01, 22.12it/s, loss=2.98, v_num=1, val_acc=0.671]
Epoch 13:  72%|███████▏  | 84/117 [00:03<00:01, 21.97it/s, loss=2.99, v_num=1, val_acc=0.671]
Epoch 13:  73%|███████▎  | 85/117 [00:03<00:01, 22.18it/s, loss=2.99, v_num=1, val_acc=0.671]
Epoch 13:  73%|███████▎  | 85/117 [00:03<00:01, 22.04it/s, loss=2.96, v_num=1, val_acc=0.671]
Epoch 13:  74%|███████▎  | 86/117 [00:03<00:01, 22.24it/s, loss=2.96, v_num=1, val_acc=0.671]
Epoch 13:  74%|███████▎  | 86/117 [00:03<00:01, 22.10it/s, loss=2.96, v_num=1, val_acc=0.671]
Epoch 13:  74%|███████▍  | 87/117 [00:03<00:01, 22.31it/s, loss=2.96, v_num=1, val_acc=0.671]
Epoch 13:  74%|███████▍  | 87/117 [00:03<00:01, 22.16it/s, loss=2.91, v_num=1, val_acc=0.671]
Epoch 13:  75%|███████▌  | 88/117 [00:03<00:01, 22.37it/s, loss=2.91, v_num=1, val_acc=0.671]
Epoch 13:  75%|███████▌  | 88/117 [00:03<00:01, 22.22it/s, loss=2.85, v_num=1, val_acc=0.671]
Epoch 13:  76%|███████▌  | 89/117 [00:03<00:01, 22.43it/s, loss=2.85, v_num=1, val_acc=0.671]
Epoch 13:  76%|███████▌  | 89/117 [00:03<00:01, 22.28it/s, loss=2.85, v_num=1, val_acc=0.671]
Epoch 13:  77%|███████▋  | 90/117 [00:04<00:01, 22.48it/s, loss=2.85, v_num=1, val_acc=0.671]
Epoch 13:  77%|███████▋  | 90/117 [00:04<00:01, 22.34it/s, loss=2.85, v_num=1, val_acc=0.671]
Epoch 13:  78%|███████▊  | 91/117 [00:04<00:01, 22.54it/s, loss=2.85, v_num=1, val_acc=0.671]
Epoch 13:  78%|███████▊  | 91/117 [00:04<00:01, 22.40it/s, loss=2.81, v_num=1, val_acc=0.671]
Epoch 13:  79%|███████▊  | 92/117 [00:04<00:01, 22.59it/s, loss=2.81, v_num=1, val_acc=0.671]
Epoch 13:  79%|███████▊  | 92/117 [00:04<00:01, 22.45it/s, loss=2.8, v_num=1, val_acc=0.671]
Epoch 13:  79%|███████▉  | 93/117 [00:04<00:01, 22.65it/s, loss=2.8, v_num=1, val_acc=0.671]
Epoch 13:  79%|███████▉  | 93/117 [00:04<00:01, 22.51it/s, loss=2.83, v_num=1, val_acc=0.671]
Epoch 13:  80%|████████  | 94/117 [00:04<00:01, 22.70it/s, loss=2.83, v_num=1, val_acc=0.671]
Epoch 13:  80%|████████  | 94/117 [00:04<00:01, 22.56it/s, loss=2.92, v_num=1, val_acc=0.671]
Epoch 13:  81%|████████  | 95/117 [00:04<00:00, 22.76it/s, loss=2.92, v_num=1, val_acc=0.671]
Epoch 13:  81%|████████  | 95/117 [00:04<00:00, 22.62it/s, loss=3.02, v_num=1, val_acc=0.671]
Epoch 13:  82%|████████▏ | 96/117 [00:04<00:00, 22.81it/s, loss=3.02, v_num=1, val_acc=0.671]
Epoch 13:  82%|████████▏ | 96/117 [00:04<00:00, 22.67it/s, loss=3.12, v_num=1, val_acc=0.671]
Epoch 13:  83%|████████▎ | 97/117 [00:04<00:00, 22.86it/s, loss=3.12, v_num=1, val_acc=0.671]
Epoch 13:  83%|████████▎ | 97/117 [00:04<00:00, 22.72it/s, loss=3.2, v_num=1, val_acc=0.671]

Validation: 0it [00:00, ?it/s]

Validation:   0%|          | 0/20 [00:00<?, ?it/s]

Validation DataLoader 0:   0%|          | 0/20 [00:00<?, ?it/s]

Validation DataLoader 0:   5%|▌         | 1/20 [00:00<00:00, 194.09it/s]
Epoch 13:  84%|████████▍ | 98/117 [00:05<00:00, 19.09it/s, loss=3.2, v_num=1, val_acc=0.671]

Validation DataLoader 0:  10%|█         | 2/20 [00:00<00:00, 56.51it/s]
Epoch 13:  85%|████████▍ | 99/117 [00:05<00:00, 19.18it/s, loss=3.2, v_num=1, val_acc=0.671]

Validation DataLoader 0:  15%|█▌        | 3/20 [00:00<00:00, 44.70it/s]
Epoch 13:  85%|████████▌ | 100/117 [00:05<00:00, 19.25it/s, loss=3.2, v_num=1, val_acc=0.671]

Validation DataLoader 0:  20%|██        | 4/20 [00:00<00:00, 40.64it/s]
Epoch 13:  86%|████████▋ | 101/117 [00:05<00:00, 19.33it/s, loss=3.2, v_num=1, val_acc=0.671]

Validation DataLoader 0:  25%|██▌       | 5/20 [00:00<00:00, 38.34it/s]
Epoch 13:  87%|████████▋ | 102/117 [00:05<00:00, 19.40it/s, loss=3.2, v_num=1, val_acc=0.671]

Validation DataLoader 0:  30%|███       | 6/20 [00:00<00:00, 37.02it/s]
Epoch 13:  88%|████████▊ | 103/117 [00:05<00:00, 19.47it/s, loss=3.2, v_num=1, val_acc=0.671]

Validation DataLoader 0:  35%|███▌      | 7/20 [00:00<00:00, 36.17it/s]
Epoch 13:  89%|████████▉ | 104/117 [00:05<00:00, 19.55it/s, loss=3.2, v_num=1, val_acc=0.671]

Validation DataLoader 0:  40%|████      | 8/20 [00:00<00:00, 35.54it/s]
Epoch 13:  90%|████████▉ | 105/117 [00:05<00:00, 19.62it/s, loss=3.2, v_num=1, val_acc=0.671]

Validation DataLoader 0:  45%|████▌     | 9/20 [00:00<00:00, 35.02it/s]
Epoch 13:  91%|█████████ | 106/117 [00:05<00:00, 19.69it/s, loss=3.2, v_num=1, val_acc=0.671]

Validation DataLoader 0:  50%|█████     | 10/20 [00:00<00:00, 34.69it/s]
Epoch 13:  91%|█████████▏| 107/117 [00:05<00:00, 19.76it/s, loss=3.2, v_num=1, val_acc=0.671]

Validation DataLoader 0:  55%|█████▌    | 11/20 [00:00<00:00, 34.35it/s]
Epoch 13:  92%|█████████▏| 108/117 [00:05<00:00, 19.83it/s, loss=3.2, v_num=1, val_acc=0.671]

Validation DataLoader 0:  60%|██████    | 12/20 [00:00<00:00, 34.11it/s]
Epoch 13:  93%|█████████▎| 109/117 [00:05<00:00, 19.89it/s, loss=3.2, v_num=1, val_acc=0.671]

Validation DataLoader 0:  65%|██████▌   | 13/20 [00:00<00:00, 33.91it/s]
Epoch 13:  94%|█████████▍| 110/117 [00:05<00:00, 19.96it/s, loss=3.2, v_num=1, val_acc=0.671]

Validation DataLoader 0:  70%|███████   | 14/20 [00:00<00:00, 33.71it/s]
Epoch 13:  95%|█████████▍| 111/117 [00:05<00:00, 20.03it/s, loss=3.2, v_num=1, val_acc=0.671]

Validation DataLoader 0:  75%|███████▌  | 15/20 [00:00<00:00, 33.58it/s]
Epoch 13:  96%|█████████▌| 112/117 [00:05<00:00, 20.09it/s, loss=3.2, v_num=1, val_acc=0.671]

Validation DataLoader 0:  80%|████████  | 16/20 [00:00<00:00, 33.44it/s]
Epoch 13:  97%|█████████▋| 113/117 [00:05<00:00, 20.16it/s, loss=3.2, v_num=1, val_acc=0.671]

Validation DataLoader 0:  85%|████████▌ | 17/20 [00:00<00:00, 33.32it/s]
Epoch 13:  97%|█████████▋| 114/117 [00:05<00:00, 20.22it/s, loss=3.2, v_num=1, val_acc=0.671]

Validation DataLoader 0:  90%|█████████ | 18/20 [00:00<00:00, 33.23it/s]
Epoch 13:  98%|█████████▊| 115/117 [00:05<00:00, 20.29it/s, loss=3.2, v_num=1, val_acc=0.671]

Validation DataLoader 0:  95%|█████████▌| 19/20 [00:00<00:00, 33.13it/s]
Epoch 13:  99%|█████████▉| 116/117 [00:05<00:00, 20.35it/s, loss=3.2, v_num=1, val_acc=0.671]

Validation DataLoader 0: 100%|██████████| 20/20 [00:00<00:00, 33.12it/s]
Epoch 13: 100%|██████████| 117/117 [00:05<00:00, 20.41it/s, loss=3.2, v_num=1, val_acc=0.671]
Epoch 13: 100%|██████████| 117/117 [00:05<00:00, 20.34it/s, loss=3.2, v_num=1, val_acc=0.655]


Epoch 13: 100%|██████████| 117/117 [00:05<00:00, 20.34it/s, loss=3.2, v_num=1, val_acc=0.655]
Epoch 13:   0%|          | 0/117 [00:00<?, ?it/s, loss=3.2, v_num=1, val_acc=0.655]
Epoch 14:   0%|          | 0/117 [00:00<?, ?it/s, loss=3.2, v_num=1, val_acc=0.655]
Epoch 14:   1%|          | 1/117 [00:00<01:48,  1.06it/s, loss=3.2, v_num=1, val_acc=0.655]
Epoch 14:   1%|          | 1/117 [00:00<01:51,  1.04it/s, loss=3.14, v_num=1, val_acc=0.655]
Epoch 14:   2%|▏         | 2/117 [00:00<00:55,  2.06it/s, loss=3.14, v_num=1, val_acc=0.655]
Epoch 14:   2%|▏         | 2/117 [00:00<00:57,  2.01it/s, loss=2.98, v_num=1, val_acc=0.655]
Epoch 14:   3%|▎         | 3/117 [00:01<00:38,  2.99it/s, loss=2.98, v_num=1, val_acc=0.655]
Epoch 14:   3%|▎         | 3/117 [00:01<00:39,  2.91it/s, loss=2.83, v_num=1, val_acc=0.655]
Epoch 14:   3%|▎         | 4/117 [00:01<00:29,  3.85it/s, loss=2.83, v_num=1, val_acc=0.655]
Epoch 14:   3%|▎         | 4/117 [00:01<00:30,  3.76it/s, loss=2.68, v_num=1, val_acc=0.655]
Epoch 14:   4%|▍         | 5/117 [00:01<00:24,  4.66it/s, loss=2.68, v_num=1, val_acc=0.655]
Epoch 14:   4%|▍         | 5/117 [00:01<00:24,  4.56it/s, loss=2.6, v_num=1, val_acc=0.655]
Epoch 14:   5%|▌         | 6/117 [00:01<00:20,  5.42it/s, loss=2.6, v_num=1, val_acc=0.655]
Epoch 14:   5%|▌         | 6/117 [00:01<00:20,  5.30it/s, loss=2.58, v_num=1, val_acc=0.655]
Epoch 14:   6%|▌         | 7/117 [00:01<00:17,  6.14it/s, loss=2.58, v_num=1, val_acc=0.655]
Epoch 14:   6%|▌         | 7/117 [00:01<00:18,  6.01it/s, loss=2.68, v_num=1, val_acc=0.655]
Epoch 14:   7%|▋         | 8/117 [00:01<00:15,  6.82it/s, loss=2.68, v_num=1, val_acc=0.655]
Epoch 14:   7%|▋         | 8/117 [00:01<00:16,  6.67it/s, loss=2.83, v_num=1, val_acc=0.655]
Epoch 14:   8%|▊         | 9/117 [00:01<00:14,  7.41it/s, loss=2.83, v_num=1, val_acc=0.655]
Epoch 14:   8%|▊         | 9/117 [00:01<00:14,  7.26it/s, loss=2.85, v_num=1, val_acc=0.655]
Epoch 14:   9%|▊         | 10/117 [00:01<00:13,  8.00it/s, loss=2.85, v_num=1, val_acc=0.655]
Epoch 14:   9%|▊         | 10/117 [00:01<00:13,  7.84it/s, loss=2.88, v_num=1, val_acc=0.655]
Epoch 14:   9%|▉         | 11/117 [00:01<00:12,  8.57it/s, loss=2.88, v_num=1, val_acc=0.655]
Epoch 14:   9%|▉         | 11/117 [00:01<00:12,  8.41it/s, loss=2.94, v_num=1, val_acc=0.655]
Epoch 14:  10%|█         | 12/117 [00:01<00:11,  9.11it/s, loss=2.94, v_num=1, val_acc=0.655]
Epoch 14:  10%|█         | 12/117 [00:01<00:11,  8.94it/s, loss=2.97, v_num=1, val_acc=0.655]
Epoch 14:  11%|█         | 13/117 [00:01<00:10,  9.63it/s, loss=2.97, v_num=1, val_acc=0.655]
Epoch 14:  11%|█         | 13/117 [00:01<00:11,  9.45it/s, loss=3.04, v_num=1, val_acc=0.655]
Epoch 14:  12%|█▏        | 14/117 [00:01<00:10, 10.11it/s, loss=3.04, v_num=1, val_acc=0.655]
Epoch 14:  12%|█▏        | 14/117 [00:01<00:10,  9.93it/s, loss=3.1, v_num=1, val_acc=0.655]
Epoch 14:  13%|█▎        | 15/117 [00:01<00:09, 10.58it/s, loss=3.1, v_num=1, val_acc=0.655]
Epoch 14:  13%|█▎        | 15/117 [00:01<00:09, 10.39it/s, loss=3.13, v_num=1, val_acc=0.655]
Epoch 14:  14%|█▎        | 16/117 [00:01<00:09, 11.02it/s, loss=3.13, v_num=1, val_acc=0.655]
Epoch 14:  14%|█▎        | 16/117 [00:01<00:09, 10.83it/s, loss=3.13, v_num=1, val_acc=0.655]
Epoch 14:  15%|█▍        | 17/117 [00:01<00:08, 11.37it/s, loss=3.13, v_num=1, val_acc=0.655]
Epoch 14:  15%|█▍        | 17/117 [00:01<00:08, 11.20it/s, loss=3.07, v_num=1, val_acc=0.655]
Epoch 14:  15%|█▌        | 18/117 [00:01<00:08, 11.78it/s, loss=3.07, v_num=1, val_acc=0.655]
Epoch 14:  15%|█▌        | 18/117 [00:01<00:08, 11.59it/s, loss=3, v_num=1, val_acc=0.655]
Epoch 14:  16%|█▌        | 19/117 [00:01<00:08, 12.17it/s, loss=3, v_num=1, val_acc=0.655]
Epoch 14:  16%|█▌        | 19/117 [00:01<00:08, 11.97it/s, loss=2.91, v_num=1, val_acc=0.655]
Epoch 14:  17%|█▋        | 20/117 [00:01<00:07, 12.54it/s, loss=2.91, v_num=1, val_acc=0.655]
Epoch 14:  17%|█▋        | 20/117 [00:01<00:07, 12.34it/s, loss=2.81, v_num=1, val_acc=0.655]
Epoch 14:  18%|█▊        | 21/117 [00:01<00:07, 12.89it/s, loss=2.81, v_num=1, val_acc=0.655]
Epoch 14:  18%|█▊        | 21/117 [00:01<00:07, 12.70it/s, loss=2.81, v_num=1, val_acc=0.655]
Epoch 14:  19%|█▉        | 22/117 [00:01<00:07, 13.22it/s, loss=2.81, v_num=1, val_acc=0.655]
Epoch 14:  19%|█▉        | 22/117 [00:01<00:07, 13.02it/s, loss=2.79, v_num=1, val_acc=0.655]
Epoch 14:  20%|█▉        | 23/117 [00:01<00:06, 13.54it/s, loss=2.79, v_num=1, val_acc=0.655]
Epoch 14:  20%|█▉        | 23/117 [00:01<00:07, 13.34it/s, loss=2.87, v_num=1, val_acc=0.655]
Epoch 14:  21%|██        | 24/117 [00:01<00:06, 13.84it/s, loss=2.87, v_num=1, val_acc=0.655]
Epoch 14:  21%|██        | 24/117 [00:01<00:06, 13.64it/s, loss=2.87, v_num=1, val_acc=0.655]
Epoch 14:  21%|██▏       | 25/117 [00:01<00:06, 14.13it/s, loss=2.87, v_num=1, val_acc=0.655]
Epoch 14:  21%|██▏       | 25/117 [00:01<00:06, 13.93it/s, loss=2.93, v_num=1, val_acc=0.655]
Epoch 14:  22%|██▏       | 26/117 [00:01<00:06, 14.40it/s, loss=2.93, v_num=1, val_acc=0.655]
Epoch 14:  22%|██▏       | 26/117 [00:01<00:06, 14.20it/s, loss=2.95, v_num=1, val_acc=0.655]
Epoch 14:  23%|██▎       | 27/117 [00:01<00:06, 14.67it/s, loss=2.95, v_num=1, val_acc=0.655]
Epoch 14:  23%|██▎       | 27/117 [00:01<00:06, 14.48it/s, loss=2.93, v_num=1, val_acc=0.655]
Epoch 14:  24%|██▍       | 28/117 [00:01<00:05, 14.95it/s, loss=2.93, v_num=1, val_acc=0.655]
Epoch 14:  24%|██▍       | 28/117 [00:01<00:06, 14.75it/s, loss=2.82, v_num=1, val_acc=0.655]
Epoch 14:  25%|██▍       | 29/117 [00:01<00:05, 15.20it/s, loss=2.82, v_num=1, val_acc=0.655]
Epoch 14:  25%|██▍       | 29/117 [00:01<00:05, 15.00it/s, loss=2.8, v_num=1, val_acc=0.655]
Epoch 14:  26%|██▌       | 30/117 [00:01<00:05, 15.44it/s, loss=2.8, v_num=1, val_acc=0.655]
Epoch 14:  26%|██▌       | 30/117 [00:01<00:05, 15.24it/s, loss=2.77, v_num=1, val_acc=0.655]
Epoch 14:  26%|██▋       | 31/117 [00:01<00:05, 15.67it/s, loss=2.77, v_num=1, val_acc=0.655]
Epoch 14:  26%|██▋       | 31/117 [00:02<00:05, 15.47it/s, loss=2.69, v_num=1, val_acc=0.655]
Epoch 14:  27%|██▋       | 32/117 [00:02<00:05, 15.89it/s, loss=2.69, v_num=1, val_acc=0.655]
Epoch 14:  27%|██▋       | 32/117 [00:02<00:05, 15.70it/s, loss=2.66, v_num=1, val_acc=0.655]
Epoch 14:  28%|██▊       | 33/117 [00:02<00:05, 16.11it/s, loss=2.66, v_num=1, val_acc=0.655]
Epoch 14:  28%|██▊       | 33/117 [00:02<00:05, 15.92it/s, loss=2.68, v_num=1, val_acc=0.655]
Epoch 14:  29%|██▉       | 34/117 [00:02<00:05, 16.32it/s, loss=2.68, v_num=1, val_acc=0.655]
Epoch 14:  29%|██▉       | 34/117 [00:02<00:05, 16.12it/s, loss=2.69, v_num=1, val_acc=0.655]
Epoch 14:  30%|██▉       | 35/117 [00:02<00:04, 16.53it/s, loss=2.69, v_num=1, val_acc=0.655]
Epoch 14:  30%|██▉       | 35/117 [00:02<00:05, 16.33it/s, loss=2.75, v_num=1, val_acc=0.655]
Epoch 14:  31%|███       | 36/117 [00:02<00:04, 16.73it/s, loss=2.75, v_num=1, val_acc=0.655]
Epoch 14:  31%|███       | 36/117 [00:02<00:04, 16.54it/s, loss=2.81, v_num=1, val_acc=0.655]
Epoch 14:  32%|███▏      | 37/117 [00:02<00:04, 16.92it/s, loss=2.81, v_num=1, val_acc=0.655]
Epoch 14:  32%|███▏      | 37/117 [00:02<00:04, 16.73it/s, loss=2.95, v_num=1, val_acc=0.655]
Epoch 14:  32%|███▏      | 38/117 [00:02<00:04, 17.11it/s, loss=2.95, v_num=1, val_acc=0.655]
Epoch 14:  32%|███▏      | 38/117 [00:02<00:04, 16.91it/s, loss=3.01, v_num=1, val_acc=0.655]
Epoch 14:  33%|███▎      | 39/117 [00:02<00:04, 17.28it/s, loss=3.01, v_num=1, val_acc=0.655]
Epoch 14:  33%|███▎      | 39/117 [00:02<00:04, 17.09it/s, loss=3.06, v_num=1, val_acc=0.655]
Epoch 14:  34%|███▍      | 40/117 [00:02<00:04, 17.45it/s, loss=3.06, v_num=1, val_acc=0.655]
Epoch 14:  34%|███▍      | 40/117 [00:02<00:04, 17.27it/s, loss=3.13, v_num=1, val_acc=0.655]
Epoch 14:  35%|███▌      | 41/117 [00:02<00:04, 17.62it/s, loss=3.13, v_num=1, val_acc=0.655]
Epoch 14:  35%|███▌      | 41/117 [00:02<00:04, 17.43it/s, loss=3.11, v_num=1, val_acc=0.655]
Epoch 14:  36%|███▌      | 42/117 [00:02<00:04, 17.78it/s, loss=3.11, v_num=1, val_acc=0.655]
Epoch 14:  36%|███▌      | 42/117 [00:02<00:04, 17.60it/s, loss=3.11, v_num=1, val_acc=0.655]
Epoch 14:  37%|███▋      | 43/117 [00:02<00:04, 17.94it/s, loss=3.11, v_num=1, val_acc=0.655]
Epoch 14:  37%|███▋      | 43/117 [00:02<00:04, 17.75it/s, loss=3.05, v_num=1, val_acc=0.655]
Epoch 14:  38%|███▊      | 44/117 [00:02<00:04, 18.10it/s, loss=3.05, v_num=1, val_acc=0.655]
Epoch 14:  38%|███▊      | 44/117 [00:02<00:04, 17.91it/s, loss=3.07, v_num=1, val_acc=0.655]
Epoch 14:  38%|███▊      | 45/117 [00:02<00:03, 18.25it/s, loss=3.07, v_num=1, val_acc=0.655]
Epoch 14:  38%|███▊      | 45/117 [00:02<00:03, 18.06it/s, loss=3.12, v_num=1, val_acc=0.655]
Epoch 14:  39%|███▉      | 46/117 [00:02<00:03, 18.39it/s, loss=3.12, v_num=1, val_acc=0.655]
Epoch 14:  39%|███▉      | 46/117 [00:02<00:03, 18.21it/s, loss=3.12, v_num=1, val_acc=0.655]
Epoch 14:  40%|████      | 47/117 [00:02<00:03, 18.53it/s, loss=3.12, v_num=1, val_acc=0.655]
Epoch 14:  40%|████      | 47/117 [00:02<00:03, 18.35it/s, loss=3.06, v_num=1, val_acc=0.655]
Epoch 14:  41%|████      | 48/117 [00:02<00:03, 18.67it/s, loss=3.06, v_num=1, val_acc=0.655]
Epoch 14:  41%|████      | 48/117 [00:02<00:03, 18.49it/s, loss=3.08, v_num=1, val_acc=0.655]
Epoch 14:  42%|████▏     | 49/117 [00:02<00:03, 18.81it/s, loss=3.08, v_num=1, val_acc=0.655]
Epoch 14:  42%|████▏     | 49/117 [00:02<00:03, 18.63it/s, loss=3.17, v_num=1, val_acc=0.655]
Epoch 14:  43%|████▎     | 50/117 [00:02<00:03, 18.93it/s, loss=3.17, v_num=1, val_acc=0.655]
Epoch 14:  43%|████▎     | 50/117 [00:02<00:03, 18.76it/s, loss=3.19, v_num=1, val_acc=0.655]
Epoch 14:  44%|████▎     | 51/117 [00:02<00:03, 19.06it/s, loss=3.19, v_num=1, val_acc=0.655]
Epoch 14:  44%|████▎     | 51/117 [00:02<00:03, 18.89it/s, loss=3.18, v_num=1, val_acc=0.655]
Epoch 14:  44%|████▍     | 52/117 [00:02<00:03, 19.19it/s, loss=3.18, v_num=1, val_acc=0.655]
Epoch 14:  44%|████▍     | 52/117 [00:02<00:03, 19.02it/s, loss=3.13, v_num=1, val_acc=0.655]
Epoch 14:  45%|████▌     | 53/117 [00:02<00:03, 19.31it/s, loss=3.13, v_num=1, val_acc=0.655]
Epoch 14:  45%|████▌     | 53/117 [00:02<00:03, 19.14it/s, loss=3.12, v_num=1, val_acc=0.655]
Epoch 14:  46%|████▌     | 54/117 [00:02<00:03, 19.43it/s, loss=3.12, v_num=1, val_acc=0.655]
Epoch 14:  46%|████▌     | 54/117 [00:02<00:03, 19.26it/s, loss=3.14, v_num=1, val_acc=0.655]
Epoch 14:  47%|████▋     | 55/117 [00:02<00:03, 19.54it/s, loss=3.14, v_num=1, val_acc=0.655]
Epoch 14:  47%|████▋     | 55/117 [00:02<00:03, 19.37it/s, loss=3.06, v_num=1, val_acc=0.655]
Epoch 14:  48%|████▊     | 56/117 [00:02<00:03, 19.65it/s, loss=3.06, v_num=1, val_acc=0.655]
Epoch 14:  48%|████▊     | 56/117 [00:02<00:03, 19.48it/s, loss=3.02, v_num=1, val_acc=0.655]
Epoch 14:  49%|████▊     | 57/117 [00:02<00:03, 19.76it/s, loss=3.02, v_num=1, val_acc=0.655]
Epoch 14:  49%|████▊     | 57/117 [00:02<00:03, 19.59it/s, loss=2.93, v_num=1, val_acc=0.655]
Epoch 14:  50%|████▉     | 58/117 [00:02<00:02, 19.87it/s, loss=2.93, v_num=1, val_acc=0.655]
Epoch 14:  50%|████▉     | 58/117 [00:02<00:02, 19.70it/s, loss=2.88, v_num=1, val_acc=0.655]
Epoch 14:  50%|█████     | 59/117 [00:02<00:02, 19.97it/s, loss=2.88, v_num=1, val_acc=0.655]
Epoch 14:  50%|█████     | 59/117 [00:02<00:02, 19.81it/s, loss=2.84, v_num=1, val_acc=0.655]
Epoch 14:  51%|█████▏    | 60/117 [00:02<00:02, 20.08it/s, loss=2.84, v_num=1, val_acc=0.655]
Epoch 14:  51%|█████▏    | 60/117 [00:03<00:02, 19.91it/s, loss=2.76, v_num=1, val_acc=0.655]
Epoch 14:  52%|█████▏    | 61/117 [00:03<00:02, 20.18it/s, loss=2.76, v_num=1, val_acc=0.655]
Epoch 14:  52%|█████▏    | 61/117 [00:03<00:02, 20.01it/s, loss=2.78, v_num=1, val_acc=0.655]
Epoch 14:  53%|█████▎    | 62/117 [00:03<00:02, 20.27it/s, loss=2.78, v_num=1, val_acc=0.655]
Epoch 14:  53%|█████▎    | 62/117 [00:03<00:02, 20.11it/s, loss=2.74, v_num=1, val_acc=0.655]
Epoch 14:  54%|█████▍    | 63/117 [00:03<00:02, 20.36it/s, loss=2.74, v_num=1, val_acc=0.655]
Epoch 14:  54%|█████▍    | 63/117 [00:03<00:02, 20.20it/s, loss=2.67, v_num=1, val_acc=0.655]
Epoch 14:  55%|█████▍    | 64/117 [00:03<00:02, 20.46it/s, loss=2.67, v_num=1, val_acc=0.655]
Epoch 14:  55%|█████▍    | 64/117 [00:03<00:02, 20.30it/s, loss=2.6, v_num=1, val_acc=0.655]
Epoch 14:  56%|█████▌    | 65/117 [00:03<00:02, 20.55it/s, loss=2.6, v_num=1, val_acc=0.655]
Epoch 14:  56%|█████▌    | 65/117 [00:03<00:02, 20.39it/s, loss=2.52, v_num=1, val_acc=0.655]
Epoch 14:  56%|█████▋    | 66/117 [00:03<00:02, 20.64it/s, loss=2.52, v_num=1, val_acc=0.655]
Epoch 14:  56%|█████▋    | 66/117 [00:03<00:02, 20.48it/s, loss=2.56, v_num=1, val_acc=0.655]
Epoch 14:  57%|█████▋    | 67/117 [00:03<00:02, 20.73it/s, loss=2.56, v_num=1, val_acc=0.655]
Epoch 14:  57%|█████▋    | 67/117 [00:03<00:02, 20.57it/s, loss=2.6, v_num=1, val_acc=0.655]
Epoch 14:  58%|█████▊    | 68/117 [00:03<00:02, 20.81it/s, loss=2.6, v_num=1, val_acc=0.655]
Epoch 14:  58%|█████▊    | 68/117 [00:03<00:02, 20.65it/s, loss=2.58, v_num=1, val_acc=0.655]
Epoch 14:  59%|█████▉    | 69/117 [00:03<00:02, 20.90it/s, loss=2.58, v_num=1, val_acc=0.655]
Epoch 14:  59%|█████▉    | 69/117 [00:03<00:02, 20.74it/s, loss=2.44, v_num=1, val_acc=0.655]
Epoch 14:  60%|█████▉    | 70/117 [00:03<00:02, 20.98it/s, loss=2.44, v_num=1, val_acc=0.655]
Epoch 14:  60%|█████▉    | 70/117 [00:03<00:02, 20.82it/s, loss=2.44, v_num=1, val_acc=0.655]
Epoch 14:  61%|██████    | 71/117 [00:03<00:02, 21.06it/s, loss=2.44, v_num=1, val_acc=0.655]
Epoch 14:  61%|██████    | 71/117 [00:03<00:02, 20.90it/s, loss=2.49, v_num=1, val_acc=0.655]
Epoch 14:  62%|██████▏   | 72/117 [00:03<00:02, 21.10it/s, loss=2.49, v_num=1, val_acc=0.655]
Epoch 14:  62%|██████▏   | 72/117 [00:03<00:02, 20.96it/s, loss=2.58, v_num=1, val_acc=0.655]
Epoch 14:  62%|██████▏   | 73/117 [00:03<00:02, 21.19it/s, loss=2.58, v_num=1, val_acc=0.655]
Epoch 14:  62%|██████▏   | 73/117 [00:03<00:02, 21.04it/s, loss=2.65, v_num=1, val_acc=0.655]
Epoch 14:  63%|██████▎   | 74/117 [00:03<00:02, 21.27it/s, loss=2.65, v_num=1, val_acc=0.655]
Epoch 14:  63%|██████▎   | 74/117 [00:03<00:02, 21.12it/s, loss=2.67, v_num=1, val_acc=0.655]
Epoch 14:  64%|██████▍   | 75/117 [00:03<00:01, 21.35it/s, loss=2.67, v_num=1, val_acc=0.655]
Epoch 14:  64%|██████▍   | 75/117 [00:03<00:01, 21.19it/s, loss=2.74, v_num=1, val_acc=0.655]
Epoch 14:  65%|██████▍   | 76/117 [00:03<00:01, 21.42it/s, loss=2.74, v_num=1, val_acc=0.655]
Epoch 14:  65%|██████▍   | 76/117 [00:03<00:01, 21.27it/s, loss=2.76, v_num=1, val_acc=0.655]
Epoch 14:  66%|██████▌   | 77/117 [00:03<00:01, 21.49it/s, loss=2.76, v_num=1, val_acc=0.655]
Epoch 14:  66%|██████▌   | 77/117 [00:03<00:01, 21.34it/s, loss=2.76, v_num=1, val_acc=0.655]
Epoch 14:  67%|██████▋   | 78/117 [00:03<00:01, 21.57it/s, loss=2.76, v_num=1, val_acc=0.655]
Epoch 14:  67%|██████▋   | 78/117 [00:03<00:01, 21.42it/s, loss=2.84, v_num=1, val_acc=0.655]
Epoch 14:  68%|██████▊   | 79/117 [00:03<00:01, 21.64it/s, loss=2.84, v_num=1, val_acc=0.655]
Epoch 14:  68%|██████▊   | 79/117 [00:03<00:01, 21.49it/s, loss=2.93, v_num=1, val_acc=0.655]
Epoch 14:  68%|██████▊   | 80/117 [00:03<00:01, 21.71it/s, loss=2.93, v_num=1, val_acc=0.655]
Epoch 14:  68%|██████▊   | 80/117 [00:03<00:01, 21.56it/s, loss=2.96, v_num=1, val_acc=0.655]
Epoch 14:  69%|██████▉   | 81/117 [00:03<00:01, 21.78it/s, loss=2.96, v_num=1, val_acc=0.655]
Epoch 14:  69%|██████▉   | 81/117 [00:03<00:01, 21.63it/s, loss=2.98, v_num=1, val_acc=0.655]
Epoch 14:  70%|███████   | 82/117 [00:03<00:01, 21.83it/s, loss=2.98, v_num=1, val_acc=0.655]
Epoch 14:  70%|███████   | 82/117 [00:03<00:01, 21.68it/s, loss=3.1, v_num=1, val_acc=0.655]
Epoch 14:  71%|███████   | 83/117 [00:03<00:01, 21.90it/s, loss=3.1, v_num=1, val_acc=0.655]
Epoch 14:  71%|███████   | 83/117 [00:03<00:01, 21.75it/s, loss=3.2, v_num=1, val_acc=0.655]
Epoch 14:  72%|███████▏  | 84/117 [00:03<00:01, 21.96it/s, loss=3.2, v_num=1, val_acc=0.655]
Epoch 14:  72%|███████▏  | 84/117 [00:03<00:01, 21.82it/s, loss=3.24, v_num=1, val_acc=0.655]
Epoch 14:  73%|███████▎  | 85/117 [00:03<00:01, 22.03it/s, loss=3.24, v_num=1, val_acc=0.655]
Epoch 14:  73%|███████▎  | 85/117 [00:03<00:01, 21.88it/s, loss=3.21, v_num=1, val_acc=0.655]
Epoch 14:  74%|███████▎  | 86/117 [00:03<00:01, 22.09it/s, loss=3.21, v_num=1, val_acc=0.655]
Epoch 14:  74%|███████▎  | 86/117 [00:03<00:01, 21.95it/s, loss=3.14, v_num=1, val_acc=0.655]
Epoch 14:  74%|███████▍  | 87/117 [00:03<00:01, 22.15it/s, loss=3.14, v_num=1, val_acc=0.655]
Epoch 14:  74%|███████▍  | 87/117 [00:03<00:01, 22.01it/s, loss=3.06, v_num=1, val_acc=0.655]
Epoch 14:  75%|███████▌  | 88/117 [00:03<00:01, 22.21it/s, loss=3.06, v_num=1, val_acc=0.655]
Epoch 14:  75%|███████▌  | 88/117 [00:03<00:01, 22.07it/s, loss=3.13, v_num=1, val_acc=0.655]
Epoch 14:  76%|███████▌  | 89/117 [00:03<00:01, 22.27it/s, loss=3.13, v_num=1, val_acc=0.655]
Epoch 14:  76%|███████▌  | 89/117 [00:04<00:01, 22.13it/s, loss=3.15, v_num=1, val_acc=0.655]
Epoch 14:  77%|███████▋  | 90/117 [00:04<00:01, 22.33it/s, loss=3.15, v_num=1, val_acc=0.655]
Epoch 14:  77%|███████▋  | 90/117 [00:04<00:01, 22.19it/s, loss=3.24, v_num=1, val_acc=0.655]
Epoch 14:  78%|███████▊  | 91/117 [00:04<00:01, 22.39it/s, loss=3.24, v_num=1, val_acc=0.655]
Epoch 14:  78%|███████▊  | 91/117 [00:04<00:01, 22.25it/s, loss=3.27, v_num=1, val_acc=0.655]
Epoch 14:  79%|███████▊  | 92/117 [00:04<00:01, 22.44it/s, loss=3.27, v_num=1, val_acc=0.655]
Epoch 14:  79%|███████▊  | 92/117 [00:04<00:01, 22.31it/s, loss=3.32, v_num=1, val_acc=0.655]
Epoch 14:  79%|███████▉  | 93/117 [00:04<00:01, 22.50it/s, loss=3.32, v_num=1, val_acc=0.655]
Epoch 14:  79%|███████▉  | 93/117 [00:04<00:01, 22.36it/s, loss=3.39, v_num=1, val_acc=0.655]
Epoch 14:  80%|████████  | 94/117 [00:04<00:01, 22.55it/s, loss=3.39, v_num=1, val_acc=0.655]
Epoch 14:  80%|████████  | 94/117 [00:04<00:01, 22.41it/s, loss=3.38, v_num=1, val_acc=0.655]
Epoch 14:  81%|████████  | 95/117 [00:04<00:00, 22.60it/s, loss=3.38, v_num=1, val_acc=0.655]
Epoch 14:  81%|████████  | 95/117 [00:04<00:00, 22.47it/s, loss=3.34, v_num=1, val_acc=0.655]
Epoch 14:  82%|████████▏ | 96/117 [00:04<00:00, 22.66it/s, loss=3.34, v_num=1, val_acc=0.655]
Epoch 14:  82%|████████▏ | 96/117 [00:04<00:00, 22.52it/s, loss=3.3, v_num=1, val_acc=0.655]
Epoch 14:  83%|████████▎ | 97/117 [00:04<00:00, 22.71it/s, loss=3.3, v_num=1, val_acc=0.655]
Epoch 14:  83%|████████▎ | 97/117 [00:04<00:00, 22.57it/s, loss=3.3, v_num=1, val_acc=0.655]

Validation: 0it [00:00, ?it/s]

Validation:   0%|          | 0/20 [00:00<?, ?it/s]

Validation DataLoader 0:   0%|          | 0/20 [00:00<?, ?it/s]

Validation DataLoader 0:   5%|▌         | 1/20 [00:00<00:00, 186.97it/s]
Epoch 14:  84%|████████▍ | 98/117 [00:05<00:00, 19.02it/s, loss=3.3, v_num=1, val_acc=0.655]

Validation DataLoader 0:  10%|█         | 2/20 [00:00<00:00, 55.39it/s]
Epoch 14:  85%|████████▍ | 99/117 [00:05<00:00, 19.10it/s, loss=3.3, v_num=1, val_acc=0.655]

Validation DataLoader 0:  15%|█▌        | 3/20 [00:00<00:00, 44.20it/s]
Epoch 14:  85%|████████▌ | 100/117 [00:05<00:00, 19.18it/s, loss=3.3, v_num=1, val_acc=0.655]

Validation DataLoader 0:  20%|██        | 4/20 [00:00<00:00, 40.34it/s]
Epoch 14:  86%|████████▋ | 101/117 [00:05<00:00, 19.25it/s, loss=3.3, v_num=1, val_acc=0.655]

Validation DataLoader 0:  25%|██▌       | 5/20 [00:00<00:00, 38.16it/s]
Epoch 14:  87%|████████▋ | 102/117 [00:05<00:00, 19.33it/s, loss=3.3, v_num=1, val_acc=0.655]

Validation DataLoader 0:  30%|███       | 6/20 [00:00<00:00, 36.90it/s]
Epoch 14:  88%|████████▊ | 103/117 [00:05<00:00, 19.40it/s, loss=3.3, v_num=1, val_acc=0.655]

Validation DataLoader 0:  35%|███▌      | 7/20 [00:00<00:00, 36.06it/s]
Epoch 14:  89%|████████▉ | 104/117 [00:05<00:00, 19.47it/s, loss=3.3, v_num=1, val_acc=0.655]

Validation DataLoader 0:  40%|████      | 8/20 [00:00<00:00, 35.43it/s]
Epoch 14:  90%|████████▉ | 105/117 [00:05<00:00, 19.54it/s, loss=3.3, v_num=1, val_acc=0.655]

Validation DataLoader 0:  45%|████▌     | 9/20 [00:00<00:00, 34.93it/s]
Epoch 14:  91%|█████████ | 106/117 [00:05<00:00, 19.61it/s, loss=3.3, v_num=1, val_acc=0.655]

Validation DataLoader 0:  50%|█████     | 10/20 [00:00<00:00, 34.56it/s]
Epoch 14:  91%|█████████▏| 107/117 [00:05<00:00, 19.68it/s, loss=3.3, v_num=1, val_acc=0.655]

Validation DataLoader 0:  55%|█████▌    | 11/20 [00:00<00:00, 34.28it/s]
Epoch 14:  92%|█████████▏| 108/117 [00:05<00:00, 19.75it/s, loss=3.3, v_num=1, val_acc=0.655]

Validation DataLoader 0:  60%|██████    | 12/20 [00:00<00:00, 34.02it/s]
Epoch 14:  93%|█████████▎| 109/117 [00:05<00:00, 19.82it/s, loss=3.3, v_num=1, val_acc=0.655]

Validation DataLoader 0:  65%|██████▌   | 13/20 [00:00<00:00, 33.78it/s]
Epoch 14:  94%|█████████▍| 110/117 [00:05<00:00, 19.89it/s, loss=3.3, v_num=1, val_acc=0.655]

Validation DataLoader 0:  70%|███████   | 14/20 [00:00<00:00, 33.58it/s]
Epoch 14:  95%|█████████▍| 111/117 [00:05<00:00, 19.95it/s, loss=3.3, v_num=1, val_acc=0.655]

Validation DataLoader 0:  75%|███████▌  | 15/20 [00:00<00:00, 33.42it/s]
Epoch 14:  96%|█████████▌| 112/117 [00:05<00:00, 20.02it/s, loss=3.3, v_num=1, val_acc=0.655]

Validation DataLoader 0:  80%|████████  | 16/20 [00:00<00:00, 33.30it/s]
Epoch 14:  97%|█████████▋| 113/117 [00:05<00:00, 20.08it/s, loss=3.3, v_num=1, val_acc=0.655]

Validation DataLoader 0:  85%|████████▌ | 17/20 [00:00<00:00, 33.20it/s]
Epoch 14:  97%|█████████▋| 114/117 [00:05<00:00, 20.15it/s, loss=3.3, v_num=1, val_acc=0.655]

Validation DataLoader 0:  90%|█████████ | 18/20 [00:00<00:00, 33.09it/s]
Epoch 14:  98%|█████████▊| 115/117 [00:05<00:00, 20.21it/s, loss=3.3, v_num=1, val_acc=0.655]

Validation DataLoader 0:  95%|█████████▌| 19/20 [00:00<00:00, 33.01it/s]
Epoch 14:  99%|█████████▉| 116/117 [00:05<00:00, 20.27it/s, loss=3.3, v_num=1, val_acc=0.655]

Validation DataLoader 0: 100%|██████████| 20/20 [00:00<00:00, 33.01it/s]
Epoch 14: 100%|██████████| 117/117 [00:05<00:00, 20.34it/s, loss=3.3, v_num=1, val_acc=0.655]
Epoch 14: 100%|██████████| 117/117 [00:05<00:00, 20.27it/s, loss=3.3, v_num=1, val_acc=0.630]


Epoch 14: 100%|██████████| 117/117 [00:05<00:00, 20.26it/s, loss=3.3, v_num=1, val_acc=0.630]
Epoch 14:   0%|          | 0/117 [00:00<?, ?it/s, loss=3.3, v_num=1, val_acc=0.630]
Epoch 15:   0%|          | 0/117 [00:00<?, ?it/s, loss=3.3, v_num=1, val_acc=0.630]
Epoch 15:   1%|          | 1/117 [00:00<01:47,  1.08it/s, loss=3.3, v_num=1, val_acc=0.630]
Epoch 15:   1%|          | 1/117 [00:00<01:50,  1.05it/s, loss=3.37, v_num=1, val_acc=0.630]
Epoch 15:   2%|▏         | 2/117 [00:00<00:55,  2.08it/s, loss=3.37, v_num=1, val_acc=0.630]
Epoch 15:   2%|▏         | 2/117 [00:00<00:56,  2.03it/s, loss=3.32, v_num=1, val_acc=0.630]
Epoch 15:   3%|▎         | 3/117 [00:01<00:38,  2.99it/s, loss=3.32, v_num=1, val_acc=0.630]
Epoch 15:   3%|▎         | 3/117 [00:01<00:38,  2.93it/s, loss=3.31, v_num=1, val_acc=0.630]
Epoch 15:   3%|▎         | 4/117 [00:01<00:29,  3.86it/s, loss=3.31, v_num=1, val_acc=0.630]
Epoch 15:   3%|▎         | 4/117 [00:01<00:29,  3.77it/s, loss=3.3, v_num=1, val_acc=0.630]
Epoch 15:   4%|▍         | 5/117 [00:01<00:23,  4.68it/s, loss=3.3, v_num=1, val_acc=0.630]
Epoch 15:   4%|▍         | 5/117 [00:01<00:24,  4.57it/s, loss=3.18, v_num=1, val_acc=0.630]
Epoch 15:   5%|▌         | 6/117 [00:01<00:20,  5.43it/s, loss=3.18, v_num=1, val_acc=0.630]
Epoch 15:   5%|▌         | 6/117 [00:01<00:20,  5.32it/s, loss=3.15, v_num=1, val_acc=0.630]
Epoch 15:   6%|▌         | 7/117 [00:01<00:17,  6.15it/s, loss=3.15, v_num=1, val_acc=0.630]
Epoch 15:   6%|▌         | 7/117 [00:01<00:18,  6.02it/s, loss=3.15, v_num=1, val_acc=0.630]
Epoch 15:   7%|▋         | 8/117 [00:01<00:15,  6.82it/s, loss=3.15, v_num=1, val_acc=0.630]
Epoch 15:   7%|▋         | 8/117 [00:01<00:16,  6.68it/s, loss=3.26, v_num=1, val_acc=0.630]
Epoch 15:   8%|▊         | 9/117 [00:01<00:14,  7.46it/s, loss=3.26, v_num=1, val_acc=0.630]
Epoch 15:   8%|▊         | 9/117 [00:01<00:14,  7.30it/s, loss=3.32, v_num=1, val_acc=0.630]
Epoch 15:   9%|▊         | 10/117 [00:01<00:13,  8.04it/s, loss=3.32, v_num=1, val_acc=0.630]
Epoch 15:   9%|▊         | 10/117 [00:01<00:13,  7.89it/s, loss=3.34, v_num=1, val_acc=0.630]
Epoch 15:   9%|▉         | 11/117 [00:01<00:12,  8.60it/s, loss=3.34, v_num=1, val_acc=0.630]
Epoch 15:   9%|▉         | 11/117 [00:01<00:12,  8.43it/s, loss=3.24, v_num=1, val_acc=0.630]
Epoch 15:  10%|█         | 12/117 [00:01<00:11,  9.14it/s, loss=3.24, v_num=1, val_acc=0.630]
Epoch 15:  10%|█         | 12/117 [00:01<00:11,  8.97it/s, loss=3.17, v_num=1, val_acc=0.630]
Epoch 15:  11%|█         | 13/117 [00:01<00:10,  9.65it/s, loss=3.17, v_num=1, val_acc=0.630]
Epoch 15:  11%|█         | 13/117 [00:01<00:10,  9.48it/s, loss=3.09, v_num=1, val_acc=0.630]
Epoch 15:  12%|█▏        | 14/117 [00:01<00:10, 10.14it/s, loss=3.09, v_num=1, val_acc=0.630]
Epoch 15:  12%|█▏        | 14/117 [00:01<00:10,  9.96it/s, loss=3.03, v_num=1, val_acc=0.630]
Epoch 15:  13%|█▎        | 15/117 [00:01<00:09, 10.60it/s, loss=3.03, v_num=1, val_acc=0.630]
Epoch 15:  13%|█▎        | 15/117 [00:01<00:09, 10.41it/s, loss=2.96, v_num=1, val_acc=0.630]
Epoch 15:  14%|█▎        | 16/117 [00:01<00:09, 11.05it/s, loss=2.96, v_num=1, val_acc=0.630]
Epoch 15:  14%|█▎        | 16/117 [00:01<00:09, 10.85it/s, loss=2.87, v_num=1, val_acc=0.630]
Epoch 15:  15%|█▍        | 17/117 [00:01<00:08, 11.46it/s, loss=2.87, v_num=1, val_acc=0.630]
Epoch 15:  15%|█▍        | 17/117 [00:01<00:08, 11.27it/s, loss=3.02, v_num=1, val_acc=0.630]
Epoch 15:  15%|█▌        | 18/117 [00:01<00:08, 11.85it/s, loss=3.02, v_num=1, val_acc=0.630]
Epoch 15:  15%|█▌        | 18/117 [00:01<00:08, 11.65it/s, loss=3.04, v_num=1, val_acc=0.630]
Epoch 15:  16%|█▌        | 19/117 [00:01<00:08, 12.23it/s, loss=3.04, v_num=1, val_acc=0.630]
Epoch 15:  16%|█▌        | 19/117 [00:01<00:08, 12.03it/s, loss=3.06, v_num=1, val_acc=0.630]
Epoch 15:  17%|█▋        | 20/117 [00:01<00:07, 12.60it/s, loss=3.06, v_num=1, val_acc=0.630]
Epoch 15:  17%|█▋        | 20/117 [00:01<00:07, 12.40it/s, loss=3.04, v_num=1, val_acc=0.630]
Epoch 15:  18%|█▊        | 21/117 [00:01<00:07, 12.96it/s, loss=3.04, v_num=1, val_acc=0.630]
Epoch 15:  18%|█▊        | 21/117 [00:01<00:07, 12.76it/s, loss=2.91, v_num=1, val_acc=0.630]
Epoch 15:  19%|█▉        | 22/117 [00:01<00:07, 13.29it/s, loss=2.91, v_num=1, val_acc=0.630]
Epoch 15:  19%|█▉        | 22/117 [00:01<00:07, 13.09it/s, loss=2.86, v_num=1, val_acc=0.630]
Epoch 15:  20%|█▉        | 23/117 [00:01<00:06, 13.61it/s, loss=2.86, v_num=1, val_acc=0.630]
Epoch 15:  20%|█▉        | 23/117 [00:01<00:07, 13.41it/s, loss=2.88, v_num=1, val_acc=0.630]
Epoch 15:  21%|██        | 24/117 [00:01<00:06, 13.90it/s, loss=2.88, v_num=1, val_acc=0.630]
Epoch 15:  21%|██        | 24/117 [00:01<00:06, 13.71it/s, loss=2.82, v_num=1, val_acc=0.630]
Epoch 15:  21%|██▏       | 25/117 [00:01<00:06, 14.21it/s, loss=2.82, v_num=1, val_acc=0.630]
Epoch 15:  21%|██▏       | 25/117 [00:01<00:06, 14.01it/s, loss=2.85, v_num=1, val_acc=0.630]
Epoch 15:  22%|██▏       | 26/117 [00:01<00:06, 14.50it/s, loss=2.85, v_num=1, val_acc=0.630]
Epoch 15:  22%|██▏       | 26/117 [00:01<00:06, 14.30it/s, loss=2.87, v_num=1, val_acc=0.630]
Epoch 15:  23%|██▎       | 27/117 [00:01<00:06, 14.73it/s, loss=2.87, v_num=1, val_acc=0.630]
Epoch 15:  23%|██▎       | 27/117 [00:01<00:06, 14.56it/s, loss=2.87, v_num=1, val_acc=0.630]
Epoch 15:  24%|██▍       | 28/117 [00:01<00:05, 15.03it/s, loss=2.87, v_num=1, val_acc=0.630]
Epoch 15:  24%|██▍       | 28/117 [00:01<00:06, 14.83it/s, loss=2.82, v_num=1, val_acc=0.630]
Epoch 15:  25%|██▍       | 29/117 [00:01<00:05, 15.28it/s, loss=2.82, v_num=1, val_acc=0.630]
Epoch 15:  25%|██▍       | 29/117 [00:01<00:05, 15.08it/s, loss=2.8, v_num=1, val_acc=0.630]
Epoch 15:  26%|██▌       | 30/117 [00:01<00:05, 15.53it/s, loss=2.8, v_num=1, val_acc=0.630]
Epoch 15:  26%|██▌       | 30/117 [00:01<00:05, 15.33it/s, loss=2.81, v_num=1, val_acc=0.630]
Epoch 15:  26%|██▋       | 31/117 [00:01<00:05, 15.76it/s, loss=2.81, v_num=1, val_acc=0.630]
Epoch 15:  26%|██▋       | 31/117 [00:01<00:05, 15.56it/s, loss=2.9, v_num=1, val_acc=0.630]
Epoch 15:  27%|██▋       | 32/117 [00:02<00:05, 15.99it/s, loss=2.9, v_num=1, val_acc=0.630]
Epoch 15:  27%|██▋       | 32/117 [00:02<00:05, 15.79it/s, loss=3, v_num=1, val_acc=0.630]
Epoch 15:  28%|██▊       | 33/117 [00:02<00:05, 16.21it/s, loss=3, v_num=1, val_acc=0.630]
Epoch 15:  28%|██▊       | 33/117 [00:02<00:05, 16.01it/s, loss=3.11, v_num=1, val_acc=0.630]
Epoch 15:  29%|██▉       | 34/117 [00:02<00:05, 16.40it/s, loss=3.11, v_num=1, val_acc=0.630]
Epoch 15:  29%|██▉       | 34/117 [00:02<00:05, 16.20it/s, loss=3.2, v_num=1, val_acc=0.630]
Epoch 15:  30%|██▉       | 35/117 [00:02<00:04, 16.56it/s, loss=3.2, v_num=1, val_acc=0.630]
Epoch 15:  30%|██▉       | 35/117 [00:02<00:05, 16.40it/s, loss=3.28, v_num=1, val_acc=0.630]
Epoch 15:  31%|███       | 36/117 [00:02<00:04, 16.79it/s, loss=3.28, v_num=1, val_acc=0.630]
Epoch 15:  31%|███       | 36/117 [00:02<00:04, 16.60it/s, loss=3.24, v_num=1, val_acc=0.630]
Epoch 15:  32%|███▏      | 37/117 [00:02<00:04, 16.99it/s, loss=3.24, v_num=1, val_acc=0.630]
Epoch 15:  32%|███▏      | 37/117 [00:02<00:04, 16.79it/s, loss=3.06, v_num=1, val_acc=0.630]
Epoch 15:  32%|███▏      | 38/117 [00:02<00:04, 17.11it/s, loss=3.06, v_num=1, val_acc=0.630]
Epoch 15:  32%|███▏      | 38/117 [00:02<00:04, 16.95it/s, loss=3.02, v_num=1, val_acc=0.630]
Epoch 15:  33%|███▎      | 39/117 [00:02<00:04, 17.29it/s, loss=3.02, v_num=1, val_acc=0.630]
Epoch 15:  33%|███▎      | 39/117 [00:02<00:04, 17.11it/s, loss=3.04, v_num=1, val_acc=0.630]
Epoch 15:  34%|███▍      | 40/117 [00:02<00:04, 17.47it/s, loss=3.04, v_num=1, val_acc=0.630]
Epoch 15:  34%|███▍      | 40/117 [00:02<00:04, 17.28it/s, loss=3.03, v_num=1, val_acc=0.630]
Epoch 15:  35%|███▌      | 41/117 [00:02<00:04, 17.62it/s, loss=3.03, v_num=1, val_acc=0.630]
Epoch 15:  35%|███▌      | 41/117 [00:02<00:04, 17.44it/s, loss=3.02, v_num=1, val_acc=0.630]
Epoch 15:  36%|███▌      | 42/117 [00:02<00:04, 17.73it/s, loss=3.02, v_num=1, val_acc=0.630]
Epoch 15:  36%|███▌      | 42/117 [00:02<00:04, 17.61it/s, loss=3.06, v_num=1, val_acc=0.630]
Epoch 15:  37%|███▋      | 43/117 [00:02<00:04, 17.94it/s, loss=3.06, v_num=1, val_acc=0.630]
Epoch 15:  37%|███▋      | 43/117 [00:02<00:04, 17.76it/s, loss=3.08, v_num=1, val_acc=0.630]
Epoch 15:  38%|███▊      | 44/117 [00:02<00:04, 18.10it/s, loss=3.08, v_num=1, val_acc=0.630]
Epoch 15:  38%|███▊      | 44/117 [00:02<00:04, 17.92it/s, loss=3.12, v_num=1, val_acc=0.630]
Epoch 15:  38%|███▊      | 45/117 [00:02<00:03, 18.20it/s, loss=3.12, v_num=1, val_acc=0.630]
Epoch 15:  38%|███▊      | 45/117 [00:02<00:03, 18.06it/s, loss=3.14, v_num=1, val_acc=0.630]
Epoch 15:  39%|███▉      | 46/117 [00:02<00:03, 18.38it/s, loss=3.14, v_num=1, val_acc=0.630]
Epoch 15:  39%|███▉      | 46/117 [00:02<00:03, 18.20it/s, loss=3.14, v_num=1, val_acc=0.630]
Epoch 15:  40%|████      | 47/117 [00:02<00:03, 18.52it/s, loss=3.14, v_num=1, val_acc=0.630]
Epoch 15:  40%|████      | 47/117 [00:02<00:03, 18.34it/s, loss=3.2, v_num=1, val_acc=0.630]
Epoch 15:  41%|████      | 48/117 [00:02<00:03, 18.66it/s, loss=3.2, v_num=1, val_acc=0.630]
Epoch 15:  41%|████      | 48/117 [00:02<00:03, 18.48it/s, loss=3.32, v_num=1, val_acc=0.630]
Epoch 15:  42%|████▏     | 49/117 [00:02<00:03, 18.76it/s, loss=3.32, v_num=1, val_acc=0.630]
Epoch 15:  42%|████▏     | 49/117 [00:02<00:03, 18.61it/s, loss=3.3, v_num=1, val_acc=0.630]
Epoch 15:  43%|████▎     | 50/117 [00:02<00:03, 18.92it/s, loss=3.3, v_num=1, val_acc=0.630]
Epoch 15:  43%|████▎     | 50/117 [00:02<00:03, 18.74it/s, loss=3.27, v_num=1, val_acc=0.630]
Epoch 15:  44%|████▎     | 51/117 [00:02<00:03, 19.05it/s, loss=3.27, v_num=1, val_acc=0.630]
Epoch 15:  44%|████▎     | 51/117 [00:02<00:03, 18.87it/s, loss=3.19, v_num=1, val_acc=0.630]
Epoch 15:  44%|████▍     | 52/117 [00:02<00:03, 19.12it/s, loss=3.19, v_num=1, val_acc=0.630]
Epoch 15:  44%|████▍     | 52/117 [00:02<00:03, 18.99it/s, loss=3.12, v_num=1, val_acc=0.630]
Epoch 15:  45%|████▌     | 53/117 [00:02<00:03, 19.29it/s, loss=3.12, v_num=1, val_acc=0.630]
Epoch 15:  45%|████▌     | 53/117 [00:02<00:03, 19.11it/s, loss=2.99, v_num=1, val_acc=0.630]
Epoch 15:  46%|████▌     | 54/117 [00:02<00:03, 19.41it/s, loss=2.99, v_num=1, val_acc=0.630]
Epoch 15:  46%|████▌     | 54/117 [00:02<00:03, 19.24it/s, loss=2.93, v_num=1, val_acc=0.630]
Epoch 15:  47%|████▋     | 55/117 [00:02<00:03, 19.53it/s, loss=2.93, v_num=1, val_acc=0.630]
Epoch 15:  47%|████▋     | 55/117 [00:02<00:03, 19.35it/s, loss=2.9, v_num=1, val_acc=0.630]
Epoch 15:  48%|████▊     | 56/117 [00:02<00:03, 19.61it/s, loss=2.9, v_num=1, val_acc=0.630]
Epoch 15:  48%|████▊     | 56/117 [00:02<00:03, 19.46it/s, loss=2.87, v_num=1, val_acc=0.630]
Epoch 15:  49%|████▊     | 57/117 [00:02<00:03, 19.75it/s, loss=2.87, v_num=1, val_acc=0.630]
Epoch 15:  49%|████▊     | 57/117 [00:02<00:03, 19.58it/s, loss=2.87, v_num=1, val_acc=0.630]
Epoch 15:  50%|████▉     | 58/117 [00:02<00:02, 19.85it/s, loss=2.87, v_num=1, val_acc=0.630]
Epoch 15:  50%|████▉     | 58/117 [00:02<00:02, 19.68it/s, loss=2.91, v_num=1, val_acc=0.630]
Epoch 15:  50%|█████     | 59/117 [00:02<00:02, 19.93it/s, loss=2.91, v_num=1, val_acc=0.630]
Epoch 15:  50%|█████     | 59/117 [00:02<00:02, 19.79it/s, loss=2.93, v_num=1, val_acc=0.630]
Epoch 15:  51%|█████▏    | 60/117 [00:02<00:02, 20.05it/s, loss=2.93, v_num=1, val_acc=0.630]
Epoch 15:  51%|█████▏    | 60/117 [00:03<00:02, 19.89it/s, loss=3.06, v_num=1, val_acc=0.630]
Epoch 15:  52%|█████▏    | 61/117 [00:03<00:02, 20.16it/s, loss=3.06, v_num=1, val_acc=0.630]
Epoch 15:  52%|█████▏    | 61/117 [00:03<00:02, 19.99it/s, loss=3.1, v_num=1, val_acc=0.630]
Epoch 15:  53%|█████▎    | 62/117 [00:03<00:02, 20.23it/s, loss=3.1, v_num=1, val_acc=0.630]
Epoch 15:  53%|█████▎    | 62/117 [00:03<00:02, 20.09it/s, loss=3.13, v_num=1, val_acc=0.630]
Epoch 15:  54%|█████▍    | 63/117 [00:03<00:02, 20.35it/s, loss=3.13, v_num=1, val_acc=0.630]
Epoch 15:  54%|█████▍    | 63/117 [00:03<00:02, 20.19it/s, loss=3.08, v_num=1, val_acc=0.630]
Epoch 15:  55%|█████▍    | 64/117 [00:03<00:02, 20.45it/s, loss=3.08, v_num=1, val_acc=0.630]
Epoch 15:  55%|█████▍    | 64/117 [00:03<00:02, 20.28it/s, loss=3.06, v_num=1, val_acc=0.630]
Epoch 15:  56%|█████▌    | 65/117 [00:03<00:02, 20.53it/s, loss=3.06, v_num=1, val_acc=0.630]
Epoch 15:  56%|█████▌    | 65/117 [00:03<00:02, 20.37it/s, loss=3.08, v_num=1, val_acc=0.630]
Epoch 15:  56%|█████▋    | 66/117 [00:03<00:02, 20.57it/s, loss=3.08, v_num=1, val_acc=0.630]
Epoch 15:  56%|█████▋    | 66/117 [00:03<00:02, 20.46it/s, loss=3.04, v_num=1, val_acc=0.630]
Epoch 15:  57%|█████▋    | 67/117 [00:03<00:02, 20.69it/s, loss=3.04, v_num=1, val_acc=0.630]
Epoch 15:  57%|█████▋    | 67/117 [00:03<00:02, 20.54it/s, loss=2.95, v_num=1, val_acc=0.630]
Epoch 15:  58%|█████▊    | 68/117 [00:03<00:02, 20.79it/s, loss=2.95, v_num=1, val_acc=0.630]
Epoch 15:  58%|█████▊    | 68/117 [00:03<00:02, 20.62it/s, loss=2.81, v_num=1, val_acc=0.630]
Epoch 15:  59%|█████▉    | 69/117 [00:03<00:02, 20.85it/s, loss=2.81, v_num=1, val_acc=0.630]
Epoch 15:  59%|█████▉    | 69/117 [00:03<00:02, 20.70it/s, loss=2.8, v_num=1, val_acc=0.630]
Epoch 15:  60%|█████▉    | 70/117 [00:03<00:02, 20.92it/s, loss=2.8, v_num=1, val_acc=0.630]
Epoch 15:  60%|█████▉    | 70/117 [00:03<00:02, 20.77it/s, loss=2.8, v_num=1, val_acc=0.630]
Epoch 15:  61%|██████    | 71/117 [00:03<00:02, 20.98it/s, loss=2.8, v_num=1, val_acc=0.630]
Epoch 15:  61%|██████    | 71/117 [00:03<00:02, 20.84it/s, loss=2.89, v_num=1, val_acc=0.630]
Epoch 15:  62%|██████▏   | 72/117 [00:03<00:02, 21.07it/s, loss=2.89, v_num=1, val_acc=0.630]
Epoch 15:  62%|██████▏   | 72/117 [00:03<00:02, 20.91it/s, loss=2.91, v_num=1, val_acc=0.630]
Epoch 15:  62%|██████▏   | 73/117 [00:03<00:02, 21.15it/s, loss=2.91, v_num=1, val_acc=0.630]
Epoch 15:  62%|██████▏   | 73/117 [00:03<00:02, 20.99it/s, loss=2.96, v_num=1, val_acc=0.630]
Epoch 15:  63%|██████▎   | 74/117 [00:03<00:02, 21.22it/s, loss=2.96, v_num=1, val_acc=0.630]
Epoch 15:  63%|██████▎   | 74/117 [00:03<00:02, 21.07it/s, loss=3, v_num=1, val_acc=0.630]
Epoch 15:  64%|██████▍   | 75/117 [00:03<00:01, 21.27it/s, loss=3, v_num=1, val_acc=0.630]
Epoch 15:  64%|██████▍   | 75/117 [00:03<00:01, 21.14it/s, loss=3.01, v_num=1, val_acc=0.630]
Epoch 15:  65%|██████▍   | 76/117 [00:03<00:01, 21.35it/s, loss=3.01, v_num=1, val_acc=0.630]
Epoch 15:  65%|██████▍   | 76/117 [00:03<00:01, 21.21it/s, loss=3.05, v_num=1, val_acc=0.630]
Epoch 15:  66%|██████▌   | 77/117 [00:03<00:01, 21.41it/s, loss=3.05, v_num=1, val_acc=0.630]
Epoch 15:  66%|██████▌   | 77/117 [00:03<00:01, 21.27it/s, loss=3.09, v_num=1, val_acc=0.630]
Epoch 15:  67%|██████▋   | 78/117 [00:03<00:01, 21.49it/s, loss=3.09, v_num=1, val_acc=0.630]
Epoch 15:  67%|██████▋   | 78/117 [00:03<00:01, 21.34it/s, loss=3.04, v_num=1, val_acc=0.630]
Epoch 15:  68%|██████▊   | 79/117 [00:03<00:01, 21.57it/s, loss=3.04, v_num=1, val_acc=0.630]
Epoch 15:  68%|██████▊   | 79/117 [00:03<00:01, 21.42it/s, loss=2.92, v_num=1, val_acc=0.630]
Epoch 15:  68%|██████▊   | 80/117 [00:03<00:01, 21.64it/s, loss=2.92, v_num=1, val_acc=0.630]
Epoch 15:  68%|██████▊   | 80/117 [00:03<00:01, 21.49it/s, loss=2.78, v_num=1, val_acc=0.630]
Epoch 15:  69%|██████▉   | 81/117 [00:03<00:01, 21.71it/s, loss=2.78, v_num=1, val_acc=0.630]
Epoch 15:  69%|██████▉   | 81/117 [00:03<00:01, 21.56it/s, loss=2.78, v_num=1, val_acc=0.630]
Epoch 15:  70%|███████   | 82/117 [00:03<00:01, 21.75it/s, loss=2.78, v_num=1, val_acc=0.630]
Epoch 15:  70%|███████   | 82/117 [00:03<00:01, 21.61it/s, loss=2.8, v_num=1, val_acc=0.630]
Epoch 15:  71%|███████   | 83/117 [00:03<00:01, 21.82it/s, loss=2.8, v_num=1, val_acc=0.630]
Epoch 15:  71%|███████   | 83/117 [00:03<00:01, 21.67it/s, loss=2.84, v_num=1, val_acc=0.630]
Epoch 15:  72%|███████▏  | 84/117 [00:03<00:01, 21.86it/s, loss=2.84, v_num=1, val_acc=0.630]
Epoch 15:  72%|███████▏  | 84/117 [00:03<00:01, 21.73it/s, loss=2.84, v_num=1, val_acc=0.630]
Epoch 15:  73%|███████▎  | 85/117 [00:03<00:01, 21.93it/s, loss=2.84, v_num=1, val_acc=0.630]
Epoch 15:  73%|███████▎  | 85/117 [00:03<00:01, 21.78it/s, loss=2.81, v_num=1, val_acc=0.630]
Epoch 15:  74%|███████▎  | 86/117 [00:03<00:01, 21.99it/s, loss=2.81, v_num=1, val_acc=0.630]
Epoch 15:  74%|███████▎  | 86/117 [00:03<00:01, 21.85it/s, loss=2.82, v_num=1, val_acc=0.630]
Epoch 15:  74%|███████▍  | 87/117 [00:03<00:01, 22.06it/s, loss=2.82, v_num=1, val_acc=0.630]
Epoch 15:  74%|███████▍  | 87/117 [00:03<00:01, 21.92it/s, loss=2.82, v_num=1, val_acc=0.630]
Epoch 15:  75%|███████▌  | 88/117 [00:03<00:01, 22.12it/s, loss=2.82, v_num=1, val_acc=0.630]
Epoch 15:  75%|███████▌  | 88/117 [00:04<00:01, 21.98it/s, loss=2.8, v_num=1, val_acc=0.630]
Epoch 15:  76%|███████▌  | 89/117 [00:04<00:01, 22.18it/s, loss=2.8, v_num=1, val_acc=0.630]
Epoch 15:  76%|███████▌  | 89/117 [00:04<00:01, 22.04it/s, loss=2.83, v_num=1, val_acc=0.630]
Epoch 15:  77%|███████▋  | 90/117 [00:04<00:01, 22.24it/s, loss=2.83, v_num=1, val_acc=0.630]
Epoch 15:  77%|███████▋  | 90/117 [00:04<00:01, 22.10it/s, loss=2.85, v_num=1, val_acc=0.630]
Epoch 15:  78%|███████▊  | 91/117 [00:04<00:01, 22.30it/s, loss=2.85, v_num=1, val_acc=0.630]
Epoch 15:  78%|███████▊  | 91/117 [00:04<00:01, 22.16it/s, loss=2.77, v_num=1, val_acc=0.630]
Epoch 15:  79%|███████▊  | 92/117 [00:04<00:01, 22.36it/s, loss=2.77, v_num=1, val_acc=0.630]
Epoch 15:  79%|███████▊  | 92/117 [00:04<00:01, 22.22it/s, loss=2.76, v_num=1, val_acc=0.630]
Epoch 15:  79%|███████▉  | 93/117 [00:04<00:01, 22.42it/s, loss=2.76, v_num=1, val_acc=0.630]
Epoch 15:  79%|███████▉  | 93/117 [00:04<00:01, 22.28it/s, loss=2.82, v_num=1, val_acc=0.630]
Epoch 15:  80%|████████  | 94/117 [00:04<00:01, 22.47it/s, loss=2.82, v_num=1, val_acc=0.630]
Epoch 15:  80%|████████  | 94/117 [00:04<00:01, 22.34it/s, loss=2.76, v_num=1, val_acc=0.630]
Epoch 15:  81%|████████  | 95/117 [00:04<00:00, 22.53it/s, loss=2.76, v_num=1, val_acc=0.630]
Epoch 15:  81%|████████  | 95/117 [00:04<00:00, 22.39it/s, loss=2.66, v_num=1, val_acc=0.630]
Epoch 15:  82%|████████▏ | 96/117 [00:04<00:00, 22.58it/s, loss=2.66, v_num=1, val_acc=0.630]
Epoch 15:  82%|████████▏ | 96/117 [00:04<00:00, 22.45it/s, loss=2.62, v_num=1, val_acc=0.630]
Epoch 15:  83%|████████▎ | 97/117 [00:04<00:00, 22.63it/s, loss=2.62, v_num=1, val_acc=0.630]
Epoch 15:  83%|████████▎ | 97/117 [00:04<00:00, 22.50it/s, loss=2.63, v_num=1, val_acc=0.630]

Validation: 0it [00:00, ?it/s]

Validation:   0%|          | 0/20 [00:00<?, ?it/s]

Validation DataLoader 0:   0%|          | 0/20 [00:00<?, ?it/s]

Validation DataLoader 0:   5%|▌         | 1/20 [00:00<00:00, 171.02it/s]
Epoch 15:  84%|████████▍ | 98/117 [00:05<00:00, 19.08it/s, loss=2.63, v_num=1, val_acc=0.630]

Validation DataLoader 0:  10%|█         | 2/20 [00:00<00:00, 54.68it/s]
Epoch 15:  85%|████████▍ | 99/117 [00:05<00:00, 19.16it/s, loss=2.63, v_num=1, val_acc=0.630]

Validation DataLoader 0:  15%|█▌        | 3/20 [00:00<00:00, 43.89it/s]
Epoch 15:  85%|████████▌ | 100/117 [00:05<00:00, 19.23it/s, loss=2.63, v_num=1, val_acc=0.630]

Validation DataLoader 0:  20%|██        | 4/20 [00:00<00:00, 39.93it/s]
Epoch 15:  86%|████████▋ | 101/117 [00:05<00:00, 19.31it/s, loss=2.63, v_num=1, val_acc=0.630]

Validation DataLoader 0:  25%|██▌       | 5/20 [00:00<00:00, 37.59it/s]
Epoch 15:  87%|████████▋ | 102/117 [00:05<00:00, 19.38it/s, loss=2.63, v_num=1, val_acc=0.630]

Validation DataLoader 0:  30%|███       | 6/20 [00:00<00:00, 36.45it/s]
Epoch 15:  88%|████████▊ | 103/117 [00:05<00:00, 19.45it/s, loss=2.63, v_num=1, val_acc=0.630]

Validation DataLoader 0:  35%|███▌      | 7/20 [00:00<00:00, 35.68it/s]
Epoch 15:  89%|████████▉ | 104/117 [00:05<00:00, 19.52it/s, loss=2.63, v_num=1, val_acc=0.630]

Validation DataLoader 0:  40%|████      | 8/20 [00:00<00:00, 35.08it/s]
Epoch 15:  90%|████████▉ | 105/117 [00:05<00:00, 19.59it/s, loss=2.63, v_num=1, val_acc=0.630]

Validation DataLoader 0:  45%|████▌     | 9/20 [00:00<00:00, 34.61it/s]
Epoch 15:  91%|█████████ | 106/117 [00:05<00:00, 19.66it/s, loss=2.63, v_num=1, val_acc=0.630]

Validation DataLoader 0:  50%|█████     | 10/20 [00:00<00:00, 34.35it/s]
Epoch 15:  91%|█████████▏| 107/117 [00:05<00:00, 19.73it/s, loss=2.63, v_num=1, val_acc=0.630]

Validation DataLoader 0:  55%|█████▌    | 11/20 [00:00<00:00, 34.10it/s]
Epoch 15:  92%|█████████▏| 108/117 [00:05<00:00, 19.80it/s, loss=2.63, v_num=1, val_acc=0.630]

Validation DataLoader 0:  60%|██████    | 12/20 [00:00<00:00, 33.88it/s]
Epoch 15:  93%|█████████▎| 109/117 [00:05<00:00, 19.87it/s, loss=2.63, v_num=1, val_acc=0.630]

Validation DataLoader 0:  65%|██████▌   | 13/20 [00:00<00:00, 33.71it/s]
Epoch 15:  94%|█████████▍| 110/117 [00:05<00:00, 19.94it/s, loss=2.63, v_num=1, val_acc=0.630]

Validation DataLoader 0:  70%|███████   | 14/20 [00:00<00:00, 33.55it/s]
Epoch 15:  95%|█████████▍| 111/117 [00:05<00:00, 20.01it/s, loss=2.63, v_num=1, val_acc=0.630]

Validation DataLoader 0:  75%|███████▌  | 15/20 [00:00<00:00, 33.43it/s]
Epoch 15:  96%|█████████▌| 112/117 [00:05<00:00, 20.07it/s, loss=2.63, v_num=1, val_acc=0.630]

Validation DataLoader 0:  80%|████████  | 16/20 [00:00<00:00, 33.31it/s]
Epoch 15:  97%|█████████▋| 113/117 [00:05<00:00, 20.14it/s, loss=2.63, v_num=1, val_acc=0.630]

Validation DataLoader 0:  85%|████████▌ | 17/20 [00:00<00:00, 33.04it/s]
Epoch 15:  97%|█████████▋| 114/117 [00:05<00:00, 20.19it/s, loss=2.63, v_num=1, val_acc=0.630]

Validation DataLoader 0:  90%|█████████ | 18/20 [00:00<00:00, 33.08it/s]
Epoch 15:  98%|█████████▊| 115/117 [00:05<00:00, 20.26it/s, loss=2.63, v_num=1, val_acc=0.630]

Validation DataLoader 0:  95%|█████████▌| 19/20 [00:00<00:00, 33.00it/s]
Epoch 15:  99%|█████████▉| 116/117 [00:05<00:00, 20.33it/s, loss=2.63, v_num=1, val_acc=0.630]

Validation DataLoader 0: 100%|██████████| 20/20 [00:00<00:00, 33.00it/s]
Epoch 15: 100%|██████████| 117/117 [00:05<00:00, 20.39it/s, loss=2.63, v_num=1, val_acc=0.630]
Epoch 15: 100%|██████████| 117/117 [00:05<00:00, 20.32it/s, loss=2.63, v_num=1, val_acc=0.679]


Epoch 15: 100%|██████████| 117/117 [00:05<00:00, 20.32it/s, loss=2.63, v_num=1, val_acc=0.679]
Epoch 15:   0%|          | 0/117 [00:00<?, ?it/s, loss=2.63, v_num=1, val_acc=0.679]
Epoch 16:   0%|          | 0/117 [00:00<?, ?it/s, loss=2.63, v_num=1, val_acc=0.679]
Epoch 16:   1%|          | 1/117 [00:00<01:46,  1.09it/s, loss=2.63, v_num=1, val_acc=0.679]
Epoch 16:   1%|          | 1/117 [00:00<01:49,  1.06it/s, loss=2.62, v_num=1, val_acc=0.679]
Epoch 16:   2%|▏         | 2/117 [00:00<00:54,  2.10it/s, loss=2.62, v_num=1, val_acc=0.679]
Epoch 16:   2%|▏         | 2/117 [00:00<00:56,  2.04it/s, loss=2.63, v_num=1, val_acc=0.679]
Epoch 16:   3%|▎         | 3/117 [00:00<00:37,  3.03it/s, loss=2.63, v_num=1, val_acc=0.679]
Epoch 16:   3%|▎         | 3/117 [00:01<00:38,  2.96it/s, loss=2.64, v_num=1, val_acc=0.679]
Epoch 16:   3%|▎         | 4/117 [00:01<00:28,  3.91it/s, loss=2.64, v_num=1, val_acc=0.679]
Epoch 16:   3%|▎         | 4/117 [00:01<00:29,  3.81it/s, loss=2.6, v_num=1, val_acc=0.679]
Epoch 16:   4%|▍         | 5/117 [00:01<00:23,  4.72it/s, loss=2.6, v_num=1, val_acc=0.679]
Epoch 16:   4%|▍         | 5/117 [00:01<00:24,  4.61it/s, loss=2.49, v_num=1, val_acc=0.679]
Epoch 16:   5%|▌         | 6/117 [00:01<00:20,  5.49it/s, loss=2.49, v_num=1, val_acc=0.679]
Epoch 16:   5%|▌         | 6/117 [00:01<00:20,  5.37it/s, loss=2.45, v_num=1, val_acc=0.679]
Epoch 16:   6%|▌         | 7/117 [00:01<00:17,  6.21it/s, loss=2.45, v_num=1, val_acc=0.679]
Epoch 16:   6%|▌         | 7/117 [00:01<00:18,  6.07it/s, loss=2.48, v_num=1, val_acc=0.679]
Epoch 16:   7%|▋         | 8/117 [00:01<00:15,  6.89it/s, loss=2.48, v_num=1, val_acc=0.679]
Epoch 16:   7%|▋         | 8/117 [00:01<00:16,  6.74it/s, loss=2.51, v_num=1, val_acc=0.679]
Epoch 16:   8%|▊         | 9/117 [00:01<00:14,  7.48it/s, loss=2.51, v_num=1, val_acc=0.679]
Epoch 16:   8%|▊         | 9/117 [00:01<00:14,  7.33it/s, loss=2.52, v_num=1, val_acc=0.679]
Epoch 16:   9%|▊         | 10/117 [00:01<00:13,  8.09it/s, loss=2.52, v_num=1, val_acc=0.679]
Epoch 16:   9%|▊         | 10/117 [00:01<00:13,  7.93it/s, loss=2.53, v_num=1, val_acc=0.679]
Epoch 16:   9%|▉         | 11/117 [00:01<00:12,  8.66it/s, loss=2.53, v_num=1, val_acc=0.679]
Epoch 16:   9%|▉         | 11/117 [00:01<00:12,  8.50it/s, loss=2.58, v_num=1, val_acc=0.679]
Epoch 16:  10%|█         | 12/117 [00:01<00:11,  9.21it/s, loss=2.58, v_num=1, val_acc=0.679]
Epoch 16:  10%|█         | 12/117 [00:01<00:11,  9.03it/s, loss=2.55, v_num=1, val_acc=0.679]
Epoch 16:  11%|█         | 13/117 [00:01<00:10,  9.73it/s, loss=2.55, v_num=1, val_acc=0.679]
Epoch 16:  11%|█         | 13/117 [00:01<00:10,  9.55it/s, loss=2.55, v_num=1, val_acc=0.679]
Epoch 16:  12%|█▏        | 14/117 [00:01<00:10, 10.22it/s, loss=2.55, v_num=1, val_acc=0.679]
Epoch 16:  12%|█▏        | 14/117 [00:01<00:10, 10.03it/s, loss=2.67, v_num=1, val_acc=0.679]
Epoch 16:  13%|█▎        | 15/117 [00:01<00:09, 10.69it/s, loss=2.67, v_num=1, val_acc=0.679]
Epoch 16:  13%|█▎        | 15/117 [00:01<00:09, 10.50it/s, loss=2.71, v_num=1, val_acc=0.679]
Epoch 16:  14%|█▎        | 16/117 [00:01<00:09, 11.13it/s, loss=2.71, v_num=1, val_acc=0.679]
Epoch 16:  14%|█▎        | 16/117 [00:01<00:09, 10.94it/s, loss=2.65, v_num=1, val_acc=0.679]
Epoch 16:  15%|█▍        | 17/117 [00:01<00:08, 11.53it/s, loss=2.65, v_num=1, val_acc=0.679]
Epoch 16:  15%|█▍        | 17/117 [00:01<00:08, 11.33it/s, loss=2.66, v_num=1, val_acc=0.679]
Epoch 16:  15%|█▌        | 18/117 [00:01<00:08, 11.93it/s, loss=2.66, v_num=1, val_acc=0.679]
Epoch 16:  15%|█▌        | 18/117 [00:01<00:08, 11.73it/s, loss=2.72, v_num=1, val_acc=0.679]
Epoch 16:  16%|█▌        | 19/117 [00:01<00:07, 12.32it/s, loss=2.72, v_num=1, val_acc=0.679]
Epoch 16:  16%|█▌        | 19/117 [00:01<00:08, 12.12it/s, loss=2.75, v_num=1, val_acc=0.679]
Epoch 16:  17%|█▋        | 20/117 [00:01<00:07, 12.66it/s, loss=2.75, v_num=1, val_acc=0.679]
Epoch 16:  17%|█▋        | 20/117 [00:01<00:07, 12.46it/s, loss=2.73, v_num=1, val_acc=0.679]
Epoch 16:  18%|█▊        | 21/117 [00:01<00:07, 13.02it/s, loss=2.73, v_num=1, val_acc=0.679]
Epoch 16:  18%|█▊        | 21/117 [00:01<00:07, 12.82it/s, loss=2.76, v_num=1, val_acc=0.679]
Epoch 16:  19%|█▉        | 22/117 [00:01<00:07, 13.37it/s, loss=2.76, v_num=1, val_acc=0.679]
Epoch 16:  19%|█▉        | 22/117 [00:01<00:07, 13.16it/s, loss=2.8, v_num=1, val_acc=0.679]
Epoch 16:  20%|█▉        | 23/117 [00:01<00:06, 13.68it/s, loss=2.8, v_num=1, val_acc=0.679]
Epoch 16:  20%|█▉        | 23/117 [00:01<00:06, 13.48it/s, loss=2.87, v_num=1, val_acc=0.679]
Epoch 16:  21%|██        | 24/117 [00:01<00:06, 13.99it/s, loss=2.87, v_num=1, val_acc=0.679]
Epoch 16:  21%|██        | 24/117 [00:01<00:06, 13.79it/s, loss=2.98, v_num=1, val_acc=0.679]
Epoch 16:  21%|██▏       | 25/117 [00:01<00:06, 14.28it/s, loss=2.98, v_num=1, val_acc=0.679]
Epoch 16:  21%|██▏       | 25/117 [00:01<00:06, 14.08it/s, loss=3.04, v_num=1, val_acc=0.679]
Epoch 16:  22%|██▏       | 26/117 [00:01<00:06, 14.57it/s, loss=3.04, v_num=1, val_acc=0.679]
Epoch 16:  22%|██▏       | 26/117 [00:01<00:06, 14.36it/s, loss=3.06, v_num=1, val_acc=0.679]
Epoch 16:  23%|██▎       | 27/117 [00:01<00:06, 14.85it/s, loss=3.06, v_num=1, val_acc=0.679]
Epoch 16:  23%|██▎       | 27/117 [00:01<00:06, 14.64it/s, loss=3.09, v_num=1, val_acc=0.679]
Epoch 16:  24%|██▍       | 28/117 [00:01<00:05, 15.12it/s, loss=3.09, v_num=1, val_acc=0.679]
Epoch 16:  24%|██▍       | 28/117 [00:01<00:05, 14.91it/s, loss=3.09, v_num=1, val_acc=0.679]
Epoch 16:  25%|██▍       | 29/117 [00:01<00:05, 15.37it/s, loss=3.09, v_num=1, val_acc=0.679]
Epoch 16:  25%|██▍       | 29/117 [00:01<00:05, 15.16it/s, loss=3.07, v_num=1, val_acc=0.679]
Epoch 16:  26%|██▌       | 30/117 [00:01<00:05, 15.61it/s, loss=3.07, v_num=1, val_acc=0.679]
Epoch 16:  26%|██▌       | 30/117 [00:01<00:05, 15.41it/s, loss=3.05, v_num=1, val_acc=0.679]
Epoch 16:  26%|██▋       | 31/117 [00:01<00:05, 15.85it/s, loss=3.05, v_num=1, val_acc=0.679]
Epoch 16:  26%|██▋       | 31/117 [00:01<00:05, 15.65it/s, loss=2.99, v_num=1, val_acc=0.679]
Epoch 16:  27%|██▋       | 32/117 [00:01<00:05, 16.08it/s, loss=2.99, v_num=1, val_acc=0.679]
Epoch 16:  27%|██▋       | 32/117 [00:02<00:05, 15.88it/s, loss=2.98, v_num=1, val_acc=0.679]
Epoch 16:  28%|██▊       | 33/117 [00:02<00:05, 16.30it/s, loss=2.98, v_num=1, val_acc=0.679]
Epoch 16:  28%|██▊       | 33/117 [00:02<00:05, 16.10it/s, loss=3, v_num=1, val_acc=0.679]
Epoch 16:  29%|██▉       | 34/117 [00:02<00:05, 16.51it/s, loss=3, v_num=1, val_acc=0.679]
Epoch 16:  29%|██▉       | 34/117 [00:02<00:05, 16.31it/s, loss=2.98, v_num=1, val_acc=0.679]
Epoch 16:  30%|██▉       | 35/117 [00:02<00:04, 16.72it/s, loss=2.98, v_num=1, val_acc=0.679]
Epoch 16:  30%|██▉       | 35/117 [00:02<00:04, 16.52it/s, loss=2.95, v_num=1, val_acc=0.679]
Epoch 16:  31%|███       | 36/117 [00:02<00:04, 16.92it/s, loss=2.95, v_num=1, val_acc=0.679]
Epoch 16:  31%|███       | 36/117 [00:02<00:04, 16.72it/s, loss=2.93, v_num=1, val_acc=0.679]
Epoch 16:  32%|███▏      | 37/117 [00:02<00:04, 17.11it/s, loss=2.93, v_num=1, val_acc=0.679]
Epoch 16:  32%|███▏      | 37/117 [00:02<00:04, 16.92it/s, loss=2.96, v_num=1, val_acc=0.679]
Epoch 16:  32%|███▏      | 38/117 [00:02<00:04, 17.30it/s, loss=2.96, v_num=1, val_acc=0.679]
Epoch 16:  32%|███▏      | 38/117 [00:02<00:04, 17.10it/s, loss=2.9, v_num=1, val_acc=0.679]
Epoch 16:  33%|███▎      | 39/117 [00:02<00:04, 17.48it/s, loss=2.9, v_num=1, val_acc=0.679]
Epoch 16:  33%|███▎      | 39/117 [00:02<00:04, 17.29it/s, loss=2.81, v_num=1, val_acc=0.679]
Epoch 16:  34%|███▍      | 40/117 [00:02<00:04, 17.66it/s, loss=2.81, v_num=1, val_acc=0.679]
Epoch 16:  34%|███▍      | 40/117 [00:02<00:04, 17.47it/s, loss=2.77, v_num=1, val_acc=0.679]
Epoch 16:  35%|███▌      | 41/117 [00:02<00:04, 17.83it/s, loss=2.77, v_num=1, val_acc=0.679]
Epoch 16:  35%|███▌      | 41/117 [00:02<00:04, 17.64it/s, loss=2.72, v_num=1, val_acc=0.679]
Epoch 16:  36%|███▌      | 42/117 [00:02<00:04, 17.99it/s, loss=2.72, v_num=1, val_acc=0.679]
Epoch 16:  36%|███▌      | 42/117 [00:02<00:04, 17.80it/s, loss=2.72, v_num=1, val_acc=0.679]
Epoch 16:  37%|███▋      | 43/117 [00:02<00:04, 18.15it/s, loss=2.72, v_num=1, val_acc=0.679]
Epoch 16:  37%|███▋      | 43/117 [00:02<00:04, 17.96it/s, loss=2.68, v_num=1, val_acc=0.679]
Epoch 16:  38%|███▊      | 44/117 [00:02<00:03, 18.30it/s, loss=2.68, v_num=1, val_acc=0.679]
Epoch 16:  38%|███▊      | 44/117 [00:02<00:04, 18.11it/s, loss=2.61, v_num=1, val_acc=0.679]
Epoch 16:  38%|███▊      | 45/117 [00:02<00:03, 18.45it/s, loss=2.61, v_num=1, val_acc=0.679]
Epoch 16:  38%|███▊      | 45/117 [00:02<00:03, 18.26it/s, loss=2.56, v_num=1, val_acc=0.679]
Epoch 16:  39%|███▉      | 46/117 [00:02<00:03, 18.59it/s, loss=2.56, v_num=1, val_acc=0.679]
Epoch 16:  39%|███▉      | 46/117 [00:02<00:03, 18.41it/s, loss=2.58, v_num=1, val_acc=0.679]
Epoch 16:  40%|████      | 47/117 [00:02<00:03, 18.74it/s, loss=2.58, v_num=1, val_acc=0.679]
Epoch 16:  40%|████      | 47/117 [00:02<00:03, 18.55it/s, loss=2.57, v_num=1, val_acc=0.679]
Epoch 16:  41%|████      | 48/117 [00:02<00:03, 18.87it/s, loss=2.57, v_num=1, val_acc=0.679]
Epoch 16:  41%|████      | 48/117 [00:02<00:03, 18.68it/s, loss=2.63, v_num=1, val_acc=0.679]
Epoch 16:  42%|████▏     | 49/117 [00:02<00:03, 18.99it/s, loss=2.63, v_num=1, val_acc=0.679]
Epoch 16:  42%|████▏     | 49/117 [00:02<00:03, 18.81it/s, loss=2.64, v_num=1, val_acc=0.679]
Epoch 16:  43%|████▎     | 50/117 [00:02<00:03, 19.11it/s, loss=2.64, v_num=1, val_acc=0.679]
Epoch 16:  43%|████▎     | 50/117 [00:02<00:03, 18.94it/s, loss=2.64, v_num=1, val_acc=0.679]
Epoch 16:  44%|████▎     | 51/117 [00:02<00:03, 19.24it/s, loss=2.64, v_num=1, val_acc=0.679]
Epoch 16:  44%|████▎     | 51/117 [00:02<00:03, 19.06it/s, loss=2.68, v_num=1, val_acc=0.679]
Epoch 16:  44%|████▍     | 52/117 [00:02<00:03, 19.36it/s, loss=2.68, v_num=1, val_acc=0.679]
Epoch 16:  44%|████▍     | 52/117 [00:02<00:03, 19.18it/s, loss=2.71, v_num=1, val_acc=0.679]
Epoch 16:  45%|████▌     | 53/117 [00:02<00:03, 19.48it/s, loss=2.71, v_num=1, val_acc=0.679]
Epoch 16:  45%|████▌     | 53/117 [00:02<00:03, 19.31it/s, loss=2.72, v_num=1, val_acc=0.679]
Epoch 16:  46%|████▌     | 54/117 [00:02<00:03, 19.61it/s, loss=2.72, v_num=1, val_acc=0.679]
Epoch 16:  46%|████▌     | 54/117 [00:02<00:03, 19.43it/s, loss=2.64, v_num=1, val_acc=0.679]
Epoch 16:  47%|████▋     | 55/117 [00:02<00:03, 19.72it/s, loss=2.64, v_num=1, val_acc=0.679]
Epoch 16:  47%|████▋     | 55/117 [00:02<00:03, 19.55it/s, loss=2.58, v_num=1, val_acc=0.679]
Epoch 16:  48%|████▊     | 56/117 [00:02<00:03, 19.84it/s, loss=2.58, v_num=1, val_acc=0.679]
Epoch 16:  48%|████▊     | 56/117 [00:02<00:03, 19.66it/s, loss=2.53, v_num=1, val_acc=0.679]
Epoch 16:  49%|████▊     | 57/117 [00:02<00:03, 19.95it/s, loss=2.53, v_num=1, val_acc=0.679]
Epoch 16:  49%|████▊     | 57/117 [00:02<00:03, 19.78it/s, loss=2.47, v_num=1, val_acc=0.679]
Epoch 16:  50%|████▉     | 58/117 [00:02<00:02, 20.06it/s, loss=2.47, v_num=1, val_acc=0.679]
Epoch 16:  50%|████▉     | 58/117 [00:02<00:02, 19.89it/s, loss=2.47, v_num=1, val_acc=0.679]
Epoch 16:  50%|█████     | 59/117 [00:02<00:02, 20.17it/s, loss=2.47, v_num=1, val_acc=0.679]
Epoch 16:  50%|█████     | 59/117 [00:02<00:02, 20.00it/s, loss=2.47, v_num=1, val_acc=0.679]
Epoch 16:  51%|█████▏    | 60/117 [00:02<00:02, 20.27it/s, loss=2.47, v_num=1, val_acc=0.679]
Epoch 16:  51%|█████▏    | 60/117 [00:02<00:02, 20.10it/s, loss=2.49, v_num=1, val_acc=0.679]
Epoch 16:  52%|█████▏    | 61/117 [00:02<00:02, 20.37it/s, loss=2.49, v_num=1, val_acc=0.679]
Epoch 16:  52%|█████▏    | 61/117 [00:03<00:02, 20.20it/s, loss=2.5, v_num=1, val_acc=0.679]
Epoch 16:  53%|█████▎    | 62/117 [00:03<00:02, 20.47it/s, loss=2.5, v_num=1, val_acc=0.679]
Epoch 16:  53%|█████▎    | 62/117 [00:03<00:02, 20.30it/s, loss=2.49, v_num=1, val_acc=0.679]
Epoch 16:  54%|█████▍    | 63/117 [00:03<00:02, 20.57it/s, loss=2.49, v_num=1, val_acc=0.679]
Epoch 16:  54%|█████▍    | 63/117 [00:03<00:02, 20.40it/s, loss=2.49, v_num=1, val_acc=0.679]
Epoch 16:  55%|█████▍    | 64/117 [00:03<00:02, 20.67it/s, loss=2.49, v_num=1, val_acc=0.679]
Epoch 16:  55%|█████▍    | 64/117 [00:03<00:02, 20.50it/s, loss=2.42, v_num=1, val_acc=0.679]
Epoch 16:  56%|█████▌    | 65/117 [00:03<00:02, 20.76it/s, loss=2.42, v_num=1, val_acc=0.679]
Epoch 16:  56%|█████▌    | 65/117 [00:03<00:02, 20.59it/s, loss=2.34, v_num=1, val_acc=0.679]
Epoch 16:  56%|█████▋    | 66/117 [00:03<00:02, 20.85it/s, loss=2.34, v_num=1, val_acc=0.679]
Epoch 16:  56%|█████▋    | 66/117 [00:03<00:02, 20.69it/s, loss=2.26, v_num=1, val_acc=0.679]
Epoch 16:  57%|█████▋    | 67/117 [00:03<00:02, 20.94it/s, loss=2.26, v_num=1, val_acc=0.679]
Epoch 16:  57%|█████▋    | 67/117 [00:03<00:02, 20.77it/s, loss=2.21, v_num=1, val_acc=0.679]
Epoch 16:  58%|█████▊    | 68/117 [00:03<00:02, 21.02it/s, loss=2.21, v_num=1, val_acc=0.679]
Epoch 16:  58%|█████▊    | 68/117 [00:03<00:02, 20.86it/s, loss=2.13, v_num=1, val_acc=0.679]
Epoch 16:  59%|█████▉    | 69/117 [00:03<00:02, 21.11it/s, loss=2.13, v_num=1, val_acc=0.679]
Epoch 16:  59%|█████▉    | 69/117 [00:03<00:02, 20.95it/s, loss=2.14, v_num=1, val_acc=0.679]
Epoch 16:  60%|█████▉    | 70/117 [00:03<00:02, 21.20it/s, loss=2.14, v_num=1, val_acc=0.679]
Epoch 16:  60%|█████▉    | 70/117 [00:03<00:02, 21.03it/s, loss=2.14, v_num=1, val_acc=0.679]
Epoch 16:  61%|██████    | 71/117 [00:03<00:02, 21.28it/s, loss=2.14, v_num=1, val_acc=0.679]
Epoch 16:  61%|██████    | 71/117 [00:03<00:02, 21.12it/s, loss=2.13, v_num=1, val_acc=0.679]
Epoch 16:  62%|██████▏   | 72/117 [00:03<00:02, 21.36it/s, loss=2.13, v_num=1, val_acc=0.679]
Epoch 16:  62%|██████▏   | 72/117 [00:03<00:02, 21.20it/s, loss=2.14, v_num=1, val_acc=0.679]
Epoch 16:  62%|██████▏   | 73/117 [00:03<00:02, 21.43it/s, loss=2.14, v_num=1, val_acc=0.679]
Epoch 16:  62%|██████▏   | 73/117 [00:03<00:02, 21.28it/s, loss=2.07, v_num=1, val_acc=0.679]
Epoch 16:  63%|██████▎   | 74/117 [00:03<00:01, 21.51it/s, loss=2.07, v_num=1, val_acc=0.679]
Epoch 16:  63%|██████▎   | 74/117 [00:03<00:02, 21.35it/s, loss=2.07, v_num=1, val_acc=0.679]
Epoch 16:  64%|██████▍   | 75/117 [00:03<00:01, 21.58it/s, loss=2.07, v_num=1, val_acc=0.679]
Epoch 16:  64%|██████▍   | 75/117 [00:03<00:01, 21.43it/s, loss=2.13, v_num=1, val_acc=0.679]
Epoch 16:  65%|██████▍   | 76/117 [00:03<00:01, 21.65it/s, loss=2.13, v_num=1, val_acc=0.679]
Epoch 16:  65%|██████▍   | 76/117 [00:03<00:01, 21.50it/s, loss=2.13, v_num=1, val_acc=0.679]
Epoch 16:  66%|██████▌   | 77/117 [00:03<00:01, 21.72it/s, loss=2.13, v_num=1, val_acc=0.679]
Epoch 16:  66%|██████▌   | 77/117 [00:03<00:01, 21.57it/s, loss=2.17, v_num=1, val_acc=0.679]
Epoch 16:  67%|██████▋   | 78/117 [00:03<00:01, 21.80it/s, loss=2.17, v_num=1, val_acc=0.679]
Epoch 16:  67%|██████▋   | 78/117 [00:03<00:01, 21.64it/s, loss=2.22, v_num=1, val_acc=0.679]
Epoch 16:  68%|██████▊   | 79/117 [00:03<00:01, 21.86it/s, loss=2.22, v_num=1, val_acc=0.679]
Epoch 16:  68%|██████▊   | 79/117 [00:03<00:01, 21.71it/s, loss=2.24, v_num=1, val_acc=0.679]
Epoch 16:  68%|██████▊   | 80/117 [00:03<00:01, 21.93it/s, loss=2.24, v_num=1, val_acc=0.679]
Epoch 16:  68%|██████▊   | 80/117 [00:03<00:01, 21.78it/s, loss=2.29, v_num=1, val_acc=0.679]
Epoch 16:  69%|██████▉   | 81/117 [00:03<00:01, 22.00it/s, loss=2.29, v_num=1, val_acc=0.679]
Epoch 16:  69%|██████▉   | 81/117 [00:03<00:01, 21.85it/s, loss=2.31, v_num=1, val_acc=0.679]
Epoch 16:  70%|███████   | 82/117 [00:03<00:01, 22.05it/s, loss=2.31, v_num=1, val_acc=0.679]
Epoch 16:  70%|███████   | 82/117 [00:03<00:01, 21.90it/s, loss=2.34, v_num=1, val_acc=0.679]
Epoch 16:  71%|███████   | 83/117 [00:03<00:01, 22.12it/s, loss=2.34, v_num=1, val_acc=0.679]
Epoch 16:  71%|███████   | 83/117 [00:03<00:01, 21.97it/s, loss=2.37, v_num=1, val_acc=0.679]
Epoch 16:  72%|███████▏  | 84/117 [00:03<00:01, 22.18it/s, loss=2.37, v_num=1, val_acc=0.679]
Epoch 16:  72%|███████▏  | 84/117 [00:03<00:01, 22.03it/s, loss=2.43, v_num=1, val_acc=0.679]
Epoch 16:  73%|███████▎  | 85/117 [00:03<00:01, 22.24it/s, loss=2.43, v_num=1, val_acc=0.679]
Epoch 16:  73%|███████▎  | 85/117 [00:03<00:01, 22.09it/s, loss=2.54, v_num=1, val_acc=0.679]
Epoch 16:  74%|███████▎  | 86/117 [00:03<00:01, 22.30it/s, loss=2.54, v_num=1, val_acc=0.679]
Epoch 16:  74%|███████▎  | 86/117 [00:03<00:01, 22.15it/s, loss=2.63, v_num=1, val_acc=0.679]
Epoch 16:  74%|███████▍  | 87/117 [00:03<00:01, 22.36it/s, loss=2.63, v_num=1, val_acc=0.679]
Epoch 16:  74%|███████▍  | 87/117 [00:03<00:01, 22.22it/s, loss=2.67, v_num=1, val_acc=0.679]
Epoch 16:  75%|███████▌  | 88/117 [00:03<00:01, 22.42it/s, loss=2.67, v_num=1, val_acc=0.679]
Epoch 16:  75%|███████▌  | 88/117 [00:03<00:01, 22.28it/s, loss=2.65, v_num=1, val_acc=0.679]
Epoch 16:  76%|███████▌  | 89/117 [00:03<00:01, 22.48it/s, loss=2.65, v_num=1, val_acc=0.679]
Epoch 16:  76%|███████▌  | 89/117 [00:03<00:01, 22.34it/s, loss=2.62, v_num=1, val_acc=0.679]
Epoch 16:  77%|███████▋  | 90/117 [00:03<00:01, 22.52it/s, loss=2.62, v_num=1, val_acc=0.679]
Epoch 16:  77%|███████▋  | 90/117 [00:04<00:01, 22.39it/s, loss=2.6, v_num=1, val_acc=0.679]
Epoch 16:  78%|███████▊  | 91/117 [00:04<00:01, 22.57it/s, loss=2.6, v_num=1, val_acc=0.679]
Epoch 16:  78%|███████▊  | 91/117 [00:04<00:01, 22.44it/s, loss=2.66, v_num=1, val_acc=0.679]
Epoch 16:  79%|███████▊  | 92/117 [00:04<00:01, 22.63it/s, loss=2.66, v_num=1, val_acc=0.679]
Epoch 16:  79%|███████▊  | 92/117 [00:04<00:01, 22.49it/s, loss=2.81, v_num=1, val_acc=0.679]
Epoch 16:  79%|███████▉  | 93/117 [00:04<00:01, 22.68it/s, loss=2.81, v_num=1, val_acc=0.679]
Epoch 16:  79%|███████▉  | 93/117 [00:04<00:01, 22.54it/s, loss=2.97, v_num=1, val_acc=0.679]
Epoch 16:  80%|████████  | 94/117 [00:04<00:01, 22.74it/s, loss=2.97, v_num=1, val_acc=0.679]
Epoch 16:  80%|████████  | 94/117 [00:04<00:01, 22.60it/s, loss=3.11, v_num=1, val_acc=0.679]
Epoch 16:  81%|████████  | 95/117 [00:04<00:00, 22.79it/s, loss=3.11, v_num=1, val_acc=0.679]
Epoch 16:  81%|████████  | 95/117 [00:04<00:00, 22.65it/s, loss=3.17, v_num=1, val_acc=0.679]
Epoch 16:  82%|████████▏ | 96/117 [00:04<00:00, 22.84it/s, loss=3.17, v_num=1, val_acc=0.679]
Epoch 16:  82%|████████▏ | 96/117 [00:04<00:00, 22.70it/s, loss=3.26, v_num=1, val_acc=0.679]
Epoch 16:  83%|████████▎ | 97/117 [00:04<00:00, 22.89it/s, loss=3.26, v_num=1, val_acc=0.679]
Epoch 16:  83%|████████▎ | 97/117 [00:04<00:00, 22.76it/s, loss=3.3, v_num=1, val_acc=0.679]

Validation: 0it [00:00, ?it/s]

Validation:   0%|          | 0/20 [00:00<?, ?it/s]

Validation DataLoader 0:   0%|          | 0/20 [00:00<?, ?it/s]

Validation DataLoader 0:   5%|▌         | 1/20 [00:00<00:00, 168.02it/s]
Epoch 16:  84%|████████▍ | 98/117 [00:05<00:00, 19.32it/s, loss=3.3, v_num=1, val_acc=0.679]

Validation DataLoader 0:  10%|█         | 2/20 [00:00<00:00, 54.64it/s]
Epoch 16:  85%|████████▍ | 99/117 [00:05<00:00, 19.40it/s, loss=3.3, v_num=1, val_acc=0.679]

Validation DataLoader 0:  15%|█▌        | 3/20 [00:00<00:00, 44.25it/s]
Epoch 16:  85%|████████▌ | 100/117 [00:05<00:00, 19.47it/s, loss=3.3, v_num=1, val_acc=0.679]

Validation DataLoader 0:  20%|██        | 4/20 [00:00<00:00, 40.16it/s]
Epoch 16:  86%|████████▋ | 101/117 [00:05<00:00, 19.55it/s, loss=3.3, v_num=1, val_acc=0.679]

Validation DataLoader 0:  25%|██▌       | 5/20 [00:00<00:00, 37.96it/s]
Epoch 16:  87%|████████▋ | 102/117 [00:05<00:00, 19.62it/s, loss=3.3, v_num=1, val_acc=0.679]

Validation DataLoader 0:  30%|███       | 6/20 [00:00<00:00, 36.55it/s]
Epoch 16:  88%|████████▊ | 103/117 [00:05<00:00, 19.69it/s, loss=3.3, v_num=1, val_acc=0.679]

Validation DataLoader 0:  35%|███▌      | 7/20 [00:00<00:00, 35.87it/s]
Epoch 16:  89%|████████▉ | 104/117 [00:05<00:00, 19.76it/s, loss=3.3, v_num=1, val_acc=0.679]

Validation DataLoader 0:  40%|████      | 8/20 [00:00<00:00, 35.29it/s]
Epoch 16:  90%|████████▉ | 105/117 [00:05<00:00, 19.83it/s, loss=3.3, v_num=1, val_acc=0.679]

Validation DataLoader 0:  45%|████▌     | 9/20 [00:00<00:00, 34.79it/s]
Epoch 16:  91%|█████████ | 106/117 [00:05<00:00, 19.90it/s, loss=3.3, v_num=1, val_acc=0.679]

Validation DataLoader 0:  50%|█████     | 10/20 [00:00<00:00, 34.44it/s]
Epoch 16:  91%|█████████▏| 107/117 [00:05<00:00, 19.97it/s, loss=3.3, v_num=1, val_acc=0.679]

Validation DataLoader 0:  55%|█████▌    | 11/20 [00:00<00:00, 34.19it/s]
Epoch 16:  92%|█████████▏| 108/117 [00:05<00:00, 20.04it/s, loss=3.3, v_num=1, val_acc=0.679]

Validation DataLoader 0:  60%|██████    | 12/20 [00:00<00:00, 33.97it/s]
Epoch 16:  93%|█████████▎| 109/117 [00:05<00:00, 20.11it/s, loss=3.3, v_num=1, val_acc=0.679]

Validation DataLoader 0:  65%|██████▌   | 13/20 [00:00<00:00, 33.75it/s]
Epoch 16:  94%|█████████▍| 110/117 [00:05<00:00, 20.17it/s, loss=3.3, v_num=1, val_acc=0.679]

Validation DataLoader 0:  70%|███████   | 14/20 [00:00<00:00, 33.61it/s]
Epoch 16:  95%|█████████▍| 111/117 [00:05<00:00, 20.24it/s, loss=3.3, v_num=1, val_acc=0.679]

Validation DataLoader 0:  75%|███████▌  | 15/20 [00:00<00:00, 33.48it/s]
Epoch 16:  96%|█████████▌| 112/117 [00:05<00:00, 20.31it/s, loss=3.3, v_num=1, val_acc=0.679]

Validation DataLoader 0:  80%|████████  | 16/20 [00:00<00:00, 33.35it/s]
Epoch 16:  97%|█████████▋| 113/117 [00:05<00:00, 20.37it/s, loss=3.3, v_num=1, val_acc=0.679]

Validation DataLoader 0:  85%|████████▌ | 17/20 [00:00<00:00, 33.23it/s]
Epoch 16:  97%|█████████▋| 114/117 [00:05<00:00, 20.43it/s, loss=3.3, v_num=1, val_acc=0.679]

Validation DataLoader 0:  90%|█████████ | 18/20 [00:00<00:00, 33.14it/s]
Epoch 16:  98%|█████████▊| 115/117 [00:05<00:00, 20.50it/s, loss=3.3, v_num=1, val_acc=0.679]

Validation DataLoader 0:  95%|█████████▌| 19/20 [00:00<00:00, 33.06it/s]
Epoch 16:  99%|█████████▉| 116/117 [00:05<00:00, 20.56it/s, loss=3.3, v_num=1, val_acc=0.679]

Validation DataLoader 0: 100%|██████████| 20/20 [00:00<00:00, 33.05it/s]
Epoch 16: 100%|██████████| 117/117 [00:05<00:00, 20.62it/s, loss=3.3, v_num=1, val_acc=0.679]
Epoch 16: 100%|██████████| 117/117 [00:05<00:00, 20.55it/s, loss=3.3, v_num=1, val_acc=0.697]


Epoch 16: 100%|██████████| 117/117 [00:05<00:00, 20.55it/s, loss=3.3, v_num=1, val_acc=0.697]
Epoch 16:   0%|          | 0/117 [00:00<?, ?it/s, loss=3.3, v_num=1, val_acc=0.697]
Epoch 17:   0%|          | 0/117 [00:00<?, ?it/s, loss=3.3, v_num=1, val_acc=0.697]
Epoch 17:   1%|          | 1/117 [00:00<01:42,  1.13it/s, loss=3.3, v_num=1, val_acc=0.697]
Epoch 17:   1%|          | 1/117 [00:00<01:44,  1.11it/s, loss=3.27, v_num=1, val_acc=0.697]
Epoch 17:   2%|▏         | 2/117 [00:00<00:52,  2.17it/s, loss=3.27, v_num=1, val_acc=0.697]
Epoch 17:   2%|▏         | 2/117 [00:00<00:54,  2.12it/s, loss=3.28, v_num=1, val_acc=0.697]
Epoch 17:   3%|▎         | 3/117 [00:00<00:36,  3.13it/s, loss=3.28, v_num=1, val_acc=0.697]
Epoch 17:   3%|▎         | 3/117 [00:00<00:37,  3.05it/s, loss=3.27, v_num=1, val_acc=0.697]
Epoch 17:   3%|▎         | 4/117 [00:00<00:28,  4.02it/s, loss=3.27, v_num=1, val_acc=0.697]
Epoch 17:   3%|▎         | 4/117 [00:01<00:28,  3.93it/s, loss=3.29, v_num=1, val_acc=0.697]
Epoch 17:   4%|▍         | 5/117 [00:01<00:23,  4.87it/s, loss=3.29, v_num=1, val_acc=0.697]
Epoch 17:   4%|▍         | 5/117 [00:01<00:23,  4.75it/s, loss=3.26, v_num=1, val_acc=0.697]
Epoch 17:   5%|▌         | 6/117 [00:01<00:19,  5.66it/s, loss=3.26, v_num=1, val_acc=0.697]
Epoch 17:   5%|▌         | 6/117 [00:01<00:20,  5.52it/s, loss=3.25, v_num=1, val_acc=0.697]
Epoch 17:   6%|▌         | 7/117 [00:01<00:17,  6.39it/s, loss=3.25, v_num=1, val_acc=0.697]
Epoch 17:   6%|▌         | 7/117 [00:01<00:17,  6.25it/s, loss=3.31, v_num=1, val_acc=0.697]
Epoch 17:   7%|▋         | 8/117 [00:01<00:15,  7.09it/s, loss=3.31, v_num=1, val_acc=0.697]
Epoch 17:   7%|▋         | 8/117 [00:01<00:15,  6.93it/s, loss=3.33, v_num=1, val_acc=0.697]
Epoch 17:   8%|▊         | 9/117 [00:01<00:14,  7.67it/s, loss=3.33, v_num=1, val_acc=0.697]
Epoch 17:   8%|▊         | 9/117 [00:01<00:14,  7.52it/s, loss=3.25, v_num=1, val_acc=0.697]
Epoch 17:   9%|▊         | 10/117 [00:01<00:12,  8.28it/s, loss=3.25, v_num=1, val_acc=0.697]
Epoch 17:   9%|▊         | 10/117 [00:01<00:13,  8.11it/s, loss=3.21, v_num=1, val_acc=0.697]
Epoch 17:   9%|▉         | 11/117 [00:01<00:11,  8.86it/s, loss=3.21, v_num=1, val_acc=0.697]
Epoch 17:   9%|▉         | 11/117 [00:01<00:12,  8.68it/s, loss=3.26, v_num=1, val_acc=0.697]
Epoch 17:  10%|█         | 12/117 [00:01<00:11,  9.41it/s, loss=3.26, v_num=1, val_acc=0.697]
Epoch 17:  10%|█         | 12/117 [00:01<00:11,  9.23it/s, loss=3.28, v_num=1, val_acc=0.697]
Epoch 17:  11%|█         | 13/117 [00:01<00:10,  9.94it/s, loss=3.28, v_num=1, val_acc=0.697]
Epoch 17:  11%|█         | 13/117 [00:01<00:10,  9.75it/s, loss=3.34, v_num=1, val_acc=0.697]
Epoch 17:  12%|█▏        | 14/117 [00:01<00:09, 10.44it/s, loss=3.34, v_num=1, val_acc=0.697]
Epoch 17:  12%|█▏        | 14/117 [00:01<00:10, 10.24it/s, loss=3.28, v_num=1, val_acc=0.697]
Epoch 17:  13%|█▎        | 15/117 [00:01<00:09, 10.90it/s, loss=3.28, v_num=1, val_acc=0.697]
Epoch 17:  13%|█▎        | 15/117 [00:01<00:09, 10.71it/s, loss=3.11, v_num=1, val_acc=0.697]
Epoch 17:  14%|█▎        | 16/117 [00:01<00:08, 11.35it/s, loss=3.11, v_num=1, val_acc=0.697]
Epoch 17:  14%|█▎        | 16/117 [00:01<00:09, 11.15it/s, loss=2.97, v_num=1, val_acc=0.697]
Epoch 17:  15%|█▍        | 17/117 [00:01<00:08, 11.75it/s, loss=2.97, v_num=1, val_acc=0.697]
Epoch 17:  15%|█▍        | 17/117 [00:01<00:08, 11.55it/s, loss=2.85, v_num=1, val_acc=0.697]
Epoch 17:  15%|█▌        | 18/117 [00:01<00:08, 12.16it/s, loss=2.85, v_num=1, val_acc=0.697]
Epoch 17:  15%|█▌        | 18/117 [00:01<00:08, 11.95it/s, loss=2.74, v_num=1, val_acc=0.697]
Epoch 17:  16%|█▌        | 19/117 [00:01<00:07, 12.54it/s, loss=2.74, v_num=1, val_acc=0.697]
Epoch 17:  16%|█▌        | 19/117 [00:01<00:07, 12.34it/s, loss=2.68, v_num=1, val_acc=0.697]
Epoch 17:  17%|█▋        | 20/117 [00:01<00:07, 12.92it/s, loss=2.68, v_num=1, val_acc=0.697]
Epoch 17:  17%|█▋        | 20/117 [00:01<00:07, 12.71it/s, loss=2.62, v_num=1, val_acc=0.697]
Epoch 17:  18%|█▊        | 21/117 [00:01<00:07, 13.28it/s, loss=2.62, v_num=1, val_acc=0.697]
Epoch 17:  18%|█▊        | 21/117 [00:01<00:07, 13.07it/s, loss=2.68, v_num=1, val_acc=0.697]
Epoch 17:  19%|█▉        | 22/117 [00:01<00:06, 13.61it/s, loss=2.68, v_num=1, val_acc=0.697]
Epoch 17:  19%|█▉        | 22/117 [00:01<00:07, 13.40it/s, loss=2.74, v_num=1, val_acc=0.697]
Epoch 17:  20%|█▉        | 23/117 [00:01<00:06, 13.93it/s, loss=2.74, v_num=1, val_acc=0.697]
Epoch 17:  20%|█▉        | 23/117 [00:01<00:06, 13.73it/s, loss=2.72, v_num=1, val_acc=0.697]
Epoch 17:  21%|██        | 24/117 [00:01<00:06, 14.24it/s, loss=2.72, v_num=1, val_acc=0.697]
Epoch 17:  21%|██        | 24/117 [00:01<00:06, 14.03it/s, loss=2.7, v_num=1, val_acc=0.697]
Epoch 17:  21%|██▏       | 25/117 [00:01<00:06, 14.49it/s, loss=2.7, v_num=1, val_acc=0.697]
Epoch 17:  21%|██▏       | 25/117 [00:01<00:06, 14.30it/s, loss=2.68, v_num=1, val_acc=0.697]
Epoch 17:  22%|██▏       | 26/117 [00:01<00:06, 14.77it/s, loss=2.68, v_num=1, val_acc=0.697]
Epoch 17:  22%|██▏       | 26/117 [00:01<00:06, 14.57it/s, loss=2.63, v_num=1, val_acc=0.697]
Epoch 17:  23%|██▎       | 27/117 [00:01<00:05, 15.05it/s, loss=2.63, v_num=1, val_acc=0.697]
Epoch 17:  23%|██▎       | 27/117 [00:01<00:06, 14.85it/s, loss=2.51, v_num=1, val_acc=0.697]
Epoch 17:  24%|██▍       | 28/117 [00:01<00:05, 15.32it/s, loss=2.51, v_num=1, val_acc=0.697]
Epoch 17:  24%|██▍       | 28/117 [00:01<00:05, 15.11it/s, loss=2.43, v_num=1, val_acc=0.697]
Epoch 17:  25%|██▍       | 29/117 [00:01<00:05, 15.57it/s, loss=2.43, v_num=1, val_acc=0.697]
Epoch 17:  25%|██▍       | 29/117 [00:01<00:05, 15.36it/s, loss=2.47, v_num=1, val_acc=0.697]
Epoch 17:  26%|██▌       | 30/117 [00:01<00:05, 15.81it/s, loss=2.47, v_num=1, val_acc=0.697]
Epoch 17:  26%|██▌       | 30/117 [00:01<00:05, 15.60it/s, loss=2.5, v_num=1, val_acc=0.697]
Epoch 17:  26%|██▋       | 31/117 [00:01<00:05, 16.04it/s, loss=2.5, v_num=1, val_acc=0.697]
Epoch 17:  26%|██▋       | 31/117 [00:01<00:05, 15.84it/s, loss=2.44, v_num=1, val_acc=0.697]
Epoch 17:  27%|██▋       | 32/117 [00:01<00:05, 16.28it/s, loss=2.44, v_num=1, val_acc=0.697]
Epoch 17:  27%|██▋       | 32/117 [00:01<00:05, 16.07it/s, loss=2.43, v_num=1, val_acc=0.697]
Epoch 17:  28%|██▊       | 33/117 [00:02<00:05, 16.48it/s, loss=2.43, v_num=1, val_acc=0.697]
Epoch 17:  28%|██▊       | 33/117 [00:02<00:05, 16.28it/s, loss=2.45, v_num=1, val_acc=0.697]
Epoch 17:  29%|██▉       | 34/117 [00:02<00:04, 16.70it/s, loss=2.45, v_num=1, val_acc=0.697]
Epoch 17:  29%|██▉       | 34/117 [00:02<00:05, 16.50it/s, loss=2.56, v_num=1, val_acc=0.697]
Epoch 17:  30%|██▉       | 35/117 [00:02<00:04, 16.92it/s, loss=2.56, v_num=1, val_acc=0.697]
Epoch 17:  30%|██▉       | 35/117 [00:02<00:04, 16.71it/s, loss=2.59, v_num=1, val_acc=0.697]
Epoch 17:  31%|███       | 36/117 [00:02<00:04, 17.11it/s, loss=2.59, v_num=1, val_acc=0.697]
Epoch 17:  31%|███       | 36/117 [00:02<00:04, 16.91it/s, loss=2.61, v_num=1, val_acc=0.697]
Epoch 17:  32%|███▏      | 37/117 [00:02<00:04, 17.31it/s, loss=2.61, v_num=1, val_acc=0.697]
Epoch 17:  32%|███▏      | 37/117 [00:02<00:04, 17.10it/s, loss=2.59, v_num=1, val_acc=0.697]
Epoch 17:  32%|███▏      | 38/117 [00:02<00:04, 17.49it/s, loss=2.59, v_num=1, val_acc=0.697]
Epoch 17:  32%|███▏      | 38/117 [00:02<00:04, 17.29it/s, loss=2.62, v_num=1, val_acc=0.697]
Epoch 17:  33%|███▎      | 39/117 [00:02<00:04, 17.67it/s, loss=2.62, v_num=1, val_acc=0.697]
Epoch 17:  33%|███▎      | 39/117 [00:02<00:04, 17.48it/s, loss=2.66, v_num=1, val_acc=0.697]
Epoch 17:  34%|███▍      | 40/117 [00:02<00:04, 17.84it/s, loss=2.66, v_num=1, val_acc=0.697]
Epoch 17:  34%|███▍      | 40/117 [00:02<00:04, 17.64it/s, loss=2.63, v_num=1, val_acc=0.697]
Epoch 17:  35%|███▌      | 41/117 [00:02<00:04, 18.01it/s, loss=2.63, v_num=1, val_acc=0.697]
Epoch 17:  35%|███▌      | 41/117 [00:02<00:04, 17.81it/s, loss=2.61, v_num=1, val_acc=0.697]
Epoch 17:  36%|███▌      | 42/117 [00:02<00:04, 18.18it/s, loss=2.61, v_num=1, val_acc=0.697]
Epoch 17:  36%|███▌      | 42/117 [00:02<00:04, 17.98it/s, loss=2.58, v_num=1, val_acc=0.697]
Epoch 17:  37%|███▋      | 43/117 [00:02<00:04, 18.33it/s, loss=2.58, v_num=1, val_acc=0.697]
Epoch 17:  37%|███▋      | 43/117 [00:02<00:04, 18.13it/s, loss=2.52, v_num=1, val_acc=0.697]
Epoch 17:  38%|███▊      | 44/117 [00:02<00:03, 18.48it/s, loss=2.52, v_num=1, val_acc=0.697]
Epoch 17:  38%|███▊      | 44/117 [00:02<00:03, 18.28it/s, loss=2.49, v_num=1, val_acc=0.697]
Epoch 17:  38%|███▊      | 45/117 [00:02<00:03, 18.63it/s, loss=2.49, v_num=1, val_acc=0.697]
Epoch 17:  38%|███▊      | 45/117 [00:02<00:03, 18.44it/s, loss=2.44, v_num=1, val_acc=0.697]
Epoch 17:  39%|███▉      | 46/117 [00:02<00:03, 18.78it/s, loss=2.44, v_num=1, val_acc=0.697]
Epoch 17:  39%|███▉      | 46/117 [00:02<00:03, 18.58it/s, loss=2.44, v_num=1, val_acc=0.697]
Epoch 17:  40%|████      | 47/117 [00:02<00:03, 18.92it/s, loss=2.44, v_num=1, val_acc=0.697]
Epoch 17:  40%|████      | 47/117 [00:02<00:03, 18.73it/s, loss=2.47, v_num=1, val_acc=0.697]
Epoch 17:  41%|████      | 48/117 [00:02<00:03, 19.06it/s, loss=2.47, v_num=1, val_acc=0.697]
Epoch 17:  41%|████      | 48/117 [00:02<00:03, 18.87it/s, loss=2.56, v_num=1, val_acc=0.697]
Epoch 17:  42%|████▏     | 49/117 [00:02<00:03, 19.19it/s, loss=2.56, v_num=1, val_acc=0.697]
Epoch 17:  42%|████▏     | 49/117 [00:02<00:03, 19.01it/s, loss=2.54, v_num=1, val_acc=0.697]
Epoch 17:  43%|████▎     | 50/117 [00:02<00:03, 19.33it/s, loss=2.54, v_num=1, val_acc=0.697]
Epoch 17:  43%|████▎     | 50/117 [00:02<00:03, 19.14it/s, loss=2.54, v_num=1, val_acc=0.697]
Epoch 17:  44%|████▎     | 51/117 [00:02<00:03, 19.45it/s, loss=2.54, v_num=1, val_acc=0.697]
Epoch 17:  44%|████▎     | 51/117 [00:02<00:03, 19.27it/s, loss=2.6, v_num=1, val_acc=0.697]
Epoch 17:  44%|████▍     | 52/117 [00:02<00:03, 19.57it/s, loss=2.6, v_num=1, val_acc=0.697]
Epoch 17:  44%|████▍     | 52/117 [00:02<00:03, 19.39it/s, loss=2.68, v_num=1, val_acc=0.697]
Epoch 17:  45%|████▌     | 53/117 [00:02<00:03, 19.69it/s, loss=2.68, v_num=1, val_acc=0.697]
Epoch 17:  45%|████▌     | 53/117 [00:02<00:03, 19.51it/s, loss=2.79, v_num=1, val_acc=0.697]
Epoch 17:  46%|████▌     | 54/117 [00:02<00:03, 19.82it/s, loss=2.79, v_num=1, val_acc=0.697]
Epoch 17:  46%|████▌     | 54/117 [00:02<00:03, 19.63it/s, loss=2.78, v_num=1, val_acc=0.697]
Epoch 17:  47%|████▋     | 55/117 [00:02<00:03, 19.93it/s, loss=2.78, v_num=1, val_acc=0.697]
Epoch 17:  47%|████▋     | 55/117 [00:02<00:03, 19.75it/s, loss=2.84, v_num=1, val_acc=0.697]
Epoch 17:  48%|████▊     | 56/117 [00:02<00:03, 20.01it/s, loss=2.84, v_num=1, val_acc=0.697]
Epoch 17:  48%|████▊     | 56/117 [00:02<00:03, 19.85it/s, loss=2.89, v_num=1, val_acc=0.697]
Epoch 17:  49%|████▊     | 57/117 [00:02<00:02, 20.14it/s, loss=2.89, v_num=1, val_acc=0.697]
Epoch 17:  49%|████▊     | 57/117 [00:02<00:03, 19.96it/s, loss=2.96, v_num=1, val_acc=0.697]
Epoch 17:  50%|████▉     | 58/117 [00:02<00:02, 20.24it/s, loss=2.96, v_num=1, val_acc=0.697]
Epoch 17:  50%|████▉     | 58/117 [00:02<00:02, 20.07it/s, loss=3.06, v_num=1, val_acc=0.697]
Epoch 17:  50%|█████     | 59/117 [00:02<00:02, 20.30it/s, loss=3.06, v_num=1, val_acc=0.697]
Epoch 17:  50%|█████     | 59/117 [00:02<00:02, 20.13it/s, loss=3.06, v_num=1, val_acc=0.697]
Epoch 17:  51%|█████▏    | 60/117 [00:02<00:02, 20.40it/s, loss=3.06, v_num=1, val_acc=0.697]
Epoch 17:  51%|█████▏    | 60/117 [00:02<00:02, 20.23it/s, loss=3.14, v_num=1, val_acc=0.697]
Epoch 17:  52%|█████▏    | 61/117 [00:02<00:02, 20.50it/s, loss=3.14, v_num=1, val_acc=0.697]
Epoch 17:  52%|█████▏    | 61/117 [00:03<00:02, 20.32it/s, loss=3.12, v_num=1, val_acc=0.697]
Epoch 17:  53%|█████▎    | 62/117 [00:03<00:02, 20.59it/s, loss=3.12, v_num=1, val_acc=0.697]
Epoch 17:  53%|█████▎    | 62/117 [00:03<00:02, 20.42it/s, loss=3.07, v_num=1, val_acc=0.697]
Epoch 17:  54%|█████▍    | 63/117 [00:03<00:02, 20.69it/s, loss=3.07, v_num=1, val_acc=0.697]
Epoch 17:  54%|█████▍    | 63/117 [00:03<00:02, 20.52it/s, loss=3.07, v_num=1, val_acc=0.697]
Epoch 17:  55%|█████▍    | 64/117 [00:03<00:02, 20.78it/s, loss=3.07, v_num=1, val_acc=0.697]
Epoch 17:  55%|█████▍    | 64/117 [00:03<00:02, 20.61it/s, loss=3.14, v_num=1, val_acc=0.697]
Epoch 17:  56%|█████▌    | 65/117 [00:03<00:02, 20.87it/s, loss=3.14, v_num=1, val_acc=0.697]
Epoch 17:  56%|█████▌    | 65/117 [00:03<00:02, 20.70it/s, loss=3.22, v_num=1, val_acc=0.697]
Epoch 17:  56%|█████▋    | 66/117 [00:03<00:02, 20.95it/s, loss=3.22, v_num=1, val_acc=0.697]
Epoch 17:  56%|█████▋    | 66/117 [00:03<00:02, 20.79it/s, loss=3.21, v_num=1, val_acc=0.697]
Epoch 17:  57%|█████▋    | 67/117 [00:03<00:02, 21.03it/s, loss=3.21, v_num=1, val_acc=0.697]
Epoch 17:  57%|█████▋    | 67/117 [00:03<00:02, 20.86it/s, loss=3.21, v_num=1, val_acc=0.697]
Epoch 17:  58%|█████▊    | 68/117 [00:03<00:02, 21.11it/s, loss=3.21, v_num=1, val_acc=0.697]
Epoch 17:  58%|█████▊    | 68/117 [00:03<00:02, 20.94it/s, loss=3.13, v_num=1, val_acc=0.697]
Epoch 17:  59%|█████▉    | 69/117 [00:03<00:02, 21.18it/s, loss=3.13, v_num=1, val_acc=0.697]
Epoch 17:  59%|█████▉    | 69/117 [00:03<00:02, 21.02it/s, loss=3.15, v_num=1, val_acc=0.697]
Epoch 17:  60%|█████▉    | 70/117 [00:03<00:02, 21.26it/s, loss=3.15, v_num=1, val_acc=0.697]
Epoch 17:  60%|█████▉    | 70/117 [00:03<00:02, 21.10it/s, loss=3.2, v_num=1, val_acc=0.697]
Epoch 17:  61%|██████    | 71/117 [00:03<00:02, 21.34it/s, loss=3.2, v_num=1, val_acc=0.697]
Epoch 17:  61%|██████    | 71/117 [00:03<00:02, 21.18it/s, loss=3.2, v_num=1, val_acc=0.697]
Epoch 17:  62%|██████▏   | 72/117 [00:03<00:02, 21.42it/s, loss=3.2, v_num=1, val_acc=0.697]
Epoch 17:  62%|██████▏   | 72/117 [00:03<00:02, 21.26it/s, loss=3.14, v_num=1, val_acc=0.697]
Epoch 17:  62%|██████▏   | 73/117 [00:03<00:02, 21.49it/s, loss=3.14, v_num=1, val_acc=0.697]
Epoch 17:  62%|██████▏   | 73/117 [00:03<00:02, 21.33it/s, loss=2.98, v_num=1, val_acc=0.697]
Epoch 17:  63%|██████▎   | 74/117 [00:03<00:01, 21.57it/s, loss=2.98, v_num=1, val_acc=0.697]
Epoch 17:  63%|██████▎   | 74/117 [00:03<00:02, 21.41it/s, loss=2.95, v_num=1, val_acc=0.697]
Epoch 17:  64%|██████▍   | 75/117 [00:03<00:01, 21.64it/s, loss=2.95, v_num=1, val_acc=0.697]
Epoch 17:  64%|██████▍   | 75/117 [00:03<00:01, 21.49it/s, loss=2.97, v_num=1, val_acc=0.697]
Epoch 17:  65%|██████▍   | 76/117 [00:03<00:01, 21.70it/s, loss=2.97, v_num=1, val_acc=0.697]
Epoch 17:  65%|██████▍   | 76/117 [00:03<00:01, 21.56it/s, loss=2.98, v_num=1, val_acc=0.697]
Epoch 17:  66%|██████▌   | 77/117 [00:03<00:01, 21.78it/s, loss=2.98, v_num=1, val_acc=0.697]
Epoch 17:  66%|██████▌   | 77/117 [00:03<00:01, 21.63it/s, loss=3.03, v_num=1, val_acc=0.697]
Epoch 17:  67%|██████▋   | 78/117 [00:03<00:01, 21.85it/s, loss=3.03, v_num=1, val_acc=0.697]
Epoch 17:  67%|██████▋   | 78/117 [00:03<00:01, 21.70it/s, loss=3.01, v_num=1, val_acc=0.697]
Epoch 17:  68%|██████▊   | 79/117 [00:03<00:01, 21.88it/s, loss=3.01, v_num=1, val_acc=0.697]
Epoch 17:  68%|██████▊   | 79/117 [00:03<00:01, 21.76it/s, loss=3.07, v_num=1, val_acc=0.697]
Epoch 17:  68%|██████▊   | 80/117 [00:03<00:01, 21.98it/s, loss=3.07, v_num=1, val_acc=0.697]
Epoch 17:  68%|██████▊   | 80/117 [00:03<00:01, 21.83it/s, loss=3.04, v_num=1, val_acc=0.697]
Epoch 17:  69%|██████▉   | 81/117 [00:03<00:01, 22.01it/s, loss=3.04, v_num=1, val_acc=0.697]
Epoch 17:  69%|██████▉   | 81/117 [00:03<00:01, 21.87it/s, loss=3.05, v_num=1, val_acc=0.697]
Epoch 17:  70%|███████   | 82/117 [00:03<00:01, 22.00it/s, loss=3.05, v_num=1, val_acc=0.697]
Epoch 17:  70%|███████   | 82/117 [00:03<00:01, 21.91it/s, loss=3.08, v_num=1, val_acc=0.697]
Epoch 17:  71%|███████   | 83/117 [00:03<00:01, 22.12it/s, loss=3.08, v_num=1, val_acc=0.697]
Epoch 17:  71%|███████   | 83/117 [00:03<00:01, 21.97it/s, loss=3.1, v_num=1, val_acc=0.697]
Epoch 17:  72%|███████▏  | 84/117 [00:03<00:01, 22.18it/s, loss=3.1, v_num=1, val_acc=0.697]
Epoch 17:  72%|███████▏  | 84/117 [00:03<00:01, 22.03it/s, loss=3.07, v_num=1, val_acc=0.697]
Epoch 17:  73%|███████▎  | 85/117 [00:03<00:01, 22.24it/s, loss=3.07, v_num=1, val_acc=0.697]
Epoch 17:  73%|███████▎  | 85/117 [00:03<00:01, 22.09it/s, loss=3.02, v_num=1, val_acc=0.697]
Epoch 17:  74%|███████▎  | 86/117 [00:03<00:01, 22.30it/s, loss=3.02, v_num=1, val_acc=0.697]
Epoch 17:  74%|███████▎  | 86/117 [00:03<00:01, 22.16it/s, loss=3.06, v_num=1, val_acc=0.697]
Epoch 17:  74%|███████▍  | 87/117 [00:03<00:01, 22.33it/s, loss=3.06, v_num=1, val_acc=0.697]
Epoch 17:  74%|███████▍  | 87/117 [00:03<00:01, 22.22it/s, loss=3.07, v_num=1, val_acc=0.697]
Epoch 17:  75%|███████▌  | 88/117 [00:03<00:01, 22.42it/s, loss=3.07, v_num=1, val_acc=0.697]
Epoch 17:  75%|███████▌  | 88/117 [00:03<00:01, 22.28it/s, loss=3.1, v_num=1, val_acc=0.697]
Epoch 17:  76%|███████▌  | 89/117 [00:03<00:01, 22.48it/s, loss=3.1, v_num=1, val_acc=0.697]
Epoch 17:  76%|███████▌  | 89/117 [00:03<00:01, 22.33it/s, loss=3.08, v_num=1, val_acc=0.697]
Epoch 17:  77%|███████▋  | 90/117 [00:03<00:01, 22.53it/s, loss=3.08, v_num=1, val_acc=0.697]
Epoch 17:  77%|███████▋  | 90/117 [00:04<00:01, 22.39it/s, loss=3, v_num=1, val_acc=0.697]
Epoch 17:  78%|███████▊  | 91/117 [00:04<00:01, 22.59it/s, loss=3, v_num=1, val_acc=0.697]
Epoch 17:  78%|███████▊  | 91/117 [00:04<00:01, 22.45it/s, loss=2.93, v_num=1, val_acc=0.697]
Epoch 17:  79%|███████▊  | 92/117 [00:04<00:01, 22.64it/s, loss=2.93, v_num=1, val_acc=0.697]
Epoch 17:  79%|███████▊  | 92/117 [00:04<00:01, 22.50it/s, loss=2.89, v_num=1, val_acc=0.697]
Epoch 17:  79%|███████▉  | 93/117 [00:04<00:01, 22.69it/s, loss=2.89, v_num=1, val_acc=0.697]
Epoch 17:  79%|███████▉  | 93/117 [00:04<00:01, 22.55it/s, loss=2.88, v_num=1, val_acc=0.697]
Epoch 17:  80%|████████  | 94/117 [00:04<00:01, 22.74it/s, loss=2.88, v_num=1, val_acc=0.697]
Epoch 17:  80%|████████  | 94/117 [00:04<00:01, 22.61it/s, loss=2.84, v_num=1, val_acc=0.697]
Epoch 17:  81%|████████  | 95/117 [00:04<00:00, 22.80it/s, loss=2.84, v_num=1, val_acc=0.697]
Epoch 17:  81%|████████  | 95/117 [00:04<00:00, 22.66it/s, loss=2.82, v_num=1, val_acc=0.697]
Epoch 17:  82%|████████▏ | 96/117 [00:04<00:00, 22.85it/s, loss=2.82, v_num=1, val_acc=0.697]
Epoch 17:  82%|████████▏ | 96/117 [00:04<00:00, 22.71it/s, loss=2.79, v_num=1, val_acc=0.697]
Epoch 17:  83%|████████▎ | 97/117 [00:04<00:00, 22.89it/s, loss=2.79, v_num=1, val_acc=0.697]
Epoch 17:  83%|████████▎ | 97/117 [00:04<00:00, 22.76it/s, loss=2.68, v_num=1, val_acc=0.697]

Validation: 0it [00:00, ?it/s]

Validation:   0%|          | 0/20 [00:00<?, ?it/s]

Validation DataLoader 0:   0%|          | 0/20 [00:00<?, ?it/s]

Validation DataLoader 0:   5%|▌         | 1/20 [00:00<00:00, 126.77it/s]
Epoch 17:  84%|████████▍ | 98/117 [00:05<00:00, 19.09it/s, loss=2.68, v_num=1, val_acc=0.697]

Validation DataLoader 0:  10%|█         | 2/20 [00:00<00:00, 54.23it/s]
Epoch 17:  85%|████████▍ | 99/117 [00:05<00:00, 19.17it/s, loss=2.68, v_num=1, val_acc=0.697]

Validation DataLoader 0:  15%|█▌        | 3/20 [00:00<00:00, 43.47it/s]
Epoch 17:  85%|████████▌ | 100/117 [00:05<00:00, 19.25it/s, loss=2.68, v_num=1, val_acc=0.697]

Validation DataLoader 0:  20%|██        | 4/20 [00:00<00:00, 38.86it/s]
Epoch 17:  86%|████████▋ | 101/117 [00:05<00:00, 19.31it/s, loss=2.68, v_num=1, val_acc=0.697]

Validation DataLoader 0:  25%|██▌       | 5/20 [00:00<00:00, 36.65it/s]
Epoch 17:  87%|████████▋ | 102/117 [00:05<00:00, 19.38it/s, loss=2.68, v_num=1, val_acc=0.697]

Validation DataLoader 0:  30%|███       | 6/20 [00:00<00:00, 35.70it/s]
Epoch 17:  88%|████████▊ | 103/117 [00:05<00:00, 19.45it/s, loss=2.68, v_num=1, val_acc=0.697]

Validation DataLoader 0:  35%|███▌      | 7/20 [00:00<00:00, 35.00it/s]
Epoch 17:  89%|████████▉ | 104/117 [00:05<00:00, 19.52it/s, loss=2.68, v_num=1, val_acc=0.697]

Validation DataLoader 0:  40%|████      | 8/20 [00:00<00:00, 34.66it/s]
Epoch 17:  90%|████████▉ | 105/117 [00:05<00:00, 19.60it/s, loss=2.68, v_num=1, val_acc=0.697]

Validation DataLoader 0:  45%|████▌     | 9/20 [00:00<00:00, 34.29it/s]
Epoch 17:  91%|█████████ | 106/117 [00:05<00:00, 19.67it/s, loss=2.68, v_num=1, val_acc=0.697]

Validation DataLoader 0:  50%|█████     | 10/20 [00:00<00:00, 34.06it/s]
Epoch 17:  91%|█████████▏| 107/117 [00:05<00:00, 19.74it/s, loss=2.68, v_num=1, val_acc=0.697]

Validation DataLoader 0:  55%|█████▌    | 11/20 [00:00<00:00, 33.85it/s]
Epoch 17:  92%|█████████▏| 108/117 [00:05<00:00, 19.81it/s, loss=2.68, v_num=1, val_acc=0.697]

Validation DataLoader 0:  60%|██████    | 12/20 [00:00<00:00, 33.69it/s]
Epoch 17:  93%|█████████▎| 109/117 [00:05<00:00, 19.88it/s, loss=2.68, v_num=1, val_acc=0.697]

Validation DataLoader 0:  65%|██████▌   | 13/20 [00:00<00:00, 33.53it/s]
Epoch 17:  94%|█████████▍| 110/117 [00:05<00:00, 19.95it/s, loss=2.68, v_num=1, val_acc=0.697]

Validation DataLoader 0:  70%|███████   | 14/20 [00:00<00:00, 33.41it/s]
Epoch 17:  95%|█████████▍| 111/117 [00:05<00:00, 20.02it/s, loss=2.68, v_num=1, val_acc=0.697]

Validation DataLoader 0:  75%|███████▌  | 15/20 [00:00<00:00, 33.30it/s]
Epoch 17:  96%|█████████▌| 112/117 [00:05<00:00, 20.08it/s, loss=2.68, v_num=1, val_acc=0.697]

Validation DataLoader 0:  80%|████████  | 16/20 [00:00<00:00, 33.20it/s]
Epoch 17:  97%|█████████▋| 113/117 [00:05<00:00, 20.15it/s, loss=2.68, v_num=1, val_acc=0.697]

Validation DataLoader 0:  85%|████████▌ | 17/20 [00:00<00:00, 33.10it/s]
Epoch 17:  97%|█████████▋| 114/117 [00:05<00:00, 20.21it/s, loss=2.68, v_num=1, val_acc=0.697]

Validation DataLoader 0:  90%|█████████ | 18/20 [00:00<00:00, 33.02it/s]
Epoch 17:  98%|█████████▊| 115/117 [00:05<00:00, 20.28it/s, loss=2.68, v_num=1, val_acc=0.697]

Validation DataLoader 0:  95%|█████████▌| 19/20 [00:00<00:00, 32.94it/s]
Epoch 17:  99%|█████████▉| 116/117 [00:05<00:00, 20.34it/s, loss=2.68, v_num=1, val_acc=0.697]

Validation DataLoader 0: 100%|██████████| 20/20 [00:00<00:00, 32.94it/s]
Epoch 17: 100%|██████████| 117/117 [00:05<00:00, 20.41it/s, loss=2.68, v_num=1, val_acc=0.697]
Epoch 17: 100%|██████████| 117/117 [00:05<00:00, 20.33it/s, loss=2.68, v_num=1, val_acc=0.676]


Epoch 17: 100%|██████████| 117/117 [00:05<00:00, 20.33it/s, loss=2.68, v_num=1, val_acc=0.676]
Epoch 17:   0%|          | 0/117 [00:00<?, ?it/s, loss=2.68, v_num=1, val_acc=0.676]
Epoch 18:   0%|          | 0/117 [00:00<?, ?it/s, loss=2.68, v_num=1, val_acc=0.676]
Epoch 18:   1%|          | 1/117 [00:00<01:48,  1.07it/s, loss=2.68, v_num=1, val_acc=0.676]
Epoch 18:   1%|          | 1/117 [00:00<01:50,  1.05it/s, loss=2.56, v_num=1, val_acc=0.676]
Epoch 18:   2%|▏         | 2/117 [00:00<00:55,  2.07it/s, loss=2.56, v_num=1, val_acc=0.676]
Epoch 18:   2%|▏         | 2/117 [00:00<00:57,  2.02it/s, loss=2.44, v_num=1, val_acc=0.676]
Epoch 18:   3%|▎         | 3/117 [00:01<00:38,  2.98it/s, loss=2.44, v_num=1, val_acc=0.676]
Epoch 18:   3%|▎         | 3/117 [00:01<00:39,  2.91it/s, loss=2.44, v_num=1, val_acc=0.676]
Epoch 18:   3%|▎         | 4/117 [00:01<00:29,  3.84it/s, loss=2.44, v_num=1, val_acc=0.676]
Epoch 18:   3%|▎         | 4/117 [00:01<00:30,  3.75it/s, loss=2.45, v_num=1, val_acc=0.676]
Epoch 18:   4%|▍         | 5/117 [00:01<00:24,  4.64it/s, loss=2.45, v_num=1, val_acc=0.676]
Epoch 18:   4%|▍         | 5/117 [00:01<00:24,  4.53it/s, loss=2.42, v_num=1, val_acc=0.676]
Epoch 18:   5%|▌         | 6/117 [00:01<00:20,  5.38it/s, loss=2.42, v_num=1, val_acc=0.676]
Epoch 18:   5%|▌         | 6/117 [00:01<00:21,  5.27it/s, loss=2.41, v_num=1, val_acc=0.676]
Epoch 18:   6%|▌         | 7/117 [00:01<00:18,  6.08it/s, loss=2.41, v_num=1, val_acc=0.676]
Epoch 18:   6%|▌         | 7/117 [00:01<00:18,  5.96it/s, loss=2.42, v_num=1, val_acc=0.676]
Epoch 18:   7%|▋         | 8/117 [00:01<00:16,  6.75it/s, loss=2.42, v_num=1, val_acc=0.676]
Epoch 18:   7%|▋         | 8/117 [00:01<00:16,  6.61it/s, loss=2.48, v_num=1, val_acc=0.676]
Epoch 18:   8%|▊         | 9/117 [00:01<00:14,  7.38it/s, loss=2.48, v_num=1, val_acc=0.676]
Epoch 18:   8%|▊         | 9/117 [00:01<00:14,  7.23it/s, loss=2.5, v_num=1, val_acc=0.676]
Epoch 18:   9%|▊         | 10/117 [00:01<00:13,  7.98it/s, loss=2.5, v_num=1, val_acc=0.676]
Epoch 18:   9%|▊         | 10/117 [00:01<00:13,  7.82it/s, loss=2.51, v_num=1, val_acc=0.676]
Epoch 18:   9%|▉         | 11/117 [00:01<00:12,  8.53it/s, loss=2.51, v_num=1, val_acc=0.676]
Epoch 18:   9%|▉         | 11/117 [00:01<00:12,  8.37it/s, loss=2.5, v_num=1, val_acc=0.676]
Epoch 18:  10%|█         | 12/117 [00:01<00:11,  9.07it/s, loss=2.5, v_num=1, val_acc=0.676]
Epoch 18:  10%|█         | 12/117 [00:01<00:11,  8.90it/s, loss=2.53, v_num=1, val_acc=0.676]
Epoch 18:  11%|█         | 13/117 [00:01<00:10,  9.58it/s, loss=2.53, v_num=1, val_acc=0.676]
Epoch 18:  11%|█         | 13/117 [00:01<00:11,  9.40it/s, loss=2.55, v_num=1, val_acc=0.676]
Epoch 18:  12%|█▏        | 14/117 [00:01<00:10, 10.05it/s, loss=2.55, v_num=1, val_acc=0.676]
Epoch 18:  12%|█▏        | 14/117 [00:01<00:10,  9.88it/s, loss=2.6, v_num=1, val_acc=0.676]
Epoch 18:  13%|█▎        | 15/117 [00:01<00:09, 10.51it/s, loss=2.6, v_num=1, val_acc=0.676]
Epoch 18:  13%|█▎        | 15/117 [00:01<00:09, 10.33it/s, loss=2.64, v_num=1, val_acc=0.676]
Epoch 18:  14%|█▎        | 16/117 [00:01<00:09, 10.94it/s, loss=2.64, v_num=1, val_acc=0.676]
Epoch 18:  14%|█▎        | 16/117 [00:01<00:09, 10.75it/s, loss=2.67, v_num=1, val_acc=0.676]
Epoch 18:  15%|█▍        | 17/117 [00:01<00:08, 11.34it/s, loss=2.67, v_num=1, val_acc=0.676]
Epoch 18:  15%|█▍        | 17/117 [00:01<00:08, 11.16it/s, loss=2.63, v_num=1, val_acc=0.676]
Epoch 18:  15%|█▌        | 18/117 [00:01<00:08, 11.73it/s, loss=2.63, v_num=1, val_acc=0.676]
Epoch 18:  15%|█▌        | 18/117 [00:01<00:08, 11.54it/s, loss=2.55, v_num=1, val_acc=0.676]
Epoch 18:  16%|█▌        | 19/117 [00:01<00:08, 12.11it/s, loss=2.55, v_num=1, val_acc=0.676]
Epoch 18:  16%|█▌        | 19/117 [00:01<00:08, 11.92it/s, loss=2.48, v_num=1, val_acc=0.676]
Epoch 18:  17%|█▋        | 20/117 [00:01<00:07, 12.47it/s, loss=2.48, v_num=1, val_acc=0.676]
Epoch 18:  17%|█▋        | 20/117 [00:01<00:07, 12.28it/s, loss=2.43, v_num=1, val_acc=0.676]
Epoch 18:  18%|█▊        | 21/117 [00:01<00:07, 12.82it/s, loss=2.43, v_num=1, val_acc=0.676]
Epoch 18:  18%|█▊        | 21/117 [00:01<00:07, 12.63it/s, loss=2.43, v_num=1, val_acc=0.676]
Epoch 18:  19%|█▉        | 22/117 [00:01<00:07, 13.14it/s, loss=2.43, v_num=1, val_acc=0.676]
Epoch 18:  19%|█▉        | 22/117 [00:01<00:07, 12.95it/s, loss=2.44, v_num=1, val_acc=0.676]
Epoch 18:  20%|█▉        | 23/117 [00:01<00:06, 13.46it/s, loss=2.44, v_num=1, val_acc=0.676]
Epoch 18:  20%|█▉        | 23/117 [00:01<00:07, 13.27it/s, loss=2.44, v_num=1, val_acc=0.676]
Epoch 18:  21%|██        | 24/117 [00:01<00:06, 13.77it/s, loss=2.44, v_num=1, val_acc=0.676]
Epoch 18:  21%|██        | 24/117 [00:01<00:06, 13.57it/s, loss=2.46, v_num=1, val_acc=0.676]
Epoch 18:  21%|██▏       | 25/117 [00:01<00:06, 14.06it/s, loss=2.46, v_num=1, val_acc=0.676]
Epoch 18:  21%|██▏       | 25/117 [00:01<00:06, 13.86it/s, loss=2.45, v_num=1, val_acc=0.676]
Epoch 18:  22%|██▏       | 26/117 [00:01<00:06, 14.34it/s, loss=2.45, v_num=1, val_acc=0.676]
Epoch 18:  22%|██▏       | 26/117 [00:01<00:06, 14.14it/s, loss=2.47, v_num=1, val_acc=0.676]
Epoch 18:  23%|██▎       | 27/117 [00:01<00:06, 14.62it/s, loss=2.47, v_num=1, val_acc=0.676]
Epoch 18:  23%|██▎       | 27/117 [00:01<00:06, 14.42it/s, loss=2.44, v_num=1, val_acc=0.676]
Epoch 18:  24%|██▍       | 28/117 [00:01<00:05, 14.88it/s, loss=2.44, v_num=1, val_acc=0.676]
Epoch 18:  24%|██▍       | 28/117 [00:01<00:06, 14.68it/s, loss=2.38, v_num=1, val_acc=0.676]
Epoch 18:  25%|██▍       | 29/117 [00:01<00:05, 15.12it/s, loss=2.38, v_num=1, val_acc=0.676]
Epoch 18:  25%|██▍       | 29/117 [00:01<00:05, 14.93it/s, loss=2.36, v_num=1, val_acc=0.676]
Epoch 18:  26%|██▌       | 30/117 [00:01<00:05, 15.37it/s, loss=2.36, v_num=1, val_acc=0.676]
Epoch 18:  26%|██▌       | 30/117 [00:01<00:05, 15.18it/s, loss=2.48, v_num=1, val_acc=0.676]
Epoch 18:  26%|██▋       | 31/117 [00:01<00:05, 15.61it/s, loss=2.48, v_num=1, val_acc=0.676]
Epoch 18:  26%|██▋       | 31/117 [00:02<00:05, 15.41it/s, loss=2.52, v_num=1, val_acc=0.676]
Epoch 18:  27%|██▋       | 32/117 [00:02<00:05, 15.83it/s, loss=2.52, v_num=1, val_acc=0.676]
Epoch 18:  27%|██▋       | 32/117 [00:02<00:05, 15.64it/s, loss=2.57, v_num=1, val_acc=0.676]
Epoch 18:  28%|██▊       | 33/117 [00:02<00:05, 16.05it/s, loss=2.57, v_num=1, val_acc=0.676]
Epoch 18:  28%|██▊       | 33/117 [00:02<00:05, 15.86it/s, loss=2.64, v_num=1, val_acc=0.676]
Epoch 18:  29%|██▉       | 34/117 [00:02<00:05, 16.26it/s, loss=2.64, v_num=1, val_acc=0.676]
Epoch 18:  29%|██▉       | 34/117 [00:02<00:05, 16.07it/s, loss=2.61, v_num=1, val_acc=0.676]
Epoch 18:  30%|██▉       | 35/117 [00:02<00:04, 16.47it/s, loss=2.61, v_num=1, val_acc=0.676]
Epoch 18:  30%|██▉       | 35/117 [00:02<00:05, 16.28it/s, loss=2.58, v_num=1, val_acc=0.676]
Epoch 18:  31%|███       | 36/117 [00:02<00:04, 16.66it/s, loss=2.58, v_num=1, val_acc=0.676]
Epoch 18:  31%|███       | 36/117 [00:02<00:04, 16.47it/s, loss=2.61, v_num=1, val_acc=0.676]
Epoch 18:  32%|███▏      | 37/117 [00:02<00:04, 16.86it/s, loss=2.61, v_num=1, val_acc=0.676]
Epoch 18:  32%|███▏      | 37/117 [00:02<00:04, 16.67it/s, loss=2.68, v_num=1, val_acc=0.676]
Epoch 18:  32%|███▏      | 38/117 [00:02<00:04, 17.04it/s, loss=2.68, v_num=1, val_acc=0.676]
Epoch 18:  32%|███▏      | 38/117 [00:02<00:04, 16.85it/s, loss=2.74, v_num=1, val_acc=0.676]
Epoch 18:  33%|███▎      | 39/117 [00:02<00:04, 17.22it/s, loss=2.74, v_num=1, val_acc=0.676]
Epoch 18:  33%|███▎      | 39/117 [00:02<00:04, 17.04it/s, loss=2.76, v_num=1, val_acc=0.676]
Epoch 18:  34%|███▍      | 40/117 [00:02<00:04, 17.40it/s, loss=2.76, v_num=1, val_acc=0.676]
Epoch 18:  34%|███▍      | 40/117 [00:02<00:04, 17.21it/s, loss=2.84, v_num=1, val_acc=0.676]
Epoch 18:  35%|███▌      | 41/117 [00:02<00:04, 17.57it/s, loss=2.84, v_num=1, val_acc=0.676]
Epoch 18:  35%|███▌      | 41/117 [00:02<00:04, 17.38it/s, loss=2.86, v_num=1, val_acc=0.676]
Epoch 18:  36%|███▌      | 42/117 [00:02<00:04, 17.73it/s, loss=2.86, v_num=1, val_acc=0.676]
Epoch 18:  36%|███▌      | 42/117 [00:02<00:04, 17.55it/s, loss=2.87, v_num=1, val_acc=0.676]
Epoch 18:  37%|███▋      | 43/117 [00:02<00:04, 17.89it/s, loss=2.87, v_num=1, val_acc=0.676]
Epoch 18:  37%|███▋      | 43/117 [00:02<00:04, 17.71it/s, loss=2.85, v_num=1, val_acc=0.676]
Epoch 18:  38%|███▊      | 44/117 [00:02<00:04, 18.05it/s, loss=2.85, v_num=1, val_acc=0.676]
Epoch 18:  38%|███▊      | 44/117 [00:02<00:04, 17.86it/s, loss=2.79, v_num=1, val_acc=0.676]
Epoch 18:  38%|███▊      | 45/117 [00:02<00:03, 18.20it/s, loss=2.79, v_num=1, val_acc=0.676]
Epoch 18:  38%|███▊      | 45/117 [00:02<00:03, 18.01it/s, loss=2.81, v_num=1, val_acc=0.676]
Epoch 18:  39%|███▉      | 46/117 [00:02<00:03, 18.34it/s, loss=2.81, v_num=1, val_acc=0.676]
Epoch 18:  39%|███▉      | 46/117 [00:02<00:03, 18.16it/s, loss=2.86, v_num=1, val_acc=0.676]
Epoch 18:  40%|████      | 47/117 [00:02<00:03, 18.48it/s, loss=2.86, v_num=1, val_acc=0.676]
Epoch 18:  40%|████      | 47/117 [00:02<00:03, 18.30it/s, loss=2.93, v_num=1, val_acc=0.676]
Epoch 18:  41%|████      | 48/117 [00:02<00:03, 18.62it/s, loss=2.93, v_num=1, val_acc=0.676]
Epoch 18:  41%|████      | 48/117 [00:02<00:03, 18.44it/s, loss=3, v_num=1, val_acc=0.676]
Epoch 18:  42%|████▏     | 49/117 [00:02<00:03, 18.75it/s, loss=3, v_num=1, val_acc=0.676]
Epoch 18:  42%|████▏     | 49/117 [00:02<00:03, 18.58it/s, loss=2.97, v_num=1, val_acc=0.676]
Epoch 18:  43%|████▎     | 50/117 [00:02<00:03, 18.89it/s, loss=2.97, v_num=1, val_acc=0.676]
Epoch 18:  43%|████▎     | 50/117 [00:02<00:03, 18.71it/s, loss=2.88, v_num=1, val_acc=0.676]
Epoch 18:  44%|████▎     | 51/117 [00:02<00:03, 19.01it/s, loss=2.88, v_num=1, val_acc=0.676]
Epoch 18:  44%|████▎     | 51/117 [00:02<00:03, 18.83it/s, loss=2.88, v_num=1, val_acc=0.676]
Epoch 18:  44%|████▍     | 52/117 [00:02<00:03, 19.14it/s, loss=2.88, v_num=1, val_acc=0.676]
Epoch 18:  44%|████▍     | 52/117 [00:02<00:03, 18.96it/s, loss=2.85, v_num=1, val_acc=0.676]
Epoch 18:  45%|████▌     | 53/117 [00:02<00:03, 19.26it/s, loss=2.85, v_num=1, val_acc=0.676]
Epoch 18:  45%|████▌     | 53/117 [00:02<00:03, 19.08it/s, loss=2.75, v_num=1, val_acc=0.676]
Epoch 18:  46%|████▌     | 54/117 [00:02<00:03, 19.37it/s, loss=2.75, v_num=1, val_acc=0.676]
Epoch 18:  46%|████▌     | 54/117 [00:02<00:03, 19.20it/s, loss=2.77, v_num=1, val_acc=0.676]
Epoch 18:  47%|████▋     | 55/117 [00:02<00:03, 19.49it/s, loss=2.77, v_num=1, val_acc=0.676]
Epoch 18:  47%|████▋     | 55/117 [00:02<00:03, 19.32it/s, loss=2.73, v_num=1, val_acc=0.676]
Epoch 18:  48%|████▊     | 56/117 [00:02<00:03, 19.60it/s, loss=2.73, v_num=1, val_acc=0.676]
Epoch 18:  48%|████▊     | 56/117 [00:02<00:03, 19.43it/s, loss=2.62, v_num=1, val_acc=0.676]
Epoch 18:  49%|████▊     | 57/117 [00:02<00:03, 19.71it/s, loss=2.62, v_num=1, val_acc=0.676]
Epoch 18:  49%|████▊     | 57/117 [00:02<00:03, 19.54it/s, loss=2.54, v_num=1, val_acc=0.676]
Epoch 18:  50%|████▉     | 58/117 [00:02<00:02, 19.82it/s, loss=2.54, v_num=1, val_acc=0.676]
Epoch 18:  50%|████▉     | 58/117 [00:02<00:03, 19.65it/s, loss=2.46, v_num=1, val_acc=0.676]
Epoch 18:  50%|█████     | 59/117 [00:02<00:02, 19.92it/s, loss=2.46, v_num=1, val_acc=0.676]
Epoch 18:  50%|█████     | 59/117 [00:02<00:02, 19.76it/s, loss=2.51, v_num=1, val_acc=0.676]
Epoch 18:  51%|█████▏    | 60/117 [00:02<00:02, 20.03it/s, loss=2.51, v_num=1, val_acc=0.676]
Epoch 18:  51%|█████▏    | 60/117 [00:03<00:02, 19.86it/s, loss=2.47, v_num=1, val_acc=0.676]
Epoch 18:  52%|█████▏    | 61/117 [00:03<00:02, 20.12it/s, loss=2.47, v_num=1, val_acc=0.676]
Epoch 18:  52%|█████▏    | 61/117 [00:03<00:02, 19.96it/s, loss=2.5, v_num=1, val_acc=0.676]
Epoch 18:  53%|█████▎    | 62/117 [00:03<00:02, 20.22it/s, loss=2.5, v_num=1, val_acc=0.676]
Epoch 18:  53%|█████▎    | 62/117 [00:03<00:02, 20.06it/s, loss=2.48, v_num=1, val_acc=0.676]
Epoch 18:  54%|█████▍    | 63/117 [00:03<00:02, 20.32it/s, loss=2.48, v_num=1, val_acc=0.676]
Epoch 18:  54%|█████▍    | 63/117 [00:03<00:02, 20.16it/s, loss=2.48, v_num=1, val_acc=0.676]
Epoch 18:  55%|█████▍    | 64/117 [00:03<00:02, 20.41it/s, loss=2.48, v_num=1, val_acc=0.676]
Epoch 18:  55%|█████▍    | 64/117 [00:03<00:02, 20.25it/s, loss=2.46, v_num=1, val_acc=0.676]
Epoch 18:  56%|█████▌    | 65/117 [00:03<00:02, 20.49it/s, loss=2.46, v_num=1, val_acc=0.676]
Epoch 18:  56%|█████▌    | 65/117 [00:03<00:02, 20.33it/s, loss=2.49, v_num=1, val_acc=0.676]
Epoch 18:  56%|█████▋    | 66/117 [00:03<00:02, 20.57it/s, loss=2.49, v_num=1, val_acc=0.676]
Epoch 18:  56%|█████▋    | 66/117 [00:03<00:02, 20.42it/s, loss=2.56, v_num=1, val_acc=0.676]
Epoch 18:  57%|█████▋    | 67/117 [00:03<00:02, 20.66it/s, loss=2.56, v_num=1, val_acc=0.676]
Epoch 18:  57%|█████▋    | 67/117 [00:03<00:02, 20.51it/s, loss=2.62, v_num=1, val_acc=0.676]
Epoch 18:  58%|█████▊    | 68/117 [00:03<00:02, 20.74it/s, loss=2.62, v_num=1, val_acc=0.676]
Epoch 18:  58%|█████▊    | 68/117 [00:03<00:02, 20.59it/s, loss=2.65, v_num=1, val_acc=0.676]
Epoch 18:  59%|█████▉    | 69/117 [00:03<00:02, 20.78it/s, loss=2.65, v_num=1, val_acc=0.676]
Epoch 18:  59%|█████▉    | 69/117 [00:03<00:02, 20.67it/s, loss=2.72, v_num=1, val_acc=0.676]
Epoch 18:  60%|█████▉    | 70/117 [00:03<00:02, 20.91it/s, loss=2.72, v_num=1, val_acc=0.676]
Epoch 18:  60%|█████▉    | 70/117 [00:03<00:02, 20.75it/s, loss=2.66, v_num=1, val_acc=0.676]
Epoch 18:  61%|██████    | 71/117 [00:03<00:02, 20.91it/s, loss=2.66, v_num=1, val_acc=0.676]
Epoch 18:  61%|██████    | 71/117 [00:03<00:02, 20.78it/s, loss=2.64, v_num=1, val_acc=0.676]
Epoch 18:  62%|██████▏   | 72/117 [00:03<00:02, 21.00it/s, loss=2.64, v_num=1, val_acc=0.676]
Epoch 18:  62%|██████▏   | 72/117 [00:03<00:02, 20.85it/s, loss=2.62, v_num=1, val_acc=0.676]
Epoch 18:  62%|██████▏   | 73/117 [00:03<00:02, 21.08it/s, loss=2.62, v_num=1, val_acc=0.676]
Epoch 18:  62%|██████▏   | 73/117 [00:03<00:02, 20.93it/s, loss=2.69, v_num=1, val_acc=0.676]
Epoch 18:  63%|██████▎   | 74/117 [00:03<00:02, 21.07it/s, loss=2.69, v_num=1, val_acc=0.676]
Epoch 18:  63%|██████▎   | 74/117 [00:03<00:02, 20.94it/s, loss=2.76, v_num=1, val_acc=0.676]
Epoch 18:  64%|██████▍   | 75/117 [00:03<00:01, 21.13it/s, loss=2.76, v_num=1, val_acc=0.676]
Epoch 18:  64%|██████▍   | 75/117 [00:03<00:01, 21.00it/s, loss=2.84, v_num=1, val_acc=0.676]
Epoch 18:  65%|██████▍   | 76/117 [00:03<00:01, 21.19it/s, loss=2.84, v_num=1, val_acc=0.676]
Epoch 18:  65%|██████▍   | 76/117 [00:03<00:01, 21.06it/s, loss=2.89, v_num=1, val_acc=0.676]
Epoch 18:  66%|██████▌   | 77/117 [00:03<00:01, 21.26it/s, loss=2.89, v_num=1, val_acc=0.676]
Epoch 18:  66%|██████▌   | 77/117 [00:03<00:01, 21.13it/s, loss=2.9, v_num=1, val_acc=0.676]
Epoch 18:  67%|██████▋   | 78/117 [00:03<00:01, 21.34it/s, loss=2.9, v_num=1, val_acc=0.676]
Epoch 18:  67%|██████▋   | 78/117 [00:03<00:01, 21.20it/s, loss=2.91, v_num=1, val_acc=0.676]
Epoch 18:  68%|██████▊   | 79/117 [00:03<00:01, 21.42it/s, loss=2.91, v_num=1, val_acc=0.676]
Epoch 18:  68%|██████▊   | 79/117 [00:03<00:01, 21.27it/s, loss=2.94, v_num=1, val_acc=0.676]
Epoch 18:  68%|██████▊   | 80/117 [00:03<00:01, 21.45it/s, loss=2.94, v_num=1, val_acc=0.676]
Epoch 18:  68%|██████▊   | 80/117 [00:03<00:01, 21.34it/s, loss=2.91, v_num=1, val_acc=0.676]
Epoch 18:  69%|██████▉   | 81/117 [00:03<00:01, 21.52it/s, loss=2.91, v_num=1, val_acc=0.676]
Epoch 18:  69%|██████▉   | 81/117 [00:03<00:01, 21.39it/s, loss=2.84, v_num=1, val_acc=0.676]
Epoch 18:  70%|███████   | 82/117 [00:03<00:01, 21.54it/s, loss=2.84, v_num=1, val_acc=0.676]
Epoch 18:  70%|███████   | 82/117 [00:03<00:01, 21.41it/s, loss=2.87, v_num=1, val_acc=0.676]
Epoch 18:  71%|███████   | 83/117 [00:03<00:01, 21.57it/s, loss=2.87, v_num=1, val_acc=0.676]
Epoch 18:  71%|███████   | 83/117 [00:03<00:01, 21.47it/s, loss=2.91, v_num=1, val_acc=0.676]
Epoch 18:  72%|███████▏  | 84/117 [00:03<00:01, 21.67it/s, loss=2.91, v_num=1, val_acc=0.676]
Epoch 18:  72%|███████▏  | 84/117 [00:03<00:01, 21.53it/s, loss=2.94, v_num=1, val_acc=0.676]
Epoch 18:  73%|███████▎  | 85/117 [00:03<00:01, 21.73it/s, loss=2.94, v_num=1, val_acc=0.676]
Epoch 18:  73%|███████▎  | 85/117 [00:03<00:01, 21.59it/s, loss=2.89, v_num=1, val_acc=0.676]
Epoch 18:  74%|███████▎  | 86/117 [00:03<00:01, 21.79it/s, loss=2.89, v_num=1, val_acc=0.676]
Epoch 18:  74%|███████▎  | 86/117 [00:03<00:01, 21.66it/s, loss=2.74, v_num=1, val_acc=0.676]
Epoch 18:  74%|███████▍  | 87/117 [00:03<00:01, 21.86it/s, loss=2.74, v_num=1, val_acc=0.676]
Epoch 18:  74%|███████▍  | 87/117 [00:04<00:01, 21.72it/s, loss=2.64, v_num=1, val_acc=0.676]
Epoch 18:  75%|███████▌  | 88/117 [00:04<00:01, 21.92it/s, loss=2.64, v_num=1, val_acc=0.676]
Epoch 18:  75%|███████▌  | 88/117 [00:04<00:01, 21.78it/s, loss=2.58, v_num=1, val_acc=0.676]
Epoch 18:  76%|███████▌  | 89/117 [00:04<00:01, 21.98it/s, loss=2.58, v_num=1, val_acc=0.676]
Epoch 18:  76%|███████▌  | 89/117 [00:04<00:01, 21.85it/s, loss=2.61, v_num=1, val_acc=0.676]
Epoch 18:  77%|███████▋  | 90/117 [00:04<00:01, 22.03it/s, loss=2.61, v_num=1, val_acc=0.676]
Epoch 18:  77%|███████▋  | 90/117 [00:04<00:01, 21.90it/s, loss=2.61, v_num=1, val_acc=0.676]
Epoch 18:  78%|███████▊  | 91/117 [00:04<00:01, 22.10it/s, loss=2.61, v_num=1, val_acc=0.676]
Epoch 18:  78%|███████▊  | 91/117 [00:04<00:01, 21.96it/s, loss=2.53, v_num=1, val_acc=0.676]
Epoch 18:  79%|███████▊  | 92/117 [00:04<00:01, 22.15it/s, loss=2.53, v_num=1, val_acc=0.676]
Epoch 18:  79%|███████▊  | 92/117 [00:04<00:01, 22.02it/s, loss=2.53, v_num=1, val_acc=0.676]
Epoch 18:  79%|███████▉  | 93/117 [00:04<00:01, 22.21it/s, loss=2.53, v_num=1, val_acc=0.676]
Epoch 18:  79%|███████▉  | 93/117 [00:04<00:01, 22.08it/s, loss=2.55, v_num=1, val_acc=0.676]
Epoch 18:  80%|████████  | 94/117 [00:04<00:01, 22.26it/s, loss=2.55, v_num=1, val_acc=0.676]
Epoch 18:  80%|████████  | 94/117 [00:04<00:01, 22.13it/s, loss=2.56, v_num=1, val_acc=0.676]
Epoch 18:  81%|████████  | 95/117 [00:04<00:00, 22.32it/s, loss=2.56, v_num=1, val_acc=0.676]
Epoch 18:  81%|████████  | 95/117 [00:04<00:00, 22.19it/s, loss=2.51, v_num=1, val_acc=0.676]
Epoch 18:  82%|████████▏ | 96/117 [00:04<00:00, 22.38it/s, loss=2.51, v_num=1, val_acc=0.676]
Epoch 18:  82%|████████▏ | 96/117 [00:04<00:00, 22.24it/s, loss=2.48, v_num=1, val_acc=0.676]
Epoch 18:  83%|████████▎ | 97/117 [00:04<00:00, 22.42it/s, loss=2.48, v_num=1, val_acc=0.676]
Epoch 18:  83%|████████▎ | 97/117 [00:04<00:00, 22.29it/s, loss=2.47, v_num=1, val_acc=0.676]

Validation: 0it [00:00, ?it/s]

Validation:   0%|          | 0/20 [00:00<?, ?it/s]

Validation DataLoader 0:   0%|          | 0/20 [00:00<?, ?it/s]

Validation DataLoader 0:   5%|▌         | 1/20 [00:00<00:00, 164.33it/s]
Epoch 18:  84%|████████▍ | 98/117 [00:05<00:01, 18.67it/s, loss=2.47, v_num=1, val_acc=0.676]

Validation DataLoader 0:  10%|█         | 2/20 [00:00<00:00, 52.64it/s]
Epoch 18:  85%|████████▍ | 99/117 [00:05<00:00, 18.74it/s, loss=2.47, v_num=1, val_acc=0.676]

Validation DataLoader 0:  15%|█▌        | 3/20 [00:00<00:00, 43.56it/s]
Epoch 18:  85%|████████▌ | 100/117 [00:05<00:00, 18.82it/s, loss=2.47, v_num=1, val_acc=0.676]

Validation DataLoader 0:  20%|██        | 4/20 [00:00<00:00, 39.71it/s]
Epoch 18:  86%|████████▋ | 101/117 [00:05<00:00, 18.90it/s, loss=2.47, v_num=1, val_acc=0.676]

Validation DataLoader 0:  25%|██▌       | 5/20 [00:00<00:00, 37.67it/s]
Epoch 18:  87%|████████▋ | 102/117 [00:05<00:00, 18.97it/s, loss=2.47, v_num=1, val_acc=0.676]

Validation DataLoader 0:  30%|███       | 6/20 [00:00<00:00, 36.29it/s]
Epoch 18:  88%|████████▊ | 103/117 [00:05<00:00, 19.04it/s, loss=2.47, v_num=1, val_acc=0.676]

Validation DataLoader 0:  35%|███▌      | 7/20 [00:00<00:00, 35.53it/s]
Epoch 18:  89%|████████▉ | 104/117 [00:05<00:00, 19.12it/s, loss=2.47, v_num=1, val_acc=0.676]

Validation DataLoader 0:  40%|████      | 8/20 [00:00<00:00, 34.97it/s]
Epoch 18:  90%|████████▉ | 105/117 [00:05<00:00, 19.19it/s, loss=2.47, v_num=1, val_acc=0.676]

Validation DataLoader 0:  45%|████▌     | 9/20 [00:00<00:00, 34.52it/s]
Epoch 18:  91%|█████████ | 106/117 [00:05<00:00, 19.26it/s, loss=2.47, v_num=1, val_acc=0.676]

Validation DataLoader 0:  50%|█████     | 10/20 [00:00<00:00, 34.15it/s]
Epoch 18:  91%|█████████▏| 107/117 [00:05<00:00, 19.33it/s, loss=2.47, v_num=1, val_acc=0.676]

Validation DataLoader 0:  55%|█████▌    | 11/20 [00:00<00:00, 33.92it/s]
Epoch 18:  92%|█████████▏| 108/117 [00:05<00:00, 19.40it/s, loss=2.47, v_num=1, val_acc=0.676]

Validation DataLoader 0:  60%|██████    | 12/20 [00:00<00:00, 33.71it/s]
Epoch 18:  93%|█████████▎| 109/117 [00:05<00:00, 19.47it/s, loss=2.47, v_num=1, val_acc=0.676]

Validation DataLoader 0:  65%|██████▌   | 13/20 [00:00<00:00, 33.52it/s]
Epoch 18:  94%|█████████▍| 110/117 [00:05<00:00, 19.53it/s, loss=2.47, v_num=1, val_acc=0.676]

Validation DataLoader 0:  70%|███████   | 14/20 [00:00<00:00, 33.34it/s]
Epoch 18:  95%|█████████▍| 111/117 [00:05<00:00, 19.60it/s, loss=2.47, v_num=1, val_acc=0.676]

Validation DataLoader 0:  75%|███████▌  | 15/20 [00:00<00:00, 33.23it/s]
Epoch 18:  96%|█████████▌| 112/117 [00:05<00:00, 19.67it/s, loss=2.47, v_num=1, val_acc=0.676]

Validation DataLoader 0:  80%|████████  | 16/20 [00:00<00:00, 33.02it/s]
Epoch 18:  97%|█████████▋| 113/117 [00:05<00:00, 19.73it/s, loss=2.47, v_num=1, val_acc=0.676]

Validation DataLoader 0:  85%|████████▌ | 17/20 [00:00<00:00, 32.75it/s]
Epoch 18:  97%|█████████▋| 114/117 [00:05<00:00, 19.78it/s, loss=2.47, v_num=1, val_acc=0.676]

Validation DataLoader 0:  90%|█████████ | 18/20 [00:00<00:00, 32.59it/s]
Epoch 18:  98%|█████████▊| 115/117 [00:05<00:00, 19.84it/s, loss=2.47, v_num=1, val_acc=0.676]

Validation DataLoader 0:  95%|█████████▌| 19/20 [00:00<00:00, 32.53it/s]
Epoch 18:  99%|█████████▉| 116/117 [00:05<00:00, 19.90it/s, loss=2.47, v_num=1, val_acc=0.676]

Validation DataLoader 0: 100%|██████████| 20/20 [00:00<00:00, 32.52it/s]
Epoch 18: 100%|██████████| 117/117 [00:05<00:00, 19.97it/s, loss=2.47, v_num=1, val_acc=0.676]
Epoch 18: 100%|██████████| 117/117 [00:05<00:00, 19.91it/s, loss=2.47, v_num=1, val_acc=0.680]


Epoch 18: 100%|██████████| 117/117 [00:05<00:00, 19.90it/s, loss=2.47, v_num=1, val_acc=0.680]
Epoch 18:   0%|          | 0/117 [00:00<?, ?it/s, loss=2.47, v_num=1, val_acc=0.680]
Epoch 19:   0%|          | 0/117 [00:00<?, ?it/s, loss=2.47, v_num=1, val_acc=0.680]
Epoch 19:   1%|          | 1/117 [00:00<01:45,  1.10it/s, loss=2.47, v_num=1, val_acc=0.680]
Epoch 19:   1%|          | 1/117 [00:00<01:48,  1.07it/s, loss=2.46, v_num=1, val_acc=0.680]
Epoch 19:   2%|▏         | 2/117 [00:00<00:54,  2.13it/s, loss=2.46, v_num=1, val_acc=0.680]
Epoch 19:   2%|▏         | 2/117 [00:00<00:55,  2.07it/s, loss=2.39, v_num=1, val_acc=0.680]
Epoch 19:   3%|▎         | 3/117 [00:00<00:37,  3.08it/s, loss=2.39, v_num=1, val_acc=0.680]
Epoch 19:   3%|▎         | 3/117 [00:00<00:37,  3.00it/s, loss=2.45, v_num=1, val_acc=0.680]
Epoch 19:   3%|▎         | 4/117 [00:01<00:28,  3.96it/s, loss=2.45, v_num=1, val_acc=0.680]
Epoch 19:   3%|▎         | 4/117 [00:01<00:29,  3.87it/s, loss=2.49, v_num=1, val_acc=0.680]
Epoch 19:   4%|▍         | 5/117 [00:01<00:23,  4.78it/s, loss=2.49, v_num=1, val_acc=0.680]
Epoch 19:   4%|▍         | 5/117 [00:01<00:24,  4.66it/s, loss=2.54, v_num=1, val_acc=0.680]
Epoch 19:   5%|▌         | 6/117 [00:01<00:19,  5.55it/s, loss=2.54, v_num=1, val_acc=0.680]
Epoch 19:   5%|▌         | 6/117 [00:01<00:20,  5.43it/s, loss=2.55, v_num=1, val_acc=0.680]
Epoch 19:   6%|▌         | 7/117 [00:01<00:17,  6.29it/s, loss=2.55, v_num=1, val_acc=0.680]
Epoch 19:   6%|▌         | 7/117 [00:01<00:17,  6.15it/s, loss=2.62, v_num=1, val_acc=0.680]
Epoch 19:   7%|▋         | 8/117 [00:01<00:15,  6.97it/s, loss=2.62, v_num=1, val_acc=0.680]
Epoch 19:   7%|▋         | 8/117 [00:01<00:15,  6.82it/s, loss=2.59, v_num=1, val_acc=0.680]
Epoch 19:   8%|▊         | 9/117 [00:01<00:14,  7.58it/s, loss=2.59, v_num=1, val_acc=0.680]
Epoch 19:   8%|▊         | 9/117 [00:01<00:14,  7.43it/s, loss=2.61, v_num=1, val_acc=0.680]
Epoch 19:   9%|▊         | 10/117 [00:01<00:13,  8.19it/s, loss=2.61, v_num=1, val_acc=0.680]
Epoch 19:   9%|▊         | 10/117 [00:01<00:13,  8.03it/s, loss=2.59, v_num=1, val_acc=0.680]
Epoch 19:   9%|▉         | 11/117 [00:01<00:12,  8.78it/s, loss=2.59, v_num=1, val_acc=0.680]
Epoch 19:   9%|▉         | 11/117 [00:01<00:12,  8.60it/s, loss=2.51, v_num=1, val_acc=0.680]
Epoch 19:  10%|█         | 12/117 [00:01<00:11,  9.32it/s, loss=2.51, v_num=1, val_acc=0.680]
Epoch 19:  10%|█         | 12/117 [00:01<00:11,  9.14it/s, loss=2.36, v_num=1, val_acc=0.680]
Epoch 19:  11%|█         | 13/117 [00:01<00:10,  9.83it/s, loss=2.36, v_num=1, val_acc=0.680]
Epoch 19:  11%|█         | 13/117 [00:01<00:10,  9.64it/s, loss=2.33, v_num=1, val_acc=0.680]
Epoch 19:  12%|█▏        | 14/117 [00:01<00:09, 10.32it/s, loss=2.33, v_num=1, val_acc=0.680]
Epoch 19:  12%|█▏        | 14/117 [00:01<00:10, 10.13it/s, loss=2.39, v_num=1, val_acc=0.680]
Epoch 19:  13%|█▎        | 15/117 [00:01<00:09, 10.79it/s, loss=2.39, v_num=1, val_acc=0.680]
Epoch 19:  13%|█▎        | 15/117 [00:01<00:09, 10.60it/s, loss=2.35, v_num=1, val_acc=0.680]
Epoch 19:  14%|█▎        | 16/117 [00:01<00:08, 11.24it/s, loss=2.35, v_num=1, val_acc=0.680]
Epoch 19:  14%|█▎        | 16/117 [00:01<00:09, 11.04it/s, loss=2.3, v_num=1, val_acc=0.680]
Epoch 19:  15%|█▍        | 17/117 [00:01<00:08, 11.65it/s, loss=2.3, v_num=1, val_acc=0.680]
Epoch 19:  15%|█▍        | 17/117 [00:01<00:08, 11.45it/s, loss=2.31, v_num=1, val_acc=0.680]
Epoch 19:  15%|█▌        | 18/117 [00:01<00:08, 12.05it/s, loss=2.31, v_num=1, val_acc=0.680]
Epoch 19:  15%|█▌        | 18/117 [00:01<00:08, 11.85it/s, loss=2.35, v_num=1, val_acc=0.680]
Epoch 19:  16%|█▌        | 19/117 [00:01<00:07, 12.44it/s, loss=2.35, v_num=1, val_acc=0.680]
Epoch 19:  16%|█▌        | 19/117 [00:01<00:08, 12.24it/s, loss=2.34, v_num=1, val_acc=0.680]
Epoch 19:  17%|█▋        | 20/117 [00:01<00:07, 12.81it/s, loss=2.34, v_num=1, val_acc=0.680]
Epoch 19:  17%|█▋        | 20/117 [00:01<00:07, 12.61it/s, loss=2.36, v_num=1, val_acc=0.680]
Epoch 19:  18%|█▊        | 21/117 [00:01<00:07, 13.16it/s, loss=2.36, v_num=1, val_acc=0.680]
Epoch 19:  18%|█▊        | 21/117 [00:01<00:07, 12.96it/s, loss=2.35, v_num=1, val_acc=0.680]
Epoch 19:  19%|█▉        | 22/117 [00:01<00:07, 13.50it/s, loss=2.35, v_num=1, val_acc=0.680]
Epoch 19:  19%|█▉        | 22/117 [00:01<00:07, 13.29it/s, loss=2.28, v_num=1, val_acc=0.680]
Epoch 19:  20%|█▉        | 23/117 [00:01<00:06, 13.82it/s, loss=2.28, v_num=1, val_acc=0.680]
Epoch 19:  20%|█▉        | 23/117 [00:01<00:06, 13.62it/s, loss=2.26, v_num=1, val_acc=0.680]
Epoch 19:  21%|██        | 24/117 [00:01<00:06, 14.13it/s, loss=2.26, v_num=1, val_acc=0.680]
Epoch 19:  21%|██        | 24/117 [00:01<00:06, 13.93it/s, loss=2.34, v_num=1, val_acc=0.680]
Epoch 19:  21%|██▏       | 25/117 [00:01<00:06, 14.42it/s, loss=2.34, v_num=1, val_acc=0.680]
Epoch 19:  21%|██▏       | 25/117 [00:01<00:06, 14.22it/s, loss=2.48, v_num=1, val_acc=0.680]
Epoch 19:  22%|██▏       | 26/117 [00:01<00:06, 14.72it/s, loss=2.48, v_num=1, val_acc=0.680]
Epoch 19:  22%|██▏       | 26/117 [00:01<00:06, 14.51it/s, loss=2.45, v_num=1, val_acc=0.680]
Epoch 19:  23%|██▎       | 27/117 [00:01<00:06, 14.99it/s, loss=2.45, v_num=1, val_acc=0.680]
Epoch 19:  23%|██▎       | 27/117 [00:01<00:06, 14.78it/s, loss=2.37, v_num=1, val_acc=0.680]
Epoch 19:  24%|██▍       | 28/117 [00:01<00:05, 15.25it/s, loss=2.37, v_num=1, val_acc=0.680]
Epoch 19:  24%|██▍       | 28/117 [00:01<00:05, 15.04it/s, loss=2.41, v_num=1, val_acc=0.680]
Epoch 19:  25%|██▍       | 29/117 [00:01<00:05, 15.50it/s, loss=2.41, v_num=1, val_acc=0.680]
Epoch 19:  25%|██▍       | 29/117 [00:01<00:05, 15.30it/s, loss=2.46, v_num=1, val_acc=0.680]
Epoch 19:  26%|██▌       | 30/117 [00:01<00:05, 15.74it/s, loss=2.46, v_num=1, val_acc=0.680]
Epoch 19:  26%|██▌       | 30/117 [00:01<00:05, 15.54it/s, loss=2.58, v_num=1, val_acc=0.680]
Epoch 19:  26%|██▋       | 31/117 [00:01<00:05, 15.97it/s, loss=2.58, v_num=1, val_acc=0.680]
Epoch 19:  26%|██▋       | 31/117 [00:01<00:05, 15.77it/s, loss=2.7, v_num=1, val_acc=0.680]
Epoch 19:  27%|██▋       | 32/117 [00:01<00:05, 16.20it/s, loss=2.7, v_num=1, val_acc=0.680]
Epoch 19:  27%|██▋       | 32/117 [00:01<00:05, 16.00it/s, loss=2.76, v_num=1, val_acc=0.680]
Epoch 19:  28%|██▊       | 33/117 [00:02<00:05, 16.43it/s, loss=2.76, v_num=1, val_acc=0.680]
Epoch 19:  28%|██▊       | 33/117 [00:02<00:05, 16.22it/s, loss=2.83, v_num=1, val_acc=0.680]
Epoch 19:  29%|██▉       | 34/117 [00:02<00:04, 16.64it/s, loss=2.83, v_num=1, val_acc=0.680]
Epoch 19:  29%|██▉       | 34/117 [00:02<00:05, 16.43it/s, loss=2.81, v_num=1, val_acc=0.680]
Epoch 19:  30%|██▉       | 35/117 [00:02<00:04, 16.84it/s, loss=2.81, v_num=1, val_acc=0.680]
Epoch 19:  30%|██▉       | 35/117 [00:02<00:04, 16.64it/s, loss=2.88, v_num=1, val_acc=0.680]
Epoch 19:  31%|███       | 36/117 [00:02<00:04, 17.04it/s, loss=2.88, v_num=1, val_acc=0.680]
Epoch 19:  31%|███       | 36/117 [00:02<00:04, 16.84it/s, loss=2.91, v_num=1, val_acc=0.680]
Epoch 19:  32%|███▏      | 37/117 [00:02<00:04, 17.23it/s, loss=2.91, v_num=1, val_acc=0.680]
Epoch 19:  32%|███▏      | 37/117 [00:02<00:04, 17.03it/s, loss=2.82, v_num=1, val_acc=0.680]
Epoch 19:  32%|███▏      | 38/117 [00:02<00:04, 17.40it/s, loss=2.82, v_num=1, val_acc=0.680]
Epoch 19:  32%|███▏      | 38/117 [00:02<00:04, 17.20it/s, loss=2.8, v_num=1, val_acc=0.680]
Epoch 19:  33%|███▎      | 39/117 [00:02<00:04, 17.58it/s, loss=2.8, v_num=1, val_acc=0.680]
Epoch 19:  33%|███▎      | 39/117 [00:02<00:04, 17.38it/s, loss=2.82, v_num=1, val_acc=0.680]
Epoch 19:  34%|███▍      | 40/117 [00:02<00:04, 17.76it/s, loss=2.82, v_num=1, val_acc=0.680]
Epoch 19:  34%|███▍      | 40/117 [00:02<00:04, 17.56it/s, loss=2.82, v_num=1, val_acc=0.680]
Epoch 19:  35%|███▌      | 41/117 [00:02<00:04, 17.93it/s, loss=2.82, v_num=1, val_acc=0.680]
Epoch 19:  35%|███▌      | 41/117 [00:02<00:04, 17.73it/s, loss=2.85, v_num=1, val_acc=0.680]
Epoch 19:  36%|███▌      | 42/117 [00:02<00:04, 18.09it/s, loss=2.85, v_num=1, val_acc=0.680]
Epoch 19:  36%|███▌      | 42/117 [00:02<00:04, 17.90it/s, loss=2.96, v_num=1, val_acc=0.680]
Epoch 19:  37%|███▋      | 43/117 [00:02<00:04, 18.25it/s, loss=2.96, v_num=1, val_acc=0.680]
Epoch 19:  37%|███▋      | 43/117 [00:02<00:04, 18.06it/s, loss=3.03, v_num=1, val_acc=0.680]
Epoch 19:  38%|███▊      | 44/117 [00:02<00:03, 18.41it/s, loss=3.03, v_num=1, val_acc=0.680]
Epoch 19:  38%|███▊      | 44/117 [00:02<00:04, 18.22it/s, loss=2.97, v_num=1, val_acc=0.680]
Epoch 19:  38%|███▊      | 45/117 [00:02<00:03, 18.56it/s, loss=2.97, v_num=1, val_acc=0.680]
Epoch 19:  38%|███▊      | 45/117 [00:02<00:03, 18.37it/s, loss=2.74, v_num=1, val_acc=0.680]
Epoch 19:  39%|███▉      | 46/117 [00:02<00:03, 18.66it/s, loss=2.74, v_num=1, val_acc=0.680]
Epoch 19:  39%|███▉      | 46/117 [00:02<00:03, 18.49it/s, loss=2.67, v_num=1, val_acc=0.680]
Epoch 19:  40%|████      | 47/117 [00:02<00:03, 18.82it/s, loss=2.67, v_num=1, val_acc=0.680]
Epoch 19:  40%|████      | 47/117 [00:02<00:03, 18.63it/s, loss=2.68, v_num=1, val_acc=0.680]
Epoch 19:  41%|████      | 48/117 [00:02<00:03, 18.96it/s, loss=2.68, v_num=1, val_acc=0.680]
Epoch 19:  41%|████      | 48/117 [00:02<00:03, 18.78it/s, loss=2.7, v_num=1, val_acc=0.680]
Epoch 19:  42%|████▏     | 49/117 [00:02<00:03, 19.10it/s, loss=2.7, v_num=1, val_acc=0.680]
Epoch 19:  42%|████▏     | 49/117 [00:02<00:03, 18.91it/s, loss=2.67, v_num=1, val_acc=0.680]
Epoch 19:  43%|████▎     | 50/117 [00:02<00:03, 19.23it/s, loss=2.67, v_num=1, val_acc=0.680]
Epoch 19:  43%|████▎     | 50/117 [00:02<00:03, 19.05it/s, loss=2.58, v_num=1, val_acc=0.680]
Epoch 19:  44%|████▎     | 51/117 [00:02<00:03, 19.36it/s, loss=2.58, v_num=1, val_acc=0.680]
Epoch 19:  44%|████▎     | 51/117 [00:02<00:03, 19.18it/s, loss=2.54, v_num=1, val_acc=0.680]
Epoch 19:  44%|████▍     | 52/117 [00:02<00:03, 19.49it/s, loss=2.54, v_num=1, val_acc=0.680]
Epoch 19:  44%|████▍     | 52/117 [00:02<00:03, 19.30it/s, loss=2.57, v_num=1, val_acc=0.680]
Epoch 19:  45%|████▌     | 53/117 [00:02<00:03, 19.57it/s, loss=2.57, v_num=1, val_acc=0.680]
Epoch 19:  45%|████▌     | 53/117 [00:02<00:03, 19.41it/s, loss=2.54, v_num=1, val_acc=0.680]
Epoch 19:  46%|████▌     | 54/117 [00:02<00:03, 19.71it/s, loss=2.54, v_num=1, val_acc=0.680]
Epoch 19:  46%|████▌     | 54/117 [00:02<00:03, 19.53it/s, loss=2.53, v_num=1, val_acc=0.680]
Epoch 19:  47%|████▋     | 55/117 [00:02<00:03, 19.83it/s, loss=2.53, v_num=1, val_acc=0.680]
Epoch 19:  47%|████▋     | 55/117 [00:02<00:03, 19.65it/s, loss=2.46, v_num=1, val_acc=0.680]
Epoch 19:  48%|████▊     | 56/117 [00:02<00:03, 19.94it/s, loss=2.46, v_num=1, val_acc=0.680]
Epoch 19:  48%|████▊     | 56/117 [00:02<00:03, 19.76it/s, loss=2.41, v_num=1, val_acc=0.680]
Epoch 19:  49%|████▊     | 57/117 [00:02<00:02, 20.05it/s, loss=2.41, v_num=1, val_acc=0.680]
Epoch 19:  49%|████▊     | 57/117 [00:02<00:03, 19.88it/s, loss=2.45, v_num=1, val_acc=0.680]
Epoch 19:  50%|████▉     | 58/117 [00:02<00:02, 20.16it/s, loss=2.45, v_num=1, val_acc=0.680]
Epoch 19:  50%|████▉     | 58/117 [00:02<00:02, 19.98it/s, loss=2.44, v_num=1, val_acc=0.680]
Epoch 19:  50%|█████     | 59/117 [00:02<00:02, 20.27it/s, loss=2.44, v_num=1, val_acc=0.680]
Epoch 19:  50%|█████     | 59/117 [00:02<00:02, 20.09it/s, loss=2.48, v_num=1, val_acc=0.680]
Epoch 19:  51%|█████▏    | 60/117 [00:02<00:02, 20.37it/s, loss=2.48, v_num=1, val_acc=0.680]
Epoch 19:  51%|█████▏    | 60/117 [00:02<00:02, 20.20it/s, loss=2.5, v_num=1, val_acc=0.680]
Epoch 19:  52%|█████▏    | 61/117 [00:02<00:02, 20.47it/s, loss=2.5, v_num=1, val_acc=0.680]
Epoch 19:  52%|█████▏    | 61/117 [00:03<00:02, 20.30it/s, loss=2.48, v_num=1, val_acc=0.680]
Epoch 19:  53%|█████▎    | 62/117 [00:03<00:02, 20.56it/s, loss=2.48, v_num=1, val_acc=0.680]
Epoch 19:  53%|█████▎    | 62/117 [00:03<00:02, 20.39it/s, loss=2.45, v_num=1, val_acc=0.680]
Epoch 19:  54%|█████▍    | 63/117 [00:03<00:02, 20.66it/s, loss=2.45, v_num=1, val_acc=0.680]
Epoch 19:  54%|█████▍    | 63/117 [00:03<00:02, 20.49it/s, loss=2.44, v_num=1, val_acc=0.680]
Epoch 19:  55%|█████▍    | 64/117 [00:03<00:02, 20.76it/s, loss=2.44, v_num=1, val_acc=0.680]
Epoch 19:  55%|█████▍    | 64/117 [00:03<00:02, 20.59it/s, loss=2.43, v_num=1, val_acc=0.680]
Epoch 19:  56%|█████▌    | 65/117 [00:03<00:02, 20.85it/s, loss=2.43, v_num=1, val_acc=0.680]
Epoch 19:  56%|█████▌    | 65/117 [00:03<00:02, 20.68it/s, loss=2.49, v_num=1, val_acc=0.680]
Epoch 19:  56%|█████▋    | 66/117 [00:03<00:02, 20.94it/s, loss=2.49, v_num=1, val_acc=0.680]
Epoch 19:  56%|█████▋    | 66/117 [00:03<00:02, 20.77it/s, loss=2.54, v_num=1, val_acc=0.680]
Epoch 19:  57%|█████▋    | 67/117 [00:03<00:02, 21.03it/s, loss=2.54, v_num=1, val_acc=0.680]
Epoch 19:  57%|█████▋    | 67/117 [00:03<00:02, 20.86it/s, loss=2.6, v_num=1, val_acc=0.680]
Epoch 19:  58%|█████▊    | 68/117 [00:03<00:02, 21.11it/s, loss=2.6, v_num=1, val_acc=0.680]
Epoch 19:  58%|█████▊    | 68/117 [00:03<00:02, 20.95it/s, loss=2.56, v_num=1, val_acc=0.680]
Epoch 19:  59%|█████▉    | 69/117 [00:03<00:02, 21.20it/s, loss=2.56, v_num=1, val_acc=0.680]
Epoch 19:  59%|█████▉    | 69/117 [00:03<00:02, 21.04it/s, loss=2.57, v_num=1, val_acc=0.680]
Epoch 19:  60%|█████▉    | 70/117 [00:03<00:02, 21.28it/s, loss=2.57, v_num=1, val_acc=0.680]
Epoch 19:  60%|█████▉    | 70/117 [00:03<00:02, 21.12it/s, loss=2.6, v_num=1, val_acc=0.680]
Epoch 19:  61%|██████    | 71/117 [00:03<00:02, 21.36it/s, loss=2.6, v_num=1, val_acc=0.680]
Epoch 19:  61%|██████    | 71/117 [00:03<00:02, 21.20it/s, loss=2.55, v_num=1, val_acc=0.680]
Epoch 19:  62%|██████▏   | 72/117 [00:03<00:02, 21.44it/s, loss=2.55, v_num=1, val_acc=0.680]
Epoch 19:  62%|██████▏   | 72/117 [00:03<00:02, 21.28it/s, loss=2.54, v_num=1, val_acc=0.680]
Epoch 19:  62%|██████▏   | 73/117 [00:03<00:02, 21.52it/s, loss=2.54, v_num=1, val_acc=0.680]
Epoch 19:  62%|██████▏   | 73/117 [00:03<00:02, 21.36it/s, loss=2.58, v_num=1, val_acc=0.680]
Epoch 19:  63%|██████▎   | 74/117 [00:03<00:01, 21.60it/s, loss=2.58, v_num=1, val_acc=0.680]
Epoch 19:  63%|██████▎   | 74/117 [00:03<00:02, 21.44it/s, loss=2.64, v_num=1, val_acc=0.680]
Epoch 19:  64%|██████▍   | 75/117 [00:03<00:01, 21.67it/s, loss=2.64, v_num=1, val_acc=0.680]
Epoch 19:  64%|██████▍   | 75/117 [00:03<00:01, 21.52it/s, loss=2.68, v_num=1, val_acc=0.680]
Epoch 19:  65%|██████▍   | 76/117 [00:03<00:01, 21.75it/s, loss=2.68, v_num=1, val_acc=0.680]
Epoch 19:  65%|██████▍   | 76/117 [00:03<00:01, 21.59it/s, loss=2.68, v_num=1, val_acc=0.680]
Epoch 19:  66%|██████▌   | 77/117 [00:03<00:01, 21.82it/s, loss=2.68, v_num=1, val_acc=0.680]
Epoch 19:  66%|██████▌   | 77/117 [00:03<00:01, 21.66it/s, loss=2.61, v_num=1, val_acc=0.680]
Epoch 19:  67%|██████▋   | 78/117 [00:03<00:01, 21.89it/s, loss=2.61, v_num=1, val_acc=0.680]
Epoch 19:  67%|██████▋   | 78/117 [00:03<00:01, 21.73it/s, loss=2.58, v_num=1, val_acc=0.680]
Epoch 19:  68%|██████▊   | 79/117 [00:03<00:01, 21.95it/s, loss=2.58, v_num=1, val_acc=0.680]
Epoch 19:  68%|██████▊   | 79/117 [00:03<00:01, 21.80it/s, loss=2.54, v_num=1, val_acc=0.680]
Epoch 19:  68%|██████▊   | 80/117 [00:03<00:01, 22.02it/s, loss=2.54, v_num=1, val_acc=0.680]
Epoch 19:  68%|██████▊   | 80/117 [00:03<00:01, 21.87it/s, loss=2.51, v_num=1, val_acc=0.680]
Epoch 19:  69%|██████▉   | 81/117 [00:03<00:01, 22.09it/s, loss=2.51, v_num=1, val_acc=0.680]
Epoch 19:  69%|██████▉   | 81/117 [00:03<00:01, 21.94it/s, loss=2.51, v_num=1, val_acc=0.680]
Epoch 19:  70%|███████   | 82/117 [00:03<00:01, 22.14it/s, loss=2.51, v_num=1, val_acc=0.680]
Epoch 19:  70%|███████   | 82/117 [00:03<00:01, 21.99it/s, loss=2.48, v_num=1, val_acc=0.680]
Epoch 19:  71%|███████   | 83/117 [00:03<00:01, 22.21it/s, loss=2.48, v_num=1, val_acc=0.680]
Epoch 19:  71%|███████   | 83/117 [00:03<00:01, 22.06it/s, loss=2.46, v_num=1, val_acc=0.680]
Epoch 19:  72%|███████▏  | 84/117 [00:03<00:01, 22.27it/s, loss=2.46, v_num=1, val_acc=0.680]
Epoch 19:  72%|███████▏  | 84/117 [00:03<00:01, 22.12it/s, loss=2.46, v_num=1, val_acc=0.680]
Epoch 19:  73%|███████▎  | 85/117 [00:03<00:01, 22.34it/s, loss=2.46, v_num=1, val_acc=0.680]
Epoch 19:  73%|███████▎  | 85/117 [00:03<00:01, 22.19it/s, loss=2.44, v_num=1, val_acc=0.680]
Epoch 19:  74%|███████▎  | 86/117 [00:03<00:01, 22.40it/s, loss=2.44, v_num=1, val_acc=0.680]
Epoch 19:  74%|███████▎  | 86/117 [00:03<00:01, 22.25it/s, loss=2.44, v_num=1, val_acc=0.680]
Epoch 19:  74%|███████▍  | 87/117 [00:03<00:01, 22.46it/s, loss=2.44, v_num=1, val_acc=0.680]
Epoch 19:  74%|███████▍  | 87/117 [00:03<00:01, 22.31it/s, loss=2.36, v_num=1, val_acc=0.680]
Epoch 19:  75%|███████▌  | 88/117 [00:03<00:01, 22.52it/s, loss=2.36, v_num=1, val_acc=0.680]
Epoch 19:  75%|███████▌  | 88/117 [00:03<00:01, 22.37it/s, loss=2.33, v_num=1, val_acc=0.680]
Epoch 19:  76%|███████▌  | 89/117 [00:03<00:01, 22.58it/s, loss=2.33, v_num=1, val_acc=0.680]
Epoch 19:  76%|███████▌  | 89/117 [00:03<00:01, 22.44it/s, loss=2.31, v_num=1, val_acc=0.680]
Epoch 19:  77%|███████▋  | 90/117 [00:03<00:01, 22.64it/s, loss=2.31, v_num=1, val_acc=0.680]
Epoch 19:  77%|███████▋  | 90/117 [00:04<00:01, 22.49it/s, loss=2.3, v_num=1, val_acc=0.680]
Epoch 19:  78%|███████▊  | 91/117 [00:04<00:01, 22.67it/s, loss=2.3, v_num=1, val_acc=0.680]
Epoch 19:  78%|███████▊  | 91/117 [00:04<00:01, 22.54it/s, loss=2.32, v_num=1, val_acc=0.680]
Epoch 19:  79%|███████▊  | 92/117 [00:04<00:01, 22.73it/s, loss=2.32, v_num=1, val_acc=0.680]
Epoch 19:  79%|███████▊  | 92/117 [00:04<00:01, 22.59it/s, loss=2.26, v_num=1, val_acc=0.680]
Epoch 19:  79%|███████▉  | 93/117 [00:04<00:01, 22.79it/s, loss=2.26, v_num=1, val_acc=0.680]
Epoch 19:  79%|███████▉  | 93/117 [00:04<00:01, 22.65it/s, loss=2.23, v_num=1, val_acc=0.680]
Epoch 19:  80%|████████  | 94/117 [00:04<00:01, 22.84it/s, loss=2.23, v_num=1, val_acc=0.680]
Epoch 19:  80%|████████  | 94/117 [00:04<00:01, 22.70it/s, loss=2.14, v_num=1, val_acc=0.680]
Epoch 19:  81%|████████  | 95/117 [00:04<00:00, 22.89it/s, loss=2.14, v_num=1, val_acc=0.680]
Epoch 19:  81%|████████  | 95/117 [00:04<00:00, 22.75it/s, loss=2.12, v_num=1, val_acc=0.680]
Epoch 19:  82%|████████▏ | 96/117 [00:04<00:00, 22.94it/s, loss=2.12, v_num=1, val_acc=0.680]
Epoch 19:  82%|████████▏ | 96/117 [00:04<00:00, 22.81it/s, loss=2.15, v_num=1, val_acc=0.680]
Epoch 19:  83%|████████▎ | 97/117 [00:04<00:00, 23.00it/s, loss=2.15, v_num=1, val_acc=0.680]
Epoch 19:  83%|████████▎ | 97/117 [00:04<00:00, 22.86it/s, loss=2.22, v_num=1, val_acc=0.680]

Validation: 0it [00:00, ?it/s]

Validation:   0%|          | 0/20 [00:00<?, ?it/s]

Validation DataLoader 0:   0%|          | 0/20 [00:00<?, ?it/s]

Validation DataLoader 0:   5%|▌         | 1/20 [00:00<00:00, 191.78it/s]
Epoch 19:  84%|████████▍ | 98/117 [00:05<00:00, 19.30it/s, loss=2.22, v_num=1, val_acc=0.680]

Validation DataLoader 0:  10%|█         | 2/20 [00:00<00:00, 55.91it/s]
Epoch 19:  85%|████████▍ | 99/117 [00:05<00:00, 19.38it/s, loss=2.22, v_num=1, val_acc=0.680]

Validation DataLoader 0:  15%|█▌        | 3/20 [00:00<00:00, 44.56it/s]
Epoch 19:  85%|████████▌ | 100/117 [00:05<00:00, 19.46it/s, loss=2.22, v_num=1, val_acc=0.680]

Validation DataLoader 0:  20%|██        | 4/20 [00:00<00:00, 40.50it/s]
Epoch 19:  86%|████████▋ | 101/117 [00:05<00:00, 19.53it/s, loss=2.22, v_num=1, val_acc=0.680]

Validation DataLoader 0:  25%|██▌       | 5/20 [00:00<00:00, 38.31it/s]
Epoch 19:  87%|████████▋ | 102/117 [00:05<00:00, 19.60it/s, loss=2.22, v_num=1, val_acc=0.680]

Validation DataLoader 0:  30%|███       | 6/20 [00:00<00:00, 37.01it/s]
Epoch 19:  88%|████████▊ | 103/117 [00:05<00:00, 19.68it/s, loss=2.22, v_num=1, val_acc=0.680]

Validation DataLoader 0:  35%|███▌      | 7/20 [00:00<00:00, 36.15it/s]
Epoch 19:  89%|████████▉ | 104/117 [00:05<00:00, 19.75it/s, loss=2.22, v_num=1, val_acc=0.680]

Validation DataLoader 0:  40%|████      | 8/20 [00:00<00:00, 35.52it/s]
Epoch 19:  90%|████████▉ | 105/117 [00:05<00:00, 19.82it/s, loss=2.22, v_num=1, val_acc=0.680]

Validation DataLoader 0:  45%|████▌     | 9/20 [00:00<00:00, 35.06it/s]
Epoch 19:  91%|█████████ | 106/117 [00:05<00:00, 19.89it/s, loss=2.22, v_num=1, val_acc=0.680]

Validation DataLoader 0:  50%|█████     | 10/20 [00:00<00:00, 34.67it/s]
Epoch 19:  91%|█████████▏| 107/117 [00:05<00:00, 19.96it/s, loss=2.22, v_num=1, val_acc=0.680]

Validation DataLoader 0:  55%|█████▌    | 11/20 [00:00<00:00, 34.42it/s]
Epoch 19:  92%|█████████▏| 108/117 [00:05<00:00, 20.03it/s, loss=2.22, v_num=1, val_acc=0.680]

Validation DataLoader 0:  60%|██████    | 12/20 [00:00<00:00, 34.19it/s]
Epoch 19:  93%|█████████▎| 109/117 [00:05<00:00, 20.10it/s, loss=2.22, v_num=1, val_acc=0.680]

Validation DataLoader 0:  65%|██████▌   | 13/20 [00:00<00:00, 33.98it/s]
Epoch 19:  94%|█████████▍| 110/117 [00:05<00:00, 20.17it/s, loss=2.22, v_num=1, val_acc=0.680]

Validation DataLoader 0:  70%|███████   | 14/20 [00:00<00:00, 33.82it/s]
Epoch 19:  95%|█████████▍| 111/117 [00:05<00:00, 20.23it/s, loss=2.22, v_num=1, val_acc=0.680]

Validation DataLoader 0:  75%|███████▌  | 15/20 [00:00<00:00, 33.67it/s]
Epoch 19:  96%|█████████▌| 112/117 [00:05<00:00, 20.30it/s, loss=2.22, v_num=1, val_acc=0.680]

Validation DataLoader 0:  80%|████████  | 16/20 [00:00<00:00, 33.51it/s]
Epoch 19:  97%|█████████▋| 113/117 [00:05<00:00, 20.36it/s, loss=2.22, v_num=1, val_acc=0.680]

Validation DataLoader 0:  85%|████████▌ | 17/20 [00:00<00:00, 33.38it/s]
Epoch 19:  97%|█████████▋| 114/117 [00:05<00:00, 20.42it/s, loss=2.22, v_num=1, val_acc=0.680]

Validation DataLoader 0:  90%|█████████ | 18/20 [00:00<00:00, 33.28it/s]
Epoch 19:  98%|█████████▊| 115/117 [00:05<00:00, 20.49it/s, loss=2.22, v_num=1, val_acc=0.680]

Validation DataLoader 0:  95%|█████████▌| 19/20 [00:00<00:00, 33.20it/s]
Epoch 19:  99%|█████████▉| 116/117 [00:05<00:00, 20.55it/s, loss=2.22, v_num=1, val_acc=0.680]

Validation DataLoader 0: 100%|██████████| 20/20 [00:00<00:00, 33.19it/s]
Epoch 19: 100%|██████████| 117/117 [00:05<00:00, 20.62it/s, loss=2.22, v_num=1, val_acc=0.680]
Epoch 19: 100%|██████████| 117/117 [00:05<00:00, 20.55it/s, loss=2.22, v_num=1, val_acc=0.648]


Epoch 19: 100%|██████████| 117/117 [00:05<00:00, 20.54it/s, loss=2.22, v_num=1, val_acc=0.648]
Epoch 19:   0%|          | 0/117 [00:00<?, ?it/s, loss=2.22, v_num=1, val_acc=0.648]
Epoch 20:   0%|          | 0/117 [00:00<?, ?it/s, loss=2.22, v_num=1, val_acc=0.648]
Epoch 20:   1%|          | 1/117 [00:00<01:54,  1.01it/s, loss=2.22, v_num=1, val_acc=0.648]
Epoch 20:   1%|          | 1/117 [00:01<01:57,  1.01s/it, loss=2.35, v_num=1, val_acc=0.648]
Epoch 20:   2%|▏         | 2/117 [00:01<00:58,  1.95it/s, loss=2.35, v_num=1, val_acc=0.648]
Epoch 20:   2%|▏         | 2/117 [00:01<01:00,  1.91it/s, loss=2.41, v_num=1, val_acc=0.648]
Epoch 20:   3%|▎         | 3/117 [00:01<00:40,  2.84it/s, loss=2.41, v_num=1, val_acc=0.648]
Epoch 20:   3%|▎         | 3/117 [00:01<00:41,  2.78it/s, loss=2.49, v_num=1, val_acc=0.648]
Epoch 20:   3%|▎         | 4/117 [00:01<00:31,  3.64it/s, loss=2.49, v_num=1, val_acc=0.648]
Epoch 20:   3%|▎         | 4/117 [00:01<00:31,  3.56it/s, loss=2.53, v_num=1, val_acc=0.648]
Epoch 20:   4%|▍         | 5/117 [00:01<00:25,  4.40it/s, loss=2.53, v_num=1, val_acc=0.648]
Epoch 20:   4%|▍         | 5/117 [00:01<00:25,  4.31it/s, loss=2.55, v_num=1, val_acc=0.648]
Epoch 20:   5%|▌         | 6/117 [00:01<00:21,  5.14it/s, loss=2.55, v_num=1, val_acc=0.648]
Epoch 20:   5%|▌         | 6/117 [00:01<00:22,  5.03it/s, loss=2.6, v_num=1, val_acc=0.648]
Epoch 20:   6%|▌         | 7/117 [00:01<00:19,  5.75it/s, loss=2.6, v_num=1, val_acc=0.648]
Epoch 20:   6%|▌         | 7/117 [00:01<00:19,  5.65it/s, loss=2.62, v_num=1, val_acc=0.648]
Epoch 20:   7%|▋         | 8/117 [00:01<00:17,  6.38it/s, loss=2.62, v_num=1, val_acc=0.648]
Epoch 20:   7%|▋         | 8/117 [00:01<00:17,  6.27it/s, loss=2.59, v_num=1, val_acc=0.648]
Epoch 20:   8%|▊         | 9/117 [00:01<00:15,  6.96it/s, loss=2.59, v_num=1, val_acc=0.648]
Epoch 20:   8%|▊         | 9/117 [00:01<00:15,  6.84it/s, loss=2.54, v_num=1, val_acc=0.648]
Epoch 20:   9%|▊         | 10/117 [00:01<00:14,  7.53it/s, loss=2.54, v_num=1, val_acc=0.648]
Epoch 20:   9%|▊         | 10/117 [00:01<00:14,  7.39it/s, loss=2.56, v_num=1, val_acc=0.648]
Epoch 20:   9%|▉         | 11/117 [00:01<00:13,  8.07it/s, loss=2.56, v_num=1, val_acc=0.648]
Epoch 20:   9%|▉         | 11/117 [00:01<00:13,  7.93it/s, loss=2.59, v_num=1, val_acc=0.648]
Epoch 20:  10%|█         | 12/117 [00:01<00:12,  8.59it/s, loss=2.59, v_num=1, val_acc=0.648]
Epoch 20:  10%|█         | 12/117 [00:01<00:12,  8.43it/s, loss=2.65, v_num=1, val_acc=0.648]
Epoch 20:  11%|█         | 13/117 [00:01<00:11,  9.08it/s, loss=2.65, v_num=1, val_acc=0.648]
Epoch 20:  11%|█         | 13/117 [00:01<00:11,  8.92it/s, loss=2.63, v_num=1, val_acc=0.648]
Epoch 20:  12%|█▏        | 14/117 [00:01<00:10,  9.55it/s, loss=2.63, v_num=1, val_acc=0.648]
Epoch 20:  12%|█▏        | 14/117 [00:01<00:10,  9.39it/s, loss=2.66, v_num=1, val_acc=0.648]
Epoch 20:  13%|█▎        | 15/117 [00:01<00:10, 10.00it/s, loss=2.66, v_num=1, val_acc=0.648]
Epoch 20:  13%|█▎        | 15/117 [00:01<00:10,  9.84it/s, loss=2.69, v_num=1, val_acc=0.648]
Epoch 20:  14%|█▎        | 16/117 [00:01<00:09, 10.43it/s, loss=2.69, v_num=1, val_acc=0.648]
Epoch 20:  14%|█▎        | 16/117 [00:01<00:09, 10.27it/s, loss=2.7, v_num=1, val_acc=0.648]
Epoch 20:  15%|█▍        | 17/117 [00:01<00:09, 10.83it/s, loss=2.7, v_num=1, val_acc=0.648]
Epoch 20:  15%|█▍        | 17/117 [00:01<00:09, 10.66it/s, loss=2.78, v_num=1, val_acc=0.648]
Epoch 20:  15%|█▌        | 18/117 [00:01<00:08, 11.23it/s, loss=2.78, v_num=1, val_acc=0.648]
Epoch 20:  15%|█▌        | 18/117 [00:01<00:08, 11.05it/s, loss=2.76, v_num=1, val_acc=0.648]
Epoch 20:  16%|█▌        | 19/117 [00:01<00:08, 11.58it/s, loss=2.76, v_num=1, val_acc=0.648]
Epoch 20:  16%|█▌        | 19/117 [00:01<00:08, 11.42it/s, loss=2.74, v_num=1, val_acc=0.648]
Epoch 20:  17%|█▋        | 20/117 [00:01<00:08, 11.91it/s, loss=2.74, v_num=1, val_acc=0.648]
Epoch 20:  17%|█▋        | 20/117 [00:01<00:08, 11.76it/s, loss=2.7, v_num=1, val_acc=0.648]
Epoch 20:  18%|█▊        | 21/117 [00:01<00:07, 12.24it/s, loss=2.7, v_num=1, val_acc=0.648]
Epoch 20:  18%|█▊        | 21/117 [00:01<00:07, 12.08it/s, loss=2.62, v_num=1, val_acc=0.648]
Epoch 20:  19%|█▉        | 22/117 [00:01<00:07, 12.59it/s, loss=2.62, v_num=1, val_acc=0.648]
Epoch 20:  19%|█▉        | 22/117 [00:01<00:07, 12.41it/s, loss=2.68, v_num=1, val_acc=0.648]
Epoch 20:  20%|█▉        | 23/117 [00:01<00:07, 12.88it/s, loss=2.68, v_num=1, val_acc=0.648]
Epoch 20:  20%|█▉        | 23/117 [00:01<00:07, 12.71it/s, loss=2.65, v_num=1, val_acc=0.648]
Epoch 20:  21%|██        | 24/117 [00:01<00:07, 13.19it/s, loss=2.65, v_num=1, val_acc=0.648]
Epoch 20:  21%|██        | 24/117 [00:01<00:07, 13.01it/s, loss=2.6, v_num=1, val_acc=0.648]
Epoch 20:  21%|██▏       | 25/117 [00:01<00:06, 13.47it/s, loss=2.6, v_num=1, val_acc=0.648]
Epoch 20:  21%|██▏       | 25/117 [00:01<00:06, 13.30it/s, loss=2.56, v_num=1, val_acc=0.648]
Epoch 20:  22%|██▏       | 26/117 [00:01<00:06, 13.71it/s, loss=2.56, v_num=1, val_acc=0.648]
Epoch 20:  22%|██▏       | 26/117 [00:01<00:06, 13.56it/s, loss=2.49, v_num=1, val_acc=0.648]
Epoch 20:  23%|██▎       | 27/117 [00:01<00:06, 13.94it/s, loss=2.49, v_num=1, val_acc=0.648]
Epoch 20:  23%|██▎       | 27/117 [00:01<00:06, 13.81it/s, loss=2.52, v_num=1, val_acc=0.648]
Epoch 20:  24%|██▍       | 28/117 [00:01<00:06, 14.19it/s, loss=2.52, v_num=1, val_acc=0.648]
Epoch 20:  24%|██▍       | 28/117 [00:01<00:06, 14.06it/s, loss=2.56, v_num=1, val_acc=0.648]
Epoch 20:  25%|██▍       | 29/117 [00:02<00:06, 14.43it/s, loss=2.56, v_num=1, val_acc=0.648]
Epoch 20:  25%|██▍       | 29/117 [00:02<00:06, 14.30it/s, loss=2.6, v_num=1, val_acc=0.648]
Epoch 20:  26%|██▌       | 30/117 [00:02<00:05, 14.64it/s, loss=2.6, v_num=1, val_acc=0.648]
Epoch 20:  26%|██▌       | 30/117 [00:02<00:05, 14.51it/s, loss=2.65, v_num=1, val_acc=0.648]
Epoch 20:  26%|██▋       | 31/117 [00:02<00:05, 14.90it/s, loss=2.65, v_num=1, val_acc=0.648]
Epoch 20:  26%|██▋       | 31/117 [00:02<00:05, 14.73it/s, loss=2.64, v_num=1, val_acc=0.648]
Epoch 20:  27%|██▋       | 32/117 [00:02<00:05, 15.09it/s, loss=2.64, v_num=1, val_acc=0.648]
Epoch 20:  27%|██▋       | 32/117 [00:02<00:05, 14.94it/s, loss=2.59, v_num=1, val_acc=0.648]
Epoch 20:  28%|██▊       | 33/117 [00:02<00:05, 15.32it/s, loss=2.59, v_num=1, val_acc=0.648]
Epoch 20:  28%|██▊       | 33/117 [00:02<00:05, 15.15it/s, loss=2.57, v_num=1, val_acc=0.648]
Epoch 20:  29%|██▉       | 34/117 [00:02<00:05, 15.53it/s, loss=2.57, v_num=1, val_acc=0.648]
Epoch 20:  29%|██▉       | 34/117 [00:02<00:05, 15.36it/s, loss=2.56, v_num=1, val_acc=0.648]
Epoch 20:  30%|██▉       | 35/117 [00:02<00:05, 15.73it/s, loss=2.56, v_num=1, val_acc=0.648]
Epoch 20:  30%|██▉       | 35/117 [00:02<00:05, 15.55it/s, loss=2.56, v_num=1, val_acc=0.648]
Epoch 20:  31%|███       | 36/117 [00:02<00:05, 15.92it/s, loss=2.56, v_num=1, val_acc=0.648]
Epoch 20:  31%|███       | 36/117 [00:02<00:05, 15.75it/s, loss=2.57, v_num=1, val_acc=0.648]
Epoch 20:  32%|███▏      | 37/117 [00:02<00:04, 16.10it/s, loss=2.57, v_num=1, val_acc=0.648]
Epoch 20:  32%|███▏      | 37/117 [00:02<00:05, 15.93it/s, loss=2.58, v_num=1, val_acc=0.648]
Epoch 20:  32%|███▏      | 38/117 [00:02<00:04, 16.28it/s, loss=2.58, v_num=1, val_acc=0.648]
Epoch 20:  32%|███▏      | 38/117 [00:02<00:04, 16.12it/s, loss=2.67, v_num=1, val_acc=0.648]
Epoch 20:  33%|███▎      | 39/117 [00:02<00:04, 16.46it/s, loss=2.67, v_num=1, val_acc=0.648]
Epoch 20:  33%|███▎      | 39/117 [00:02<00:04, 16.29it/s, loss=2.66, v_num=1, val_acc=0.648]
Epoch 20:  34%|███▍      | 40/117 [00:02<00:04, 16.63it/s, loss=2.66, v_num=1, val_acc=0.648]
Epoch 20:  34%|███▍      | 40/117 [00:02<00:04, 16.46it/s, loss=2.64, v_num=1, val_acc=0.648]
Epoch 20:  35%|███▌      | 41/117 [00:02<00:04, 16.81it/s, loss=2.64, v_num=1, val_acc=0.648]
Epoch 20:  35%|███▌      | 41/117 [00:02<00:04, 16.64it/s, loss=2.58, v_num=1, val_acc=0.648]
Epoch 20:  36%|███▌      | 42/117 [00:02<00:04, 16.97it/s, loss=2.58, v_num=1, val_acc=0.648]
Epoch 20:  36%|███▌      | 42/117 [00:02<00:04, 16.80it/s, loss=2.47, v_num=1, val_acc=0.648]
Epoch 20:  37%|███▋      | 43/117 [00:02<00:04, 17.11it/s, loss=2.47, v_num=1, val_acc=0.648]
Epoch 20:  37%|███▋      | 43/117 [00:02<00:04, 16.96it/s, loss=2.48, v_num=1, val_acc=0.648]
Epoch 20:  38%|███▊      | 44/117 [00:02<00:04, 17.26it/s, loss=2.48, v_num=1, val_acc=0.648]
Epoch 20:  38%|███▊      | 44/117 [00:02<00:04, 17.10it/s, loss=2.52, v_num=1, val_acc=0.648]
Epoch 20:  38%|███▊      | 45/117 [00:02<00:04, 17.41it/s, loss=2.52, v_num=1, val_acc=0.648]
Epoch 20:  38%|███▊      | 45/117 [00:02<00:04, 17.24it/s, loss=2.58, v_num=1, val_acc=0.648]
Epoch 20:  39%|███▉      | 46/117 [00:02<00:04, 17.53it/s, loss=2.58, v_num=1, val_acc=0.648]
Epoch 20:  39%|███▉      | 46/117 [00:02<00:04, 17.38it/s, loss=2.59, v_num=1, val_acc=0.648]
Epoch 20:  40%|████      | 47/117 [00:02<00:03, 17.68it/s, loss=2.59, v_num=1, val_acc=0.648]
Epoch 20:  40%|████      | 47/117 [00:02<00:03, 17.52it/s, loss=2.52, v_num=1, val_acc=0.648]
Epoch 20:  41%|████      | 48/117 [00:02<00:03, 17.81it/s, loss=2.52, v_num=1, val_acc=0.648]
Epoch 20:  41%|████      | 48/117 [00:02<00:03, 17.66it/s, loss=2.5, v_num=1, val_acc=0.648]
Epoch 20:  42%|████▏     | 49/117 [00:02<00:03, 17.95it/s, loss=2.5, v_num=1, val_acc=0.648]
Epoch 20:  42%|████▏     | 49/117 [00:02<00:03, 17.79it/s, loss=2.5, v_num=1, val_acc=0.648]
Epoch 20:  43%|████▎     | 50/117 [00:02<00:03, 18.09it/s, loss=2.5, v_num=1, val_acc=0.648]
Epoch 20:  43%|████▎     | 50/117 [00:02<00:03, 17.93it/s, loss=2.51, v_num=1, val_acc=0.648]
Epoch 20:  44%|████▎     | 51/117 [00:02<00:03, 18.22it/s, loss=2.51, v_num=1, val_acc=0.648]
Epoch 20:  44%|████▎     | 51/117 [00:02<00:03, 18.06it/s, loss=2.61, v_num=1, val_acc=0.648]
Epoch 20:  44%|████▍     | 52/117 [00:02<00:03, 18.35it/s, loss=2.61, v_num=1, val_acc=0.648]
Epoch 20:  44%|████▍     | 52/117 [00:02<00:03, 18.19it/s, loss=2.65, v_num=1, val_acc=0.648]
Epoch 20:  45%|████▌     | 53/117 [00:02<00:03, 18.48it/s, loss=2.65, v_num=1, val_acc=0.648]
Epoch 20:  45%|████▌     | 53/117 [00:02<00:03, 18.32it/s, loss=2.88, v_num=1, val_acc=0.648]
Epoch 20:  46%|████▌     | 54/117 [00:02<00:03, 18.58it/s, loss=2.88, v_num=1, val_acc=0.648]
Epoch 20:  46%|████▌     | 54/117 [00:02<00:03, 18.42it/s, loss=2.91, v_num=1, val_acc=0.648]
Epoch 20:  47%|████▋     | 55/117 [00:02<00:03, 18.69it/s, loss=2.91, v_num=1, val_acc=0.648]
Epoch 20:  47%|████▋     | 55/117 [00:02<00:03, 18.54it/s, loss=2.98, v_num=1, val_acc=0.648]
Epoch 20:  48%|████▊     | 56/117 [00:02<00:03, 18.78it/s, loss=2.98, v_num=1, val_acc=0.648]
Epoch 20:  48%|████▊     | 56/117 [00:03<00:03, 18.64it/s, loss=3, v_num=1, val_acc=0.648]
Epoch 20:  49%|████▊     | 57/117 [00:03<00:03, 18.92it/s, loss=3, v_num=1, val_acc=0.648]
Epoch 20:  49%|████▊     | 57/117 [00:03<00:03, 18.76it/s, loss=3.01, v_num=1, val_acc=0.648]
Epoch 20:  50%|████▉     | 58/117 [00:03<00:03, 19.03it/s, loss=3.01, v_num=1, val_acc=0.648]
Epoch 20:  50%|████▉     | 58/117 [00:03<00:03, 18.87it/s, loss=2.96, v_num=1, val_acc=0.648]
Epoch 20:  50%|█████     | 59/117 [00:03<00:03, 19.10it/s, loss=2.96, v_num=1, val_acc=0.648]
Epoch 20:  50%|█████     | 59/117 [00:03<00:03, 18.97it/s, loss=3.04, v_num=1, val_acc=0.648]
Epoch 20:  51%|█████▏    | 60/117 [00:03<00:02, 19.21it/s, loss=3.04, v_num=1, val_acc=0.648]
Epoch 20:  51%|█████▏    | 60/117 [00:03<00:02, 19.06it/s, loss=3.04, v_num=1, val_acc=0.648]
Epoch 20:  52%|█████▏    | 61/117 [00:03<00:02, 19.31it/s, loss=3.04, v_num=1, val_acc=0.648]
Epoch 20:  52%|█████▏    | 61/117 [00:03<00:02, 19.16it/s, loss=3.04, v_num=1, val_acc=0.648]
Epoch 20:  53%|█████▎    | 62/117 [00:03<00:02, 19.38it/s, loss=3.04, v_num=1, val_acc=0.648]
Epoch 20:  53%|█████▎    | 62/117 [00:03<00:02, 19.24it/s, loss=3.03, v_num=1, val_acc=0.648]
Epoch 20:  54%|█████▍    | 63/117 [00:03<00:02, 19.47it/s, loss=3.03, v_num=1, val_acc=0.648]
Epoch 20:  54%|█████▍    | 63/117 [00:03<00:02, 19.33it/s, loss=3.07, v_num=1, val_acc=0.648]
Epoch 20:  55%|█████▍    | 64/117 [00:03<00:02, 19.55it/s, loss=3.07, v_num=1, val_acc=0.648]
Epoch 20:  55%|█████▍    | 64/117 [00:03<00:02, 19.42it/s, loss=3.03, v_num=1, val_acc=0.648]
Epoch 20:  56%|█████▌    | 65/117 [00:03<00:02, 19.66it/s, loss=3.03, v_num=1, val_acc=0.648]
Epoch 20:  56%|█████▌    | 65/117 [00:03<00:02, 19.51it/s, loss=2.95, v_num=1, val_acc=0.648]
Epoch 20:  56%|█████▋    | 66/117 [00:03<00:02, 19.76it/s, loss=2.95, v_num=1, val_acc=0.648]
Epoch 20:  56%|█████▋    | 66/117 [00:03<00:02, 19.61it/s, loss=2.94, v_num=1, val_acc=0.648]
Epoch 20:  57%|█████▋    | 67/117 [00:03<00:02, 19.85it/s, loss=2.94, v_num=1, val_acc=0.648]
Epoch 20:  57%|█████▋    | 67/117 [00:03<00:02, 19.70it/s, loss=3, v_num=1, val_acc=0.648]
Epoch 20:  58%|█████▊    | 68/117 [00:03<00:02, 19.91it/s, loss=3, v_num=1, val_acc=0.648]
Epoch 20:  58%|█████▊    | 68/117 [00:03<00:02, 19.78it/s, loss=2.98, v_num=1, val_acc=0.648]
Epoch 20:  59%|█████▉    | 69/117 [00:03<00:02, 19.98it/s, loss=2.98, v_num=1, val_acc=0.648]
Epoch 20:  59%|█████▉    | 69/117 [00:03<00:02, 19.85it/s, loss=3.02, v_num=1, val_acc=0.648]
Epoch 20:  60%|█████▉    | 70/117 [00:03<00:02, 20.05it/s, loss=3.02, v_num=1, val_acc=0.648]
Epoch 20:  60%|█████▉    | 70/117 [00:03<00:02, 19.92it/s, loss=2.95, v_num=1, val_acc=0.648]
Epoch 20:  61%|██████    | 71/117 [00:03<00:02, 20.15it/s, loss=2.95, v_num=1, val_acc=0.648]
Epoch 20:  61%|██████    | 71/117 [00:03<00:02, 20.01it/s, loss=2.85, v_num=1, val_acc=0.648]
Epoch 20:  62%|██████▏   | 72/117 [00:03<00:02, 20.24it/s, loss=2.85, v_num=1, val_acc=0.648]
Epoch 20:  62%|██████▏   | 72/117 [00:03<00:02, 20.10it/s, loss=2.81, v_num=1, val_acc=0.648]
Epoch 20:  62%|██████▏   | 73/117 [00:03<00:02, 20.32it/s, loss=2.81, v_num=1, val_acc=0.648]
Epoch 20:  62%|██████▏   | 73/117 [00:03<00:02, 20.17it/s, loss=2.56, v_num=1, val_acc=0.648]
Epoch 20:  63%|██████▎   | 74/117 [00:03<00:02, 20.40it/s, loss=2.56, v_num=1, val_acc=0.648]
Epoch 20:  63%|██████▎   | 74/117 [00:03<00:02, 20.26it/s, loss=2.46, v_num=1, val_acc=0.648]
Epoch 20:  64%|██████▍   | 75/117 [00:03<00:02, 20.48it/s, loss=2.46, v_num=1, val_acc=0.648]
Epoch 20:  64%|██████▍   | 75/117 [00:03<00:02, 20.34it/s, loss=2.35, v_num=1, val_acc=0.648]
Epoch 20:  65%|██████▍   | 76/117 [00:03<00:01, 20.55it/s, loss=2.35, v_num=1, val_acc=0.648]
Epoch 20:  65%|██████▍   | 76/117 [00:03<00:02, 20.42it/s, loss=2.26, v_num=1, val_acc=0.648]
Epoch 20:  66%|██████▌   | 77/117 [00:03<00:01, 20.63it/s, loss=2.26, v_num=1, val_acc=0.648]
Epoch 20:  66%|██████▌   | 77/117 [00:03<00:01, 20.49it/s, loss=2.22, v_num=1, val_acc=0.648]
Epoch 20:  67%|██████▋   | 78/117 [00:03<00:01, 20.71it/s, loss=2.22, v_num=1, val_acc=0.648]
Epoch 20:  67%|██████▋   | 78/117 [00:03<00:01, 20.57it/s, loss=2.18, v_num=1, val_acc=0.648]
Epoch 20:  68%|██████▊   | 79/117 [00:03<00:01, 20.79it/s, loss=2.18, v_num=1, val_acc=0.648]
Epoch 20:  68%|██████▊   | 79/117 [00:03<00:01, 20.65it/s, loss=2.18, v_num=1, val_acc=0.648]
Epoch 20:  68%|██████▊   | 80/117 [00:03<00:01, 20.86it/s, loss=2.18, v_num=1, val_acc=0.648]
Epoch 20:  68%|██████▊   | 80/117 [00:03<00:01, 20.72it/s, loss=2.22, v_num=1, val_acc=0.648]
Epoch 20:  69%|██████▉   | 81/117 [00:03<00:01, 20.93it/s, loss=2.22, v_num=1, val_acc=0.648]
Epoch 20:  69%|██████▉   | 81/117 [00:03<00:01, 20.80it/s, loss=2.25, v_num=1, val_acc=0.648]
Epoch 20:  70%|███████   | 82/117 [00:03<00:01, 20.95it/s, loss=2.25, v_num=1, val_acc=0.648]
Epoch 20:  70%|███████   | 82/117 [00:03<00:01, 20.81it/s, loss=2.23, v_num=1, val_acc=0.648]
Epoch 20:  71%|███████   | 83/117 [00:03<00:01, 21.02it/s, loss=2.23, v_num=1, val_acc=0.648]
Epoch 20:  71%|███████   | 83/117 [00:03<00:01, 20.89it/s, loss=2.15, v_num=1, val_acc=0.648]
Epoch 20:  72%|███████▏  | 84/117 [00:03<00:01, 21.09it/s, loss=2.15, v_num=1, val_acc=0.648]
Epoch 20:  72%|███████▏  | 84/117 [00:04<00:01, 20.96it/s, loss=2.14, v_num=1, val_acc=0.648]
Epoch 20:  73%|███████▎  | 85/117 [00:04<00:01, 21.16it/s, loss=2.14, v_num=1, val_acc=0.648]
Epoch 20:  73%|███████▎  | 85/117 [00:04<00:01, 21.03it/s, loss=2.12, v_num=1, val_acc=0.648]
Epoch 20:  74%|███████▎  | 86/117 [00:04<00:01, 21.23it/s, loss=2.12, v_num=1, val_acc=0.648]
Epoch 20:  74%|███████▎  | 86/117 [00:04<00:01, 21.09it/s, loss=2.09, v_num=1, val_acc=0.648]
Epoch 20:  74%|███████▍  | 87/117 [00:04<00:01, 21.29it/s, loss=2.09, v_num=1, val_acc=0.648]
Epoch 20:  74%|███████▍  | 87/117 [00:04<00:01, 21.16it/s, loss=2.02, v_num=1, val_acc=0.648]
Epoch 20:  75%|███████▌  | 88/117 [00:04<00:01, 21.34it/s, loss=2.02, v_num=1, val_acc=0.648]
Epoch 20:  75%|███████▌  | 88/117 [00:04<00:01, 21.22it/s, loss=2.04, v_num=1, val_acc=0.648]
Epoch 20:  76%|███████▌  | 89/117 [00:04<00:01, 21.40it/s, loss=2.04, v_num=1, val_acc=0.648]
Epoch 20:  76%|███████▌  | 89/117 [00:04<00:01, 21.28it/s, loss=1.97, v_num=1, val_acc=0.648]
Epoch 20:  77%|███████▋  | 90/117 [00:04<00:01, 21.47it/s, loss=1.97, v_num=1, val_acc=0.648]
Epoch 20:  77%|███████▋  | 90/117 [00:04<00:01, 21.34it/s, loss=1.97, v_num=1, val_acc=0.648]
Epoch 20:  78%|███████▊  | 91/117 [00:04<00:01, 21.53it/s, loss=1.97, v_num=1, val_acc=0.648]
Epoch 20:  78%|███████▊  | 91/117 [00:04<00:01, 21.40it/s, loss=2.04, v_num=1, val_acc=0.648]
Epoch 20:  79%|███████▊  | 92/117 [00:04<00:01, 21.59it/s, loss=2.04, v_num=1, val_acc=0.648]
Epoch 20:  79%|███████▊  | 92/117 [00:04<00:01, 21.47it/s, loss=2.11, v_num=1, val_acc=0.648]
Epoch 20:  79%|███████▉  | 93/117 [00:04<00:01, 21.65it/s, loss=2.11, v_num=1, val_acc=0.648]
Epoch 20:  79%|███████▉  | 93/117 [00:04<00:01, 21.53it/s, loss=2.25, v_num=1, val_acc=0.648]
Epoch 20:  80%|████████  | 94/117 [00:04<00:01, 21.71it/s, loss=2.25, v_num=1, val_acc=0.648]
Epoch 20:  80%|████████  | 94/117 [00:04<00:01, 21.59it/s, loss=2.39, v_num=1, val_acc=0.648]
Epoch 20:  81%|████████  | 95/117 [00:04<00:01, 21.77it/s, loss=2.39, v_num=1, val_acc=0.648]
Epoch 20:  81%|████████  | 95/117 [00:04<00:01, 21.65it/s, loss=2.51, v_num=1, val_acc=0.648]
Epoch 20:  82%|████████▏ | 96/117 [00:04<00:00, 21.83it/s, loss=2.51, v_num=1, val_acc=0.648]
Epoch 20:  82%|████████▏ | 96/117 [00:04<00:00, 21.70it/s, loss=2.56, v_num=1, val_acc=0.648]
Epoch 20:  83%|████████▎ | 97/117 [00:04<00:00, 21.88it/s, loss=2.56, v_num=1, val_acc=0.648]
Epoch 20:  83%|████████▎ | 97/117 [00:04<00:00, 21.76it/s, loss=2.55, v_num=1, val_acc=0.648]

Validation: 0it [00:00, ?it/s]

Validation:   0%|          | 0/20 [00:00<?, ?it/s]

Validation DataLoader 0:   0%|          | 0/20 [00:00<?, ?it/s]

Validation DataLoader 0:   5%|▌         | 1/20 [00:00<00:00, 196.04it/s]
Epoch 20:  84%|████████▍ | 98/117 [00:05<00:01, 18.50it/s, loss=2.55, v_num=1, val_acc=0.648]

Validation DataLoader 0:  10%|█         | 2/20 [00:00<00:00, 56.37it/s]
Epoch 20:  85%|████████▍ | 99/117 [00:05<00:00, 18.58it/s, loss=2.55, v_num=1, val_acc=0.648]

Validation DataLoader 0:  15%|█▌        | 3/20 [00:00<00:00, 44.86it/s]
Epoch 20:  85%|████████▌ | 100/117 [00:05<00:00, 18.66it/s, loss=2.55, v_num=1, val_acc=0.648]

Validation DataLoader 0:  20%|██        | 4/20 [00:00<00:00, 40.67it/s]
Epoch 20:  86%|████████▋ | 101/117 [00:05<00:00, 18.74it/s, loss=2.55, v_num=1, val_acc=0.648]

Validation DataLoader 0:  25%|██▌       | 5/20 [00:00<00:00, 38.48it/s]
Epoch 20:  87%|████████▋ | 102/117 [00:05<00:00, 18.81it/s, loss=2.55, v_num=1, val_acc=0.648]

Validation DataLoader 0:  30%|███       | 6/20 [00:00<00:00, 37.15it/s]
Epoch 20:  88%|████████▊ | 103/117 [00:05<00:00, 18.89it/s, loss=2.55, v_num=1, val_acc=0.648]

Validation DataLoader 0:  35%|███▌      | 7/20 [00:00<00:00, 36.27it/s]
Epoch 20:  89%|████████▉ | 104/117 [00:05<00:00, 18.96it/s, loss=2.55, v_num=1, val_acc=0.648]

Validation DataLoader 0:  40%|████      | 8/20 [00:00<00:00, 35.63it/s]
Epoch 20:  90%|████████▉ | 105/117 [00:05<00:00, 19.03it/s, loss=2.55, v_num=1, val_acc=0.648]

Validation DataLoader 0:  45%|████▌     | 9/20 [00:00<00:00, 35.08it/s]
Epoch 20:  91%|█████████ | 106/117 [00:05<00:00, 19.10it/s, loss=2.55, v_num=1, val_acc=0.648]

Validation DataLoader 0:  50%|█████     | 10/20 [00:00<00:00, 34.74it/s]
Epoch 20:  91%|█████████▏| 107/117 [00:05<00:00, 19.18it/s, loss=2.55, v_num=1, val_acc=0.648]

Validation DataLoader 0:  55%|█████▌    | 11/20 [00:00<00:00, 34.46it/s]
Epoch 20:  92%|█████████▏| 108/117 [00:05<00:00, 19.25it/s, loss=2.55, v_num=1, val_acc=0.648]

Validation DataLoader 0:  60%|██████    | 12/20 [00:00<00:00, 34.21it/s]
Epoch 20:  93%|█████████▎| 109/117 [00:05<00:00, 19.32it/s, loss=2.55, v_num=1, val_acc=0.648]

Validation DataLoader 0:  65%|██████▌   | 13/20 [00:00<00:00, 33.97it/s]
Epoch 20:  94%|█████████▍| 110/117 [00:05<00:00, 19.38it/s, loss=2.55, v_num=1, val_acc=0.648]

Validation DataLoader 0:  70%|███████   | 14/20 [00:00<00:00, 33.81it/s]
Epoch 20:  95%|█████████▍| 111/117 [00:05<00:00, 19.45it/s, loss=2.55, v_num=1, val_acc=0.648]

Validation DataLoader 0:  75%|███████▌  | 15/20 [00:00<00:00, 33.66it/s]
Epoch 20:  96%|█████████▌| 112/117 [00:05<00:00, 19.52it/s, loss=2.55, v_num=1, val_acc=0.648]

Validation DataLoader 0:  80%|████████  | 16/20 [00:00<00:00, 33.51it/s]
Epoch 20:  97%|█████████▋| 113/117 [00:05<00:00, 19.59it/s, loss=2.55, v_num=1, val_acc=0.648]

Validation DataLoader 0:  85%|████████▌ | 17/20 [00:00<00:00, 33.37it/s]
Epoch 20:  97%|█████████▋| 114/117 [00:05<00:00, 19.65it/s, loss=2.55, v_num=1, val_acc=0.648]

Validation DataLoader 0:  90%|█████████ | 18/20 [00:00<00:00, 33.28it/s]
Epoch 20:  98%|█████████▊| 115/117 [00:05<00:00, 19.72it/s, loss=2.55, v_num=1, val_acc=0.648]

Validation DataLoader 0:  95%|█████████▌| 19/20 [00:00<00:00, 33.18it/s]
Epoch 20:  99%|█████████▉| 116/117 [00:05<00:00, 19.78it/s, loss=2.55, v_num=1, val_acc=0.648]

Validation DataLoader 0: 100%|██████████| 20/20 [00:00<00:00, 33.18it/s]
Epoch 20: 100%|██████████| 117/117 [00:05<00:00, 19.85it/s, loss=2.55, v_num=1, val_acc=0.648]
Epoch 20: 100%|██████████| 117/117 [00:05<00:00, 19.78it/s, loss=2.55, v_num=1, val_acc=0.725]


Epoch 20: 100%|██████████| 117/117 [00:05<00:00, 19.78it/s, loss=2.55, v_num=1, val_acc=0.725]
Epoch 20:   0%|          | 0/117 [00:00<?, ?it/s, loss=2.55, v_num=1, val_acc=0.725]
Epoch 21:   0%|          | 0/117 [00:00<?, ?it/s, loss=2.55, v_num=1, val_acc=0.725]
Epoch 21:   1%|          | 1/117 [00:00<01:46,  1.09it/s, loss=2.55, v_num=1, val_acc=0.725]
Epoch 21:   1%|          | 1/117 [00:00<01:49,  1.06it/s, loss=2.52, v_num=1, val_acc=0.725]
Epoch 21:   2%|▏         | 2/117 [00:00<00:55,  2.08it/s, loss=2.52, v_num=1, val_acc=0.725]
Epoch 21:   2%|▏         | 2/117 [00:00<00:56,  2.03it/s, loss=2.43, v_num=1, val_acc=0.725]
Epoch 21:   3%|▎         | 3/117 [00:00<00:37,  3.02it/s, loss=2.43, v_num=1, val_acc=0.725]
Epoch 21:   3%|▎         | 3/117 [00:01<00:38,  2.95it/s, loss=2.37, v_num=1, val_acc=0.725]
Epoch 21:   3%|▎         | 4/117 [00:01<00:28,  3.90it/s, loss=2.37, v_num=1, val_acc=0.725]
Epoch 21:   3%|▎         | 4/117 [00:01<00:29,  3.81it/s, loss=2.36, v_num=1, val_acc=0.725]
Epoch 21:   4%|▍         | 5/117 [00:01<00:23,  4.72it/s, loss=2.36, v_num=1, val_acc=0.725]
Epoch 21:   4%|▍         | 5/117 [00:01<00:24,  4.61it/s, loss=2.39, v_num=1, val_acc=0.725]
Epoch 21:   5%|▌         | 6/117 [00:01<00:20,  5.49it/s, loss=2.39, v_num=1, val_acc=0.725]
Epoch 21:   5%|▌         | 6/117 [00:01<00:20,  5.36it/s, loss=2.48, v_num=1, val_acc=0.725]
Epoch 21:   6%|▌         | 7/117 [00:01<00:17,  6.21it/s, loss=2.48, v_num=1, val_acc=0.725]
Epoch 21:   6%|▌         | 7/117 [00:01<00:18,  6.08it/s, loss=2.51, v_num=1, val_acc=0.725]
Epoch 21:   7%|▋         | 8/117 [00:01<00:15,  6.90it/s, loss=2.51, v_num=1, val_acc=0.725]
Epoch 21:   7%|▋         | 8/117 [00:01<00:16,  6.75it/s, loss=2.55, v_num=1, val_acc=0.725]
Epoch 21:   8%|▊         | 9/117 [00:01<00:14,  7.53it/s, loss=2.55, v_num=1, val_acc=0.725]
Epoch 21:   8%|▊         | 9/117 [00:01<00:14,  7.37it/s, loss=2.62, v_num=1, val_acc=0.725]
Epoch 21:   9%|▊         | 10/117 [00:01<00:13,  8.07it/s, loss=2.62, v_num=1, val_acc=0.725]
Epoch 21:   9%|▊         | 10/117 [00:01<00:13,  7.93it/s, loss=2.7, v_num=1, val_acc=0.725]
Epoch 21:   9%|▉         | 11/117 [00:01<00:12,  8.66it/s, loss=2.7, v_num=1, val_acc=0.725]
Epoch 21:   9%|▉         | 11/117 [00:01<00:12,  8.49it/s, loss=2.69, v_num=1, val_acc=0.725]
Epoch 21:  10%|█         | 12/117 [00:01<00:11,  9.21it/s, loss=2.69, v_num=1, val_acc=0.725]
Epoch 21:  10%|█         | 12/117 [00:01<00:11,  9.03it/s, loss=2.71, v_num=1, val_acc=0.725]
Epoch 21:  11%|█         | 13/117 [00:01<00:10,  9.73it/s, loss=2.71, v_num=1, val_acc=0.725]
Epoch 21:  11%|█         | 13/117 [00:01<00:10,  9.55it/s, loss=2.67, v_num=1, val_acc=0.725]
Epoch 21:  12%|█▏        | 14/117 [00:01<00:10, 10.21it/s, loss=2.67, v_num=1, val_acc=0.725]
Epoch 21:  12%|█▏        | 14/117 [00:01<00:10, 10.02it/s, loss=2.59, v_num=1, val_acc=0.725]
Epoch 21:  13%|█▎        | 15/117 [00:01<00:09, 10.68it/s, loss=2.59, v_num=1, val_acc=0.725]
Epoch 21:  13%|█▎        | 15/117 [00:01<00:09, 10.49it/s, loss=2.46, v_num=1, val_acc=0.725]
Epoch 21:  14%|█▎        | 16/117 [00:01<00:09, 11.12it/s, loss=2.46, v_num=1, val_acc=0.725]
Epoch 21:  14%|█▎        | 16/117 [00:01<00:09, 10.93it/s, loss=2.31, v_num=1, val_acc=0.725]
Epoch 21:  15%|█▍        | 17/117 [00:01<00:08, 11.54it/s, loss=2.31, v_num=1, val_acc=0.725]
Epoch 21:  15%|█▍        | 17/117 [00:01<00:08, 11.35it/s, loss=2.19, v_num=1, val_acc=0.725]
Epoch 21:  15%|█▌        | 18/117 [00:01<00:08, 11.92it/s, loss=2.19, v_num=1, val_acc=0.725]
Epoch 21:  15%|█▌        | 18/117 [00:01<00:08, 11.73it/s, loss=2.13, v_num=1, val_acc=0.725]
Epoch 21:  16%|█▌        | 19/117 [00:01<00:07, 12.32it/s, loss=2.13, v_num=1, val_acc=0.725]
Epoch 21:  16%|█▌        | 19/117 [00:01<00:08, 12.12it/s, loss=2.1, v_num=1, val_acc=0.725]
Epoch 21:  17%|█▋        | 20/117 [00:01<00:07, 12.68it/s, loss=2.1, v_num=1, val_acc=0.725]
Epoch 21:  17%|█▋        | 20/117 [00:01<00:07, 12.48it/s, loss=2.07, v_num=1, val_acc=0.725]
Epoch 21:  18%|█▊        | 21/117 [00:01<00:07, 13.04it/s, loss=2.07, v_num=1, val_acc=0.725]
Epoch 21:  18%|█▊        | 21/117 [00:01<00:07, 12.84it/s, loss=2.12, v_num=1, val_acc=0.725]
Epoch 21:  19%|█▉        | 22/117 [00:01<00:07, 13.38it/s, loss=2.12, v_num=1, val_acc=0.725]
Epoch 21:  19%|█▉        | 22/117 [00:01<00:07, 13.17it/s, loss=2.2, v_num=1, val_acc=0.725]
Epoch 21:  20%|█▉        | 23/117 [00:01<00:06, 13.70it/s, loss=2.2, v_num=1, val_acc=0.725]
Epoch 21:  20%|█▉        | 23/117 [00:01<00:06, 13.50it/s, loss=2.24, v_num=1, val_acc=0.725]
Epoch 21:  21%|██        | 24/117 [00:01<00:06, 14.01it/s, loss=2.24, v_num=1, val_acc=0.725]
Epoch 21:  21%|██        | 24/117 [00:01<00:06, 13.80it/s, loss=2.3, v_num=1, val_acc=0.725]
Epoch 21:  21%|██▏       | 25/117 [00:01<00:06, 14.31it/s, loss=2.3, v_num=1, val_acc=0.725]
Epoch 21:  21%|██▏       | 25/117 [00:01<00:06, 14.10it/s, loss=2.29, v_num=1, val_acc=0.725]
Epoch 21:  22%|██▏       | 26/117 [00:01<00:06, 14.59it/s, loss=2.29, v_num=1, val_acc=0.725]
Epoch 21:  22%|██▏       | 26/117 [00:01<00:06, 14.39it/s, loss=2.21, v_num=1, val_acc=0.725]
Epoch 21:  23%|██▎       | 27/117 [00:01<00:06, 14.87it/s, loss=2.21, v_num=1, val_acc=0.725]
Epoch 21:  23%|██▎       | 27/117 [00:01<00:06, 14.67it/s, loss=2.17, v_num=1, val_acc=0.725]
Epoch 21:  24%|██▍       | 28/117 [00:01<00:05, 15.14it/s, loss=2.17, v_num=1, val_acc=0.725]
Epoch 21:  24%|██▍       | 28/117 [00:01<00:05, 14.93it/s, loss=2.12, v_num=1, val_acc=0.725]
Epoch 21:  25%|██▍       | 29/117 [00:01<00:05, 15.38it/s, loss=2.12, v_num=1, val_acc=0.725]
Epoch 21:  25%|██▍       | 29/117 [00:01<00:05, 15.18it/s, loss=2.05, v_num=1, val_acc=0.725]
Epoch 21:  26%|██▌       | 30/117 [00:01<00:05, 15.62it/s, loss=2.05, v_num=1, val_acc=0.725]
Epoch 21:  26%|██▌       | 30/117 [00:01<00:05, 15.42it/s, loss=1.99, v_num=1, val_acc=0.725]
Epoch 21:  26%|██▋       | 31/117 [00:01<00:05, 15.85it/s, loss=1.99, v_num=1, val_acc=0.725]
Epoch 21:  26%|██▋       | 31/117 [00:01<00:05, 15.65it/s, loss=2.07, v_num=1, val_acc=0.725]
Epoch 21:  27%|██▋       | 32/117 [00:01<00:05, 16.07it/s, loss=2.07, v_num=1, val_acc=0.725]
Epoch 21:  27%|██▋       | 32/117 [00:02<00:05, 15.88it/s, loss=2.06, v_num=1, val_acc=0.725]
Epoch 21:  28%|██▊       | 33/117 [00:02<00:05, 16.30it/s, loss=2.06, v_num=1, val_acc=0.725]
Epoch 21:  28%|██▊       | 33/117 [00:02<00:05, 16.10it/s, loss=2.08, v_num=1, val_acc=0.725]
Epoch 21:  29%|██▉       | 34/117 [00:02<00:05, 16.52it/s, loss=2.08, v_num=1, val_acc=0.725]
Epoch 21:  29%|██▉       | 34/117 [00:02<00:05, 16.31it/s, loss=2.13, v_num=1, val_acc=0.725]
Epoch 21:  30%|██▉       | 35/117 [00:02<00:04, 16.72it/s, loss=2.13, v_num=1, val_acc=0.725]
Epoch 21:  30%|██▉       | 35/117 [00:02<00:04, 16.52it/s, loss=2.27, v_num=1, val_acc=0.725]
Epoch 21:  31%|███       | 36/117 [00:02<00:04, 16.93it/s, loss=2.27, v_num=1, val_acc=0.725]
Epoch 21:  31%|███       | 36/117 [00:02<00:04, 16.73it/s, loss=2.26, v_num=1, val_acc=0.725]
Epoch 21:  32%|███▏      | 37/117 [00:02<00:04, 17.12it/s, loss=2.26, v_num=1, val_acc=0.725]
Epoch 21:  32%|███▏      | 37/117 [00:02<00:04, 16.92it/s, loss=2.27, v_num=1, val_acc=0.725]
Epoch 21:  32%|███▏      | 38/117 [00:02<00:04, 17.31it/s, loss=2.27, v_num=1, val_acc=0.725]
Epoch 21:  32%|███▏      | 38/117 [00:02<00:04, 17.11it/s, loss=2.25, v_num=1, val_acc=0.725]
Epoch 21:  33%|███▎      | 39/117 [00:02<00:04, 17.49it/s, loss=2.25, v_num=1, val_acc=0.725]
Epoch 21:  33%|███▎      | 39/117 [00:02<00:04, 17.29it/s, loss=2.26, v_num=1, val_acc=0.725]
Epoch 21:  34%|███▍      | 40/117 [00:02<00:04, 17.67it/s, loss=2.26, v_num=1, val_acc=0.725]
Epoch 21:  34%|███▍      | 40/117 [00:02<00:04, 17.47it/s, loss=2.28, v_num=1, val_acc=0.725]
Epoch 21:  35%|███▌      | 41/117 [00:02<00:04, 17.84it/s, loss=2.28, v_num=1, val_acc=0.725]
Epoch 21:  35%|███▌      | 41/117 [00:02<00:04, 17.65it/s, loss=2.28, v_num=1, val_acc=0.725]
Epoch 21:  36%|███▌      | 42/117 [00:02<00:04, 18.01it/s, loss=2.28, v_num=1, val_acc=0.725]
Epoch 21:  36%|███▌      | 42/117 [00:02<00:04, 17.81it/s, loss=2.34, v_num=1, val_acc=0.725]
Epoch 21:  37%|███▋      | 43/117 [00:02<00:04, 18.13it/s, loss=2.34, v_num=1, val_acc=0.725]
Epoch 21:  37%|███▋      | 43/117 [00:02<00:04, 17.95it/s, loss=2.42, v_num=1, val_acc=0.725]
Epoch 21:  38%|███▊      | 44/117 [00:02<00:03, 18.30it/s, loss=2.42, v_num=1, val_acc=0.725]
Epoch 21:  38%|███▊      | 44/117 [00:02<00:04, 18.11it/s, loss=2.4, v_num=1, val_acc=0.725]
Epoch 21:  38%|███▊      | 45/117 [00:02<00:03, 18.44it/s, loss=2.4, v_num=1, val_acc=0.725]
Epoch 21:  38%|███▊      | 45/117 [00:02<00:03, 18.25it/s, loss=2.48, v_num=1, val_acc=0.725]
Epoch 21:  39%|███▉      | 46/117 [00:02<00:03, 18.59it/s, loss=2.48, v_num=1, val_acc=0.725]
Epoch 21:  39%|███▉      | 46/117 [00:02<00:03, 18.40it/s, loss=2.58, v_num=1, val_acc=0.725]
Epoch 21:  40%|████      | 47/117 [00:02<00:03, 18.74it/s, loss=2.58, v_num=1, val_acc=0.725]
Epoch 21:  40%|████      | 47/117 [00:02<00:03, 18.55it/s, loss=2.6, v_num=1, val_acc=0.725]
Epoch 21:  41%|████      | 48/117 [00:02<00:03, 18.88it/s, loss=2.6, v_num=1, val_acc=0.725]
Epoch 21:  41%|████      | 48/117 [00:02<00:03, 18.69it/s, loss=2.67, v_num=1, val_acc=0.725]
Epoch 21:  42%|████▏     | 49/117 [00:02<00:03, 19.01it/s, loss=2.67, v_num=1, val_acc=0.725]
Epoch 21:  42%|████▏     | 49/117 [00:02<00:03, 18.83it/s, loss=2.71, v_num=1, val_acc=0.725]
Epoch 21:  43%|████▎     | 50/117 [00:02<00:03, 19.14it/s, loss=2.71, v_num=1, val_acc=0.725]
Epoch 21:  43%|████▎     | 50/117 [00:02<00:03, 18.96it/s, loss=2.75, v_num=1, val_acc=0.725]
Epoch 21:  44%|████▎     | 51/117 [00:02<00:03, 19.27it/s, loss=2.75, v_num=1, val_acc=0.725]
Epoch 21:  44%|████▎     | 51/117 [00:02<00:03, 19.09it/s, loss=2.73, v_num=1, val_acc=0.725]
Epoch 21:  44%|████▍     | 52/117 [00:02<00:03, 19.39it/s, loss=2.73, v_num=1, val_acc=0.725]
Epoch 21:  44%|████▍     | 52/117 [00:02<00:03, 19.21it/s, loss=2.78, v_num=1, val_acc=0.725]
Epoch 21:  45%|████▌     | 53/117 [00:02<00:03, 19.51it/s, loss=2.78, v_num=1, val_acc=0.725]
Epoch 21:  45%|████▌     | 53/117 [00:02<00:03, 19.33it/s, loss=2.81, v_num=1, val_acc=0.725]
Epoch 21:  46%|████▌     | 54/117 [00:02<00:03, 19.63it/s, loss=2.81, v_num=1, val_acc=0.725]
Epoch 21:  46%|████▌     | 54/117 [00:02<00:03, 19.45it/s, loss=2.86, v_num=1, val_acc=0.725]
Epoch 21:  47%|████▋     | 55/117 [00:02<00:03, 19.75it/s, loss=2.86, v_num=1, val_acc=0.725]
Epoch 21:  47%|████▋     | 55/117 [00:02<00:03, 19.57it/s, loss=2.84, v_num=1, val_acc=0.725]
Epoch 21:  48%|████▊     | 56/117 [00:02<00:03, 19.86it/s, loss=2.84, v_num=1, val_acc=0.725]
Epoch 21:  48%|████▊     | 56/117 [00:02<00:03, 19.69it/s, loss=2.97, v_num=1, val_acc=0.725]
Epoch 21:  49%|████▊     | 57/117 [00:02<00:03, 19.97it/s, loss=2.97, v_num=1, val_acc=0.725]
Epoch 21:  49%|████▊     | 57/117 [00:02<00:03, 19.80it/s, loss=2.99, v_num=1, val_acc=0.725]
Epoch 21:  50%|████▉     | 58/117 [00:02<00:02, 20.08it/s, loss=2.99, v_num=1, val_acc=0.725]
Epoch 21:  50%|████▉     | 58/117 [00:02<00:02, 19.91it/s, loss=2.98, v_num=1, val_acc=0.725]
Epoch 21:  50%|█████     | 59/117 [00:02<00:02, 20.18it/s, loss=2.98, v_num=1, val_acc=0.725]
Epoch 21:  50%|█████     | 59/117 [00:02<00:02, 20.01it/s, loss=2.94, v_num=1, val_acc=0.725]
Epoch 21:  51%|█████▏    | 60/117 [00:02<00:02, 20.29it/s, loss=2.94, v_num=1, val_acc=0.725]
Epoch 21:  51%|█████▏    | 60/117 [00:02<00:02, 20.11it/s, loss=2.91, v_num=1, val_acc=0.725]
Epoch 21:  52%|█████▏    | 61/117 [00:02<00:02, 20.38it/s, loss=2.91, v_num=1, val_acc=0.725]
Epoch 21:  52%|█████▏    | 61/117 [00:03<00:02, 20.21it/s, loss=2.89, v_num=1, val_acc=0.725]
Epoch 21:  53%|█████▎    | 62/117 [00:03<00:02, 20.48it/s, loss=2.89, v_num=1, val_acc=0.725]
Epoch 21:  53%|█████▎    | 62/117 [00:03<00:02, 20.31it/s, loss=2.78, v_num=1, val_acc=0.725]
Epoch 21:  54%|█████▍    | 63/117 [00:03<00:02, 20.58it/s, loss=2.78, v_num=1, val_acc=0.725]
Epoch 21:  54%|█████▍    | 63/117 [00:03<00:02, 20.41it/s, loss=2.67, v_num=1, val_acc=0.725]
Epoch 21:  55%|█████▍    | 64/117 [00:03<00:02, 20.67it/s, loss=2.67, v_num=1, val_acc=0.725]
Epoch 21:  55%|█████▍    | 64/117 [00:03<00:02, 20.50it/s, loss=2.7, v_num=1, val_acc=0.725]
Epoch 21:  56%|█████▌    | 65/117 [00:03<00:02, 20.76it/s, loss=2.7, v_num=1, val_acc=0.725]
Epoch 21:  56%|█████▌    | 65/117 [00:03<00:02, 20.59it/s, loss=2.57, v_num=1, val_acc=0.725]
Epoch 21:  56%|█████▋    | 66/117 [00:03<00:02, 20.85it/s, loss=2.57, v_num=1, val_acc=0.725]
Epoch 21:  56%|█████▋    | 66/117 [00:03<00:02, 20.68it/s, loss=2.47, v_num=1, val_acc=0.725]
Epoch 21:  57%|█████▋    | 67/117 [00:03<00:02, 20.94it/s, loss=2.47, v_num=1, val_acc=0.725]
Epoch 21:  57%|█████▋    | 67/117 [00:03<00:02, 20.77it/s, loss=2.43, v_num=1, val_acc=0.725]
Epoch 21:  58%|█████▊    | 68/117 [00:03<00:02, 21.02it/s, loss=2.43, v_num=1, val_acc=0.725]
Epoch 21:  58%|█████▊    | 68/117 [00:03<00:02, 20.86it/s, loss=2.39, v_num=1, val_acc=0.725]
Epoch 21:  59%|█████▉    | 69/117 [00:03<00:02, 21.10it/s, loss=2.39, v_num=1, val_acc=0.725]
Epoch 21:  59%|█████▉    | 69/117 [00:03<00:02, 20.94it/s, loss=2.34, v_num=1, val_acc=0.725]
Epoch 21:  60%|█████▉    | 70/117 [00:03<00:02, 21.18it/s, loss=2.34, v_num=1, val_acc=0.725]
Epoch 21:  60%|█████▉    | 70/117 [00:03<00:02, 21.02it/s, loss=2.34, v_num=1, val_acc=0.725]
Epoch 21:  61%|██████    | 71/117 [00:03<00:02, 21.27it/s, loss=2.34, v_num=1, val_acc=0.725]
Epoch 21:  61%|██████    | 71/117 [00:03<00:02, 21.11it/s, loss=2.31, v_num=1, val_acc=0.725]
Epoch 21:  62%|██████▏   | 72/117 [00:03<00:02, 21.35it/s, loss=2.31, v_num=1, val_acc=0.725]
Epoch 21:  62%|██████▏   | 72/117 [00:03<00:02, 21.19it/s, loss=2.27, v_num=1, val_acc=0.725]
Epoch 21:  62%|██████▏   | 73/117 [00:03<00:02, 21.42it/s, loss=2.27, v_num=1, val_acc=0.725]
Epoch 21:  62%|██████▏   | 73/117 [00:03<00:02, 21.27it/s, loss=2.29, v_num=1, val_acc=0.725]
Epoch 21:  63%|██████▎   | 74/117 [00:03<00:02, 21.50it/s, loss=2.29, v_num=1, val_acc=0.725]
Epoch 21:  63%|██████▎   | 74/117 [00:03<00:02, 21.34it/s, loss=2.22, v_num=1, val_acc=0.725]
Epoch 21:  64%|██████▍   | 75/117 [00:03<00:01, 21.57it/s, loss=2.22, v_num=1, val_acc=0.725]
Epoch 21:  64%|██████▍   | 75/117 [00:03<00:01, 21.42it/s, loss=2.19, v_num=1, val_acc=0.725]
Epoch 21:  65%|██████▍   | 76/117 [00:03<00:01, 21.64it/s, loss=2.19, v_num=1, val_acc=0.725]
Epoch 21:  65%|██████▍   | 76/117 [00:03<00:01, 21.49it/s, loss=2.1, v_num=1, val_acc=0.725]
Epoch 21:  66%|██████▌   | 77/117 [00:03<00:01, 21.71it/s, loss=2.1, v_num=1, val_acc=0.725]
Epoch 21:  66%|██████▌   | 77/117 [00:03<00:01, 21.56it/s, loss=2.08, v_num=1, val_acc=0.725]
Epoch 21:  67%|██████▋   | 78/117 [00:03<00:01, 21.78it/s, loss=2.08, v_num=1, val_acc=0.725]
Epoch 21:  67%|██████▋   | 78/117 [00:03<00:01, 21.63it/s, loss=2.11, v_num=1, val_acc=0.725]
Epoch 21:  68%|██████▊   | 79/117 [00:03<00:01, 21.85it/s, loss=2.11, v_num=1, val_acc=0.725]
Epoch 21:  68%|██████▊   | 79/117 [00:03<00:01, 21.70it/s, loss=2.13, v_num=1, val_acc=0.725]
Epoch 21:  68%|██████▊   | 80/117 [00:03<00:01, 21.92it/s, loss=2.13, v_num=1, val_acc=0.725]
Epoch 21:  68%|██████▊   | 80/117 [00:03<00:01, 21.77it/s, loss=2.21, v_num=1, val_acc=0.725]
Epoch 21:  69%|██████▉   | 81/117 [00:03<00:01, 21.98it/s, loss=2.21, v_num=1, val_acc=0.725]
Epoch 21:  69%|██████▉   | 81/117 [00:03<00:01, 21.83it/s, loss=2.33, v_num=1, val_acc=0.725]
Epoch 21:  70%|███████   | 82/117 [00:03<00:01, 22.00it/s, loss=2.33, v_num=1, val_acc=0.725]
Epoch 21:  70%|███████   | 82/117 [00:03<00:01, 21.86it/s, loss=2.33, v_num=1, val_acc=0.725]
Epoch 21:  71%|███████   | 83/117 [00:03<00:01, 22.07it/s, loss=2.33, v_num=1, val_acc=0.725]
Epoch 21:  71%|███████   | 83/117 [00:03<00:01, 21.92it/s, loss=2.37, v_num=1, val_acc=0.725]
Epoch 21:  72%|███████▏  | 84/117 [00:03<00:01, 22.14it/s, loss=2.37, v_num=1, val_acc=0.725]
Epoch 21:  72%|███████▏  | 84/117 [00:03<00:01, 21.99it/s, loss=2.33, v_num=1, val_acc=0.725]
Epoch 21:  73%|███████▎  | 85/117 [00:03<00:01, 22.20it/s, loss=2.33, v_num=1, val_acc=0.725]
Epoch 21:  73%|███████▎  | 85/117 [00:03<00:01, 22.05it/s, loss=2.4, v_num=1, val_acc=0.725]
Epoch 21:  74%|███████▎  | 86/117 [00:03<00:01, 22.26it/s, loss=2.4, v_num=1, val_acc=0.725]
Epoch 21:  74%|███████▎  | 86/117 [00:03<00:01, 22.12it/s, loss=2.5, v_num=1, val_acc=0.725]
Epoch 21:  74%|███████▍  | 87/117 [00:03<00:01, 22.32it/s, loss=2.5, v_num=1, val_acc=0.725]
Epoch 21:  74%|███████▍  | 87/117 [00:03<00:01, 22.18it/s, loss=2.66, v_num=1, val_acc=0.725]
Epoch 21:  75%|███████▌  | 88/117 [00:03<00:01, 22.38it/s, loss=2.66, v_num=1, val_acc=0.725]
Epoch 21:  75%|███████▌  | 88/117 [00:03<00:01, 22.24it/s, loss=2.72, v_num=1, val_acc=0.725]
Epoch 21:  76%|███████▌  | 89/117 [00:03<00:01, 22.44it/s, loss=2.72, v_num=1, val_acc=0.725]
Epoch 21:  76%|███████▌  | 89/117 [00:03<00:01, 22.30it/s, loss=2.75, v_num=1, val_acc=0.725]
Epoch 21:  77%|███████▋  | 90/117 [00:03<00:01, 22.50it/s, loss=2.75, v_num=1, val_acc=0.725]
Epoch 21:  77%|███████▋  | 90/117 [00:04<00:01, 22.36it/s, loss=2.76, v_num=1, val_acc=0.725]
Epoch 21:  78%|███████▊  | 91/117 [00:04<00:01, 22.56it/s, loss=2.76, v_num=1, val_acc=0.725]
Epoch 21:  78%|███████▊  | 91/117 [00:04<00:01, 22.42it/s, loss=2.74, v_num=1, val_acc=0.725]
Epoch 21:  79%|███████▊  | 92/117 [00:04<00:01, 22.62it/s, loss=2.74, v_num=1, val_acc=0.725]
Epoch 21:  79%|███████▊  | 92/117 [00:04<00:01, 22.48it/s, loss=2.8, v_num=1, val_acc=0.725]
Epoch 21:  79%|███████▉  | 93/117 [00:04<00:01, 22.67it/s, loss=2.8, v_num=1, val_acc=0.725]
Epoch 21:  79%|███████▉  | 93/117 [00:04<00:01, 22.53it/s, loss=2.75, v_num=1, val_acc=0.725]
Epoch 21:  80%|████████  | 94/117 [00:04<00:01, 22.72it/s, loss=2.75, v_num=1, val_acc=0.725]
Epoch 21:  80%|████████  | 94/117 [00:04<00:01, 22.59it/s, loss=2.76, v_num=1, val_acc=0.725]
Epoch 21:  81%|████████  | 95/117 [00:04<00:00, 22.78it/s, loss=2.76, v_num=1, val_acc=0.725]
Epoch 21:  81%|████████  | 95/117 [00:04<00:00, 22.64it/s, loss=2.71, v_num=1, val_acc=0.725]
Epoch 21:  82%|████████▏ | 96/117 [00:04<00:00, 22.83it/s, loss=2.71, v_num=1, val_acc=0.725]
Epoch 21:  82%|████████▏ | 96/117 [00:04<00:00, 22.69it/s, loss=2.79, v_num=1, val_acc=0.725]
Epoch 21:  83%|████████▎ | 97/117 [00:04<00:00, 22.88it/s, loss=2.79, v_num=1, val_acc=0.725]
Epoch 21:  83%|████████▎ | 97/117 [00:04<00:00, 22.75it/s, loss=2.8, v_num=1, val_acc=0.725]

Validation: 0it [00:00, ?it/s]

Validation:   0%|          | 0/20 [00:00<?, ?it/s]

Validation DataLoader 0:   0%|          | 0/20 [00:00<?, ?it/s]

Validation DataLoader 0:   5%|▌         | 1/20 [00:00<00:00, 133.13it/s]
Epoch 21:  84%|████████▍ | 98/117 [00:05<00:00, 19.09it/s, loss=2.8, v_num=1, val_acc=0.725]

Validation DataLoader 0:  10%|█         | 2/20 [00:00<00:00, 55.31it/s]
Epoch 21:  85%|████████▍ | 99/117 [00:05<00:00, 19.18it/s, loss=2.8, v_num=1, val_acc=0.725]

Validation DataLoader 0:  15%|█▌        | 3/20 [00:00<00:00, 44.21it/s]
Epoch 21:  85%|████████▌ | 100/117 [00:05<00:00, 19.26it/s, loss=2.8, v_num=1, val_acc=0.725]

Validation DataLoader 0:  20%|██        | 4/20 [00:00<00:00, 40.05it/s]
Epoch 21:  86%|████████▋ | 101/117 [00:05<00:00, 19.33it/s, loss=2.8, v_num=1, val_acc=0.725]

Validation DataLoader 0:  25%|██▌       | 5/20 [00:00<00:00, 37.87it/s]
Epoch 21:  87%|████████▋ | 102/117 [00:05<00:00, 19.40it/s, loss=2.8, v_num=1, val_acc=0.725]

Validation DataLoader 0:  30%|███       | 6/20 [00:00<00:00, 36.70it/s]
Epoch 21:  88%|████████▊ | 103/117 [00:05<00:00, 19.48it/s, loss=2.8, v_num=1, val_acc=0.725]

Validation DataLoader 0:  35%|███▌      | 7/20 [00:00<00:00, 35.84it/s]
Epoch 21:  89%|████████▉ | 104/117 [00:05<00:00, 19.55it/s, loss=2.8, v_num=1, val_acc=0.725]

Validation DataLoader 0:  40%|████      | 8/20 [00:00<00:00, 35.29it/s]
Epoch 21:  90%|████████▉ | 105/117 [00:05<00:00, 19.62it/s, loss=2.8, v_num=1, val_acc=0.725]

Validation DataLoader 0:  45%|████▌     | 9/20 [00:00<00:00, 34.78it/s]
Epoch 21:  91%|█████████ | 106/117 [00:05<00:00, 19.69it/s, loss=2.8, v_num=1, val_acc=0.725]

Validation DataLoader 0:  50%|█████     | 10/20 [00:00<00:00, 34.49it/s]
Epoch 21:  91%|█████████▏| 107/117 [00:05<00:00, 19.76it/s, loss=2.8, v_num=1, val_acc=0.725]

Validation DataLoader 0:  55%|█████▌    | 11/20 [00:00<00:00, 34.20it/s]
Epoch 21:  92%|█████████▏| 108/117 [00:05<00:00, 19.83it/s, loss=2.8, v_num=1, val_acc=0.725]

Validation DataLoader 0:  60%|██████    | 12/20 [00:00<00:00, 33.99it/s]
Epoch 21:  93%|█████████▎| 109/117 [00:05<00:00, 19.90it/s, loss=2.8, v_num=1, val_acc=0.725]

Validation DataLoader 0:  65%|██████▌   | 13/20 [00:00<00:00, 33.80it/s]
Epoch 21:  94%|█████████▍| 110/117 [00:05<00:00, 19.96it/s, loss=2.8, v_num=1, val_acc=0.725]

Validation DataLoader 0:  70%|███████   | 14/20 [00:00<00:00, 33.65it/s]
Epoch 21:  95%|█████████▍| 111/117 [00:05<00:00, 20.03it/s, loss=2.8, v_num=1, val_acc=0.725]

Validation DataLoader 0:  75%|███████▌  | 15/20 [00:00<00:00, 33.53it/s]
Epoch 21:  96%|█████████▌| 112/117 [00:05<00:00, 20.10it/s, loss=2.8, v_num=1, val_acc=0.725]

Validation DataLoader 0:  80%|████████  | 16/20 [00:00<00:00, 33.41it/s]
Epoch 21:  97%|█████████▋| 113/117 [00:05<00:00, 20.16it/s, loss=2.8, v_num=1, val_acc=0.725]

Validation DataLoader 0:  85%|████████▌ | 17/20 [00:00<00:00, 33.29it/s]
Epoch 21:  97%|█████████▋| 114/117 [00:05<00:00, 20.23it/s, loss=2.8, v_num=1, val_acc=0.725]

Validation DataLoader 0:  90%|█████████ | 18/20 [00:00<00:00, 33.20it/s]
Epoch 21:  98%|█████████▊| 115/117 [00:05<00:00, 20.29it/s, loss=2.8, v_num=1, val_acc=0.725]

Validation DataLoader 0:  95%|█████████▌| 19/20 [00:00<00:00, 33.10it/s]
Epoch 21:  99%|█████████▉| 116/117 [00:05<00:00, 20.35it/s, loss=2.8, v_num=1, val_acc=0.725]

Validation DataLoader 0: 100%|██████████| 20/20 [00:00<00:00, 33.08it/s]
Epoch 21: 100%|██████████| 117/117 [00:05<00:00, 20.42it/s, loss=2.8, v_num=1, val_acc=0.725]
Epoch 21: 100%|██████████| 117/117 [00:05<00:00, 20.35it/s, loss=2.8, v_num=1, val_acc=0.677]


Epoch 21: 100%|██████████| 117/117 [00:05<00:00, 20.35it/s, loss=2.8, v_num=1, val_acc=0.677]
Epoch 21:   0%|          | 0/117 [00:00<?, ?it/s, loss=2.8, v_num=1, val_acc=0.677]
Epoch 22:   0%|          | 0/117 [00:00<?, ?it/s, loss=2.8, v_num=1, val_acc=0.677]
Epoch 22:   1%|          | 1/117 [00:00<01:45,  1.10it/s, loss=2.8, v_num=1, val_acc=0.677]
Epoch 22:   1%|          | 1/117 [00:00<01:47,  1.08it/s, loss=2.78, v_num=1, val_acc=0.677]
Epoch 22:   2%|▏         | 2/117 [00:00<00:53,  2.13it/s, loss=2.78, v_num=1, val_acc=0.677]
Epoch 22:   2%|▏         | 2/117 [00:00<00:55,  2.08it/s, loss=2.75, v_num=1, val_acc=0.677]
Epoch 22:   3%|▎         | 3/117 [00:00<00:37,  3.06it/s, loss=2.75, v_num=1, val_acc=0.677]
Epoch 22:   3%|▎         | 3/117 [00:01<00:38,  2.99it/s, loss=2.68, v_num=1, val_acc=0.677]
Epoch 22:   3%|▎         | 4/117 [00:01<00:28,  3.95it/s, loss=2.68, v_num=1, val_acc=0.677]
Epoch 22:   3%|▎         | 4/117 [00:01<00:29,  3.85it/s, loss=2.54, v_num=1, val_acc=0.677]
Epoch 22:   4%|▍         | 5/117 [00:01<00:23,  4.78it/s, loss=2.54, v_num=1, val_acc=0.677]
Epoch 22:   4%|▍         | 5/117 [00:01<00:24,  4.66it/s, loss=2.57, v_num=1, val_acc=0.677]
Epoch 22:   5%|▌         | 6/117 [00:01<00:20,  5.53it/s, loss=2.57, v_num=1, val_acc=0.677]
Epoch 22:   5%|▌         | 6/117 [00:01<00:20,  5.41it/s, loss=2.61, v_num=1, val_acc=0.677]
Epoch 22:   6%|▌         | 7/117 [00:01<00:17,  6.27it/s, loss=2.61, v_num=1, val_acc=0.677]
Epoch 22:   6%|▌         | 7/117 [00:01<00:17,  6.13it/s, loss=2.64, v_num=1, val_acc=0.677]
Epoch 22:   7%|▋         | 8/117 [00:01<00:15,  6.96it/s, loss=2.64, v_num=1, val_acc=0.677]
Epoch 22:   7%|▋         | 8/117 [00:01<00:16,  6.80it/s, loss=2.62, v_num=1, val_acc=0.677]
Epoch 22:   8%|▊         | 9/117 [00:01<00:14,  7.59it/s, loss=2.62, v_num=1, val_acc=0.677]
Epoch 22:   8%|▊         | 9/117 [00:01<00:14,  7.43it/s, loss=2.51, v_num=1, val_acc=0.677]
Epoch 22:   9%|▊         | 10/117 [00:01<00:13,  8.20it/s, loss=2.51, v_num=1, val_acc=0.677]
Epoch 22:   9%|▊         | 10/117 [00:01<00:13,  8.03it/s, loss=2.43, v_num=1, val_acc=0.677]
Epoch 22:   9%|▉         | 11/117 [00:01<00:12,  8.75it/s, loss=2.43, v_num=1, val_acc=0.677]
Epoch 22:   9%|▉         | 11/117 [00:01<00:12,  8.58it/s, loss=2.4, v_num=1, val_acc=0.677]
Epoch 22:  10%|█         | 12/117 [00:01<00:11,  9.30it/s, loss=2.4, v_num=1, val_acc=0.677]
Epoch 22:  10%|█         | 12/117 [00:01<00:11,  9.12it/s, loss=2.39, v_num=1, val_acc=0.677]
Epoch 22:  11%|█         | 13/117 [00:01<00:10,  9.82it/s, loss=2.39, v_num=1, val_acc=0.677]
Epoch 22:  11%|█         | 13/117 [00:01<00:10,  9.63it/s, loss=2.32, v_num=1, val_acc=0.677]
Epoch 22:  12%|█▏        | 14/117 [00:01<00:09, 10.31it/s, loss=2.32, v_num=1, val_acc=0.677]
Epoch 22:  12%|█▏        | 14/117 [00:01<00:10, 10.12it/s, loss=2.3, v_num=1, val_acc=0.677]
Epoch 22:  13%|█▎        | 15/117 [00:01<00:09, 10.78it/s, loss=2.3, v_num=1, val_acc=0.677]
Epoch 22:  13%|█▎        | 15/117 [00:01<00:09, 10.59it/s, loss=2.26, v_num=1, val_acc=0.677]
Epoch 22:  14%|█▎        | 16/117 [00:01<00:08, 11.23it/s, loss=2.26, v_num=1, val_acc=0.677]
Epoch 22:  14%|█▎        | 16/117 [00:01<00:09, 11.03it/s, loss=2.33, v_num=1, val_acc=0.677]
Epoch 22:  15%|█▍        | 17/117 [00:01<00:08, 11.60it/s, loss=2.33, v_num=1, val_acc=0.677]
Epoch 22:  15%|█▍        | 17/117 [00:01<00:08, 11.41it/s, loss=2.32, v_num=1, val_acc=0.677]
Epoch 22:  15%|█▌        | 18/117 [00:01<00:08, 12.02it/s, loss=2.32, v_num=1, val_acc=0.677]
Epoch 22:  15%|█▌        | 18/117 [00:01<00:08, 11.82it/s, loss=2.32, v_num=1, val_acc=0.677]
Epoch 22:  16%|█▌        | 19/117 [00:01<00:07, 12.39it/s, loss=2.32, v_num=1, val_acc=0.677]
Epoch 22:  16%|█▌        | 19/117 [00:01<00:08, 12.19it/s, loss=2.21, v_num=1, val_acc=0.677]
Epoch 22:  17%|█▋        | 20/117 [00:01<00:07, 12.76it/s, loss=2.21, v_num=1, val_acc=0.677]
Epoch 22:  17%|█▋        | 20/117 [00:01<00:07, 12.56it/s, loss=2.2, v_num=1, val_acc=0.677]
Epoch 22:  18%|█▊        | 21/117 [00:01<00:07, 13.12it/s, loss=2.2, v_num=1, val_acc=0.677]
Epoch 22:  18%|█▊        | 21/117 [00:01<00:07, 12.91it/s, loss=2.19, v_num=1, val_acc=0.677]
Epoch 22:  19%|█▉        | 22/117 [00:01<00:07, 13.46it/s, loss=2.19, v_num=1, val_acc=0.677]
Epoch 22:  19%|█▉        | 22/117 [00:01<00:07, 13.26it/s, loss=2.22, v_num=1, val_acc=0.677]
Epoch 22:  20%|█▉        | 23/117 [00:01<00:06, 13.79it/s, loss=2.22, v_num=1, val_acc=0.677]
Epoch 22:  20%|█▉        | 23/117 [00:01<00:06, 13.58it/s, loss=2.23, v_num=1, val_acc=0.677]
Epoch 22:  21%|██        | 24/117 [00:01<00:06, 14.10it/s, loss=2.23, v_num=1, val_acc=0.677]
Epoch 22:  21%|██        | 24/117 [00:01<00:06, 13.89it/s, loss=2.26, v_num=1, val_acc=0.677]
Epoch 22:  21%|██▏       | 25/117 [00:01<00:06, 14.39it/s, loss=2.26, v_num=1, val_acc=0.677]
Epoch 22:  21%|██▏       | 25/117 [00:01<00:06, 14.18it/s, loss=2.27, v_num=1, val_acc=0.677]
Epoch 22:  22%|██▏       | 26/117 [00:01<00:06, 14.68it/s, loss=2.27, v_num=1, val_acc=0.677]
Epoch 22:  22%|██▏       | 26/117 [00:01<00:06, 14.47it/s, loss=2.22, v_num=1, val_acc=0.677]
Epoch 22:  23%|██▎       | 27/117 [00:01<00:06, 14.95it/s, loss=2.22, v_num=1, val_acc=0.677]
Epoch 22:  23%|██▎       | 27/117 [00:01<00:06, 14.74it/s, loss=2.23, v_num=1, val_acc=0.677]
Epoch 22:  24%|██▍       | 28/117 [00:01<00:05, 15.22it/s, loss=2.23, v_num=1, val_acc=0.677]
Epoch 22:  24%|██▍       | 28/117 [00:01<00:05, 15.01it/s, loss=2.26, v_num=1, val_acc=0.677]
Epoch 22:  25%|██▍       | 29/117 [00:01<00:05, 15.46it/s, loss=2.26, v_num=1, val_acc=0.677]
Epoch 22:  25%|██▍       | 29/117 [00:01<00:05, 15.26it/s, loss=2.29, v_num=1, val_acc=0.677]
Epoch 22:  26%|██▌       | 30/117 [00:01<00:05, 15.71it/s, loss=2.29, v_num=1, val_acc=0.677]
Epoch 22:  26%|██▌       | 30/117 [00:01<00:05, 15.50it/s, loss=2.26, v_num=1, val_acc=0.677]
Epoch 22:  26%|██▋       | 31/117 [00:01<00:05, 15.95it/s, loss=2.26, v_num=1, val_acc=0.677]
Epoch 22:  26%|██▋       | 31/117 [00:01<00:05, 15.74it/s, loss=2.27, v_num=1, val_acc=0.677]
Epoch 22:  27%|██▋       | 32/117 [00:01<00:05, 16.17it/s, loss=2.27, v_num=1, val_acc=0.677]
Epoch 22:  27%|██▋       | 32/117 [00:02<00:05, 15.97it/s, loss=2.25, v_num=1, val_acc=0.677]
Epoch 22:  28%|██▊       | 33/117 [00:02<00:05, 16.40it/s, loss=2.25, v_num=1, val_acc=0.677]
Epoch 22:  28%|██▊       | 33/117 [00:02<00:05, 16.19it/s, loss=2.25, v_num=1, val_acc=0.677]
Epoch 22:  29%|██▉       | 34/117 [00:02<00:04, 16.61it/s, loss=2.25, v_num=1, val_acc=0.677]
Epoch 22:  29%|██▉       | 34/117 [00:02<00:05, 16.41it/s, loss=2.23, v_num=1, val_acc=0.677]
Epoch 22:  30%|██▉       | 35/117 [00:02<00:04, 16.82it/s, loss=2.23, v_num=1, val_acc=0.677]
Epoch 22:  30%|██▉       | 35/117 [00:02<00:04, 16.61it/s, loss=2.23, v_num=1, val_acc=0.677]
Epoch 22:  31%|███       | 36/117 [00:02<00:04, 17.02it/s, loss=2.23, v_num=1, val_acc=0.677]
Epoch 22:  31%|███       | 36/117 [00:02<00:04, 16.82it/s, loss=2.18, v_num=1, val_acc=0.677]
Epoch 22:  32%|███▏      | 37/117 [00:02<00:04, 17.21it/s, loss=2.18, v_num=1, val_acc=0.677]
Epoch 22:  32%|███▏      | 37/117 [00:02<00:04, 17.01it/s, loss=2.22, v_num=1, val_acc=0.677]
Epoch 22:  32%|███▏      | 38/117 [00:02<00:04, 17.40it/s, loss=2.22, v_num=1, val_acc=0.677]
Epoch 22:  32%|███▏      | 38/117 [00:02<00:04, 17.20it/s, loss=2.21, v_num=1, val_acc=0.677]
Epoch 22:  33%|███▎      | 39/117 [00:02<00:04, 17.58it/s, loss=2.21, v_num=1, val_acc=0.677]
Epoch 22:  33%|███▎      | 39/117 [00:02<00:04, 17.38it/s, loss=2.29, v_num=1, val_acc=0.677]
Epoch 22:  34%|███▍      | 40/117 [00:02<00:04, 17.76it/s, loss=2.29, v_num=1, val_acc=0.677]
Epoch 22:  34%|███▍      | 40/117 [00:02<00:04, 17.56it/s, loss=2.3, v_num=1, val_acc=0.677]
Epoch 22:  35%|███▌      | 41/117 [00:02<00:04, 17.90it/s, loss=2.3, v_num=1, val_acc=0.677]
Epoch 22:  35%|███▌      | 41/117 [00:02<00:04, 17.71it/s, loss=2.35, v_num=1, val_acc=0.677]
Epoch 22:  36%|███▌      | 42/117 [00:02<00:04, 18.08it/s, loss=2.35, v_num=1, val_acc=0.677]
Epoch 22:  36%|███▌      | 42/117 [00:02<00:04, 17.88it/s, loss=2.42, v_num=1, val_acc=0.677]
Epoch 22:  37%|███▋      | 43/117 [00:02<00:04, 18.24it/s, loss=2.42, v_num=1, val_acc=0.677]
Epoch 22:  37%|███▋      | 43/117 [00:02<00:04, 18.04it/s, loss=2.52, v_num=1, val_acc=0.677]
Epoch 22:  38%|███▊      | 44/117 [00:02<00:03, 18.40it/s, loss=2.52, v_num=1, val_acc=0.677]
Epoch 22:  38%|███▊      | 44/117 [00:02<00:04, 18.20it/s, loss=2.65, v_num=1, val_acc=0.677]
Epoch 22:  38%|███▊      | 45/117 [00:02<00:03, 18.55it/s, loss=2.65, v_num=1, val_acc=0.677]
Epoch 22:  38%|███▊      | 45/117 [00:02<00:03, 18.36it/s, loss=2.69, v_num=1, val_acc=0.677]
Epoch 22:  39%|███▉      | 46/117 [00:02<00:03, 18.70it/s, loss=2.69, v_num=1, val_acc=0.677]
Epoch 22:  39%|███▉      | 46/117 [00:02<00:03, 18.50it/s, loss=2.68, v_num=1, val_acc=0.677]
Epoch 22:  40%|████      | 47/117 [00:02<00:03, 18.84it/s, loss=2.68, v_num=1, val_acc=0.677]
Epoch 22:  40%|████      | 47/117 [00:02<00:03, 18.65it/s, loss=2.7, v_num=1, val_acc=0.677]
Epoch 22:  41%|████      | 48/117 [00:02<00:03, 18.98it/s, loss=2.7, v_num=1, val_acc=0.677]
Epoch 22:  41%|████      | 48/117 [00:02<00:03, 18.79it/s, loss=2.75, v_num=1, val_acc=0.677]
Epoch 22:  42%|████▏     | 49/117 [00:02<00:03, 19.12it/s, loss=2.75, v_num=1, val_acc=0.677]
Epoch 22:  42%|████▏     | 49/117 [00:02<00:03, 18.93it/s, loss=2.74, v_num=1, val_acc=0.677]
Epoch 22:  43%|████▎     | 50/117 [00:02<00:03, 19.25it/s, loss=2.74, v_num=1, val_acc=0.677]
Epoch 22:  43%|████▎     | 50/117 [00:02<00:03, 19.07it/s, loss=2.76, v_num=1, val_acc=0.677]
Epoch 22:  44%|████▎     | 51/117 [00:02<00:03, 19.38it/s, loss=2.76, v_num=1, val_acc=0.677]
Epoch 22:  44%|████▎     | 51/117 [00:02<00:03, 19.20it/s, loss=2.71, v_num=1, val_acc=0.677]
Epoch 22:  44%|████▍     | 52/117 [00:02<00:03, 19.51it/s, loss=2.71, v_num=1, val_acc=0.677]
Epoch 22:  44%|████▍     | 52/117 [00:02<00:03, 19.32it/s, loss=2.76, v_num=1, val_acc=0.677]
Epoch 22:  45%|████▌     | 53/117 [00:02<00:03, 19.63it/s, loss=2.76, v_num=1, val_acc=0.677]
Epoch 22:  45%|████▌     | 53/117 [00:02<00:03, 19.45it/s, loss=2.82, v_num=1, val_acc=0.677]
Epoch 22:  46%|████▌     | 54/117 [00:02<00:03, 19.75it/s, loss=2.82, v_num=1, val_acc=0.677]
Epoch 22:  46%|████▌     | 54/117 [00:02<00:03, 19.57it/s, loss=2.9, v_num=1, val_acc=0.677]
Epoch 22:  47%|████▋     | 55/117 [00:02<00:03, 19.87it/s, loss=2.9, v_num=1, val_acc=0.677]
Epoch 22:  47%|████▋     | 55/117 [00:02<00:03, 19.69it/s, loss=2.85, v_num=1, val_acc=0.677]
Epoch 22:  48%|████▊     | 56/117 [00:02<00:03, 19.98it/s, loss=2.85, v_num=1, val_acc=0.677]
Epoch 22:  48%|████▊     | 56/117 [00:02<00:03, 19.80it/s, loss=2.84, v_num=1, val_acc=0.677]
Epoch 22:  49%|████▊     | 57/117 [00:02<00:02, 20.09it/s, loss=2.84, v_num=1, val_acc=0.677]
Epoch 22:  49%|████▊     | 57/117 [00:02<00:03, 19.91it/s, loss=2.82, v_num=1, val_acc=0.677]
Epoch 22:  50%|████▉     | 58/117 [00:02<00:02, 20.20it/s, loss=2.82, v_num=1, val_acc=0.677]
Epoch 22:  50%|████▉     | 58/117 [00:02<00:02, 20.02it/s, loss=2.81, v_num=1, val_acc=0.677]
Epoch 22:  50%|█████     | 59/117 [00:02<00:02, 20.30it/s, loss=2.81, v_num=1, val_acc=0.677]
Epoch 22:  50%|█████     | 59/117 [00:02<00:02, 20.13it/s, loss=2.77, v_num=1, val_acc=0.677]
Epoch 22:  51%|█████▏    | 60/117 [00:02<00:02, 20.41it/s, loss=2.77, v_num=1, val_acc=0.677]
Epoch 22:  51%|█████▏    | 60/117 [00:02<00:02, 20.23it/s, loss=2.84, v_num=1, val_acc=0.677]
Epoch 22:  52%|█████▏    | 61/117 [00:02<00:02, 20.51it/s, loss=2.84, v_num=1, val_acc=0.677]
Epoch 22:  52%|█████▏    | 61/117 [00:02<00:02, 20.34it/s, loss=2.93, v_num=1, val_acc=0.677]
Epoch 22:  53%|█████▎    | 62/117 [00:03<00:02, 20.61it/s, loss=2.93, v_num=1, val_acc=0.677]
Epoch 22:  53%|█████▎    | 62/117 [00:03<00:02, 20.44it/s, loss=2.87, v_num=1, val_acc=0.677]
Epoch 22:  54%|█████▍    | 63/117 [00:03<00:02, 20.71it/s, loss=2.87, v_num=1, val_acc=0.677]
Epoch 22:  54%|█████▍    | 63/117 [00:03<00:02, 20.53it/s, loss=2.81, v_num=1, val_acc=0.677]
Epoch 22:  55%|█████▍    | 64/117 [00:03<00:02, 20.80it/s, loss=2.81, v_num=1, val_acc=0.677]
Epoch 22:  55%|█████▍    | 64/117 [00:03<00:02, 20.63it/s, loss=2.66, v_num=1, val_acc=0.677]
Epoch 22:  56%|█████▌    | 65/117 [00:03<00:02, 20.89it/s, loss=2.66, v_num=1, val_acc=0.677]
Epoch 22:  56%|█████▌    | 65/117 [00:03<00:02, 20.72it/s, loss=2.57, v_num=1, val_acc=0.677]
Epoch 22:  56%|█████▋    | 66/117 [00:03<00:02, 20.98it/s, loss=2.57, v_num=1, val_acc=0.677]
Epoch 22:  56%|█████▋    | 66/117 [00:03<00:02, 20.82it/s, loss=2.58, v_num=1, val_acc=0.677]
Epoch 22:  57%|█████▋    | 67/117 [00:03<00:02, 21.06it/s, loss=2.58, v_num=1, val_acc=0.677]
Epoch 22:  57%|█████▋    | 67/117 [00:03<00:02, 20.90it/s, loss=2.52, v_num=1, val_acc=0.677]
Epoch 22:  58%|█████▊    | 68/117 [00:03<00:02, 21.15it/s, loss=2.52, v_num=1, val_acc=0.677]
Epoch 22:  58%|█████▊    | 68/117 [00:03<00:02, 20.99it/s, loss=2.45, v_num=1, val_acc=0.677]
Epoch 22:  59%|█████▉    | 69/117 [00:03<00:02, 21.24it/s, loss=2.45, v_num=1, val_acc=0.677]
Epoch 22:  59%|█████▉    | 69/117 [00:03<00:02, 21.07it/s, loss=2.46, v_num=1, val_acc=0.677]
Epoch 22:  60%|█████▉    | 70/117 [00:03<00:02, 21.32it/s, loss=2.46, v_num=1, val_acc=0.677]
Epoch 22:  60%|█████▉    | 70/117 [00:03<00:02, 21.16it/s, loss=2.44, v_num=1, val_acc=0.677]
Epoch 22:  61%|██████    | 71/117 [00:03<00:02, 21.40it/s, loss=2.44, v_num=1, val_acc=0.677]
Epoch 22:  61%|██████    | 71/117 [00:03<00:02, 21.24it/s, loss=2.47, v_num=1, val_acc=0.677]
Epoch 22:  62%|██████▏   | 72/117 [00:03<00:02, 21.48it/s, loss=2.47, v_num=1, val_acc=0.677]
Epoch 22:  62%|██████▏   | 72/117 [00:03<00:02, 21.32it/s, loss=2.5, v_num=1, val_acc=0.677]
Epoch 22:  62%|██████▏   | 73/117 [00:03<00:02, 21.56it/s, loss=2.5, v_num=1, val_acc=0.677]
Epoch 22:  62%|██████▏   | 73/117 [00:03<00:02, 21.40it/s, loss=2.49, v_num=1, val_acc=0.677]
Epoch 22:  63%|██████▎   | 74/117 [00:03<00:01, 21.64it/s, loss=2.49, v_num=1, val_acc=0.677]
Epoch 22:  63%|██████▎   | 74/117 [00:03<00:02, 21.48it/s, loss=2.52, v_num=1, val_acc=0.677]
Epoch 22:  64%|██████▍   | 75/117 [00:03<00:01, 21.71it/s, loss=2.52, v_num=1, val_acc=0.677]
Epoch 22:  64%|██████▍   | 75/117 [00:03<00:01, 21.56it/s, loss=2.66, v_num=1, val_acc=0.677]
Epoch 22:  65%|██████▍   | 76/117 [00:03<00:01, 21.79it/s, loss=2.66, v_num=1, val_acc=0.677]
Epoch 22:  65%|██████▍   | 76/117 [00:03<00:01, 21.63it/s, loss=2.68, v_num=1, val_acc=0.677]
Epoch 22:  66%|██████▌   | 77/117 [00:03<00:01, 21.86it/s, loss=2.68, v_num=1, val_acc=0.677]
Epoch 22:  66%|██████▌   | 77/117 [00:03<00:01, 21.70it/s, loss=2.7, v_num=1, val_acc=0.677]
Epoch 22:  67%|██████▋   | 78/117 [00:03<00:01, 21.93it/s, loss=2.7, v_num=1, val_acc=0.677]
Epoch 22:  67%|██████▋   | 78/117 [00:03<00:01, 21.77it/s, loss=2.8, v_num=1, val_acc=0.677]
Epoch 22:  68%|██████▊   | 79/117 [00:03<00:01, 22.00it/s, loss=2.8, v_num=1, val_acc=0.677]
Epoch 22:  68%|██████▊   | 79/117 [00:03<00:01, 21.84it/s, loss=2.86, v_num=1, val_acc=0.677]
Epoch 22:  68%|██████▊   | 80/117 [00:03<00:01, 22.06it/s, loss=2.86, v_num=1, val_acc=0.677]
Epoch 22:  68%|██████▊   | 80/117 [00:03<00:01, 21.91it/s, loss=2.91, v_num=1, val_acc=0.677]
Epoch 22:  69%|██████▉   | 81/117 [00:03<00:01, 22.13it/s, loss=2.91, v_num=1, val_acc=0.677]
Epoch 22:  69%|██████▉   | 81/117 [00:03<00:01, 21.98it/s, loss=2.84, v_num=1, val_acc=0.677]
Epoch 22:  70%|███████   | 82/117 [00:03<00:01, 22.16it/s, loss=2.84, v_num=1, val_acc=0.677]
Epoch 22:  70%|███████   | 82/117 [00:03<00:01, 22.01it/s, loss=2.91, v_num=1, val_acc=0.677]
Epoch 22:  71%|███████   | 83/117 [00:03<00:01, 22.22it/s, loss=2.91, v_num=1, val_acc=0.677]
Epoch 22:  71%|███████   | 83/117 [00:03<00:01, 22.07it/s, loss=2.87, v_num=1, val_acc=0.677]
Epoch 22:  72%|███████▏  | 84/117 [00:03<00:01, 22.28it/s, loss=2.87, v_num=1, val_acc=0.677]
Epoch 22:  72%|███████▏  | 84/117 [00:03<00:01, 22.14it/s, loss=2.82, v_num=1, val_acc=0.677]
Epoch 22:  73%|███████▎  | 85/117 [00:03<00:01, 22.35it/s, loss=2.82, v_num=1, val_acc=0.677]
Epoch 22:  73%|███████▎  | 85/117 [00:03<00:01, 22.20it/s, loss=2.8, v_num=1, val_acc=0.677]
Epoch 22:  74%|███████▎  | 86/117 [00:03<00:01, 22.41it/s, loss=2.8, v_num=1, val_acc=0.677]
Epoch 22:  74%|███████▎  | 86/117 [00:03<00:01, 22.27it/s, loss=2.74, v_num=1, val_acc=0.677]
Epoch 22:  74%|███████▍  | 87/117 [00:03<00:01, 22.47it/s, loss=2.74, v_num=1, val_acc=0.677]
Epoch 22:  74%|███████▍  | 87/117 [00:03<00:01, 22.33it/s, loss=2.69, v_num=1, val_acc=0.677]
Epoch 22:  75%|███████▌  | 88/117 [00:03<00:01, 22.53it/s, loss=2.69, v_num=1, val_acc=0.677]
Epoch 22:  75%|███████▌  | 88/117 [00:03<00:01, 22.39it/s, loss=2.61, v_num=1, val_acc=0.677]
Epoch 22:  76%|███████▌  | 89/117 [00:03<00:01, 22.59it/s, loss=2.61, v_num=1, val_acc=0.677]
Epoch 22:  76%|███████▌  | 89/117 [00:03<00:01, 22.45it/s, loss=2.59, v_num=1, val_acc=0.677]
Epoch 22:  77%|███████▋  | 90/117 [00:03<00:01, 22.65it/s, loss=2.59, v_num=1, val_acc=0.677]
Epoch 22:  77%|███████▋  | 90/117 [00:03<00:01, 22.51it/s, loss=2.59, v_num=1, val_acc=0.677]
Epoch 22:  78%|███████▊  | 91/117 [00:04<00:01, 22.71it/s, loss=2.59, v_num=1, val_acc=0.677]
Epoch 22:  78%|███████▊  | 91/117 [00:04<00:01, 22.57it/s, loss=2.64, v_num=1, val_acc=0.677]
Epoch 22:  79%|███████▊  | 92/117 [00:04<00:01, 22.76it/s, loss=2.64, v_num=1, val_acc=0.677]
Epoch 22:  79%|███████▊  | 92/117 [00:04<00:01, 22.62it/s, loss=2.58, v_num=1, val_acc=0.677]
Epoch 22:  79%|███████▉  | 93/117 [00:04<00:01, 22.81it/s, loss=2.58, v_num=1, val_acc=0.677]
Epoch 22:  79%|███████▉  | 93/117 [00:04<00:01, 22.67it/s, loss=2.59, v_num=1, val_acc=0.677]
Epoch 22:  80%|████████  | 94/117 [00:04<00:01, 22.87it/s, loss=2.59, v_num=1, val_acc=0.677]
Epoch 22:  80%|████████  | 94/117 [00:04<00:01, 22.73it/s, loss=2.52, v_num=1, val_acc=0.677]
Epoch 22:  81%|████████  | 95/117 [00:04<00:00, 22.92it/s, loss=2.52, v_num=1, val_acc=0.677]
Epoch 22:  81%|████████  | 95/117 [00:04<00:00, 22.78it/s, loss=2.42, v_num=1, val_acc=0.677]
Epoch 22:  82%|████████▏ | 96/117 [00:04<00:00, 22.97it/s, loss=2.42, v_num=1, val_acc=0.677]
Epoch 22:  82%|████████▏ | 96/117 [00:04<00:00, 22.83it/s, loss=2.46, v_num=1, val_acc=0.677]
Epoch 22:  83%|████████▎ | 97/117 [00:04<00:00, 23.02it/s, loss=2.46, v_num=1, val_acc=0.677]
Epoch 22:  83%|████████▎ | 97/117 [00:04<00:00, 22.88it/s, loss=2.46, v_num=1, val_acc=0.677]

Validation: 0it [00:00, ?it/s]

Validation:   0%|          | 0/20 [00:00<?, ?it/s]

Validation DataLoader 0:   0%|          | 0/20 [00:00<?, ?it/s]

Validation DataLoader 0:   5%|▌         | 1/20 [00:00<00:00, 145.63it/s]
Epoch 22:  84%|████████▍ | 98/117 [00:05<00:00, 19.31it/s, loss=2.46, v_num=1, val_acc=0.677]

Validation DataLoader 0:  10%|█         | 2/20 [00:00<00:00, 55.16it/s]
Epoch 22:  85%|████████▍ | 99/117 [00:05<00:00, 19.39it/s, loss=2.46, v_num=1, val_acc=0.677]

Validation DataLoader 0:  15%|█▌        | 3/20 [00:00<00:00, 44.10it/s]
Epoch 22:  85%|████████▌ | 100/117 [00:05<00:00, 19.47it/s, loss=2.46, v_num=1, val_acc=0.677]

Validation DataLoader 0:  20%|██        | 4/20 [00:00<00:00, 40.08it/s]
Epoch 22:  86%|████████▋ | 101/117 [00:05<00:00, 19.54it/s, loss=2.46, v_num=1, val_acc=0.677]

Validation DataLoader 0:  25%|██▌       | 5/20 [00:00<00:00, 37.89it/s]
Epoch 22:  87%|████████▋ | 102/117 [00:05<00:00, 19.61it/s, loss=2.46, v_num=1, val_acc=0.677]

Validation DataLoader 0:  30%|███       | 6/20 [00:00<00:00, 36.76it/s]
Epoch 22:  88%|████████▊ | 103/117 [00:05<00:00, 19.69it/s, loss=2.46, v_num=1, val_acc=0.677]

Validation DataLoader 0:  35%|███▌      | 7/20 [00:00<00:00, 35.88it/s]
Epoch 22:  89%|████████▉ | 104/117 [00:05<00:00, 19.76it/s, loss=2.46, v_num=1, val_acc=0.677]

Validation DataLoader 0:  40%|████      | 8/20 [00:00<00:00, 35.31it/s]
Epoch 22:  90%|████████▉ | 105/117 [00:05<00:00, 19.83it/s, loss=2.46, v_num=1, val_acc=0.677]

Validation DataLoader 0:  45%|████▌     | 9/20 [00:00<00:00, 34.72it/s]
Epoch 22:  91%|█████████ | 106/117 [00:05<00:00, 19.90it/s, loss=2.46, v_num=1, val_acc=0.677]

Validation DataLoader 0:  50%|█████     | 10/20 [00:00<00:00, 34.46it/s]
Epoch 22:  91%|█████████▏| 107/117 [00:05<00:00, 19.97it/s, loss=2.46, v_num=1, val_acc=0.677]

Validation DataLoader 0:  55%|█████▌    | 11/20 [00:00<00:00, 34.18it/s]
Epoch 22:  92%|█████████▏| 108/117 [00:05<00:00, 20.04it/s, loss=2.46, v_num=1, val_acc=0.677]

Validation DataLoader 0:  60%|██████    | 12/20 [00:00<00:00, 33.96it/s]
Epoch 22:  93%|█████████▎| 109/117 [00:05<00:00, 20.10it/s, loss=2.46, v_num=1, val_acc=0.677]

Validation DataLoader 0:  65%|██████▌   | 13/20 [00:00<00:00, 33.76it/s]
Epoch 22:  94%|█████████▍| 110/117 [00:05<00:00, 20.17it/s, loss=2.46, v_num=1, val_acc=0.677]

Validation DataLoader 0:  70%|███████   | 14/20 [00:00<00:00, 33.61it/s]
Epoch 22:  95%|█████████▍| 111/117 [00:05<00:00, 20.24it/s, loss=2.46, v_num=1, val_acc=0.677]

Validation DataLoader 0:  75%|███████▌  | 15/20 [00:00<00:00, 33.49it/s]
Epoch 22:  96%|█████████▌| 112/117 [00:05<00:00, 20.30it/s, loss=2.46, v_num=1, val_acc=0.677]

Validation DataLoader 0:  80%|████████  | 16/20 [00:00<00:00, 33.36it/s]
Epoch 22:  97%|█████████▋| 113/117 [00:05<00:00, 20.37it/s, loss=2.46, v_num=1, val_acc=0.677]

Validation DataLoader 0:  85%|████████▌ | 17/20 [00:00<00:00, 33.23it/s]
Epoch 22:  97%|█████████▋| 114/117 [00:05<00:00, 20.43it/s, loss=2.46, v_num=1, val_acc=0.677]

Validation DataLoader 0:  90%|█████████ | 18/20 [00:00<00:00, 33.08it/s]
Epoch 22:  98%|█████████▊| 115/117 [00:05<00:00, 20.49it/s, loss=2.46, v_num=1, val_acc=0.677]

Validation DataLoader 0:  95%|█████████▌| 19/20 [00:00<00:00, 32.90it/s]
Epoch 22:  99%|█████████▉| 116/117 [00:05<00:00, 20.55it/s, loss=2.46, v_num=1, val_acc=0.677]

Validation DataLoader 0: 100%|██████████| 20/20 [00:00<00:00, 32.85it/s]
Epoch 22: 100%|██████████| 117/117 [00:05<00:00, 20.61it/s, loss=2.46, v_num=1, val_acc=0.677]
Epoch 22: 100%|██████████| 117/117 [00:05<00:00, 20.54it/s, loss=2.46, v_num=1, val_acc=0.633]


Epoch 22: 100%|██████████| 117/117 [00:05<00:00, 20.53it/s, loss=2.46, v_num=1, val_acc=0.633]
Epoch 22:   0%|          | 0/117 [00:00<?, ?it/s, loss=2.46, v_num=1, val_acc=0.633]
Epoch 23:   0%|          | 0/117 [00:00<?, ?it/s, loss=2.46, v_num=1, val_acc=0.633]
Epoch 23:   1%|          | 1/117 [00:00<01:51,  1.04it/s, loss=2.46, v_num=1, val_acc=0.633]
Epoch 23:   1%|          | 1/117 [00:00<01:53,  1.02it/s, loss=2.4, v_num=1, val_acc=0.633]
Epoch 23:   2%|▏         | 2/117 [00:00<00:57,  2.02it/s, loss=2.4, v_num=1, val_acc=0.633]
Epoch 23:   2%|▏         | 2/117 [00:01<00:58,  1.97it/s, loss=2.35, v_num=1, val_acc=0.633]
Epoch 23:   3%|▎         | 3/117 [00:01<00:39,  2.92it/s, loss=2.35, v_num=1, val_acc=0.633]
Epoch 23:   3%|▎         | 3/117 [00:01<00:39,  2.86it/s, loss=2.26, v_num=1, val_acc=0.633]
Epoch 23:   3%|▎         | 4/117 [00:01<00:31,  3.57it/s, loss=2.26, v_num=1, val_acc=0.633]
Epoch 23:   3%|▎         | 4/117 [00:01<00:32,  3.50it/s, loss=2.25, v_num=1, val_acc=0.633]
Epoch 23:   4%|▍         | 5/117 [00:01<00:25,  4.33it/s, loss=2.25, v_num=1, val_acc=0.633]
Epoch 23:   4%|▍         | 5/117 [00:01<00:26,  4.24it/s, loss=2.2, v_num=1, val_acc=0.633]
Epoch 23:   5%|▌         | 6/117 [00:01<00:22,  5.04it/s, loss=2.2, v_num=1, val_acc=0.633]
Epoch 23:   5%|▌         | 6/117 [00:01<00:22,  4.94it/s, loss=2.2, v_num=1, val_acc=0.633]
Epoch 23:   6%|▌         | 7/117 [00:01<00:19,  5.69it/s, loss=2.2, v_num=1, val_acc=0.633]
Epoch 23:   6%|▌         | 7/117 [00:01<00:19,  5.58it/s, loss=2.21, v_num=1, val_acc=0.633]
Epoch 23:   7%|▋         | 8/117 [00:01<00:17,  6.32it/s, loss=2.21, v_num=1, val_acc=0.633]
Epoch 23:   7%|▋         | 8/117 [00:01<00:17,  6.20it/s, loss=2.22, v_num=1, val_acc=0.633]
Epoch 23:   8%|▊         | 9/117 [00:01<00:15,  6.86it/s, loss=2.22, v_num=1, val_acc=0.633]
Epoch 23:   8%|▊         | 9/117 [00:01<00:16,  6.73it/s, loss=2.22, v_num=1, val_acc=0.633]
Epoch 23:   9%|▊         | 10/117 [00:01<00:14,  7.42it/s, loss=2.22, v_num=1, val_acc=0.633]
Epoch 23:   9%|▊         | 10/117 [00:01<00:14,  7.29it/s, loss=2.25, v_num=1, val_acc=0.633]
Epoch 23:   9%|▉         | 11/117 [00:01<00:13,  7.96it/s, loss=2.25, v_num=1, val_acc=0.633]
Epoch 23:   9%|▉         | 11/117 [00:01<00:13,  7.82it/s, loss=2.28, v_num=1, val_acc=0.633]
Epoch 23:  10%|█         | 12/117 [00:01<00:12,  8.47it/s, loss=2.28, v_num=1, val_acc=0.633]
Epoch 23:  10%|█         | 12/117 [00:01<00:12,  8.33it/s, loss=2.28, v_num=1, val_acc=0.633]
Epoch 23:  11%|█         | 13/117 [00:01<00:11,  8.96it/s, loss=2.28, v_num=1, val_acc=0.633]
Epoch 23:  11%|█         | 13/117 [00:01<00:11,  8.81it/s, loss=2.26, v_num=1, val_acc=0.633]
Epoch 23:  12%|█▏        | 14/117 [00:01<00:10,  9.39it/s, loss=2.26, v_num=1, val_acc=0.633]
Epoch 23:  12%|█▏        | 14/117 [00:01<00:11,  9.25it/s, loss=2.25, v_num=1, val_acc=0.633]
Epoch 23:  13%|█▎        | 15/117 [00:01<00:10,  9.81it/s, loss=2.25, v_num=1, val_acc=0.633]
Epoch 23:  13%|█▎        | 15/117 [00:01<00:10,  9.67it/s, loss=2.29, v_num=1, val_acc=0.633]
Epoch 23:  14%|█▎        | 16/117 [00:01<00:09, 10.22it/s, loss=2.29, v_num=1, val_acc=0.633]
Epoch 23:  14%|█▎        | 16/117 [00:01<00:10, 10.07it/s, loss=2.25, v_num=1, val_acc=0.633]
Epoch 23:  15%|█▍        | 17/117 [00:01<00:09, 10.58it/s, loss=2.25, v_num=1, val_acc=0.633]
Epoch 23:  15%|█▍        | 17/117 [00:01<00:09, 10.44it/s, loss=2.25, v_num=1, val_acc=0.633]
Epoch 23:  15%|█▌        | 18/117 [00:01<00:09, 10.96it/s, loss=2.25, v_num=1, val_acc=0.633]
Epoch 23:  15%|█▌        | 18/117 [00:01<00:09, 10.81it/s, loss=2.28, v_num=1, val_acc=0.633]
Epoch 23:  16%|█▌        | 19/117 [00:01<00:08, 11.35it/s, loss=2.28, v_num=1, val_acc=0.633]
Epoch 23:  16%|█▌        | 19/117 [00:01<00:08, 11.18it/s, loss=2.28, v_num=1, val_acc=0.633]
Epoch 23:  17%|█▋        | 20/117 [00:01<00:08, 11.66it/s, loss=2.28, v_num=1, val_acc=0.633]
Epoch 23:  17%|█▋        | 20/117 [00:01<00:08, 11.50it/s, loss=2.22, v_num=1, val_acc=0.633]
Epoch 23:  18%|█▊        | 21/117 [00:01<00:08, 11.96it/s, loss=2.22, v_num=1, val_acc=0.633]
Epoch 23:  18%|█▊        | 21/117 [00:01<00:08, 11.80it/s, loss=2.2, v_num=1, val_acc=0.633]
Epoch 23:  19%|█▉        | 22/117 [00:01<00:07, 12.26it/s, loss=2.2, v_num=1, val_acc=0.633]
Epoch 23:  19%|█▉        | 22/117 [00:01<00:07, 12.11it/s, loss=2.23, v_num=1, val_acc=0.633]
Epoch 23:  20%|█▉        | 23/117 [00:01<00:07, 12.56it/s, loss=2.23, v_num=1, val_acc=0.633]
Epoch 23:  20%|█▉        | 23/117 [00:01<00:07, 12.41it/s, loss=2.25, v_num=1, val_acc=0.633]
Epoch 23:  21%|██        | 24/117 [00:01<00:07, 12.86it/s, loss=2.25, v_num=1, val_acc=0.633]
Epoch 23:  21%|██        | 24/117 [00:01<00:07, 12.71it/s, loss=2.25, v_num=1, val_acc=0.633]
Epoch 23:  21%|██▏       | 25/117 [00:01<00:06, 13.14it/s, loss=2.25, v_num=1, val_acc=0.633]
Epoch 23:  21%|██▏       | 25/117 [00:01<00:07, 12.99it/s, loss=2.25, v_num=1, val_acc=0.633]
Epoch 23:  22%|██▏       | 26/117 [00:01<00:06, 13.42it/s, loss=2.25, v_num=1, val_acc=0.633]
Epoch 23:  22%|██▏       | 26/117 [00:01<00:06, 13.26it/s, loss=2.33, v_num=1, val_acc=0.633]
Epoch 23:  23%|██▎       | 27/117 [00:01<00:06, 13.68it/s, loss=2.33, v_num=1, val_acc=0.633]
Epoch 23:  23%|██▎       | 27/117 [00:01<00:06, 13.53it/s, loss=2.38, v_num=1, val_acc=0.633]
Epoch 23:  24%|██▍       | 28/117 [00:02<00:06, 13.92it/s, loss=2.38, v_num=1, val_acc=0.633]
Epoch 23:  24%|██▍       | 28/117 [00:02<00:06, 13.76it/s, loss=2.41, v_num=1, val_acc=0.633]
Epoch 23:  25%|██▍       | 29/117 [00:02<00:06, 14.18it/s, loss=2.41, v_num=1, val_acc=0.633]
Epoch 23:  25%|██▍       | 29/117 [00:02<00:06, 14.01it/s, loss=2.46, v_num=1, val_acc=0.633]
Epoch 23:  26%|██▌       | 30/117 [00:02<00:06, 14.42it/s, loss=2.46, v_num=1, val_acc=0.633]
Epoch 23:  26%|██▌       | 30/117 [00:02<00:06, 14.25it/s, loss=2.47, v_num=1, val_acc=0.633]
Epoch 23:  26%|██▋       | 31/117 [00:02<00:05, 14.63it/s, loss=2.47, v_num=1, val_acc=0.633]
Epoch 23:  26%|██▋       | 31/117 [00:02<00:05, 14.48it/s, loss=2.46, v_num=1, val_acc=0.633]
Epoch 23:  27%|██▋       | 32/117 [00:02<00:05, 14.85it/s, loss=2.46, v_num=1, val_acc=0.633]
Epoch 23:  27%|██▋       | 32/117 [00:02<00:05, 14.70it/s, loss=2.5, v_num=1, val_acc=0.633]
Epoch 23:  28%|██▊       | 33/117 [00:02<00:05, 15.06it/s, loss=2.5, v_num=1, val_acc=0.633]
Epoch 23:  28%|██▊       | 33/117 [00:02<00:05, 14.90it/s, loss=2.62, v_num=1, val_acc=0.633]
Epoch 23:  29%|██▉       | 34/117 [00:02<00:05, 15.28it/s, loss=2.62, v_num=1, val_acc=0.633]
Epoch 23:  29%|██▉       | 34/117 [00:02<00:05, 15.11it/s, loss=2.62, v_num=1, val_acc=0.633]
Epoch 23:  30%|██▉       | 35/117 [00:02<00:05, 15.48it/s, loss=2.62, v_num=1, val_acc=0.633]
Epoch 23:  30%|██▉       | 35/117 [00:02<00:05, 15.32it/s, loss=2.61, v_num=1, val_acc=0.633]
Epoch 23:  31%|███       | 36/117 [00:02<00:05, 15.66it/s, loss=2.61, v_num=1, val_acc=0.633]
Epoch 23:  31%|███       | 36/117 [00:02<00:05, 15.50it/s, loss=2.67, v_num=1, val_acc=0.633]
Epoch 23:  32%|███▏      | 37/117 [00:02<00:05, 15.84it/s, loss=2.67, v_num=1, val_acc=0.633]
Epoch 23:  32%|███▏      | 37/117 [00:02<00:05, 15.69it/s, loss=2.73, v_num=1, val_acc=0.633]
Epoch 23:  32%|███▏      | 38/117 [00:02<00:04, 16.02it/s, loss=2.73, v_num=1, val_acc=0.633]
Epoch 23:  32%|███▏      | 38/117 [00:02<00:04, 15.87it/s, loss=2.66, v_num=1, val_acc=0.633]
Epoch 23:  33%|███▎      | 39/117 [00:02<00:04, 16.18it/s, loss=2.66, v_num=1, val_acc=0.633]
Epoch 23:  33%|███▎      | 39/117 [00:02<00:04, 16.03it/s, loss=2.59, v_num=1, val_acc=0.633]
Epoch 23:  34%|███▍      | 40/117 [00:02<00:04, 16.34it/s, loss=2.59, v_num=1, val_acc=0.633]
Epoch 23:  34%|███▍      | 40/117 [00:02<00:04, 16.19it/s, loss=2.58, v_num=1, val_acc=0.633]
Epoch 23:  35%|███▌      | 41/117 [00:02<00:04, 16.50it/s, loss=2.58, v_num=1, val_acc=0.633]
Epoch 23:  35%|███▌      | 41/117 [00:02<00:04, 16.35it/s, loss=2.57, v_num=1, val_acc=0.633]
Epoch 23:  36%|███▌      | 42/117 [00:02<00:04, 16.67it/s, loss=2.57, v_num=1, val_acc=0.633]
Epoch 23:  36%|███▌      | 42/117 [00:02<00:04, 16.51it/s, loss=2.56, v_num=1, val_acc=0.633]
Epoch 23:  37%|███▋      | 43/117 [00:02<00:04, 16.83it/s, loss=2.56, v_num=1, val_acc=0.633]
Epoch 23:  37%|███▋      | 43/117 [00:02<00:04, 16.67it/s, loss=2.5, v_num=1, val_acc=0.633]
Epoch 23:  38%|███▊      | 44/117 [00:02<00:04, 16.94it/s, loss=2.5, v_num=1, val_acc=0.633]
Epoch 23:  38%|███▊      | 44/117 [00:02<00:04, 16.82it/s, loss=2.51, v_num=1, val_acc=0.633]
Epoch 23:  38%|███▊      | 45/117 [00:02<00:04, 17.13it/s, loss=2.51, v_num=1, val_acc=0.633]
Epoch 23:  38%|███▊      | 45/117 [00:02<00:04, 16.97it/s, loss=2.48, v_num=1, val_acc=0.633]
Epoch 23:  39%|███▉      | 46/117 [00:02<00:04, 17.27it/s, loss=2.48, v_num=1, val_acc=0.633]
Epoch 23:  39%|███▉      | 46/117 [00:02<00:04, 17.12it/s, loss=2.41, v_num=1, val_acc=0.633]
Epoch 23:  40%|████      | 47/117 [00:02<00:04, 17.41it/s, loss=2.41, v_num=1, val_acc=0.633]
Epoch 23:  40%|████      | 47/117 [00:02<00:04, 17.26it/s, loss=2.4, v_num=1, val_acc=0.633]
Epoch 23:  41%|████      | 48/117 [00:02<00:03, 17.56it/s, loss=2.4, v_num=1, val_acc=0.633]
Epoch 23:  41%|████      | 48/117 [00:02<00:03, 17.40it/s, loss=2.43, v_num=1, val_acc=0.633]
Epoch 23:  42%|████▏     | 49/117 [00:02<00:03, 17.65it/s, loss=2.43, v_num=1, val_acc=0.633]
Epoch 23:  42%|████▏     | 49/117 [00:02<00:03, 17.54it/s, loss=2.42, v_num=1, val_acc=0.633]
Epoch 23:  43%|████▎     | 50/117 [00:02<00:03, 17.79it/s, loss=2.42, v_num=1, val_acc=0.633]
Epoch 23:  43%|████▎     | 50/117 [00:02<00:03, 17.64it/s, loss=2.45, v_num=1, val_acc=0.633]
Epoch 23:  44%|████▎     | 51/117 [00:02<00:03, 17.87it/s, loss=2.45, v_num=1, val_acc=0.633]
Epoch 23:  44%|████▎     | 51/117 [00:02<00:03, 17.77it/s, loss=2.47, v_num=1, val_acc=0.633]
Epoch 23:  44%|████▍     | 52/117 [00:02<00:03, 18.05it/s, loss=2.47, v_num=1, val_acc=0.633]
Epoch 23:  44%|████▍     | 52/117 [00:02<00:03, 17.90it/s, loss=2.57, v_num=1, val_acc=0.633]
Epoch 23:  45%|████▌     | 53/117 [00:02<00:03, 18.17it/s, loss=2.57, v_num=1, val_acc=0.633]
Epoch 23:  45%|████▌     | 53/117 [00:02<00:03, 18.02it/s, loss=2.48, v_num=1, val_acc=0.633]
Epoch 23:  46%|████▌     | 54/117 [00:02<00:03, 18.29it/s, loss=2.48, v_num=1, val_acc=0.633]
Epoch 23:  46%|████▌     | 54/117 [00:02<00:03, 18.14it/s, loss=2.48, v_num=1, val_acc=0.633]
Epoch 23:  47%|████▋     | 55/117 [00:02<00:03, 18.40it/s, loss=2.48, v_num=1, val_acc=0.633]
Epoch 23:  47%|████▋     | 55/117 [00:03<00:03, 18.26it/s, loss=2.43, v_num=1, val_acc=0.633]
Epoch 23:  48%|████▊     | 56/117 [00:03<00:03, 18.52it/s, loss=2.43, v_num=1, val_acc=0.633]
Epoch 23:  48%|████▊     | 56/117 [00:03<00:03, 18.37it/s, loss=2.4, v_num=1, val_acc=0.633]
Epoch 23:  49%|████▊     | 57/117 [00:03<00:03, 18.63it/s, loss=2.4, v_num=1, val_acc=0.633]
Epoch 23:  49%|████▊     | 57/117 [00:03<00:03, 18.48it/s, loss=2.31, v_num=1, val_acc=0.633]
Epoch 23:  50%|████▉     | 58/117 [00:03<00:03, 18.74it/s, loss=2.31, v_num=1, val_acc=0.633]
Epoch 23:  50%|████▉     | 58/117 [00:03<00:03, 18.59it/s, loss=2.34, v_num=1, val_acc=0.633]
Epoch 23:  50%|█████     | 59/117 [00:03<00:03, 18.85it/s, loss=2.34, v_num=1, val_acc=0.633]
Epoch 23:  50%|█████     | 59/117 [00:03<00:03, 18.70it/s, loss=2.39, v_num=1, val_acc=0.633]
Epoch 23:  51%|█████▏    | 60/117 [00:03<00:03, 18.93it/s, loss=2.39, v_num=1, val_acc=0.633]
Epoch 23:  51%|█████▏    | 60/117 [00:03<00:03, 18.78it/s, loss=2.42, v_num=1, val_acc=0.633]
Epoch 23:  52%|█████▏    | 61/117 [00:03<00:02, 19.03it/s, loss=2.42, v_num=1, val_acc=0.633]
Epoch 23:  52%|█████▏    | 61/117 [00:03<00:02, 18.88it/s, loss=2.44, v_num=1, val_acc=0.633]
Epoch 23:  53%|█████▎    | 62/117 [00:03<00:02, 19.11it/s, loss=2.44, v_num=1, val_acc=0.633]
Epoch 23:  53%|█████▎    | 62/117 [00:03<00:02, 18.98it/s, loss=2.41, v_num=1, val_acc=0.633]
Epoch 23:  54%|█████▍    | 63/117 [00:03<00:02, 19.22it/s, loss=2.41, v_num=1, val_acc=0.633]
Epoch 23:  54%|█████▍    | 63/117 [00:03<00:02, 19.08it/s, loss=2.43, v_num=1, val_acc=0.633]
Epoch 23:  55%|█████▍    | 64/117 [00:03<00:02, 19.32it/s, loss=2.43, v_num=1, val_acc=0.633]
Epoch 23:  55%|█████▍    | 64/117 [00:03<00:02, 19.18it/s, loss=2.38, v_num=1, val_acc=0.633]
Epoch 23:  56%|█████▌    | 65/117 [00:03<00:02, 19.41it/s, loss=2.38, v_num=1, val_acc=0.633]
Epoch 23:  56%|█████▌    | 65/117 [00:03<00:02, 19.27it/s, loss=2.36, v_num=1, val_acc=0.633]
Epoch 23:  56%|█████▋    | 66/117 [00:03<00:02, 19.50it/s, loss=2.36, v_num=1, val_acc=0.633]
Epoch 23:  56%|█████▋    | 66/117 [00:03<00:02, 19.36it/s, loss=2.39, v_num=1, val_acc=0.633]
Epoch 23:  57%|█████▋    | 67/117 [00:03<00:02, 19.56it/s, loss=2.39, v_num=1, val_acc=0.633]
Epoch 23:  57%|█████▋    | 67/117 [00:03<00:02, 19.45it/s, loss=2.38, v_num=1, val_acc=0.633]
Epoch 23:  58%|█████▊    | 68/117 [00:03<00:02, 19.67it/s, loss=2.38, v_num=1, val_acc=0.633]
Epoch 23:  58%|█████▊    | 68/117 [00:03<00:02, 19.53it/s, loss=2.38, v_num=1, val_acc=0.633]
Epoch 23:  59%|█████▉    | 69/117 [00:03<00:02, 19.76it/s, loss=2.38, v_num=1, val_acc=0.633]
Epoch 23:  59%|█████▉    | 69/117 [00:03<00:02, 19.62it/s, loss=2.35, v_num=1, val_acc=0.633]
Epoch 23:  60%|█████▉    | 70/117 [00:03<00:02, 19.83it/s, loss=2.35, v_num=1, val_acc=0.633]
Epoch 23:  60%|█████▉    | 70/117 [00:03<00:02, 19.69it/s, loss=2.33, v_num=1, val_acc=0.633]
Epoch 23:  61%|██████    | 71/117 [00:03<00:02, 19.92it/s, loss=2.33, v_num=1, val_acc=0.633]
Epoch 23:  61%|██████    | 71/117 [00:03<00:02, 19.78it/s, loss=2.31, v_num=1, val_acc=0.633]
Epoch 23:  62%|██████▏   | 72/117 [00:03<00:02, 19.96it/s, loss=2.31, v_num=1, val_acc=0.633]
Epoch 23:  62%|██████▏   | 72/117 [00:03<00:02, 19.83it/s, loss=2.16, v_num=1, val_acc=0.633]
Epoch 23:  62%|██████▏   | 73/117 [00:03<00:02, 20.05it/s, loss=2.16, v_num=1, val_acc=0.633]
Epoch 23:  62%|██████▏   | 73/117 [00:03<00:02, 19.92it/s, loss=2.1, v_num=1, val_acc=0.633]
Epoch 23:  63%|██████▎   | 74/117 [00:03<00:02, 20.12it/s, loss=2.1, v_num=1, val_acc=0.633]
Epoch 23:  63%|██████▎   | 74/117 [00:03<00:02, 20.00it/s, loss=2.03, v_num=1, val_acc=0.633]
Epoch 23:  64%|██████▍   | 75/117 [00:03<00:02, 20.10it/s, loss=2.03, v_num=1, val_acc=0.633]
Epoch 23:  64%|██████▍   | 75/117 [00:03<00:02, 19.98it/s, loss=2.06, v_num=1, val_acc=0.633]
Epoch 23:  65%|██████▍   | 76/117 [00:03<00:02, 20.17it/s, loss=2.06, v_num=1, val_acc=0.633]
Epoch 23:  65%|██████▍   | 76/117 [00:03<00:02, 20.06it/s, loss=2.08, v_num=1, val_acc=0.633]
Epoch 23:  66%|██████▌   | 77/117 [00:03<00:01, 20.23it/s, loss=2.08, v_num=1, val_acc=0.633]
Epoch 23:  66%|██████▌   | 77/117 [00:03<00:01, 20.12it/s, loss=2.22, v_num=1, val_acc=0.633]
Epoch 23:  67%|██████▋   | 78/117 [00:03<00:01, 20.32it/s, loss=2.22, v_num=1, val_acc=0.633]
Epoch 23:  67%|██████▋   | 78/117 [00:03<00:01, 20.20it/s, loss=2.28, v_num=1, val_acc=0.633]
Epoch 23:  68%|██████▊   | 79/117 [00:03<00:01, 20.39it/s, loss=2.28, v_num=1, val_acc=0.633]
Epoch 23:  68%|██████▊   | 79/117 [00:03<00:01, 20.27it/s, loss=2.36, v_num=1, val_acc=0.633]
Epoch 23:  68%|██████▊   | 80/117 [00:03<00:01, 20.47it/s, loss=2.36, v_num=1, val_acc=0.633]
Epoch 23:  68%|██████▊   | 80/117 [00:03<00:01, 20.35it/s, loss=2.45, v_num=1, val_acc=0.633]
Epoch 23:  69%|██████▉   | 81/117 [00:03<00:01, 20.55it/s, loss=2.45, v_num=1, val_acc=0.633]
Epoch 23:  69%|██████▉   | 81/117 [00:03<00:01, 20.42it/s, loss=2.54, v_num=1, val_acc=0.633]
Epoch 23:  70%|███████   | 82/117 [00:03<00:01, 20.56it/s, loss=2.54, v_num=1, val_acc=0.633]
Epoch 23:  70%|███████   | 82/117 [00:04<00:01, 20.44it/s, loss=2.6, v_num=1, val_acc=0.633]
Epoch 23:  71%|███████   | 83/117 [00:04<00:01, 20.64it/s, loss=2.6, v_num=1, val_acc=0.633]
Epoch 23:  71%|███████   | 83/117 [00:04<00:01, 20.51it/s, loss=2.59, v_num=1, val_acc=0.633]
Epoch 23:  72%|███████▏  | 84/117 [00:04<00:01, 20.71it/s, loss=2.59, v_num=1, val_acc=0.633]
Epoch 23:  72%|███████▏  | 84/117 [00:04<00:01, 20.58it/s, loss=2.6, v_num=1, val_acc=0.633]
Epoch 23:  73%|███████▎  | 85/117 [00:04<00:01, 20.78it/s, loss=2.6, v_num=1, val_acc=0.633]
Epoch 23:  73%|███████▎  | 85/117 [00:04<00:01, 20.65it/s, loss=2.61, v_num=1, val_acc=0.633]
Epoch 23:  74%|███████▎  | 86/117 [00:04<00:01, 20.84it/s, loss=2.61, v_num=1, val_acc=0.633]
Epoch 23:  74%|███████▎  | 86/117 [00:04<00:01, 20.71it/s, loss=2.64, v_num=1, val_acc=0.633]
Epoch 23:  74%|███████▍  | 87/117 [00:04<00:01, 20.91it/s, loss=2.64, v_num=1, val_acc=0.633]
Epoch 23:  74%|███████▍  | 87/117 [00:04<00:01, 20.78it/s, loss=2.63, v_num=1, val_acc=0.633]
Epoch 23:  75%|███████▌  | 88/117 [00:04<00:01, 20.97it/s, loss=2.63, v_num=1, val_acc=0.633]
Epoch 23:  75%|███████▌  | 88/117 [00:04<00:01, 20.84it/s, loss=2.59, v_num=1, val_acc=0.633]
Epoch 23:  76%|███████▌  | 89/117 [00:04<00:01, 21.03it/s, loss=2.59, v_num=1, val_acc=0.633]
Epoch 23:  76%|███████▌  | 89/117 [00:04<00:01, 20.91it/s, loss=2.62, v_num=1, val_acc=0.633]
Epoch 23:  77%|███████▋  | 90/117 [00:04<00:01, 21.09it/s, loss=2.62, v_num=1, val_acc=0.633]
Epoch 23:  77%|███████▋  | 90/117 [00:04<00:01, 20.97it/s, loss=2.67, v_num=1, val_acc=0.633]
Epoch 23:  78%|███████▊  | 91/117 [00:04<00:01, 21.15it/s, loss=2.67, v_num=1, val_acc=0.633]
Epoch 23:  78%|███████▊  | 91/117 [00:04<00:01, 21.03it/s, loss=2.71, v_num=1, val_acc=0.633]
Epoch 23:  79%|███████▊  | 92/117 [00:04<00:01, 21.21it/s, loss=2.71, v_num=1, val_acc=0.633]
Epoch 23:  79%|███████▊  | 92/117 [00:04<00:01, 21.09it/s, loss=2.75, v_num=1, val_acc=0.633]
Epoch 23:  79%|███████▉  | 93/117 [00:04<00:01, 21.27it/s, loss=2.75, v_num=1, val_acc=0.633]
Epoch 23:  79%|███████▉  | 93/117 [00:04<00:01, 21.15it/s, loss=2.78, v_num=1, val_acc=0.633]
Epoch 23:  80%|████████  | 94/117 [00:04<00:01, 21.33it/s, loss=2.78, v_num=1, val_acc=0.633]
Epoch 23:  80%|████████  | 94/117 [00:04<00:01, 21.20it/s, loss=2.79, v_num=1, val_acc=0.633]
Epoch 23:  81%|████████  | 95/117 [00:04<00:01, 21.38it/s, loss=2.79, v_num=1, val_acc=0.633]
Epoch 23:  81%|████████  | 95/117 [00:04<00:01, 21.26it/s, loss=2.78, v_num=1, val_acc=0.633]
Epoch 23:  82%|████████▏ | 96/117 [00:04<00:00, 21.43it/s, loss=2.78, v_num=1, val_acc=0.633]
Epoch 23:  82%|████████▏ | 96/117 [00:04<00:00, 21.31it/s, loss=2.74, v_num=1, val_acc=0.633]
Epoch 23:  83%|████████▎ | 97/117 [00:04<00:00, 21.49it/s, loss=2.74, v_num=1, val_acc=0.633]
Epoch 23:  83%|████████▎ | 97/117 [00:04<00:00, 21.37it/s, loss=2.63, v_num=1, val_acc=0.633]

Validation: 0it [00:00, ?it/s]

Validation:   0%|          | 0/20 [00:00<?, ?it/s]

Validation DataLoader 0:   0%|          | 0/20 [00:00<?, ?it/s]

Validation DataLoader 0:   5%|▌         | 1/20 [00:00<00:00, 138.15it/s]
Epoch 23:  84%|████████▍ | 98/117 [00:05<00:01, 17.91it/s, loss=2.63, v_num=1, val_acc=0.633]

Validation DataLoader 0:  10%|█         | 2/20 [00:00<00:00, 26.06it/s]
Epoch 23:  85%|████████▍ | 99/117 [00:05<00:01, 17.87it/s, loss=2.63, v_num=1, val_acc=0.633]

Validation DataLoader 0:  15%|█▌        | 3/20 [00:00<00:00, 27.36it/s]
Epoch 23:  85%|████████▌ | 100/117 [00:05<00:00, 17.94it/s, loss=2.63, v_num=1, val_acc=0.633]

Validation DataLoader 0:  20%|██        | 4/20 [00:00<00:00, 28.00it/s]
Epoch 23:  86%|████████▋ | 101/117 [00:05<00:00, 18.01it/s, loss=2.63, v_num=1, val_acc=0.633]

Validation DataLoader 0:  25%|██▌       | 5/20 [00:00<00:00, 28.79it/s]
Epoch 23:  87%|████████▋ | 102/117 [00:05<00:00, 18.09it/s, loss=2.63, v_num=1, val_acc=0.633]

Validation DataLoader 0:  30%|███       | 6/20 [00:00<00:00, 29.13it/s]
Epoch 23:  88%|████████▊ | 103/117 [00:05<00:00, 18.17it/s, loss=2.63, v_num=1, val_acc=0.633]

Validation DataLoader 0:  35%|███▌      | 7/20 [00:00<00:00, 29.40it/s]
Epoch 23:  89%|████████▉ | 104/117 [00:05<00:00, 18.24it/s, loss=2.63, v_num=1, val_acc=0.633]

Validation DataLoader 0:  40%|████      | 8/20 [00:00<00:00, 29.56it/s]
Epoch 23:  90%|████████▉ | 105/117 [00:05<00:00, 18.31it/s, loss=2.63, v_num=1, val_acc=0.633]

Validation DataLoader 0:  45%|████▌     | 9/20 [00:00<00:00, 29.72it/s]
Epoch 23:  91%|█████████ | 106/117 [00:05<00:00, 18.38it/s, loss=2.63, v_num=1, val_acc=0.633]

Validation DataLoader 0:  50%|█████     | 10/20 [00:00<00:00, 29.75it/s]
Epoch 23:  91%|█████████▏| 107/117 [00:05<00:00, 18.45it/s, loss=2.63, v_num=1, val_acc=0.633]

Validation DataLoader 0:  55%|█████▌    | 11/20 [00:00<00:00, 29.90it/s]
Epoch 23:  92%|█████████▏| 108/117 [00:05<00:00, 18.52it/s, loss=2.63, v_num=1, val_acc=0.633]

Validation DataLoader 0:  60%|██████    | 12/20 [00:00<00:00, 30.01it/s]
Epoch 23:  93%|█████████▎| 109/117 [00:05<00:00, 18.59it/s, loss=2.63, v_num=1, val_acc=0.633]

Validation DataLoader 0:  65%|██████▌   | 13/20 [00:00<00:00, 30.05it/s]
Epoch 23:  94%|█████████▍| 110/117 [00:05<00:00, 18.66it/s, loss=2.63, v_num=1, val_acc=0.633]

Validation DataLoader 0:  70%|███████   | 14/20 [00:00<00:00, 30.13it/s]
Epoch 23:  95%|█████████▍| 111/117 [00:05<00:00, 18.72it/s, loss=2.63, v_num=1, val_acc=0.633]

Validation DataLoader 0:  75%|███████▌  | 15/20 [00:00<00:00, 30.21it/s]
Epoch 23:  96%|█████████▌| 112/117 [00:05<00:00, 18.79it/s, loss=2.63, v_num=1, val_acc=0.633]

Validation DataLoader 0:  80%|████████  | 16/20 [00:00<00:00, 30.26it/s]
Epoch 23:  97%|█████████▋| 113/117 [00:05<00:00, 18.86it/s, loss=2.63, v_num=1, val_acc=0.633]

Validation DataLoader 0:  85%|████████▌ | 17/20 [00:00<00:00, 30.30it/s]
Epoch 23:  97%|█████████▋| 114/117 [00:06<00:00, 18.92it/s, loss=2.63, v_num=1, val_acc=0.633]

Validation DataLoader 0:  90%|█████████ | 18/20 [00:00<00:00, 30.33it/s]
Epoch 23:  98%|█████████▊| 115/117 [00:06<00:00, 18.99it/s, loss=2.63, v_num=1, val_acc=0.633]

Validation DataLoader 0:  95%|█████████▌| 19/20 [00:00<00:00, 30.41it/s]
Epoch 23:  99%|█████████▉| 116/117 [00:06<00:00, 19.05it/s, loss=2.63, v_num=1, val_acc=0.633]

Validation DataLoader 0: 100%|██████████| 20/20 [00:00<00:00, 30.51it/s]
Epoch 23: 100%|██████████| 117/117 [00:06<00:00, 19.12it/s, loss=2.63, v_num=1, val_acc=0.633]
Epoch 23: 100%|██████████| 117/117 [00:06<00:00, 19.06it/s, loss=2.63, v_num=1, val_acc=0.647]


Epoch 23: 100%|██████████| 117/117 [00:06<00:00, 19.06it/s, loss=2.63, v_num=1, val_acc=0.647]
Epoch 23:   0%|          | 0/117 [00:00<?, ?it/s, loss=2.63, v_num=1, val_acc=0.647]
Epoch 24:   0%|          | 0/117 [00:00<?, ?it/s, loss=2.63, v_num=1, val_acc=0.647]
Epoch 24:   1%|          | 1/117 [00:01<02:02,  1.05s/it, loss=2.63, v_num=1, val_acc=0.647]
Epoch 24:   1%|          | 1/117 [00:01<02:02,  1.06s/it, loss=2.63, v_num=1, val_acc=0.647]
Epoch 24:   2%|▏         | 2/117 [00:01<01:03,  1.82it/s, loss=2.63, v_num=1, val_acc=0.647]
Epoch 24:   2%|▏         | 2/117 [00:01<01:04,  1.78it/s, loss=2.54, v_num=1, val_acc=0.647]
Epoch 24:   3%|▎         | 3/117 [00:01<00:43,  2.64it/s, loss=2.54, v_num=1, val_acc=0.647]
Epoch 24:   3%|▎         | 3/117 [00:01<00:43,  2.59it/s, loss=2.42, v_num=1, val_acc=0.647]
Epoch 24:   3%|▎         | 4/117 [00:01<00:33,  3.42it/s, loss=2.42, v_num=1, val_acc=0.647]
Epoch 24:   3%|▎         | 4/117 [00:01<00:33,  3.36it/s, loss=2.36, v_num=1, val_acc=0.647]
Epoch 24:   4%|▍         | 5/117 [00:01<00:26,  4.15it/s, loss=2.36, v_num=1, val_acc=0.647]
Epoch 24:   4%|▍         | 5/117 [00:01<00:27,  4.07it/s, loss=2.31, v_num=1, val_acc=0.647]
Epoch 24:   5%|▌         | 6/117 [00:01<00:22,  4.83it/s, loss=2.31, v_num=1, val_acc=0.647]
Epoch 24:   5%|▌         | 6/117 [00:01<00:23,  4.75it/s, loss=2.35, v_num=1, val_acc=0.647]
Epoch 24:   6%|▌         | 7/117 [00:01<00:20,  5.39it/s, loss=2.35, v_num=1, val_acc=0.647]
Epoch 24:   6%|▌         | 7/117 [00:01<00:20,  5.33it/s, loss=2.47, v_num=1, val_acc=0.647]
Epoch 24:   7%|▋         | 8/117 [00:01<00:18,  6.03it/s, loss=2.47, v_num=1, val_acc=0.647]
Epoch 24:   7%|▋         | 8/117 [00:01<00:18,  5.93it/s, loss=2.47, v_num=1, val_acc=0.647]
Epoch 24:   8%|▊         | 9/117 [00:01<00:16,  6.61it/s, loss=2.47, v_num=1, val_acc=0.647]
Epoch 24:   8%|▊         | 9/117 [00:01<00:16,  6.50it/s, loss=2.43, v_num=1, val_acc=0.647]
Epoch 24:   9%|▊         | 10/117 [00:01<00:15,  7.01it/s, loss=2.43, v_num=1, val_acc=0.647]
Epoch 24:   9%|▊         | 10/117 [00:01<00:15,  6.90it/s, loss=2.41, v_num=1, val_acc=0.647]
Epoch 24:   9%|▉         | 11/117 [00:01<00:14,  7.53it/s, loss=2.41, v_num=1, val_acc=0.647]
Epoch 24:   9%|▉         | 11/117 [00:01<00:14,  7.42it/s, loss=2.42, v_num=1, val_acc=0.647]
Epoch 24:  10%|█         | 12/117 [00:01<00:13,  8.01it/s, loss=2.42, v_num=1, val_acc=0.647]
Epoch 24:  10%|█         | 12/117 [00:01<00:13,  7.90it/s, loss=2.43, v_num=1, val_acc=0.647]
Epoch 24:  11%|█         | 13/117 [00:01<00:12,  8.41it/s, loss=2.43, v_num=1, val_acc=0.647]
Epoch 24:  11%|█         | 13/117 [00:01<00:12,  8.29it/s, loss=2.37, v_num=1, val_acc=0.647]
Epoch 24:  12%|█▏        | 14/117 [00:01<00:11,  8.85it/s, loss=2.37, v_num=1, val_acc=0.647]
Epoch 24:  12%|█▏        | 14/117 [00:01<00:11,  8.73it/s, loss=2.32, v_num=1, val_acc=0.647]
Epoch 24:  13%|█▎        | 15/117 [00:01<00:11,  9.13it/s, loss=2.32, v_num=1, val_acc=0.647]
Epoch 24:  13%|█▎        | 15/117 [00:01<00:11,  9.01it/s, loss=2.27, v_num=1, val_acc=0.647]
Epoch 24:  14%|█▎        | 16/117 [00:01<00:10,  9.55it/s, loss=2.27, v_num=1, val_acc=0.647]
Epoch 24:  14%|█▎        | 16/117 [00:01<00:10,  9.41it/s, loss=2.24, v_num=1, val_acc=0.647]
Epoch 24:  15%|█▍        | 17/117 [00:01<00:10,  9.94it/s, loss=2.24, v_num=1, val_acc=0.647]
Epoch 24:  15%|█▍        | 17/117 [00:01<00:10,  9.80it/s, loss=2.2, v_num=1, val_acc=0.647]
Epoch 24:  15%|█▌        | 18/117 [00:01<00:09, 10.30it/s, loss=2.2, v_num=1, val_acc=0.647]
Epoch 24:  15%|█▌        | 18/117 [00:01<00:09, 10.16it/s, loss=2.18, v_num=1, val_acc=0.647]
Epoch 24:  16%|█▌        | 19/117 [00:01<00:09, 10.66it/s, loss=2.18, v_num=1, val_acc=0.647]
Epoch 24:  16%|█▌        | 19/117 [00:01<00:09, 10.52it/s, loss=2.17, v_num=1, val_acc=0.647]
Epoch 24:  17%|█▋        | 20/117 [00:01<00:08, 11.01it/s, loss=2.17, v_num=1, val_acc=0.647]
Epoch 24:  17%|█▋        | 20/117 [00:01<00:08, 10.86it/s, loss=2.18, v_num=1, val_acc=0.647]
Epoch 24:  18%|█▊        | 21/117 [00:01<00:08, 11.34it/s, loss=2.18, v_num=1, val_acc=0.647]
Epoch 24:  18%|█▊        | 21/117 [00:01<00:08, 11.19it/s, loss=2.14, v_num=1, val_acc=0.647]
Epoch 24:  19%|█▉        | 22/117 [00:01<00:08, 11.67it/s, loss=2.14, v_num=1, val_acc=0.647]
Epoch 24:  19%|█▉        | 22/117 [00:01<00:08, 11.51it/s, loss=2.22, v_num=1, val_acc=0.647]
Epoch 24:  20%|█▉        | 23/117 [00:01<00:07, 11.96it/s, loss=2.22, v_num=1, val_acc=0.647]
Epoch 24:  20%|█▉        | 23/117 [00:01<00:07, 11.81it/s, loss=2.26, v_num=1, val_acc=0.647]
Epoch 24:  21%|██        | 24/117 [00:01<00:07, 12.26it/s, loss=2.26, v_num=1, val_acc=0.647]
Epoch 24:  21%|██        | 24/117 [00:01<00:07, 12.10it/s, loss=2.25, v_num=1, val_acc=0.647]
Epoch 24:  21%|██▏       | 25/117 [00:01<00:07, 12.53it/s, loss=2.25, v_num=1, val_acc=0.647]
Epoch 24:  21%|██▏       | 25/117 [00:02<00:07, 12.38it/s, loss=2.25, v_num=1, val_acc=0.647]
Epoch 24:  22%|██▏       | 26/117 [00:02<00:07, 12.78it/s, loss=2.25, v_num=1, val_acc=0.647]
Epoch 24:  22%|██▏       | 26/117 [00:02<00:07, 12.64it/s, loss=2.19, v_num=1, val_acc=0.647]
Epoch 24:  23%|██▎       | 27/117 [00:02<00:06, 13.06it/s, loss=2.19, v_num=1, val_acc=0.647]
Epoch 24:  23%|██▎       | 27/117 [00:02<00:06, 12.91it/s, loss=2.14, v_num=1, val_acc=0.647]
Epoch 24:  24%|██▍       | 28/117 [00:02<00:06, 13.32it/s, loss=2.14, v_num=1, val_acc=0.647]
Epoch 24:  24%|██▍       | 28/117 [00:02<00:06, 13.17it/s, loss=2.22, v_num=1, val_acc=0.647]
Epoch 24:  25%|██▍       | 29/117 [00:02<00:06, 13.57it/s, loss=2.22, v_num=1, val_acc=0.647]
Epoch 24:  25%|██▍       | 29/117 [00:02<00:06, 13.42it/s, loss=2.29, v_num=1, val_acc=0.647]
Epoch 24:  26%|██▌       | 30/117 [00:02<00:06, 13.78it/s, loss=2.29, v_num=1, val_acc=0.647]
Epoch 24:  26%|██▌       | 30/117 [00:02<00:06, 13.63it/s, loss=2.32, v_num=1, val_acc=0.647]
Epoch 24:  26%|██▋       | 31/117 [00:02<00:06, 14.02it/s, loss=2.32, v_num=1, val_acc=0.647]
Epoch 24:  26%|██▋       | 31/117 [00:02<00:06, 13.86it/s, loss=2.36, v_num=1, val_acc=0.647]
Epoch 24:  27%|██▋       | 32/117 [00:02<00:05, 14.25it/s, loss=2.36, v_num=1, val_acc=0.647]
Epoch 24:  27%|██▋       | 32/117 [00:02<00:06, 14.09it/s, loss=2.34, v_num=1, val_acc=0.647]
Epoch 24:  28%|██▊       | 33/117 [00:02<00:05, 14.46it/s, loss=2.34, v_num=1, val_acc=0.647]
Epoch 24:  28%|██▊       | 33/117 [00:02<00:05, 14.31it/s, loss=2.32, v_num=1, val_acc=0.647]
Epoch 24:  29%|██▉       | 34/117 [00:02<00:05, 14.67it/s, loss=2.32, v_num=1, val_acc=0.647]
Epoch 24:  29%|██▉       | 34/117 [00:02<00:05, 14.52it/s, loss=2.32, v_num=1, val_acc=0.647]
Epoch 24:  30%|██▉       | 35/117 [00:02<00:05, 14.88it/s, loss=2.32, v_num=1, val_acc=0.647]
Epoch 24:  30%|██▉       | 35/117 [00:02<00:05, 14.73it/s, loss=2.31, v_num=1, val_acc=0.647]
Epoch 24:  31%|███       | 36/117 [00:02<00:05, 15.09it/s, loss=2.31, v_num=1, val_acc=0.647]
Epoch 24:  31%|███       | 36/117 [00:02<00:05, 14.93it/s, loss=2.31, v_num=1, val_acc=0.647]
Epoch 24:  32%|███▏      | 37/117 [00:02<00:05, 15.26it/s, loss=2.31, v_num=1, val_acc=0.647]
Epoch 24:  32%|███▏      | 37/117 [00:02<00:05, 15.12it/s, loss=2.3, v_num=1, val_acc=0.647]
Epoch 24:  32%|███▏      | 38/117 [00:02<00:05, 15.42it/s, loss=2.3, v_num=1, val_acc=0.647]
Epoch 24:  32%|███▏      | 38/117 [00:02<00:05, 15.29it/s, loss=2.28, v_num=1, val_acc=0.647]
Epoch 24:  33%|███▎      | 39/117 [00:02<00:04, 15.61it/s, loss=2.28, v_num=1, val_acc=0.647]
Epoch 24:  33%|███▎      | 39/117 [00:02<00:05, 15.47it/s, loss=2.25, v_num=1, val_acc=0.647]
Epoch 24:  34%|███▍      | 40/117 [00:02<00:04, 15.74it/s, loss=2.25, v_num=1, val_acc=0.647]
Epoch 24:  34%|███▍      | 40/117 [00:02<00:04, 15.63it/s, loss=2.19, v_num=1, val_acc=0.647]
Epoch 24:  35%|███▌      | 41/117 [00:02<00:04, 15.95it/s, loss=2.19, v_num=1, val_acc=0.647]
Epoch 24:  35%|███▌      | 41/117 [00:02<00:04, 15.80it/s, loss=2.12, v_num=1, val_acc=0.647]
Epoch 24:  36%|███▌      | 42/117 [00:02<00:04, 16.11it/s, loss=2.12, v_num=1, val_acc=0.647]
Epoch 24:  36%|███▌      | 42/117 [00:02<00:04, 15.96it/s, loss=2.02, v_num=1, val_acc=0.647]
Epoch 24:  37%|███▋      | 43/117 [00:02<00:04, 16.26it/s, loss=2.02, v_num=1, val_acc=0.647]
Epoch 24:  37%|███▋      | 43/117 [00:02<00:04, 16.13it/s, loss=2, v_num=1, val_acc=0.647]
Epoch 24:  38%|███▊      | 44/117 [00:02<00:04, 16.42it/s, loss=2, v_num=1, val_acc=0.647]
Epoch 24:  38%|███▊      | 44/117 [00:02<00:04, 16.29it/s, loss=2.07, v_num=1, val_acc=0.647]
Epoch 24:  38%|███▊      | 45/117 [00:02<00:04, 16.59it/s, loss=2.07, v_num=1, val_acc=0.647]
Epoch 24:  38%|███▊      | 45/117 [00:02<00:04, 16.45it/s, loss=2.05, v_num=1, val_acc=0.647]
Epoch 24:  39%|███▉      | 46/117 [00:02<00:04, 16.72it/s, loss=2.05, v_num=1, val_acc=0.647]
Epoch 24:  39%|███▉      | 46/117 [00:02<00:04, 16.59it/s, loss=2.07, v_num=1, val_acc=0.647]
Epoch 24:  40%|████      | 47/117 [00:02<00:04, 16.87it/s, loss=2.07, v_num=1, val_acc=0.647]
Epoch 24:  40%|████      | 47/117 [00:02<00:04, 16.74it/s, loss=2.05, v_num=1, val_acc=0.647]
Epoch 24:  41%|████      | 48/117 [00:02<00:04, 17.01it/s, loss=2.05, v_num=1, val_acc=0.647]
Epoch 24:  41%|████      | 48/117 [00:02<00:04, 16.88it/s, loss=2.01, v_num=1, val_acc=0.647]
Epoch 24:  42%|████▏     | 49/117 [00:02<00:03, 17.17it/s, loss=2.01, v_num=1, val_acc=0.647]
Epoch 24:  42%|████▏     | 49/117 [00:02<00:03, 17.02it/s, loss=1.99, v_num=1, val_acc=0.647]
Epoch 24:  43%|████▎     | 50/117 [00:02<00:03, 17.30it/s, loss=1.99, v_num=1, val_acc=0.647]
Epoch 24:  43%|████▎     | 50/117 [00:02<00:03, 17.16it/s, loss=2.01, v_num=1, val_acc=0.647]
Epoch 24:  44%|████▎     | 51/117 [00:02<00:03, 17.43it/s, loss=2.01, v_num=1, val_acc=0.647]
Epoch 24:  44%|████▎     | 51/117 [00:02<00:03, 17.29it/s, loss=2.04, v_num=1, val_acc=0.647]
Epoch 24:  44%|████▍     | 52/117 [00:02<00:03, 17.54it/s, loss=2.04, v_num=1, val_acc=0.647]
Epoch 24:  44%|████▍     | 52/117 [00:02<00:03, 17.42it/s, loss=2.1, v_num=1, val_acc=0.647]
Epoch 24:  45%|████▌     | 53/117 [00:02<00:03, 17.69it/s, loss=2.1, v_num=1, val_acc=0.647]
Epoch 24:  45%|████▌     | 53/117 [00:03<00:03, 17.55it/s, loss=2.1, v_num=1, val_acc=0.647]
Epoch 24:  46%|████▌     | 54/117 [00:03<00:03, 17.79it/s, loss=2.1, v_num=1, val_acc=0.647]
Epoch 24:  46%|████▌     | 54/117 [00:03<00:03, 17.67it/s, loss=2.11, v_num=1, val_acc=0.647]
Epoch 24:  47%|████▋     | 55/117 [00:03<00:03, 17.92it/s, loss=2.11, v_num=1, val_acc=0.647]
Epoch 24:  47%|████▋     | 55/117 [00:03<00:03, 17.79it/s, loss=2.18, v_num=1, val_acc=0.647]
Epoch 24:  48%|████▊     | 56/117 [00:03<00:03, 18.05it/s, loss=2.18, v_num=1, val_acc=0.647]
Epoch 24:  48%|████▊     | 56/117 [00:03<00:03, 17.91it/s, loss=2.26, v_num=1, val_acc=0.647]
Epoch 24:  49%|████▊     | 57/117 [00:03<00:03, 18.14it/s, loss=2.26, v_num=1, val_acc=0.647]
Epoch 24:  49%|████▊     | 57/117 [00:03<00:03, 18.03it/s, loss=2.34, v_num=1, val_acc=0.647]
Epoch 24:  50%|████▉     | 58/117 [00:03<00:03, 18.26it/s, loss=2.34, v_num=1, val_acc=0.647]
Epoch 24:  50%|████▉     | 58/117 [00:03<00:03, 18.14it/s, loss=2.36, v_num=1, val_acc=0.647]
Epoch 24:  50%|█████     | 59/117 [00:03<00:03, 18.36it/s, loss=2.36, v_num=1, val_acc=0.647]
Epoch 24:  50%|█████     | 59/117 [00:03<00:03, 18.25it/s, loss=2.39, v_num=1, val_acc=0.647]
Epoch 24:  51%|█████▏    | 60/117 [00:03<00:03, 18.46it/s, loss=2.39, v_num=1, val_acc=0.647]
Epoch 24:  51%|█████▏    | 60/117 [00:03<00:03, 18.35it/s, loss=2.44, v_num=1, val_acc=0.647]
Epoch 24:  52%|█████▏    | 61/117 [00:03<00:03, 18.57it/s, loss=2.44, v_num=1, val_acc=0.647]
Epoch 24:  52%|█████▏    | 61/117 [00:03<00:03, 18.45it/s, loss=2.51, v_num=1, val_acc=0.647]
Epoch 24:  53%|█████▎    | 62/117 [00:03<00:02, 18.67it/s, loss=2.51, v_num=1, val_acc=0.647]
Epoch 24:  53%|█████▎    | 62/117 [00:03<00:02, 18.54it/s, loss=2.64, v_num=1, val_acc=0.647]
Epoch 24:  54%|█████▍    | 63/117 [00:03<00:02, 18.76it/s, loss=2.64, v_num=1, val_acc=0.647]
Epoch 24:  54%|█████▍    | 63/117 [00:03<00:02, 18.63it/s, loss=2.64, v_num=1, val_acc=0.647]
Epoch 24:  55%|█████▍    | 64/117 [00:03<00:02, 18.81it/s, loss=2.64, v_num=1, val_acc=0.647]
Epoch 24:  55%|█████▍    | 64/117 [00:03<00:02, 18.70it/s, loss=2.58, v_num=1, val_acc=0.647]
Epoch 24:  56%|█████▌    | 65/117 [00:03<00:02, 18.94it/s, loss=2.58, v_num=1, val_acc=0.647]
Epoch 24:  56%|█████▌    | 65/117 [00:03<00:02, 18.80it/s, loss=2.57, v_num=1, val_acc=0.647]
Epoch 24:  56%|█████▋    | 66/117 [00:03<00:02, 18.92it/s, loss=2.57, v_num=1, val_acc=0.647]
Epoch 24:  56%|█████▋    | 66/117 [00:03<00:02, 18.79it/s, loss=2.54, v_num=1, val_acc=0.647]
Epoch 24:  57%|█████▋    | 67/117 [00:03<00:02, 19.03it/s, loss=2.54, v_num=1, val_acc=0.647]
Epoch 24:  57%|█████▋    | 67/117 [00:03<00:02, 18.89it/s, loss=2.51, v_num=1, val_acc=0.647]
Epoch 24:  58%|█████▊    | 68/117 [00:03<00:02, 19.12it/s, loss=2.51, v_num=1, val_acc=0.647]
Epoch 24:  58%|█████▊    | 68/117 [00:03<00:02, 18.99it/s, loss=2.53, v_num=1, val_acc=0.647]
Epoch 24:  59%|█████▉    | 69/117 [00:03<00:02, 19.22it/s, loss=2.53, v_num=1, val_acc=0.647]
Epoch 24:  59%|█████▉    | 69/117 [00:03<00:02, 19.09it/s, loss=2.46, v_num=1, val_acc=0.647]
Epoch 24:  60%|█████▉    | 70/117 [00:03<00:02, 19.31it/s, loss=2.46, v_num=1, val_acc=0.647]
Epoch 24:  60%|█████▉    | 70/117 [00:03<00:02, 19.18it/s, loss=2.41, v_num=1, val_acc=0.647]
Epoch 24:  61%|██████    | 71/117 [00:03<00:02, 19.40it/s, loss=2.41, v_num=1, val_acc=0.647]
Epoch 24:  61%|██████    | 71/117 [00:03<00:02, 19.28it/s, loss=2.33, v_num=1, val_acc=0.647]
Epoch 24:  62%|██████▏   | 72/117 [00:03<00:02, 19.48it/s, loss=2.33, v_num=1, val_acc=0.647]
Epoch 24:  62%|██████▏   | 72/117 [00:03<00:02, 19.37it/s, loss=2.29, v_num=1, val_acc=0.647]
Epoch 24:  62%|██████▏   | 73/117 [00:03<00:02, 19.54it/s, loss=2.29, v_num=1, val_acc=0.647]
Epoch 24:  62%|██████▏   | 73/117 [00:03<00:02, 19.42it/s, loss=2.35, v_num=1, val_acc=0.647]
Epoch 24:  63%|██████▎   | 74/117 [00:03<00:02, 19.61it/s, loss=2.35, v_num=1, val_acc=0.647]
Epoch 24:  63%|██████▎   | 74/117 [00:03<00:02, 19.51it/s, loss=2.43, v_num=1, val_acc=0.647]
Epoch 24:  64%|██████▍   | 75/117 [00:03<00:02, 19.68it/s, loss=2.43, v_num=1, val_acc=0.647]
Epoch 24:  64%|██████▍   | 75/117 [00:03<00:02, 19.57it/s, loss=2.39, v_num=1, val_acc=0.647]
Epoch 24:  65%|██████▍   | 76/117 [00:03<00:02, 19.79it/s, loss=2.39, v_num=1, val_acc=0.647]
Epoch 24:  65%|██████▍   | 76/117 [00:03<00:02, 19.66it/s, loss=2.32, v_num=1, val_acc=0.647]
Epoch 24:  66%|██████▌   | 77/117 [00:03<00:02, 19.86it/s, loss=2.32, v_num=1, val_acc=0.647]
Epoch 24:  66%|██████▌   | 77/117 [00:03<00:02, 19.74it/s, loss=2.28, v_num=1, val_acc=0.647]
Epoch 24:  67%|██████▋   | 78/117 [00:03<00:01, 19.89it/s, loss=2.28, v_num=1, val_acc=0.647]
Epoch 24:  67%|██████▋   | 78/117 [00:03<00:01, 19.76it/s, loss=2.34, v_num=1, val_acc=0.647]
Epoch 24:  68%|██████▊   | 79/117 [00:03<00:01, 19.97it/s, loss=2.34, v_num=1, val_acc=0.647]
Epoch 24:  68%|██████▊   | 79/117 [00:03<00:01, 19.84it/s, loss=2.37, v_num=1, val_acc=0.647]
Epoch 24:  68%|██████▊   | 80/117 [00:03<00:01, 20.03it/s, loss=2.37, v_num=1, val_acc=0.647]
Epoch 24:  68%|██████▊   | 80/117 [00:04<00:01, 19.92it/s, loss=2.4, v_num=1, val_acc=0.647]
Epoch 24:  69%|██████▉   | 81/117 [00:04<00:01, 20.13it/s, loss=2.4, v_num=1, val_acc=0.647]
Epoch 24:  69%|██████▉   | 81/117 [00:04<00:01, 20.00it/s, loss=2.37, v_num=1, val_acc=0.647]
Epoch 24:  70%|███████   | 82/117 [00:04<00:01, 20.07it/s, loss=2.37, v_num=1, val_acc=0.647]
Epoch 24:  70%|███████   | 82/117 [00:04<00:01, 19.98it/s, loss=2.29, v_num=1, val_acc=0.647]
Epoch 24:  71%|███████   | 83/117 [00:04<00:01, 20.15it/s, loss=2.29, v_num=1, val_acc=0.647]
Epoch 24:  71%|███████   | 83/117 [00:04<00:01, 20.04it/s, loss=2.28, v_num=1, val_acc=0.647]
Epoch 24:  72%|███████▏  | 84/117 [00:04<00:01, 20.14it/s, loss=2.28, v_num=1, val_acc=0.647]
Epoch 24:  72%|███████▏  | 84/117 [00:04<00:01, 20.03it/s, loss=2.36, v_num=1, val_acc=0.647]
Epoch 24:  73%|███████▎  | 85/117 [00:04<00:01, 20.21it/s, loss=2.36, v_num=1, val_acc=0.647]
Epoch 24:  73%|███████▎  | 85/117 [00:04<00:01, 20.10it/s, loss=2.38, v_num=1, val_acc=0.647]
Epoch 24:  74%|███████▎  | 86/117 [00:04<00:01, 20.29it/s, loss=2.38, v_num=1, val_acc=0.647]
Epoch 24:  74%|███████▎  | 86/117 [00:04<00:01, 20.18it/s, loss=2.4, v_num=1, val_acc=0.647]
Epoch 24:  74%|███████▍  | 87/117 [00:04<00:01, 20.37it/s, loss=2.4, v_num=1, val_acc=0.647]
Epoch 24:  74%|███████▍  | 87/117 [00:04<00:01, 20.25it/s, loss=2.4, v_num=1, val_acc=0.647]
Epoch 24:  75%|███████▌  | 88/117 [00:04<00:01, 20.43it/s, loss=2.4, v_num=1, val_acc=0.647]
Epoch 24:  75%|███████▌  | 88/117 [00:04<00:01, 20.32it/s, loss=2.35, v_num=1, val_acc=0.647]
Epoch 24:  76%|███████▌  | 89/117 [00:04<00:01, 20.50it/s, loss=2.35, v_num=1, val_acc=0.647]
Epoch 24:  76%|███████▌  | 89/117 [00:04<00:01, 20.38it/s, loss=2.35, v_num=1, val_acc=0.647]
Epoch 24:  77%|███████▋  | 90/117 [00:04<00:01, 20.55it/s, loss=2.35, v_num=1, val_acc=0.647]
Epoch 24:  77%|███████▋  | 90/117 [00:04<00:01, 20.44it/s, loss=2.43, v_num=1, val_acc=0.647]
Epoch 24:  78%|███████▊  | 91/117 [00:04<00:01, 20.62it/s, loss=2.43, v_num=1, val_acc=0.647]
Epoch 24:  78%|███████▊  | 91/117 [00:04<00:01, 20.50it/s, loss=2.44, v_num=1, val_acc=0.647]
Epoch 24:  79%|███████▊  | 92/117 [00:04<00:01, 20.69it/s, loss=2.44, v_num=1, val_acc=0.647]
Epoch 24:  79%|███████▊  | 92/117 [00:04<00:01, 20.57it/s, loss=2.41, v_num=1, val_acc=0.647]
Epoch 24:  79%|███████▉  | 93/117 [00:04<00:01, 20.75it/s, loss=2.41, v_num=1, val_acc=0.647]
Epoch 24:  79%|███████▉  | 93/117 [00:04<00:01, 20.63it/s, loss=2.37, v_num=1, val_acc=0.647]
Epoch 24:  80%|████████  | 94/117 [00:04<00:01, 20.81it/s, loss=2.37, v_num=1, val_acc=0.647]
Epoch 24:  80%|████████  | 94/117 [00:04<00:01, 20.70it/s, loss=2.3, v_num=1, val_acc=0.647]
Epoch 24:  81%|████████  | 95/117 [00:04<00:01, 20.88it/s, loss=2.3, v_num=1, val_acc=0.647]
Epoch 24:  81%|████████  | 95/117 [00:04<00:01, 20.76it/s, loss=2.27, v_num=1, val_acc=0.647]
Epoch 24:  82%|████████▏ | 96/117 [00:04<00:01, 20.94it/s, loss=2.27, v_num=1, val_acc=0.647]
Epoch 24:  82%|████████▏ | 96/117 [00:04<00:01, 20.82it/s, loss=2.32, v_num=1, val_acc=0.647]
Epoch 24:  83%|████████▎ | 97/117 [00:04<00:00, 20.99it/s, loss=2.32, v_num=1, val_acc=0.647]
Epoch 24:  83%|████████▎ | 97/117 [00:04<00:00, 20.88it/s, loss=2.38, v_num=1, val_acc=0.647]

Validation: 0it [00:00, ?it/s]

Validation:   0%|          | 0/20 [00:00<?, ?it/s]

Validation DataLoader 0:   0%|          | 0/20 [00:00<?, ?it/s]

Validation DataLoader 0:   5%|▌         | 1/20 [00:00<00:00, 135.72it/s]
Epoch 24:  84%|████████▍ | 98/117 [00:05<00:01, 17.33it/s, loss=2.38, v_num=1, val_acc=0.647]

Validation DataLoader 0:  10%|█         | 2/20 [00:00<00:00, 52.28it/s]
Epoch 24:  85%|████████▍ | 99/117 [00:05<00:01, 17.42it/s, loss=2.38, v_num=1, val_acc=0.647]

Validation DataLoader 0:  15%|█▌        | 3/20 [00:00<00:00, 42.86it/s]
Epoch 24:  85%|████████▌ | 100/117 [00:05<00:00, 17.50it/s, loss=2.38, v_num=1, val_acc=0.647]

Validation DataLoader 0:  20%|██        | 4/20 [00:00<00:00, 38.90it/s]
Epoch 24:  86%|████████▋ | 101/117 [00:05<00:00, 17.57it/s, loss=2.38, v_num=1, val_acc=0.647]

Validation DataLoader 0:  25%|██▌       | 5/20 [00:00<00:00, 37.03it/s]
Epoch 24:  87%|████████▋ | 102/117 [00:05<00:00, 17.65it/s, loss=2.38, v_num=1, val_acc=0.647]

Validation DataLoader 0:  30%|███       | 6/20 [00:00<00:00, 35.35it/s]
Epoch 24:  88%|████████▊ | 103/117 [00:05<00:00, 17.71it/s, loss=2.38, v_num=1, val_acc=0.647]

Validation DataLoader 0:  35%|███▌      | 7/20 [00:00<00:00, 34.65it/s]
Epoch 24:  89%|████████▉ | 104/117 [00:05<00:00, 17.78it/s, loss=2.38, v_num=1, val_acc=0.647]

Validation DataLoader 0:  40%|████      | 8/20 [00:00<00:00, 34.35it/s]
Epoch 24:  90%|████████▉ | 105/117 [00:05<00:00, 17.86it/s, loss=2.38, v_num=1, val_acc=0.647]

Validation DataLoader 0:  45%|████▌     | 9/20 [00:00<00:00, 34.01it/s]
Epoch 24:  91%|█████████ | 106/117 [00:05<00:00, 17.94it/s, loss=2.38, v_num=1, val_acc=0.647]

Validation DataLoader 0:  50%|█████     | 10/20 [00:00<00:00, 33.76it/s]
Epoch 24:  91%|█████████▏| 107/117 [00:05<00:00, 18.01it/s, loss=2.38, v_num=1, val_acc=0.647]

Validation DataLoader 0:  55%|█████▌    | 11/20 [00:00<00:00, 33.58it/s]
Epoch 24:  92%|█████████▏| 108/117 [00:05<00:00, 18.08it/s, loss=2.38, v_num=1, val_acc=0.647]

Validation DataLoader 0:  60%|██████    | 12/20 [00:00<00:00, 33.41it/s]
Epoch 24:  93%|█████████▎| 109/117 [00:06<00:00, 18.15it/s, loss=2.38, v_num=1, val_acc=0.647]

Validation DataLoader 0:  65%|██████▌   | 13/20 [00:00<00:00, 33.24it/s]
Epoch 24:  94%|█████████▍| 110/117 [00:06<00:00, 18.22it/s, loss=2.38, v_num=1, val_acc=0.647]

Validation DataLoader 0:  70%|███████   | 14/20 [00:00<00:00, 33.13it/s]
Epoch 24:  95%|█████████▍| 111/117 [00:06<00:00, 18.29it/s, loss=2.38, v_num=1, val_acc=0.647]

Validation DataLoader 0:  75%|███████▌  | 15/20 [00:00<00:00, 33.03it/s]
Epoch 24:  96%|█████████▌| 112/117 [00:06<00:00, 18.36it/s, loss=2.38, v_num=1, val_acc=0.647]

Validation DataLoader 0:  80%|████████  | 16/20 [00:00<00:00, 32.94it/s]
Epoch 24:  97%|█████████▋| 113/117 [00:06<00:00, 18.43it/s, loss=2.38, v_num=1, val_acc=0.647]

Validation DataLoader 0:  85%|████████▌ | 17/20 [00:00<00:00, 32.86it/s]
Epoch 24:  97%|█████████▋| 114/117 [00:06<00:00, 18.50it/s, loss=2.38, v_num=1, val_acc=0.647]

Validation DataLoader 0:  90%|█████████ | 18/20 [00:00<00:00, 32.78it/s]
Epoch 24:  98%|█████████▊| 115/117 [00:06<00:00, 18.56it/s, loss=2.38, v_num=1, val_acc=0.647]

Validation DataLoader 0:  95%|█████████▌| 19/20 [00:00<00:00, 32.72it/s]
Epoch 24:  99%|█████████▉| 116/117 [00:06<00:00, 18.63it/s, loss=2.38, v_num=1, val_acc=0.647]

Validation DataLoader 0: 100%|██████████| 20/20 [00:00<00:00, 32.73it/s]
Epoch 24: 100%|██████████| 117/117 [00:06<00:00, 18.70it/s, loss=2.38, v_num=1, val_acc=0.647]
Epoch 24: 100%|██████████| 117/117 [00:06<00:00, 18.64it/s, loss=2.38, v_num=1, val_acc=0.685]


Epoch 24: 100%|██████████| 117/117 [00:06<00:00, 18.64it/s, loss=2.38, v_num=1, val_acc=0.685]
Epoch 24:   0%|          | 0/117 [00:00<?, ?it/s, loss=2.38, v_num=1, val_acc=0.685]
Epoch 25:   0%|          | 0/117 [00:00<?, ?it/s, loss=2.38, v_num=1, val_acc=0.685]
Epoch 25:   1%|          | 1/117 [00:00<01:45,  1.10it/s, loss=2.38, v_num=1, val_acc=0.685]
Epoch 25:   1%|          | 1/117 [00:00<01:47,  1.07it/s, loss=2.37, v_num=1, val_acc=0.685]
Epoch 25:   2%|▏         | 2/117 [00:00<00:54,  2.13it/s, loss=2.37, v_num=1, val_acc=0.685]
Epoch 25:   2%|▏         | 2/117 [00:00<00:55,  2.07it/s, loss=2.34, v_num=1, val_acc=0.685]
Epoch 25:   3%|▎         | 3/117 [00:00<00:37,  3.05it/s, loss=2.34, v_num=1, val_acc=0.685]
Epoch 25:   3%|▎         | 3/117 [00:01<00:38,  2.98it/s, loss=2.27, v_num=1, val_acc=0.685]
Epoch 25:   3%|▎         | 4/117 [00:01<00:28,  3.94it/s, loss=2.27, v_num=1, val_acc=0.685]
Epoch 25:   3%|▎         | 4/117 [00:01<00:29,  3.85it/s, loss=2.25, v_num=1, val_acc=0.685]
Epoch 25:   4%|▍         | 5/117 [00:01<00:23,  4.77it/s, loss=2.25, v_num=1, val_acc=0.685]
Epoch 25:   4%|▍         | 5/117 [00:01<00:24,  4.66it/s, loss=2.25, v_num=1, val_acc=0.685]
Epoch 25:   5%|▌         | 6/117 [00:01<00:20,  5.55it/s, loss=2.25, v_num=1, val_acc=0.685]
Epoch 25:   5%|▌         | 6/117 [00:01<00:20,  5.42it/s, loss=2.26, v_num=1, val_acc=0.685]
Epoch 25:   6%|▌         | 7/117 [00:01<00:17,  6.28it/s, loss=2.26, v_num=1, val_acc=0.685]
Epoch 25:   6%|▌         | 7/117 [00:01<00:17,  6.14it/s, loss=2.16, v_num=1, val_acc=0.685]
Epoch 25:   7%|▋         | 8/117 [00:01<00:15,  6.96it/s, loss=2.16, v_num=1, val_acc=0.685]
Epoch 25:   7%|▋         | 8/117 [00:01<00:15,  6.81it/s, loss=2.2, v_num=1, val_acc=0.685]
Epoch 25:   8%|▊         | 9/117 [00:01<00:14,  7.60it/s, loss=2.2, v_num=1, val_acc=0.685]
Epoch 25:   8%|▊         | 9/117 [00:01<00:14,  7.45it/s, loss=2.18, v_num=1, val_acc=0.685]
Epoch 25:   9%|▊         | 10/117 [00:01<00:13,  8.21it/s, loss=2.18, v_num=1, val_acc=0.685]
Epoch 25:   9%|▊         | 10/117 [00:01<00:13,  8.04it/s, loss=2.18, v_num=1, val_acc=0.685]
Epoch 25:   9%|▉         | 11/117 [00:01<00:12,  8.74it/s, loss=2.18, v_num=1, val_acc=0.685]
Epoch 25:   9%|▉         | 11/117 [00:01<00:12,  8.58it/s, loss=2.14, v_num=1, val_acc=0.685]
Epoch 25:  10%|█         | 12/117 [00:01<00:11,  9.29it/s, loss=2.14, v_num=1, val_acc=0.685]
Epoch 25:  10%|█         | 12/117 [00:01<00:11,  9.12it/s, loss=2.14, v_num=1, val_acc=0.685]
Epoch 25:  11%|█         | 13/117 [00:01<00:10,  9.81it/s, loss=2.14, v_num=1, val_acc=0.685]
Epoch 25:  11%|█         | 13/117 [00:01<00:10,  9.63it/s, loss=2.08, v_num=1, val_acc=0.685]
Epoch 25:  12%|█▏        | 14/117 [00:01<00:09, 10.31it/s, loss=2.08, v_num=1, val_acc=0.685]
Epoch 25:  12%|█▏        | 14/117 [00:01<00:10, 10.12it/s, loss=2.09, v_num=1, val_acc=0.685]
Epoch 25:  13%|█▎        | 15/117 [00:01<00:09, 10.78it/s, loss=2.09, v_num=1, val_acc=0.685]
Epoch 25:  13%|█▎        | 15/117 [00:01<00:09, 10.58it/s, loss=2.19, v_num=1, val_acc=0.685]
Epoch 25:  14%|█▎        | 16/117 [00:01<00:08, 11.22it/s, loss=2.19, v_num=1, val_acc=0.685]
Epoch 25:  14%|█▎        | 16/117 [00:01<00:09, 11.03it/s, loss=2.22, v_num=1, val_acc=0.685]
Epoch 25:  15%|█▍        | 17/117 [00:01<00:08, 11.64it/s, loss=2.22, v_num=1, val_acc=0.685]
Epoch 25:  15%|█▍        | 17/117 [00:01<00:08, 11.44it/s, loss=2.23, v_num=1, val_acc=0.685]
Epoch 25:  15%|█▌        | 18/117 [00:01<00:08, 12.04it/s, loss=2.23, v_num=1, val_acc=0.685]
Epoch 25:  15%|█▌        | 18/117 [00:01<00:08, 11.84it/s, loss=2.23, v_num=1, val_acc=0.685]
Epoch 25:  16%|█▌        | 19/117 [00:01<00:07, 12.40it/s, loss=2.23, v_num=1, val_acc=0.685]
Epoch 25:  16%|█▌        | 19/117 [00:01<00:08, 12.20it/s, loss=2.21, v_num=1, val_acc=0.685]
Epoch 25:  17%|█▋        | 20/117 [00:01<00:07, 12.77it/s, loss=2.21, v_num=1, val_acc=0.685]
Epoch 25:  17%|█▋        | 20/117 [00:01<00:07, 12.57it/s, loss=2.18, v_num=1, val_acc=0.685]
Epoch 25:  18%|█▊        | 21/117 [00:01<00:07, 13.13it/s, loss=2.18, v_num=1, val_acc=0.685]
Epoch 25:  18%|█▊        | 21/117 [00:01<00:07, 12.92it/s, loss=2.19, v_num=1, val_acc=0.685]
Epoch 25:  19%|█▉        | 22/117 [00:01<00:07, 13.46it/s, loss=2.19, v_num=1, val_acc=0.685]
Epoch 25:  19%|█▉        | 22/117 [00:01<00:07, 13.26it/s, loss=2.18, v_num=1, val_acc=0.685]
Epoch 25:  20%|█▉        | 23/117 [00:01<00:06, 13.79it/s, loss=2.18, v_num=1, val_acc=0.685]
Epoch 25:  20%|█▉        | 23/117 [00:01<00:06, 13.58it/s, loss=2.21, v_num=1, val_acc=0.685]
Epoch 25:  21%|██        | 24/117 [00:01<00:06, 14.09it/s, loss=2.21, v_num=1, val_acc=0.685]
Epoch 25:  21%|██        | 24/117 [00:01<00:06, 13.89it/s, loss=2.18, v_num=1, val_acc=0.685]
Epoch 25:  21%|██▏       | 25/117 [00:01<00:06, 14.37it/s, loss=2.18, v_num=1, val_acc=0.685]
Epoch 25:  21%|██▏       | 25/117 [00:01<00:06, 14.17it/s, loss=2.13, v_num=1, val_acc=0.685]
Epoch 25:  22%|██▏       | 26/117 [00:01<00:06, 14.62it/s, loss=2.13, v_num=1, val_acc=0.685]
Epoch 25:  22%|██▏       | 26/117 [00:01<00:06, 14.42it/s, loss=2.11, v_num=1, val_acc=0.685]
Epoch 25:  23%|██▎       | 27/117 [00:01<00:06, 14.86it/s, loss=2.11, v_num=1, val_acc=0.685]
Epoch 25:  23%|██▎       | 27/117 [00:01<00:06, 14.67it/s, loss=2.11, v_num=1, val_acc=0.685]
Epoch 25:  24%|██▍       | 28/117 [00:01<00:05, 15.09it/s, loss=2.11, v_num=1, val_acc=0.685]
Epoch 25:  24%|██▍       | 28/117 [00:01<00:05, 14.91it/s, loss=2.1, v_num=1, val_acc=0.685]
Epoch 25:  25%|██▍       | 29/117 [00:01<00:05, 15.36it/s, loss=2.1, v_num=1, val_acc=0.685]
Epoch 25:  25%|██▍       | 29/117 [00:01<00:05, 15.16it/s, loss=2.18, v_num=1, val_acc=0.685]
Epoch 25:  26%|██▌       | 30/117 [00:01<00:05, 15.61it/s, loss=2.18, v_num=1, val_acc=0.685]
Epoch 25:  26%|██▌       | 30/117 [00:01<00:05, 15.41it/s, loss=2.19, v_num=1, val_acc=0.685]
Epoch 25:  26%|██▋       | 31/117 [00:01<00:05, 15.84it/s, loss=2.19, v_num=1, val_acc=0.685]
Epoch 25:  26%|██▋       | 31/117 [00:01<00:05, 15.64it/s, loss=2.23, v_num=1, val_acc=0.685]
Epoch 25:  27%|██▋       | 32/117 [00:01<00:05, 16.06it/s, loss=2.23, v_num=1, val_acc=0.685]
Epoch 25:  27%|██▋       | 32/117 [00:02<00:05, 15.86it/s, loss=2.22, v_num=1, val_acc=0.685]
Epoch 25:  28%|██▊       | 33/117 [00:02<00:05, 16.28it/s, loss=2.22, v_num=1, val_acc=0.685]
Epoch 25:  28%|██▊       | 33/117 [00:02<00:05, 16.08it/s, loss=2.24, v_num=1, val_acc=0.685]
Epoch 25:  29%|██▉       | 34/117 [00:02<00:05, 16.48it/s, loss=2.24, v_num=1, val_acc=0.685]
Epoch 25:  29%|██▉       | 34/117 [00:02<00:05, 16.29it/s, loss=2.24, v_num=1, val_acc=0.685]
Epoch 25:  30%|██▉       | 35/117 [00:02<00:04, 16.68it/s, loss=2.24, v_num=1, val_acc=0.685]
Epoch 25:  30%|██▉       | 35/117 [00:02<00:04, 16.49it/s, loss=2.22, v_num=1, val_acc=0.685]
Epoch 25:  31%|███       | 36/117 [00:02<00:04, 16.89it/s, loss=2.22, v_num=1, val_acc=0.685]
Epoch 25:  31%|███       | 36/117 [00:02<00:04, 16.69it/s, loss=2.26, v_num=1, val_acc=0.685]
Epoch 25:  32%|███▏      | 37/117 [00:02<00:04, 17.08it/s, loss=2.26, v_num=1, val_acc=0.685]
Epoch 25:  32%|███▏      | 37/117 [00:02<00:04, 16.88it/s, loss=2.3, v_num=1, val_acc=0.685]
Epoch 25:  32%|███▏      | 38/117 [00:02<00:04, 17.26it/s, loss=2.3, v_num=1, val_acc=0.685]
Epoch 25:  32%|███▏      | 38/117 [00:02<00:04, 17.06it/s, loss=2.38, v_num=1, val_acc=0.685]
Epoch 25:  33%|███▎      | 39/117 [00:02<00:04, 17.43it/s, loss=2.38, v_num=1, val_acc=0.685]
Epoch 25:  33%|███▎      | 39/117 [00:02<00:04, 17.24it/s, loss=2.48, v_num=1, val_acc=0.685]
Epoch 25:  34%|███▍      | 40/117 [00:02<00:04, 17.60it/s, loss=2.48, v_num=1, val_acc=0.685]
Epoch 25:  34%|███▍      | 40/117 [00:02<00:04, 17.41it/s, loss=2.55, v_num=1, val_acc=0.685]
Epoch 25:  35%|███▌      | 41/117 [00:02<00:04, 17.77it/s, loss=2.55, v_num=1, val_acc=0.685]
Epoch 25:  35%|███▌      | 41/117 [00:02<00:04, 17.58it/s, loss=2.51, v_num=1, val_acc=0.685]
Epoch 25:  36%|███▌      | 42/117 [00:02<00:04, 17.94it/s, loss=2.51, v_num=1, val_acc=0.685]
Epoch 25:  36%|███▌      | 42/117 [00:02<00:04, 17.75it/s, loss=2.57, v_num=1, val_acc=0.685]
Epoch 25:  37%|███▋      | 43/117 [00:02<00:04, 18.10it/s, loss=2.57, v_num=1, val_acc=0.685]
Epoch 25:  37%|███▋      | 43/117 [00:02<00:04, 17.91it/s, loss=2.55, v_num=1, val_acc=0.685]
Epoch 25:  38%|███▊      | 44/117 [00:02<00:03, 18.26it/s, loss=2.55, v_num=1, val_acc=0.685]
Epoch 25:  38%|███▊      | 44/117 [00:02<00:04, 18.07it/s, loss=2.55, v_num=1, val_acc=0.685]
Epoch 25:  38%|███▊      | 45/117 [00:02<00:03, 18.41it/s, loss=2.55, v_num=1, val_acc=0.685]
Epoch 25:  38%|███▊      | 45/117 [00:02<00:03, 18.22it/s, loss=2.55, v_num=1, val_acc=0.685]
Epoch 25:  39%|███▉      | 46/117 [00:02<00:03, 18.56it/s, loss=2.55, v_num=1, val_acc=0.685]
Epoch 25:  39%|███▉      | 46/117 [00:02<00:03, 18.37it/s, loss=2.53, v_num=1, val_acc=0.685]
Epoch 25:  40%|████      | 47/117 [00:02<00:03, 18.70it/s, loss=2.53, v_num=1, val_acc=0.685]
Epoch 25:  40%|████      | 47/117 [00:02<00:03, 18.52it/s, loss=2.49, v_num=1, val_acc=0.685]
Epoch 25:  41%|████      | 48/117 [00:02<00:03, 18.84it/s, loss=2.49, v_num=1, val_acc=0.685]
Epoch 25:  41%|████      | 48/117 [00:02<00:03, 18.66it/s, loss=2.47, v_num=1, val_acc=0.685]
Epoch 25:  42%|████▏     | 49/117 [00:02<00:03, 18.98it/s, loss=2.47, v_num=1, val_acc=0.685]
Epoch 25:  42%|████▏     | 49/117 [00:02<00:03, 18.79it/s, loss=2.4, v_num=1, val_acc=0.685]
Epoch 25:  43%|████▎     | 50/117 [00:02<00:03, 19.11it/s, loss=2.4, v_num=1, val_acc=0.685]
Epoch 25:  43%|████▎     | 50/117 [00:02<00:03, 18.93it/s, loss=2.44, v_num=1, val_acc=0.685]
Epoch 25:  44%|████▎     | 51/117 [00:02<00:03, 19.24it/s, loss=2.44, v_num=1, val_acc=0.685]
Epoch 25:  44%|████▎     | 51/117 [00:02<00:03, 19.06it/s, loss=2.43, v_num=1, val_acc=0.685]
Epoch 25:  44%|████▍     | 52/117 [00:02<00:03, 19.37it/s, loss=2.43, v_num=1, val_acc=0.685]
Epoch 25:  44%|████▍     | 52/117 [00:02<00:03, 19.19it/s, loss=2.48, v_num=1, val_acc=0.685]
Epoch 25:  45%|████▌     | 53/117 [00:02<00:03, 19.49it/s, loss=2.48, v_num=1, val_acc=0.685]
Epoch 25:  45%|████▌     | 53/117 [00:02<00:03, 19.31it/s, loss=2.45, v_num=1, val_acc=0.685]
Epoch 25:  46%|████▌     | 54/117 [00:02<00:03, 19.61it/s, loss=2.45, v_num=1, val_acc=0.685]
Epoch 25:  46%|████▌     | 54/117 [00:02<00:03, 19.43it/s, loss=2.43, v_num=1, val_acc=0.685]
Epoch 25:  47%|████▋     | 55/117 [00:02<00:03, 19.73it/s, loss=2.43, v_num=1, val_acc=0.685]
Epoch 25:  47%|████▋     | 55/117 [00:02<00:03, 19.55it/s, loss=2.37, v_num=1, val_acc=0.685]
Epoch 25:  48%|████▊     | 56/117 [00:02<00:03, 19.85it/s, loss=2.37, v_num=1, val_acc=0.685]
Epoch 25:  48%|████▊     | 56/117 [00:02<00:03, 19.67it/s, loss=2.35, v_num=1, val_acc=0.685]
Epoch 25:  49%|████▊     | 57/117 [00:02<00:03, 19.95it/s, loss=2.35, v_num=1, val_acc=0.685]
Epoch 25:  49%|████▊     | 57/117 [00:02<00:03, 19.78it/s, loss=2.36, v_num=1, val_acc=0.685]
Epoch 25:  50%|████▉     | 58/117 [00:02<00:02, 20.06it/s, loss=2.36, v_num=1, val_acc=0.685]
Epoch 25:  50%|████▉     | 58/117 [00:02<00:02, 19.89it/s, loss=2.34, v_num=1, val_acc=0.685]
Epoch 25:  50%|█████     | 59/117 [00:02<00:02, 20.17it/s, loss=2.34, v_num=1, val_acc=0.685]
Epoch 25:  50%|█████     | 59/117 [00:02<00:02, 20.00it/s, loss=2.25, v_num=1, val_acc=0.685]
Epoch 25:  51%|█████▏    | 60/117 [00:02<00:02, 20.28it/s, loss=2.25, v_num=1, val_acc=0.685]
Epoch 25:  51%|█████▏    | 60/117 [00:02<00:02, 20.10it/s, loss=2.15, v_num=1, val_acc=0.685]
Epoch 25:  52%|█████▏    | 61/117 [00:02<00:02, 20.38it/s, loss=2.15, v_num=1, val_acc=0.685]
Epoch 25:  52%|█████▏    | 61/117 [00:03<00:02, 20.21it/s, loss=2.15, v_num=1, val_acc=0.685]
Epoch 25:  53%|█████▎    | 62/117 [00:03<00:02, 20.47it/s, loss=2.15, v_num=1, val_acc=0.685]
Epoch 25:  53%|█████▎    | 62/117 [00:03<00:02, 20.30it/s, loss=2.12, v_num=1, val_acc=0.685]
Epoch 25:  54%|█████▍    | 63/117 [00:03<00:02, 20.57it/s, loss=2.12, v_num=1, val_acc=0.685]
Epoch 25:  54%|█████▍    | 63/117 [00:03<00:02, 20.40it/s, loss=2.17, v_num=1, val_acc=0.685]
Epoch 25:  55%|█████▍    | 64/117 [00:03<00:02, 20.67it/s, loss=2.17, v_num=1, val_acc=0.685]
Epoch 25:  55%|█████▍    | 64/117 [00:03<00:02, 20.50it/s, loss=2.21, v_num=1, val_acc=0.685]
Epoch 25:  56%|█████▌    | 65/117 [00:03<00:02, 20.76it/s, loss=2.21, v_num=1, val_acc=0.685]
Epoch 25:  56%|█████▌    | 65/117 [00:03<00:02, 20.59it/s, loss=2.25, v_num=1, val_acc=0.685]
Epoch 25:  56%|█████▋    | 66/117 [00:03<00:02, 20.85it/s, loss=2.25, v_num=1, val_acc=0.685]
Epoch 25:  56%|█████▋    | 66/117 [00:03<00:02, 20.69it/s, loss=2.26, v_num=1, val_acc=0.685]
Epoch 25:  57%|█████▋    | 67/117 [00:03<00:02, 20.94it/s, loss=2.26, v_num=1, val_acc=0.685]
Epoch 25:  57%|█████▋    | 67/117 [00:03<00:02, 20.78it/s, loss=2.28, v_num=1, val_acc=0.685]
Epoch 25:  58%|█████▊    | 68/117 [00:03<00:02, 21.03it/s, loss=2.28, v_num=1, val_acc=0.685]
Epoch 25:  58%|█████▊    | 68/117 [00:03<00:02, 20.87it/s, loss=2.28, v_num=1, val_acc=0.685]
Epoch 25:  59%|█████▉    | 69/117 [00:03<00:02, 21.11it/s, loss=2.28, v_num=1, val_acc=0.685]
Epoch 25:  59%|█████▉    | 69/117 [00:03<00:02, 20.95it/s, loss=2.28, v_num=1, val_acc=0.685]
Epoch 25:  60%|█████▉    | 70/117 [00:03<00:02, 21.19it/s, loss=2.28, v_num=1, val_acc=0.685]
Epoch 25:  60%|█████▉    | 70/117 [00:03<00:02, 21.03it/s, loss=2.21, v_num=1, val_acc=0.685]
Epoch 25:  61%|██████    | 71/117 [00:03<00:02, 21.28it/s, loss=2.21, v_num=1, val_acc=0.685]
Epoch 25:  61%|██████    | 71/117 [00:03<00:02, 21.12it/s, loss=2.22, v_num=1, val_acc=0.685]
Epoch 25:  62%|██████▏   | 72/117 [00:03<00:02, 21.36it/s, loss=2.22, v_num=1, val_acc=0.685]
Epoch 25:  62%|██████▏   | 72/117 [00:03<00:02, 21.20it/s, loss=2.2, v_num=1, val_acc=0.685]
Epoch 25:  62%|██████▏   | 73/117 [00:03<00:02, 21.44it/s, loss=2.2, v_num=1, val_acc=0.685]
Epoch 25:  62%|██████▏   | 73/117 [00:03<00:02, 21.28it/s, loss=2.27, v_num=1, val_acc=0.685]
Epoch 25:  63%|██████▎   | 74/117 [00:03<00:01, 21.51it/s, loss=2.27, v_num=1, val_acc=0.685]
Epoch 25:  63%|██████▎   | 74/117 [00:03<00:02, 21.36it/s, loss=2.29, v_num=1, val_acc=0.685]
Epoch 25:  64%|██████▍   | 75/117 [00:03<00:01, 21.56it/s, loss=2.29, v_num=1, val_acc=0.685]
Epoch 25:  64%|██████▍   | 75/117 [00:03<00:01, 21.42it/s, loss=2.31, v_num=1, val_acc=0.685]
Epoch 25:  65%|██████▍   | 76/117 [00:03<00:01, 21.64it/s, loss=2.31, v_num=1, val_acc=0.685]
Epoch 25:  65%|██████▍   | 76/117 [00:03<00:01, 21.49it/s, loss=2.32, v_num=1, val_acc=0.685]
Epoch 25:  66%|██████▌   | 77/117 [00:03<00:01, 21.71it/s, loss=2.32, v_num=1, val_acc=0.685]
Epoch 25:  66%|██████▌   | 77/117 [00:03<00:01, 21.56it/s, loss=2.3, v_num=1, val_acc=0.685]
Epoch 25:  67%|██████▋   | 78/117 [00:03<00:01, 21.78it/s, loss=2.3, v_num=1, val_acc=0.685]
Epoch 25:  67%|██████▋   | 78/117 [00:03<00:01, 21.63it/s, loss=2.28, v_num=1, val_acc=0.685]
Epoch 25:  68%|██████▊   | 79/117 [00:03<00:01, 21.85it/s, loss=2.28, v_num=1, val_acc=0.685]
Epoch 25:  68%|██████▊   | 79/117 [00:03<00:01, 21.70it/s, loss=2.25, v_num=1, val_acc=0.685]
Epoch 25:  68%|██████▊   | 80/117 [00:03<00:01, 21.92it/s, loss=2.25, v_num=1, val_acc=0.685]
Epoch 25:  68%|██████▊   | 80/117 [00:03<00:01, 21.77it/s, loss=2.22, v_num=1, val_acc=0.685]
Epoch 25:  69%|██████▉   | 81/117 [00:03<00:01, 21.95it/s, loss=2.22, v_num=1, val_acc=0.685]
Epoch 25:  69%|██████▉   | 81/117 [00:03<00:01, 21.82it/s, loss=2.17, v_num=1, val_acc=0.685]
Epoch 25:  70%|███████   | 82/117 [00:03<00:01, 22.01it/s, loss=2.17, v_num=1, val_acc=0.685]
Epoch 25:  70%|███████   | 82/117 [00:03<00:01, 21.87it/s, loss=2.13, v_num=1, val_acc=0.685]
Epoch 25:  71%|███████   | 83/117 [00:03<00:01, 22.08it/s, loss=2.13, v_num=1, val_acc=0.685]
Epoch 25:  71%|███████   | 83/117 [00:03<00:01, 21.93it/s, loss=2.11, v_num=1, val_acc=0.685]
Epoch 25:  72%|███████▏  | 84/117 [00:03<00:01, 22.15it/s, loss=2.11, v_num=1, val_acc=0.685]
Epoch 25:  72%|███████▏  | 84/117 [00:03<00:01, 22.00it/s, loss=2.09, v_num=1, val_acc=0.685]
Epoch 25:  73%|███████▎  | 85/117 [00:03<00:01, 22.21it/s, loss=2.09, v_num=1, val_acc=0.685]
Epoch 25:  73%|███████▎  | 85/117 [00:03<00:01, 22.06it/s, loss=2.08, v_num=1, val_acc=0.685]
Epoch 25:  74%|███████▎  | 86/117 [00:03<00:01, 22.27it/s, loss=2.08, v_num=1, val_acc=0.685]
Epoch 25:  74%|███████▎  | 86/117 [00:03<00:01, 22.13it/s, loss=2.13, v_num=1, val_acc=0.685]
Epoch 25:  74%|███████▍  | 87/117 [00:03<00:01, 22.34it/s, loss=2.13, v_num=1, val_acc=0.685]
Epoch 25:  74%|███████▍  | 87/117 [00:03<00:01, 22.19it/s, loss=2.14, v_num=1, val_acc=0.685]
Epoch 25:  75%|███████▌  | 88/117 [00:03<00:01, 22.40it/s, loss=2.14, v_num=1, val_acc=0.685]
Epoch 25:  75%|███████▌  | 88/117 [00:03<00:01, 22.25it/s, loss=2.16, v_num=1, val_acc=0.685]
Epoch 25:  76%|███████▌  | 89/117 [00:03<00:01, 22.46it/s, loss=2.16, v_num=1, val_acc=0.685]
Epoch 25:  76%|███████▌  | 89/117 [00:03<00:01, 22.31it/s, loss=2.19, v_num=1, val_acc=0.685]
Epoch 25:  77%|███████▋  | 90/117 [00:03<00:01, 22.52it/s, loss=2.19, v_num=1, val_acc=0.685]
Epoch 25:  77%|███████▋  | 90/117 [00:04<00:01, 22.37it/s, loss=2.29, v_num=1, val_acc=0.685]
Epoch 25:  78%|███████▊  | 91/117 [00:04<00:01, 22.57it/s, loss=2.29, v_num=1, val_acc=0.685]
Epoch 25:  78%|███████▊  | 91/117 [00:04<00:01, 22.43it/s, loss=2.3, v_num=1, val_acc=0.685]
Epoch 25:  79%|███████▊  | 92/117 [00:04<00:01, 22.63it/s, loss=2.3, v_num=1, val_acc=0.685]
Epoch 25:  79%|███████▊  | 92/117 [00:04<00:01, 22.49it/s, loss=2.37, v_num=1, val_acc=0.685]
Epoch 25:  79%|███████▉  | 93/117 [00:04<00:01, 22.68it/s, loss=2.37, v_num=1, val_acc=0.685]
Epoch 25:  79%|███████▉  | 93/117 [00:04<00:01, 22.54it/s, loss=2.34, v_num=1, val_acc=0.685]
Epoch 25:  80%|████████  | 94/117 [00:04<00:01, 22.74it/s, loss=2.34, v_num=1, val_acc=0.685]
Epoch 25:  80%|████████  | 94/117 [00:04<00:01, 22.60it/s, loss=2.32, v_num=1, val_acc=0.685]
Epoch 25:  81%|████████  | 95/117 [00:04<00:00, 22.79it/s, loss=2.32, v_num=1, val_acc=0.685]
Epoch 25:  81%|████████  | 95/117 [00:04<00:00, 22.65it/s, loss=2.29, v_num=1, val_acc=0.685]
Epoch 25:  82%|████████▏ | 96/117 [00:04<00:00, 22.84it/s, loss=2.29, v_num=1, val_acc=0.685]
Epoch 25:  82%|████████▏ | 96/117 [00:04<00:00, 22.71it/s, loss=2.25, v_num=1, val_acc=0.685]
Epoch 25:  83%|████████▎ | 97/117 [00:04<00:00, 22.89it/s, loss=2.25, v_num=1, val_acc=0.685]
Epoch 25:  83%|████████▎ | 97/117 [00:04<00:00, 22.76it/s, loss=2.22, v_num=1, val_acc=0.685]

Validation: 0it [00:00, ?it/s]

Validation:   0%|          | 0/20 [00:00<?, ?it/s]

Validation DataLoader 0:   0%|          | 0/20 [00:00<?, ?it/s]

Validation DataLoader 0:   5%|▌         | 1/20 [00:00<00:00, 160.68it/s]
Epoch 25:  84%|████████▍ | 98/117 [00:05<00:00, 19.24it/s, loss=2.22, v_num=1, val_acc=0.685]

Validation DataLoader 0:  10%|█         | 2/20 [00:00<00:00, 54.96it/s]
Epoch 25:  85%|████████▍ | 99/117 [00:05<00:00, 19.32it/s, loss=2.22, v_num=1, val_acc=0.685]

Validation DataLoader 0:  15%|█▌        | 3/20 [00:00<00:00, 44.18it/s]
Epoch 25:  85%|████████▌ | 100/117 [00:05<00:00, 19.39it/s, loss=2.22, v_num=1, val_acc=0.685]

Validation DataLoader 0:  20%|██        | 4/20 [00:00<00:00, 40.15it/s]
Epoch 25:  86%|████████▋ | 101/117 [00:05<00:00, 19.47it/s, loss=2.22, v_num=1, val_acc=0.685]

Validation DataLoader 0:  25%|██▌       | 5/20 [00:00<00:00, 37.80it/s]
Epoch 25:  87%|████████▋ | 102/117 [00:05<00:00, 19.54it/s, loss=2.22, v_num=1, val_acc=0.685]

Validation DataLoader 0:  30%|███       | 6/20 [00:00<00:00, 36.50it/s]
Epoch 25:  88%|████████▊ | 103/117 [00:05<00:00, 19.61it/s, loss=2.22, v_num=1, val_acc=0.685]

Validation DataLoader 0:  35%|███▌      | 7/20 [00:00<00:00, 35.80it/s]
Epoch 25:  89%|████████▉ | 104/117 [00:05<00:00, 19.68it/s, loss=2.22, v_num=1, val_acc=0.685]

Validation DataLoader 0:  40%|████      | 8/20 [00:00<00:00, 34.92it/s]
Epoch 25:  90%|████████▉ | 105/117 [00:05<00:00, 19.75it/s, loss=2.22, v_num=1, val_acc=0.685]

Validation DataLoader 0:  45%|████▌     | 9/20 [00:00<00:00, 34.35it/s]
Epoch 25:  91%|█████████ | 106/117 [00:05<00:00, 19.81it/s, loss=2.22, v_num=1, val_acc=0.685]

Validation DataLoader 0:  50%|█████     | 10/20 [00:00<00:00, 34.16it/s]
Epoch 25:  91%|█████████▏| 107/117 [00:05<00:00, 19.88it/s, loss=2.22, v_num=1, val_acc=0.685]

Validation DataLoader 0:  55%|█████▌    | 11/20 [00:00<00:00, 33.93it/s]
Epoch 25:  92%|█████████▏| 108/117 [00:05<00:00, 19.95it/s, loss=2.22, v_num=1, val_acc=0.685]

Validation DataLoader 0:  60%|██████    | 12/20 [00:00<00:00, 33.75it/s]
Epoch 25:  93%|█████████▎| 109/117 [00:05<00:00, 20.02it/s, loss=2.22, v_num=1, val_acc=0.685]

Validation DataLoader 0:  65%|██████▌   | 13/20 [00:00<00:00, 33.38it/s]
Epoch 25:  94%|█████████▍| 110/117 [00:05<00:00, 20.08it/s, loss=2.22, v_num=1, val_acc=0.685]

Validation DataLoader 0:  70%|███████   | 14/20 [00:00<00:00, 33.28it/s]
Epoch 25:  95%|█████████▍| 111/117 [00:05<00:00, 20.15it/s, loss=2.22, v_num=1, val_acc=0.685]

Validation DataLoader 0:  75%|███████▌  | 15/20 [00:00<00:00, 33.18it/s]
Epoch 25:  96%|█████████▌| 112/117 [00:05<00:00, 20.21it/s, loss=2.22, v_num=1, val_acc=0.685]

Validation DataLoader 0:  80%|████████  | 16/20 [00:00<00:00, 33.07it/s]
Epoch 25:  97%|█████████▋| 113/117 [00:05<00:00, 20.28it/s, loss=2.22, v_num=1, val_acc=0.685]

Validation DataLoader 0:  85%|████████▌ | 17/20 [00:00<00:00, 32.97it/s]
Epoch 25:  97%|█████████▋| 114/117 [00:05<00:00, 20.34it/s, loss=2.22, v_num=1, val_acc=0.685]

Validation DataLoader 0:  90%|█████████ | 18/20 [00:00<00:00, 32.90it/s]
Epoch 25:  98%|█████████▊| 115/117 [00:05<00:00, 20.41it/s, loss=2.22, v_num=1, val_acc=0.685]

Validation DataLoader 0:  95%|█████████▌| 19/20 [00:00<00:00, 32.84it/s]
Epoch 25:  99%|█████████▉| 116/117 [00:05<00:00, 20.47it/s, loss=2.22, v_num=1, val_acc=0.685]

Validation DataLoader 0: 100%|██████████| 20/20 [00:00<00:00, 32.85it/s]
Epoch 25: 100%|██████████| 117/117 [00:05<00:00, 20.54it/s, loss=2.22, v_num=1, val_acc=0.685]
Epoch 25: 100%|██████████| 117/117 [00:05<00:00, 20.46it/s, loss=2.22, v_num=1, val_acc=0.731]


Epoch 25: 100%|██████████| 117/117 [00:05<00:00, 20.46it/s, loss=2.22, v_num=1, val_acc=0.731]
Epoch 25:   0%|          | 0/117 [00:00<?, ?it/s, loss=2.22, v_num=1, val_acc=0.731]
Epoch 26:   0%|          | 0/117 [00:00<?, ?it/s, loss=2.22, v_num=1, val_acc=0.731]
Epoch 26:   1%|          | 1/117 [00:00<01:43,  1.12it/s, loss=2.22, v_num=1, val_acc=0.731]
Epoch 26:   1%|          | 1/117 [00:00<01:46,  1.09it/s, loss=2.19, v_num=1, val_acc=0.731]
Epoch 26:   2%|▏         | 2/117 [00:00<00:53,  2.15it/s, loss=2.19, v_num=1, val_acc=0.731]
Epoch 26:   2%|▏         | 2/117 [00:00<00:54,  2.10it/s, loss=2.17, v_num=1, val_acc=0.731]
Epoch 26:   3%|▎         | 3/117 [00:00<00:36,  3.09it/s, loss=2.17, v_num=1, val_acc=0.731]
Epoch 26:   3%|▎         | 3/117 [00:00<00:37,  3.02it/s, loss=2.21, v_num=1, val_acc=0.731]
Epoch 26:   3%|▎         | 4/117 [00:01<00:28,  3.99it/s, loss=2.21, v_num=1, val_acc=0.731]
Epoch 26:   3%|▎         | 4/117 [00:01<00:29,  3.89it/s, loss=2.27, v_num=1, val_acc=0.731]
Epoch 26:   4%|▍         | 5/117 [00:01<00:23,  4.82it/s, loss=2.27, v_num=1, val_acc=0.731]
Epoch 26:   4%|▍         | 5/117 [00:01<00:23,  4.71it/s, loss=2.3, v_num=1, val_acc=0.731]
Epoch 26:   5%|▌         | 6/117 [00:01<00:19,  5.60it/s, loss=2.3, v_num=1, val_acc=0.731]
Epoch 26:   5%|▌         | 6/117 [00:01<00:20,  5.47it/s, loss=2.29, v_num=1, val_acc=0.731]
Epoch 26:   6%|▌         | 7/117 [00:01<00:17,  6.33it/s, loss=2.29, v_num=1, val_acc=0.731]
Epoch 26:   6%|▌         | 7/117 [00:01<00:17,  6.19it/s, loss=2.3, v_num=1, val_acc=0.731]
Epoch 26:   7%|▋         | 8/117 [00:01<00:15,  7.02it/s, loss=2.3, v_num=1, val_acc=0.731]
Epoch 26:   7%|▋         | 8/117 [00:01<00:15,  6.87it/s, loss=2.38, v_num=1, val_acc=0.731]
Epoch 26:   8%|▊         | 9/117 [00:01<00:14,  7.65it/s, loss=2.38, v_num=1, val_acc=0.731]
Epoch 26:   8%|▊         | 9/117 [00:01<00:14,  7.50it/s, loss=2.35, v_num=1, val_acc=0.731]
Epoch 26:   9%|▊         | 10/117 [00:01<00:12,  8.26it/s, loss=2.35, v_num=1, val_acc=0.731]
Epoch 26:   9%|▊         | 10/117 [00:01<00:13,  8.10it/s, loss=2.34, v_num=1, val_acc=0.731]
Epoch 26:   9%|▉         | 11/117 [00:01<00:12,  8.82it/s, loss=2.34, v_num=1, val_acc=0.731]
Epoch 26:   9%|▉         | 11/117 [00:01<00:12,  8.65it/s, loss=2.34, v_num=1, val_acc=0.731]
Epoch 26:  10%|█         | 12/117 [00:01<00:11,  9.37it/s, loss=2.34, v_num=1, val_acc=0.731]
Epoch 26:  10%|█         | 12/117 [00:01<00:11,  9.19it/s, loss=2.3, v_num=1, val_acc=0.731]
Epoch 26:  11%|█         | 13/117 [00:01<00:10,  9.89it/s, loss=2.3, v_num=1, val_acc=0.731]
Epoch 26:  11%|█         | 13/117 [00:01<00:10,  9.70it/s, loss=2.16, v_num=1, val_acc=0.731]
Epoch 26:  12%|█▏        | 14/117 [00:01<00:09, 10.38it/s, loss=2.16, v_num=1, val_acc=0.731]
Epoch 26:  12%|█▏        | 14/117 [00:01<00:10, 10.19it/s, loss=2.1, v_num=1, val_acc=0.731]
Epoch 26:  13%|█▎        | 15/117 [00:01<00:09, 10.84it/s, loss=2.1, v_num=1, val_acc=0.731]
Epoch 26:  13%|█▎        | 15/117 [00:01<00:09, 10.65it/s, loss=1.98, v_num=1, val_acc=0.731]
Epoch 26:  14%|█▎        | 16/117 [00:01<00:08, 11.29it/s, loss=1.98, v_num=1, val_acc=0.731]
Epoch 26:  14%|█▎        | 16/117 [00:01<00:09, 11.09it/s, loss=1.93, v_num=1, val_acc=0.731]
Epoch 26:  15%|█▍        | 17/117 [00:01<00:08, 11.70it/s, loss=1.93, v_num=1, val_acc=0.731]
Epoch 26:  15%|█▍        | 17/117 [00:01<00:08, 11.50it/s, loss=1.91, v_num=1, val_acc=0.731]
Epoch 26:  15%|█▌        | 18/117 [00:01<00:08, 12.11it/s, loss=1.91, v_num=1, val_acc=0.731]
Epoch 26:  15%|█▌        | 18/117 [00:01<00:08, 11.91it/s, loss=2.01, v_num=1, val_acc=0.731]
Epoch 26:  16%|█▌        | 19/117 [00:01<00:07, 12.49it/s, loss=2.01, v_num=1, val_acc=0.731]
Epoch 26:  16%|█▌        | 19/117 [00:01<00:07, 12.28it/s, loss=2.06, v_num=1, val_acc=0.731]
Epoch 26:  17%|█▋        | 20/117 [00:01<00:07, 12.86it/s, loss=2.06, v_num=1, val_acc=0.731]
Epoch 26:  17%|█▋        | 20/117 [00:01<00:07, 12.65it/s, loss=2.11, v_num=1, val_acc=0.731]
Epoch 26:  18%|█▊        | 21/117 [00:01<00:07, 13.22it/s, loss=2.11, v_num=1, val_acc=0.731]
Epoch 26:  18%|█▊        | 21/117 [00:01<00:07, 13.01it/s, loss=2.21, v_num=1, val_acc=0.731]
Epoch 26:  19%|█▉        | 22/117 [00:01<00:07, 13.56it/s, loss=2.21, v_num=1, val_acc=0.731]
Epoch 26:  19%|█▉        | 22/117 [00:01<00:07, 13.35it/s, loss=2.29, v_num=1, val_acc=0.731]
Epoch 26:  20%|█▉        | 23/117 [00:01<00:06, 13.88it/s, loss=2.29, v_num=1, val_acc=0.731]
Epoch 26:  20%|█▉        | 23/117 [00:01<00:06, 13.67it/s, loss=2.38, v_num=1, val_acc=0.731]
Epoch 26:  21%|██        | 24/117 [00:01<00:06, 14.19it/s, loss=2.38, v_num=1, val_acc=0.731]
Epoch 26:  21%|██        | 24/117 [00:01<00:06, 13.98it/s, loss=2.41, v_num=1, val_acc=0.731]
Epoch 26:  21%|██▏       | 25/117 [00:01<00:06, 14.49it/s, loss=2.41, v_num=1, val_acc=0.731]
Epoch 26:  21%|██▏       | 25/117 [00:01<00:06, 14.28it/s, loss=2.49, v_num=1, val_acc=0.731]
Epoch 26:  22%|██▏       | 26/117 [00:01<00:06, 14.78it/s, loss=2.49, v_num=1, val_acc=0.731]
Epoch 26:  22%|██▏       | 26/117 [00:01<00:06, 14.57it/s, loss=2.54, v_num=1, val_acc=0.731]
Epoch 26:  23%|██▎       | 27/117 [00:01<00:05, 15.05it/s, loss=2.54, v_num=1, val_acc=0.731]
Epoch 26:  23%|██▎       | 27/117 [00:01<00:06, 14.84it/s, loss=2.53, v_num=1, val_acc=0.731]
Epoch 26:  24%|██▍       | 28/117 [00:01<00:05, 15.32it/s, loss=2.53, v_num=1, val_acc=0.731]
Epoch 26:  24%|██▍       | 28/117 [00:01<00:05, 15.11it/s, loss=2.43, v_num=1, val_acc=0.731]
Epoch 26:  25%|██▍       | 29/117 [00:01<00:05, 15.56it/s, loss=2.43, v_num=1, val_acc=0.731]
Epoch 26:  25%|██▍       | 29/117 [00:01<00:05, 15.36it/s, loss=2.42, v_num=1, val_acc=0.731]
Epoch 26:  26%|██▌       | 30/117 [00:01<00:05, 15.81it/s, loss=2.42, v_num=1, val_acc=0.731]
Epoch 26:  26%|██▌       | 30/117 [00:01<00:05, 15.60it/s, loss=2.47, v_num=1, val_acc=0.731]
Epoch 26:  26%|██▋       | 31/117 [00:01<00:05, 16.05it/s, loss=2.47, v_num=1, val_acc=0.731]
Epoch 26:  26%|██▋       | 31/117 [00:01<00:05, 15.84it/s, loss=2.51, v_num=1, val_acc=0.731]
Epoch 26:  27%|██▋       | 32/117 [00:01<00:05, 16.28it/s, loss=2.51, v_num=1, val_acc=0.731]
Epoch 26:  27%|██▋       | 32/117 [00:01<00:05, 16.07it/s, loss=2.6, v_num=1, val_acc=0.731]
Epoch 26:  28%|██▊       | 33/117 [00:02<00:05, 16.50it/s, loss=2.6, v_num=1, val_acc=0.731]
Epoch 26:  28%|██▊       | 33/117 [00:02<00:05, 16.29it/s, loss=2.72, v_num=1, val_acc=0.731]
Epoch 26:  29%|██▉       | 34/117 [00:02<00:04, 16.71it/s, loss=2.72, v_num=1, val_acc=0.731]
Epoch 26:  29%|██▉       | 34/117 [00:02<00:05, 16.51it/s, loss=2.74, v_num=1, val_acc=0.731]
Epoch 26:  30%|██▉       | 35/117 [00:02<00:04, 16.92it/s, loss=2.74, v_num=1, val_acc=0.731]
Epoch 26:  30%|██▉       | 35/117 [00:02<00:04, 16.71it/s, loss=2.75, v_num=1, val_acc=0.731]
Epoch 26:  31%|███       | 36/117 [00:02<00:04, 17.12it/s, loss=2.75, v_num=1, val_acc=0.731]
Epoch 26:  31%|███       | 36/117 [00:02<00:04, 16.92it/s, loss=2.79, v_num=1, val_acc=0.731]
Epoch 26:  32%|███▏      | 37/117 [00:02<00:04, 17.31it/s, loss=2.79, v_num=1, val_acc=0.731]
Epoch 26:  32%|███▏      | 37/117 [00:02<00:04, 17.11it/s, loss=2.79, v_num=1, val_acc=0.731]
Epoch 26:  32%|███▏      | 38/117 [00:02<00:04, 17.50it/s, loss=2.79, v_num=1, val_acc=0.731]
Epoch 26:  32%|███▏      | 38/117 [00:02<00:04, 17.30it/s, loss=2.78, v_num=1, val_acc=0.731]
Epoch 26:  33%|███▎      | 39/117 [00:02<00:04, 17.68it/s, loss=2.78, v_num=1, val_acc=0.731]
Epoch 26:  33%|███▎      | 39/117 [00:02<00:04, 17.48it/s, loss=2.69, v_num=1, val_acc=0.731]
Epoch 26:  34%|███▍      | 40/117 [00:02<00:04, 17.86it/s, loss=2.69, v_num=1, val_acc=0.731]
Epoch 26:  34%|███▍      | 40/117 [00:02<00:04, 17.66it/s, loss=2.64, v_num=1, val_acc=0.731]
Epoch 26:  35%|███▌      | 41/117 [00:02<00:04, 18.03it/s, loss=2.64, v_num=1, val_acc=0.731]
Epoch 26:  35%|███▌      | 41/117 [00:02<00:04, 17.83it/s, loss=2.58, v_num=1, val_acc=0.731]
Epoch 26:  36%|███▌      | 42/117 [00:02<00:04, 18.20it/s, loss=2.58, v_num=1, val_acc=0.731]
Epoch 26:  36%|███▌      | 42/117 [00:02<00:04, 18.00it/s, loss=2.6, v_num=1, val_acc=0.731]
Epoch 26:  37%|███▋      | 43/117 [00:02<00:04, 18.36it/s, loss=2.6, v_num=1, val_acc=0.731]
Epoch 26:  37%|███▋      | 43/117 [00:02<00:04, 18.16it/s, loss=2.54, v_num=1, val_acc=0.731]
Epoch 26:  38%|███▊      | 44/117 [00:02<00:03, 18.51it/s, loss=2.54, v_num=1, val_acc=0.731]
Epoch 26:  38%|███▊      | 44/117 [00:02<00:03, 18.32it/s, loss=2.48, v_num=1, val_acc=0.731]
Epoch 26:  38%|███▊      | 45/117 [00:02<00:03, 18.66it/s, loss=2.48, v_num=1, val_acc=0.731]
Epoch 26:  38%|███▊      | 45/117 [00:02<00:03, 18.47it/s, loss=2.37, v_num=1, val_acc=0.731]
Epoch 26:  39%|███▉      | 46/117 [00:02<00:03, 18.81it/s, loss=2.37, v_num=1, val_acc=0.731]
Epoch 26:  39%|███▉      | 46/117 [00:02<00:03, 18.62it/s, loss=2.33, v_num=1, val_acc=0.731]
Epoch 26:  40%|████      | 47/117 [00:02<00:03, 18.96it/s, loss=2.33, v_num=1, val_acc=0.731]
Epoch 26:  40%|████      | 47/117 [00:02<00:03, 18.77it/s, loss=2.36, v_num=1, val_acc=0.731]
Epoch 26:  41%|████      | 48/117 [00:02<00:03, 19.10it/s, loss=2.36, v_num=1, val_acc=0.731]
Epoch 26:  41%|████      | 48/117 [00:02<00:03, 18.91it/s, loss=2.42, v_num=1, val_acc=0.731]
Epoch 26:  42%|████▏     | 49/117 [00:02<00:03, 19.23it/s, loss=2.42, v_num=1, val_acc=0.731]
Epoch 26:  42%|████▏     | 49/117 [00:02<00:03, 19.04it/s, loss=2.47, v_num=1, val_acc=0.731]
Epoch 26:  43%|████▎     | 50/117 [00:02<00:03, 19.36it/s, loss=2.47, v_num=1, val_acc=0.731]
Epoch 26:  43%|████▎     | 50/117 [00:02<00:03, 19.18it/s, loss=2.45, v_num=1, val_acc=0.731]
Epoch 26:  44%|████▎     | 51/117 [00:02<00:03, 19.49it/s, loss=2.45, v_num=1, val_acc=0.731]
Epoch 26:  44%|████▎     | 51/117 [00:02<00:03, 19.31it/s, loss=2.38, v_num=1, val_acc=0.731]
Epoch 26:  44%|████▍     | 52/117 [00:02<00:03, 19.62it/s, loss=2.38, v_num=1, val_acc=0.731]
Epoch 26:  44%|████▍     | 52/117 [00:02<00:03, 19.43it/s, loss=2.29, v_num=1, val_acc=0.731]
Epoch 26:  45%|████▌     | 53/117 [00:02<00:03, 19.74it/s, loss=2.29, v_num=1, val_acc=0.731]
Epoch 26:  45%|████▌     | 53/117 [00:02<00:03, 19.56it/s, loss=2.22, v_num=1, val_acc=0.731]
Epoch 26:  46%|████▌     | 54/117 [00:02<00:03, 19.86it/s, loss=2.22, v_num=1, val_acc=0.731]
Epoch 26:  46%|████▌     | 54/117 [00:02<00:03, 19.68it/s, loss=2.27, v_num=1, val_acc=0.731]
Epoch 26:  47%|████▋     | 55/117 [00:02<00:03, 19.98it/s, loss=2.27, v_num=1, val_acc=0.731]
Epoch 26:  47%|████▋     | 55/117 [00:02<00:03, 19.80it/s, loss=2.33, v_num=1, val_acc=0.731]
Epoch 26:  48%|████▊     | 56/117 [00:02<00:03, 20.09it/s, loss=2.33, v_num=1, val_acc=0.731]
Epoch 26:  48%|████▊     | 56/117 [00:02<00:03, 19.91it/s, loss=2.32, v_num=1, val_acc=0.731]
Epoch 26:  49%|████▊     | 57/117 [00:02<00:02, 20.20it/s, loss=2.32, v_num=1, val_acc=0.731]
Epoch 26:  49%|████▊     | 57/117 [00:02<00:02, 20.02it/s, loss=2.33, v_num=1, val_acc=0.731]
Epoch 26:  50%|████▉     | 58/117 [00:02<00:02, 20.31it/s, loss=2.33, v_num=1, val_acc=0.731]
Epoch 26:  50%|████▉     | 58/117 [00:02<00:02, 20.13it/s, loss=2.24, v_num=1, val_acc=0.731]
Epoch 26:  50%|█████     | 59/117 [00:02<00:02, 20.41it/s, loss=2.24, v_num=1, val_acc=0.731]
Epoch 26:  50%|█████     | 59/117 [00:02<00:02, 20.24it/s, loss=2.3, v_num=1, val_acc=0.731]
Epoch 26:  51%|█████▏    | 60/117 [00:02<00:02, 20.52it/s, loss=2.3, v_num=1, val_acc=0.731]
Epoch 26:  51%|█████▏    | 60/117 [00:02<00:02, 20.34it/s, loss=2.29, v_num=1, val_acc=0.731]
Epoch 26:  52%|█████▏    | 61/117 [00:02<00:02, 20.62it/s, loss=2.29, v_num=1, val_acc=0.731]
Epoch 26:  52%|█████▏    | 61/117 [00:02<00:02, 20.44it/s, loss=2.28, v_num=1, val_acc=0.731]
Epoch 26:  53%|█████▎    | 62/117 [00:02<00:02, 20.72it/s, loss=2.28, v_num=1, val_acc=0.731]
Epoch 26:  53%|█████▎    | 62/117 [00:03<00:02, 20.54it/s, loss=2.2, v_num=1, val_acc=0.731]
Epoch 26:  54%|█████▍    | 63/117 [00:03<00:02, 20.81it/s, loss=2.2, v_num=1, val_acc=0.731]
Epoch 26:  54%|█████▍    | 63/117 [00:03<00:02, 20.64it/s, loss=2.18, v_num=1, val_acc=0.731]
Epoch 26:  55%|█████▍    | 64/117 [00:03<00:02, 20.91it/s, loss=2.18, v_num=1, val_acc=0.731]
Epoch 26:  55%|█████▍    | 64/117 [00:03<00:02, 20.74it/s, loss=2.2, v_num=1, val_acc=0.731]
Epoch 26:  56%|█████▌    | 65/117 [00:03<00:02, 21.00it/s, loss=2.2, v_num=1, val_acc=0.731]
Epoch 26:  56%|█████▌    | 65/117 [00:03<00:02, 20.83it/s, loss=2.27, v_num=1, val_acc=0.731]
Epoch 26:  56%|█████▋    | 66/117 [00:03<00:02, 21.09it/s, loss=2.27, v_num=1, val_acc=0.731]
Epoch 26:  56%|█████▋    | 66/117 [00:03<00:02, 20.92it/s, loss=2.29, v_num=1, val_acc=0.731]
Epoch 26:  57%|█████▋    | 67/117 [00:03<00:02, 21.17it/s, loss=2.29, v_num=1, val_acc=0.731]
Epoch 26:  57%|█████▋    | 67/117 [00:03<00:02, 21.00it/s, loss=2.27, v_num=1, val_acc=0.731]
Epoch 26:  58%|█████▊    | 68/117 [00:03<00:02, 21.25it/s, loss=2.27, v_num=1, val_acc=0.731]
Epoch 26:  58%|█████▊    | 68/117 [00:03<00:02, 21.09it/s, loss=2.22, v_num=1, val_acc=0.731]
Epoch 26:  59%|█████▉    | 69/117 [00:03<00:02, 21.34it/s, loss=2.22, v_num=1, val_acc=0.731]
Epoch 26:  59%|█████▉    | 69/117 [00:03<00:02, 21.18it/s, loss=2.23, v_num=1, val_acc=0.731]
Epoch 26:  60%|█████▉    | 70/117 [00:03<00:02, 21.43it/s, loss=2.23, v_num=1, val_acc=0.731]
Epoch 26:  60%|█████▉    | 70/117 [00:03<00:02, 21.26it/s, loss=2.24, v_num=1, val_acc=0.731]
Epoch 26:  61%|██████    | 71/117 [00:03<00:02, 21.51it/s, loss=2.24, v_num=1, val_acc=0.731]
Epoch 26:  61%|██████    | 71/117 [00:03<00:02, 21.34it/s, loss=2.22, v_num=1, val_acc=0.731]
Epoch 26:  62%|██████▏   | 72/117 [00:03<00:02, 21.58it/s, loss=2.22, v_num=1, val_acc=0.731]
Epoch 26:  62%|██████▏   | 72/117 [00:03<00:02, 21.42it/s, loss=2.24, v_num=1, val_acc=0.731]
Epoch 26:  62%|██████▏   | 73/117 [00:03<00:02, 21.66it/s, loss=2.24, v_num=1, val_acc=0.731]
Epoch 26:  62%|██████▏   | 73/117 [00:03<00:02, 21.50it/s, loss=2.23, v_num=1, val_acc=0.731]
Epoch 26:  63%|██████▎   | 74/117 [00:03<00:01, 21.74it/s, loss=2.23, v_num=1, val_acc=0.731]
Epoch 26:  63%|██████▎   | 74/117 [00:03<00:01, 21.58it/s, loss=2.17, v_num=1, val_acc=0.731]
Epoch 26:  64%|██████▍   | 75/117 [00:03<00:01, 21.81it/s, loss=2.17, v_num=1, val_acc=0.731]
Epoch 26:  64%|██████▍   | 75/117 [00:03<00:01, 21.65it/s, loss=2.14, v_num=1, val_acc=0.731]
Epoch 26:  65%|██████▍   | 76/117 [00:03<00:01, 21.88it/s, loss=2.14, v_num=1, val_acc=0.731]
Epoch 26:  65%|██████▍   | 76/117 [00:03<00:01, 21.73it/s, loss=2.14, v_num=1, val_acc=0.731]
Epoch 26:  66%|██████▌   | 77/117 [00:03<00:01, 21.96it/s, loss=2.14, v_num=1, val_acc=0.731]
Epoch 26:  66%|██████▌   | 77/117 [00:03<00:01, 21.80it/s, loss=2.13, v_num=1, val_acc=0.731]
Epoch 26:  67%|██████▋   | 78/117 [00:03<00:01, 22.03it/s, loss=2.13, v_num=1, val_acc=0.731]
Epoch 26:  67%|██████▋   | 78/117 [00:03<00:01, 21.87it/s, loss=2.13, v_num=1, val_acc=0.731]
Epoch 26:  68%|██████▊   | 79/117 [00:03<00:01, 22.09it/s, loss=2.13, v_num=1, val_acc=0.731]
Epoch 26:  68%|██████▊   | 79/117 [00:03<00:01, 21.94it/s, loss=2.1, v_num=1, val_acc=0.731]
Epoch 26:  68%|██████▊   | 80/117 [00:03<00:01, 22.16it/s, loss=2.1, v_num=1, val_acc=0.731]
Epoch 26:  68%|██████▊   | 80/117 [00:03<00:01, 22.01it/s, loss=2.18, v_num=1, val_acc=0.731]
Epoch 26:  69%|██████▉   | 81/117 [00:03<00:01, 22.23it/s, loss=2.18, v_num=1, val_acc=0.731]
Epoch 26:  69%|██████▉   | 81/117 [00:03<00:01, 22.07it/s, loss=2.21, v_num=1, val_acc=0.731]
Epoch 26:  70%|███████   | 82/117 [00:03<00:01, 22.26it/s, loss=2.21, v_num=1, val_acc=0.731]
Epoch 26:  70%|███████   | 82/117 [00:03<00:01, 22.11it/s, loss=2.25, v_num=1, val_acc=0.731]
Epoch 26:  71%|███████   | 83/117 [00:03<00:01, 22.32it/s, loss=2.25, v_num=1, val_acc=0.731]
Epoch 26:  71%|███████   | 83/117 [00:03<00:01, 22.17it/s, loss=2.26, v_num=1, val_acc=0.731]
Epoch 26:  72%|███████▏  | 84/117 [00:03<00:01, 22.39it/s, loss=2.26, v_num=1, val_acc=0.731]
Epoch 26:  72%|███████▏  | 84/117 [00:03<00:01, 22.24it/s, loss=2.31, v_num=1, val_acc=0.731]
Epoch 26:  73%|███████▎  | 85/117 [00:03<00:01, 22.45it/s, loss=2.31, v_num=1, val_acc=0.731]
Epoch 26:  73%|███████▎  | 85/117 [00:03<00:01, 22.30it/s, loss=2.26, v_num=1, val_acc=0.731]
Epoch 26:  74%|███████▎  | 86/117 [00:03<00:01, 22.51it/s, loss=2.26, v_num=1, val_acc=0.731]
Epoch 26:  74%|███████▎  | 86/117 [00:03<00:01, 22.36it/s, loss=2.25, v_num=1, val_acc=0.731]
Epoch 26:  74%|███████▍  | 87/117 [00:03<00:01, 22.57it/s, loss=2.25, v_num=1, val_acc=0.731]
Epoch 26:  74%|███████▍  | 87/117 [00:03<00:01, 22.42it/s, loss=2.27, v_num=1, val_acc=0.731]
Epoch 26:  75%|███████▌  | 88/117 [00:03<00:01, 22.63it/s, loss=2.27, v_num=1, val_acc=0.731]
Epoch 26:  75%|███████▌  | 88/117 [00:03<00:01, 22.48it/s, loss=2.31, v_num=1, val_acc=0.731]
Epoch 26:  76%|███████▌  | 89/117 [00:03<00:01, 22.69it/s, loss=2.31, v_num=1, val_acc=0.731]
Epoch 26:  76%|███████▌  | 89/117 [00:03<00:01, 22.54it/s, loss=2.26, v_num=1, val_acc=0.731]
Epoch 26:  77%|███████▋  | 90/117 [00:03<00:01, 22.74it/s, loss=2.26, v_num=1, val_acc=0.731]
Epoch 26:  77%|███████▋  | 90/117 [00:03<00:01, 22.60it/s, loss=2.21, v_num=1, val_acc=0.731]
Epoch 26:  78%|███████▊  | 91/117 [00:03<00:01, 22.80it/s, loss=2.21, v_num=1, val_acc=0.731]
Epoch 26:  78%|███████▊  | 91/117 [00:04<00:01, 22.65it/s, loss=2.21, v_num=1, val_acc=0.731]
Epoch 26:  79%|███████▊  | 92/117 [00:04<00:01, 22.85it/s, loss=2.21, v_num=1, val_acc=0.731]
Epoch 26:  79%|███████▊  | 92/117 [00:04<00:01, 22.71it/s, loss=2.21, v_num=1, val_acc=0.731]
Epoch 26:  79%|███████▉  | 93/117 [00:04<00:01, 22.91it/s, loss=2.21, v_num=1, val_acc=0.731]
Epoch 26:  79%|███████▉  | 93/117 [00:04<00:01, 22.76it/s, loss=2.2, v_num=1, val_acc=0.731]
Epoch 26:  80%|████████  | 94/117 [00:04<00:01, 22.96it/s, loss=2.2, v_num=1, val_acc=0.731]
Epoch 26:  80%|████████  | 94/117 [00:04<00:01, 22.81it/s, loss=2.24, v_num=1, val_acc=0.731]
Epoch 26:  81%|████████  | 95/117 [00:04<00:00, 23.00it/s, loss=2.24, v_num=1, val_acc=0.731]
Epoch 26:  81%|████████  | 95/117 [00:04<00:00, 22.86it/s, loss=2.31, v_num=1, val_acc=0.731]
Epoch 26:  82%|████████▏ | 96/117 [00:04<00:00, 23.05it/s, loss=2.31, v_num=1, val_acc=0.731]
Epoch 26:  82%|████████▏ | 96/117 [00:04<00:00, 22.91it/s, loss=2.3, v_num=1, val_acc=0.731]
Epoch 26:  83%|████████▎ | 97/117 [00:04<00:00, 23.10it/s, loss=2.3, v_num=1, val_acc=0.731]
Epoch 26:  83%|████████▎ | 97/117 [00:04<00:00, 22.97it/s, loss=2.31, v_num=1, val_acc=0.731]

Validation: 0it [00:00, ?it/s]

Validation:   0%|          | 0/20 [00:00<?, ?it/s]

Validation DataLoader 0:   0%|          | 0/20 [00:00<?, ?it/s]

Validation DataLoader 0:   5%|▌         | 1/20 [00:00<00:00, 183.14it/s]
Epoch 26:  84%|████████▍ | 98/117 [00:05<00:00, 19.31it/s, loss=2.31, v_num=1, val_acc=0.731]

Validation DataLoader 0:  10%|█         | 2/20 [00:00<00:00, 55.34it/s]
Epoch 26:  85%|████████▍ | 99/117 [00:05<00:00, 19.39it/s, loss=2.31, v_num=1, val_acc=0.731]

Validation DataLoader 0:  15%|█▌        | 3/20 [00:00<00:00, 44.09it/s]
Epoch 26:  85%|████████▌ | 100/117 [00:05<00:00, 19.47it/s, loss=2.31, v_num=1, val_acc=0.731]

Validation DataLoader 0:  20%|██        | 4/20 [00:00<00:00, 39.96it/s]
Epoch 26:  86%|████████▋ | 101/117 [00:05<00:00, 19.54it/s, loss=2.31, v_num=1, val_acc=0.731]

Validation DataLoader 0:  25%|██▌       | 5/20 [00:00<00:00, 37.81it/s]
Epoch 26:  87%|████████▋ | 102/117 [00:05<00:00, 19.61it/s, loss=2.31, v_num=1, val_acc=0.731]

Validation DataLoader 0:  30%|███       | 6/20 [00:00<00:00, 36.59it/s]
Epoch 26:  88%|████████▊ | 103/117 [00:05<00:00, 19.68it/s, loss=2.31, v_num=1, val_acc=0.731]

Validation DataLoader 0:  35%|███▌      | 7/20 [00:00<00:00, 35.80it/s]
Epoch 26:  89%|████████▉ | 104/117 [00:05<00:00, 19.75it/s, loss=2.31, v_num=1, val_acc=0.731]

Validation DataLoader 0:  40%|████      | 8/20 [00:00<00:00, 35.22it/s]
Epoch 26:  90%|████████▉ | 105/117 [00:05<00:00, 19.82it/s, loss=2.31, v_num=1, val_acc=0.731]

Validation DataLoader 0:  45%|████▌     | 9/20 [00:00<00:00, 34.72it/s]
Epoch 26:  91%|█████████ | 106/117 [00:05<00:00, 19.89it/s, loss=2.31, v_num=1, val_acc=0.731]

Validation DataLoader 0:  50%|█████     | 10/20 [00:00<00:00, 34.46it/s]
Epoch 26:  91%|█████████▏| 107/117 [00:05<00:00, 19.96it/s, loss=2.31, v_num=1, val_acc=0.731]

Validation DataLoader 0:  55%|█████▌    | 11/20 [00:00<00:00, 34.20it/s]
Epoch 26:  92%|█████████▏| 108/117 [00:05<00:00, 20.03it/s, loss=2.31, v_num=1, val_acc=0.731]

Validation DataLoader 0:  60%|██████    | 12/20 [00:00<00:00, 33.98it/s]
Epoch 26:  93%|█████████▎| 109/117 [00:05<00:00, 20.10it/s, loss=2.31, v_num=1, val_acc=0.731]

Validation DataLoader 0:  65%|██████▌   | 13/20 [00:00<00:00, 33.79it/s]
Epoch 26:  94%|█████████▍| 110/117 [00:05<00:00, 20.17it/s, loss=2.31, v_num=1, val_acc=0.731]

Validation DataLoader 0:  70%|███████   | 14/20 [00:00<00:00, 33.64it/s]
Epoch 26:  95%|█████████▍| 111/117 [00:05<00:00, 20.24it/s, loss=2.31, v_num=1, val_acc=0.731]

Validation DataLoader 0:  75%|███████▌  | 15/20 [00:00<00:00, 33.49it/s]
Epoch 26:  96%|█████████▌| 112/117 [00:05<00:00, 20.30it/s, loss=2.31, v_num=1, val_acc=0.731]

Validation DataLoader 0:  80%|████████  | 16/20 [00:00<00:00, 33.35it/s]
Epoch 26:  97%|█████████▋| 113/117 [00:05<00:00, 20.36it/s, loss=2.31, v_num=1, val_acc=0.731]

Validation DataLoader 0:  85%|████████▌ | 17/20 [00:00<00:00, 33.24it/s]
Epoch 26:  97%|█████████▋| 114/117 [00:05<00:00, 20.43it/s, loss=2.31, v_num=1, val_acc=0.731]

Validation DataLoader 0:  90%|█████████ | 18/20 [00:00<00:00, 33.15it/s]
Epoch 26:  98%|█████████▊| 115/117 [00:05<00:00, 20.49it/s, loss=2.31, v_num=1, val_acc=0.731]

Validation DataLoader 0:  95%|█████████▌| 19/20 [00:00<00:00, 33.07it/s]
Epoch 26:  99%|█████████▉| 116/117 [00:05<00:00, 20.55it/s, loss=2.31, v_num=1, val_acc=0.731]

Validation DataLoader 0: 100%|██████████| 20/20 [00:00<00:00, 33.05it/s]
Epoch 26: 100%|██████████| 117/117 [00:05<00:00, 20.62it/s, loss=2.31, v_num=1, val_acc=0.731]
Epoch 26: 100%|██████████| 117/117 [00:05<00:00, 20.55it/s, loss=2.31, v_num=1, val_acc=0.695]


Epoch 26: 100%|██████████| 117/117 [00:05<00:00, 20.54it/s, loss=2.31, v_num=1, val_acc=0.695]
Epoch 26:   0%|          | 0/117 [00:00<?, ?it/s, loss=2.31, v_num=1, val_acc=0.695]
Epoch 27:   0%|          | 0/117 [00:00<?, ?it/s, loss=2.31, v_num=1, val_acc=0.695]
Epoch 27:   1%|          | 1/117 [00:00<01:49,  1.06it/s, loss=2.31, v_num=1, val_acc=0.695]
Epoch 27:   1%|          | 1/117 [00:00<01:52,  1.03it/s, loss=2.29, v_num=1, val_acc=0.695]
Epoch 27:   2%|▏         | 2/117 [00:00<00:56,  2.05it/s, loss=2.29, v_num=1, val_acc=0.695]
Epoch 27:   2%|▏         | 2/117 [00:01<00:57,  1.99it/s, loss=2.31, v_num=1, val_acc=0.695]
Epoch 27:   3%|▎         | 3/117 [00:01<00:38,  2.97it/s, loss=2.31, v_num=1, val_acc=0.695]
Epoch 27:   3%|▎         | 3/117 [00:01<00:39,  2.89it/s, loss=2.32, v_num=1, val_acc=0.695]
Epoch 27:   3%|▎         | 4/117 [00:01<00:29,  3.83it/s, loss=2.32, v_num=1, val_acc=0.695]
Epoch 27:   3%|▎         | 4/117 [00:01<00:30,  3.74it/s, loss=2.38, v_num=1, val_acc=0.695]
Epoch 27:   4%|▍         | 5/117 [00:01<00:24,  4.64it/s, loss=2.38, v_num=1, val_acc=0.695]
Epoch 27:   4%|▍         | 5/117 [00:01<00:24,  4.53it/s, loss=2.37, v_num=1, val_acc=0.695]
Epoch 27:   5%|▌         | 6/117 [00:01<00:20,  5.40it/s, loss=2.37, v_num=1, val_acc=0.695]
Epoch 27:   5%|▌         | 6/117 [00:01<00:21,  5.27it/s, loss=2.38, v_num=1, val_acc=0.695]
Epoch 27:   6%|▌         | 7/117 [00:01<00:18,  6.11it/s, loss=2.38, v_num=1, val_acc=0.695]
Epoch 27:   6%|▌         | 7/117 [00:01<00:18,  5.98it/s, loss=2.33, v_num=1, val_acc=0.695]
Epoch 27:   7%|▋         | 8/117 [00:01<00:16,  6.78it/s, loss=2.33, v_num=1, val_acc=0.695]
Epoch 27:   7%|▋         | 8/117 [00:01<00:16,  6.64it/s, loss=2.38, v_num=1, val_acc=0.695]
Epoch 27:   8%|▊         | 9/117 [00:01<00:14,  7.37it/s, loss=2.38, v_num=1, val_acc=0.695]
Epoch 27:   8%|▊         | 9/117 [00:01<00:14,  7.22it/s, loss=2.4, v_num=1, val_acc=0.695]
Epoch 27:   9%|▊         | 10/117 [00:01<00:13,  7.96it/s, loss=2.4, v_num=1, val_acc=0.695]
Epoch 27:   9%|▊         | 10/117 [00:01<00:13,  7.81it/s, loss=2.38, v_num=1, val_acc=0.695]
Epoch 27:   9%|▉         | 11/117 [00:01<00:12,  8.53it/s, loss=2.38, v_num=1, val_acc=0.695]
Epoch 27:   9%|▉         | 11/117 [00:01<00:12,  8.37it/s, loss=2.33, v_num=1, val_acc=0.695]
Epoch 27:  10%|█         | 12/117 [00:01<00:11,  9.07it/s, loss=2.33, v_num=1, val_acc=0.695]
Epoch 27:  10%|█         | 12/117 [00:01<00:11,  8.90it/s, loss=2.32, v_num=1, val_acc=0.695]
Epoch 27:  11%|█         | 13/117 [00:01<00:10,  9.58it/s, loss=2.32, v_num=1, val_acc=0.695]
Epoch 27:  11%|█         | 13/117 [00:01<00:11,  9.41it/s, loss=2.39, v_num=1, val_acc=0.695]
Epoch 27:  12%|█▏        | 14/117 [00:01<00:10, 10.07it/s, loss=2.39, v_num=1, val_acc=0.695]
Epoch 27:  12%|█▏        | 14/117 [00:01<00:10,  9.89it/s, loss=2.36, v_num=1, val_acc=0.695]
Epoch 27:  13%|█▎        | 15/117 [00:01<00:09, 10.54it/s, loss=2.36, v_num=1, val_acc=0.695]
Epoch 27:  13%|█▎        | 15/117 [00:01<00:09, 10.36it/s, loss=2.34, v_num=1, val_acc=0.695]
Epoch 27:  14%|█▎        | 16/117 [00:01<00:09, 10.99it/s, loss=2.34, v_num=1, val_acc=0.695]
Epoch 27:  14%|█▎        | 16/117 [00:01<00:09, 10.80it/s, loss=2.33, v_num=1, val_acc=0.695]
Epoch 27:  15%|█▍        | 17/117 [00:01<00:08, 11.38it/s, loss=2.33, v_num=1, val_acc=0.695]
Epoch 27:  15%|█▍        | 17/117 [00:01<00:08, 11.19it/s, loss=2.32, v_num=1, val_acc=0.695]
Epoch 27:  15%|█▌        | 18/117 [00:01<00:08, 11.78it/s, loss=2.32, v_num=1, val_acc=0.695]
Epoch 27:  15%|█▌        | 18/117 [00:01<00:08, 11.59it/s, loss=2.25, v_num=1, val_acc=0.695]
Epoch 27:  16%|█▌        | 19/117 [00:01<00:08, 12.17it/s, loss=2.25, v_num=1, val_acc=0.695]
Epoch 27:  16%|█▌        | 19/117 [00:01<00:08, 11.97it/s, loss=2.25, v_num=1, val_acc=0.695]
Epoch 27:  17%|█▋        | 20/117 [00:01<00:07, 12.54it/s, loss=2.25, v_num=1, val_acc=0.695]
Epoch 27:  17%|█▋        | 20/117 [00:01<00:07, 12.34it/s, loss=2.23, v_num=1, val_acc=0.695]
Epoch 27:  18%|█▊        | 21/117 [00:01<00:07, 12.89it/s, loss=2.23, v_num=1, val_acc=0.695]
Epoch 27:  18%|█▊        | 21/117 [00:01<00:07, 12.70it/s, loss=2.24, v_num=1, val_acc=0.695]
Epoch 27:  19%|█▉        | 22/117 [00:01<00:07, 13.23it/s, loss=2.24, v_num=1, val_acc=0.695]
Epoch 27:  19%|█▉        | 22/117 [00:01<00:07, 13.03it/s, loss=2.23, v_num=1, val_acc=0.695]
Epoch 27:  20%|█▉        | 23/117 [00:01<00:06, 13.55it/s, loss=2.23, v_num=1, val_acc=0.695]
Epoch 27:  20%|█▉        | 23/117 [00:01<00:07, 13.35it/s, loss=2.15, v_num=1, val_acc=0.695]
Epoch 27:  21%|██        | 24/117 [00:01<00:06, 13.86it/s, loss=2.15, v_num=1, val_acc=0.695]
Epoch 27:  21%|██        | 24/117 [00:01<00:06, 13.66it/s, loss=2.09, v_num=1, val_acc=0.695]
Epoch 27:  21%|██▏       | 25/117 [00:01<00:06, 14.14it/s, loss=2.09, v_num=1, val_acc=0.695]
Epoch 27:  21%|██▏       | 25/117 [00:01<00:06, 13.94it/s, loss=2.08, v_num=1, val_acc=0.695]
Epoch 27:  22%|██▏       | 26/117 [00:01<00:06, 14.43it/s, loss=2.08, v_num=1, val_acc=0.695]
Epoch 27:  22%|██▏       | 26/117 [00:01<00:06, 14.23it/s, loss=2.08, v_num=1, val_acc=0.695]
Epoch 27:  23%|██▎       | 27/117 [00:01<00:06, 14.71it/s, loss=2.08, v_num=1, val_acc=0.695]
Epoch 27:  23%|██▎       | 27/117 [00:01<00:06, 14.51it/s, loss=2.1, v_num=1, val_acc=0.695]
Epoch 27:  24%|██▍       | 28/117 [00:01<00:05, 14.98it/s, loss=2.1, v_num=1, val_acc=0.695]
Epoch 27:  24%|██▍       | 28/117 [00:01<00:06, 14.78it/s, loss=2.03, v_num=1, val_acc=0.695]
Epoch 27:  25%|██▍       | 29/117 [00:01<00:05, 15.23it/s, loss=2.03, v_num=1, val_acc=0.695]
Epoch 27:  25%|██▍       | 29/117 [00:01<00:05, 15.03it/s, loss=1.99, v_num=1, val_acc=0.695]
Epoch 27:  26%|██▌       | 30/117 [00:01<00:05, 15.47it/s, loss=1.99, v_num=1, val_acc=0.695]
Epoch 27:  26%|██▌       | 30/117 [00:01<00:05, 15.27it/s, loss=2.04, v_num=1, val_acc=0.695]
Epoch 27:  26%|██▋       | 31/117 [00:01<00:05, 15.70it/s, loss=2.04, v_num=1, val_acc=0.695]
Epoch 27:  26%|██▋       | 31/117 [00:01<00:05, 15.51it/s, loss=2.19, v_num=1, val_acc=0.695]
Epoch 27:  27%|██▋       | 32/117 [00:02<00:05, 15.93it/s, loss=2.19, v_num=1, val_acc=0.695]
Epoch 27:  27%|██▋       | 32/117 [00:02<00:05, 15.73it/s, loss=2.23, v_num=1, val_acc=0.695]
Epoch 27:  28%|██▊       | 33/117 [00:02<00:05, 16.14it/s, loss=2.23, v_num=1, val_acc=0.695]
Epoch 27:  28%|██▊       | 33/117 [00:02<00:05, 15.94it/s, loss=2.27, v_num=1, val_acc=0.695]
Epoch 27:  29%|██▉       | 34/117 [00:02<00:05, 16.36it/s, loss=2.27, v_num=1, val_acc=0.695]
Epoch 27:  29%|██▉       | 34/117 [00:02<00:05, 16.16it/s, loss=2.4, v_num=1, val_acc=0.695]
Epoch 27:  30%|██▉       | 35/117 [00:02<00:04, 16.57it/s, loss=2.4, v_num=1, val_acc=0.695]
Epoch 27:  30%|██▉       | 35/117 [00:02<00:05, 16.38it/s, loss=2.47, v_num=1, val_acc=0.695]
Epoch 27:  31%|███       | 36/117 [00:02<00:04, 16.77it/s, loss=2.47, v_num=1, val_acc=0.695]
Epoch 27:  31%|███       | 36/117 [00:02<00:04, 16.58it/s, loss=2.47, v_num=1, val_acc=0.695]
Epoch 27:  32%|███▏      | 37/117 [00:02<00:04, 16.97it/s, loss=2.47, v_num=1, val_acc=0.695]
Epoch 27:  32%|███▏      | 37/117 [00:02<00:04, 16.77it/s, loss=2.47, v_num=1, val_acc=0.695]
Epoch 27:  32%|███▏      | 38/117 [00:02<00:04, 17.16it/s, loss=2.47, v_num=1, val_acc=0.695]
Epoch 27:  32%|███▏      | 38/117 [00:02<00:04, 16.96it/s, loss=2.48, v_num=1, val_acc=0.695]
Epoch 27:  33%|███▎      | 39/117 [00:02<00:04, 17.34it/s, loss=2.48, v_num=1, val_acc=0.695]
Epoch 27:  33%|███▎      | 39/117 [00:02<00:04, 17.15it/s, loss=2.45, v_num=1, val_acc=0.695]
Epoch 27:  34%|███▍      | 40/117 [00:02<00:04, 17.52it/s, loss=2.45, v_num=1, val_acc=0.695]
Epoch 27:  34%|███▍      | 40/117 [00:02<00:04, 17.32it/s, loss=2.46, v_num=1, val_acc=0.695]
Epoch 27:  35%|███▌      | 41/117 [00:02<00:04, 17.69it/s, loss=2.46, v_num=1, val_acc=0.695]
Epoch 27:  35%|███▌      | 41/117 [00:02<00:04, 17.50it/s, loss=2.45, v_num=1, val_acc=0.695]
Epoch 27:  36%|███▌      | 42/117 [00:02<00:04, 17.86it/s, loss=2.45, v_num=1, val_acc=0.695]
Epoch 27:  36%|███▌      | 42/117 [00:02<00:04, 17.67it/s, loss=2.46, v_num=1, val_acc=0.695]
Epoch 27:  37%|███▋      | 43/117 [00:02<00:04, 18.02it/s, loss=2.46, v_num=1, val_acc=0.695]
Epoch 27:  37%|███▋      | 43/117 [00:02<00:04, 17.83it/s, loss=2.5, v_num=1, val_acc=0.695]
Epoch 27:  38%|███▊      | 44/117 [00:02<00:04, 18.18it/s, loss=2.5, v_num=1, val_acc=0.695]
Epoch 27:  38%|███▊      | 44/117 [00:02<00:04, 17.99it/s, loss=2.53, v_num=1, val_acc=0.695]
Epoch 27:  38%|███▊      | 45/117 [00:02<00:03, 18.33it/s, loss=2.53, v_num=1, val_acc=0.695]
Epoch 27:  38%|███▊      | 45/117 [00:02<00:03, 18.14it/s, loss=2.56, v_num=1, val_acc=0.695]
Epoch 27:  39%|███▉      | 46/117 [00:02<00:03, 18.48it/s, loss=2.56, v_num=1, val_acc=0.695]
Epoch 27:  39%|███▉      | 46/117 [00:02<00:03, 18.29it/s, loss=2.6, v_num=1, val_acc=0.695]
Epoch 27:  40%|████      | 47/117 [00:02<00:03, 18.62it/s, loss=2.6, v_num=1, val_acc=0.695]
Epoch 27:  40%|████      | 47/117 [00:02<00:03, 18.44it/s, loss=2.59, v_num=1, val_acc=0.695]
Epoch 27:  41%|████      | 48/117 [00:02<00:03, 18.76it/s, loss=2.59, v_num=1, val_acc=0.695]
Epoch 27:  41%|████      | 48/117 [00:02<00:03, 18.58it/s, loss=2.66, v_num=1, val_acc=0.695]
Epoch 27:  42%|████▏     | 49/117 [00:02<00:03, 18.90it/s, loss=2.66, v_num=1, val_acc=0.695]
Epoch 27:  42%|████▏     | 49/117 [00:02<00:03, 18.72it/s, loss=2.67, v_num=1, val_acc=0.695]
Epoch 27:  43%|████▎     | 50/117 [00:02<00:03, 19.03it/s, loss=2.67, v_num=1, val_acc=0.695]
Epoch 27:  43%|████▎     | 50/117 [00:02<00:03, 18.85it/s, loss=2.65, v_num=1, val_acc=0.695]
Epoch 27:  44%|████▎     | 51/117 [00:02<00:03, 19.16it/s, loss=2.65, v_num=1, val_acc=0.695]
Epoch 27:  44%|████▎     | 51/117 [00:02<00:03, 18.98it/s, loss=2.49, v_num=1, val_acc=0.695]
Epoch 27:  44%|████▍     | 52/117 [00:02<00:03, 19.29it/s, loss=2.49, v_num=1, val_acc=0.695]
Epoch 27:  44%|████▍     | 52/117 [00:02<00:03, 19.11it/s, loss=2.4, v_num=1, val_acc=0.695]
Epoch 27:  45%|████▌     | 53/117 [00:02<00:03, 19.41it/s, loss=2.4, v_num=1, val_acc=0.695]
Epoch 27:  45%|████▌     | 53/117 [00:02<00:03, 19.24it/s, loss=2.27, v_num=1, val_acc=0.695]
Epoch 27:  46%|████▌     | 54/117 [00:02<00:03, 19.53it/s, loss=2.27, v_num=1, val_acc=0.695]
Epoch 27:  46%|████▌     | 54/117 [00:02<00:03, 19.36it/s, loss=2.17, v_num=1, val_acc=0.695]
Epoch 27:  47%|████▋     | 55/117 [00:02<00:03, 19.65it/s, loss=2.17, v_num=1, val_acc=0.695]
Epoch 27:  47%|████▋     | 55/117 [00:02<00:03, 19.48it/s, loss=2.18, v_num=1, val_acc=0.695]
Epoch 27:  48%|████▊     | 56/117 [00:02<00:03, 19.77it/s, loss=2.18, v_num=1, val_acc=0.695]
Epoch 27:  48%|████▊     | 56/117 [00:02<00:03, 19.59it/s, loss=2.31, v_num=1, val_acc=0.695]
Epoch 27:  49%|████▊     | 57/117 [00:02<00:03, 19.88it/s, loss=2.31, v_num=1, val_acc=0.695]
Epoch 27:  49%|████▊     | 57/117 [00:02<00:03, 19.71it/s, loss=2.36, v_num=1, val_acc=0.695]
Epoch 27:  50%|████▉     | 58/117 [00:02<00:02, 19.99it/s, loss=2.36, v_num=1, val_acc=0.695]
Epoch 27:  50%|████▉     | 58/117 [00:02<00:02, 19.82it/s, loss=2.33, v_num=1, val_acc=0.695]
Epoch 27:  50%|█████     | 59/117 [00:02<00:02, 20.10it/s, loss=2.33, v_num=1, val_acc=0.695]
Epoch 27:  50%|█████     | 59/117 [00:02<00:02, 19.93it/s, loss=2.36, v_num=1, val_acc=0.695]
Epoch 27:  51%|█████▏    | 60/117 [00:02<00:02, 20.20it/s, loss=2.36, v_num=1, val_acc=0.695]
Epoch 27:  51%|█████▏    | 60/117 [00:02<00:02, 20.03it/s, loss=2.39, v_num=1, val_acc=0.695]
Epoch 27:  52%|█████▏    | 61/117 [00:03<00:02, 20.30it/s, loss=2.39, v_num=1, val_acc=0.695]
Epoch 27:  52%|█████▏    | 61/117 [00:03<00:02, 20.14it/s, loss=2.43, v_num=1, val_acc=0.695]
Epoch 27:  53%|█████▎    | 62/117 [00:03<00:02, 20.40it/s, loss=2.43, v_num=1, val_acc=0.695]
Epoch 27:  53%|█████▎    | 62/117 [00:03<00:02, 20.24it/s, loss=2.43, v_num=1, val_acc=0.695]
Epoch 27:  54%|█████▍    | 63/117 [00:03<00:02, 20.50it/s, loss=2.43, v_num=1, val_acc=0.695]
Epoch 27:  54%|█████▍    | 63/117 [00:03<00:02, 20.34it/s, loss=2.4, v_num=1, val_acc=0.695]
Epoch 27:  55%|█████▍    | 64/117 [00:03<00:02, 20.60it/s, loss=2.4, v_num=1, val_acc=0.695]
Epoch 27:  55%|█████▍    | 64/117 [00:03<00:02, 20.43it/s, loss=2.34, v_num=1, val_acc=0.695]
Epoch 27:  56%|█████▌    | 65/117 [00:03<00:02, 20.69it/s, loss=2.34, v_num=1, val_acc=0.695]
Epoch 27:  56%|█████▌    | 65/117 [00:03<00:02, 20.53it/s, loss=2.32, v_num=1, val_acc=0.695]
Epoch 27:  56%|█████▋    | 66/117 [00:03<00:02, 20.78it/s, loss=2.32, v_num=1, val_acc=0.695]
Epoch 27:  56%|█████▋    | 66/117 [00:03<00:02, 20.62it/s, loss=2.31, v_num=1, val_acc=0.695]
Epoch 27:  57%|█████▋    | 67/117 [00:03<00:02, 20.87it/s, loss=2.31, v_num=1, val_acc=0.695]
Epoch 27:  57%|█████▋    | 67/117 [00:03<00:02, 20.71it/s, loss=2.36, v_num=1, val_acc=0.695]
Epoch 27:  58%|█████▊    | 68/117 [00:03<00:02, 20.96it/s, loss=2.36, v_num=1, val_acc=0.695]
Epoch 27:  58%|█████▊    | 68/117 [00:03<00:02, 20.80it/s, loss=2.3, v_num=1, val_acc=0.695]
Epoch 27:  59%|█████▉    | 69/117 [00:03<00:02, 21.04it/s, loss=2.3, v_num=1, val_acc=0.695]
Epoch 27:  59%|█████▉    | 69/117 [00:03<00:02, 20.89it/s, loss=2.32, v_num=1, val_acc=0.695]
Epoch 27:  60%|█████▉    | 70/117 [00:03<00:02, 21.13it/s, loss=2.32, v_num=1, val_acc=0.695]
Epoch 27:  60%|█████▉    | 70/117 [00:03<00:02, 20.97it/s, loss=2.3, v_num=1, val_acc=0.695]
Epoch 27:  61%|██████    | 71/117 [00:03<00:02, 21.21it/s, loss=2.3, v_num=1, val_acc=0.695]
Epoch 27:  61%|██████    | 71/117 [00:03<00:02, 21.05it/s, loss=2.32, v_num=1, val_acc=0.695]
Epoch 27:  62%|██████▏   | 72/117 [00:03<00:02, 21.29it/s, loss=2.32, v_num=1, val_acc=0.695]
Epoch 27:  62%|██████▏   | 72/117 [00:03<00:02, 21.14it/s, loss=2.37, v_num=1, val_acc=0.695]
Epoch 27:  62%|██████▏   | 73/117 [00:03<00:02, 21.37it/s, loss=2.37, v_num=1, val_acc=0.695]
Epoch 27:  62%|██████▏   | 73/117 [00:03<00:02, 21.21it/s, loss=2.45, v_num=1, val_acc=0.695]
Epoch 27:  63%|██████▎   | 74/117 [00:03<00:02, 21.44it/s, loss=2.45, v_num=1, val_acc=0.695]
Epoch 27:  63%|██████▎   | 74/117 [00:03<00:02, 21.29it/s, loss=2.44, v_num=1, val_acc=0.695]
Epoch 27:  64%|██████▍   | 75/117 [00:03<00:01, 21.52it/s, loss=2.44, v_num=1, val_acc=0.695]
Epoch 27:  64%|██████▍   | 75/117 [00:03<00:01, 21.36it/s, loss=2.39, v_num=1, val_acc=0.695]
Epoch 27:  65%|██████▍   | 76/117 [00:03<00:01, 21.59it/s, loss=2.39, v_num=1, val_acc=0.695]
Epoch 27:  65%|██████▍   | 76/117 [00:03<00:01, 21.44it/s, loss=2.28, v_num=1, val_acc=0.695]
Epoch 27:  66%|██████▌   | 77/117 [00:03<00:01, 21.66it/s, loss=2.28, v_num=1, val_acc=0.695]
Epoch 27:  66%|██████▌   | 77/117 [00:03<00:01, 21.51it/s, loss=2.31, v_num=1, val_acc=0.695]
Epoch 27:  67%|██████▋   | 78/117 [00:03<00:01, 21.73it/s, loss=2.31, v_num=1, val_acc=0.695]
Epoch 27:  67%|██████▋   | 78/117 [00:03<00:01, 21.58it/s, loss=2.37, v_num=1, val_acc=0.695]
Epoch 27:  68%|██████▊   | 79/117 [00:03<00:01, 21.80it/s, loss=2.37, v_num=1, val_acc=0.695]
Epoch 27:  68%|██████▊   | 79/117 [00:03<00:01, 21.65it/s, loss=2.38, v_num=1, val_acc=0.695]
Epoch 27:  68%|██████▊   | 80/117 [00:03<00:01, 21.87it/s, loss=2.38, v_num=1, val_acc=0.695]
Epoch 27:  68%|██████▊   | 80/117 [00:03<00:01, 21.72it/s, loss=2.41, v_num=1, val_acc=0.695]
Epoch 27:  69%|██████▉   | 81/117 [00:03<00:01, 21.94it/s, loss=2.41, v_num=1, val_acc=0.695]
Epoch 27:  69%|██████▉   | 81/117 [00:03<00:01, 21.79it/s, loss=2.39, v_num=1, val_acc=0.695]
Epoch 27:  70%|███████   | 82/117 [00:03<00:01, 21.99it/s, loss=2.39, v_num=1, val_acc=0.695]
Epoch 27:  70%|███████   | 82/117 [00:03<00:01, 21.84it/s, loss=2.39, v_num=1, val_acc=0.695]
Epoch 27:  71%|███████   | 83/117 [00:03<00:01, 22.06it/s, loss=2.39, v_num=1, val_acc=0.695]
Epoch 27:  71%|███████   | 83/117 [00:03<00:01, 21.91it/s, loss=2.37, v_num=1, val_acc=0.695]
Epoch 27:  72%|███████▏  | 84/117 [00:03<00:01, 22.12it/s, loss=2.37, v_num=1, val_acc=0.695]
Epoch 27:  72%|███████▏  | 84/117 [00:03<00:01, 21.97it/s, loss=2.37, v_num=1, val_acc=0.695]
Epoch 27:  73%|███████▎  | 85/117 [00:03<00:01, 22.18it/s, loss=2.37, v_num=1, val_acc=0.695]
Epoch 27:  73%|███████▎  | 85/117 [00:03<00:01, 22.04it/s, loss=2.37, v_num=1, val_acc=0.695]
Epoch 27:  74%|███████▎  | 86/117 [00:03<00:01, 22.25it/s, loss=2.37, v_num=1, val_acc=0.695]
Epoch 27:  74%|███████▎  | 86/117 [00:03<00:01, 22.10it/s, loss=2.29, v_num=1, val_acc=0.695]
Epoch 27:  74%|███████▍  | 87/117 [00:03<00:01, 22.31it/s, loss=2.29, v_num=1, val_acc=0.695]
Epoch 27:  74%|███████▍  | 87/117 [00:03<00:01, 22.16it/s, loss=2.18, v_num=1, val_acc=0.695]
Epoch 27:  75%|███████▌  | 88/117 [00:03<00:01, 22.37it/s, loss=2.18, v_num=1, val_acc=0.695]
Epoch 27:  75%|███████▌  | 88/117 [00:03<00:01, 22.22it/s, loss=2.16, v_num=1, val_acc=0.695]
Epoch 27:  76%|███████▌  | 89/117 [00:03<00:01, 22.42it/s, loss=2.16, v_num=1, val_acc=0.695]
Epoch 27:  76%|███████▌  | 89/117 [00:03<00:01, 22.28it/s, loss=2.13, v_num=1, val_acc=0.695]
Epoch 27:  77%|███████▋  | 90/117 [00:04<00:01, 22.48it/s, loss=2.13, v_num=1, val_acc=0.695]
Epoch 27:  77%|███████▋  | 90/117 [00:04<00:01, 22.34it/s, loss=2.13, v_num=1, val_acc=0.695]
Epoch 27:  78%|███████▊  | 91/117 [00:04<00:01, 22.54it/s, loss=2.13, v_num=1, val_acc=0.695]
Epoch 27:  78%|███████▊  | 91/117 [00:04<00:01, 22.40it/s, loss=2.11, v_num=1, val_acc=0.695]
Epoch 27:  79%|███████▊  | 92/117 [00:04<00:01, 22.59it/s, loss=2.11, v_num=1, val_acc=0.695]
Epoch 27:  79%|███████▊  | 92/117 [00:04<00:01, 22.45it/s, loss=2.11, v_num=1, val_acc=0.695]
Epoch 27:  79%|███████▉  | 93/117 [00:04<00:01, 22.65it/s, loss=2.11, v_num=1, val_acc=0.695]
Epoch 27:  79%|███████▉  | 93/117 [00:04<00:01, 22.51it/s, loss=2.17, v_num=1, val_acc=0.695]
Epoch 27:  80%|████████  | 94/117 [00:04<00:01, 22.69it/s, loss=2.17, v_num=1, val_acc=0.695]
Epoch 27:  80%|████████  | 94/117 [00:04<00:01, 22.55it/s, loss=2.32, v_num=1, val_acc=0.695]
Epoch 27:  81%|████████  | 95/117 [00:04<00:00, 22.74it/s, loss=2.32, v_num=1, val_acc=0.695]
Epoch 27:  81%|████████  | 95/117 [00:04<00:00, 22.61it/s, loss=2.37, v_num=1, val_acc=0.695]
Epoch 27:  82%|████████▏ | 96/117 [00:04<00:00, 22.79it/s, loss=2.37, v_num=1, val_acc=0.695]
Epoch 27:  82%|████████▏ | 96/117 [00:04<00:00, 22.66it/s, loss=2.39, v_num=1, val_acc=0.695]
Epoch 27:  83%|████████▎ | 97/117 [00:04<00:00, 22.84it/s, loss=2.39, v_num=1, val_acc=0.695]
Epoch 27:  83%|████████▎ | 97/117 [00:04<00:00, 22.71it/s, loss=2.32, v_num=1, val_acc=0.695]

Validation: 0it [00:00, ?it/s]

Validation:   0%|          | 0/20 [00:00<?, ?it/s]

Validation DataLoader 0:   0%|          | 0/20 [00:00<?, ?it/s]

Validation DataLoader 0:   5%|▌         | 1/20 [00:00<00:00, 185.75it/s]
Epoch 27:  84%|████████▍ | 98/117 [00:05<00:00, 19.24it/s, loss=2.32, v_num=1, val_acc=0.695]

Validation DataLoader 0:  10%|█         | 2/20 [00:00<00:00, 55.45it/s]
Epoch 27:  85%|████████▍ | 99/117 [00:05<00:00, 19.32it/s, loss=2.32, v_num=1, val_acc=0.695]

Validation DataLoader 0:  15%|█▌        | 3/20 [00:00<00:00, 44.40it/s]
Epoch 27:  85%|████████▌ | 100/117 [00:05<00:00, 19.39it/s, loss=2.32, v_num=1, val_acc=0.695]

Validation DataLoader 0:  20%|██        | 4/20 [00:00<00:00, 40.34it/s]
Epoch 27:  86%|████████▋ | 101/117 [00:05<00:00, 19.47it/s, loss=2.32, v_num=1, val_acc=0.695]

Validation DataLoader 0:  25%|██▌       | 5/20 [00:00<00:00, 37.90it/s]
Epoch 27:  87%|████████▋ | 102/117 [00:05<00:00, 19.54it/s, loss=2.32, v_num=1, val_acc=0.695]

Validation DataLoader 0:  30%|███       | 6/20 [00:00<00:00, 36.74it/s]
Epoch 27:  88%|████████▊ | 103/117 [00:05<00:00, 19.61it/s, loss=2.32, v_num=1, val_acc=0.695]

Validation DataLoader 0:  35%|███▌      | 7/20 [00:00<00:00, 35.85it/s]
Epoch 27:  89%|████████▉ | 104/117 [00:05<00:00, 19.68it/s, loss=2.32, v_num=1, val_acc=0.695]

Validation DataLoader 0:  40%|████      | 8/20 [00:00<00:00, 35.27it/s]
Epoch 27:  90%|████████▉ | 105/117 [00:05<00:00, 19.75it/s, loss=2.32, v_num=1, val_acc=0.695]

Validation DataLoader 0:  45%|████▌     | 9/20 [00:00<00:00, 34.83it/s]
Epoch 27:  91%|█████████ | 106/117 [00:05<00:00, 19.82it/s, loss=2.32, v_num=1, val_acc=0.695]

Validation DataLoader 0:  50%|█████     | 10/20 [00:00<00:00, 34.50it/s]
Epoch 27:  91%|█████████▏| 107/117 [00:05<00:00, 19.89it/s, loss=2.32, v_num=1, val_acc=0.695]

Validation DataLoader 0:  55%|█████▌    | 11/20 [00:00<00:00, 34.25it/s]
Epoch 27:  92%|█████████▏| 108/117 [00:05<00:00, 19.96it/s, loss=2.32, v_num=1, val_acc=0.695]

Validation DataLoader 0:  60%|██████    | 12/20 [00:00<00:00, 34.03it/s]
Epoch 27:  93%|█████████▎| 109/117 [00:05<00:00, 20.03it/s, loss=2.32, v_num=1, val_acc=0.695]

Validation DataLoader 0:  65%|██████▌   | 13/20 [00:00<00:00, 33.84it/s]
Epoch 27:  94%|█████████▍| 110/117 [00:05<00:00, 20.10it/s, loss=2.32, v_num=1, val_acc=0.695]

Validation DataLoader 0:  70%|███████   | 14/20 [00:00<00:00, 33.68it/s]
Epoch 27:  95%|█████████▍| 111/117 [00:05<00:00, 20.16it/s, loss=2.32, v_num=1, val_acc=0.695]

Validation DataLoader 0:  75%|███████▌  | 15/20 [00:00<00:00, 33.56it/s]
Epoch 27:  96%|█████████▌| 112/117 [00:05<00:00, 20.23it/s, loss=2.32, v_num=1, val_acc=0.695]

Validation DataLoader 0:  80%|████████  | 16/20 [00:00<00:00, 33.44it/s]
Epoch 27:  97%|█████████▋| 113/117 [00:05<00:00, 20.30it/s, loss=2.32, v_num=1, val_acc=0.695]

Validation DataLoader 0:  85%|████████▌ | 17/20 [00:00<00:00, 33.32it/s]
Epoch 27:  97%|█████████▋| 114/117 [00:05<00:00, 20.36it/s, loss=2.32, v_num=1, val_acc=0.695]

Validation DataLoader 0:  90%|█████████ | 18/20 [00:00<00:00, 33.23it/s]
Epoch 27:  98%|█████████▊| 115/117 [00:05<00:00, 20.42it/s, loss=2.32, v_num=1, val_acc=0.695]

Validation DataLoader 0:  95%|█████████▌| 19/20 [00:00<00:00, 33.15it/s]
Epoch 27:  99%|█████████▉| 116/117 [00:05<00:00, 20.49it/s, loss=2.32, v_num=1, val_acc=0.695]

Validation DataLoader 0: 100%|██████████| 20/20 [00:00<00:00, 33.14it/s]
Epoch 27: 100%|██████████| 117/117 [00:05<00:00, 20.55it/s, loss=2.32, v_num=1, val_acc=0.695]
Epoch 27: 100%|██████████| 117/117 [00:05<00:00, 20.48it/s, loss=2.32, v_num=1, val_acc=0.659]


Epoch 27: 100%|██████████| 117/117 [00:05<00:00, 20.48it/s, loss=2.32, v_num=1, val_acc=0.659]
Epoch 27:   0%|          | 0/117 [00:00<?, ?it/s, loss=2.32, v_num=1, val_acc=0.659]
Epoch 28:   0%|          | 0/117 [00:00<?, ?it/s, loss=2.32, v_num=1, val_acc=0.659]
Epoch 28:   1%|          | 1/117 [00:00<01:44,  1.11it/s, loss=2.32, v_num=1, val_acc=0.659]
Epoch 28:   1%|          | 1/117 [00:00<01:47,  1.08it/s, loss=2.31, v_num=1, val_acc=0.659]
Epoch 28:   2%|▏         | 2/117 [00:00<00:54,  2.12it/s, loss=2.31, v_num=1, val_acc=0.659]
Epoch 28:   2%|▏         | 2/117 [00:00<00:55,  2.07it/s, loss=2.28, v_num=1, val_acc=0.659]
Epoch 28:   3%|▎         | 3/117 [00:00<00:37,  3.06it/s, loss=2.28, v_num=1, val_acc=0.659]
Epoch 28:   3%|▎         | 3/117 [00:01<00:38,  2.99it/s, loss=2.22, v_num=1, val_acc=0.659]
Epoch 28:   3%|▎         | 4/117 [00:01<00:28,  3.96it/s, loss=2.22, v_num=1, val_acc=0.659]
Epoch 28:   3%|▎         | 4/117 [00:01<00:29,  3.86it/s, loss=2.19, v_num=1, val_acc=0.659]
Epoch 28:   4%|▍         | 5/117 [00:01<00:23,  4.78it/s, loss=2.19, v_num=1, val_acc=0.659]
Epoch 28:   4%|▍         | 5/117 [00:01<00:23,  4.67it/s, loss=2.2, v_num=1, val_acc=0.659]
Epoch 28:   5%|▌         | 6/117 [00:01<00:19,  5.55it/s, loss=2.2, v_num=1, val_acc=0.659]
Epoch 28:   5%|▌         | 6/117 [00:01<00:20,  5.43it/s, loss=2.27, v_num=1, val_acc=0.659]
Epoch 28:   6%|▌         | 7/117 [00:01<00:17,  6.28it/s, loss=2.27, v_num=1, val_acc=0.659]
Epoch 28:   6%|▌         | 7/117 [00:01<00:17,  6.14it/s, loss=2.26, v_num=1, val_acc=0.659]
Epoch 28:   7%|▋         | 8/117 [00:01<00:15,  6.97it/s, loss=2.26, v_num=1, val_acc=0.659]
Epoch 28:   7%|▋         | 8/117 [00:01<00:15,  6.82it/s, loss=2.25, v_num=1, val_acc=0.659]
Epoch 28:   8%|▊         | 9/117 [00:01<00:14,  7.61it/s, loss=2.25, v_num=1, val_acc=0.659]
Epoch 28:   8%|▊         | 9/117 [00:01<00:14,  7.45it/s, loss=2.21, v_num=1, val_acc=0.659]
Epoch 28:   9%|▊         | 10/117 [00:01<00:13,  8.17it/s, loss=2.21, v_num=1, val_acc=0.659]
Epoch 28:   9%|▊         | 10/117 [00:01<00:13,  8.01it/s, loss=2.2, v_num=1, val_acc=0.659]
Epoch 28:   9%|▉         | 11/117 [00:01<00:12,  8.75it/s, loss=2.2, v_num=1, val_acc=0.659]
Epoch 28:   9%|▉         | 11/117 [00:01<00:12,  8.58it/s, loss=2.21, v_num=1, val_acc=0.659]
Epoch 28:  10%|█         | 12/117 [00:01<00:11,  9.30it/s, loss=2.21, v_num=1, val_acc=0.659]
Epoch 28:  10%|█         | 12/117 [00:01<00:11,  9.12it/s, loss=2.22, v_num=1, val_acc=0.659]
Epoch 28:  11%|█         | 13/117 [00:01<00:10,  9.81it/s, loss=2.22, v_num=1, val_acc=0.659]
Epoch 28:  11%|█         | 13/117 [00:01<00:10,  9.63it/s, loss=2.22, v_num=1, val_acc=0.659]
Epoch 28:  12%|█▏        | 14/117 [00:01<00:10, 10.30it/s, loss=2.22, v_num=1, val_acc=0.659]
Epoch 28:  12%|█▏        | 14/117 [00:01<00:10, 10.11it/s, loss=2.23, v_num=1, val_acc=0.659]
Epoch 28:  13%|█▎        | 15/117 [00:01<00:09, 10.76it/s, loss=2.23, v_num=1, val_acc=0.659]
Epoch 28:  13%|█▎        | 15/117 [00:01<00:09, 10.57it/s, loss=2.24, v_num=1, val_acc=0.659]
Epoch 28:  14%|█▎        | 16/117 [00:01<00:09, 11.20it/s, loss=2.24, v_num=1, val_acc=0.659]
Epoch 28:  14%|█▎        | 16/117 [00:01<00:09, 11.01it/s, loss=2.18, v_num=1, val_acc=0.659]
Epoch 28:  15%|█▍        | 17/117 [00:01<00:08, 11.62it/s, loss=2.18, v_num=1, val_acc=0.659]
Epoch 28:  15%|█▍        | 17/117 [00:01<00:08, 11.43it/s, loss=2.02, v_num=1, val_acc=0.659]
Epoch 28:  15%|█▌        | 18/117 [00:01<00:08, 12.00it/s, loss=2.02, v_num=1, val_acc=0.659]
Epoch 28:  15%|█▌        | 18/117 [00:01<00:08, 11.80it/s, loss=1.97, v_num=1, val_acc=0.659]
Epoch 28:  16%|█▌        | 19/117 [00:01<00:07, 12.39it/s, loss=1.97, v_num=1, val_acc=0.659]
Epoch 28:  16%|█▌        | 19/117 [00:01<00:08, 12.19it/s, loss=1.93, v_num=1, val_acc=0.659]
Epoch 28:  17%|█▋        | 20/117 [00:01<00:07, 12.75it/s, loss=1.93, v_num=1, val_acc=0.659]
Epoch 28:  17%|█▋        | 20/117 [00:01<00:07, 12.55it/s, loss=1.91, v_num=1, val_acc=0.659]
Epoch 28:  18%|█▊        | 21/117 [00:01<00:07, 13.10it/s, loss=1.91, v_num=1, val_acc=0.659]
Epoch 28:  18%|█▊        | 21/117 [00:01<00:07, 12.90it/s, loss=1.87, v_num=1, val_acc=0.659]
Epoch 28:  19%|█▉        | 22/117 [00:01<00:07, 13.44it/s, loss=1.87, v_num=1, val_acc=0.659]
Epoch 28:  19%|█▉        | 22/117 [00:01<00:07, 13.23it/s, loss=1.89, v_num=1, val_acc=0.659]
Epoch 28:  20%|█▉        | 23/117 [00:01<00:06, 13.76it/s, loss=1.89, v_num=1, val_acc=0.659]
Epoch 28:  20%|█▉        | 23/117 [00:01<00:06, 13.55it/s, loss=1.91, v_num=1, val_acc=0.659]
Epoch 28:  21%|██        | 24/117 [00:01<00:06, 14.06it/s, loss=1.91, v_num=1, val_acc=0.659]
Epoch 28:  21%|██        | 24/117 [00:01<00:06, 13.86it/s, loss=1.94, v_num=1, val_acc=0.659]
Epoch 28:  21%|██▏       | 25/117 [00:01<00:06, 14.36it/s, loss=1.94, v_num=1, val_acc=0.659]
Epoch 28:  21%|██▏       | 25/117 [00:01<00:06, 14.15it/s, loss=1.9, v_num=1, val_acc=0.659]
Epoch 28:  22%|██▏       | 26/117 [00:01<00:06, 14.63it/s, loss=1.9, v_num=1, val_acc=0.659]
Epoch 28:  22%|██▏       | 26/117 [00:01<00:06, 14.43it/s, loss=1.82, v_num=1, val_acc=0.659]
Epoch 28:  23%|██▎       | 27/117 [00:01<00:06, 14.91it/s, loss=1.82, v_num=1, val_acc=0.659]
Epoch 28:  23%|██▎       | 27/117 [00:01<00:06, 14.71it/s, loss=1.85, v_num=1, val_acc=0.659]
Epoch 28:  24%|██▍       | 28/117 [00:01<00:05, 15.18it/s, loss=1.85, v_num=1, val_acc=0.659]
Epoch 28:  24%|██▍       | 28/117 [00:01<00:05, 14.98it/s, loss=1.84, v_num=1, val_acc=0.659]
Epoch 28:  25%|██▍       | 29/117 [00:01<00:05, 15.42it/s, loss=1.84, v_num=1, val_acc=0.659]
Epoch 28:  25%|██▍       | 29/117 [00:01<00:05, 15.23it/s, loss=1.88, v_num=1, val_acc=0.659]
Epoch 28:  26%|██▌       | 30/117 [00:01<00:05, 15.68it/s, loss=1.88, v_num=1, val_acc=0.659]
Epoch 28:  26%|██▌       | 30/117 [00:01<00:05, 15.48it/s, loss=1.88, v_num=1, val_acc=0.659]
Epoch 28:  26%|██▋       | 31/117 [00:01<00:05, 15.92it/s, loss=1.88, v_num=1, val_acc=0.659]
Epoch 28:  26%|██▋       | 31/117 [00:01<00:05, 15.71it/s, loss=1.87, v_num=1, val_acc=0.659]
Epoch 28:  27%|██▋       | 32/117 [00:01<00:05, 16.15it/s, loss=1.87, v_num=1, val_acc=0.659]
Epoch 28:  27%|██▋       | 32/117 [00:02<00:05, 15.94it/s, loss=1.85, v_num=1, val_acc=0.659]
Epoch 28:  28%|██▊       | 33/117 [00:02<00:05, 16.37it/s, loss=1.85, v_num=1, val_acc=0.659]
Epoch 28:  28%|██▊       | 33/117 [00:02<00:05, 16.17it/s, loss=1.87, v_num=1, val_acc=0.659]
Epoch 28:  29%|██▉       | 34/117 [00:02<00:05, 16.58it/s, loss=1.87, v_num=1, val_acc=0.659]
Epoch 28:  29%|██▉       | 34/117 [00:02<00:05, 16.38it/s, loss=1.93, v_num=1, val_acc=0.659]
Epoch 28:  30%|██▉       | 35/117 [00:02<00:04, 16.78it/s, loss=1.93, v_num=1, val_acc=0.659]
Epoch 28:  30%|██▉       | 35/117 [00:02<00:04, 16.58it/s, loss=1.95, v_num=1, val_acc=0.659]
Epoch 28:  31%|███       | 36/117 [00:02<00:04, 16.97it/s, loss=1.95, v_num=1, val_acc=0.659]
Epoch 28:  31%|███       | 36/117 [00:02<00:04, 16.78it/s, loss=1.88, v_num=1, val_acc=0.659]
Epoch 28:  32%|███▏      | 37/117 [00:02<00:04, 17.16it/s, loss=1.88, v_num=1, val_acc=0.659]
Epoch 28:  32%|███▏      | 37/117 [00:02<00:04, 16.97it/s, loss=1.89, v_num=1, val_acc=0.659]
Epoch 28:  32%|███▏      | 38/117 [00:02<00:04, 17.35it/s, loss=1.89, v_num=1, val_acc=0.659]
Epoch 28:  32%|███▏      | 38/117 [00:02<00:04, 17.16it/s, loss=1.88, v_num=1, val_acc=0.659]
Epoch 28:  33%|███▎      | 39/117 [00:02<00:04, 17.54it/s, loss=1.88, v_num=1, val_acc=0.659]
Epoch 28:  33%|███▎      | 39/117 [00:02<00:04, 17.34it/s, loss=1.9, v_num=1, val_acc=0.659]
Epoch 28:  34%|███▍      | 40/117 [00:02<00:04, 17.71it/s, loss=1.9, v_num=1, val_acc=0.659]
Epoch 28:  34%|███▍      | 40/117 [00:02<00:04, 17.52it/s, loss=1.93, v_num=1, val_acc=0.659]
Epoch 28:  35%|███▌      | 41/117 [00:02<00:04, 17.88it/s, loss=1.93, v_num=1, val_acc=0.659]
Epoch 28:  35%|███▌      | 41/117 [00:02<00:04, 17.69it/s, loss=1.92, v_num=1, val_acc=0.659]
Epoch 28:  36%|███▌      | 42/117 [00:02<00:04, 18.05it/s, loss=1.92, v_num=1, val_acc=0.659]
Epoch 28:  36%|███▌      | 42/117 [00:02<00:04, 17.85it/s, loss=1.9, v_num=1, val_acc=0.659]
Epoch 28:  37%|███▋      | 43/117 [00:02<00:04, 18.21it/s, loss=1.9, v_num=1, val_acc=0.659]
Epoch 28:  37%|███▋      | 43/117 [00:02<00:04, 18.01it/s, loss=1.95, v_num=1, val_acc=0.659]
Epoch 28:  38%|███▊      | 44/117 [00:02<00:03, 18.36it/s, loss=1.95, v_num=1, val_acc=0.659]
Epoch 28:  38%|███▊      | 44/117 [00:02<00:04, 18.17it/s, loss=1.98, v_num=1, val_acc=0.659]
Epoch 28:  38%|███▊      | 45/117 [00:02<00:03, 18.51it/s, loss=1.98, v_num=1, val_acc=0.659]
Epoch 28:  38%|███▊      | 45/117 [00:02<00:03, 18.32it/s, loss=2.06, v_num=1, val_acc=0.659]
Epoch 28:  39%|███▉      | 46/117 [00:02<00:03, 18.66it/s, loss=2.06, v_num=1, val_acc=0.659]
Epoch 28:  39%|███▉      | 46/117 [00:02<00:03, 18.47it/s, loss=2.13, v_num=1, val_acc=0.659]
Epoch 28:  40%|████      | 47/117 [00:02<00:03, 18.81it/s, loss=2.13, v_num=1, val_acc=0.659]
Epoch 28:  40%|████      | 47/117 [00:02<00:03, 18.62it/s, loss=2.19, v_num=1, val_acc=0.659]
Epoch 28:  41%|████      | 48/117 [00:02<00:03, 18.95it/s, loss=2.19, v_num=1, val_acc=0.659]
Epoch 28:  41%|████      | 48/117 [00:02<00:03, 18.76it/s, loss=2.23, v_num=1, val_acc=0.659]
Epoch 28:  42%|████▏     | 49/117 [00:02<00:03, 19.09it/s, loss=2.23, v_num=1, val_acc=0.659]
Epoch 28:  42%|████▏     | 49/117 [00:02<00:03, 18.90it/s, loss=2.3, v_num=1, val_acc=0.659]
Epoch 28:  43%|████▎     | 50/117 [00:02<00:03, 19.22it/s, loss=2.3, v_num=1, val_acc=0.659]
Epoch 28:  43%|████▎     | 50/117 [00:02<00:03, 19.03it/s, loss=2.38, v_num=1, val_acc=0.659]
Epoch 28:  44%|████▎     | 51/117 [00:02<00:03, 19.31it/s, loss=2.38, v_num=1, val_acc=0.659]
Epoch 28:  44%|████▎     | 51/117 [00:02<00:03, 19.14it/s, loss=2.43, v_num=1, val_acc=0.659]
Epoch 28:  44%|████▍     | 52/117 [00:02<00:03, 19.44it/s, loss=2.43, v_num=1, val_acc=0.659]
Epoch 28:  44%|████▍     | 52/117 [00:02<00:03, 19.26it/s, loss=2.47, v_num=1, val_acc=0.659]
Epoch 28:  45%|████▌     | 53/117 [00:02<00:03, 19.56it/s, loss=2.47, v_num=1, val_acc=0.659]
Epoch 28:  45%|████▌     | 53/117 [00:02<00:03, 19.38it/s, loss=2.48, v_num=1, val_acc=0.659]
Epoch 28:  46%|████▌     | 54/117 [00:02<00:03, 19.69it/s, loss=2.48, v_num=1, val_acc=0.659]
Epoch 28:  46%|████▌     | 54/117 [00:02<00:03, 19.51it/s, loss=2.53, v_num=1, val_acc=0.659]
Epoch 28:  47%|████▋     | 55/117 [00:02<00:03, 19.80it/s, loss=2.53, v_num=1, val_acc=0.659]
Epoch 28:  47%|████▋     | 55/117 [00:02<00:03, 19.62it/s, loss=2.54, v_num=1, val_acc=0.659]
Epoch 28:  48%|████▊     | 56/117 [00:02<00:03, 19.91it/s, loss=2.54, v_num=1, val_acc=0.659]
Epoch 28:  48%|████▊     | 56/117 [00:02<00:03, 19.74it/s, loss=2.57, v_num=1, val_acc=0.659]
Epoch 28:  49%|████▊     | 57/117 [00:02<00:02, 20.02it/s, loss=2.57, v_num=1, val_acc=0.659]
Epoch 28:  49%|████▊     | 57/117 [00:02<00:03, 19.85it/s, loss=2.55, v_num=1, val_acc=0.659]
Epoch 28:  50%|████▉     | 58/117 [00:02<00:02, 20.13it/s, loss=2.55, v_num=1, val_acc=0.659]
Epoch 28:  50%|████▉     | 58/117 [00:02<00:02, 19.95it/s, loss=2.54, v_num=1, val_acc=0.659]
Epoch 28:  50%|█████     | 59/117 [00:02<00:02, 20.23it/s, loss=2.54, v_num=1, val_acc=0.659]
Epoch 28:  50%|█████     | 59/117 [00:02<00:02, 20.05it/s, loss=2.53, v_num=1, val_acc=0.659]
Epoch 28:  51%|█████▏    | 60/117 [00:02<00:02, 20.31it/s, loss=2.53, v_num=1, val_acc=0.659]
Epoch 28:  51%|█████▏    | 60/117 [00:02<00:02, 20.14it/s, loss=2.48, v_num=1, val_acc=0.659]
Epoch 28:  52%|█████▏    | 61/117 [00:02<00:02, 20.42it/s, loss=2.48, v_num=1, val_acc=0.659]
Epoch 28:  52%|█████▏    | 61/117 [00:03<00:02, 20.25it/s, loss=2.52, v_num=1, val_acc=0.659]
Epoch 28:  53%|█████▎    | 62/117 [00:03<00:02, 20.52it/s, loss=2.52, v_num=1, val_acc=0.659]
Epoch 28:  53%|█████▎    | 62/117 [00:03<00:02, 20.35it/s, loss=2.53, v_num=1, val_acc=0.659]
Epoch 28:  54%|█████▍    | 63/117 [00:03<00:02, 20.62it/s, loss=2.53, v_num=1, val_acc=0.659]
Epoch 28:  54%|█████▍    | 63/117 [00:03<00:02, 20.45it/s, loss=2.51, v_num=1, val_acc=0.659]
Epoch 28:  55%|█████▍    | 64/117 [00:03<00:02, 20.71it/s, loss=2.51, v_num=1, val_acc=0.659]
Epoch 28:  55%|█████▍    | 64/117 [00:03<00:02, 20.54it/s, loss=2.44, v_num=1, val_acc=0.659]
Epoch 28:  56%|█████▌    | 65/117 [00:03<00:02, 20.81it/s, loss=2.44, v_num=1, val_acc=0.659]
Epoch 28:  56%|█████▌    | 65/117 [00:03<00:02, 20.64it/s, loss=2.36, v_num=1, val_acc=0.659]
Epoch 28:  56%|█████▋    | 66/117 [00:03<00:02, 20.90it/s, loss=2.36, v_num=1, val_acc=0.659]
Epoch 28:  56%|█████▋    | 66/117 [00:03<00:02, 20.73it/s, loss=2.3, v_num=1, val_acc=0.659]
Epoch 28:  57%|█████▋    | 67/117 [00:03<00:02, 20.98it/s, loss=2.3, v_num=1, val_acc=0.659]
Epoch 28:  57%|█████▋    | 67/117 [00:03<00:02, 20.82it/s, loss=2.23, v_num=1, val_acc=0.659]
Epoch 28:  58%|█████▊    | 68/117 [00:03<00:02, 21.07it/s, loss=2.23, v_num=1, val_acc=0.659]
Epoch 28:  58%|█████▊    | 68/117 [00:03<00:02, 20.91it/s, loss=2.22, v_num=1, val_acc=0.659]
Epoch 28:  59%|█████▉    | 69/117 [00:03<00:02, 21.16it/s, loss=2.22, v_num=1, val_acc=0.659]
Epoch 28:  59%|█████▉    | 69/117 [00:03<00:02, 20.99it/s, loss=2.21, v_num=1, val_acc=0.659]
Epoch 28:  60%|█████▉    | 70/117 [00:03<00:02, 21.24it/s, loss=2.21, v_num=1, val_acc=0.659]
Epoch 28:  60%|█████▉    | 70/117 [00:03<00:02, 21.08it/s, loss=2.16, v_num=1, val_acc=0.659]
Epoch 28:  61%|██████    | 71/117 [00:03<00:02, 21.32it/s, loss=2.16, v_num=1, val_acc=0.659]
Epoch 28:  61%|██████    | 71/117 [00:03<00:02, 21.16it/s, loss=2.13, v_num=1, val_acc=0.659]
Epoch 28:  62%|██████▏   | 72/117 [00:03<00:02, 21.40it/s, loss=2.13, v_num=1, val_acc=0.659]
Epoch 28:  62%|██████▏   | 72/117 [00:03<00:02, 21.24it/s, loss=2.1, v_num=1, val_acc=0.659]
Epoch 28:  62%|██████▏   | 73/117 [00:03<00:02, 21.48it/s, loss=2.1, v_num=1, val_acc=0.659]
Epoch 28:  62%|██████▏   | 73/117 [00:03<00:02, 21.32it/s, loss=2.04, v_num=1, val_acc=0.659]
Epoch 28:  63%|██████▎   | 74/117 [00:03<00:01, 21.56it/s, loss=2.04, v_num=1, val_acc=0.659]
Epoch 28:  63%|██████▎   | 74/117 [00:03<00:02, 21.40it/s, loss=1.91, v_num=1, val_acc=0.659]
Epoch 28:  64%|██████▍   | 75/117 [00:03<00:01, 21.63it/s, loss=1.91, v_num=1, val_acc=0.659]
Epoch 28:  64%|██████▍   | 75/117 [00:03<00:01, 21.47it/s, loss=1.92, v_num=1, val_acc=0.659]
Epoch 28:  65%|██████▍   | 76/117 [00:03<00:01, 21.71it/s, loss=1.92, v_num=1, val_acc=0.659]
Epoch 28:  65%|██████▍   | 76/117 [00:03<00:01, 21.55it/s, loss=1.92, v_num=1, val_acc=0.659]
Epoch 28:  66%|██████▌   | 77/117 [00:03<00:01, 21.78it/s, loss=1.92, v_num=1, val_acc=0.659]
Epoch 28:  66%|██████▌   | 77/117 [00:03<00:01, 21.62it/s, loss=1.93, v_num=1, val_acc=0.659]
Epoch 28:  67%|██████▋   | 78/117 [00:03<00:01, 21.85it/s, loss=1.93, v_num=1, val_acc=0.659]
Epoch 28:  67%|██████▋   | 78/117 [00:03<00:01, 21.70it/s, loss=1.96, v_num=1, val_acc=0.659]
Epoch 28:  68%|██████▊   | 79/117 [00:03<00:01, 21.92it/s, loss=1.96, v_num=1, val_acc=0.659]
Epoch 28:  68%|██████▊   | 79/117 [00:03<00:01, 21.77it/s, loss=2.02, v_num=1, val_acc=0.659]
Epoch 28:  68%|██████▊   | 80/117 [00:03<00:01, 21.99it/s, loss=2.02, v_num=1, val_acc=0.659]
Epoch 28:  68%|██████▊   | 80/117 [00:03<00:01, 21.84it/s, loss=2.05, v_num=1, val_acc=0.659]
Epoch 28:  69%|██████▉   | 81/117 [00:03<00:01, 22.05it/s, loss=2.05, v_num=1, val_acc=0.659]
Epoch 28:  69%|██████▉   | 81/117 [00:03<00:01, 21.90it/s, loss=2.05, v_num=1, val_acc=0.659]
Epoch 28:  70%|███████   | 82/117 [00:03<00:01, 22.09it/s, loss=2.05, v_num=1, val_acc=0.659]
Epoch 28:  70%|███████   | 82/117 [00:03<00:01, 21.94it/s, loss=2.04, v_num=1, val_acc=0.659]
Epoch 28:  71%|███████   | 83/117 [00:03<00:01, 22.16it/s, loss=2.04, v_num=1, val_acc=0.659]
Epoch 28:  71%|███████   | 83/117 [00:03<00:01, 22.01it/s, loss=2.01, v_num=1, val_acc=0.659]
Epoch 28:  72%|███████▏  | 84/117 [00:03<00:01, 22.22it/s, loss=2.01, v_num=1, val_acc=0.659]
Epoch 28:  72%|███████▏  | 84/117 [00:03<00:01, 22.07it/s, loss=2.03, v_num=1, val_acc=0.659]
Epoch 28:  73%|███████▎  | 85/117 [00:03<00:01, 22.28it/s, loss=2.03, v_num=1, val_acc=0.659]
Epoch 28:  73%|███████▎  | 85/117 [00:03<00:01, 22.13it/s, loss=2.06, v_num=1, val_acc=0.659]
Epoch 28:  74%|███████▎  | 86/117 [00:03<00:01, 22.34it/s, loss=2.06, v_num=1, val_acc=0.659]
Epoch 28:  74%|███████▎  | 86/117 [00:03<00:01, 22.20it/s, loss=2.17, v_num=1, val_acc=0.659]
Epoch 28:  74%|███████▍  | 87/117 [00:03<00:01, 22.40it/s, loss=2.17, v_num=1, val_acc=0.659]
Epoch 28:  74%|███████▍  | 87/117 [00:03<00:01, 22.26it/s, loss=2.18, v_num=1, val_acc=0.659]
Epoch 28:  75%|███████▌  | 88/117 [00:03<00:01, 22.46it/s, loss=2.18, v_num=1, val_acc=0.659]
Epoch 28:  75%|███████▌  | 88/117 [00:03<00:01, 22.32it/s, loss=2.15, v_num=1, val_acc=0.659]
Epoch 28:  76%|███████▌  | 89/117 [00:03<00:01, 22.52it/s, loss=2.15, v_num=1, val_acc=0.659]
Epoch 28:  76%|███████▌  | 89/117 [00:03<00:01, 22.38it/s, loss=2.1, v_num=1, val_acc=0.659]
Epoch 28:  77%|███████▋  | 90/117 [00:03<00:01, 22.58it/s, loss=2.1, v_num=1, val_acc=0.659]
Epoch 28:  77%|███████▋  | 90/117 [00:04<00:01, 22.44it/s, loss=2.15, v_num=1, val_acc=0.659]
Epoch 28:  78%|███████▊  | 91/117 [00:04<00:01, 22.64it/s, loss=2.15, v_num=1, val_acc=0.659]
Epoch 28:  78%|███████▊  | 91/117 [00:04<00:01, 22.49it/s, loss=2.3, v_num=1, val_acc=0.659]
Epoch 28:  79%|███████▊  | 92/117 [00:04<00:01, 22.69it/s, loss=2.3, v_num=1, val_acc=0.659]
Epoch 28:  79%|███████▊  | 92/117 [00:04<00:01, 22.55it/s, loss=2.33, v_num=1, val_acc=0.659]
Epoch 28:  79%|███████▉  | 93/117 [00:04<00:01, 22.75it/s, loss=2.33, v_num=1, val_acc=0.659]
Epoch 28:  79%|███████▉  | 93/117 [00:04<00:01, 22.61it/s, loss=2.36, v_num=1, val_acc=0.659]
Epoch 28:  80%|████████  | 94/117 [00:04<00:01, 22.80it/s, loss=2.36, v_num=1, val_acc=0.659]
Epoch 28:  80%|████████  | 94/117 [00:04<00:01, 22.66it/s, loss=2.33, v_num=1, val_acc=0.659]
Epoch 28:  81%|████████  | 95/117 [00:04<00:00, 22.86it/s, loss=2.33, v_num=1, val_acc=0.659]
Epoch 28:  81%|████████  | 95/117 [00:04<00:00, 22.72it/s, loss=2.23, v_num=1, val_acc=0.659]
Epoch 28:  82%|████████▏ | 96/117 [00:04<00:00, 22.91it/s, loss=2.23, v_num=1, val_acc=0.659]
Epoch 28:  82%|████████▏ | 96/117 [00:04<00:00, 22.77it/s, loss=2.22, v_num=1, val_acc=0.659]
Epoch 28:  83%|████████▎ | 97/117 [00:04<00:00, 22.96it/s, loss=2.22, v_num=1, val_acc=0.659]
Epoch 28:  83%|████████▎ | 97/117 [00:04<00:00, 22.82it/s, loss=2.22, v_num=1, val_acc=0.659]

Validation: 0it [00:00, ?it/s]

Validation:   0%|          | 0/20 [00:00<?, ?it/s]

Validation DataLoader 0:   0%|          | 0/20 [00:00<?, ?it/s]

Validation DataLoader 0:   5%|▌         | 1/20 [00:00<00:00, 133.51it/s]
Epoch 28:  84%|████████▍ | 98/117 [00:05<00:00, 19.29it/s, loss=2.22, v_num=1, val_acc=0.659]

Validation DataLoader 0:  10%|█         | 2/20 [00:00<00:00, 55.12it/s]
Epoch 28:  85%|████████▍ | 99/117 [00:05<00:00, 19.38it/s, loss=2.22, v_num=1, val_acc=0.659]

Validation DataLoader 0:  15%|█▌        | 3/20 [00:00<00:00, 42.35it/s]
Epoch 28:  85%|████████▌ | 100/117 [00:05<00:00, 19.44it/s, loss=2.22, v_num=1, val_acc=0.659]

Validation DataLoader 0:  20%|██        | 4/20 [00:00<00:00, 39.53it/s]
Epoch 28:  86%|████████▋ | 101/117 [00:05<00:00, 19.52it/s, loss=2.22, v_num=1, val_acc=0.659]

Validation DataLoader 0:  25%|██▌       | 5/20 [00:00<00:00, 37.53it/s]
Epoch 28:  87%|████████▋ | 102/117 [00:05<00:00, 19.59it/s, loss=2.22, v_num=1, val_acc=0.659]

Validation DataLoader 0:  30%|███       | 6/20 [00:00<00:00, 36.44it/s]
Epoch 28:  88%|████████▊ | 103/117 [00:05<00:00, 19.67it/s, loss=2.22, v_num=1, val_acc=0.659]

Validation DataLoader 0:  35%|███▌      | 7/20 [00:00<00:00, 35.67it/s]
Epoch 28:  89%|████████▉ | 104/117 [00:05<00:00, 19.74it/s, loss=2.22, v_num=1, val_acc=0.659]

Validation DataLoader 0:  40%|████      | 8/20 [00:00<00:00, 35.14it/s]
Epoch 28:  90%|████████▉ | 105/117 [00:05<00:00, 19.81it/s, loss=2.22, v_num=1, val_acc=0.659]

Validation DataLoader 0:  45%|████▌     | 9/20 [00:00<00:00, 34.74it/s]
Epoch 28:  91%|█████████ | 106/117 [00:05<00:00, 19.88it/s, loss=2.22, v_num=1, val_acc=0.659]

Validation DataLoader 0:  50%|█████     | 10/20 [00:00<00:00, 34.44it/s]
Epoch 28:  91%|█████████▏| 107/117 [00:05<00:00, 19.95it/s, loss=2.22, v_num=1, val_acc=0.659]

Validation DataLoader 0:  55%|█████▌    | 11/20 [00:00<00:00, 34.19it/s]
Epoch 28:  92%|█████████▏| 108/117 [00:05<00:00, 20.02it/s, loss=2.22, v_num=1, val_acc=0.659]

Validation DataLoader 0:  60%|██████    | 12/20 [00:00<00:00, 33.97it/s]
Epoch 28:  93%|█████████▎| 109/117 [00:05<00:00, 20.09it/s, loss=2.22, v_num=1, val_acc=0.659]

Validation DataLoader 0:  65%|██████▌   | 13/20 [00:00<00:00, 33.78it/s]
Epoch 28:  94%|█████████▍| 110/117 [00:05<00:00, 20.16it/s, loss=2.22, v_num=1, val_acc=0.659]

Validation DataLoader 0:  70%|███████   | 14/20 [00:00<00:00, 33.63it/s]
Epoch 28:  95%|█████████▍| 111/117 [00:05<00:00, 20.22it/s, loss=2.22, v_num=1, val_acc=0.659]

Validation DataLoader 0:  75%|███████▌  | 15/20 [00:00<00:00, 33.52it/s]
Epoch 28:  96%|█████████▌| 112/117 [00:05<00:00, 20.29it/s, loss=2.22, v_num=1, val_acc=0.659]

Validation DataLoader 0:  80%|████████  | 16/20 [00:00<00:00, 33.40it/s]
Epoch 28:  97%|█████████▋| 113/117 [00:05<00:00, 20.36it/s, loss=2.22, v_num=1, val_acc=0.659]

Validation DataLoader 0:  85%|████████▌ | 17/20 [00:00<00:00, 33.27it/s]
Epoch 28:  97%|█████████▋| 114/117 [00:05<00:00, 20.42it/s, loss=2.22, v_num=1, val_acc=0.659]

Validation DataLoader 0:  90%|█████████ | 18/20 [00:00<00:00, 33.19it/s]
Epoch 28:  98%|█████████▊| 115/117 [00:05<00:00, 20.48it/s, loss=2.22, v_num=1, val_acc=0.659]

Validation DataLoader 0:  95%|█████████▌| 19/20 [00:00<00:00, 33.09it/s]
Epoch 28:  99%|█████████▉| 116/117 [00:05<00:00, 20.54it/s, loss=2.22, v_num=1, val_acc=0.659]

Validation DataLoader 0: 100%|██████████| 20/20 [00:00<00:00, 33.11it/s]
Epoch 28: 100%|██████████| 117/117 [00:05<00:00, 20.61it/s, loss=2.22, v_num=1, val_acc=0.659]
Epoch 28: 100%|██████████| 117/117 [00:05<00:00, 20.54it/s, loss=2.22, v_num=1, val_acc=0.665]


Epoch 28: 100%|██████████| 117/117 [00:05<00:00, 20.54it/s, loss=2.22, v_num=1, val_acc=0.665]
Epoch 28:   0%|          | 0/117 [00:00<?, ?it/s, loss=2.22, v_num=1, val_acc=0.665]
Epoch 29:   0%|          | 0/117 [00:00<?, ?it/s, loss=2.22, v_num=1, val_acc=0.665]
Epoch 29:   1%|          | 1/117 [00:00<01:45,  1.10it/s, loss=2.22, v_num=1, val_acc=0.665]
Epoch 29:   1%|          | 1/117 [00:00<01:48,  1.07it/s, loss=2.22, v_num=1, val_acc=0.665]
Epoch 29:   2%|▏         | 2/117 [00:00<00:54,  2.11it/s, loss=2.22, v_num=1, val_acc=0.665]
Epoch 29:   2%|▏         | 2/117 [00:00<00:55,  2.06it/s, loss=2.25, v_num=1, val_acc=0.665]
Epoch 29:   3%|▎         | 3/117 [00:00<00:37,  3.06it/s, loss=2.25, v_num=1, val_acc=0.665]
Epoch 29:   3%|▎         | 3/117 [00:01<00:38,  2.99it/s, loss=2.26, v_num=1, val_acc=0.665]
Epoch 29:   3%|▎         | 4/117 [00:01<00:28,  3.94it/s, loss=2.26, v_num=1, val_acc=0.665]
Epoch 29:   3%|▎         | 4/117 [00:01<00:29,  3.85it/s, loss=2.21, v_num=1, val_acc=0.665]
Epoch 29:   4%|▍         | 5/117 [00:01<00:23,  4.76it/s, loss=2.21, v_num=1, val_acc=0.665]
Epoch 29:   4%|▍         | 5/117 [00:01<00:24,  4.65it/s, loss=2.18, v_num=1, val_acc=0.665]
Epoch 29:   5%|▌         | 6/117 [00:01<00:20,  5.54it/s, loss=2.18, v_num=1, val_acc=0.665]
Epoch 29:   5%|▌         | 6/117 [00:01<00:20,  5.41it/s, loss=2.17, v_num=1, val_acc=0.665]
Epoch 29:   6%|▌         | 7/117 [00:01<00:17,  6.27it/s, loss=2.17, v_num=1, val_acc=0.665]
Epoch 29:   6%|▌         | 7/117 [00:01<00:17,  6.13it/s, loss=2.22, v_num=1, val_acc=0.665]
Epoch 29:   7%|▋         | 8/117 [00:01<00:15,  6.95it/s, loss=2.22, v_num=1, val_acc=0.665]
Epoch 29:   7%|▋         | 8/117 [00:01<00:16,  6.80it/s, loss=2.27, v_num=1, val_acc=0.665]
Epoch 29:   8%|▊         | 9/117 [00:01<00:14,  7.59it/s, loss=2.27, v_num=1, val_acc=0.665]
Epoch 29:   8%|▊         | 9/117 [00:01<00:14,  7.43it/s, loss=2.22, v_num=1, val_acc=0.665]
Epoch 29:   9%|▊         | 10/117 [00:01<00:13,  8.17it/s, loss=2.22, v_num=1, val_acc=0.665]
Epoch 29:   9%|▊         | 10/117 [00:01<00:13,  8.00it/s, loss=2.2, v_num=1, val_acc=0.665]
Epoch 29:   9%|▉         | 11/117 [00:01<00:12,  8.74it/s, loss=2.2, v_num=1, val_acc=0.665]
Epoch 29:   9%|▉         | 11/117 [00:01<00:12,  8.57it/s, loss=2.22, v_num=1, val_acc=0.665]
Epoch 29:  10%|█         | 12/117 [00:01<00:11,  9.28it/s, loss=2.22, v_num=1, val_acc=0.665]
Epoch 29:  10%|█         | 12/117 [00:01<00:11,  9.11it/s, loss=2.22, v_num=1, val_acc=0.665]
Epoch 29:  11%|█         | 13/117 [00:01<00:10,  9.79it/s, loss=2.22, v_num=1, val_acc=0.665]
Epoch 29:  11%|█         | 13/117 [00:01<00:10,  9.61it/s, loss=2.17, v_num=1, val_acc=0.665]
Epoch 29:  12%|█▏        | 14/117 [00:01<00:10, 10.28it/s, loss=2.17, v_num=1, val_acc=0.665]
Epoch 29:  12%|█▏        | 14/117 [00:01<00:10, 10.10it/s, loss=2.12, v_num=1, val_acc=0.665]
Epoch 29:  13%|█▎        | 15/117 [00:01<00:09, 10.75it/s, loss=2.12, v_num=1, val_acc=0.665]
Epoch 29:  13%|█▎        | 15/117 [00:01<00:09, 10.56it/s, loss=2.18, v_num=1, val_acc=0.665]
Epoch 29:  14%|█▎        | 16/117 [00:01<00:09, 11.19it/s, loss=2.18, v_num=1, val_acc=0.665]
Epoch 29:  14%|█▎        | 16/117 [00:01<00:09, 11.00it/s, loss=2.28, v_num=1, val_acc=0.665]
Epoch 29:  15%|█▍        | 17/117 [00:01<00:08, 11.61it/s, loss=2.28, v_num=1, val_acc=0.665]
Epoch 29:  15%|█▍        | 17/117 [00:01<00:08, 11.41it/s, loss=2.36, v_num=1, val_acc=0.665]
Epoch 29:  15%|█▌        | 18/117 [00:01<00:08, 12.00it/s, loss=2.36, v_num=1, val_acc=0.665]
Epoch 29:  15%|█▌        | 18/117 [00:01<00:08, 11.81it/s, loss=2.38, v_num=1, val_acc=0.665]
Epoch 29:  16%|█▌        | 19/117 [00:01<00:07, 12.39it/s, loss=2.38, v_num=1, val_acc=0.665]
Epoch 29:  16%|█▌        | 19/117 [00:01<00:08, 12.19it/s, loss=2.41, v_num=1, val_acc=0.665]
Epoch 29:  17%|█▋        | 20/117 [00:01<00:07, 12.74it/s, loss=2.41, v_num=1, val_acc=0.665]
Epoch 29:  17%|█▋        | 20/117 [00:01<00:07, 12.54it/s, loss=2.4, v_num=1, val_acc=0.665]
Epoch 29:  18%|█▊        | 21/117 [00:01<00:07, 13.10it/s, loss=2.4, v_num=1, val_acc=0.665]
Epoch 29:  18%|█▊        | 21/117 [00:01<00:07, 12.90it/s, loss=2.36, v_num=1, val_acc=0.665]
Epoch 29:  19%|█▉        | 22/117 [00:01<00:07, 13.43it/s, loss=2.36, v_num=1, val_acc=0.665]
Epoch 29:  19%|█▉        | 22/117 [00:01<00:07, 13.23it/s, loss=2.29, v_num=1, val_acc=0.665]
Epoch 29:  20%|█▉        | 23/117 [00:01<00:06, 13.76it/s, loss=2.29, v_num=1, val_acc=0.665]
Epoch 29:  20%|█▉        | 23/117 [00:01<00:06, 13.55it/s, loss=2.31, v_num=1, val_acc=0.665]
Epoch 29:  21%|██        | 24/117 [00:01<00:06, 14.04it/s, loss=2.31, v_num=1, val_acc=0.665]
Epoch 29:  21%|██        | 24/117 [00:01<00:06, 13.84it/s, loss=2.37, v_num=1, val_acc=0.665]
Epoch 29:  21%|██▏       | 25/117 [00:01<00:06, 14.35it/s, loss=2.37, v_num=1, val_acc=0.665]
Epoch 29:  21%|██▏       | 25/117 [00:01<00:06, 14.14it/s, loss=2.45, v_num=1, val_acc=0.665]
Epoch 29:  22%|██▏       | 26/117 [00:01<00:06, 14.64it/s, loss=2.45, v_num=1, val_acc=0.665]
Epoch 29:  22%|██▏       | 26/117 [00:01<00:06, 14.43it/s, loss=2.51, v_num=1, val_acc=0.665]
Epoch 29:  23%|██▎       | 27/117 [00:01<00:06, 14.92it/s, loss=2.51, v_num=1, val_acc=0.665]
Epoch 29:  23%|██▎       | 27/117 [00:01<00:06, 14.71it/s, loss=2.48, v_num=1, val_acc=0.665]
Epoch 29:  24%|██▍       | 28/117 [00:01<00:05, 15.18it/s, loss=2.48, v_num=1, val_acc=0.665]
Epoch 29:  24%|██▍       | 28/117 [00:01<00:05, 14.98it/s, loss=2.41, v_num=1, val_acc=0.665]
Epoch 29:  25%|██▍       | 29/117 [00:01<00:05, 15.42it/s, loss=2.41, v_num=1, val_acc=0.665]
Epoch 29:  25%|██▍       | 29/117 [00:01<00:05, 15.22it/s, loss=2.35, v_num=1, val_acc=0.665]
Epoch 29:  26%|██▌       | 30/117 [00:01<00:05, 15.64it/s, loss=2.35, v_num=1, val_acc=0.665]
Epoch 29:  26%|██▌       | 30/117 [00:01<00:05, 15.45it/s, loss=2.35, v_num=1, val_acc=0.665]
Epoch 29:  26%|██▋       | 31/117 [00:01<00:05, 15.84it/s, loss=2.35, v_num=1, val_acc=0.665]
Epoch 29:  26%|██▋       | 31/117 [00:01<00:05, 15.66it/s, loss=2.33, v_num=1, val_acc=0.665]
Epoch 29:  27%|██▋       | 32/117 [00:01<00:05, 16.08it/s, loss=2.33, v_num=1, val_acc=0.665]
Epoch 29:  27%|██▋       | 32/117 [00:02<00:05, 15.88it/s, loss=2.35, v_num=1, val_acc=0.665]
Epoch 29:  28%|██▊       | 33/117 [00:02<00:05, 16.31it/s, loss=2.35, v_num=1, val_acc=0.665]
Epoch 29:  28%|██▊       | 33/117 [00:02<00:05, 16.10it/s, loss=2.43, v_num=1, val_acc=0.665]
Epoch 29:  29%|██▉       | 34/117 [00:02<00:05, 16.53it/s, loss=2.43, v_num=1, val_acc=0.665]
Epoch 29:  29%|██▉       | 34/117 [00:02<00:05, 16.33it/s, loss=2.44, v_num=1, val_acc=0.665]
Epoch 29:  30%|██▉       | 35/117 [00:02<00:04, 16.74it/s, loss=2.44, v_num=1, val_acc=0.665]
Epoch 29:  30%|██▉       | 35/117 [00:02<00:04, 16.54it/s, loss=2.43, v_num=1, val_acc=0.665]
Epoch 29:  31%|███       | 36/117 [00:02<00:04, 16.94it/s, loss=2.43, v_num=1, val_acc=0.665]
Epoch 29:  31%|███       | 36/117 [00:02<00:04, 16.74it/s, loss=2.31, v_num=1, val_acc=0.665]
Epoch 29:  32%|███▏      | 37/117 [00:02<00:04, 17.13it/s, loss=2.31, v_num=1, val_acc=0.665]
Epoch 29:  32%|███▏      | 37/117 [00:02<00:04, 16.93it/s, loss=2.26, v_num=1, val_acc=0.665]
Epoch 29:  32%|███▏      | 38/117 [00:02<00:04, 17.31it/s, loss=2.26, v_num=1, val_acc=0.665]
Epoch 29:  32%|███▏      | 38/117 [00:02<00:04, 17.11it/s, loss=2.23, v_num=1, val_acc=0.665]
Epoch 29:  33%|███▎      | 39/117 [00:02<00:04, 17.50it/s, loss=2.23, v_num=1, val_acc=0.665]
Epoch 29:  33%|███▎      | 39/117 [00:02<00:04, 17.30it/s, loss=2.2, v_num=1, val_acc=0.665]
Epoch 29:  34%|███▍      | 40/117 [00:02<00:04, 17.66it/s, loss=2.2, v_num=1, val_acc=0.665]
Epoch 29:  34%|███▍      | 40/117 [00:02<00:04, 17.47it/s, loss=2.26, v_num=1, val_acc=0.665]
Epoch 29:  35%|███▌      | 41/117 [00:02<00:04, 17.84it/s, loss=2.26, v_num=1, val_acc=0.665]
Epoch 29:  35%|███▌      | 41/117 [00:02<00:04, 17.64it/s, loss=2.25, v_num=1, val_acc=0.665]
Epoch 29:  36%|███▌      | 42/117 [00:02<00:04, 18.01it/s, loss=2.25, v_num=1, val_acc=0.665]
Epoch 29:  36%|███▌      | 42/117 [00:02<00:04, 17.82it/s, loss=2.23, v_num=1, val_acc=0.665]
Epoch 29:  37%|███▋      | 43/117 [00:02<00:04, 18.12it/s, loss=2.23, v_num=1, val_acc=0.665]
Epoch 29:  37%|███▋      | 43/117 [00:02<00:04, 17.97it/s, loss=2.16, v_num=1, val_acc=0.665]
Epoch 29:  38%|███▊      | 44/117 [00:02<00:03, 18.33it/s, loss=2.16, v_num=1, val_acc=0.665]
Epoch 29:  38%|███▊      | 44/117 [00:02<00:04, 18.13it/s, loss=2.13, v_num=1, val_acc=0.665]
Epoch 29:  38%|███▊      | 45/117 [00:02<00:03, 18.48it/s, loss=2.13, v_num=1, val_acc=0.665]
Epoch 29:  38%|███▊      | 45/117 [00:02<00:03, 18.29it/s, loss=2.07, v_num=1, val_acc=0.665]
Epoch 29:  39%|███▉      | 46/117 [00:02<00:03, 18.63it/s, loss=2.07, v_num=1, val_acc=0.665]
Epoch 29:  39%|███▉      | 46/117 [00:02<00:03, 18.44it/s, loss=1.97, v_num=1, val_acc=0.665]
Epoch 29:  40%|████      | 47/117 [00:02<00:03, 18.77it/s, loss=1.97, v_num=1, val_acc=0.665]
Epoch 29:  40%|████      | 47/117 [00:02<00:03, 18.58it/s, loss=1.93, v_num=1, val_acc=0.665]
Epoch 29:  41%|████      | 48/117 [00:02<00:03, 18.91it/s, loss=1.93, v_num=1, val_acc=0.665]
Epoch 29:  41%|████      | 48/117 [00:02<00:03, 18.72it/s, loss=1.88, v_num=1, val_acc=0.665]
Epoch 29:  42%|████▏     | 49/117 [00:02<00:03, 19.05it/s, loss=1.88, v_num=1, val_acc=0.665]
Epoch 29:  42%|████▏     | 49/117 [00:02<00:03, 18.87it/s, loss=1.87, v_num=1, val_acc=0.665]
Epoch 29:  43%|████▎     | 50/117 [00:02<00:03, 19.19it/s, loss=1.87, v_num=1, val_acc=0.665]
Epoch 29:  43%|████▎     | 50/117 [00:02<00:03, 19.00it/s, loss=1.84, v_num=1, val_acc=0.665]
Epoch 29:  44%|████▎     | 51/117 [00:02<00:03, 19.31it/s, loss=1.84, v_num=1, val_acc=0.665]
Epoch 29:  44%|████▎     | 51/117 [00:02<00:03, 19.13it/s, loss=1.84, v_num=1, val_acc=0.665]
Epoch 29:  44%|████▍     | 52/117 [00:02<00:03, 19.44it/s, loss=1.84, v_num=1, val_acc=0.665]
Epoch 29:  44%|████▍     | 52/117 [00:02<00:03, 19.26it/s, loss=1.83, v_num=1, val_acc=0.665]
Epoch 29:  45%|████▌     | 53/117 [00:02<00:03, 19.56it/s, loss=1.83, v_num=1, val_acc=0.665]
Epoch 29:  45%|████▌     | 53/117 [00:02<00:03, 19.38it/s, loss=1.75, v_num=1, val_acc=0.665]
Epoch 29:  46%|████▌     | 54/117 [00:02<00:03, 19.68it/s, loss=1.75, v_num=1, val_acc=0.665]
Epoch 29:  46%|████▌     | 54/117 [00:02<00:03, 19.50it/s, loss=1.67, v_num=1, val_acc=0.665]
Epoch 29:  47%|████▋     | 55/117 [00:02<00:03, 19.79it/s, loss=1.67, v_num=1, val_acc=0.665]
Epoch 29:  47%|████▋     | 55/117 [00:02<00:03, 19.62it/s, loss=1.67, v_num=1, val_acc=0.665]
Epoch 29:  48%|████▊     | 56/117 [00:02<00:03, 19.91it/s, loss=1.67, v_num=1, val_acc=0.665]
Epoch 29:  48%|████▊     | 56/117 [00:02<00:03, 19.73it/s, loss=1.68, v_num=1, val_acc=0.665]
Epoch 29:  49%|████▊     | 57/117 [00:02<00:02, 20.02it/s, loss=1.68, v_num=1, val_acc=0.665]
Epoch 29:  49%|████▊     | 57/117 [00:02<00:03, 19.85it/s, loss=1.68, v_num=1, val_acc=0.665]
Epoch 29:  50%|████▉     | 58/117 [00:02<00:02, 20.13it/s, loss=1.68, v_num=1, val_acc=0.665]
Epoch 29:  50%|████▉     | 58/117 [00:02<00:02, 19.96it/s, loss=1.73, v_num=1, val_acc=0.665]
Epoch 29:  50%|█████     | 59/117 [00:02<00:02, 20.24it/s, loss=1.73, v_num=1, val_acc=0.665]
Epoch 29:  50%|█████     | 59/117 [00:02<00:02, 20.07it/s, loss=1.78, v_num=1, val_acc=0.665]
Epoch 29:  51%|█████▏    | 60/117 [00:02<00:02, 20.32it/s, loss=1.78, v_num=1, val_acc=0.665]
Epoch 29:  51%|█████▏    | 60/117 [00:02<00:02, 20.15it/s, loss=1.74, v_num=1, val_acc=0.665]
Epoch 29:  52%|█████▏    | 61/117 [00:02<00:02, 20.43it/s, loss=1.74, v_num=1, val_acc=0.665]
Epoch 29:  52%|█████▏    | 61/117 [00:03<00:02, 20.25it/s, loss=1.76, v_num=1, val_acc=0.665]
Epoch 29:  53%|█████▎    | 62/117 [00:03<00:02, 20.52it/s, loss=1.76, v_num=1, val_acc=0.665]
Epoch 29:  53%|█████▎    | 62/117 [00:03<00:02, 20.35it/s, loss=1.77, v_num=1, val_acc=0.665]
Epoch 29:  54%|█████▍    | 63/117 [00:03<00:02, 20.61it/s, loss=1.77, v_num=1, val_acc=0.665]
Epoch 29:  54%|█████▍    | 63/117 [00:03<00:02, 20.45it/s, loss=1.79, v_num=1, val_acc=0.665]
Epoch 29:  55%|█████▍    | 64/117 [00:03<00:02, 20.71it/s, loss=1.79, v_num=1, val_acc=0.665]
Epoch 29:  55%|█████▍    | 64/117 [00:03<00:02, 20.54it/s, loss=1.77, v_num=1, val_acc=0.665]
Epoch 29:  56%|█████▌    | 65/117 [00:03<00:02, 20.80it/s, loss=1.77, v_num=1, val_acc=0.665]
Epoch 29:  56%|█████▌    | 65/117 [00:03<00:02, 20.63it/s, loss=1.79, v_num=1, val_acc=0.665]
Epoch 29:  56%|█████▋    | 66/117 [00:03<00:02, 20.89it/s, loss=1.79, v_num=1, val_acc=0.665]
Epoch 29:  56%|█████▋    | 66/117 [00:03<00:02, 20.73it/s, loss=1.81, v_num=1, val_acc=0.665]
Epoch 29:  57%|█████▋    | 67/117 [00:03<00:02, 20.98it/s, loss=1.81, v_num=1, val_acc=0.665]
Epoch 29:  57%|█████▋    | 67/117 [00:03<00:02, 20.82it/s, loss=1.83, v_num=1, val_acc=0.665]
Epoch 29:  58%|█████▊    | 68/117 [00:03<00:02, 21.07it/s, loss=1.83, v_num=1, val_acc=0.665]
Epoch 29:  58%|█████▊    | 68/117 [00:03<00:02, 20.90it/s, loss=1.87, v_num=1, val_acc=0.665]
Epoch 29:  59%|█████▉    | 69/117 [00:03<00:02, 21.15it/s, loss=1.87, v_num=1, val_acc=0.665]
Epoch 29:  59%|█████▉    | 69/117 [00:03<00:02, 20.99it/s, loss=1.9, v_num=1, val_acc=0.665]
Epoch 29:  60%|█████▉    | 70/117 [00:03<00:02, 21.20it/s, loss=1.9, v_num=1, val_acc=0.665]
Epoch 29:  60%|█████▉    | 70/117 [00:03<00:02, 21.06it/s, loss=1.96, v_num=1, val_acc=0.665]
Epoch 29:  61%|██████    | 71/117 [00:03<00:02, 21.29it/s, loss=1.96, v_num=1, val_acc=0.665]
Epoch 29:  61%|██████    | 71/117 [00:03<00:02, 21.13it/s, loss=1.98, v_num=1, val_acc=0.665]
Epoch 29:  62%|██████▏   | 72/117 [00:03<00:02, 21.37it/s, loss=1.98, v_num=1, val_acc=0.665]
Epoch 29:  62%|██████▏   | 72/117 [00:03<00:02, 21.21it/s, loss=1.99, v_num=1, val_acc=0.665]
Epoch 29:  62%|██████▏   | 73/117 [00:03<00:02, 21.44it/s, loss=1.99, v_num=1, val_acc=0.665]
Epoch 29:  62%|██████▏   | 73/117 [00:03<00:02, 21.28it/s, loss=1.99, v_num=1, val_acc=0.665]
Epoch 29:  63%|██████▎   | 74/117 [00:03<00:01, 21.51it/s, loss=1.99, v_num=1, val_acc=0.665]
Epoch 29:  63%|██████▎   | 74/117 [00:03<00:02, 21.36it/s, loss=2, v_num=1, val_acc=0.665]
Epoch 29:  64%|██████▍   | 75/117 [00:03<00:01, 21.59it/s, loss=2, v_num=1, val_acc=0.665]
Epoch 29:  64%|██████▍   | 75/117 [00:03<00:01, 21.43it/s, loss=1.96, v_num=1, val_acc=0.665]
Epoch 29:  65%|██████▍   | 76/117 [00:03<00:01, 21.66it/s, loss=1.96, v_num=1, val_acc=0.665]
Epoch 29:  65%|██████▍   | 76/117 [00:03<00:01, 21.51it/s, loss=2, v_num=1, val_acc=0.665]
Epoch 29:  66%|██████▌   | 77/117 [00:03<00:01, 21.74it/s, loss=2, v_num=1, val_acc=0.665]
Epoch 29:  66%|██████▌   | 77/117 [00:03<00:01, 21.58it/s, loss=2.05, v_num=1, val_acc=0.665]
Epoch 29:  67%|██████▋   | 78/117 [00:03<00:01, 21.81it/s, loss=2.05, v_num=1, val_acc=0.665]
Epoch 29:  67%|██████▋   | 78/117 [00:03<00:01, 21.65it/s, loss=2.05, v_num=1, val_acc=0.665]
Epoch 29:  68%|██████▊   | 79/117 [00:03<00:01, 21.87it/s, loss=2.05, v_num=1, val_acc=0.665]
Epoch 29:  68%|██████▊   | 79/117 [00:03<00:01, 21.72it/s, loss=2.07, v_num=1, val_acc=0.665]
Epoch 29:  68%|██████▊   | 80/117 [00:03<00:01, 21.94it/s, loss=2.07, v_num=1, val_acc=0.665]
Epoch 29:  68%|██████▊   | 80/117 [00:03<00:01, 21.79it/s, loss=2.1, v_num=1, val_acc=0.665]
Epoch 29:  69%|██████▉   | 81/117 [00:03<00:01, 22.01it/s, loss=2.1, v_num=1, val_acc=0.665]
Epoch 29:  69%|██████▉   | 81/117 [00:03<00:01, 21.86it/s, loss=2.09, v_num=1, val_acc=0.665]
Epoch 29:  70%|███████   | 82/117 [00:03<00:01, 22.06it/s, loss=2.09, v_num=1, val_acc=0.665]
Epoch 29:  70%|███████   | 82/117 [00:03<00:01, 21.92it/s, loss=2.06, v_num=1, val_acc=0.665]
Epoch 29:  71%|███████   | 83/117 [00:03<00:01, 22.13it/s, loss=2.06, v_num=1, val_acc=0.665]
Epoch 29:  71%|███████   | 83/117 [00:03<00:01, 21.98it/s, loss=2.02, v_num=1, val_acc=0.665]
Epoch 29:  72%|███████▏  | 84/117 [00:03<00:01, 22.20it/s, loss=2.02, v_num=1, val_acc=0.665]
Epoch 29:  72%|███████▏  | 84/117 [00:03<00:01, 22.05it/s, loss=2.02, v_num=1, val_acc=0.665]
Epoch 29:  73%|███████▎  | 85/117 [00:03<00:01, 22.26it/s, loss=2.02, v_num=1, val_acc=0.665]
Epoch 29:  73%|███████▎  | 85/117 [00:03<00:01, 22.11it/s, loss=2.02, v_num=1, val_acc=0.665]
Epoch 29:  74%|███████▎  | 86/117 [00:03<00:01, 22.32it/s, loss=2.02, v_num=1, val_acc=0.665]
Epoch 29:  74%|███████▎  | 86/117 [00:03<00:01, 22.18it/s, loss=2.09, v_num=1, val_acc=0.665]
Epoch 29:  74%|███████▍  | 87/117 [00:03<00:01, 22.39it/s, loss=2.09, v_num=1, val_acc=0.665]
Epoch 29:  74%|███████▍  | 87/117 [00:03<00:01, 22.24it/s, loss=2.17, v_num=1, val_acc=0.665]
Epoch 29:  75%|███████▌  | 88/117 [00:03<00:01, 22.44it/s, loss=2.17, v_num=1, val_acc=0.665]
Epoch 29:  75%|███████▌  | 88/117 [00:03<00:01, 22.30it/s, loss=2.18, v_num=1, val_acc=0.665]
Epoch 29:  76%|███████▌  | 89/117 [00:03<00:01, 22.50it/s, loss=2.18, v_num=1, val_acc=0.665]
Epoch 29:  76%|███████▌  | 89/117 [00:03<00:01, 22.36it/s, loss=2.17, v_num=1, val_acc=0.665]
Epoch 29:  77%|███████▋  | 90/117 [00:03<00:01, 22.56it/s, loss=2.17, v_num=1, val_acc=0.665]
Epoch 29:  77%|███████▋  | 90/117 [00:04<00:01, 22.42it/s, loss=2.17, v_num=1, val_acc=0.665]
Epoch 29:  78%|███████▊  | 91/117 [00:04<00:01, 22.62it/s, loss=2.17, v_num=1, val_acc=0.665]
Epoch 29:  78%|███████▊  | 91/117 [00:04<00:01, 22.48it/s, loss=2.15, v_num=1, val_acc=0.665]
Epoch 29:  79%|███████▊  | 92/117 [00:04<00:01, 22.68it/s, loss=2.15, v_num=1, val_acc=0.665]
Epoch 29:  79%|███████▊  | 92/117 [00:04<00:01, 22.54it/s, loss=2.17, v_num=1, val_acc=0.665]
Epoch 29:  79%|███████▉  | 93/117 [00:04<00:01, 22.73it/s, loss=2.17, v_num=1, val_acc=0.665]
Epoch 29:  79%|███████▉  | 93/117 [00:04<00:01, 22.59it/s, loss=2.16, v_num=1, val_acc=0.665]
Epoch 29:  80%|████████  | 94/117 [00:04<00:01, 22.78it/s, loss=2.16, v_num=1, val_acc=0.665]
Epoch 29:  80%|████████  | 94/117 [00:04<00:01, 22.64it/s, loss=2.19, v_num=1, val_acc=0.665]
Epoch 29:  81%|████████  | 95/117 [00:04<00:00, 22.83it/s, loss=2.19, v_num=1, val_acc=0.665]
Epoch 29:  81%|████████  | 95/117 [00:04<00:00, 22.70it/s, loss=2.17, v_num=1, val_acc=0.665]
Epoch 29:  82%|████████▏ | 96/117 [00:04<00:00, 22.89it/s, loss=2.17, v_num=1, val_acc=0.665]
Epoch 29:  82%|████████▏ | 96/117 [00:04<00:00, 22.75it/s, loss=2.18, v_num=1, val_acc=0.665]
Epoch 29:  83%|████████▎ | 97/117 [00:04<00:00, 22.94it/s, loss=2.18, v_num=1, val_acc=0.665]
Epoch 29:  83%|████████▎ | 97/117 [00:04<00:00, 22.80it/s, loss=2.19, v_num=1, val_acc=0.665]

Validation: 0it [00:00, ?it/s]

Validation:   0%|          | 0/20 [00:00<?, ?it/s]

Validation DataLoader 0:   0%|          | 0/20 [00:00<?, ?it/s]

Validation DataLoader 0:   5%|▌         | 1/20 [00:00<00:00, 179.72it/s]
Epoch 29:  84%|████████▍ | 98/117 [00:05<00:00, 19.10it/s, loss=2.19, v_num=1, val_acc=0.665]

Validation DataLoader 0:  10%|█         | 2/20 [00:00<00:00, 55.93it/s]
Epoch 29:  85%|████████▍ | 99/117 [00:05<00:00, 19.18it/s, loss=2.19, v_num=1, val_acc=0.665]

Validation DataLoader 0:  15%|█▌        | 3/20 [00:00<00:00, 44.65it/s]
Epoch 29:  85%|████████▌ | 100/117 [00:05<00:00, 19.26it/s, loss=2.19, v_num=1, val_acc=0.665]

Validation DataLoader 0:  20%|██        | 4/20 [00:00<00:00, 40.61it/s]
Epoch 29:  86%|████████▋ | 101/117 [00:05<00:00, 19.33it/s, loss=2.19, v_num=1, val_acc=0.665]

Validation DataLoader 0:  25%|██▌       | 5/20 [00:00<00:00, 38.39it/s]
Epoch 29:  87%|████████▋ | 102/117 [00:05<00:00, 19.41it/s, loss=2.19, v_num=1, val_acc=0.665]

Validation DataLoader 0:  30%|███       | 6/20 [00:00<00:00, 37.12it/s]
Epoch 29:  88%|████████▊ | 103/117 [00:05<00:00, 19.48it/s, loss=2.19, v_num=1, val_acc=0.665]

Validation DataLoader 0:  35%|███▌      | 7/20 [00:00<00:00, 36.24it/s]
Epoch 29:  89%|████████▉ | 104/117 [00:05<00:00, 19.55it/s, loss=2.19, v_num=1, val_acc=0.665]

Validation DataLoader 0:  40%|████      | 8/20 [00:00<00:00, 35.60it/s]
Epoch 29:  90%|████████▉ | 105/117 [00:05<00:00, 19.63it/s, loss=2.19, v_num=1, val_acc=0.665]

Validation DataLoader 0:  45%|████▌     | 9/20 [00:00<00:00, 35.09it/s]
Epoch 29:  91%|█████████ | 106/117 [00:05<00:00, 19.70it/s, loss=2.19, v_num=1, val_acc=0.665]

Validation DataLoader 0:  50%|█████     | 10/20 [00:00<00:00, 34.75it/s]
Epoch 29:  91%|█████████▏| 107/117 [00:05<00:00, 19.77it/s, loss=2.19, v_num=1, val_acc=0.665]

Validation DataLoader 0:  55%|█████▌    | 11/20 [00:00<00:00, 34.47it/s]
Epoch 29:  92%|█████████▏| 108/117 [00:05<00:00, 19.84it/s, loss=2.19, v_num=1, val_acc=0.665]

Validation DataLoader 0:  60%|██████    | 12/20 [00:00<00:00, 34.23it/s]
Epoch 29:  93%|█████████▎| 109/117 [00:05<00:00, 19.91it/s, loss=2.19, v_num=1, val_acc=0.665]

Validation DataLoader 0:  65%|██████▌   | 13/20 [00:00<00:00, 34.03it/s]
Epoch 29:  94%|█████████▍| 110/117 [00:05<00:00, 19.97it/s, loss=2.19, v_num=1, val_acc=0.665]

Validation DataLoader 0:  70%|███████   | 14/20 [00:00<00:00, 33.87it/s]
Epoch 29:  95%|█████████▍| 111/117 [00:05<00:00, 20.04it/s, loss=2.19, v_num=1, val_acc=0.665]

Validation DataLoader 0:  75%|███████▌  | 15/20 [00:00<00:00, 33.71it/s]
Epoch 29:  96%|█████████▌| 112/117 [00:05<00:00, 20.11it/s, loss=2.19, v_num=1, val_acc=0.665]

Validation DataLoader 0:  80%|████████  | 16/20 [00:00<00:00, 33.59it/s]
Epoch 29:  97%|█████████▋| 113/117 [00:05<00:00, 20.17it/s, loss=2.19, v_num=1, val_acc=0.665]

Validation DataLoader 0:  85%|████████▌ | 17/20 [00:00<00:00, 33.46it/s]
Epoch 29:  97%|█████████▋| 114/117 [00:05<00:00, 20.24it/s, loss=2.19, v_num=1, val_acc=0.665]

Validation DataLoader 0:  90%|█████████ | 18/20 [00:00<00:00, 33.36it/s]
Epoch 29:  98%|█████████▊| 115/117 [00:05<00:00, 20.30it/s, loss=2.19, v_num=1, val_acc=0.665]

Validation DataLoader 0:  95%|█████████▌| 19/20 [00:00<00:00, 33.27it/s]
Epoch 29:  99%|█████████▉| 116/117 [00:05<00:00, 20.36it/s, loss=2.19, v_num=1, val_acc=0.665]

Validation DataLoader 0: 100%|██████████| 20/20 [00:00<00:00, 33.25it/s]
Epoch 29: 100%|██████████| 117/117 [00:05<00:00, 20.43it/s, loss=2.19, v_num=1, val_acc=0.665]
Epoch 29: 100%|██████████| 117/117 [00:05<00:00, 20.36it/s, loss=2.19, v_num=1, val_acc=0.695]


Epoch 29: 100%|██████████| 117/117 [00:05<00:00, 20.36it/s, loss=2.19, v_num=1, val_acc=0.695]
Epoch 29:   0%|          | 0/117 [00:00<?, ?it/s, loss=2.19, v_num=1, val_acc=0.695]
Epoch 30:   0%|          | 0/117 [00:00<?, ?it/s, loss=2.19, v_num=1, val_acc=0.695]
Epoch 30:   1%|          | 1/117 [00:00<01:45,  1.10it/s, loss=2.19, v_num=1, val_acc=0.695]
Epoch 30:   1%|          | 1/117 [00:00<01:48,  1.07it/s, loss=2.22, v_num=1, val_acc=0.695]
Epoch 30:   2%|▏         | 2/117 [00:00<00:54,  2.11it/s, loss=2.22, v_num=1, val_acc=0.695]
Epoch 30:   2%|▏         | 2/117 [00:00<00:55,  2.06it/s, loss=2.17, v_num=1, val_acc=0.695]
Epoch 30:   3%|▎         | 3/117 [00:00<00:37,  3.06it/s, loss=2.17, v_num=1, val_acc=0.695]
Epoch 30:   3%|▎         | 3/117 [00:01<00:38,  2.98it/s, loss=2.12, v_num=1, val_acc=0.695]
Epoch 30:   3%|▎         | 4/117 [00:01<00:28,  3.91it/s, loss=2.12, v_num=1, val_acc=0.695]
Epoch 30:   3%|▎         | 4/117 [00:01<00:29,  3.83it/s, loss=2.14, v_num=1, val_acc=0.695]
Epoch 30:   4%|▍         | 5/117 [00:01<00:23,  4.75it/s, loss=2.14, v_num=1, val_acc=0.695]
Epoch 30:   4%|▍         | 5/117 [00:01<00:24,  4.63it/s, loss=2.24, v_num=1, val_acc=0.695]
Epoch 30:   5%|▌         | 6/117 [00:01<00:20,  5.52it/s, loss=2.24, v_num=1, val_acc=0.695]
Epoch 30:   5%|▌         | 6/117 [00:01<00:20,  5.39it/s, loss=2.34, v_num=1, val_acc=0.695]
Epoch 30:   6%|▌         | 7/117 [00:01<00:17,  6.25it/s, loss=2.34, v_num=1, val_acc=0.695]
Epoch 30:   6%|▌         | 7/117 [00:01<00:18,  6.11it/s, loss=2.39, v_num=1, val_acc=0.695]
Epoch 30:   7%|▋         | 8/117 [00:01<00:15,  6.93it/s, loss=2.39, v_num=1, val_acc=0.695]
Epoch 30:   7%|▋         | 8/117 [00:01<00:16,  6.78it/s, loss=2.34, v_num=1, val_acc=0.695]
Epoch 30:   8%|▊         | 9/117 [00:01<00:14,  7.57it/s, loss=2.34, v_num=1, val_acc=0.695]
Epoch 30:   8%|▊         | 9/117 [00:01<00:14,  7.41it/s, loss=2.24, v_num=1, val_acc=0.695]
Epoch 30:   9%|▊         | 10/117 [00:01<00:13,  8.18it/s, loss=2.24, v_num=1, val_acc=0.695]
Epoch 30:   9%|▊         | 10/117 [00:01<00:13,  8.01it/s, loss=2.15, v_num=1, val_acc=0.695]
Epoch 30:   9%|▉         | 11/117 [00:01<00:12,  8.75it/s, loss=2.15, v_num=1, val_acc=0.695]
Epoch 30:   9%|▉         | 11/117 [00:01<00:12,  8.58it/s, loss=2.09, v_num=1, val_acc=0.695]
Epoch 30:  10%|█         | 12/117 [00:01<00:11,  9.27it/s, loss=2.09, v_num=1, val_acc=0.695]
Epoch 30:  10%|█         | 12/117 [00:01<00:11,  9.10it/s, loss=2.06, v_num=1, val_acc=0.695]
Epoch 30:  11%|█         | 13/117 [00:01<00:10,  9.80it/s, loss=2.06, v_num=1, val_acc=0.695]
Epoch 30:  11%|█         | 13/117 [00:01<00:10,  9.61it/s, loss=2.02, v_num=1, val_acc=0.695]
Epoch 30:  12%|█▏        | 14/117 [00:01<00:10, 10.29it/s, loss=2.02, v_num=1, val_acc=0.695]
Epoch 30:  12%|█▏        | 14/117 [00:01<00:10, 10.10it/s, loss=2, v_num=1, val_acc=0.695]
Epoch 30:  13%|█▎        | 15/117 [00:01<00:09, 10.76it/s, loss=2, v_num=1, val_acc=0.695]
Epoch 30:  13%|█▎        | 15/117 [00:01<00:09, 10.57it/s, loss=1.98, v_num=1, val_acc=0.695]
Epoch 30:  14%|█▎        | 16/117 [00:01<00:09, 11.21it/s, loss=1.98, v_num=1, val_acc=0.695]
Epoch 30:  14%|█▎        | 16/117 [00:01<00:09, 11.01it/s, loss=2, v_num=1, val_acc=0.695]
Epoch 30:  15%|█▍        | 17/117 [00:01<00:08, 11.63it/s, loss=2, v_num=1, val_acc=0.695]
Epoch 30:  15%|█▍        | 17/117 [00:01<00:08, 11.43it/s, loss=1.95, v_num=1, val_acc=0.695]
Epoch 30:  15%|█▌        | 18/117 [00:01<00:08, 12.03it/s, loss=1.95, v_num=1, val_acc=0.695]
Epoch 30:  15%|█▌        | 18/117 [00:01<00:08, 11.83it/s, loss=1.95, v_num=1, val_acc=0.695]
Epoch 30:  16%|█▌        | 19/117 [00:01<00:07, 12.42it/s, loss=1.95, v_num=1, val_acc=0.695]
Epoch 30:  16%|█▌        | 19/117 [00:01<00:08, 12.22it/s, loss=1.94, v_num=1, val_acc=0.695]
Epoch 30:  17%|█▋        | 20/117 [00:01<00:07, 12.77it/s, loss=1.94, v_num=1, val_acc=0.695]
Epoch 30:  17%|█▋        | 20/117 [00:01<00:07, 12.57it/s, loss=1.93, v_num=1, val_acc=0.695]
Epoch 30:  18%|█▊        | 21/117 [00:01<00:07, 13.13it/s, loss=1.93, v_num=1, val_acc=0.695]
Epoch 30:  18%|█▊        | 21/117 [00:01<00:07, 12.92it/s, loss=1.93, v_num=1, val_acc=0.695]
Epoch 30:  19%|█▉        | 22/117 [00:01<00:07, 13.47it/s, loss=1.93, v_num=1, val_acc=0.695]
Epoch 30:  19%|█▉        | 22/117 [00:01<00:07, 13.26it/s, loss=1.94, v_num=1, val_acc=0.695]
Epoch 30:  20%|█▉        | 23/117 [00:01<00:06, 13.80it/s, loss=1.94, v_num=1, val_acc=0.695]
Epoch 30:  20%|█▉        | 23/117 [00:01<00:06, 13.59it/s, loss=1.95, v_num=1, val_acc=0.695]
Epoch 30:  21%|██        | 24/117 [00:01<00:06, 14.11it/s, loss=1.95, v_num=1, val_acc=0.695]
Epoch 30:  21%|██        | 24/117 [00:01<00:06, 13.90it/s, loss=1.93, v_num=1, val_acc=0.695]
Epoch 30:  21%|██▏       | 25/117 [00:01<00:06, 14.40it/s, loss=1.93, v_num=1, val_acc=0.695]
Epoch 30:  21%|██▏       | 25/117 [00:01<00:06, 14.19it/s, loss=1.86, v_num=1, val_acc=0.695]
Epoch 30:  22%|██▏       | 26/117 [00:01<00:06, 14.70it/s, loss=1.86, v_num=1, val_acc=0.695]
Epoch 30:  22%|██▏       | 26/117 [00:01<00:06, 14.49it/s, loss=1.8, v_num=1, val_acc=0.695]
Epoch 30:  23%|██▎       | 27/117 [00:01<00:06, 14.97it/s, loss=1.8, v_num=1, val_acc=0.695]
Epoch 30:  23%|██▎       | 27/117 [00:01<00:06, 14.76it/s, loss=1.8, v_num=1, val_acc=0.695]
Epoch 30:  24%|██▍       | 28/117 [00:01<00:05, 15.22it/s, loss=1.8, v_num=1, val_acc=0.695]
Epoch 30:  24%|██▍       | 28/117 [00:01<00:05, 15.01it/s, loss=1.85, v_num=1, val_acc=0.695]
Epoch 30:  25%|██▍       | 29/117 [00:01<00:05, 15.48it/s, loss=1.85, v_num=1, val_acc=0.695]
Epoch 30:  25%|██▍       | 29/117 [00:01<00:05, 15.27it/s, loss=1.91, v_num=1, val_acc=0.695]
Epoch 30:  26%|██▌       | 30/117 [00:01<00:05, 15.73it/s, loss=1.91, v_num=1, val_acc=0.695]
Epoch 30:  26%|██▌       | 30/117 [00:01<00:05, 15.53it/s, loss=1.97, v_num=1, val_acc=0.695]
Epoch 30:  26%|██▋       | 31/117 [00:01<00:05, 15.96it/s, loss=1.97, v_num=1, val_acc=0.695]
Epoch 30:  26%|██▋       | 31/117 [00:01<00:05, 15.76it/s, loss=2.03, v_num=1, val_acc=0.695]
Epoch 30:  27%|██▋       | 32/117 [00:01<00:05, 16.19it/s, loss=2.03, v_num=1, val_acc=0.695]
Epoch 30:  27%|██▋       | 32/117 [00:02<00:05, 15.98it/s, loss=2.05, v_num=1, val_acc=0.695]
Epoch 30:  28%|██▊       | 33/117 [00:02<00:05, 16.41it/s, loss=2.05, v_num=1, val_acc=0.695]
Epoch 30:  28%|██▊       | 33/117 [00:02<00:05, 16.21it/s, loss=2.08, v_num=1, val_acc=0.695]
Epoch 30:  29%|██▉       | 34/117 [00:02<00:04, 16.63it/s, loss=2.08, v_num=1, val_acc=0.695]
Epoch 30:  29%|██▉       | 34/117 [00:02<00:05, 16.42it/s, loss=2.13, v_num=1, val_acc=0.695]
Epoch 30:  30%|██▉       | 35/117 [00:02<00:04, 16.83it/s, loss=2.13, v_num=1, val_acc=0.695]
Epoch 30:  30%|██▉       | 35/117 [00:02<00:04, 16.63it/s, loss=2.14, v_num=1, val_acc=0.695]
Epoch 30:  31%|███       | 36/117 [00:02<00:04, 17.03it/s, loss=2.14, v_num=1, val_acc=0.695]
Epoch 30:  31%|███       | 36/117 [00:02<00:04, 16.83it/s, loss=2.21, v_num=1, val_acc=0.695]
Epoch 30:  32%|███▏      | 37/117 [00:02<00:04, 17.22it/s, loss=2.21, v_num=1, val_acc=0.695]
Epoch 30:  32%|███▏      | 37/117 [00:02<00:04, 17.02it/s, loss=2.21, v_num=1, val_acc=0.695]
Epoch 30:  32%|███▏      | 38/117 [00:02<00:04, 17.41it/s, loss=2.21, v_num=1, val_acc=0.695]
Epoch 30:  32%|███▏      | 38/117 [00:02<00:04, 17.21it/s, loss=2.21, v_num=1, val_acc=0.695]
Epoch 30:  33%|███▎      | 39/117 [00:02<00:04, 17.59it/s, loss=2.21, v_num=1, val_acc=0.695]
Epoch 30:  33%|███▎      | 39/117 [00:02<00:04, 17.39it/s, loss=2.14, v_num=1, val_acc=0.695]
Epoch 30:  34%|███▍      | 40/117 [00:02<00:04, 17.76it/s, loss=2.14, v_num=1, val_acc=0.695]
Epoch 30:  34%|███▍      | 40/117 [00:02<00:04, 17.56it/s, loss=2.1, v_num=1, val_acc=0.695]
Epoch 30:  35%|███▌      | 41/117 [00:02<00:04, 17.92it/s, loss=2.1, v_num=1, val_acc=0.695]
Epoch 30:  35%|███▌      | 41/117 [00:02<00:04, 17.73it/s, loss=2.11, v_num=1, val_acc=0.695]
Epoch 30:  36%|███▌      | 42/117 [00:02<00:04, 18.09it/s, loss=2.11, v_num=1, val_acc=0.695]
Epoch 30:  36%|███▌      | 42/117 [00:02<00:04, 17.89it/s, loss=2.13, v_num=1, val_acc=0.695]
Epoch 30:  37%|███▋      | 43/117 [00:02<00:04, 18.25it/s, loss=2.13, v_num=1, val_acc=0.695]
Epoch 30:  37%|███▋      | 43/117 [00:02<00:04, 18.06it/s, loss=2.16, v_num=1, val_acc=0.695]
Epoch 30:  38%|███▊      | 44/117 [00:02<00:03, 18.40it/s, loss=2.16, v_num=1, val_acc=0.695]
Epoch 30:  38%|███▊      | 44/117 [00:02<00:04, 18.21it/s, loss=2.17, v_num=1, val_acc=0.695]
Epoch 30:  38%|███▊      | 45/117 [00:02<00:03, 18.56it/s, loss=2.17, v_num=1, val_acc=0.695]
Epoch 30:  38%|███▊      | 45/117 [00:02<00:03, 18.37it/s, loss=2.16, v_num=1, val_acc=0.695]
Epoch 30:  39%|███▉      | 46/117 [00:02<00:03, 18.71it/s, loss=2.16, v_num=1, val_acc=0.695]
Epoch 30:  39%|███▉      | 46/117 [00:02<00:03, 18.51it/s, loss=2.16, v_num=1, val_acc=0.695]
Epoch 30:  40%|████      | 47/117 [00:02<00:03, 18.85it/s, loss=2.16, v_num=1, val_acc=0.695]
Epoch 30:  40%|████      | 47/117 [00:02<00:03, 18.66it/s, loss=2.13, v_num=1, val_acc=0.695]
Epoch 30:  41%|████      | 48/117 [00:02<00:03, 18.99it/s, loss=2.13, v_num=1, val_acc=0.695]
Epoch 30:  41%|████      | 48/117 [00:02<00:03, 18.80it/s, loss=2.14, v_num=1, val_acc=0.695]
Epoch 30:  42%|████▏     | 49/117 [00:02<00:03, 19.13it/s, loss=2.14, v_num=1, val_acc=0.695]
Epoch 30:  42%|████▏     | 49/117 [00:02<00:03, 18.94it/s, loss=2.2, v_num=1, val_acc=0.695]
Epoch 30:  43%|████▎     | 50/117 [00:02<00:03, 19.26it/s, loss=2.2, v_num=1, val_acc=0.695]
Epoch 30:  43%|████▎     | 50/117 [00:02<00:03, 19.08it/s, loss=2.24, v_num=1, val_acc=0.695]
Epoch 30:  44%|████▎     | 51/117 [00:02<00:03, 19.39it/s, loss=2.24, v_num=1, val_acc=0.695]
Epoch 30:  44%|████▎     | 51/117 [00:02<00:03, 19.20it/s, loss=2.28, v_num=1, val_acc=0.695]
Epoch 30:  44%|████▍     | 52/117 [00:02<00:03, 19.51it/s, loss=2.28, v_num=1, val_acc=0.695]
Epoch 30:  44%|████▍     | 52/117 [00:02<00:03, 19.33it/s, loss=2.32, v_num=1, val_acc=0.695]
Epoch 30:  45%|████▌     | 53/117 [00:02<00:03, 19.63it/s, loss=2.32, v_num=1, val_acc=0.695]
Epoch 30:  45%|████▌     | 53/117 [00:02<00:03, 19.45it/s, loss=2.36, v_num=1, val_acc=0.695]
Epoch 30:  46%|████▌     | 54/117 [00:02<00:03, 19.75it/s, loss=2.36, v_num=1, val_acc=0.695]
Epoch 30:  46%|████▌     | 54/117 [00:02<00:03, 19.57it/s, loss=2.34, v_num=1, val_acc=0.695]
Epoch 30:  47%|████▋     | 55/117 [00:02<00:03, 19.87it/s, loss=2.34, v_num=1, val_acc=0.695]
Epoch 30:  47%|████▋     | 55/117 [00:02<00:03, 19.69it/s, loss=2.35, v_num=1, val_acc=0.695]
Epoch 30:  48%|████▊     | 56/117 [00:02<00:03, 19.99it/s, loss=2.35, v_num=1, val_acc=0.695]
Epoch 30:  48%|████▊     | 56/117 [00:02<00:03, 19.81it/s, loss=2.25, v_num=1, val_acc=0.695]
Epoch 30:  49%|████▊     | 57/117 [00:02<00:02, 20.10it/s, loss=2.25, v_num=1, val_acc=0.695]
Epoch 30:  49%|████▊     | 57/117 [00:02<00:03, 19.92it/s, loss=2.27, v_num=1, val_acc=0.695]
Epoch 30:  50%|████▉     | 58/117 [00:02<00:02, 20.21it/s, loss=2.27, v_num=1, val_acc=0.695]
Epoch 30:  50%|████▉     | 58/117 [00:02<00:02, 20.03it/s, loss=2.29, v_num=1, val_acc=0.695]
Epoch 30:  50%|█████     | 59/117 [00:02<00:02, 20.31it/s, loss=2.29, v_num=1, val_acc=0.695]
Epoch 30:  50%|█████     | 59/117 [00:02<00:02, 20.14it/s, loss=2.32, v_num=1, val_acc=0.695]
Epoch 30:  51%|█████▏    | 60/117 [00:02<00:02, 20.41it/s, loss=2.32, v_num=1, val_acc=0.695]
Epoch 30:  51%|█████▏    | 60/117 [00:02<00:02, 20.24it/s, loss=2.29, v_num=1, val_acc=0.695]
Epoch 30:  52%|█████▏    | 61/117 [00:02<00:02, 20.51it/s, loss=2.29, v_num=1, val_acc=0.695]
Epoch 30:  52%|█████▏    | 61/117 [00:02<00:02, 20.34it/s, loss=2.22, v_num=1, val_acc=0.695]
Epoch 30:  53%|█████▎    | 62/117 [00:03<00:02, 20.61it/s, loss=2.22, v_num=1, val_acc=0.695]
Epoch 30:  53%|█████▎    | 62/117 [00:03<00:02, 20.44it/s, loss=2.16, v_num=1, val_acc=0.695]
Epoch 30:  54%|█████▍    | 63/117 [00:03<00:02, 20.70it/s, loss=2.16, v_num=1, val_acc=0.695]
Epoch 30:  54%|█████▍    | 63/117 [00:03<00:02, 20.53it/s, loss=2.12, v_num=1, val_acc=0.695]
Epoch 30:  55%|█████▍    | 64/117 [00:03<00:02, 20.79it/s, loss=2.12, v_num=1, val_acc=0.695]
Epoch 30:  55%|█████▍    | 64/117 [00:03<00:02, 20.63it/s, loss=2.13, v_num=1, val_acc=0.695]
Epoch 30:  56%|█████▌    | 65/117 [00:03<00:02, 20.89it/s, loss=2.13, v_num=1, val_acc=0.695]
Epoch 30:  56%|█████▌    | 65/117 [00:03<00:02, 20.72it/s, loss=2.15, v_num=1, val_acc=0.695]
Epoch 30:  56%|█████▋    | 66/117 [00:03<00:02, 20.98it/s, loss=2.15, v_num=1, val_acc=0.695]
Epoch 30:  56%|█████▋    | 66/117 [00:03<00:02, 20.81it/s, loss=2.12, v_num=1, val_acc=0.695]
Epoch 30:  57%|█████▋    | 67/117 [00:03<00:02, 21.06it/s, loss=2.12, v_num=1, val_acc=0.695]
Epoch 30:  57%|█████▋    | 67/117 [00:03<00:02, 20.90it/s, loss=2.08, v_num=1, val_acc=0.695]
Epoch 30:  58%|█████▊    | 68/117 [00:03<00:02, 21.14it/s, loss=2.08, v_num=1, val_acc=0.695]
Epoch 30:  58%|█████▊    | 68/117 [00:03<00:02, 20.98it/s, loss=2.01, v_num=1, val_acc=0.695]
Epoch 30:  59%|█████▉    | 69/117 [00:03<00:02, 21.23it/s, loss=2.01, v_num=1, val_acc=0.695]
Epoch 30:  59%|█████▉    | 69/117 [00:03<00:02, 21.06it/s, loss=1.91, v_num=1, val_acc=0.695]
Epoch 30:  60%|█████▉    | 70/117 [00:03<00:02, 21.31it/s, loss=1.91, v_num=1, val_acc=0.695]
Epoch 30:  60%|█████▉    | 70/117 [00:03<00:02, 21.14it/s, loss=1.82, v_num=1, val_acc=0.695]
Epoch 30:  61%|██████    | 71/117 [00:03<00:02, 21.34it/s, loss=1.82, v_num=1, val_acc=0.695]
Epoch 30:  61%|██████    | 71/117 [00:03<00:02, 21.20it/s, loss=1.76, v_num=1, val_acc=0.695]
Epoch 30:  62%|██████▏   | 72/117 [00:03<00:02, 21.45it/s, loss=1.76, v_num=1, val_acc=0.695]
Epoch 30:  62%|██████▏   | 72/117 [00:03<00:02, 21.28it/s, loss=1.75, v_num=1, val_acc=0.695]
Epoch 30:  62%|██████▏   | 73/117 [00:03<00:02, 21.52it/s, loss=1.75, v_num=1, val_acc=0.695]
Epoch 30:  62%|██████▏   | 73/117 [00:03<00:02, 21.36it/s, loss=1.71, v_num=1, val_acc=0.695]
Epoch 30:  63%|██████▎   | 74/117 [00:03<00:01, 21.60it/s, loss=1.71, v_num=1, val_acc=0.695]
Epoch 30:  63%|██████▎   | 74/117 [00:03<00:02, 21.44it/s, loss=1.7, v_num=1, val_acc=0.695]
Epoch 30:  64%|██████▍   | 75/117 [00:03<00:01, 21.68it/s, loss=1.7, v_num=1, val_acc=0.695]
Epoch 30:  64%|██████▍   | 75/117 [00:03<00:01, 21.52it/s, loss=1.66, v_num=1, val_acc=0.695]
Epoch 30:  65%|██████▍   | 76/117 [00:03<00:01, 21.75it/s, loss=1.66, v_num=1, val_acc=0.695]
Epoch 30:  65%|██████▍   | 76/117 [00:03<00:01, 21.60it/s, loss=1.67, v_num=1, val_acc=0.695]
Epoch 30:  66%|██████▌   | 77/117 [00:03<00:01, 21.82it/s, loss=1.67, v_num=1, val_acc=0.695]
Epoch 30:  66%|██████▌   | 77/117 [00:03<00:01, 21.67it/s, loss=1.65, v_num=1, val_acc=0.695]
Epoch 30:  67%|██████▋   | 78/117 [00:03<00:01, 21.90it/s, loss=1.65, v_num=1, val_acc=0.695]
Epoch 30:  67%|██████▋   | 78/117 [00:03<00:01, 21.74it/s, loss=1.66, v_num=1, val_acc=0.695]
Epoch 30:  68%|██████▊   | 79/117 [00:03<00:01, 21.96it/s, loss=1.66, v_num=1, val_acc=0.695]
Epoch 30:  68%|██████▊   | 79/117 [00:03<00:01, 21.81it/s, loss=1.7, v_num=1, val_acc=0.695]
Epoch 30:  68%|██████▊   | 80/117 [00:03<00:01, 22.04it/s, loss=1.7, v_num=1, val_acc=0.695]
Epoch 30:  68%|██████▊   | 80/117 [00:03<00:01, 21.88it/s, loss=1.7, v_num=1, val_acc=0.695]
Epoch 30:  69%|██████▉   | 81/117 [00:03<00:01, 22.10it/s, loss=1.7, v_num=1, val_acc=0.695]
Epoch 30:  69%|██████▉   | 81/117 [00:03<00:01, 21.95it/s, loss=1.72, v_num=1, val_acc=0.695]
Epoch 30:  70%|███████   | 82/117 [00:03<00:01, 22.13it/s, loss=1.72, v_num=1, val_acc=0.695]
Epoch 30:  70%|███████   | 82/117 [00:03<00:01, 21.98it/s, loss=1.79, v_num=1, val_acc=0.695]
Epoch 30:  71%|███████   | 83/117 [00:03<00:01, 22.20it/s, loss=1.79, v_num=1, val_acc=0.695]
Epoch 30:  71%|███████   | 83/117 [00:03<00:01, 22.05it/s, loss=1.81, v_num=1, val_acc=0.695]
Epoch 30:  72%|███████▏  | 84/117 [00:03<00:01, 22.26it/s, loss=1.81, v_num=1, val_acc=0.695]
Epoch 30:  72%|███████▏  | 84/117 [00:03<00:01, 22.12it/s, loss=1.81, v_num=1, val_acc=0.695]
Epoch 30:  73%|███████▎  | 85/117 [00:03<00:01, 22.33it/s, loss=1.81, v_num=1, val_acc=0.695]
Epoch 30:  73%|███████▎  | 85/117 [00:03<00:01, 22.18it/s, loss=1.83, v_num=1, val_acc=0.695]
Epoch 30:  74%|███████▎  | 86/117 [00:03<00:01, 22.39it/s, loss=1.83, v_num=1, val_acc=0.695]
Epoch 30:  74%|███████▎  | 86/117 [00:03<00:01, 22.24it/s, loss=1.9, v_num=1, val_acc=0.695]
Epoch 30:  74%|███████▍  | 87/117 [00:03<00:01, 22.45it/s, loss=1.9, v_num=1, val_acc=0.695]
Epoch 30:  74%|███████▍  | 87/117 [00:03<00:01, 22.31it/s, loss=2.04, v_num=1, val_acc=0.695]
Epoch 30:  75%|███████▌  | 88/117 [00:03<00:01, 22.52it/s, loss=2.04, v_num=1, val_acc=0.695]
Epoch 30:  75%|███████▌  | 88/117 [00:03<00:01, 22.37it/s, loss=2.12, v_num=1, val_acc=0.695]
Epoch 30:  76%|███████▌  | 89/117 [00:03<00:01, 22.58it/s, loss=2.12, v_num=1, val_acc=0.695]
Epoch 30:  76%|███████▌  | 89/117 [00:03<00:01, 22.43it/s, loss=2.17, v_num=1, val_acc=0.695]
Epoch 30:  77%|███████▋  | 90/117 [00:03<00:01, 22.63it/s, loss=2.17, v_num=1, val_acc=0.695]
Epoch 30:  77%|███████▋  | 90/117 [00:04<00:01, 22.49it/s, loss=2.17, v_num=1, val_acc=0.695]
Epoch 30:  78%|███████▊  | 91/117 [00:04<00:01, 22.69it/s, loss=2.17, v_num=1, val_acc=0.695]
Epoch 30:  78%|███████▊  | 91/117 [00:04<00:01, 22.54it/s, loss=2.18, v_num=1, val_acc=0.695]
Epoch 30:  79%|███████▊  | 92/117 [00:04<00:01, 22.74it/s, loss=2.18, v_num=1, val_acc=0.695]
Epoch 30:  79%|███████▊  | 92/117 [00:04<00:01, 22.60it/s, loss=2.11, v_num=1, val_acc=0.695]
Epoch 30:  79%|███████▉  | 93/117 [00:04<00:01, 22.80it/s, loss=2.11, v_num=1, val_acc=0.695]
Epoch 30:  79%|███████▉  | 93/117 [00:04<00:01, 22.66it/s, loss=2.1, v_num=1, val_acc=0.695]
Epoch 30:  80%|████████  | 94/117 [00:04<00:01, 22.85it/s, loss=2.1, v_num=1, val_acc=0.695]
Epoch 30:  80%|████████  | 94/117 [00:04<00:01, 22.71it/s, loss=2.07, v_num=1, val_acc=0.695]
Epoch 30:  81%|████████  | 95/117 [00:04<00:00, 22.90it/s, loss=2.07, v_num=1, val_acc=0.695]
Epoch 30:  81%|████████  | 95/117 [00:04<00:00, 22.76it/s, loss=2.06, v_num=1, val_acc=0.695]
Epoch 30:  82%|████████▏ | 96/117 [00:04<00:00, 22.96it/s, loss=2.06, v_num=1, val_acc=0.695]
Epoch 30:  82%|████████▏ | 96/117 [00:04<00:00, 22.82it/s, loss=2.03, v_num=1, val_acc=0.695]
Epoch 30:  83%|████████▎ | 97/117 [00:04<00:00, 23.01it/s, loss=2.03, v_num=1, val_acc=0.695]
Epoch 30:  83%|████████▎ | 97/117 [00:04<00:00, 22.87it/s, loss=1.99, v_num=1, val_acc=0.695]

Validation: 0it [00:00, ?it/s]

Validation:   0%|          | 0/20 [00:00<?, ?it/s]

Validation DataLoader 0:   0%|          | 0/20 [00:00<?, ?it/s]

Validation DataLoader 0:   5%|▌         | 1/20 [00:00<00:00, 189.69it/s]
Epoch 30:  84%|████████▍ | 98/117 [00:05<00:00, 19.28it/s, loss=1.99, v_num=1, val_acc=0.695]

Validation DataLoader 0:  10%|█         | 2/20 [00:00<00:00, 56.13it/s]
Epoch 30:  85%|████████▍ | 99/117 [00:05<00:00, 19.36it/s, loss=1.99, v_num=1, val_acc=0.695]

Validation DataLoader 0:  15%|█▌        | 3/20 [00:00<00:00, 44.90it/s]
Epoch 30:  85%|████████▌ | 100/117 [00:05<00:00, 19.44it/s, loss=1.99, v_num=1, val_acc=0.695]

Validation DataLoader 0:  20%|██        | 4/20 [00:00<00:00, 40.67it/s]
Epoch 30:  86%|████████▋ | 101/117 [00:05<00:00, 19.52it/s, loss=1.99, v_num=1, val_acc=0.695]

Validation DataLoader 0:  25%|██▌       | 5/20 [00:00<00:00, 38.53it/s]
Epoch 30:  87%|████████▋ | 102/117 [00:05<00:00, 19.59it/s, loss=1.99, v_num=1, val_acc=0.695]

Validation DataLoader 0:  30%|███       | 6/20 [00:00<00:00, 37.20it/s]
Epoch 30:  88%|████████▊ | 103/117 [00:05<00:00, 19.66it/s, loss=1.99, v_num=1, val_acc=0.695]

Validation DataLoader 0:  35%|███▌      | 7/20 [00:00<00:00, 36.32it/s]
Epoch 30:  89%|████████▉ | 104/117 [00:05<00:00, 19.74it/s, loss=1.99, v_num=1, val_acc=0.695]

Validation DataLoader 0:  40%|████      | 8/20 [00:00<00:00, 35.69it/s]
Epoch 30:  90%|████████▉ | 105/117 [00:05<00:00, 19.81it/s, loss=1.99, v_num=1, val_acc=0.695]

Validation DataLoader 0:  45%|████▌     | 9/20 [00:00<00:00, 35.16it/s]
Epoch 30:  91%|█████████ | 106/117 [00:05<00:00, 19.88it/s, loss=1.99, v_num=1, val_acc=0.695]

Validation DataLoader 0:  50%|█████     | 10/20 [00:00<00:00, 34.82it/s]
Epoch 30:  91%|█████████▏| 107/117 [00:05<00:00, 19.95it/s, loss=1.99, v_num=1, val_acc=0.695]

Validation DataLoader 0:  55%|█████▌    | 11/20 [00:00<00:00, 34.52it/s]
Epoch 30:  92%|█████████▏| 108/117 [00:05<00:00, 20.02it/s, loss=1.99, v_num=1, val_acc=0.695]

Validation DataLoader 0:  60%|██████    | 12/20 [00:00<00:00, 34.30it/s]
Epoch 30:  93%|█████████▎| 109/117 [00:05<00:00, 20.09it/s, loss=1.99, v_num=1, val_acc=0.695]

Validation DataLoader 0:  65%|██████▌   | 13/20 [00:00<00:00, 34.08it/s]
Epoch 30:  94%|█████████▍| 110/117 [00:05<00:00, 20.15it/s, loss=1.99, v_num=1, val_acc=0.695]

Validation DataLoader 0:  70%|███████   | 14/20 [00:00<00:00, 33.88it/s]
Epoch 30:  95%|█████████▍| 111/117 [00:05<00:00, 20.22it/s, loss=1.99, v_num=1, val_acc=0.695]

Validation DataLoader 0:  75%|███████▌  | 15/20 [00:00<00:00, 33.74it/s]
Epoch 30:  96%|█████████▌| 112/117 [00:05<00:00, 20.29it/s, loss=1.99, v_num=1, val_acc=0.695]

Validation DataLoader 0:  80%|████████  | 16/20 [00:00<00:00, 33.61it/s]
Epoch 30:  97%|█████████▋| 113/117 [00:05<00:00, 20.35it/s, loss=1.99, v_num=1, val_acc=0.695]

Validation DataLoader 0:  85%|████████▌ | 17/20 [00:00<00:00, 33.49it/s]
Epoch 30:  97%|█████████▋| 114/117 [00:05<00:00, 20.41it/s, loss=1.99, v_num=1, val_acc=0.695]

Validation DataLoader 0:  90%|█████████ | 18/20 [00:00<00:00, 33.39it/s]
Epoch 30:  98%|█████████▊| 115/117 [00:05<00:00, 20.48it/s, loss=1.99, v_num=1, val_acc=0.695]

Validation DataLoader 0:  95%|█████████▌| 19/20 [00:00<00:00, 33.30it/s]
Epoch 30:  99%|█████████▉| 116/117 [00:05<00:00, 20.54it/s, loss=1.99, v_num=1, val_acc=0.695]

Validation DataLoader 0: 100%|██████████| 20/20 [00:00<00:00, 33.28it/s]
Epoch 30: 100%|██████████| 117/117 [00:05<00:00, 20.61it/s, loss=1.99, v_num=1, val_acc=0.695]
Epoch 30: 100%|██████████| 117/117 [00:05<00:00, 20.53it/s, loss=1.99, v_num=1, val_acc=0.710]


Epoch 30: 100%|██████████| 117/117 [00:05<00:00, 20.53it/s, loss=1.99, v_num=1, val_acc=0.710]
Epoch 30:   0%|          | 0/117 [00:00<?, ?it/s, loss=1.99, v_num=1, val_acc=0.710]
Epoch 31:   0%|          | 0/117 [00:00<?, ?it/s, loss=1.99, v_num=1, val_acc=0.710]
Epoch 31:   1%|          | 1/117 [00:00<01:43,  1.12it/s, loss=1.99, v_num=1, val_acc=0.710]
Epoch 31:   1%|          | 1/117 [00:00<01:46,  1.09it/s, loss=1.94, v_num=1, val_acc=0.710]
Epoch 31:   2%|▏         | 2/117 [00:00<00:53,  2.15it/s, loss=1.94, v_num=1, val_acc=0.710]
Epoch 31:   2%|▏         | 2/117 [00:00<00:54,  2.10it/s, loss=1.91, v_num=1, val_acc=0.710]
Epoch 31:   3%|▎         | 3/117 [00:00<00:36,  3.10it/s, loss=1.91, v_num=1, val_acc=0.710]
Epoch 31:   3%|▎         | 3/117 [00:00<00:37,  3.03it/s, loss=1.93, v_num=1, val_acc=0.710]
Epoch 31:   3%|▎         | 4/117 [00:00<00:28,  4.00it/s, loss=1.93, v_num=1, val_acc=0.710]
Epoch 31:   3%|▎         | 4/117 [00:01<00:28,  3.90it/s, loss=1.94, v_num=1, val_acc=0.710]
Epoch 31:   4%|▍         | 5/117 [00:01<00:23,  4.84it/s, loss=1.94, v_num=1, val_acc=0.710]
Epoch 31:   4%|▍         | 5/117 [00:01<00:23,  4.72it/s, loss=1.99, v_num=1, val_acc=0.710]
Epoch 31:   5%|▌         | 6/117 [00:01<00:19,  5.62it/s, loss=1.99, v_num=1, val_acc=0.710]
Epoch 31:   5%|▌         | 6/117 [00:01<00:20,  5.50it/s, loss=2.04, v_num=1, val_acc=0.710]
Epoch 31:   6%|▌         | 7/117 [00:01<00:17,  6.36it/s, loss=2.04, v_num=1, val_acc=0.710]
Epoch 31:   6%|▌         | 7/117 [00:01<00:17,  6.22it/s, loss=2.07, v_num=1, val_acc=0.710]
Epoch 31:   7%|▋         | 8/117 [00:01<00:15,  7.05it/s, loss=2.07, v_num=1, val_acc=0.710]
Epoch 31:   7%|▋         | 8/117 [00:01<00:15,  6.90it/s, loss=2.04, v_num=1, val_acc=0.710]
Epoch 31:   8%|▊         | 9/117 [00:01<00:14,  7.70it/s, loss=2.04, v_num=1, val_acc=0.710]
Epoch 31:   8%|▊         | 9/117 [00:01<00:14,  7.54it/s, loss=1.97, v_num=1, val_acc=0.710]
Epoch 31:   9%|▊         | 10/117 [00:01<00:12,  8.29it/s, loss=1.97, v_num=1, val_acc=0.710]
Epoch 31:   9%|▊         | 10/117 [00:01<00:13,  8.12it/s, loss=1.85, v_num=1, val_acc=0.710]
Epoch 31:   9%|▉         | 11/117 [00:01<00:11,  8.86it/s, loss=1.85, v_num=1, val_acc=0.710]
Epoch 31:   9%|▉         | 11/117 [00:01<00:12,  8.68it/s, loss=1.82, v_num=1, val_acc=0.710]
Epoch 31:  10%|█         | 12/117 [00:01<00:11,  9.41it/s, loss=1.82, v_num=1, val_acc=0.710]
Epoch 31:  10%|█         | 12/117 [00:01<00:11,  9.23it/s, loss=1.8, v_num=1, val_acc=0.710]
Epoch 31:  11%|█         | 13/117 [00:01<00:10,  9.94it/s, loss=1.8, v_num=1, val_acc=0.710]
Epoch 31:  11%|█         | 13/117 [00:01<00:10,  9.75it/s, loss=1.8, v_num=1, val_acc=0.710]
Epoch 31:  12%|█▏        | 14/117 [00:01<00:09, 10.44it/s, loss=1.8, v_num=1, val_acc=0.710]
Epoch 31:  12%|█▏        | 14/117 [00:01<00:10, 10.24it/s, loss=1.83, v_num=1, val_acc=0.710]
Epoch 31:  13%|█▎        | 15/117 [00:01<00:09, 10.91it/s, loss=1.83, v_num=1, val_acc=0.710]
Epoch 31:  13%|█▎        | 15/117 [00:01<00:09, 10.71it/s, loss=1.94, v_num=1, val_acc=0.710]
Epoch 31:  14%|█▎        | 16/117 [00:01<00:08, 11.36it/s, loss=1.94, v_num=1, val_acc=0.710]
Epoch 31:  14%|█▎        | 16/117 [00:01<00:09, 11.16it/s, loss=1.97, v_num=1, val_acc=0.710]
Epoch 31:  15%|█▍        | 17/117 [00:01<00:08, 11.78it/s, loss=1.97, v_num=1, val_acc=0.710]
Epoch 31:  15%|█▍        | 17/117 [00:01<00:08, 11.58it/s, loss=1.98, v_num=1, val_acc=0.710]
Epoch 31:  15%|█▌        | 18/117 [00:01<00:08, 12.18it/s, loss=1.98, v_num=1, val_acc=0.710]
Epoch 31:  15%|█▌        | 18/117 [00:01<00:08, 11.97it/s, loss=1.99, v_num=1, val_acc=0.710]
Epoch 31:  16%|█▌        | 19/117 [00:01<00:07, 12.56it/s, loss=1.99, v_num=1, val_acc=0.710]
Epoch 31:  16%|█▌        | 19/117 [00:01<00:07, 12.35it/s, loss=1.99, v_num=1, val_acc=0.710]
Epoch 31:  17%|█▋        | 20/117 [00:01<00:07, 12.94it/s, loss=1.99, v_num=1, val_acc=0.710]
Epoch 31:  17%|█▋        | 20/117 [00:01<00:07, 12.73it/s, loss=2.02, v_num=1, val_acc=0.710]
Epoch 31:  18%|█▊        | 21/117 [00:01<00:07, 13.29it/s, loss=2.02, v_num=1, val_acc=0.710]
Epoch 31:  18%|█▊        | 21/117 [00:01<00:07, 13.08it/s, loss=2.06, v_num=1, val_acc=0.710]
Epoch 31:  19%|█▉        | 22/117 [00:01<00:06, 13.63it/s, loss=2.06, v_num=1, val_acc=0.710]
Epoch 31:  19%|█▉        | 22/117 [00:01<00:07, 13.42it/s, loss=2.15, v_num=1, val_acc=0.710]
Epoch 31:  20%|█▉        | 23/117 [00:01<00:06, 13.96it/s, loss=2.15, v_num=1, val_acc=0.710]
Epoch 31:  20%|█▉        | 23/117 [00:01<00:06, 13.74it/s, loss=2.16, v_num=1, val_acc=0.710]
Epoch 31:  21%|██        | 24/117 [00:01<00:06, 14.27it/s, loss=2.16, v_num=1, val_acc=0.710]
Epoch 31:  21%|██        | 24/117 [00:01<00:06, 14.06it/s, loss=2.14, v_num=1, val_acc=0.710]
Epoch 31:  21%|██▏       | 25/117 [00:01<00:06, 14.56it/s, loss=2.14, v_num=1, val_acc=0.710]
Epoch 31:  21%|██▏       | 25/117 [00:01<00:06, 14.35it/s, loss=2.06, v_num=1, val_acc=0.710]
Epoch 31:  22%|██▏       | 26/117 [00:01<00:06, 14.85it/s, loss=2.06, v_num=1, val_acc=0.710]
Epoch 31:  22%|██▏       | 26/117 [00:01<00:06, 14.64it/s, loss=2.06, v_num=1, val_acc=0.710]
Epoch 31:  23%|██▎       | 27/117 [00:01<00:05, 15.12it/s, loss=2.06, v_num=1, val_acc=0.710]
Epoch 31:  23%|██▎       | 27/117 [00:01<00:06, 14.91it/s, loss=2.02, v_num=1, val_acc=0.710]
Epoch 31:  24%|██▍       | 28/117 [00:01<00:05, 15.38it/s, loss=2.02, v_num=1, val_acc=0.710]
Epoch 31:  24%|██▍       | 28/117 [00:01<00:05, 15.17it/s, loss=2.03, v_num=1, val_acc=0.710]
Epoch 31:  25%|██▍       | 29/117 [00:01<00:05, 15.64it/s, loss=2.03, v_num=1, val_acc=0.710]
Epoch 31:  25%|██▍       | 29/117 [00:01<00:05, 15.43it/s, loss=2.05, v_num=1, val_acc=0.710]
Epoch 31:  26%|██▌       | 30/117 [00:01<00:05, 15.89it/s, loss=2.05, v_num=1, val_acc=0.710]
Epoch 31:  26%|██▌       | 30/117 [00:01<00:05, 15.67it/s, loss=2.07, v_num=1, val_acc=0.710]
Epoch 31:  26%|██▋       | 31/117 [00:01<00:05, 16.12it/s, loss=2.07, v_num=1, val_acc=0.710]
Epoch 31:  26%|██▋       | 31/117 [00:01<00:05, 15.91it/s, loss=2.08, v_num=1, val_acc=0.710]
Epoch 31:  27%|██▋       | 32/117 [00:01<00:05, 16.34it/s, loss=2.08, v_num=1, val_acc=0.710]
Epoch 31:  27%|██▋       | 32/117 [00:01<00:05, 16.14it/s, loss=2.08, v_num=1, val_acc=0.710]
Epoch 31:  28%|██▊       | 33/117 [00:01<00:05, 16.56it/s, loss=2.08, v_num=1, val_acc=0.710]
Epoch 31:  28%|██▊       | 33/117 [00:02<00:05, 16.35it/s, loss=2.08, v_num=1, val_acc=0.710]
Epoch 31:  29%|██▉       | 34/117 [00:02<00:04, 16.77it/s, loss=2.08, v_num=1, val_acc=0.710]
Epoch 31:  29%|██▉       | 34/117 [00:02<00:05, 16.56it/s, loss=2.03, v_num=1, val_acc=0.710]
Epoch 31:  30%|██▉       | 35/117 [00:02<00:04, 16.97it/s, loss=2.03, v_num=1, val_acc=0.710]
Epoch 31:  30%|██▉       | 35/117 [00:02<00:04, 16.77it/s, loss=1.96, v_num=1, val_acc=0.710]
Epoch 31:  31%|███       | 36/117 [00:02<00:04, 17.16it/s, loss=1.96, v_num=1, val_acc=0.710]
Epoch 31:  31%|███       | 36/117 [00:02<00:04, 16.96it/s, loss=1.98, v_num=1, val_acc=0.710]
Epoch 31:  32%|███▏      | 37/117 [00:02<00:04, 17.36it/s, loss=1.98, v_num=1, val_acc=0.710]
Epoch 31:  32%|███▏      | 37/117 [00:02<00:04, 17.15it/s, loss=1.99, v_num=1, val_acc=0.710]
Epoch 31:  32%|███▏      | 38/117 [00:02<00:04, 17.54it/s, loss=1.99, v_num=1, val_acc=0.710]
Epoch 31:  32%|███▏      | 38/117 [00:02<00:04, 17.34it/s, loss=2.01, v_num=1, val_acc=0.710]
Epoch 31:  33%|███▎      | 39/117 [00:02<00:04, 17.72it/s, loss=2.01, v_num=1, val_acc=0.710]
Epoch 31:  33%|███▎      | 39/117 [00:02<00:04, 17.52it/s, loss=2.05, v_num=1, val_acc=0.710]
Epoch 31:  34%|███▍      | 40/117 [00:02<00:04, 17.89it/s, loss=2.05, v_num=1, val_acc=0.710]
Epoch 31:  34%|███▍      | 40/117 [00:02<00:04, 17.69it/s, loss=2.04, v_num=1, val_acc=0.710]
Epoch 31:  35%|███▌      | 41/117 [00:02<00:04, 18.05it/s, loss=2.04, v_num=1, val_acc=0.710]
Epoch 31:  35%|███▌      | 41/117 [00:02<00:04, 17.86it/s, loss=1.99, v_num=1, val_acc=0.710]
Epoch 31:  36%|███▌      | 42/117 [00:02<00:04, 18.22it/s, loss=1.99, v_num=1, val_acc=0.710]
Epoch 31:  36%|███▌      | 42/117 [00:02<00:04, 18.02it/s, loss=1.94, v_num=1, val_acc=0.710]
Epoch 31:  37%|███▋      | 43/117 [00:02<00:04, 18.38it/s, loss=1.94, v_num=1, val_acc=0.710]
Epoch 31:  37%|███▋      | 43/117 [00:02<00:04, 18.18it/s, loss=1.93, v_num=1, val_acc=0.710]
Epoch 31:  38%|███▊      | 44/117 [00:02<00:03, 18.52it/s, loss=1.93, v_num=1, val_acc=0.710]
Epoch 31:  38%|███▊      | 44/117 [00:02<00:03, 18.33it/s, loss=1.97, v_num=1, val_acc=0.710]
Epoch 31:  38%|███▊      | 45/117 [00:02<00:03, 18.67it/s, loss=1.97, v_num=1, val_acc=0.710]
Epoch 31:  38%|███▊      | 45/117 [00:02<00:03, 18.48it/s, loss=2.04, v_num=1, val_acc=0.710]
Epoch 31:  39%|███▉      | 46/117 [00:02<00:03, 18.82it/s, loss=2.04, v_num=1, val_acc=0.710]
Epoch 31:  39%|███▉      | 46/117 [00:02<00:03, 18.63it/s, loss=2.02, v_num=1, val_acc=0.710]
Epoch 31:  40%|████      | 47/117 [00:02<00:03, 18.97it/s, loss=2.02, v_num=1, val_acc=0.710]
Epoch 31:  40%|████      | 47/117 [00:02<00:03, 18.77it/s, loss=2.02, v_num=1, val_acc=0.710]
Epoch 31:  41%|████      | 48/117 [00:02<00:03, 19.09it/s, loss=2.02, v_num=1, val_acc=0.710]
Epoch 31:  41%|████      | 48/117 [00:02<00:03, 18.90it/s, loss=2.01, v_num=1, val_acc=0.710]
Epoch 31:  42%|████▏     | 49/117 [00:02<00:03, 19.22it/s, loss=2.01, v_num=1, val_acc=0.710]
Epoch 31:  42%|████▏     | 49/117 [00:02<00:03, 19.04it/s, loss=2, v_num=1, val_acc=0.710]
Epoch 31:  43%|████▎     | 50/117 [00:02<00:03, 19.35it/s, loss=2, v_num=1, val_acc=0.710]
Epoch 31:  43%|████▎     | 50/117 [00:02<00:03, 19.17it/s, loss=2.01, v_num=1, val_acc=0.710]
Epoch 31:  44%|████▎     | 51/117 [00:02<00:03, 19.48it/s, loss=2.01, v_num=1, val_acc=0.710]
Epoch 31:  44%|████▎     | 51/117 [00:02<00:03, 19.30it/s, loss=1.97, v_num=1, val_acc=0.710]
Epoch 31:  44%|████▍     | 52/117 [00:02<00:03, 19.61it/s, loss=1.97, v_num=1, val_acc=0.710]
Epoch 31:  44%|████▍     | 52/117 [00:02<00:03, 19.42it/s, loss=1.99, v_num=1, val_acc=0.710]
Epoch 31:  45%|████▌     | 53/117 [00:02<00:03, 19.73it/s, loss=1.99, v_num=1, val_acc=0.710]
Epoch 31:  45%|████▌     | 53/117 [00:02<00:03, 19.55it/s, loss=2, v_num=1, val_acc=0.710]
Epoch 31:  46%|████▌     | 54/117 [00:02<00:03, 19.85it/s, loss=2, v_num=1, val_acc=0.710]
Epoch 31:  46%|████▌     | 54/117 [00:02<00:03, 19.67it/s, loss=2.04, v_num=1, val_acc=0.710]
Epoch 31:  47%|████▋     | 55/117 [00:02<00:03, 19.94it/s, loss=2.04, v_num=1, val_acc=0.710]
Epoch 31:  47%|████▋     | 55/117 [00:02<00:03, 19.77it/s, loss=2.01, v_num=1, val_acc=0.710]
Epoch 31:  48%|████▊     | 56/117 [00:02<00:03, 20.04it/s, loss=2.01, v_num=1, val_acc=0.710]
Epoch 31:  48%|████▊     | 56/117 [00:02<00:03, 19.88it/s, loss=2, v_num=1, val_acc=0.710]
Epoch 31:  49%|████▊     | 57/117 [00:02<00:02, 20.14it/s, loss=2, v_num=1, val_acc=0.710]
Epoch 31:  49%|████▊     | 57/117 [00:02<00:03, 19.97it/s, loss=2.05, v_num=1, val_acc=0.710]
Epoch 31:  50%|████▉     | 58/117 [00:02<00:02, 20.25it/s, loss=2.05, v_num=1, val_acc=0.710]
Epoch 31:  50%|████▉     | 58/117 [00:02<00:02, 20.08it/s, loss=2.11, v_num=1, val_acc=0.710]
Epoch 31:  50%|█████     | 59/117 [00:02<00:02, 20.35it/s, loss=2.11, v_num=1, val_acc=0.710]
Epoch 31:  50%|█████     | 59/117 [00:02<00:02, 20.18it/s, loss=2.1, v_num=1, val_acc=0.710]
Epoch 31:  51%|█████▏    | 60/117 [00:02<00:02, 20.45it/s, loss=2.1, v_num=1, val_acc=0.710]
Epoch 31:  51%|█████▏    | 60/117 [00:02<00:02, 20.28it/s, loss=2.11, v_num=1, val_acc=0.710]
Epoch 31:  52%|█████▏    | 61/117 [00:02<00:02, 20.55it/s, loss=2.11, v_num=1, val_acc=0.710]
Epoch 31:  52%|█████▏    | 61/117 [00:02<00:02, 20.38it/s, loss=2.11, v_num=1, val_acc=0.710]
Epoch 31:  53%|█████▎    | 62/117 [00:03<00:02, 20.65it/s, loss=2.11, v_num=1, val_acc=0.710]
Epoch 31:  53%|█████▎    | 62/117 [00:03<00:02, 20.48it/s, loss=2.04, v_num=1, val_acc=0.710]
Epoch 31:  54%|█████▍    | 63/117 [00:03<00:02, 20.75it/s, loss=2.04, v_num=1, val_acc=0.710]
Epoch 31:  54%|█████▍    | 63/117 [00:03<00:02, 20.58it/s, loss=2.02, v_num=1, val_acc=0.710]
Epoch 31:  55%|█████▍    | 64/117 [00:03<00:02, 20.84it/s, loss=2.02, v_num=1, val_acc=0.710]
Epoch 31:  55%|█████▍    | 64/117 [00:03<00:02, 20.67it/s, loss=2.04, v_num=1, val_acc=0.710]
Epoch 31:  56%|█████▌    | 65/117 [00:03<00:02, 20.92it/s, loss=2.04, v_num=1, val_acc=0.710]
Epoch 31:  56%|█████▌    | 65/117 [00:03<00:02, 20.76it/s, loss=2.08, v_num=1, val_acc=0.710]
Epoch 31:  56%|█████▋    | 66/117 [00:03<00:02, 21.01it/s, loss=2.08, v_num=1, val_acc=0.710]
Epoch 31:  56%|█████▋    | 66/117 [00:03<00:02, 20.85it/s, loss=2.08, v_num=1, val_acc=0.710]
Epoch 31:  57%|█████▋    | 67/117 [00:03<00:02, 21.09it/s, loss=2.08, v_num=1, val_acc=0.710]
Epoch 31:  57%|█████▋    | 67/117 [00:03<00:02, 20.94it/s, loss=2.09, v_num=1, val_acc=0.710]
Epoch 31:  58%|█████▊    | 68/117 [00:03<00:02, 21.18it/s, loss=2.09, v_num=1, val_acc=0.710]
Epoch 31:  58%|█████▊    | 68/117 [00:03<00:02, 21.02it/s, loss=2.11, v_num=1, val_acc=0.710]
Epoch 31:  59%|█████▉    | 69/117 [00:03<00:02, 21.27it/s, loss=2.11, v_num=1, val_acc=0.710]
Epoch 31:  59%|█████▉    | 69/117 [00:03<00:02, 21.11it/s, loss=2.11, v_num=1, val_acc=0.710]
Epoch 31:  60%|█████▉    | 70/117 [00:03<00:02, 21.34it/s, loss=2.11, v_num=1, val_acc=0.710]
Epoch 31:  60%|█████▉    | 70/117 [00:03<00:02, 21.18it/s, loss=2.11, v_num=1, val_acc=0.710]
Epoch 31:  61%|██████    | 71/117 [00:03<00:02, 21.42it/s, loss=2.11, v_num=1, val_acc=0.710]
Epoch 31:  61%|██████    | 71/117 [00:03<00:02, 21.26it/s, loss=2.15, v_num=1, val_acc=0.710]
Epoch 31:  62%|██████▏   | 72/117 [00:03<00:02, 21.50it/s, loss=2.15, v_num=1, val_acc=0.710]
Epoch 31:  62%|██████▏   | 72/117 [00:03<00:02, 21.34it/s, loss=2.15, v_num=1, val_acc=0.710]
Epoch 31:  62%|██████▏   | 73/117 [00:03<00:02, 21.58it/s, loss=2.15, v_num=1, val_acc=0.710]
Epoch 31:  62%|██████▏   | 73/117 [00:03<00:02, 21.42it/s, loss=2.14, v_num=1, val_acc=0.710]
Epoch 31:  63%|██████▎   | 74/117 [00:03<00:01, 21.66it/s, loss=2.14, v_num=1, val_acc=0.710]
Epoch 31:  63%|██████▎   | 74/117 [00:03<00:02, 21.50it/s, loss=2.12, v_num=1, val_acc=0.710]
Epoch 31:  64%|██████▍   | 75/117 [00:03<00:01, 21.68it/s, loss=2.12, v_num=1, val_acc=0.710]
Epoch 31:  64%|██████▍   | 75/117 [00:03<00:01, 21.54it/s, loss=2.16, v_num=1, val_acc=0.710]
Epoch 31:  65%|██████▍   | 76/117 [00:03<00:01, 21.74it/s, loss=2.16, v_num=1, val_acc=0.710]
Epoch 31:  65%|██████▍   | 76/117 [00:03<00:01, 21.59it/s, loss=2.15, v_num=1, val_acc=0.710]
Epoch 31:  66%|██████▌   | 77/117 [00:03<00:01, 21.81it/s, loss=2.15, v_num=1, val_acc=0.710]
Epoch 31:  66%|██████▌   | 77/117 [00:03<00:01, 21.66it/s, loss=2.13, v_num=1, val_acc=0.710]
Epoch 31:  67%|██████▋   | 78/117 [00:03<00:01, 21.89it/s, loss=2.13, v_num=1, val_acc=0.710]
Epoch 31:  67%|██████▋   | 78/117 [00:03<00:01, 21.73it/s, loss=2.09, v_num=1, val_acc=0.710]
Epoch 31:  68%|██████▊   | 79/117 [00:03<00:01, 21.95it/s, loss=2.09, v_num=1, val_acc=0.710]
Epoch 31:  68%|██████▊   | 79/117 [00:03<00:01, 21.81it/s, loss=2.16, v_num=1, val_acc=0.710]
Epoch 31:  68%|██████▊   | 80/117 [00:03<00:01, 22.03it/s, loss=2.16, v_num=1, val_acc=0.710]
Epoch 31:  68%|██████▊   | 80/117 [00:03<00:01, 21.87it/s, loss=2.21, v_num=1, val_acc=0.710]
Epoch 31:  69%|██████▉   | 81/117 [00:03<00:01, 22.09it/s, loss=2.21, v_num=1, val_acc=0.710]
Epoch 31:  69%|██████▉   | 81/117 [00:03<00:01, 21.94it/s, loss=2.21, v_num=1, val_acc=0.710]
Epoch 31:  70%|███████   | 82/117 [00:03<00:01, 22.14it/s, loss=2.21, v_num=1, val_acc=0.710]
Epoch 31:  70%|███████   | 82/117 [00:03<00:01, 21.99it/s, loss=2.23, v_num=1, val_acc=0.710]
Epoch 31:  71%|███████   | 83/117 [00:03<00:01, 22.20it/s, loss=2.23, v_num=1, val_acc=0.710]
Epoch 31:  71%|███████   | 83/117 [00:03<00:01, 22.06it/s, loss=2.23, v_num=1, val_acc=0.710]
Epoch 31:  72%|███████▏  | 84/117 [00:03<00:01, 22.27it/s, loss=2.23, v_num=1, val_acc=0.710]
Epoch 31:  72%|███████▏  | 84/117 [00:03<00:01, 22.12it/s, loss=2.15, v_num=1, val_acc=0.710]
Epoch 31:  73%|███████▎  | 85/117 [00:03<00:01, 22.33it/s, loss=2.15, v_num=1, val_acc=0.710]
Epoch 31:  73%|███████▎  | 85/117 [00:03<00:01, 22.18it/s, loss=2.05, v_num=1, val_acc=0.710]
Epoch 31:  74%|███████▎  | 86/117 [00:03<00:01, 22.39it/s, loss=2.05, v_num=1, val_acc=0.710]
Epoch 31:  74%|███████▎  | 86/117 [00:03<00:01, 22.25it/s, loss=2, v_num=1, val_acc=0.710]
Epoch 31:  74%|███████▍  | 87/117 [00:03<00:01, 22.46it/s, loss=2, v_num=1, val_acc=0.710]
Epoch 31:  74%|███████▍  | 87/117 [00:03<00:01, 22.31it/s, loss=1.99, v_num=1, val_acc=0.710]
Epoch 31:  75%|███████▌  | 88/117 [00:03<00:01, 22.52it/s, loss=1.99, v_num=1, val_acc=0.710]
Epoch 31:  75%|███████▌  | 88/117 [00:03<00:01, 22.37it/s, loss=2.02, v_num=1, val_acc=0.710]
Epoch 31:  76%|███████▌  | 89/117 [00:03<00:01, 22.58it/s, loss=2.02, v_num=1, val_acc=0.710]
Epoch 31:  76%|███████▌  | 89/117 [00:03<00:01, 22.43it/s, loss=2.09, v_num=1, val_acc=0.710]
Epoch 31:  77%|███████▋  | 90/117 [00:03<00:01, 22.63it/s, loss=2.09, v_num=1, val_acc=0.710]
Epoch 31:  77%|███████▋  | 90/117 [00:04<00:01, 22.49it/s, loss=2.07, v_num=1, val_acc=0.710]
Epoch 31:  78%|███████▊  | 91/117 [00:04<00:01, 22.69it/s, loss=2.07, v_num=1, val_acc=0.710]
Epoch 31:  78%|███████▊  | 91/117 [00:04<00:01, 22.55it/s, loss=2.04, v_num=1, val_acc=0.710]
Epoch 31:  79%|███████▊  | 92/117 [00:04<00:01, 22.74it/s, loss=2.04, v_num=1, val_acc=0.710]
Epoch 31:  79%|███████▊  | 92/117 [00:04<00:01, 22.60it/s, loss=2.04, v_num=1, val_acc=0.710]
Epoch 31:  79%|███████▉  | 93/117 [00:04<00:01, 22.80it/s, loss=2.04, v_num=1, val_acc=0.710]
Epoch 31:  79%|███████▉  | 93/117 [00:04<00:01, 22.65it/s, loss=2.03, v_num=1, val_acc=0.710]
Epoch 31:  80%|████████  | 94/117 [00:04<00:01, 22.85it/s, loss=2.03, v_num=1, val_acc=0.710]
Epoch 31:  80%|████████  | 94/117 [00:04<00:01, 22.71it/s, loss=1.99, v_num=1, val_acc=0.710]
Epoch 31:  81%|████████  | 95/117 [00:04<00:00, 22.90it/s, loss=1.99, v_num=1, val_acc=0.710]
Epoch 31:  81%|████████  | 95/117 [00:04<00:00, 22.76it/s, loss=1.95, v_num=1, val_acc=0.710]
Epoch 31:  82%|████████▏ | 96/117 [00:04<00:00, 22.95it/s, loss=1.95, v_num=1, val_acc=0.710]
Epoch 31:  82%|████████▏ | 96/117 [00:04<00:00, 22.81it/s, loss=1.93, v_num=1, val_acc=0.710]
Epoch 31:  83%|████████▎ | 97/117 [00:04<00:00, 23.00it/s, loss=1.93, v_num=1, val_acc=0.710]
Epoch 31:  83%|████████▎ | 97/117 [00:04<00:00, 22.86it/s, loss=1.91, v_num=1, val_acc=0.710]

Validation: 0it [00:00, ?it/s]

Validation:   0%|          | 0/20 [00:00<?, ?it/s]

Validation DataLoader 0:   0%|          | 0/20 [00:00<?, ?it/s]

Validation DataLoader 0:   5%|▌         | 1/20 [00:00<00:00, 199.53it/s]
Epoch 31:  84%|████████▍ | 98/117 [00:05<00:00, 19.29it/s, loss=1.91, v_num=1, val_acc=0.710]

Validation DataLoader 0:  10%|█         | 2/20 [00:00<00:00, 56.63it/s]
Epoch 31:  85%|████████▍ | 99/117 [00:05<00:00, 19.37it/s, loss=1.91, v_num=1, val_acc=0.710]

Validation DataLoader 0:  15%|█▌        | 3/20 [00:00<00:00, 44.95it/s]
Epoch 31:  85%|████████▌ | 100/117 [00:05<00:00, 19.44it/s, loss=1.91, v_num=1, val_acc=0.710]

Validation DataLoader 0:  20%|██        | 4/20 [00:00<00:00, 40.78it/s]
Epoch 31:  86%|████████▋ | 101/117 [00:05<00:00, 19.52it/s, loss=1.91, v_num=1, val_acc=0.710]

Validation DataLoader 0:  25%|██▌       | 5/20 [00:00<00:00, 38.51it/s]
Epoch 31:  87%|████████▋ | 102/117 [00:05<00:00, 19.59it/s, loss=1.91, v_num=1, val_acc=0.710]

Validation DataLoader 0:  30%|███       | 6/20 [00:00<00:00, 37.20it/s]
Epoch 31:  88%|████████▊ | 103/117 [00:05<00:00, 19.67it/s, loss=1.91, v_num=1, val_acc=0.710]

Validation DataLoader 0:  35%|███▌      | 7/20 [00:00<00:00, 36.30it/s]
Epoch 31:  89%|████████▉ | 104/117 [00:05<00:00, 19.74it/s, loss=1.91, v_num=1, val_acc=0.710]

Validation DataLoader 0:  40%|████      | 8/20 [00:00<00:00, 35.67it/s]
Epoch 31:  90%|████████▉ | 105/117 [00:05<00:00, 19.81it/s, loss=1.91, v_num=1, val_acc=0.710]

Validation DataLoader 0:  45%|████▌     | 9/20 [00:00<00:00, 35.15it/s]
Epoch 31:  91%|█████████ | 106/117 [00:05<00:00, 19.88it/s, loss=1.91, v_num=1, val_acc=0.710]

Validation DataLoader 0:  50%|█████     | 10/20 [00:00<00:00, 34.79it/s]
Epoch 31:  91%|█████████▏| 107/117 [00:05<00:00, 19.95it/s, loss=1.91, v_num=1, val_acc=0.710]

Validation DataLoader 0:  55%|█████▌    | 11/20 [00:00<00:00, 34.49it/s]
Epoch 31:  92%|█████████▏| 108/117 [00:05<00:00, 20.02it/s, loss=1.91, v_num=1, val_acc=0.710]

Validation DataLoader 0:  60%|██████    | 12/20 [00:00<00:00, 34.25it/s]
Epoch 31:  93%|█████████▎| 109/117 [00:05<00:00, 20.09it/s, loss=1.91, v_num=1, val_acc=0.710]

Validation DataLoader 0:  65%|██████▌   | 13/20 [00:00<00:00, 34.01it/s]
Epoch 31:  94%|█████████▍| 110/117 [00:05<00:00, 20.15it/s, loss=1.91, v_num=1, val_acc=0.710]

Validation DataLoader 0:  70%|███████   | 14/20 [00:00<00:00, 33.84it/s]
Epoch 31:  95%|█████████▍| 111/117 [00:05<00:00, 20.22it/s, loss=1.91, v_num=1, val_acc=0.710]

Validation DataLoader 0:  75%|███████▌  | 15/20 [00:00<00:00, 33.69it/s]
Epoch 31:  96%|█████████▌| 112/117 [00:05<00:00, 20.28it/s, loss=1.91, v_num=1, val_acc=0.710]

Validation DataLoader 0:  80%|████████  | 16/20 [00:00<00:00, 33.56it/s]
Epoch 31:  97%|█████████▋| 113/117 [00:05<00:00, 20.35it/s, loss=1.91, v_num=1, val_acc=0.710]

Validation DataLoader 0:  85%|████████▌ | 17/20 [00:00<00:00, 33.45it/s]
Epoch 31:  97%|█████████▋| 114/117 [00:05<00:00, 20.41it/s, loss=1.91, v_num=1, val_acc=0.710]

Validation DataLoader 0:  90%|█████████ | 18/20 [00:00<00:00, 33.34it/s]
Epoch 31:  98%|█████████▊| 115/117 [00:05<00:00, 20.48it/s, loss=1.91, v_num=1, val_acc=0.710]

Validation DataLoader 0:  95%|█████████▌| 19/20 [00:00<00:00, 33.24it/s]
Epoch 31:  99%|█████████▉| 116/117 [00:05<00:00, 20.54it/s, loss=1.91, v_num=1, val_acc=0.710]

Validation DataLoader 0: 100%|██████████| 20/20 [00:00<00:00, 33.23it/s]
Epoch 31: 100%|██████████| 117/117 [00:05<00:00, 20.60it/s, loss=1.91, v_num=1, val_acc=0.710]
Epoch 31: 100%|██████████| 117/117 [00:05<00:00, 20.53it/s, loss=1.91, v_num=1, val_acc=0.697]


Epoch 31: 100%|██████████| 117/117 [00:05<00:00, 20.53it/s, loss=1.91, v_num=1, val_acc=0.697]
Epoch 31:   0%|          | 0/117 [00:00<?, ?it/s, loss=1.91, v_num=1, val_acc=0.697]
Epoch 32:   0%|          | 0/117 [00:00<?, ?it/s, loss=1.91, v_num=1, val_acc=0.697]
Epoch 32:   1%|          | 1/117 [00:00<01:47,  1.07it/s, loss=1.91, v_num=1, val_acc=0.697]
Epoch 32:   1%|          | 1/117 [00:00<01:50,  1.05it/s, loss=1.87, v_num=1, val_acc=0.697]
Epoch 32:   2%|▏         | 2/117 [00:00<00:55,  2.06it/s, loss=1.87, v_num=1, val_acc=0.697]
Epoch 32:   2%|▏         | 2/117 [00:00<00:57,  2.01it/s, loss=1.79, v_num=1, val_acc=0.697]
Epoch 32:   3%|▎         | 3/117 [00:01<00:38,  2.99it/s, loss=1.79, v_num=1, val_acc=0.697]
Epoch 32:   3%|▎         | 3/117 [00:01<00:39,  2.92it/s, loss=1.74, v_num=1, val_acc=0.697]
Epoch 32:   3%|▎         | 4/117 [00:01<00:29,  3.86it/s, loss=1.74, v_num=1, val_acc=0.697]
Epoch 32:   3%|▎         | 4/117 [00:01<00:30,  3.76it/s, loss=1.76, v_num=1, val_acc=0.697]
Epoch 32:   4%|▍         | 5/117 [00:01<00:23,  4.67it/s, loss=1.76, v_num=1, val_acc=0.697]
Epoch 32:   4%|▍         | 5/117 [00:01<00:24,  4.56it/s, loss=1.78, v_num=1, val_acc=0.697]
Epoch 32:   5%|▌         | 6/117 [00:01<00:20,  5.43it/s, loss=1.78, v_num=1, val_acc=0.697]
Epoch 32:   5%|▌         | 6/117 [00:01<00:20,  5.31it/s, loss=1.84, v_num=1, val_acc=0.697]
Epoch 32:   6%|▌         | 7/117 [00:01<00:17,  6.15it/s, loss=1.84, v_num=1, val_acc=0.697]
Epoch 32:   6%|▌         | 7/117 [00:01<00:18,  6.01it/s, loss=1.83, v_num=1, val_acc=0.697]
Epoch 32:   7%|▋         | 8/117 [00:01<00:15,  6.83it/s, loss=1.83, v_num=1, val_acc=0.697]
Epoch 32:   7%|▋         | 8/117 [00:01<00:16,  6.68it/s, loss=1.83, v_num=1, val_acc=0.697]
Epoch 32:   8%|▊         | 9/117 [00:01<00:14,  7.44it/s, loss=1.83, v_num=1, val_acc=0.697]
Epoch 32:   8%|▊         | 9/117 [00:01<00:14,  7.29it/s, loss=1.84, v_num=1, val_acc=0.697]
Epoch 32:   9%|▊         | 10/117 [00:01<00:13,  8.03it/s, loss=1.84, v_num=1, val_acc=0.697]
Epoch 32:   9%|▊         | 10/117 [00:01<00:13,  7.87it/s, loss=1.82, v_num=1, val_acc=0.697]
Epoch 32:   9%|▉         | 11/117 [00:01<00:12,  8.60it/s, loss=1.82, v_num=1, val_acc=0.697]
Epoch 32:   9%|▉         | 11/117 [00:01<00:12,  8.43it/s, loss=1.79, v_num=1, val_acc=0.697]
Epoch 32:  10%|█         | 12/117 [00:01<00:11,  9.14it/s, loss=1.79, v_num=1, val_acc=0.697]
Epoch 32:  10%|█         | 12/117 [00:01<00:11,  8.96it/s, loss=1.72, v_num=1, val_acc=0.697]
Epoch 32:  11%|█         | 13/117 [00:01<00:10,  9.65it/s, loss=1.72, v_num=1, val_acc=0.697]
Epoch 32:  11%|█         | 13/117 [00:01<00:10,  9.48it/s, loss=1.77, v_num=1, val_acc=0.697]
Epoch 32:  12%|█▏        | 14/117 [00:01<00:10, 10.15it/s, loss=1.77, v_num=1, val_acc=0.697]
Epoch 32:  12%|█▏        | 14/117 [00:01<00:10,  9.96it/s, loss=1.74, v_num=1, val_acc=0.697]
Epoch 32:  13%|█▎        | 15/117 [00:01<00:09, 10.61it/s, loss=1.74, v_num=1, val_acc=0.697]
Epoch 32:  13%|█▎        | 15/117 [00:01<00:09, 10.42it/s, loss=1.72, v_num=1, val_acc=0.697]
Epoch 32:  14%|█▎        | 16/117 [00:01<00:09, 11.06it/s, loss=1.72, v_num=1, val_acc=0.697]
Epoch 32:  14%|█▎        | 16/117 [00:01<00:09, 10.87it/s, loss=1.73, v_num=1, val_acc=0.697]
Epoch 32:  15%|█▍        | 17/117 [00:01<00:08, 11.46it/s, loss=1.73, v_num=1, val_acc=0.697]
Epoch 32:  15%|█▍        | 17/117 [00:01<00:08, 11.27it/s, loss=1.81, v_num=1, val_acc=0.697]
Epoch 32:  15%|█▌        | 18/117 [00:01<00:08, 11.86it/s, loss=1.81, v_num=1, val_acc=0.697]
Epoch 32:  15%|█▌        | 18/117 [00:01<00:08, 11.66it/s, loss=1.81, v_num=1, val_acc=0.697]
Epoch 32:  16%|█▌        | 19/117 [00:01<00:08, 12.24it/s, loss=1.81, v_num=1, val_acc=0.697]
Epoch 32:  16%|█▌        | 19/117 [00:01<00:08, 12.05it/s, loss=1.81, v_num=1, val_acc=0.697]
Epoch 32:  17%|█▋        | 20/117 [00:01<00:07, 12.61it/s, loss=1.81, v_num=1, val_acc=0.697]
Epoch 32:  17%|█▋        | 20/117 [00:01<00:07, 12.41it/s, loss=1.79, v_num=1, val_acc=0.697]
Epoch 32:  18%|█▊        | 21/117 [00:01<00:07, 12.97it/s, loss=1.79, v_num=1, val_acc=0.697]
Epoch 32:  18%|█▊        | 21/117 [00:01<00:07, 12.77it/s, loss=1.78, v_num=1, val_acc=0.697]
Epoch 32:  19%|█▉        | 22/117 [00:01<00:07, 13.31it/s, loss=1.78, v_num=1, val_acc=0.697]
Epoch 32:  19%|█▉        | 22/117 [00:01<00:07, 13.11it/s, loss=1.79, v_num=1, val_acc=0.697]
Epoch 32:  20%|█▉        | 23/117 [00:01<00:06, 13.63it/s, loss=1.79, v_num=1, val_acc=0.697]
Epoch 32:  20%|█▉        | 23/117 [00:01<00:07, 13.43it/s, loss=1.78, v_num=1, val_acc=0.697]
Epoch 32:  21%|██        | 24/117 [00:01<00:06, 13.94it/s, loss=1.78, v_num=1, val_acc=0.697]
Epoch 32:  21%|██        | 24/117 [00:01<00:06, 13.74it/s, loss=1.81, v_num=1, val_acc=0.697]
Epoch 32:  21%|██▏       | 25/117 [00:01<00:06, 14.24it/s, loss=1.81, v_num=1, val_acc=0.697]
Epoch 32:  21%|██▏       | 25/117 [00:01<00:06, 14.03it/s, loss=1.85, v_num=1, val_acc=0.697]
Epoch 32:  22%|██▏       | 26/117 [00:01<00:06, 14.52it/s, loss=1.85, v_num=1, val_acc=0.697]
Epoch 32:  22%|██▏       | 26/117 [00:01<00:06, 14.32it/s, loss=1.86, v_num=1, val_acc=0.697]
Epoch 32:  23%|██▎       | 27/117 [00:01<00:06, 14.80it/s, loss=1.86, v_num=1, val_acc=0.697]
Epoch 32:  23%|██▎       | 27/117 [00:01<00:06, 14.60it/s, loss=1.93, v_num=1, val_acc=0.697]
Epoch 32:  24%|██▍       | 28/117 [00:01<00:05, 15.06it/s, loss=1.93, v_num=1, val_acc=0.697]
Epoch 32:  24%|██▍       | 28/117 [00:01<00:05, 14.86it/s, loss=2, v_num=1, val_acc=0.697]
Epoch 32:  25%|██▍       | 29/117 [00:01<00:05, 15.32it/s, loss=2, v_num=1, val_acc=0.697]
Epoch 32:  25%|██▍       | 29/117 [00:01<00:05, 15.12it/s, loss=2.02, v_num=1, val_acc=0.697]
Epoch 32:  26%|██▌       | 30/117 [00:01<00:05, 15.57it/s, loss=2.02, v_num=1, val_acc=0.697]
Epoch 32:  26%|██▌       | 30/117 [00:01<00:05, 15.37it/s, loss=2.08, v_num=1, val_acc=0.697]
Epoch 32:  26%|██▋       | 31/117 [00:01<00:05, 15.81it/s, loss=2.08, v_num=1, val_acc=0.697]
Epoch 32:  26%|██▋       | 31/117 [00:01<00:05, 15.61it/s, loss=2.06, v_num=1, val_acc=0.697]
Epoch 32:  27%|██▋       | 32/117 [00:01<00:05, 16.04it/s, loss=2.06, v_num=1, val_acc=0.697]
Epoch 32:  27%|██▋       | 32/117 [00:02<00:05, 15.84it/s, loss=2.06, v_num=1, val_acc=0.697]
Epoch 32:  28%|██▊       | 33/117 [00:02<00:05, 16.26it/s, loss=2.06, v_num=1, val_acc=0.697]
Epoch 32:  28%|██▊       | 33/117 [00:02<00:05, 16.06it/s, loss=2.06, v_num=1, val_acc=0.697]
Epoch 32:  29%|██▉       | 34/117 [00:02<00:05, 16.47it/s, loss=2.06, v_num=1, val_acc=0.697]
Epoch 32:  29%|██▉       | 34/117 [00:02<00:05, 16.27it/s, loss=2.09, v_num=1, val_acc=0.697]
Epoch 32:  30%|██▉       | 35/117 [00:02<00:04, 16.68it/s, loss=2.09, v_num=1, val_acc=0.697]
Epoch 32:  30%|██▉       | 35/117 [00:02<00:04, 16.48it/s, loss=2.14, v_num=1, val_acc=0.697]
Epoch 32:  31%|███       | 36/117 [00:02<00:04, 16.88it/s, loss=2.14, v_num=1, val_acc=0.697]
Epoch 32:  31%|███       | 36/117 [00:02<00:04, 16.68it/s, loss=2.15, v_num=1, val_acc=0.697]
Epoch 32:  32%|███▏      | 37/117 [00:02<00:04, 17.07it/s, loss=2.15, v_num=1, val_acc=0.697]
Epoch 32:  32%|███▏      | 37/117 [00:02<00:04, 16.88it/s, loss=2.08, v_num=1, val_acc=0.697]
Epoch 32:  32%|███▏      | 38/117 [00:02<00:04, 17.26it/s, loss=2.08, v_num=1, val_acc=0.697]
Epoch 32:  32%|███▏      | 38/117 [00:02<00:04, 17.07it/s, loss=2.07, v_num=1, val_acc=0.697]
Epoch 32:  33%|███▎      | 39/117 [00:02<00:04, 17.45it/s, loss=2.07, v_num=1, val_acc=0.697]
Epoch 32:  33%|███▎      | 39/117 [00:02<00:04, 17.25it/s, loss=2.07, v_num=1, val_acc=0.697]
Epoch 32:  34%|███▍      | 40/117 [00:02<00:04, 17.62it/s, loss=2.07, v_num=1, val_acc=0.697]
Epoch 32:  34%|███▍      | 40/117 [00:02<00:04, 17.43it/s, loss=2.1, v_num=1, val_acc=0.697]
Epoch 32:  35%|███▌      | 41/117 [00:02<00:04, 17.79it/s, loss=2.1, v_num=1, val_acc=0.697]
Epoch 32:  35%|███▌      | 41/117 [00:02<00:04, 17.60it/s, loss=2.12, v_num=1, val_acc=0.697]
Epoch 32:  36%|███▌      | 42/117 [00:02<00:04, 17.96it/s, loss=2.12, v_num=1, val_acc=0.697]
Epoch 32:  36%|███▌      | 42/117 [00:02<00:04, 17.77it/s, loss=2.11, v_num=1, val_acc=0.697]
Epoch 32:  37%|███▋      | 43/117 [00:02<00:04, 18.12it/s, loss=2.11, v_num=1, val_acc=0.697]
Epoch 32:  37%|███▋      | 43/117 [00:02<00:04, 17.93it/s, loss=2.11, v_num=1, val_acc=0.697]
Epoch 32:  38%|███▊      | 44/117 [00:02<00:03, 18.28it/s, loss=2.11, v_num=1, val_acc=0.697]
Epoch 32:  38%|███▊      | 44/117 [00:02<00:04, 18.09it/s, loss=2.09, v_num=1, val_acc=0.697]
Epoch 32:  38%|███▊      | 45/117 [00:02<00:03, 18.43it/s, loss=2.09, v_num=1, val_acc=0.697]
Epoch 32:  38%|███▊      | 45/117 [00:02<00:03, 18.24it/s, loss=2.04, v_num=1, val_acc=0.697]
Epoch 32:  39%|███▉      | 46/117 [00:02<00:03, 18.54it/s, loss=2.04, v_num=1, val_acc=0.697]
Epoch 32:  39%|███▉      | 46/117 [00:02<00:03, 18.37it/s, loss=2.02, v_num=1, val_acc=0.697]
Epoch 32:  40%|████      | 47/117 [00:02<00:03, 18.70it/s, loss=2.02, v_num=1, val_acc=0.697]
Epoch 32:  40%|████      | 47/117 [00:02<00:03, 18.51it/s, loss=1.98, v_num=1, val_acc=0.697]
Epoch 32:  41%|████      | 48/117 [00:02<00:03, 18.84it/s, loss=1.98, v_num=1, val_acc=0.697]
Epoch 32:  41%|████      | 48/117 [00:02<00:03, 18.65it/s, loss=1.89, v_num=1, val_acc=0.697]
Epoch 32:  42%|████▏     | 49/117 [00:02<00:03, 18.98it/s, loss=1.89, v_num=1, val_acc=0.697]
Epoch 32:  42%|████▏     | 49/117 [00:02<00:03, 18.79it/s, loss=1.85, v_num=1, val_acc=0.697]
Epoch 32:  43%|████▎     | 50/117 [00:02<00:03, 19.11it/s, loss=1.85, v_num=1, val_acc=0.697]
Epoch 32:  43%|████▎     | 50/117 [00:02<00:03, 18.93it/s, loss=1.79, v_num=1, val_acc=0.697]
Epoch 32:  44%|████▎     | 51/117 [00:02<00:03, 19.24it/s, loss=1.79, v_num=1, val_acc=0.697]
Epoch 32:  44%|████▎     | 51/117 [00:02<00:03, 19.06it/s, loss=1.76, v_num=1, val_acc=0.697]
Epoch 32:  44%|████▍     | 52/117 [00:02<00:03, 19.37it/s, loss=1.76, v_num=1, val_acc=0.697]
Epoch 32:  44%|████▍     | 52/117 [00:02<00:03, 19.19it/s, loss=1.74, v_num=1, val_acc=0.697]
Epoch 32:  45%|████▌     | 53/117 [00:02<00:03, 19.49it/s, loss=1.74, v_num=1, val_acc=0.697]
Epoch 32:  45%|████▌     | 53/117 [00:02<00:03, 19.31it/s, loss=1.7, v_num=1, val_acc=0.697]
Epoch 32:  46%|████▌     | 54/117 [00:02<00:03, 19.61it/s, loss=1.7, v_num=1, val_acc=0.697]
Epoch 32:  46%|████▌     | 54/117 [00:02<00:03, 19.43it/s, loss=1.67, v_num=1, val_acc=0.697]
Epoch 32:  47%|████▋     | 55/117 [00:02<00:03, 19.73it/s, loss=1.67, v_num=1, val_acc=0.697]
Epoch 32:  47%|████▋     | 55/117 [00:02<00:03, 19.55it/s, loss=1.65, v_num=1, val_acc=0.697]
Epoch 32:  48%|████▊     | 56/117 [00:02<00:03, 19.84it/s, loss=1.65, v_num=1, val_acc=0.697]
Epoch 32:  48%|████▊     | 56/117 [00:02<00:03, 19.66it/s, loss=1.65, v_num=1, val_acc=0.697]
Epoch 32:  49%|████▊     | 57/117 [00:02<00:03, 19.95it/s, loss=1.65, v_num=1, val_acc=0.697]
Epoch 32:  49%|████▊     | 57/117 [00:02<00:03, 19.77it/s, loss=1.72, v_num=1, val_acc=0.697]
Epoch 32:  50%|████▉     | 58/117 [00:02<00:02, 20.05it/s, loss=1.72, v_num=1, val_acc=0.697]
Epoch 32:  50%|████▉     | 58/117 [00:02<00:02, 19.88it/s, loss=1.77, v_num=1, val_acc=0.697]
Epoch 32:  50%|█████     | 59/117 [00:02<00:02, 20.16it/s, loss=1.77, v_num=1, val_acc=0.697]
Epoch 32:  50%|█████     | 59/117 [00:02<00:02, 19.99it/s, loss=1.83, v_num=1, val_acc=0.697]
Epoch 32:  51%|█████▏    | 60/117 [00:02<00:02, 20.27it/s, loss=1.83, v_num=1, val_acc=0.697]
Epoch 32:  51%|█████▏    | 60/117 [00:02<00:02, 20.09it/s, loss=1.81, v_num=1, val_acc=0.697]
Epoch 32:  52%|█████▏    | 61/117 [00:02<00:02, 20.37it/s, loss=1.81, v_num=1, val_acc=0.697]
Epoch 32:  52%|█████▏    | 61/117 [00:03<00:02, 20.20it/s, loss=1.8, v_num=1, val_acc=0.697]
Epoch 32:  53%|█████▎    | 62/117 [00:03<00:02, 20.47it/s, loss=1.8, v_num=1, val_acc=0.697]
Epoch 32:  53%|█████▎    | 62/117 [00:03<00:02, 20.30it/s, loss=1.83, v_num=1, val_acc=0.697]
Epoch 32:  54%|█████▍    | 63/117 [00:03<00:02, 20.56it/s, loss=1.83, v_num=1, val_acc=0.697]
Epoch 32:  54%|█████▍    | 63/117 [00:03<00:02, 20.40it/s, loss=1.88, v_num=1, val_acc=0.697]
Epoch 32:  55%|█████▍    | 64/117 [00:03<00:02, 20.66it/s, loss=1.88, v_num=1, val_acc=0.697]
Epoch 32:  55%|█████▍    | 64/117 [00:03<00:02, 20.49it/s, loss=1.89, v_num=1, val_acc=0.697]
Epoch 32:  56%|█████▌    | 65/117 [00:03<00:02, 20.75it/s, loss=1.89, v_num=1, val_acc=0.697]
Epoch 32:  56%|█████▌    | 65/117 [00:03<00:02, 20.59it/s, loss=1.9, v_num=1, val_acc=0.697]
Epoch 32:  56%|█████▋    | 66/117 [00:03<00:02, 20.84it/s, loss=1.9, v_num=1, val_acc=0.697]
Epoch 32:  56%|█████▋    | 66/117 [00:03<00:02, 20.68it/s, loss=1.86, v_num=1, val_acc=0.697]
Epoch 32:  57%|█████▋    | 67/117 [00:03<00:02, 20.93it/s, loss=1.86, v_num=1, val_acc=0.697]
Epoch 32:  57%|█████▋    | 67/117 [00:03<00:02, 20.77it/s, loss=1.9, v_num=1, val_acc=0.697]
Epoch 32:  58%|█████▊    | 68/117 [00:03<00:02, 21.02it/s, loss=1.9, v_num=1, val_acc=0.697]
Epoch 32:  58%|█████▊    | 68/117 [00:03<00:02, 20.86it/s, loss=1.92, v_num=1, val_acc=0.697]
Epoch 32:  59%|█████▉    | 69/117 [00:03<00:02, 21.10it/s, loss=1.92, v_num=1, val_acc=0.697]
Epoch 32:  59%|█████▉    | 69/117 [00:03<00:02, 20.94it/s, loss=1.94, v_num=1, val_acc=0.697]
Epoch 32:  60%|█████▉    | 70/117 [00:03<00:02, 21.18it/s, loss=1.94, v_num=1, val_acc=0.697]
Epoch 32:  60%|█████▉    | 70/117 [00:03<00:02, 21.02it/s, loss=1.95, v_num=1, val_acc=0.697]
Epoch 32:  61%|██████    | 71/117 [00:03<00:02, 21.26it/s, loss=1.95, v_num=1, val_acc=0.697]
Epoch 32:  61%|██████    | 71/117 [00:03<00:02, 21.10it/s, loss=1.99, v_num=1, val_acc=0.697]
Epoch 32:  62%|██████▏   | 72/117 [00:03<00:02, 21.34it/s, loss=1.99, v_num=1, val_acc=0.697]
Epoch 32:  62%|██████▏   | 72/117 [00:03<00:02, 21.18it/s, loss=2.04, v_num=1, val_acc=0.697]
Epoch 32:  62%|██████▏   | 73/117 [00:03<00:02, 21.42it/s, loss=2.04, v_num=1, val_acc=0.697]
Epoch 32:  62%|██████▏   | 73/117 [00:03<00:02, 21.26it/s, loss=2.08, v_num=1, val_acc=0.697]
Epoch 32:  63%|██████▎   | 74/117 [00:03<00:02, 21.50it/s, loss=2.08, v_num=1, val_acc=0.697]
Epoch 32:  63%|██████▎   | 74/117 [00:03<00:02, 21.34it/s, loss=2.11, v_num=1, val_acc=0.697]
Epoch 32:  64%|██████▍   | 75/117 [00:03<00:01, 21.57it/s, loss=2.11, v_num=1, val_acc=0.697]
Epoch 32:  64%|██████▍   | 75/117 [00:03<00:01, 21.42it/s, loss=2.15, v_num=1, val_acc=0.697]
Epoch 32:  65%|██████▍   | 76/117 [00:03<00:01, 21.65it/s, loss=2.15, v_num=1, val_acc=0.697]
Epoch 32:  65%|██████▍   | 76/117 [00:03<00:01, 21.49it/s, loss=2.15, v_num=1, val_acc=0.697]
Epoch 32:  66%|██████▌   | 77/117 [00:03<00:01, 21.72it/s, loss=2.15, v_num=1, val_acc=0.697]
Epoch 32:  66%|██████▌   | 77/117 [00:03<00:01, 21.57it/s, loss=2.15, v_num=1, val_acc=0.697]
Epoch 32:  67%|██████▋   | 78/117 [00:03<00:01, 21.79it/s, loss=2.15, v_num=1, val_acc=0.697]
Epoch 32:  67%|██████▋   | 78/117 [00:03<00:01, 21.64it/s, loss=2.21, v_num=1, val_acc=0.697]
Epoch 32:  68%|██████▊   | 79/117 [00:03<00:01, 21.86it/s, loss=2.21, v_num=1, val_acc=0.697]
Epoch 32:  68%|██████▊   | 79/117 [00:03<00:01, 21.71it/s, loss=2.21, v_num=1, val_acc=0.697]
Epoch 32:  68%|██████▊   | 80/117 [00:03<00:01, 21.93it/s, loss=2.21, v_num=1, val_acc=0.697]
Epoch 32:  68%|██████▊   | 80/117 [00:03<00:01, 21.78it/s, loss=2.25, v_num=1, val_acc=0.697]
Epoch 32:  69%|██████▉   | 81/117 [00:03<00:01, 22.00it/s, loss=2.25, v_num=1, val_acc=0.697]
Epoch 32:  69%|██████▉   | 81/117 [00:03<00:01, 21.85it/s, loss=2.31, v_num=1, val_acc=0.697]
Epoch 32:  70%|███████   | 82/117 [00:03<00:01, 22.05it/s, loss=2.31, v_num=1, val_acc=0.697]
Epoch 32:  70%|███████   | 82/117 [00:03<00:01, 21.90it/s, loss=2.36, v_num=1, val_acc=0.697]
Epoch 32:  71%|███████   | 83/117 [00:03<00:01, 22.12it/s, loss=2.36, v_num=1, val_acc=0.697]
Epoch 32:  71%|███████   | 83/117 [00:03<00:01, 21.97it/s, loss=2.32, v_num=1, val_acc=0.697]
Epoch 32:  72%|███████▏  | 84/117 [00:03<00:01, 22.18it/s, loss=2.32, v_num=1, val_acc=0.697]
Epoch 32:  72%|███████▏  | 84/117 [00:03<00:01, 22.03it/s, loss=2.38, v_num=1, val_acc=0.697]
Epoch 32:  73%|███████▎  | 85/117 [00:03<00:01, 22.25it/s, loss=2.38, v_num=1, val_acc=0.697]
Epoch 32:  73%|███████▎  | 85/117 [00:03<00:01, 22.10it/s, loss=2.4, v_num=1, val_acc=0.697]
Epoch 32:  74%|███████▎  | 86/117 [00:03<00:01, 22.31it/s, loss=2.4, v_num=1, val_acc=0.697]
Epoch 32:  74%|███████▎  | 86/117 [00:03<00:01, 22.16it/s, loss=2.38, v_num=1, val_acc=0.697]
Epoch 32:  74%|███████▍  | 87/117 [00:03<00:01, 22.37it/s, loss=2.38, v_num=1, val_acc=0.697]
Epoch 32:  74%|███████▍  | 87/117 [00:03<00:01, 22.22it/s, loss=2.32, v_num=1, val_acc=0.697]
Epoch 32:  75%|███████▌  | 88/117 [00:03<00:01, 22.43it/s, loss=2.32, v_num=1, val_acc=0.697]
Epoch 32:  75%|███████▌  | 88/117 [00:03<00:01, 22.28it/s, loss=2.29, v_num=1, val_acc=0.697]
Epoch 32:  76%|███████▌  | 89/117 [00:03<00:01, 22.49it/s, loss=2.29, v_num=1, val_acc=0.697]
Epoch 32:  76%|███████▌  | 89/117 [00:03<00:01, 22.34it/s, loss=2.27, v_num=1, val_acc=0.697]
Epoch 32:  77%|███████▋  | 90/117 [00:03<00:01, 22.55it/s, loss=2.27, v_num=1, val_acc=0.697]
Epoch 32:  77%|███████▋  | 90/117 [00:04<00:01, 22.40it/s, loss=2.25, v_num=1, val_acc=0.697]
Epoch 32:  78%|███████▊  | 91/117 [00:04<00:01, 22.60it/s, loss=2.25, v_num=1, val_acc=0.697]
Epoch 32:  78%|███████▊  | 91/117 [00:04<00:01, 22.46it/s, loss=2.25, v_num=1, val_acc=0.697]
Epoch 32:  79%|███████▊  | 92/117 [00:04<00:01, 22.66it/s, loss=2.25, v_num=1, val_acc=0.697]
Epoch 32:  79%|███████▊  | 92/117 [00:04<00:01, 22.52it/s, loss=2.27, v_num=1, val_acc=0.697]
Epoch 32:  79%|███████▉  | 93/117 [00:04<00:01, 22.71it/s, loss=2.27, v_num=1, val_acc=0.697]
Epoch 32:  79%|███████▉  | 93/117 [00:04<00:01, 22.57it/s, loss=2.27, v_num=1, val_acc=0.697]
Epoch 32:  80%|████████  | 94/117 [00:04<00:01, 22.77it/s, loss=2.27, v_num=1, val_acc=0.697]
Epoch 32:  80%|████████  | 94/117 [00:04<00:01, 22.63it/s, loss=2.29, v_num=1, val_acc=0.697]
Epoch 32:  81%|████████  | 95/117 [00:04<00:00, 22.82it/s, loss=2.29, v_num=1, val_acc=0.697]
Epoch 32:  81%|████████  | 95/117 [00:04<00:00, 22.68it/s, loss=2.3, v_num=1, val_acc=0.697]
Epoch 32:  82%|████████▏ | 96/117 [00:04<00:00, 22.87it/s, loss=2.3, v_num=1, val_acc=0.697]
Epoch 32:  82%|████████▏ | 96/117 [00:04<00:00, 22.73it/s, loss=2.29, v_num=1, val_acc=0.697]
Epoch 32:  83%|████████▎ | 97/117 [00:04<00:00, 22.92it/s, loss=2.29, v_num=1, val_acc=0.697]
Epoch 32:  83%|████████▎ | 97/117 [00:04<00:00, 22.78it/s, loss=2.24, v_num=1, val_acc=0.697]

Validation: 0it [00:00, ?it/s]

Validation:   0%|          | 0/20 [00:00<?, ?it/s]

Validation DataLoader 0:   0%|          | 0/20 [00:00<?, ?it/s]

Validation DataLoader 0:   5%|▌         | 1/20 [00:00<00:00, 170.88it/s]
Epoch 32:  84%|████████▍ | 98/117 [00:05<00:00, 19.16it/s, loss=2.24, v_num=1, val_acc=0.697]

Validation DataLoader 0:  10%|█         | 2/20 [00:00<00:00, 55.12it/s]
Epoch 32:  85%|████████▍ | 99/117 [00:05<00:00, 19.24it/s, loss=2.24, v_num=1, val_acc=0.697]

Validation DataLoader 0:  15%|█▌        | 3/20 [00:00<00:00, 44.26it/s]
Epoch 32:  85%|████████▌ | 100/117 [00:05<00:00, 19.32it/s, loss=2.24, v_num=1, val_acc=0.697]

Validation DataLoader 0:  20%|██        | 4/20 [00:00<00:00, 40.19it/s]
Epoch 32:  86%|████████▋ | 101/117 [00:05<00:00, 19.39it/s, loss=2.24, v_num=1, val_acc=0.697]

Validation DataLoader 0:  25%|██▌       | 5/20 [00:00<00:00, 37.92it/s]
Epoch 32:  87%|████████▋ | 102/117 [00:05<00:00, 19.46it/s, loss=2.24, v_num=1, val_acc=0.697]

Validation DataLoader 0:  30%|███       | 6/20 [00:00<00:00, 36.87it/s]
Epoch 32:  88%|████████▊ | 103/117 [00:05<00:00, 19.54it/s, loss=2.24, v_num=1, val_acc=0.697]

Validation DataLoader 0:  35%|███▌      | 7/20 [00:00<00:00, 36.05it/s]
Epoch 32:  89%|████████▉ | 104/117 [00:05<00:00, 19.61it/s, loss=2.24, v_num=1, val_acc=0.697]

Validation DataLoader 0:  40%|████      | 8/20 [00:00<00:00, 35.45it/s]
Epoch 32:  90%|████████▉ | 105/117 [00:05<00:00, 19.68it/s, loss=2.24, v_num=1, val_acc=0.697]

Validation DataLoader 0:  45%|████▌     | 9/20 [00:00<00:00, 34.96it/s]
Epoch 32:  91%|█████████ | 106/117 [00:05<00:00, 19.75it/s, loss=2.24, v_num=1, val_acc=0.697]

Validation DataLoader 0:  50%|█████     | 10/20 [00:00<00:00, 34.65it/s]
Epoch 32:  91%|█████████▏| 107/117 [00:05<00:00, 19.82it/s, loss=2.24, v_num=1, val_acc=0.697]

Validation DataLoader 0:  55%|█████▌    | 11/20 [00:00<00:00, 34.36it/s]
Epoch 32:  92%|█████████▏| 108/117 [00:05<00:00, 19.89it/s, loss=2.24, v_num=1, val_acc=0.697]

Validation DataLoader 0:  60%|██████    | 12/20 [00:00<00:00, 34.12it/s]
Epoch 32:  93%|█████████▎| 109/117 [00:05<00:00, 19.96it/s, loss=2.24, v_num=1, val_acc=0.697]

Validation DataLoader 0:  65%|██████▌   | 13/20 [00:00<00:00, 33.93it/s]
Epoch 32:  94%|█████████▍| 110/117 [00:05<00:00, 20.03it/s, loss=2.24, v_num=1, val_acc=0.697]

Validation DataLoader 0:  70%|███████   | 14/20 [00:00<00:00, 33.75it/s]
Epoch 32:  95%|█████████▍| 111/117 [00:05<00:00, 20.09it/s, loss=2.24, v_num=1, val_acc=0.697]

Validation DataLoader 0:  75%|███████▌  | 15/20 [00:00<00:00, 33.62it/s]
Epoch 32:  96%|█████████▌| 112/117 [00:05<00:00, 20.16it/s, loss=2.24, v_num=1, val_acc=0.697]

Validation DataLoader 0:  80%|████████  | 16/20 [00:00<00:00, 33.49it/s]
Epoch 32:  97%|█████████▋| 113/117 [00:05<00:00, 20.23it/s, loss=2.24, v_num=1, val_acc=0.697]

Validation DataLoader 0:  85%|████████▌ | 17/20 [00:00<00:00, 33.37it/s]
Epoch 32:  97%|█████████▋| 114/117 [00:05<00:00, 20.29it/s, loss=2.24, v_num=1, val_acc=0.697]

Validation DataLoader 0:  90%|█████████ | 18/20 [00:00<00:00, 33.27it/s]
Epoch 32:  98%|█████████▊| 115/117 [00:05<00:00, 20.35it/s, loss=2.24, v_num=1, val_acc=0.697]

Validation DataLoader 0:  95%|█████████▌| 19/20 [00:00<00:00, 33.19it/s]
Epoch 32:  99%|█████████▉| 116/117 [00:05<00:00, 20.42it/s, loss=2.24, v_num=1, val_acc=0.697]

Validation DataLoader 0: 100%|██████████| 20/20 [00:00<00:00, 33.17it/s]
Epoch 32: 100%|██████████| 117/117 [00:05<00:00, 20.48it/s, loss=2.24, v_num=1, val_acc=0.697]
Epoch 32: 100%|██████████| 117/117 [00:05<00:00, 20.41it/s, loss=2.24, v_num=1, val_acc=0.674]


Epoch 32: 100%|██████████| 117/117 [00:05<00:00, 20.41it/s, loss=2.24, v_num=1, val_acc=0.674]
Epoch 32:   0%|          | 0/117 [00:00<?, ?it/s, loss=2.24, v_num=1, val_acc=0.674]
Epoch 33:   0%|          | 0/117 [00:00<?, ?it/s, loss=2.24, v_num=1, val_acc=0.674]
Epoch 33:   1%|          | 1/117 [00:00<01:42,  1.13it/s, loss=2.24, v_num=1, val_acc=0.674]
Epoch 33:   1%|          | 1/117 [00:00<01:44,  1.11it/s, loss=2.17, v_num=1, val_acc=0.674]
Epoch 33:   2%|▏         | 2/117 [00:00<00:53,  2.17it/s, loss=2.17, v_num=1, val_acc=0.674]
Epoch 33:   2%|▏         | 2/117 [00:00<00:54,  2.12it/s, loss=2.14, v_num=1, val_acc=0.674]
Epoch 33:   3%|▎         | 3/117 [00:00<00:36,  3.15it/s, loss=2.14, v_num=1, val_acc=0.674]
Epoch 33:   3%|▎         | 3/117 [00:00<00:37,  3.07it/s, loss=2.19, v_num=1, val_acc=0.674]
Epoch 33:   3%|▎         | 4/117 [00:00<00:27,  4.05it/s, loss=2.19, v_num=1, val_acc=0.674]
Epoch 33:   3%|▎         | 4/117 [00:01<00:28,  3.95it/s, loss=2.18, v_num=1, val_acc=0.674]
Epoch 33:   4%|▍         | 5/117 [00:01<00:22,  4.90it/s, loss=2.18, v_num=1, val_acc=0.674]
Epoch 33:   4%|▍         | 5/117 [00:01<00:23,  4.78it/s, loss=2.16, v_num=1, val_acc=0.674]
Epoch 33:   5%|▌         | 6/117 [00:01<00:19,  5.69it/s, loss=2.16, v_num=1, val_acc=0.674]
Epoch 33:   5%|▌         | 6/117 [00:01<00:19,  5.56it/s, loss=2.22, v_num=1, val_acc=0.674]
Epoch 33:   6%|▌         | 7/117 [00:01<00:17,  6.44it/s, loss=2.22, v_num=1, val_acc=0.674]
Epoch 33:   6%|▌         | 7/117 [00:01<00:17,  6.29it/s, loss=2.17, v_num=1, val_acc=0.674]
Epoch 33:   7%|▋         | 8/117 [00:01<00:15,  7.13it/s, loss=2.17, v_num=1, val_acc=0.674]
Epoch 33:   7%|▋         | 8/117 [00:01<00:15,  6.97it/s, loss=2.14, v_num=1, val_acc=0.674]
Epoch 33:   8%|▊         | 9/117 [00:01<00:13,  7.78it/s, loss=2.14, v_num=1, val_acc=0.674]
Epoch 33:   8%|▊         | 9/117 [00:01<00:14,  7.62it/s, loss=2.18, v_num=1, val_acc=0.674]
Epoch 33:   9%|▊         | 10/117 [00:01<00:12,  8.36it/s, loss=2.18, v_num=1, val_acc=0.674]
Epoch 33:   9%|▊         | 10/117 [00:01<00:13,  8.19it/s, loss=2.19, v_num=1, val_acc=0.674]
Epoch 33:   9%|▉         | 11/117 [00:01<00:11,  8.95it/s, loss=2.19, v_num=1, val_acc=0.674]
Epoch 33:   9%|▉         | 11/117 [00:01<00:12,  8.77it/s, loss=2.23, v_num=1, val_acc=0.674]
Epoch 33:  10%|█         | 12/117 [00:01<00:11,  9.50it/s, loss=2.23, v_num=1, val_acc=0.674]
Epoch 33:  10%|█         | 12/117 [00:01<00:11,  9.32it/s, loss=2.26, v_num=1, val_acc=0.674]
Epoch 33:  11%|█         | 13/117 [00:01<00:10, 10.03it/s, loss=2.26, v_num=1, val_acc=0.674]
Epoch 33:  11%|█         | 13/117 [00:01<00:10,  9.84it/s, loss=2.31, v_num=1, val_acc=0.674]
Epoch 33:  12%|█▏        | 14/117 [00:01<00:09, 10.53it/s, loss=2.31, v_num=1, val_acc=0.674]
Epoch 33:  12%|█▏        | 14/117 [00:01<00:09, 10.33it/s, loss=2.27, v_num=1, val_acc=0.674]
Epoch 33:  13%|█▎        | 15/117 [00:01<00:09, 11.01it/s, loss=2.27, v_num=1, val_acc=0.674]
Epoch 33:  13%|█▎        | 15/117 [00:01<00:09, 10.81it/s, loss=2.2, v_num=1, val_acc=0.674]
Epoch 33:  14%|█▎        | 16/117 [00:01<00:08, 11.46it/s, loss=2.2, v_num=1, val_acc=0.674]
Epoch 33:  14%|█▎        | 16/117 [00:01<00:08, 11.25it/s, loss=2.19, v_num=1, val_acc=0.674]
Epoch 33:  15%|█▍        | 17/117 [00:01<00:08, 11.88it/s, loss=2.19, v_num=1, val_acc=0.674]
Epoch 33:  15%|█▍        | 17/117 [00:01<00:08, 11.67it/s, loss=2.19, v_num=1, val_acc=0.674]
Epoch 33:  15%|█▌        | 18/117 [00:01<00:08, 12.27it/s, loss=2.19, v_num=1, val_acc=0.674]
Epoch 33:  15%|█▌        | 18/117 [00:01<00:08, 12.06it/s, loss=2.12, v_num=1, val_acc=0.674]
Epoch 33:  16%|█▌        | 19/117 [00:01<00:07, 12.66it/s, loss=2.12, v_num=1, val_acc=0.674]
Epoch 33:  16%|█▌        | 19/117 [00:01<00:07, 12.45it/s, loss=2.13, v_num=1, val_acc=0.674]
Epoch 33:  17%|█▋        | 20/117 [00:01<00:07, 13.04it/s, loss=2.13, v_num=1, val_acc=0.674]
Epoch 33:  17%|█▋        | 20/117 [00:01<00:07, 12.83it/s, loss=2.15, v_num=1, val_acc=0.674]
Epoch 33:  18%|█▊        | 21/117 [00:01<00:07, 13.40it/s, loss=2.15, v_num=1, val_acc=0.674]
Epoch 33:  18%|█▊        | 21/117 [00:01<00:07, 13.18it/s, loss=2.15, v_num=1, val_acc=0.674]
Epoch 33:  19%|█▉        | 22/117 [00:01<00:06, 13.74it/s, loss=2.15, v_num=1, val_acc=0.674]
Epoch 33:  19%|█▉        | 22/117 [00:01<00:07, 13.52it/s, loss=2.11, v_num=1, val_acc=0.674]
Epoch 33:  20%|█▉        | 23/117 [00:01<00:06, 14.06it/s, loss=2.11, v_num=1, val_acc=0.674]
Epoch 33:  20%|█▉        | 23/117 [00:01<00:06, 13.85it/s, loss=2.01, v_num=1, val_acc=0.674]
Epoch 33:  21%|██        | 24/117 [00:01<00:06, 14.37it/s, loss=2.01, v_num=1, val_acc=0.674]
Epoch 33:  21%|██        | 24/117 [00:01<00:06, 14.16it/s, loss=1.93, v_num=1, val_acc=0.674]
Epoch 33:  21%|██▏       | 25/117 [00:01<00:06, 14.67it/s, loss=1.93, v_num=1, val_acc=0.674]
Epoch 33:  21%|██▏       | 25/117 [00:01<00:06, 14.45it/s, loss=1.86, v_num=1, val_acc=0.674]
Epoch 33:  22%|██▏       | 26/117 [00:01<00:06, 14.94it/s, loss=1.86, v_num=1, val_acc=0.674]
Epoch 33:  22%|██▏       | 26/117 [00:01<00:06, 14.73it/s, loss=1.77, v_num=1, val_acc=0.674]
Epoch 33:  23%|██▎       | 27/117 [00:01<00:05, 15.23it/s, loss=1.77, v_num=1, val_acc=0.674]
Epoch 33:  23%|██▎       | 27/117 [00:01<00:05, 15.01it/s, loss=1.76, v_num=1, val_acc=0.674]
Epoch 33:  24%|██▍       | 28/117 [00:01<00:05, 15.50it/s, loss=1.76, v_num=1, val_acc=0.674]
Epoch 33:  24%|██▍       | 28/117 [00:01<00:05, 15.28it/s, loss=1.77, v_num=1, val_acc=0.674]
Epoch 33:  25%|██▍       | 29/117 [00:01<00:05, 15.75it/s, loss=1.77, v_num=1, val_acc=0.674]
Epoch 33:  25%|██▍       | 29/117 [00:01<00:05, 15.54it/s, loss=1.75, v_num=1, val_acc=0.674]
Epoch 33:  26%|██▌       | 30/117 [00:01<00:05, 16.00it/s, loss=1.75, v_num=1, val_acc=0.674]
Epoch 33:  26%|██▌       | 30/117 [00:01<00:05, 15.78it/s, loss=1.78, v_num=1, val_acc=0.674]
Epoch 33:  26%|██▋       | 31/117 [00:01<00:05, 16.24it/s, loss=1.78, v_num=1, val_acc=0.674]
Epoch 33:  26%|██▋       | 31/117 [00:01<00:05, 16.02it/s, loss=1.87, v_num=1, val_acc=0.674]
Epoch 33:  27%|██▋       | 32/117 [00:01<00:05, 16.46it/s, loss=1.87, v_num=1, val_acc=0.674]
Epoch 33:  27%|██▋       | 32/117 [00:01<00:05, 16.25it/s, loss=1.87, v_num=1, val_acc=0.674]
Epoch 33:  28%|██▊       | 33/117 [00:01<00:05, 16.68it/s, loss=1.87, v_num=1, val_acc=0.674]
Epoch 33:  28%|██▊       | 33/117 [00:02<00:05, 16.47it/s, loss=1.84, v_num=1, val_acc=0.674]
Epoch 33:  29%|██▉       | 34/117 [00:02<00:04, 16.89it/s, loss=1.84, v_num=1, val_acc=0.674]
Epoch 33:  29%|██▉       | 34/117 [00:02<00:04, 16.68it/s, loss=1.86, v_num=1, val_acc=0.674]
Epoch 33:  30%|██▉       | 35/117 [00:02<00:04, 17.11it/s, loss=1.86, v_num=1, val_acc=0.674]
Epoch 33:  30%|██▉       | 35/117 [00:02<00:04, 16.89it/s, loss=1.89, v_num=1, val_acc=0.674]
Epoch 33:  31%|███       | 36/117 [00:02<00:04, 17.30it/s, loss=1.89, v_num=1, val_acc=0.674]
Epoch 33:  31%|███       | 36/117 [00:02<00:04, 17.09it/s, loss=1.93, v_num=1, val_acc=0.674]
Epoch 33:  32%|███▏      | 37/117 [00:02<00:04, 17.49it/s, loss=1.93, v_num=1, val_acc=0.674]
Epoch 33:  32%|███▏      | 37/117 [00:02<00:04, 17.29it/s, loss=1.89, v_num=1, val_acc=0.674]
Epoch 33:  32%|███▏      | 38/117 [00:02<00:04, 17.68it/s, loss=1.89, v_num=1, val_acc=0.674]
Epoch 33:  32%|███▏      | 38/117 [00:02<00:04, 17.47it/s, loss=1.91, v_num=1, val_acc=0.674]
Epoch 33:  33%|███▎      | 39/117 [00:02<00:04, 17.81it/s, loss=1.91, v_num=1, val_acc=0.674]
Epoch 33:  33%|███▎      | 39/117 [00:02<00:04, 17.63it/s, loss=1.92, v_num=1, val_acc=0.674]
Epoch 33:  34%|███▍      | 40/117 [00:02<00:04, 18.01it/s, loss=1.92, v_num=1, val_acc=0.674]
Epoch 33:  34%|███▍      | 40/117 [00:02<00:04, 17.80it/s, loss=1.89, v_num=1, val_acc=0.674]
Epoch 33:  35%|███▌      | 41/117 [00:02<00:04, 18.18it/s, loss=1.89, v_num=1, val_acc=0.674]
Epoch 33:  35%|███▌      | 41/117 [00:02<00:04, 17.98it/s, loss=1.89, v_num=1, val_acc=0.674]
Epoch 33:  36%|███▌      | 42/117 [00:02<00:04, 18.34it/s, loss=1.89, v_num=1, val_acc=0.674]
Epoch 33:  36%|███▌      | 42/117 [00:02<00:04, 18.14it/s, loss=1.94, v_num=1, val_acc=0.674]
Epoch 33:  37%|███▋      | 43/117 [00:02<00:03, 18.50it/s, loss=1.94, v_num=1, val_acc=0.674]
Epoch 33:  37%|███▋      | 43/117 [00:02<00:04, 18.30it/s, loss=2.02, v_num=1, val_acc=0.674]
Epoch 33:  38%|███▊      | 44/117 [00:02<00:03, 18.66it/s, loss=2.02, v_num=1, val_acc=0.674]
Epoch 33:  38%|███▊      | 44/117 [00:02<00:03, 18.46it/s, loss=2.05, v_num=1, val_acc=0.674]
Epoch 33:  38%|███▊      | 45/117 [00:02<00:03, 18.81it/s, loss=2.05, v_num=1, val_acc=0.674]
Epoch 33:  38%|███▊      | 45/117 [00:02<00:03, 18.61it/s, loss=2.11, v_num=1, val_acc=0.674]
Epoch 33:  39%|███▉      | 46/117 [00:02<00:03, 18.95it/s, loss=2.11, v_num=1, val_acc=0.674]
Epoch 33:  39%|███▉      | 46/117 [00:02<00:03, 18.76it/s, loss=2.11, v_num=1, val_acc=0.674]
Epoch 33:  40%|████      | 47/117 [00:02<00:03, 19.09it/s, loss=2.11, v_num=1, val_acc=0.674]
Epoch 33:  40%|████      | 47/117 [00:02<00:03, 18.90it/s, loss=2.09, v_num=1, val_acc=0.674]
Epoch 33:  41%|████      | 48/117 [00:02<00:03, 19.23it/s, loss=2.09, v_num=1, val_acc=0.674]
Epoch 33:  41%|████      | 48/117 [00:02<00:03, 19.03it/s, loss=2.1, v_num=1, val_acc=0.674]
Epoch 33:  42%|████▏     | 49/117 [00:02<00:03, 19.35it/s, loss=2.1, v_num=1, val_acc=0.674]
Epoch 33:  42%|████▏     | 49/117 [00:02<00:03, 19.16it/s, loss=2.11, v_num=1, val_acc=0.674]
Epoch 33:  43%|████▎     | 50/117 [00:02<00:03, 19.48it/s, loss=2.11, v_num=1, val_acc=0.674]
Epoch 33:  43%|████▎     | 50/117 [00:02<00:03, 19.29it/s, loss=2.15, v_num=1, val_acc=0.674]
Epoch 33:  44%|████▎     | 51/117 [00:02<00:03, 19.60it/s, loss=2.15, v_num=1, val_acc=0.674]
Epoch 33:  44%|████▎     | 51/117 [00:02<00:03, 19.42it/s, loss=2.06, v_num=1, val_acc=0.674]
Epoch 33:  44%|████▍     | 52/117 [00:02<00:03, 19.73it/s, loss=2.06, v_num=1, val_acc=0.674]
Epoch 33:  44%|████▍     | 52/117 [00:02<00:03, 19.54it/s, loss=2.04, v_num=1, val_acc=0.674]
Epoch 33:  45%|████▌     | 53/117 [00:02<00:03, 19.84it/s, loss=2.04, v_num=1, val_acc=0.674]
Epoch 33:  45%|████▌     | 53/117 [00:02<00:03, 19.66it/s, loss=2.07, v_num=1, val_acc=0.674]
Epoch 33:  46%|████▌     | 54/117 [00:02<00:03, 19.96it/s, loss=2.07, v_num=1, val_acc=0.674]
Epoch 33:  46%|████▌     | 54/117 [00:02<00:03, 19.77it/s, loss=2.08, v_num=1, val_acc=0.674]
Epoch 33:  47%|████▋     | 55/117 [00:02<00:03, 20.07it/s, loss=2.08, v_num=1, val_acc=0.674]
Epoch 33:  47%|████▋     | 55/117 [00:02<00:03, 19.89it/s, loss=2.1, v_num=1, val_acc=0.674]
Epoch 33:  48%|████▊     | 56/117 [00:02<00:03, 20.18it/s, loss=2.1, v_num=1, val_acc=0.674]
Epoch 33:  48%|████▊     | 56/117 [00:02<00:03, 20.00it/s, loss=2.03, v_num=1, val_acc=0.674]
Epoch 33:  49%|████▊     | 57/117 [00:02<00:02, 20.28it/s, loss=2.03, v_num=1, val_acc=0.674]
Epoch 33:  49%|████▊     | 57/117 [00:02<00:02, 20.10it/s, loss=2.01, v_num=1, val_acc=0.674]
Epoch 33:  50%|████▉     | 58/117 [00:02<00:02, 20.39it/s, loss=2.01, v_num=1, val_acc=0.674]
Epoch 33:  50%|████▉     | 58/117 [00:02<00:02, 20.21it/s, loss=2, v_num=1, val_acc=0.674]
Epoch 33:  50%|█████     | 59/117 [00:02<00:02, 20.50it/s, loss=2, v_num=1, val_acc=0.674]
Epoch 33:  50%|█████     | 59/117 [00:02<00:02, 20.32it/s, loss=2, v_num=1, val_acc=0.674]
Epoch 33:  51%|█████▏    | 60/117 [00:02<00:02, 20.59it/s, loss=2, v_num=1, val_acc=0.674]
Epoch 33:  51%|█████▏    | 60/117 [00:02<00:02, 20.42it/s, loss=1.99, v_num=1, val_acc=0.674]
Epoch 33:  52%|█████▏    | 61/117 [00:02<00:02, 20.69it/s, loss=1.99, v_num=1, val_acc=0.674]
Epoch 33:  52%|█████▏    | 61/117 [00:02<00:02, 20.52it/s, loss=2.01, v_num=1, val_acc=0.674]
Epoch 33:  53%|█████▎    | 62/117 [00:02<00:02, 20.78it/s, loss=2.01, v_num=1, val_acc=0.674]
Epoch 33:  53%|█████▎    | 62/117 [00:03<00:02, 20.61it/s, loss=1.93, v_num=1, val_acc=0.674]
Epoch 33:  54%|█████▍    | 63/117 [00:03<00:02, 20.88it/s, loss=1.93, v_num=1, val_acc=0.674]
Epoch 33:  54%|█████▍    | 63/117 [00:03<00:02, 20.70it/s, loss=1.83, v_num=1, val_acc=0.674]
Epoch 33:  55%|█████▍    | 64/117 [00:03<00:02, 20.97it/s, loss=1.83, v_num=1, val_acc=0.674]
Epoch 33:  55%|█████▍    | 64/117 [00:03<00:02, 20.80it/s, loss=1.78, v_num=1, val_acc=0.674]
Epoch 33:  56%|█████▌    | 65/117 [00:03<00:02, 21.06it/s, loss=1.78, v_num=1, val_acc=0.674]
Epoch 33:  56%|█████▌    | 65/117 [00:03<00:02, 20.89it/s, loss=1.73, v_num=1, val_acc=0.674]
Epoch 33:  56%|█████▋    | 66/117 [00:03<00:02, 21.14it/s, loss=1.73, v_num=1, val_acc=0.674]
Epoch 33:  56%|█████▋    | 66/117 [00:03<00:02, 20.97it/s, loss=1.71, v_num=1, val_acc=0.674]
Epoch 33:  57%|█████▋    | 67/117 [00:03<00:02, 21.23it/s, loss=1.71, v_num=1, val_acc=0.674]
Epoch 33:  57%|█████▋    | 67/117 [00:03<00:02, 21.06it/s, loss=1.71, v_num=1, val_acc=0.674]
Epoch 33:  58%|█████▊    | 68/117 [00:03<00:02, 21.31it/s, loss=1.71, v_num=1, val_acc=0.674]
Epoch 33:  58%|█████▊    | 68/117 [00:03<00:02, 21.14it/s, loss=1.67, v_num=1, val_acc=0.674]
Epoch 33:  59%|█████▉    | 69/117 [00:03<00:02, 21.39it/s, loss=1.67, v_num=1, val_acc=0.674]
Epoch 33:  59%|█████▉    | 69/117 [00:03<00:02, 21.22it/s, loss=1.63, v_num=1, val_acc=0.674]
Epoch 33:  60%|█████▉    | 70/117 [00:03<00:02, 21.47it/s, loss=1.63, v_num=1, val_acc=0.674]
Epoch 33:  60%|█████▉    | 70/117 [00:03<00:02, 21.30it/s, loss=1.57, v_num=1, val_acc=0.674]
Epoch 33:  61%|██████    | 71/117 [00:03<00:02, 21.55it/s, loss=1.57, v_num=1, val_acc=0.674]
Epoch 33:  61%|██████    | 71/117 [00:03<00:02, 21.38it/s, loss=1.53, v_num=1, val_acc=0.674]
Epoch 33:  62%|██████▏   | 72/117 [00:03<00:02, 21.63it/s, loss=1.53, v_num=1, val_acc=0.674]
Epoch 33:  62%|██████▏   | 72/117 [00:03<00:02, 21.46it/s, loss=1.52, v_num=1, val_acc=0.674]
Epoch 33:  62%|██████▏   | 73/117 [00:03<00:02, 21.70it/s, loss=1.52, v_num=1, val_acc=0.674]
Epoch 33:  62%|██████▏   | 73/117 [00:03<00:02, 21.54it/s, loss=1.54, v_num=1, val_acc=0.674]
Epoch 33:  63%|██████▎   | 74/117 [00:03<00:01, 21.78it/s, loss=1.54, v_num=1, val_acc=0.674]
Epoch 33:  63%|██████▎   | 74/117 [00:03<00:01, 21.62it/s, loss=1.58, v_num=1, val_acc=0.674]
Epoch 33:  64%|██████▍   | 75/117 [00:03<00:01, 21.85it/s, loss=1.58, v_num=1, val_acc=0.674]
Epoch 33:  64%|██████▍   | 75/117 [00:03<00:01, 21.69it/s, loss=1.52, v_num=1, val_acc=0.674]
Epoch 33:  65%|██████▍   | 76/117 [00:03<00:01, 21.92it/s, loss=1.52, v_num=1, val_acc=0.674]
Epoch 33:  65%|██████▍   | 76/117 [00:03<00:01, 21.76it/s, loss=1.51, v_num=1, val_acc=0.674]
Epoch 33:  66%|██████▌   | 77/117 [00:03<00:01, 21.99it/s, loss=1.51, v_num=1, val_acc=0.674]
Epoch 33:  66%|██████▌   | 77/117 [00:03<00:01, 21.83it/s, loss=1.51, v_num=1, val_acc=0.674]
Epoch 33:  67%|██████▋   | 78/117 [00:03<00:01, 22.06it/s, loss=1.51, v_num=1, val_acc=0.674]
Epoch 33:  67%|██████▋   | 78/117 [00:03<00:01, 21.90it/s, loss=1.5, v_num=1, val_acc=0.674]
Epoch 33:  68%|██████▊   | 79/117 [00:03<00:01, 22.10it/s, loss=1.5, v_num=1, val_acc=0.674]
Epoch 33:  68%|██████▊   | 79/117 [00:03<00:01, 21.95it/s, loss=1.49, v_num=1, val_acc=0.674]
Epoch 33:  68%|██████▊   | 80/117 [00:03<00:01, 22.17it/s, loss=1.49, v_num=1, val_acc=0.674]
Epoch 33:  68%|██████▊   | 80/117 [00:03<00:01, 22.02it/s, loss=1.5, v_num=1, val_acc=0.674]
Epoch 33:  69%|██████▉   | 81/117 [00:03<00:01, 22.24it/s, loss=1.5, v_num=1, val_acc=0.674]
Epoch 33:  69%|██████▉   | 81/117 [00:03<00:01, 22.08it/s, loss=1.47, v_num=1, val_acc=0.674]
Epoch 33:  70%|███████   | 82/117 [00:03<00:01, 22.28it/s, loss=1.47, v_num=1, val_acc=0.674]
Epoch 33:  70%|███████   | 82/117 [00:03<00:01, 22.13it/s, loss=1.53, v_num=1, val_acc=0.674]
Epoch 33:  71%|███████   | 83/117 [00:03<00:01, 22.35it/s, loss=1.53, v_num=1, val_acc=0.674]
Epoch 33:  71%|███████   | 83/117 [00:03<00:01, 22.19it/s, loss=1.55, v_num=1, val_acc=0.674]
Epoch 33:  72%|███████▏  | 84/117 [00:03<00:01, 22.41it/s, loss=1.55, v_num=1, val_acc=0.674]
Epoch 33:  72%|███████▏  | 84/117 [00:03<00:01, 22.26it/s, loss=1.59, v_num=1, val_acc=0.674]
Epoch 33:  73%|███████▎  | 85/117 [00:03<00:01, 22.47it/s, loss=1.59, v_num=1, val_acc=0.674]
Epoch 33:  73%|███████▎  | 85/117 [00:03<00:01, 22.32it/s, loss=1.64, v_num=1, val_acc=0.674]
Epoch 33:  74%|███████▎  | 86/117 [00:03<00:01, 22.53it/s, loss=1.64, v_num=1, val_acc=0.674]
Epoch 33:  74%|███████▎  | 86/117 [00:03<00:01, 22.38it/s, loss=1.73, v_num=1, val_acc=0.674]
Epoch 33:  74%|███████▍  | 87/117 [00:03<00:01, 22.59it/s, loss=1.73, v_num=1, val_acc=0.674]
Epoch 33:  74%|███████▍  | 87/117 [00:03<00:01, 22.44it/s, loss=1.72, v_num=1, val_acc=0.674]
Epoch 33:  75%|███████▌  | 88/117 [00:03<00:01, 22.65it/s, loss=1.72, v_num=1, val_acc=0.674]
Epoch 33:  75%|███████▌  | 88/117 [00:03<00:01, 22.50it/s, loss=1.76, v_num=1, val_acc=0.674]
Epoch 33:  76%|███████▌  | 89/117 [00:03<00:01, 22.70it/s, loss=1.76, v_num=1, val_acc=0.674]
Epoch 33:  76%|███████▌  | 89/117 [00:03<00:01, 22.56it/s, loss=1.76, v_num=1, val_acc=0.674]
Epoch 33:  77%|███████▋  | 90/117 [00:03<00:01, 22.76it/s, loss=1.76, v_num=1, val_acc=0.674]
Epoch 33:  77%|███████▋  | 90/117 [00:03<00:01, 22.62it/s, loss=1.75, v_num=1, val_acc=0.674]
Epoch 33:  78%|███████▊  | 91/117 [00:03<00:01, 22.81it/s, loss=1.75, v_num=1, val_acc=0.674]
Epoch 33:  78%|███████▊  | 91/117 [00:04<00:01, 22.67it/s, loss=1.8, v_num=1, val_acc=0.674]
Epoch 33:  79%|███████▊  | 92/117 [00:04<00:01, 22.87it/s, loss=1.8, v_num=1, val_acc=0.674]
Epoch 33:  79%|███████▊  | 92/117 [00:04<00:01, 22.72it/s, loss=1.8, v_num=1, val_acc=0.674]
Epoch 33:  79%|███████▉  | 93/117 [00:04<00:01, 22.92it/s, loss=1.8, v_num=1, val_acc=0.674]
Epoch 33:  79%|███████▉  | 93/117 [00:04<00:01, 22.78it/s, loss=1.73, v_num=1, val_acc=0.674]
Epoch 33:  80%|████████  | 94/117 [00:04<00:01, 22.97it/s, loss=1.73, v_num=1, val_acc=0.674]
Epoch 33:  80%|████████  | 94/117 [00:04<00:01, 22.83it/s, loss=1.69, v_num=1, val_acc=0.674]
Epoch 33:  81%|████████  | 95/117 [00:04<00:00, 23.02it/s, loss=1.69, v_num=1, val_acc=0.674]
Epoch 33:  81%|████████  | 95/117 [00:04<00:00, 22.88it/s, loss=1.74, v_num=1, val_acc=0.674]
Epoch 33:  82%|████████▏ | 96/117 [00:04<00:00, 23.08it/s, loss=1.74, v_num=1, val_acc=0.674]
Epoch 33:  82%|████████▏ | 96/117 [00:04<00:00, 22.94it/s, loss=1.77, v_num=1, val_acc=0.674]
Epoch 33:  83%|████████▎ | 97/117 [00:04<00:00, 23.12it/s, loss=1.77, v_num=1, val_acc=0.674]
Epoch 33:  83%|████████▎ | 97/117 [00:04<00:00, 22.98it/s, loss=1.81, v_num=1, val_acc=0.674]

Validation: 0it [00:00, ?it/s]

Validation:   0%|          | 0/20 [00:00<?, ?it/s]

Validation DataLoader 0:   0%|          | 0/20 [00:00<?, ?it/s]

Validation DataLoader 0:   5%|▌         | 1/20 [00:00<00:00, 142.15it/s]
Epoch 33:  84%|████████▍ | 98/117 [00:05<00:00, 19.36it/s, loss=1.81, v_num=1, val_acc=0.674]

Validation DataLoader 0:  10%|█         | 2/20 [00:00<00:00, 55.52it/s]
Epoch 33:  85%|████████▍ | 99/117 [00:05<00:00, 19.44it/s, loss=1.81, v_num=1, val_acc=0.674]

Validation DataLoader 0:  15%|█▌        | 3/20 [00:00<00:00, 44.40it/s]
Epoch 33:  85%|████████▌ | 100/117 [00:05<00:00, 19.52it/s, loss=1.81, v_num=1, val_acc=0.674]

Validation DataLoader 0:  20%|██        | 4/20 [00:00<00:00, 40.36it/s]
Epoch 33:  86%|████████▋ | 101/117 [00:05<00:00, 19.59it/s, loss=1.81, v_num=1, val_acc=0.674]

Validation DataLoader 0:  25%|██▌       | 5/20 [00:00<00:00, 38.27it/s]
Epoch 33:  87%|████████▋ | 102/117 [00:05<00:00, 19.67it/s, loss=1.81, v_num=1, val_acc=0.674]

Validation DataLoader 0:  30%|███       | 6/20 [00:00<00:00, 36.97it/s]
Epoch 33:  88%|████████▊ | 103/117 [00:05<00:00, 19.74it/s, loss=1.81, v_num=1, val_acc=0.674]

Validation DataLoader 0:  35%|███▌      | 7/20 [00:00<00:00, 35.85it/s]
Epoch 33:  89%|████████▉ | 104/117 [00:05<00:00, 19.81it/s, loss=1.81, v_num=1, val_acc=0.674]

Validation DataLoader 0:  40%|████      | 8/20 [00:00<00:00, 35.47it/s]
Epoch 33:  90%|████████▉ | 105/117 [00:05<00:00, 19.88it/s, loss=1.81, v_num=1, val_acc=0.674]

Validation DataLoader 0:  45%|████▌     | 9/20 [00:00<00:00, 35.02it/s]
Epoch 33:  91%|█████████ | 106/117 [00:05<00:00, 19.95it/s, loss=1.81, v_num=1, val_acc=0.674]

Validation DataLoader 0:  50%|█████     | 10/20 [00:00<00:00, 34.61it/s]
Epoch 33:  91%|█████████▏| 107/117 [00:05<00:00, 20.02it/s, loss=1.81, v_num=1, val_acc=0.674]

Validation DataLoader 0:  55%|█████▌    | 11/20 [00:00<00:00, 34.30it/s]
Epoch 33:  92%|█████████▏| 108/117 [00:05<00:00, 20.09it/s, loss=1.81, v_num=1, val_acc=0.674]

Validation DataLoader 0:  60%|██████    | 12/20 [00:00<00:00, 34.09it/s]
Epoch 33:  93%|█████████▎| 109/117 [00:05<00:00, 20.16it/s, loss=1.81, v_num=1, val_acc=0.674]

Validation DataLoader 0:  65%|██████▌   | 13/20 [00:00<00:00, 33.87it/s]
Epoch 33:  94%|█████████▍| 110/117 [00:05<00:00, 20.22it/s, loss=1.81, v_num=1, val_acc=0.674]

Validation DataLoader 0:  70%|███████   | 14/20 [00:00<00:00, 33.70it/s]
Epoch 33:  95%|█████████▍| 111/117 [00:05<00:00, 20.29it/s, loss=1.81, v_num=1, val_acc=0.674]

Validation DataLoader 0:  75%|███████▌  | 15/20 [00:00<00:00, 33.57it/s]
Epoch 33:  96%|█████████▌| 112/117 [00:05<00:00, 20.36it/s, loss=1.81, v_num=1, val_acc=0.674]

Validation DataLoader 0:  80%|████████  | 16/20 [00:00<00:00, 33.44it/s]
Epoch 33:  97%|█████████▋| 113/117 [00:05<00:00, 20.42it/s, loss=1.81, v_num=1, val_acc=0.674]

Validation DataLoader 0:  85%|████████▌ | 17/20 [00:00<00:00, 33.31it/s]
Epoch 33:  97%|█████████▋| 114/117 [00:05<00:00, 20.48it/s, loss=1.81, v_num=1, val_acc=0.674]

Validation DataLoader 0:  90%|█████████ | 18/20 [00:00<00:00, 33.22it/s]
Epoch 33:  98%|█████████▊| 115/117 [00:05<00:00, 20.55it/s, loss=1.81, v_num=1, val_acc=0.674]

Validation DataLoader 0:  95%|█████████▌| 19/20 [00:00<00:00, 33.13it/s]
Epoch 33:  99%|█████████▉| 116/117 [00:05<00:00, 20.61it/s, loss=1.81, v_num=1, val_acc=0.674]

Validation DataLoader 0: 100%|██████████| 20/20 [00:00<00:00, 33.12it/s]
Epoch 33: 100%|██████████| 117/117 [00:05<00:00, 20.67it/s, loss=1.81, v_num=1, val_acc=0.674]
Epoch 33: 100%|██████████| 117/117 [00:05<00:00, 20.60it/s, loss=1.81, v_num=1, val_acc=0.664]


Epoch 33: 100%|██████████| 117/117 [00:05<00:00, 20.60it/s, loss=1.81, v_num=1, val_acc=0.664]
Epoch 33:   0%|          | 0/117 [00:00<?, ?it/s, loss=1.81, v_num=1, val_acc=0.664]
Epoch 34:   0%|          | 0/117 [00:00<?, ?it/s, loss=1.81, v_num=1, val_acc=0.664]
Epoch 34:   1%|          | 1/117 [00:00<01:47,  1.08it/s, loss=1.81, v_num=1, val_acc=0.664]
Epoch 34:   1%|          | 1/117 [00:00<01:49,  1.06it/s, loss=1.85, v_num=1, val_acc=0.664]
Epoch 34:   2%|▏         | 2/117 [00:00<00:54,  2.09it/s, loss=1.85, v_num=1, val_acc=0.664]
Epoch 34:   2%|▏         | 2/117 [00:00<00:56,  2.04it/s, loss=1.91, v_num=1, val_acc=0.664]
Epoch 34:   3%|▎         | 3/117 [00:00<00:37,  3.01it/s, loss=1.91, v_num=1, val_acc=0.664]
Epoch 34:   3%|▎         | 3/117 [00:01<00:38,  2.94it/s, loss=1.96, v_num=1, val_acc=0.664]
Epoch 34:   3%|▎         | 4/117 [00:01<00:29,  3.88it/s, loss=1.96, v_num=1, val_acc=0.664]
Epoch 34:   3%|▎         | 4/117 [00:01<00:29,  3.79it/s, loss=2.03, v_num=1, val_acc=0.664]
Epoch 34:   4%|▍         | 5/117 [00:01<00:23,  4.70it/s, loss=2.03, v_num=1, val_acc=0.664]
Epoch 34:   4%|▍         | 5/117 [00:01<00:24,  4.59it/s, loss=2.09, v_num=1, val_acc=0.664]
Epoch 34:   5%|▌         | 6/117 [00:01<00:20,  5.47it/s, loss=2.09, v_num=1, val_acc=0.664]
Epoch 34:   5%|▌         | 6/117 [00:01<00:20,  5.34it/s, loss=2.13, v_num=1, val_acc=0.664]
Epoch 34:   6%|▌         | 7/117 [00:01<00:17,  6.19it/s, loss=2.13, v_num=1, val_acc=0.664]
Epoch 34:   6%|▌         | 7/117 [00:01<00:18,  6.05it/s, loss=2.11, v_num=1, val_acc=0.664]
Epoch 34:   7%|▋         | 8/117 [00:01<00:15,  6.87it/s, loss=2.11, v_num=1, val_acc=0.664]
Epoch 34:   7%|▋         | 8/117 [00:01<00:16,  6.72it/s, loss=2.08, v_num=1, val_acc=0.664]
Epoch 34:   8%|▊         | 9/117 [00:01<00:14,  7.50it/s, loss=2.08, v_num=1, val_acc=0.664]
Epoch 34:   8%|▊         | 9/117 [00:01<00:14,  7.34it/s, loss=2.02, v_num=1, val_acc=0.664]
Epoch 34:   9%|▊         | 10/117 [00:01<00:13,  8.11it/s, loss=2.02, v_num=1, val_acc=0.664]
Epoch 34:   9%|▊         | 10/117 [00:01<00:13,  7.94it/s, loss=2.04, v_num=1, val_acc=0.664]
Epoch 34:   9%|▉         | 11/117 [00:01<00:12,  8.64it/s, loss=2.04, v_num=1, val_acc=0.664]
Epoch 34:   9%|▉         | 11/117 [00:01<00:12,  8.47it/s, loss=2.06, v_num=1, val_acc=0.664]
Epoch 34:  10%|█         | 12/117 [00:01<00:11,  9.18it/s, loss=2.06, v_num=1, val_acc=0.664]
Epoch 34:  10%|█         | 12/117 [00:01<00:11,  9.01it/s, loss=2.08, v_num=1, val_acc=0.664]
Epoch 34:  11%|█         | 13/117 [00:01<00:10,  9.70it/s, loss=2.08, v_num=1, val_acc=0.664]
Epoch 34:  11%|█         | 13/117 [00:01<00:10,  9.52it/s, loss=2.1, v_num=1, val_acc=0.664]
Epoch 34:  12%|█▏        | 14/117 [00:01<00:10, 10.19it/s, loss=2.1, v_num=1, val_acc=0.664]
Epoch 34:  12%|█▏        | 14/117 [00:01<00:10, 10.01it/s, loss=2.05, v_num=1, val_acc=0.664]
Epoch 34:  13%|█▎        | 15/117 [00:01<00:09, 10.66it/s, loss=2.05, v_num=1, val_acc=0.664]
Epoch 34:  13%|█▎        | 15/117 [00:01<00:09, 10.47it/s, loss=2.05, v_num=1, val_acc=0.664]
Epoch 34:  14%|█▎        | 16/117 [00:01<00:09, 11.11it/s, loss=2.05, v_num=1, val_acc=0.664]
Epoch 34:  14%|█▎        | 16/117 [00:01<00:09, 10.91it/s, loss=2.07, v_num=1, val_acc=0.664]
Epoch 34:  15%|█▍        | 17/117 [00:01<00:08, 11.52it/s, loss=2.07, v_num=1, val_acc=0.664]
Epoch 34:  15%|█▍        | 17/117 [00:01<00:08, 11.33it/s, loss=2.07, v_num=1, val_acc=0.664]
Epoch 34:  15%|█▌        | 18/117 [00:01<00:08, 11.92it/s, loss=2.07, v_num=1, val_acc=0.664]
Epoch 34:  15%|█▌        | 18/117 [00:01<00:08, 11.73it/s, loss=2.04, v_num=1, val_acc=0.664]
Epoch 34:  16%|█▌        | 19/117 [00:01<00:07, 12.29it/s, loss=2.04, v_num=1, val_acc=0.664]
Epoch 34:  16%|█▌        | 19/117 [00:01<00:08, 12.09it/s, loss=2.07, v_num=1, val_acc=0.664]
Epoch 34:  17%|█▋        | 20/117 [00:01<00:07, 12.66it/s, loss=2.07, v_num=1, val_acc=0.664]
Epoch 34:  17%|█▋        | 20/117 [00:01<00:07, 12.46it/s, loss=2.14, v_num=1, val_acc=0.664]
Epoch 34:  18%|█▊        | 21/117 [00:01<00:07, 13.02it/s, loss=2.14, v_num=1, val_acc=0.664]
Epoch 34:  18%|█▊        | 21/117 [00:01<00:07, 12.82it/s, loss=2.17, v_num=1, val_acc=0.664]
Epoch 34:  19%|█▉        | 22/117 [00:01<00:07, 13.36it/s, loss=2.17, v_num=1, val_acc=0.664]
Epoch 34:  19%|█▉        | 22/117 [00:01<00:07, 13.16it/s, loss=2.18, v_num=1, val_acc=0.664]
Epoch 34:  20%|█▉        | 23/117 [00:01<00:06, 13.68it/s, loss=2.18, v_num=1, val_acc=0.664]
Epoch 34:  20%|█▉        | 23/117 [00:01<00:06, 13.48it/s, loss=2.14, v_num=1, val_acc=0.664]
Epoch 34:  21%|██        | 24/117 [00:01<00:06, 13.99it/s, loss=2.14, v_num=1, val_acc=0.664]
Epoch 34:  21%|██        | 24/117 [00:01<00:06, 13.79it/s, loss=2.09, v_num=1, val_acc=0.664]
Epoch 34:  21%|██▏       | 25/117 [00:01<00:06, 14.29it/s, loss=2.09, v_num=1, val_acc=0.664]
Epoch 34:  21%|██▏       | 25/117 [00:01<00:06, 14.08it/s, loss=1.99, v_num=1, val_acc=0.664]
Epoch 34:  22%|██▏       | 26/117 [00:01<00:06, 14.57it/s, loss=1.99, v_num=1, val_acc=0.664]
Epoch 34:  22%|██▏       | 26/117 [00:01<00:06, 14.36it/s, loss=1.98, v_num=1, val_acc=0.664]
Epoch 34:  23%|██▎       | 27/117 [00:01<00:06, 14.77it/s, loss=1.98, v_num=1, val_acc=0.664]
Epoch 34:  23%|██▎       | 27/117 [00:01<00:06, 14.58it/s, loss=2.02, v_num=1, val_acc=0.664]
Epoch 34:  24%|██▍       | 28/117 [00:01<00:05, 15.05it/s, loss=2.02, v_num=1, val_acc=0.664]
Epoch 34:  24%|██▍       | 28/117 [00:01<00:05, 14.85it/s, loss=2.07, v_num=1, val_acc=0.664]
Epoch 34:  25%|██▍       | 29/117 [00:01<00:05, 15.31it/s, loss=2.07, v_num=1, val_acc=0.664]
Epoch 34:  25%|██▍       | 29/117 [00:01<00:05, 15.11it/s, loss=2.04, v_num=1, val_acc=0.664]
Epoch 34:  26%|██▌       | 30/117 [00:01<00:05, 15.55it/s, loss=2.04, v_num=1, val_acc=0.664]
Epoch 34:  26%|██▌       | 30/117 [00:01<00:05, 15.35it/s, loss=2.01, v_num=1, val_acc=0.664]
Epoch 34:  26%|██▋       | 31/117 [00:01<00:05, 15.79it/s, loss=2.01, v_num=1, val_acc=0.664]
Epoch 34:  26%|██▋       | 31/117 [00:01<00:05, 15.59it/s, loss=1.97, v_num=1, val_acc=0.664]
Epoch 34:  27%|██▋       | 32/117 [00:01<00:05, 16.02it/s, loss=1.97, v_num=1, val_acc=0.664]
Epoch 34:  27%|██▋       | 32/117 [00:02<00:05, 15.82it/s, loss=2, v_num=1, val_acc=0.664]
Epoch 34:  28%|██▊       | 33/117 [00:02<00:05, 16.24it/s, loss=2, v_num=1, val_acc=0.664]
Epoch 34:  28%|██▊       | 33/117 [00:02<00:05, 16.04it/s, loss=1.99, v_num=1, val_acc=0.664]
Epoch 34:  29%|██▉       | 34/117 [00:02<00:05, 16.45it/s, loss=1.99, v_num=1, val_acc=0.664]
Epoch 34:  29%|██▉       | 34/117 [00:02<00:05, 16.25it/s, loss=2.03, v_num=1, val_acc=0.664]
Epoch 34:  30%|██▉       | 35/117 [00:02<00:04, 16.65it/s, loss=2.03, v_num=1, val_acc=0.664]
Epoch 34:  30%|██▉       | 35/117 [00:02<00:04, 16.46it/s, loss=2.02, v_num=1, val_acc=0.664]
Epoch 34:  31%|███       | 36/117 [00:02<00:04, 16.85it/s, loss=2.02, v_num=1, val_acc=0.664]
Epoch 34:  31%|███       | 36/117 [00:02<00:04, 16.66it/s, loss=2, v_num=1, val_acc=0.664]
Epoch 34:  32%|███▏      | 37/117 [00:02<00:04, 17.03it/s, loss=2, v_num=1, val_acc=0.664]
Epoch 34:  32%|███▏      | 37/117 [00:02<00:04, 16.84it/s, loss=2, v_num=1, val_acc=0.664]
Epoch 34:  32%|███▏      | 38/117 [00:02<00:04, 17.22it/s, loss=2, v_num=1, val_acc=0.664]
Epoch 34:  32%|███▏      | 38/117 [00:02<00:04, 17.02it/s, loss=2.02, v_num=1, val_acc=0.664]
Epoch 34:  33%|███▎      | 39/117 [00:02<00:04, 17.40it/s, loss=2.02, v_num=1, val_acc=0.664]
Epoch 34:  33%|███▎      | 39/117 [00:02<00:04, 17.21it/s, loss=2, v_num=1, val_acc=0.664]
Epoch 34:  34%|███▍      | 40/117 [00:02<00:04, 17.58it/s, loss=2, v_num=1, val_acc=0.664]
Epoch 34:  34%|███▍      | 40/117 [00:02<00:04, 17.38it/s, loss=1.92, v_num=1, val_acc=0.664]
Epoch 34:  35%|███▌      | 41/117 [00:02<00:04, 17.74it/s, loss=1.92, v_num=1, val_acc=0.664]
Epoch 34:  35%|███▌      | 41/117 [00:02<00:04, 17.55it/s, loss=1.91, v_num=1, val_acc=0.664]
Epoch 34:  36%|███▌      | 42/117 [00:02<00:04, 17.87it/s, loss=1.91, v_num=1, val_acc=0.664]
Epoch 34:  36%|███▌      | 42/117 [00:02<00:04, 17.68it/s, loss=1.87, v_num=1, val_acc=0.664]
Epoch 34:  37%|███▋      | 43/117 [00:02<00:04, 18.03it/s, loss=1.87, v_num=1, val_acc=0.664]
Epoch 34:  37%|███▋      | 43/117 [00:02<00:04, 17.85it/s, loss=1.9, v_num=1, val_acc=0.664]
Epoch 34:  38%|███▊      | 44/117 [00:02<00:04, 18.20it/s, loss=1.9, v_num=1, val_acc=0.664]
Epoch 34:  38%|███▊      | 44/117 [00:02<00:04, 18.01it/s, loss=1.88, v_num=1, val_acc=0.664]
Epoch 34:  38%|███▊      | 45/117 [00:02<00:03, 18.35it/s, loss=1.88, v_num=1, val_acc=0.664]
Epoch 34:  38%|███▊      | 45/117 [00:02<00:03, 18.16it/s, loss=1.87, v_num=1, val_acc=0.664]
Epoch 34:  39%|███▉      | 46/117 [00:02<00:03, 18.50it/s, loss=1.87, v_num=1, val_acc=0.664]
Epoch 34:  39%|███▉      | 46/117 [00:02<00:03, 18.31it/s, loss=1.83, v_num=1, val_acc=0.664]
Epoch 34:  40%|████      | 47/117 [00:02<00:03, 18.65it/s, loss=1.83, v_num=1, val_acc=0.664]
Epoch 34:  40%|████      | 47/117 [00:02<00:03, 18.46it/s, loss=1.78, v_num=1, val_acc=0.664]
Epoch 34:  41%|████      | 48/117 [00:02<00:03, 18.76it/s, loss=1.78, v_num=1, val_acc=0.664]
Epoch 34:  41%|████      | 48/117 [00:02<00:03, 18.60it/s, loss=1.71, v_num=1, val_acc=0.664]
Epoch 34:  42%|████▏     | 49/117 [00:02<00:03, 18.88it/s, loss=1.71, v_num=1, val_acc=0.664]
Epoch 34:  42%|████▏     | 49/117 [00:02<00:03, 18.71it/s, loss=1.69, v_num=1, val_acc=0.664]
Epoch 34:  43%|████▎     | 50/117 [00:02<00:03, 19.00it/s, loss=1.69, v_num=1, val_acc=0.664]
Epoch 34:  43%|████▎     | 50/117 [00:02<00:03, 18.82it/s, loss=1.68, v_num=1, val_acc=0.664]
Epoch 34:  44%|████▎     | 51/117 [00:02<00:03, 19.09it/s, loss=1.68, v_num=1, val_acc=0.664]
Epoch 34:  44%|████▎     | 51/117 [00:02<00:03, 18.93it/s, loss=1.68, v_num=1, val_acc=0.664]
Epoch 34:  44%|████▍     | 52/117 [00:02<00:03, 19.19it/s, loss=1.68, v_num=1, val_acc=0.664]
Epoch 34:  44%|████▍     | 52/117 [00:02<00:03, 19.04it/s, loss=1.61, v_num=1, val_acc=0.664]
Epoch 34:  45%|████▌     | 53/117 [00:02<00:03, 19.34it/s, loss=1.61, v_num=1, val_acc=0.664]
Epoch 34:  45%|████▌     | 53/117 [00:02<00:03, 19.16it/s, loss=1.59, v_num=1, val_acc=0.664]
Epoch 34:  46%|████▌     | 54/117 [00:02<00:03, 19.45it/s, loss=1.59, v_num=1, val_acc=0.664]
Epoch 34:  46%|████▌     | 54/117 [00:02<00:03, 19.28it/s, loss=1.59, v_num=1, val_acc=0.664]
Epoch 34:  47%|████▋     | 55/117 [00:02<00:03, 19.57it/s, loss=1.59, v_num=1, val_acc=0.664]
Epoch 34:  47%|████▋     | 55/117 [00:02<00:03, 19.40it/s, loss=1.68, v_num=1, val_acc=0.664]
Epoch 34:  48%|████▊     | 56/117 [00:02<00:03, 19.65it/s, loss=1.68, v_num=1, val_acc=0.664]
Epoch 34:  48%|████▊     | 56/117 [00:02<00:03, 19.51it/s, loss=1.71, v_num=1, val_acc=0.664]
Epoch 34:  49%|████▊     | 57/117 [00:02<00:03, 19.79it/s, loss=1.71, v_num=1, val_acc=0.664]
Epoch 34:  49%|████▊     | 57/117 [00:02<00:03, 19.62it/s, loss=1.72, v_num=1, val_acc=0.664]
Epoch 34:  50%|████▉     | 58/117 [00:02<00:02, 19.86it/s, loss=1.72, v_num=1, val_acc=0.664]
Epoch 34:  50%|████▉     | 58/117 [00:02<00:02, 19.70it/s, loss=1.7, v_num=1, val_acc=0.664]
Epoch 34:  50%|█████     | 59/117 [00:02<00:02, 19.95it/s, loss=1.7, v_num=1, val_acc=0.664]
Epoch 34:  50%|█████     | 59/117 [00:02<00:02, 19.80it/s, loss=1.7, v_num=1, val_acc=0.664]
Epoch 34:  51%|█████▏    | 60/117 [00:02<00:02, 20.07it/s, loss=1.7, v_num=1, val_acc=0.664]
Epoch 34:  51%|█████▏    | 60/117 [00:03<00:02, 19.90it/s, loss=1.72, v_num=1, val_acc=0.664]
Epoch 34:  52%|█████▏    | 61/117 [00:03<00:02, 20.17it/s, loss=1.72, v_num=1, val_acc=0.664]
Epoch 34:  52%|█████▏    | 61/117 [00:03<00:02, 20.00it/s, loss=1.65, v_num=1, val_acc=0.664]
Epoch 34:  53%|█████▎    | 62/117 [00:03<00:02, 20.27it/s, loss=1.65, v_num=1, val_acc=0.664]
Epoch 34:  53%|█████▎    | 62/117 [00:03<00:02, 20.11it/s, loss=1.64, v_num=1, val_acc=0.664]
Epoch 34:  54%|█████▍    | 63/117 [00:03<00:02, 20.37it/s, loss=1.64, v_num=1, val_acc=0.664]
Epoch 34:  54%|█████▍    | 63/117 [00:03<00:02, 20.20it/s, loss=1.64, v_num=1, val_acc=0.664]
Epoch 34:  55%|█████▍    | 64/117 [00:03<00:02, 20.46it/s, loss=1.64, v_num=1, val_acc=0.664]
Epoch 34:  55%|█████▍    | 64/117 [00:03<00:02, 20.30it/s, loss=1.65, v_num=1, val_acc=0.664]
Epoch 34:  56%|█████▌    | 65/117 [00:03<00:02, 20.56it/s, loss=1.65, v_num=1, val_acc=0.664]
Epoch 34:  56%|█████▌    | 65/117 [00:03<00:02, 20.39it/s, loss=1.7, v_num=1, val_acc=0.664]
Epoch 34:  56%|█████▋    | 66/117 [00:03<00:02, 20.64it/s, loss=1.7, v_num=1, val_acc=0.664]
Epoch 34:  56%|█████▋    | 66/117 [00:03<00:02, 20.48it/s, loss=1.73, v_num=1, val_acc=0.664]
Epoch 34:  57%|█████▋    | 67/117 [00:03<00:02, 20.74it/s, loss=1.73, v_num=1, val_acc=0.664]
Epoch 34:  57%|█████▋    | 67/117 [00:03<00:02, 20.58it/s, loss=1.78, v_num=1, val_acc=0.664]
Epoch 34:  58%|█████▊    | 68/117 [00:03<00:02, 20.82it/s, loss=1.78, v_num=1, val_acc=0.664]
Epoch 34:  58%|█████▊    | 68/117 [00:03<00:02, 20.66it/s, loss=1.9, v_num=1, val_acc=0.664]
Epoch 34:  59%|█████▉    | 69/117 [00:03<00:02, 20.91it/s, loss=1.9, v_num=1, val_acc=0.664]
Epoch 34:  59%|█████▉    | 69/117 [00:03<00:02, 20.75it/s, loss=1.97, v_num=1, val_acc=0.664]
Epoch 34:  60%|█████▉    | 70/117 [00:03<00:02, 20.99it/s, loss=1.97, v_num=1, val_acc=0.664]
Epoch 34:  60%|█████▉    | 70/117 [00:03<00:02, 20.84it/s, loss=2, v_num=1, val_acc=0.664]
Epoch 34:  61%|██████    | 71/117 [00:03<00:02, 21.08it/s, loss=2, v_num=1, val_acc=0.664]
Epoch 34:  61%|██████    | 71/117 [00:03<00:02, 20.92it/s, loss=2.02, v_num=1, val_acc=0.664]
Epoch 34:  62%|██████▏   | 72/117 [00:03<00:02, 21.16it/s, loss=2.02, v_num=1, val_acc=0.664]
Epoch 34:  62%|██████▏   | 72/117 [00:03<00:02, 21.00it/s, loss=2.03, v_num=1, val_acc=0.664]
Epoch 34:  62%|██████▏   | 73/117 [00:03<00:02, 21.24it/s, loss=2.03, v_num=1, val_acc=0.664]
Epoch 34:  62%|██████▏   | 73/117 [00:03<00:02, 21.08it/s, loss=2.05, v_num=1, val_acc=0.664]
Epoch 34:  63%|██████▎   | 74/117 [00:03<00:02, 21.31it/s, loss=2.05, v_num=1, val_acc=0.664]
Epoch 34:  63%|██████▎   | 74/117 [00:03<00:02, 21.16it/s, loss=2.08, v_num=1, val_acc=0.664]
Epoch 34:  64%|██████▍   | 75/117 [00:03<00:01, 21.39it/s, loss=2.08, v_num=1, val_acc=0.664]
Epoch 34:  64%|██████▍   | 75/117 [00:03<00:01, 21.23it/s, loss=2.08, v_num=1, val_acc=0.664]
Epoch 34:  65%|██████▍   | 76/117 [00:03<00:01, 21.46it/s, loss=2.08, v_num=1, val_acc=0.664]
Epoch 34:  65%|██████▍   | 76/117 [00:03<00:01, 21.31it/s, loss=2.11, v_num=1, val_acc=0.664]
Epoch 34:  66%|██████▌   | 77/117 [00:03<00:01, 21.53it/s, loss=2.11, v_num=1, val_acc=0.664]
Epoch 34:  66%|██████▌   | 77/117 [00:03<00:01, 21.38it/s, loss=2.13, v_num=1, val_acc=0.664]
Epoch 34:  67%|██████▋   | 78/117 [00:03<00:01, 21.60it/s, loss=2.13, v_num=1, val_acc=0.664]
Epoch 34:  67%|██████▋   | 78/117 [00:03<00:01, 21.45it/s, loss=2.11, v_num=1, val_acc=0.664]
Epoch 34:  68%|██████▊   | 79/117 [00:03<00:01, 21.67it/s, loss=2.11, v_num=1, val_acc=0.664]
Epoch 34:  68%|██████▊   | 79/117 [00:03<00:01, 21.52it/s, loss=2.13, v_num=1, val_acc=0.664]
Epoch 34:  68%|██████▊   | 80/117 [00:03<00:01, 21.74it/s, loss=2.13, v_num=1, val_acc=0.664]
Epoch 34:  68%|██████▊   | 80/117 [00:03<00:01, 21.59it/s, loss=2.08, v_num=1, val_acc=0.664]
Epoch 34:  69%|██████▉   | 81/117 [00:03<00:01, 21.81it/s, loss=2.08, v_num=1, val_acc=0.664]
Epoch 34:  69%|██████▉   | 81/117 [00:03<00:01, 21.66it/s, loss=2.09, v_num=1, val_acc=0.664]
Epoch 34:  70%|███████   | 82/117 [00:03<00:01, 21.84it/s, loss=2.09, v_num=1, val_acc=0.664]
Epoch 34:  70%|███████   | 82/117 [00:03<00:01, 21.69it/s, loss=2.06, v_num=1, val_acc=0.664]
Epoch 34:  71%|███████   | 83/117 [00:03<00:01, 21.90it/s, loss=2.06, v_num=1, val_acc=0.664]
Epoch 34:  71%|███████   | 83/117 [00:03<00:01, 21.76it/s, loss=2.01, v_num=1, val_acc=0.664]
Epoch 34:  72%|███████▏  | 84/117 [00:03<00:01, 21.97it/s, loss=2.01, v_num=1, val_acc=0.664]
Epoch 34:  72%|███████▏  | 84/117 [00:03<00:01, 21.83it/s, loss=1.98, v_num=1, val_acc=0.664]
Epoch 34:  73%|███████▎  | 85/117 [00:03<00:01, 22.03it/s, loss=1.98, v_num=1, val_acc=0.664]
Epoch 34:  73%|███████▎  | 85/117 [00:03<00:01, 21.89it/s, loss=1.99, v_num=1, val_acc=0.664]
Epoch 34:  74%|███████▎  | 86/117 [00:03<00:01, 22.10it/s, loss=1.99, v_num=1, val_acc=0.664]
Epoch 34:  74%|███████▎  | 86/117 [00:03<00:01, 21.95it/s, loss=2.05, v_num=1, val_acc=0.664]
Epoch 34:  74%|███████▍  | 87/117 [00:03<00:01, 22.16it/s, loss=2.05, v_num=1, val_acc=0.664]
Epoch 34:  74%|███████▍  | 87/117 [00:03<00:01, 22.02it/s, loss=2.02, v_num=1, val_acc=0.664]
Epoch 34:  75%|███████▌  | 88/117 [00:03<00:01, 22.22it/s, loss=2.02, v_num=1, val_acc=0.664]
Epoch 34:  75%|███████▌  | 88/117 [00:03<00:01, 22.08it/s, loss=1.97, v_num=1, val_acc=0.664]
Epoch 34:  76%|███████▌  | 89/117 [00:03<00:01, 22.28it/s, loss=1.97, v_num=1, val_acc=0.664]
Epoch 34:  76%|███████▌  | 89/117 [00:04<00:01, 22.14it/s, loss=1.96, v_num=1, val_acc=0.664]
Epoch 34:  77%|███████▋  | 90/117 [00:04<00:01, 22.31it/s, loss=1.96, v_num=1, val_acc=0.664]
Epoch 34:  77%|███████▋  | 90/117 [00:04<00:01, 22.18it/s, loss=2.02, v_num=1, val_acc=0.664]
Epoch 34:  78%|███████▊  | 91/117 [00:04<00:01, 22.38it/s, loss=2.02, v_num=1, val_acc=0.664]
Epoch 34:  78%|███████▊  | 91/117 [00:04<00:01, 22.24it/s, loss=2.07, v_num=1, val_acc=0.664]
Epoch 34:  79%|███████▊  | 92/117 [00:04<00:01, 22.44it/s, loss=2.07, v_num=1, val_acc=0.664]
Epoch 34:  79%|███████▊  | 92/117 [00:04<00:01, 22.30it/s, loss=2.16, v_num=1, val_acc=0.664]
Epoch 34:  79%|███████▉  | 93/117 [00:04<00:01, 22.49it/s, loss=2.16, v_num=1, val_acc=0.664]
Epoch 34:  79%|███████▉  | 93/117 [00:04<00:01, 22.36it/s, loss=2.2, v_num=1, val_acc=0.664]
Epoch 34:  80%|████████  | 94/117 [00:04<00:01, 22.55it/s, loss=2.2, v_num=1, val_acc=0.664]
Epoch 34:  80%|████████  | 94/117 [00:04<00:01, 22.41it/s, loss=2.17, v_num=1, val_acc=0.664]
Epoch 34:  81%|████████  | 95/117 [00:04<00:00, 22.60it/s, loss=2.17, v_num=1, val_acc=0.664]
Epoch 34:  81%|████████  | 95/117 [00:04<00:00, 22.47it/s, loss=2.11, v_num=1, val_acc=0.664]
Epoch 34:  82%|████████▏ | 96/117 [00:04<00:00, 22.65it/s, loss=2.11, v_num=1, val_acc=0.664]
Epoch 34:  82%|████████▏ | 96/117 [00:04<00:00, 22.52it/s, loss=2.09, v_num=1, val_acc=0.664]
Epoch 34:  83%|████████▎ | 97/117 [00:04<00:00, 22.71it/s, loss=2.09, v_num=1, val_acc=0.664]
Epoch 34:  83%|████████▎ | 97/117 [00:04<00:00, 22.57it/s, loss=2.1, v_num=1, val_acc=0.664]

Validation: 0it [00:00, ?it/s]

Validation:   0%|          | 0/20 [00:00<?, ?it/s]

Validation DataLoader 0:   0%|          | 0/20 [00:00<?, ?it/s]

Validation DataLoader 0:   5%|▌         | 1/20 [00:00<00:00, 159.78it/s]
Epoch 34:  84%|████████▍ | 98/117 [00:05<00:00, 19.04it/s, loss=2.1, v_num=1, val_acc=0.664]

Validation DataLoader 0:  10%|█         | 2/20 [00:00<00:00, 55.77it/s]
Epoch 34:  85%|████████▍ | 99/117 [00:05<00:00, 19.12it/s, loss=2.1, v_num=1, val_acc=0.664]

Validation DataLoader 0:  15%|█▌        | 3/20 [00:00<00:00, 44.58it/s]
Epoch 34:  85%|████████▌ | 100/117 [00:05<00:00, 19.20it/s, loss=2.1, v_num=1, val_acc=0.664]

Validation DataLoader 0:  20%|██        | 4/20 [00:00<00:00, 40.40it/s]
Epoch 34:  86%|████████▋ | 101/117 [00:05<00:00, 19.27it/s, loss=2.1, v_num=1, val_acc=0.664]

Validation DataLoader 0:  25%|██▌       | 5/20 [00:00<00:00, 38.23it/s]
Epoch 34:  87%|████████▋ | 102/117 [00:05<00:00, 19.35it/s, loss=2.1, v_num=1, val_acc=0.664]

Validation DataLoader 0:  30%|███       | 6/20 [00:00<00:00, 36.99it/s]
Epoch 34:  88%|████████▊ | 103/117 [00:05<00:00, 19.42it/s, loss=2.1, v_num=1, val_acc=0.664]

Validation DataLoader 0:  35%|███▌      | 7/20 [00:00<00:00, 36.12it/s]
Epoch 34:  89%|████████▉ | 104/117 [00:05<00:00, 19.49it/s, loss=2.1, v_num=1, val_acc=0.664]

Validation DataLoader 0:  40%|████      | 8/20 [00:00<00:00, 35.50it/s]
Epoch 34:  90%|████████▉ | 105/117 [00:05<00:00, 19.57it/s, loss=2.1, v_num=1, val_acc=0.664]

Validation DataLoader 0:  45%|████▌     | 9/20 [00:00<00:00, 34.99it/s]
Epoch 34:  91%|█████████ | 106/117 [00:05<00:00, 19.64it/s, loss=2.1, v_num=1, val_acc=0.664]

Validation DataLoader 0:  50%|█████     | 10/20 [00:00<00:00, 34.63it/s]
Epoch 34:  91%|█████████▏| 107/117 [00:05<00:00, 19.71it/s, loss=2.1, v_num=1, val_acc=0.664]

Validation DataLoader 0:  55%|█████▌    | 11/20 [00:00<00:00, 34.37it/s]
Epoch 34:  92%|█████████▏| 108/117 [00:05<00:00, 19.78it/s, loss=2.1, v_num=1, val_acc=0.664]

Validation DataLoader 0:  60%|██████    | 12/20 [00:00<00:00, 34.13it/s]
Epoch 34:  93%|█████████▎| 109/117 [00:05<00:00, 19.84it/s, loss=2.1, v_num=1, val_acc=0.664]

Validation DataLoader 0:  65%|██████▌   | 13/20 [00:00<00:00, 33.93it/s]
Epoch 34:  94%|█████████▍| 110/117 [00:05<00:00, 19.91it/s, loss=2.1, v_num=1, val_acc=0.664]

Validation DataLoader 0:  70%|███████   | 14/20 [00:00<00:00, 33.76it/s]
Epoch 34:  95%|█████████▍| 111/117 [00:05<00:00, 19.98it/s, loss=2.1, v_num=1, val_acc=0.664]

Validation DataLoader 0:  75%|███████▌  | 15/20 [00:00<00:00, 33.60it/s]
Epoch 34:  96%|█████████▌| 112/117 [00:05<00:00, 20.04it/s, loss=2.1, v_num=1, val_acc=0.664]

Validation DataLoader 0:  80%|████████  | 16/20 [00:00<00:00, 33.46it/s]
Epoch 34:  97%|█████████▋| 113/117 [00:05<00:00, 20.11it/s, loss=2.1, v_num=1, val_acc=0.664]

Validation DataLoader 0:  85%|████████▌ | 17/20 [00:00<00:00, 33.33it/s]
Epoch 34:  97%|█████████▋| 114/117 [00:05<00:00, 20.17it/s, loss=2.1, v_num=1, val_acc=0.664]

Validation DataLoader 0:  90%|█████████ | 18/20 [00:00<00:00, 33.23it/s]
Epoch 34:  98%|█████████▊| 115/117 [00:05<00:00, 20.24it/s, loss=2.1, v_num=1, val_acc=0.664]

Validation DataLoader 0:  95%|█████████▌| 19/20 [00:00<00:00, 33.15it/s]
Epoch 34:  99%|█████████▉| 116/117 [00:05<00:00, 20.30it/s, loss=2.1, v_num=1, val_acc=0.664]

Validation DataLoader 0: 100%|██████████| 20/20 [00:00<00:00, 33.14it/s]
Epoch 34: 100%|██████████| 117/117 [00:05<00:00, 20.37it/s, loss=2.1, v_num=1, val_acc=0.664]
Epoch 34: 100%|██████████| 117/117 [00:05<00:00, 20.30it/s, loss=2.1, v_num=1, val_acc=0.708]


Epoch 34: 100%|██████████| 117/117 [00:05<00:00, 20.29it/s, loss=2.1, v_num=1, val_acc=0.708]
Epoch 34:   0%|          | 0/117 [00:00<?, ?it/s, loss=2.1, v_num=1, val_acc=0.708]
Epoch 35:   0%|          | 0/117 [00:00<?, ?it/s, loss=2.1, v_num=1, val_acc=0.708]
Epoch 35:   1%|          | 1/117 [00:00<01:47,  1.08it/s, loss=2.1, v_num=1, val_acc=0.708]
Epoch 35:   1%|          | 1/117 [00:00<01:50,  1.05it/s, loss=2.09, v_num=1, val_acc=0.708]
Epoch 35:   2%|▏         | 2/117 [00:00<00:55,  2.06it/s, loss=2.09, v_num=1, val_acc=0.708]
Epoch 35:   2%|▏         | 2/117 [00:00<00:57,  2.01it/s, loss=2.04, v_num=1, val_acc=0.708]
Epoch 35:   3%|▎         | 3/117 [00:01<00:38,  2.99it/s, loss=2.04, v_num=1, val_acc=0.708]
Epoch 35:   3%|▎         | 3/117 [00:01<00:39,  2.92it/s, loss=2.04, v_num=1, val_acc=0.708]
Epoch 35:   3%|▎         | 4/117 [00:01<00:29,  3.86it/s, loss=2.04, v_num=1, val_acc=0.708]
Epoch 35:   3%|▎         | 4/117 [00:01<00:29,  3.77it/s, loss=2.03, v_num=1, val_acc=0.708]
Epoch 35:   4%|▍         | 5/117 [00:01<00:23,  4.67it/s, loss=2.03, v_num=1, val_acc=0.708]
Epoch 35:   4%|▍         | 5/117 [00:01<00:24,  4.57it/s, loss=2.03, v_num=1, val_acc=0.708]
Epoch 35:   5%|▌         | 6/117 [00:01<00:20,  5.43it/s, loss=2.03, v_num=1, val_acc=0.708]
Epoch 35:   5%|▌         | 6/117 [00:01<00:20,  5.31it/s, loss=2.02, v_num=1, val_acc=0.708]
Epoch 35:   6%|▌         | 7/117 [00:01<00:17,  6.15it/s, loss=2.02, v_num=1, val_acc=0.708]
Epoch 35:   6%|▌         | 7/117 [00:01<00:18,  6.02it/s, loss=2.04, v_num=1, val_acc=0.708]
Epoch 35:   7%|▋         | 8/117 [00:01<00:15,  6.83it/s, loss=2.04, v_num=1, val_acc=0.708]
Epoch 35:   7%|▋         | 8/117 [00:01<00:16,  6.68it/s, loss=2.04, v_num=1, val_acc=0.708]
Epoch 35:   8%|▊         | 9/117 [00:01<00:14,  7.44it/s, loss=2.04, v_num=1, val_acc=0.708]
Epoch 35:   8%|▊         | 9/117 [00:01<00:14,  7.29it/s, loss=1.99, v_num=1, val_acc=0.708]
Epoch 35:   9%|▊         | 10/117 [00:01<00:13,  8.03it/s, loss=1.99, v_num=1, val_acc=0.708]
Epoch 35:   9%|▊         | 10/117 [00:01<00:13,  7.87it/s, loss=2, v_num=1, val_acc=0.708]
Epoch 35:   9%|▉         | 11/117 [00:01<00:12,  8.61it/s, loss=2, v_num=1, val_acc=0.708]
Epoch 35:   9%|▉         | 11/117 [00:01<00:12,  8.44it/s, loss=2, v_num=1, val_acc=0.708]
Epoch 35:  10%|█         | 12/117 [00:01<00:11,  9.14it/s, loss=2, v_num=1, val_acc=0.708]
Epoch 35:  10%|█         | 12/117 [00:01<00:11,  8.97it/s, loss=1.96, v_num=1, val_acc=0.708]
Epoch 35:  11%|█         | 13/117 [00:01<00:10,  9.66it/s, loss=1.96, v_num=1, val_acc=0.708]
Epoch 35:  11%|█         | 13/117 [00:01<00:10,  9.48it/s, loss=1.93, v_num=1, val_acc=0.708]
Epoch 35:  12%|█▏        | 14/117 [00:01<00:10, 10.15it/s, loss=1.93, v_num=1, val_acc=0.708]
Epoch 35:  12%|█▏        | 14/117 [00:01<00:10,  9.96it/s, loss=1.87, v_num=1, val_acc=0.708]
Epoch 35:  13%|█▎        | 15/117 [00:01<00:09, 10.61it/s, loss=1.87, v_num=1, val_acc=0.708]
Epoch 35:  13%|█▎        | 15/117 [00:01<00:09, 10.42it/s, loss=1.83, v_num=1, val_acc=0.708]
Epoch 35:  14%|█▎        | 16/117 [00:01<00:09, 11.06it/s, loss=1.83, v_num=1, val_acc=0.708]
Epoch 35:  14%|█▎        | 16/117 [00:01<00:09, 10.87it/s, loss=1.78, v_num=1, val_acc=0.708]
Epoch 35:  15%|█▍        | 17/117 [00:01<00:08, 11.47it/s, loss=1.78, v_num=1, val_acc=0.708]
Epoch 35:  15%|█▍        | 17/117 [00:01<00:08, 11.27it/s, loss=1.76, v_num=1, val_acc=0.708]
Epoch 35:  15%|█▌        | 18/117 [00:01<00:08, 11.86it/s, loss=1.76, v_num=1, val_acc=0.708]
Epoch 35:  15%|█▌        | 18/117 [00:01<00:08, 11.67it/s, loss=1.78, v_num=1, val_acc=0.708]
Epoch 35:  16%|█▌        | 19/117 [00:01<00:08, 12.24it/s, loss=1.78, v_num=1, val_acc=0.708]
Epoch 35:  16%|█▌        | 19/117 [00:01<00:08, 12.05it/s, loss=1.76, v_num=1, val_acc=0.708]
Epoch 35:  17%|█▋        | 20/117 [00:01<00:07, 12.61it/s, loss=1.76, v_num=1, val_acc=0.708]
Epoch 35:  17%|█▋        | 20/117 [00:01<00:07, 12.41it/s, loss=1.73, v_num=1, val_acc=0.708]
Epoch 35:  18%|█▊        | 21/117 [00:01<00:07, 12.96it/s, loss=1.73, v_num=1, val_acc=0.708]
Epoch 35:  18%|█▊        | 21/117 [00:01<00:07, 12.76it/s, loss=1.76, v_num=1, val_acc=0.708]
Epoch 35:  19%|█▉        | 22/117 [00:01<00:07, 13.28it/s, loss=1.76, v_num=1, val_acc=0.708]
Epoch 35:  19%|█▉        | 22/117 [00:01<00:07, 13.08it/s, loss=1.76, v_num=1, val_acc=0.708]
Epoch 35:  20%|█▉        | 23/117 [00:01<00:06, 13.60it/s, loss=1.76, v_num=1, val_acc=0.708]
Epoch 35:  20%|█▉        | 23/117 [00:01<00:07, 13.40it/s, loss=1.76, v_num=1, val_acc=0.708]
Epoch 35:  21%|██        | 24/117 [00:01<00:06, 13.92it/s, loss=1.76, v_num=1, val_acc=0.708]
Epoch 35:  21%|██        | 24/117 [00:01<00:06, 13.71it/s, loss=1.8, v_num=1, val_acc=0.708]
Epoch 35:  21%|██▏       | 25/117 [00:01<00:06, 14.21it/s, loss=1.8, v_num=1, val_acc=0.708]
Epoch 35:  21%|██▏       | 25/117 [00:01<00:06, 14.01it/s, loss=1.84, v_num=1, val_acc=0.708]
Epoch 35:  22%|██▏       | 26/117 [00:01<00:06, 14.49it/s, loss=1.84, v_num=1, val_acc=0.708]
Epoch 35:  22%|██▏       | 26/117 [00:01<00:06, 14.29it/s, loss=1.88, v_num=1, val_acc=0.708]
Epoch 35:  23%|██▎       | 27/117 [00:01<00:06, 14.77it/s, loss=1.88, v_num=1, val_acc=0.708]
Epoch 35:  23%|██▎       | 27/117 [00:01<00:06, 14.57it/s, loss=1.86, v_num=1, val_acc=0.708]
Epoch 35:  24%|██▍       | 28/117 [00:01<00:05, 15.03it/s, loss=1.86, v_num=1, val_acc=0.708]
Epoch 35:  24%|██▍       | 28/117 [00:01<00:06, 14.83it/s, loss=1.86, v_num=1, val_acc=0.708]
Epoch 35:  25%|██▍       | 29/117 [00:01<00:05, 15.28it/s, loss=1.86, v_num=1, val_acc=0.708]
Epoch 35:  25%|██▍       | 29/117 [00:01<00:05, 15.08it/s, loss=1.88, v_num=1, val_acc=0.708]
Epoch 35:  26%|██▌       | 30/117 [00:01<00:05, 15.52it/s, loss=1.88, v_num=1, val_acc=0.708]
Epoch 35:  26%|██▌       | 30/117 [00:01<00:05, 15.32it/s, loss=1.89, v_num=1, val_acc=0.708]
Epoch 35:  26%|██▋       | 31/117 [00:01<00:05, 15.76it/s, loss=1.89, v_num=1, val_acc=0.708]
Epoch 35:  26%|██▋       | 31/117 [00:01<00:05, 15.56it/s, loss=1.89, v_num=1, val_acc=0.708]
Epoch 35:  27%|██▋       | 32/117 [00:02<00:05, 15.99it/s, loss=1.89, v_num=1, val_acc=0.708]
Epoch 35:  27%|██▋       | 32/117 [00:02<00:05, 15.79it/s, loss=1.91, v_num=1, val_acc=0.708]
Epoch 35:  28%|██▊       | 33/117 [00:02<00:05, 16.21it/s, loss=1.91, v_num=1, val_acc=0.708]
Epoch 35:  28%|██▊       | 33/117 [00:02<00:05, 16.01it/s, loss=1.86, v_num=1, val_acc=0.708]
Epoch 35:  29%|██▉       | 34/117 [00:02<00:05, 16.42it/s, loss=1.86, v_num=1, val_acc=0.708]
Epoch 35:  29%|██▉       | 34/117 [00:02<00:05, 16.22it/s, loss=1.86, v_num=1, val_acc=0.708]
Epoch 35:  30%|██▉       | 35/117 [00:02<00:04, 16.62it/s, loss=1.86, v_num=1, val_acc=0.708]
Epoch 35:  30%|██▉       | 35/117 [00:02<00:04, 16.43it/s, loss=1.84, v_num=1, val_acc=0.708]
Epoch 35:  31%|███       | 36/117 [00:02<00:04, 16.81it/s, loss=1.84, v_num=1, val_acc=0.708]
Epoch 35:  31%|███       | 36/117 [00:02<00:04, 16.63it/s, loss=1.83, v_num=1, val_acc=0.708]
Epoch 35:  32%|███▏      | 37/117 [00:02<00:04, 16.98it/s, loss=1.83, v_num=1, val_acc=0.708]
Epoch 35:  32%|███▏      | 37/117 [00:02<00:04, 16.81it/s, loss=1.82, v_num=1, val_acc=0.708]
Epoch 35:  32%|███▏      | 38/117 [00:02<00:04, 17.18it/s, loss=1.82, v_num=1, val_acc=0.708]
Epoch 35:  32%|███▏      | 38/117 [00:02<00:04, 16.99it/s, loss=1.8, v_num=1, val_acc=0.708]
Epoch 35:  33%|███▎      | 39/117 [00:02<00:04, 17.37it/s, loss=1.8, v_num=1, val_acc=0.708]
Epoch 35:  33%|███▎      | 39/117 [00:02<00:04, 17.17it/s, loss=1.82, v_num=1, val_acc=0.708]
Epoch 35:  34%|███▍      | 40/117 [00:02<00:04, 17.54it/s, loss=1.82, v_num=1, val_acc=0.708]
Epoch 35:  34%|███▍      | 40/117 [00:02<00:04, 17.35it/s, loss=1.82, v_num=1, val_acc=0.708]
Epoch 35:  35%|███▌      | 41/117 [00:02<00:04, 17.68it/s, loss=1.82, v_num=1, val_acc=0.708]
Epoch 35:  35%|███▌      | 41/117 [00:02<00:04, 17.51it/s, loss=1.78, v_num=1, val_acc=0.708]
Epoch 35:  36%|███▌      | 42/117 [00:02<00:04, 17.86it/s, loss=1.78, v_num=1, val_acc=0.708]
Epoch 35:  36%|███▌      | 42/117 [00:02<00:04, 17.68it/s, loss=1.78, v_num=1, val_acc=0.708]
Epoch 35:  37%|███▋      | 43/117 [00:02<00:04, 18.02it/s, loss=1.78, v_num=1, val_acc=0.708]
Epoch 35:  37%|███▋      | 43/117 [00:02<00:04, 17.84it/s, loss=1.79, v_num=1, val_acc=0.708]
Epoch 35:  38%|███▊      | 44/117 [00:02<00:04, 18.18it/s, loss=1.79, v_num=1, val_acc=0.708]
Epoch 35:  38%|███▊      | 44/117 [00:02<00:04, 17.99it/s, loss=1.81, v_num=1, val_acc=0.708]
Epoch 35:  38%|███▊      | 45/117 [00:02<00:03, 18.33it/s, loss=1.81, v_num=1, val_acc=0.708]
Epoch 35:  38%|███▊      | 45/117 [00:02<00:03, 18.14it/s, loss=1.87, v_num=1, val_acc=0.708]
Epoch 35:  39%|███▉      | 46/117 [00:02<00:03, 18.47it/s, loss=1.87, v_num=1, val_acc=0.708]
Epoch 35:  39%|███▉      | 46/117 [00:02<00:03, 18.29it/s, loss=1.83, v_num=1, val_acc=0.708]
Epoch 35:  40%|████      | 47/117 [00:02<00:03, 18.62it/s, loss=1.83, v_num=1, val_acc=0.708]
Epoch 35:  40%|████      | 47/117 [00:02<00:03, 18.43it/s, loss=1.82, v_num=1, val_acc=0.708]
Epoch 35:  41%|████      | 48/117 [00:02<00:03, 18.76it/s, loss=1.82, v_num=1, val_acc=0.708]
Epoch 35:  41%|████      | 48/117 [00:02<00:03, 18.58it/s, loss=1.76, v_num=1, val_acc=0.708]
Epoch 35:  42%|████▏     | 49/117 [00:02<00:03, 18.90it/s, loss=1.76, v_num=1, val_acc=0.708]
Epoch 35:  42%|████▏     | 49/117 [00:02<00:03, 18.71it/s, loss=1.73, v_num=1, val_acc=0.708]
Epoch 35:  43%|████▎     | 50/117 [00:02<00:03, 19.02it/s, loss=1.73, v_num=1, val_acc=0.708]
Epoch 35:  43%|████▎     | 50/117 [00:02<00:03, 18.84it/s, loss=1.73, v_num=1, val_acc=0.708]
Epoch 35:  44%|████▎     | 51/117 [00:02<00:03, 19.15it/s, loss=1.73, v_num=1, val_acc=0.708]
Epoch 35:  44%|████▎     | 51/117 [00:02<00:03, 18.97it/s, loss=1.72, v_num=1, val_acc=0.708]
Epoch 35:  44%|████▍     | 52/117 [00:02<00:03, 19.28it/s, loss=1.72, v_num=1, val_acc=0.708]
Epoch 35:  44%|████▍     | 52/117 [00:02<00:03, 19.10it/s, loss=1.71, v_num=1, val_acc=0.708]
Epoch 35:  45%|████▌     | 53/117 [00:02<00:03, 19.40it/s, loss=1.71, v_num=1, val_acc=0.708]
Epoch 35:  45%|████▌     | 53/117 [00:02<00:03, 19.22it/s, loss=1.7, v_num=1, val_acc=0.708]
Epoch 35:  46%|████▌     | 54/117 [00:02<00:03, 19.51it/s, loss=1.7, v_num=1, val_acc=0.708]
Epoch 35:  46%|████▌     | 54/117 [00:02<00:03, 19.33it/s, loss=1.68, v_num=1, val_acc=0.708]
Epoch 35:  47%|████▋     | 55/117 [00:02<00:03, 19.63it/s, loss=1.68, v_num=1, val_acc=0.708]
Epoch 35:  47%|████▋     | 55/117 [00:02<00:03, 19.45it/s, loss=1.66, v_num=1, val_acc=0.708]
Epoch 35:  48%|████▊     | 56/117 [00:02<00:03, 19.74it/s, loss=1.66, v_num=1, val_acc=0.708]
Epoch 35:  48%|████▊     | 56/117 [00:02<00:03, 19.57it/s, loss=1.64, v_num=1, val_acc=0.708]
Epoch 35:  49%|████▊     | 57/117 [00:02<00:03, 19.85it/s, loss=1.64, v_num=1, val_acc=0.708]
Epoch 35:  49%|████▊     | 57/117 [00:02<00:03, 19.68it/s, loss=1.61, v_num=1, val_acc=0.708]
Epoch 35:  50%|████▉     | 58/117 [00:02<00:02, 19.96it/s, loss=1.61, v_num=1, val_acc=0.708]
Epoch 35:  50%|████▉     | 58/117 [00:02<00:02, 19.79it/s, loss=1.58, v_num=1, val_acc=0.708]
Epoch 35:  50%|█████     | 59/117 [00:02<00:02, 20.07it/s, loss=1.58, v_num=1, val_acc=0.708]
Epoch 35:  50%|█████     | 59/117 [00:02<00:02, 19.90it/s, loss=1.54, v_num=1, val_acc=0.708]
Epoch 35:  51%|█████▏    | 60/117 [00:02<00:02, 20.17it/s, loss=1.54, v_num=1, val_acc=0.708]
Epoch 35:  51%|█████▏    | 60/117 [00:02<00:02, 20.00it/s, loss=1.59, v_num=1, val_acc=0.708]
Epoch 35:  52%|█████▏    | 61/117 [00:03<00:02, 20.28it/s, loss=1.59, v_num=1, val_acc=0.708]
Epoch 35:  52%|█████▏    | 61/117 [00:03<00:02, 20.11it/s, loss=1.63, v_num=1, val_acc=0.708]
Epoch 35:  53%|█████▎    | 62/117 [00:03<00:02, 20.38it/s, loss=1.63, v_num=1, val_acc=0.708]
Epoch 35:  53%|█████▎    | 62/117 [00:03<00:02, 20.21it/s, loss=1.65, v_num=1, val_acc=0.708]
Epoch 35:  54%|█████▍    | 63/117 [00:03<00:02, 20.48it/s, loss=1.65, v_num=1, val_acc=0.708]
Epoch 35:  54%|█████▍    | 63/117 [00:03<00:02, 20.31it/s, loss=1.64, v_num=1, val_acc=0.708]
Epoch 35:  55%|█████▍    | 64/117 [00:03<00:02, 20.57it/s, loss=1.64, v_num=1, val_acc=0.708]
Epoch 35:  55%|█████▍    | 64/117 [00:03<00:02, 20.40it/s, loss=1.58, v_num=1, val_acc=0.708]
Epoch 35:  56%|█████▌    | 65/117 [00:03<00:02, 20.66it/s, loss=1.58, v_num=1, val_acc=0.708]
Epoch 35:  56%|█████▌    | 65/117 [00:03<00:02, 20.50it/s, loss=1.49, v_num=1, val_acc=0.708]
Epoch 35:  56%|█████▋    | 66/117 [00:03<00:02, 20.71it/s, loss=1.49, v_num=1, val_acc=0.708]
Epoch 35:  56%|█████▋    | 66/117 [00:03<00:02, 20.57it/s, loss=1.5, v_num=1, val_acc=0.708]
Epoch 35:  57%|█████▋    | 67/117 [00:03<00:02, 20.82it/s, loss=1.5, v_num=1, val_acc=0.708]
Epoch 35:  57%|█████▋    | 67/117 [00:03<00:02, 20.66it/s, loss=1.49, v_num=1, val_acc=0.708]
Epoch 35:  58%|█████▊    | 68/117 [00:03<00:02, 20.91it/s, loss=1.49, v_num=1, val_acc=0.708]
Epoch 35:  58%|█████▊    | 68/117 [00:03<00:02, 20.75it/s, loss=1.52, v_num=1, val_acc=0.708]
Epoch 35:  59%|█████▉    | 69/117 [00:03<00:02, 21.00it/s, loss=1.52, v_num=1, val_acc=0.708]
Epoch 35:  59%|█████▉    | 69/117 [00:03<00:02, 20.84it/s, loss=1.58, v_num=1, val_acc=0.708]
Epoch 35:  60%|█████▉    | 70/117 [00:03<00:02, 21.08it/s, loss=1.58, v_num=1, val_acc=0.708]
Epoch 35:  60%|█████▉    | 70/117 [00:03<00:02, 20.92it/s, loss=1.55, v_num=1, val_acc=0.708]
Epoch 35:  61%|██████    | 71/117 [00:03<00:02, 21.16it/s, loss=1.55, v_num=1, val_acc=0.708]
Epoch 35:  61%|██████    | 71/117 [00:03<00:02, 21.00it/s, loss=1.49, v_num=1, val_acc=0.708]
Epoch 35:  62%|██████▏   | 72/117 [00:03<00:02, 21.24it/s, loss=1.49, v_num=1, val_acc=0.708]
Epoch 35:  62%|██████▏   | 72/117 [00:03<00:02, 21.08it/s, loss=1.5, v_num=1, val_acc=0.708]
Epoch 35:  62%|██████▏   | 73/117 [00:03<00:02, 21.32it/s, loss=1.5, v_num=1, val_acc=0.708]
Epoch 35:  62%|██████▏   | 73/117 [00:03<00:02, 21.16it/s, loss=1.54, v_num=1, val_acc=0.708]
Epoch 35:  63%|██████▎   | 74/117 [00:03<00:02, 21.40it/s, loss=1.54, v_num=1, val_acc=0.708]
Epoch 35:  63%|██████▎   | 74/117 [00:03<00:02, 21.24it/s, loss=1.61, v_num=1, val_acc=0.708]
Epoch 35:  64%|██████▍   | 75/117 [00:03<00:01, 21.47it/s, loss=1.61, v_num=1, val_acc=0.708]
Epoch 35:  64%|██████▍   | 75/117 [00:03<00:01, 21.32it/s, loss=1.63, v_num=1, val_acc=0.708]
Epoch 35:  65%|██████▍   | 76/117 [00:03<00:01, 21.55it/s, loss=1.63, v_num=1, val_acc=0.708]
Epoch 35:  65%|██████▍   | 76/117 [00:03<00:01, 21.39it/s, loss=1.68, v_num=1, val_acc=0.708]
Epoch 35:  66%|██████▌   | 77/117 [00:03<00:01, 21.62it/s, loss=1.68, v_num=1, val_acc=0.708]
Epoch 35:  66%|██████▌   | 77/117 [00:03<00:01, 21.47it/s, loss=1.69, v_num=1, val_acc=0.708]
Epoch 35:  67%|██████▋   | 78/117 [00:03<00:01, 21.69it/s, loss=1.69, v_num=1, val_acc=0.708]
Epoch 35:  67%|██████▋   | 78/117 [00:03<00:01, 21.54it/s, loss=1.69, v_num=1, val_acc=0.708]
Epoch 35:  68%|██████▊   | 79/117 [00:03<00:01, 21.76it/s, loss=1.69, v_num=1, val_acc=0.708]
Epoch 35:  68%|██████▊   | 79/117 [00:03<00:01, 21.61it/s, loss=1.68, v_num=1, val_acc=0.708]
Epoch 35:  68%|██████▊   | 80/117 [00:03<00:01, 21.83it/s, loss=1.68, v_num=1, val_acc=0.708]
Epoch 35:  68%|██████▊   | 80/117 [00:03<00:01, 21.68it/s, loss=1.63, v_num=1, val_acc=0.708]
Epoch 35:  69%|██████▉   | 81/117 [00:03<00:01, 21.90it/s, loss=1.63, v_num=1, val_acc=0.708]
Epoch 35:  69%|██████▉   | 81/117 [00:03<00:01, 21.75it/s, loss=1.62, v_num=1, val_acc=0.708]
Epoch 35:  70%|███████   | 82/117 [00:03<00:01, 21.95it/s, loss=1.62, v_num=1, val_acc=0.708]
Epoch 35:  70%|███████   | 82/117 [00:03<00:01, 21.81it/s, loss=1.66, v_num=1, val_acc=0.708]
Epoch 35:  71%|███████   | 83/117 [00:03<00:01, 22.02it/s, loss=1.66, v_num=1, val_acc=0.708]
Epoch 35:  71%|███████   | 83/117 [00:03<00:01, 21.87it/s, loss=1.66, v_num=1, val_acc=0.708]
Epoch 35:  72%|███████▏  | 84/117 [00:03<00:01, 22.09it/s, loss=1.66, v_num=1, val_acc=0.708]
Epoch 35:  72%|███████▏  | 84/117 [00:03<00:01, 21.94it/s, loss=1.67, v_num=1, val_acc=0.708]
Epoch 35:  73%|███████▎  | 85/117 [00:03<00:01, 22.15it/s, loss=1.67, v_num=1, val_acc=0.708]
Epoch 35:  73%|███████▎  | 85/117 [00:03<00:01, 22.00it/s, loss=1.65, v_num=1, val_acc=0.708]
Epoch 35:  74%|███████▎  | 86/117 [00:03<00:01, 22.21it/s, loss=1.65, v_num=1, val_acc=0.708]
Epoch 35:  74%|███████▎  | 86/117 [00:03<00:01, 22.06it/s, loss=1.7, v_num=1, val_acc=0.708]
Epoch 35:  74%|███████▍  | 87/117 [00:03<00:01, 22.27it/s, loss=1.7, v_num=1, val_acc=0.708]
Epoch 35:  74%|███████▍  | 87/117 [00:03<00:01, 22.13it/s, loss=1.72, v_num=1, val_acc=0.708]
Epoch 35:  75%|███████▌  | 88/117 [00:03<00:01, 22.33it/s, loss=1.72, v_num=1, val_acc=0.708]
Epoch 35:  75%|███████▌  | 88/117 [00:03<00:01, 22.19it/s, loss=1.75, v_num=1, val_acc=0.708]
Epoch 35:  76%|███████▌  | 89/117 [00:03<00:01, 22.39it/s, loss=1.75, v_num=1, val_acc=0.708]
Epoch 35:  76%|███████▌  | 89/117 [00:04<00:01, 22.25it/s, loss=1.76, v_num=1, val_acc=0.708]
Epoch 35:  77%|███████▋  | 90/117 [00:04<00:01, 22.45it/s, loss=1.76, v_num=1, val_acc=0.708]
Epoch 35:  77%|███████▋  | 90/117 [00:04<00:01, 22.31it/s, loss=1.83, v_num=1, val_acc=0.708]
Epoch 35:  78%|███████▊  | 91/117 [00:04<00:01, 22.50it/s, loss=1.83, v_num=1, val_acc=0.708]
Epoch 35:  78%|███████▊  | 91/117 [00:04<00:01, 22.36it/s, loss=1.92, v_num=1, val_acc=0.708]
Epoch 35:  79%|███████▊  | 92/117 [00:04<00:01, 22.56it/s, loss=1.92, v_num=1, val_acc=0.708]
Epoch 35:  79%|███████▊  | 92/117 [00:04<00:01, 22.42it/s, loss=1.95, v_num=1, val_acc=0.708]
Epoch 35:  79%|███████▉  | 93/117 [00:04<00:01, 22.62it/s, loss=1.95, v_num=1, val_acc=0.708]
Epoch 35:  79%|███████▉  | 93/117 [00:04<00:01, 22.48it/s, loss=1.95, v_num=1, val_acc=0.708]
Epoch 35:  80%|████████  | 94/117 [00:04<00:01, 22.67it/s, loss=1.95, v_num=1, val_acc=0.708]
Epoch 35:  80%|████████  | 94/117 [00:04<00:01, 22.53it/s, loss=1.9, v_num=1, val_acc=0.708]
Epoch 35:  81%|████████  | 95/117 [00:04<00:00, 22.72it/s, loss=1.9, v_num=1, val_acc=0.708]
Epoch 35:  81%|████████  | 95/117 [00:04<00:00, 22.59it/s, loss=1.93, v_num=1, val_acc=0.708]
Epoch 35:  82%|████████▏ | 96/117 [00:04<00:00, 22.78it/s, loss=1.93, v_num=1, val_acc=0.708]
Epoch 35:  82%|████████▏ | 96/117 [00:04<00:00, 22.64it/s, loss=2, v_num=1, val_acc=0.708]
Epoch 35:  83%|████████▎ | 97/117 [00:04<00:00, 22.83it/s, loss=2, v_num=1, val_acc=0.708]
Epoch 35:  83%|████████▎ | 97/117 [00:04<00:00, 22.69it/s, loss=2.08, v_num=1, val_acc=0.708]

Validation: 0it [00:00, ?it/s]

Validation:   0%|          | 0/20 [00:00<?, ?it/s]

Validation DataLoader 0:   0%|          | 0/20 [00:00<?, ?it/s]

Validation DataLoader 0:   5%|▌         | 1/20 [00:00<00:00, 150.64it/s]
Epoch 35:  84%|████████▍ | 98/117 [00:05<00:00, 19.08it/s, loss=2.08, v_num=1, val_acc=0.708]

Validation DataLoader 0:  10%|█         | 2/20 [00:00<00:00, 53.76it/s]
Epoch 35:  85%|████████▍ | 99/117 [00:05<00:00, 19.16it/s, loss=2.08, v_num=1, val_acc=0.708]

Validation DataLoader 0:  15%|█▌        | 3/20 [00:00<00:00, 43.44it/s]
Epoch 35:  85%|████████▌ | 100/117 [00:05<00:00, 19.24it/s, loss=2.08, v_num=1, val_acc=0.708]

Validation DataLoader 0:  20%|██        | 4/20 [00:00<00:00, 39.68it/s]
Epoch 35:  86%|████████▋ | 101/117 [00:05<00:00, 19.31it/s, loss=2.08, v_num=1, val_acc=0.708]

Validation DataLoader 0:  25%|██▌       | 5/20 [00:00<00:00, 37.47it/s]
Epoch 35:  87%|████████▋ | 102/117 [00:05<00:00, 19.38it/s, loss=2.08, v_num=1, val_acc=0.708]

Validation DataLoader 0:  30%|███       | 6/20 [00:00<00:00, 35.42it/s]
Epoch 35:  88%|████████▊ | 103/117 [00:05<00:00, 19.44it/s, loss=2.08, v_num=1, val_acc=0.708]

Validation DataLoader 0:  35%|███▌      | 7/20 [00:00<00:00, 35.25it/s]
Epoch 35:  89%|████████▉ | 104/117 [00:05<00:00, 19.52it/s, loss=2.08, v_num=1, val_acc=0.708]

Validation DataLoader 0:  40%|████      | 8/20 [00:00<00:00, 34.76it/s]
Epoch 35:  90%|████████▉ | 105/117 [00:05<00:00, 19.59it/s, loss=2.08, v_num=1, val_acc=0.708]

Validation DataLoader 0:  45%|████▌     | 9/20 [00:00<00:00, 34.41it/s]
Epoch 35:  91%|█████████ | 106/117 [00:05<00:00, 19.66it/s, loss=2.08, v_num=1, val_acc=0.708]

Validation DataLoader 0:  50%|█████     | 10/20 [00:00<00:00, 34.12it/s]
Epoch 35:  91%|█████████▏| 107/117 [00:05<00:00, 19.73it/s, loss=2.08, v_num=1, val_acc=0.708]

Validation DataLoader 0:  55%|█████▌    | 11/20 [00:00<00:00, 33.87it/s]
Epoch 35:  92%|█████████▏| 108/117 [00:05<00:00, 19.80it/s, loss=2.08, v_num=1, val_acc=0.708]

Validation DataLoader 0:  60%|██████    | 12/20 [00:00<00:00, 33.69it/s]
Epoch 35:  93%|█████████▎| 109/117 [00:05<00:00, 19.87it/s, loss=2.08, v_num=1, val_acc=0.708]

Validation DataLoader 0:  65%|██████▌   | 13/20 [00:00<00:00, 33.50it/s]
Epoch 35:  94%|█████████▍| 110/117 [00:05<00:00, 19.94it/s, loss=2.08, v_num=1, val_acc=0.708]

Validation DataLoader 0:  70%|███████   | 14/20 [00:00<00:00, 33.35it/s]
Epoch 35:  95%|█████████▍| 111/117 [00:05<00:00, 20.01it/s, loss=2.08, v_num=1, val_acc=0.708]

Validation DataLoader 0:  75%|███████▌  | 15/20 [00:00<00:00, 33.23it/s]
Epoch 35:  96%|█████████▌| 112/117 [00:05<00:00, 20.07it/s, loss=2.08, v_num=1, val_acc=0.708]

Validation DataLoader 0:  80%|████████  | 16/20 [00:00<00:00, 33.13it/s]
Epoch 35:  97%|█████████▋| 113/117 [00:05<00:00, 20.14it/s, loss=2.08, v_num=1, val_acc=0.708]

Validation DataLoader 0:  85%|████████▌ | 17/20 [00:00<00:00, 33.03it/s]
Epoch 35:  97%|█████████▋| 114/117 [00:05<00:00, 20.20it/s, loss=2.08, v_num=1, val_acc=0.708]

Validation DataLoader 0:  90%|█████████ | 18/20 [00:00<00:00, 32.96it/s]
Epoch 35:  98%|█████████▊| 115/117 [00:05<00:00, 20.26it/s, loss=2.08, v_num=1, val_acc=0.708]

Validation DataLoader 0:  95%|█████████▌| 19/20 [00:00<00:00, 32.88it/s]
Epoch 35:  99%|█████████▉| 116/117 [00:05<00:00, 20.33it/s, loss=2.08, v_num=1, val_acc=0.708]

Validation DataLoader 0: 100%|██████████| 20/20 [00:00<00:00, 32.88it/s]
Epoch 35: 100%|██████████| 117/117 [00:05<00:00, 20.39it/s, loss=2.08, v_num=1, val_acc=0.708]
Epoch 35: 100%|██████████| 117/117 [00:05<00:00, 20.32it/s, loss=2.08, v_num=1, val_acc=0.687]


Epoch 35: 100%|██████████| 117/117 [00:05<00:00, 20.32it/s, loss=2.08, v_num=1, val_acc=0.687]
Epoch 35:   0%|          | 0/117 [00:00<?, ?it/s, loss=2.08, v_num=1, val_acc=0.687]
Epoch 36:   0%|          | 0/117 [00:00<?, ?it/s, loss=2.08, v_num=1, val_acc=0.687]
Epoch 36:   1%|          | 1/117 [00:00<01:45,  1.09it/s, loss=2.08, v_num=1, val_acc=0.687]
Epoch 36:   1%|          | 1/117 [00:00<01:48,  1.07it/s, loss=2.1, v_num=1, val_acc=0.687]
Epoch 36:   2%|▏         | 2/117 [00:00<00:54,  2.11it/s, loss=2.1, v_num=1, val_acc=0.687]
Epoch 36:   2%|▏         | 2/117 [00:00<00:55,  2.06it/s, loss=2.13, v_num=1, val_acc=0.687]
Epoch 36:   3%|▎         | 3/117 [00:00<00:37,  3.06it/s, loss=2.13, v_num=1, val_acc=0.687]
Epoch 36:   3%|▎         | 3/117 [00:01<00:38,  2.98it/s, loss=2.12, v_num=1, val_acc=0.687]
Epoch 36:   3%|▎         | 4/117 [00:01<00:28,  3.94it/s, loss=2.12, v_num=1, val_acc=0.687]
Epoch 36:   3%|▎         | 4/117 [00:01<00:29,  3.84it/s, loss=2.12, v_num=1, val_acc=0.687]
Epoch 36:   4%|▍         | 5/117 [00:01<00:23,  4.77it/s, loss=2.12, v_num=1, val_acc=0.687]
Epoch 36:   4%|▍         | 5/117 [00:01<00:24,  4.65it/s, loss=2.07, v_num=1, val_acc=0.687]
Epoch 36:   5%|▌         | 6/117 [00:01<00:20,  5.53it/s, loss=2.07, v_num=1, val_acc=0.687]
Epoch 36:   5%|▌         | 6/117 [00:01<00:20,  5.41it/s, loss=2.1, v_num=1, val_acc=0.687]
Epoch 36:   6%|▌         | 7/117 [00:01<00:17,  6.26it/s, loss=2.1, v_num=1, val_acc=0.687]
Epoch 36:   6%|▌         | 7/117 [00:01<00:17,  6.12it/s, loss=2.12, v_num=1, val_acc=0.687]
Epoch 36:   7%|▋         | 8/117 [00:01<00:15,  6.94it/s, loss=2.12, v_num=1, val_acc=0.687]
Epoch 36:   7%|▋         | 8/117 [00:01<00:16,  6.79it/s, loss=2.14, v_num=1, val_acc=0.687]
Epoch 36:   8%|▊         | 9/117 [00:01<00:14,  7.57it/s, loss=2.14, v_num=1, val_acc=0.687]
Epoch 36:   8%|▊         | 9/117 [00:01<00:14,  7.42it/s, loss=2.11, v_num=1, val_acc=0.687]
Epoch 36:   9%|▊         | 10/117 [00:01<00:13,  8.16it/s, loss=2.11, v_num=1, val_acc=0.687]
Epoch 36:   9%|▊         | 10/117 [00:01<00:13,  8.00it/s, loss=2.09, v_num=1, val_acc=0.687]
Epoch 36:   9%|▉         | 11/117 [00:01<00:12,  8.73it/s, loss=2.09, v_num=1, val_acc=0.687]
Epoch 36:   9%|▉         | 11/117 [00:01<00:12,  8.56it/s, loss=2.07, v_num=1, val_acc=0.687]
Epoch 36:  10%|█         | 12/117 [00:01<00:11,  9.27it/s, loss=2.07, v_num=1, val_acc=0.687]
Epoch 36:  10%|█         | 12/117 [00:01<00:11,  9.09it/s, loss=2.01, v_num=1, val_acc=0.687]
Epoch 36:  11%|█         | 13/117 [00:01<00:10,  9.79it/s, loss=2.01, v_num=1, val_acc=0.687]
Epoch 36:  11%|█         | 13/117 [00:01<00:10,  9.61it/s, loss=1.99, v_num=1, val_acc=0.687]
Epoch 36:  12%|█▏        | 14/117 [00:01<00:10, 10.28it/s, loss=1.99, v_num=1, val_acc=0.687]
Epoch 36:  12%|█▏        | 14/117 [00:01<00:10, 10.09it/s, loss=1.97, v_num=1, val_acc=0.687]
Epoch 36:  13%|█▎        | 15/117 [00:01<00:09, 10.75it/s, loss=1.97, v_num=1, val_acc=0.687]
Epoch 36:  13%|█▎        | 15/117 [00:01<00:09, 10.55it/s, loss=1.97, v_num=1, val_acc=0.687]
Epoch 36:  14%|█▎        | 16/117 [00:01<00:09, 11.18it/s, loss=1.97, v_num=1, val_acc=0.687]
Epoch 36:  14%|█▎        | 16/117 [00:01<00:09, 10.99it/s, loss=1.98, v_num=1, val_acc=0.687]
Epoch 36:  15%|█▍        | 17/117 [00:01<00:08, 11.61it/s, loss=1.98, v_num=1, val_acc=0.687]
Epoch 36:  15%|█▍        | 17/117 [00:01<00:08, 11.41it/s, loss=1.97, v_num=1, val_acc=0.687]
Epoch 36:  15%|█▌        | 18/117 [00:01<00:08, 12.01it/s, loss=1.97, v_num=1, val_acc=0.687]
Epoch 36:  15%|█▌        | 18/117 [00:01<00:08, 11.81it/s, loss=1.94, v_num=1, val_acc=0.687]
Epoch 36:  16%|█▌        | 19/117 [00:01<00:07, 12.39it/s, loss=1.94, v_num=1, val_acc=0.687]
Epoch 36:  16%|█▌        | 19/117 [00:01<00:08, 12.19it/s, loss=1.83, v_num=1, val_acc=0.687]
Epoch 36:  17%|█▋        | 20/117 [00:01<00:07, 12.76it/s, loss=1.83, v_num=1, val_acc=0.687]
Epoch 36:  17%|█▋        | 20/117 [00:01<00:07, 12.55it/s, loss=1.73, v_num=1, val_acc=0.687]
Epoch 36:  18%|█▊        | 21/117 [00:01<00:07, 13.11it/s, loss=1.73, v_num=1, val_acc=0.687]
Epoch 36:  18%|█▊        | 21/117 [00:01<00:07, 12.91it/s, loss=1.7, v_num=1, val_acc=0.687]
Epoch 36:  19%|█▉        | 22/117 [00:01<00:07, 13.45it/s, loss=1.7, v_num=1, val_acc=0.687]
Epoch 36:  19%|█▉        | 22/117 [00:01<00:07, 13.24it/s, loss=1.66, v_num=1, val_acc=0.687]
Epoch 36:  20%|█▉        | 23/117 [00:01<00:06, 13.77it/s, loss=1.66, v_num=1, val_acc=0.687]
Epoch 36:  20%|█▉        | 23/117 [00:01<00:06, 13.56it/s, loss=1.64, v_num=1, val_acc=0.687]
Epoch 36:  21%|██        | 24/117 [00:01<00:06, 14.08it/s, loss=1.64, v_num=1, val_acc=0.687]
Epoch 36:  21%|██        | 24/117 [00:01<00:06, 13.87it/s, loss=1.63, v_num=1, val_acc=0.687]
Epoch 36:  21%|██▏       | 25/117 [00:01<00:06, 14.37it/s, loss=1.63, v_num=1, val_acc=0.687]
Epoch 36:  21%|██▏       | 25/117 [00:01<00:06, 14.17it/s, loss=1.6, v_num=1, val_acc=0.687]
Epoch 36:  22%|██▏       | 26/117 [00:01<00:06, 14.66it/s, loss=1.6, v_num=1, val_acc=0.687]
Epoch 36:  22%|██▏       | 26/117 [00:01<00:06, 14.45it/s, loss=1.55, v_num=1, val_acc=0.687]
Epoch 36:  23%|██▎       | 27/117 [00:01<00:06, 14.93it/s, loss=1.55, v_num=1, val_acc=0.687]
Epoch 36:  23%|██▎       | 27/117 [00:01<00:06, 14.73it/s, loss=1.55, v_num=1, val_acc=0.687]
Epoch 36:  24%|██▍       | 28/117 [00:01<00:05, 15.20it/s, loss=1.55, v_num=1, val_acc=0.687]
Epoch 36:  24%|██▍       | 28/117 [00:01<00:05, 14.99it/s, loss=1.6, v_num=1, val_acc=0.687]
Epoch 36:  25%|██▍       | 29/117 [00:01<00:05, 15.45it/s, loss=1.6, v_num=1, val_acc=0.687]
Epoch 36:  25%|██▍       | 29/117 [00:01<00:05, 15.25it/s, loss=1.62, v_num=1, val_acc=0.687]
Epoch 36:  26%|██▌       | 30/117 [00:01<00:05, 15.70it/s, loss=1.62, v_num=1, val_acc=0.687]
Epoch 36:  26%|██▌       | 30/117 [00:01<00:05, 15.49it/s, loss=1.61, v_num=1, val_acc=0.687]
Epoch 36:  26%|██▋       | 31/117 [00:01<00:05, 15.94it/s, loss=1.61, v_num=1, val_acc=0.687]
Epoch 36:  26%|██▋       | 31/117 [00:01<00:05, 15.73it/s, loss=1.59, v_num=1, val_acc=0.687]
Epoch 36:  27%|██▋       | 32/117 [00:01<00:05, 16.17it/s, loss=1.59, v_num=1, val_acc=0.687]
Epoch 36:  27%|██▋       | 32/117 [00:02<00:05, 15.96it/s, loss=1.59, v_num=1, val_acc=0.687]
Epoch 36:  28%|██▊       | 33/117 [00:02<00:05, 16.38it/s, loss=1.59, v_num=1, val_acc=0.687]
Epoch 36:  28%|██▊       | 33/117 [00:02<00:05, 16.18it/s, loss=1.6, v_num=1, val_acc=0.687]
Epoch 36:  29%|██▉       | 34/117 [00:02<00:05, 16.59it/s, loss=1.6, v_num=1, val_acc=0.687]
Epoch 36:  29%|██▉       | 34/117 [00:02<00:05, 16.39it/s, loss=1.56, v_num=1, val_acc=0.687]
Epoch 36:  30%|██▉       | 35/117 [00:02<00:04, 16.80it/s, loss=1.56, v_num=1, val_acc=0.687]
Epoch 36:  30%|██▉       | 35/117 [00:02<00:04, 16.60it/s, loss=1.5, v_num=1, val_acc=0.687]
Epoch 36:  31%|███       | 36/117 [00:02<00:04, 17.00it/s, loss=1.5, v_num=1, val_acc=0.687]
Epoch 36:  31%|███       | 36/117 [00:02<00:04, 16.80it/s, loss=1.46, v_num=1, val_acc=0.687]
Epoch 36:  32%|███▏      | 37/117 [00:02<00:04, 17.19it/s, loss=1.46, v_num=1, val_acc=0.687]
Epoch 36:  32%|███▏      | 37/117 [00:02<00:04, 16.99it/s, loss=1.46, v_num=1, val_acc=0.687]
Epoch 36:  32%|███▏      | 38/117 [00:02<00:04, 17.38it/s, loss=1.46, v_num=1, val_acc=0.687]
Epoch 36:  32%|███▏      | 38/117 [00:02<00:04, 17.18it/s, loss=1.47, v_num=1, val_acc=0.687]
Epoch 36:  33%|███▎      | 39/117 [00:02<00:04, 17.56it/s, loss=1.47, v_num=1, val_acc=0.687]
Epoch 36:  33%|███▎      | 39/117 [00:02<00:04, 17.36it/s, loss=1.53, v_num=1, val_acc=0.687]
Epoch 36:  34%|███▍      | 40/117 [00:02<00:04, 17.73it/s, loss=1.53, v_num=1, val_acc=0.687]
Epoch 36:  34%|███▍      | 40/117 [00:02<00:04, 17.54it/s, loss=1.56, v_num=1, val_acc=0.687]
Epoch 36:  35%|███▌      | 41/117 [00:02<00:04, 17.90it/s, loss=1.56, v_num=1, val_acc=0.687]
Epoch 36:  35%|███▌      | 41/117 [00:02<00:04, 17.71it/s, loss=1.62, v_num=1, val_acc=0.687]
Epoch 36:  36%|███▌      | 42/117 [00:02<00:04, 18.07it/s, loss=1.62, v_num=1, val_acc=0.687]
Epoch 36:  36%|███▌      | 42/117 [00:02<00:04, 17.87it/s, loss=1.66, v_num=1, val_acc=0.687]
Epoch 36:  37%|███▋      | 43/117 [00:02<00:04, 18.23it/s, loss=1.66, v_num=1, val_acc=0.687]
Epoch 36:  37%|███▋      | 43/117 [00:02<00:04, 18.04it/s, loss=1.69, v_num=1, val_acc=0.687]
Epoch 36:  38%|███▊      | 44/117 [00:02<00:03, 18.39it/s, loss=1.69, v_num=1, val_acc=0.687]
Epoch 36:  38%|███▊      | 44/117 [00:02<00:04, 18.19it/s, loss=1.72, v_num=1, val_acc=0.687]
Epoch 36:  38%|███▊      | 45/117 [00:02<00:03, 18.54it/s, loss=1.72, v_num=1, val_acc=0.687]
Epoch 36:  38%|███▊      | 45/117 [00:02<00:03, 18.35it/s, loss=1.76, v_num=1, val_acc=0.687]
Epoch 36:  39%|███▉      | 46/117 [00:02<00:03, 18.69it/s, loss=1.76, v_num=1, val_acc=0.687]
Epoch 36:  39%|███▉      | 46/117 [00:02<00:03, 18.49it/s, loss=1.79, v_num=1, val_acc=0.687]
Epoch 36:  40%|████      | 47/117 [00:02<00:03, 18.83it/s, loss=1.79, v_num=1, val_acc=0.687]
Epoch 36:  40%|████      | 47/117 [00:02<00:03, 18.64it/s, loss=1.79, v_num=1, val_acc=0.687]
Epoch 36:  41%|████      | 48/117 [00:02<00:03, 18.96it/s, loss=1.79, v_num=1, val_acc=0.687]
Epoch 36:  41%|████      | 48/117 [00:02<00:03, 18.78it/s, loss=1.78, v_num=1, val_acc=0.687]
Epoch 36:  42%|████▏     | 49/117 [00:02<00:03, 19.09it/s, loss=1.78, v_num=1, val_acc=0.687]
Epoch 36:  42%|████▏     | 49/117 [00:02<00:03, 18.91it/s, loss=1.77, v_num=1, val_acc=0.687]
Epoch 36:  43%|████▎     | 50/117 [00:02<00:03, 19.23it/s, loss=1.77, v_num=1, val_acc=0.687]
Epoch 36:  43%|████▎     | 50/117 [00:02<00:03, 19.04it/s, loss=1.87, v_num=1, val_acc=0.687]
Epoch 36:  44%|████▎     | 51/117 [00:02<00:03, 19.35it/s, loss=1.87, v_num=1, val_acc=0.687]
Epoch 36:  44%|████▎     | 51/117 [00:02<00:03, 19.17it/s, loss=1.92, v_num=1, val_acc=0.687]
Epoch 36:  44%|████▍     | 52/117 [00:02<00:03, 19.48it/s, loss=1.92, v_num=1, val_acc=0.687]
Epoch 36:  44%|████▍     | 52/117 [00:02<00:03, 19.30it/s, loss=1.97, v_num=1, val_acc=0.687]
Epoch 36:  45%|████▌     | 53/117 [00:02<00:03, 19.60it/s, loss=1.97, v_num=1, val_acc=0.687]
Epoch 36:  45%|████▌     | 53/117 [00:02<00:03, 19.42it/s, loss=1.98, v_num=1, val_acc=0.687]
Epoch 36:  46%|████▌     | 54/117 [00:02<00:03, 19.72it/s, loss=1.98, v_num=1, val_acc=0.687]
Epoch 36:  46%|████▌     | 54/117 [00:02<00:03, 19.54it/s, loss=2.02, v_num=1, val_acc=0.687]
Epoch 36:  47%|████▋     | 55/117 [00:02<00:03, 19.84it/s, loss=2.02, v_num=1, val_acc=0.687]
Epoch 36:  47%|████▋     | 55/117 [00:02<00:03, 19.66it/s, loss=2.15, v_num=1, val_acc=0.687]
Epoch 36:  48%|████▊     | 56/117 [00:02<00:03, 19.95it/s, loss=2.15, v_num=1, val_acc=0.687]
Epoch 36:  48%|████▊     | 56/117 [00:02<00:03, 19.77it/s, loss=2.18, v_num=1, val_acc=0.687]
Epoch 36:  49%|████▊     | 57/117 [00:02<00:02, 20.06it/s, loss=2.18, v_num=1, val_acc=0.687]
Epoch 36:  49%|████▊     | 57/117 [00:02<00:03, 19.88it/s, loss=2.21, v_num=1, val_acc=0.687]
Epoch 36:  50%|████▉     | 58/117 [00:02<00:02, 20.17it/s, loss=2.21, v_num=1, val_acc=0.687]
Epoch 36:  50%|████▉     | 58/117 [00:02<00:02, 19.99it/s, loss=2.19, v_num=1, val_acc=0.687]
Epoch 36:  50%|█████     | 59/117 [00:02<00:02, 20.27it/s, loss=2.19, v_num=1, val_acc=0.687]
Epoch 36:  50%|█████     | 59/117 [00:02<00:02, 20.09it/s, loss=2.16, v_num=1, val_acc=0.687]
Epoch 36:  51%|█████▏    | 60/117 [00:02<00:02, 20.37it/s, loss=2.16, v_num=1, val_acc=0.687]
Epoch 36:  51%|█████▏    | 60/117 [00:02<00:02, 20.20it/s, loss=2.15, v_num=1, val_acc=0.687]
Epoch 36:  52%|█████▏    | 61/117 [00:02<00:02, 20.47it/s, loss=2.15, v_num=1, val_acc=0.687]
Epoch 36:  52%|█████▏    | 61/117 [00:03<00:02, 20.30it/s, loss=2.11, v_num=1, val_acc=0.687]
Epoch 36:  53%|█████▎    | 62/117 [00:03<00:02, 20.57it/s, loss=2.11, v_num=1, val_acc=0.687]
Epoch 36:  53%|█████▎    | 62/117 [00:03<00:02, 20.40it/s, loss=2.09, v_num=1, val_acc=0.687]
Epoch 36:  54%|█████▍    | 63/117 [00:03<00:02, 20.67it/s, loss=2.09, v_num=1, val_acc=0.687]
Epoch 36:  54%|█████▍    | 63/117 [00:03<00:02, 20.50it/s, loss=2.07, v_num=1, val_acc=0.687]
Epoch 36:  55%|█████▍    | 64/117 [00:03<00:02, 20.76it/s, loss=2.07, v_num=1, val_acc=0.687]
Epoch 36:  55%|█████▍    | 64/117 [00:03<00:02, 20.59it/s, loss=2.05, v_num=1, val_acc=0.687]
Epoch 36:  56%|█████▌    | 65/117 [00:03<00:02, 20.85it/s, loss=2.05, v_num=1, val_acc=0.687]
Epoch 36:  56%|█████▌    | 65/117 [00:03<00:02, 20.68it/s, loss=2.01, v_num=1, val_acc=0.687]
Epoch 36:  56%|█████▋    | 66/117 [00:03<00:02, 20.94it/s, loss=2.01, v_num=1, val_acc=0.687]
Epoch 36:  56%|█████▋    | 66/117 [00:03<00:02, 20.77it/s, loss=1.98, v_num=1, val_acc=0.687]
Epoch 36:  57%|█████▋    | 67/117 [00:03<00:02, 21.03it/s, loss=1.98, v_num=1, val_acc=0.687]
Epoch 36:  57%|█████▋    | 67/117 [00:03<00:02, 20.86it/s, loss=1.96, v_num=1, val_acc=0.687]
Epoch 36:  58%|█████▊    | 68/117 [00:03<00:02, 21.12it/s, loss=1.96, v_num=1, val_acc=0.687]
Epoch 36:  58%|█████▊    | 68/117 [00:03<00:02, 20.95it/s, loss=1.9, v_num=1, val_acc=0.687]
Epoch 36:  59%|█████▉    | 69/117 [00:03<00:02, 21.20it/s, loss=1.9, v_num=1, val_acc=0.687]
Epoch 36:  59%|█████▉    | 69/117 [00:03<00:02, 21.04it/s, loss=1.93, v_num=1, val_acc=0.687]
Epoch 36:  60%|█████▉    | 70/117 [00:03<00:02, 21.28it/s, loss=1.93, v_num=1, val_acc=0.687]
Epoch 36:  60%|█████▉    | 70/117 [00:03<00:02, 21.12it/s, loss=1.89, v_num=1, val_acc=0.687]
Epoch 36:  61%|██████    | 71/117 [00:03<00:02, 21.36it/s, loss=1.89, v_num=1, val_acc=0.687]
Epoch 36:  61%|██████    | 71/117 [00:03<00:02, 21.20it/s, loss=1.83, v_num=1, val_acc=0.687]
Epoch 36:  62%|██████▏   | 72/117 [00:03<00:02, 21.44it/s, loss=1.83, v_num=1, val_acc=0.687]
Epoch 36:  62%|██████▏   | 72/117 [00:03<00:02, 21.28it/s, loss=1.77, v_num=1, val_acc=0.687]
Epoch 36:  62%|██████▏   | 73/117 [00:03<00:02, 21.52it/s, loss=1.77, v_num=1, val_acc=0.687]
Epoch 36:  62%|██████▏   | 73/117 [00:03<00:02, 21.36it/s, loss=1.75, v_num=1, val_acc=0.687]
Epoch 36:  63%|██████▎   | 74/117 [00:03<00:01, 21.59it/s, loss=1.75, v_num=1, val_acc=0.687]
Epoch 36:  63%|██████▎   | 74/117 [00:03<00:02, 21.44it/s, loss=1.74, v_num=1, val_acc=0.687]
Epoch 36:  64%|██████▍   | 75/117 [00:03<00:01, 21.67it/s, loss=1.74, v_num=1, val_acc=0.687]
Epoch 36:  64%|██████▍   | 75/117 [00:03<00:01, 21.51it/s, loss=1.66, v_num=1, val_acc=0.687]
Epoch 36:  65%|██████▍   | 76/117 [00:03<00:01, 21.74it/s, loss=1.66, v_num=1, val_acc=0.687]
Epoch 36:  65%|██████▍   | 76/117 [00:03<00:01, 21.59it/s, loss=1.62, v_num=1, val_acc=0.687]
Epoch 36:  66%|██████▌   | 77/117 [00:03<00:01, 21.81it/s, loss=1.62, v_num=1, val_acc=0.687]
Epoch 36:  66%|██████▌   | 77/117 [00:03<00:01, 21.66it/s, loss=1.57, v_num=1, val_acc=0.687]
Epoch 36:  67%|██████▋   | 78/117 [00:03<00:01, 21.88it/s, loss=1.57, v_num=1, val_acc=0.687]
Epoch 36:  67%|██████▋   | 78/117 [00:03<00:01, 21.73it/s, loss=1.56, v_num=1, val_acc=0.687]
Epoch 36:  68%|██████▊   | 79/117 [00:03<00:01, 21.95it/s, loss=1.56, v_num=1, val_acc=0.687]
Epoch 36:  68%|██████▊   | 79/117 [00:03<00:01, 21.80it/s, loss=1.56, v_num=1, val_acc=0.687]
Epoch 36:  68%|██████▊   | 80/117 [00:03<00:01, 22.02it/s, loss=1.56, v_num=1, val_acc=0.687]
Epoch 36:  68%|██████▊   | 80/117 [00:03<00:01, 21.87it/s, loss=1.56, v_num=1, val_acc=0.687]
Epoch 36:  69%|██████▉   | 81/117 [00:03<00:01, 22.08it/s, loss=1.56, v_num=1, val_acc=0.687]
Epoch 36:  69%|██████▉   | 81/117 [00:03<00:01, 21.93it/s, loss=1.56, v_num=1, val_acc=0.687]
Epoch 36:  70%|███████   | 82/117 [00:03<00:01, 22.14it/s, loss=1.56, v_num=1, val_acc=0.687]
Epoch 36:  70%|███████   | 82/117 [00:03<00:01, 21.99it/s, loss=1.56, v_num=1, val_acc=0.687]
Epoch 36:  71%|███████   | 83/117 [00:03<00:01, 22.20it/s, loss=1.56, v_num=1, val_acc=0.687]
Epoch 36:  71%|███████   | 83/117 [00:03<00:01, 22.05it/s, loss=1.59, v_num=1, val_acc=0.687]
Epoch 36:  72%|███████▏  | 84/117 [00:03<00:01, 22.27it/s, loss=1.59, v_num=1, val_acc=0.687]
Epoch 36:  72%|███████▏  | 84/117 [00:03<00:01, 22.12it/s, loss=1.6, v_num=1, val_acc=0.687]
Epoch 36:  73%|███████▎  | 85/117 [00:03<00:01, 22.33it/s, loss=1.6, v_num=1, val_acc=0.687]
Epoch 36:  73%|███████▎  | 85/117 [00:03<00:01, 22.18it/s, loss=1.63, v_num=1, val_acc=0.687]
Epoch 36:  74%|███████▎  | 86/117 [00:03<00:01, 22.39it/s, loss=1.63, v_num=1, val_acc=0.687]
Epoch 36:  74%|███████▎  | 86/117 [00:03<00:01, 22.24it/s, loss=1.65, v_num=1, val_acc=0.687]
Epoch 36:  74%|███████▍  | 87/117 [00:03<00:01, 22.43it/s, loss=1.65, v_num=1, val_acc=0.687]
Epoch 36:  74%|███████▍  | 87/117 [00:03<00:01, 22.28it/s, loss=1.66, v_num=1, val_acc=0.687]
Epoch 36:  75%|███████▌  | 88/117 [00:03<00:01, 22.49it/s, loss=1.66, v_num=1, val_acc=0.687]
Epoch 36:  75%|███████▌  | 88/117 [00:03<00:01, 22.34it/s, loss=1.66, v_num=1, val_acc=0.687]
Epoch 36:  76%|███████▌  | 89/117 [00:03<00:01, 22.54it/s, loss=1.66, v_num=1, val_acc=0.687]
Epoch 36:  76%|███████▌  | 89/117 [00:03<00:01, 22.40it/s, loss=1.64, v_num=1, val_acc=0.687]
Epoch 36:  77%|███████▋  | 90/117 [00:03<00:01, 22.60it/s, loss=1.64, v_num=1, val_acc=0.687]
Epoch 36:  77%|███████▋  | 90/117 [00:04<00:01, 22.46it/s, loss=1.58, v_num=1, val_acc=0.687]
Epoch 36:  78%|███████▊  | 91/117 [00:04<00:01, 22.66it/s, loss=1.58, v_num=1, val_acc=0.687]
Epoch 36:  78%|███████▊  | 91/117 [00:04<00:01, 22.52it/s, loss=1.58, v_num=1, val_acc=0.687]
Epoch 36:  79%|███████▊  | 92/117 [00:04<00:01, 22.71it/s, loss=1.58, v_num=1, val_acc=0.687]
Epoch 36:  79%|███████▊  | 92/117 [00:04<00:01, 22.57it/s, loss=1.58, v_num=1, val_acc=0.687]
Epoch 36:  79%|███████▉  | 93/117 [00:04<00:01, 22.77it/s, loss=1.58, v_num=1, val_acc=0.687]
Epoch 36:  79%|███████▉  | 93/117 [00:04<00:01, 22.63it/s, loss=1.54, v_num=1, val_acc=0.687]
Epoch 36:  80%|████████  | 94/117 [00:04<00:01, 22.82it/s, loss=1.54, v_num=1, val_acc=0.687]
Epoch 36:  80%|████████  | 94/117 [00:04<00:01, 22.68it/s, loss=1.53, v_num=1, val_acc=0.687]
Epoch 36:  81%|████████  | 95/117 [00:04<00:00, 22.87it/s, loss=1.53, v_num=1, val_acc=0.687]
Epoch 36:  81%|████████  | 95/117 [00:04<00:00, 22.73it/s, loss=1.54, v_num=1, val_acc=0.687]
Epoch 36:  82%|████████▏ | 96/117 [00:04<00:00, 22.92it/s, loss=1.54, v_num=1, val_acc=0.687]
Epoch 36:  82%|████████▏ | 96/117 [00:04<00:00, 22.78it/s, loss=1.57, v_num=1, val_acc=0.687]
Epoch 36:  83%|████████▎ | 97/117 [00:04<00:00, 22.97it/s, loss=1.57, v_num=1, val_acc=0.687]
Epoch 36:  83%|████████▎ | 97/117 [00:04<00:00, 22.83it/s, loss=1.57, v_num=1, val_acc=0.687]

Validation: 0it [00:00, ?it/s]

Validation:   0%|          | 0/20 [00:00<?, ?it/s]

Validation DataLoader 0:   0%|          | 0/20 [00:00<?, ?it/s]

Validation DataLoader 0:   5%|▌         | 1/20 [00:00<00:00, 153.81it/s]
Epoch 36:  84%|████████▍ | 98/117 [00:05<00:00, 19.05it/s, loss=1.57, v_num=1, val_acc=0.687]

Validation DataLoader 0:  10%|█         | 2/20 [00:00<00:00, 54.36it/s]
Epoch 36:  85%|████████▍ | 99/117 [00:05<00:00, 19.14it/s, loss=1.57, v_num=1, val_acc=0.687]

Validation DataLoader 0:  15%|█▌        | 3/20 [00:00<00:00, 43.87it/s]
Epoch 36:  85%|████████▌ | 100/117 [00:05<00:00, 19.21it/s, loss=1.57, v_num=1, val_acc=0.687]

Validation DataLoader 0:  20%|██        | 4/20 [00:00<00:00, 39.99it/s]
Epoch 36:  86%|████████▋ | 101/117 [00:05<00:00, 19.29it/s, loss=1.57, v_num=1, val_acc=0.687]

Validation DataLoader 0:  25%|██▌       | 5/20 [00:00<00:00, 37.95it/s]
Epoch 36:  87%|████████▋ | 102/117 [00:05<00:00, 19.36it/s, loss=1.57, v_num=1, val_acc=0.687]

Validation DataLoader 0:  30%|███       | 6/20 [00:00<00:00, 36.73it/s]
Epoch 36:  88%|████████▊ | 103/117 [00:05<00:00, 19.43it/s, loss=1.57, v_num=1, val_acc=0.687]

Validation DataLoader 0:  35%|███▌      | 7/20 [00:00<00:00, 35.62it/s]
Epoch 36:  89%|████████▉ | 104/117 [00:05<00:00, 19.50it/s, loss=1.57, v_num=1, val_acc=0.687]

Validation DataLoader 0:  40%|████      | 8/20 [00:00<00:00, 35.25it/s]
Epoch 36:  90%|████████▉ | 105/117 [00:05<00:00, 19.58it/s, loss=1.57, v_num=1, val_acc=0.687]

Validation DataLoader 0:  45%|████▌     | 9/20 [00:00<00:00, 34.79it/s]
Epoch 36:  91%|█████████ | 106/117 [00:05<00:00, 19.65it/s, loss=1.57, v_num=1, val_acc=0.687]

Validation DataLoader 0:  50%|█████     | 10/20 [00:00<00:00, 34.48it/s]
Epoch 36:  91%|█████████▏| 107/117 [00:05<00:00, 19.72it/s, loss=1.57, v_num=1, val_acc=0.687]

Validation DataLoader 0:  55%|█████▌    | 11/20 [00:00<00:00, 34.20it/s]
Epoch 36:  92%|█████████▏| 108/117 [00:05<00:00, 19.79it/s, loss=1.57, v_num=1, val_acc=0.687]

Validation DataLoader 0:  60%|██████    | 12/20 [00:00<00:00, 33.98it/s]
Epoch 36:  93%|█████████▎| 109/117 [00:05<00:00, 19.85it/s, loss=1.57, v_num=1, val_acc=0.687]

Validation DataLoader 0:  65%|██████▌   | 13/20 [00:00<00:00, 33.79it/s]
Epoch 36:  94%|█████████▍| 110/117 [00:05<00:00, 19.92it/s, loss=1.57, v_num=1, val_acc=0.687]

Validation DataLoader 0:  70%|███████   | 14/20 [00:00<00:00, 33.63it/s]
Epoch 36:  95%|█████████▍| 111/117 [00:05<00:00, 19.99it/s, loss=1.57, v_num=1, val_acc=0.687]

Validation DataLoader 0:  75%|███████▌  | 15/20 [00:00<00:00, 33.48it/s]
Epoch 36:  96%|█████████▌| 112/117 [00:05<00:00, 20.05it/s, loss=1.57, v_num=1, val_acc=0.687]

Validation DataLoader 0:  80%|████████  | 16/20 [00:00<00:00, 33.37it/s]
Epoch 36:  97%|█████████▋| 113/117 [00:05<00:00, 20.12it/s, loss=1.57, v_num=1, val_acc=0.687]

Validation DataLoader 0:  85%|████████▌ | 17/20 [00:00<00:00, 33.25it/s]
Epoch 36:  97%|█████████▋| 114/117 [00:05<00:00, 20.18it/s, loss=1.57, v_num=1, val_acc=0.687]

Validation DataLoader 0:  90%|█████████ | 18/20 [00:00<00:00, 33.16it/s]
Epoch 36:  98%|█████████▊| 115/117 [00:05<00:00, 20.25it/s, loss=1.57, v_num=1, val_acc=0.687]

Validation DataLoader 0:  95%|█████████▌| 19/20 [00:00<00:00, 33.08it/s]
Epoch 36:  99%|█████████▉| 116/117 [00:05<00:00, 20.31it/s, loss=1.57, v_num=1, val_acc=0.687]

Validation DataLoader 0: 100%|██████████| 20/20 [00:00<00:00, 33.07it/s]
Epoch 36: 100%|██████████| 117/117 [00:05<00:00, 20.38it/s, loss=1.57, v_num=1, val_acc=0.687]
Epoch 36: 100%|██████████| 117/117 [00:05<00:00, 20.31it/s, loss=1.57, v_num=1, val_acc=0.706]


Epoch 36: 100%|██████████| 117/117 [00:05<00:00, 20.30it/s, loss=1.57, v_num=1, val_acc=0.706]
Epoch 36:   0%|          | 0/117 [00:00<?, ?it/s, loss=1.57, v_num=1, val_acc=0.706]
Epoch 37:   0%|          | 0/117 [00:00<?, ?it/s, loss=1.57, v_num=1, val_acc=0.706]
Epoch 37:   1%|          | 1/117 [00:00<01:45,  1.09it/s, loss=1.57, v_num=1, val_acc=0.706]
Epoch 37:   1%|          | 1/117 [00:00<01:48,  1.07it/s, loss=1.57, v_num=1, val_acc=0.706]
Epoch 37:   2%|▏         | 2/117 [00:00<00:54,  2.11it/s, loss=1.57, v_num=1, val_acc=0.706]
Epoch 37:   2%|▏         | 2/117 [00:00<00:55,  2.06it/s, loss=1.62, v_num=1, val_acc=0.706]
Epoch 37:   3%|▎         | 3/117 [00:00<00:37,  3.06it/s, loss=1.62, v_num=1, val_acc=0.706]
Epoch 37:   3%|▎         | 3/117 [00:01<00:38,  2.98it/s, loss=1.66, v_num=1, val_acc=0.706]
Epoch 37:   3%|▎         | 4/117 [00:01<00:28,  3.91it/s, loss=1.66, v_num=1, val_acc=0.706]
Epoch 37:   3%|▎         | 4/117 [00:01<00:29,  3.83it/s, loss=1.71, v_num=1, val_acc=0.706]
Epoch 37:   4%|▍         | 5/117 [00:01<00:23,  4.74it/s, loss=1.71, v_num=1, val_acc=0.706]
Epoch 37:   4%|▍         | 5/117 [00:01<00:24,  4.63it/s, loss=1.73, v_num=1, val_acc=0.706]
Epoch 37:   5%|▌         | 6/117 [00:01<00:20,  5.51it/s, loss=1.73, v_num=1, val_acc=0.706]
Epoch 37:   5%|▌         | 6/117 [00:01<00:20,  5.38it/s, loss=1.75, v_num=1, val_acc=0.706]
Epoch 37:   6%|▌         | 7/117 [00:01<00:17,  6.23it/s, loss=1.75, v_num=1, val_acc=0.706]
Epoch 37:   6%|▌         | 7/117 [00:01<00:18,  6.10it/s, loss=1.75, v_num=1, val_acc=0.706]
Epoch 37:   7%|▋         | 8/117 [00:01<00:15,  6.91it/s, loss=1.75, v_num=1, val_acc=0.706]
Epoch 37:   7%|▋         | 8/117 [00:01<00:16,  6.77it/s, loss=1.74, v_num=1, val_acc=0.706]
Epoch 37:   8%|▊         | 9/117 [00:01<00:14,  7.55it/s, loss=1.74, v_num=1, val_acc=0.706]
Epoch 37:   8%|▊         | 9/117 [00:01<00:14,  7.39it/s, loss=1.76, v_num=1, val_acc=0.706]
Epoch 37:   9%|▊         | 10/117 [00:01<00:13,  8.13it/s, loss=1.76, v_num=1, val_acc=0.706]
Epoch 37:   9%|▊         | 10/117 [00:01<00:13,  7.97it/s, loss=1.79, v_num=1, val_acc=0.706]
Epoch 37:   9%|▉         | 11/117 [00:01<00:12,  8.71it/s, loss=1.79, v_num=1, val_acc=0.706]
Epoch 37:   9%|▉         | 11/117 [00:01<00:12,  8.54it/s, loss=1.84, v_num=1, val_acc=0.706]
Epoch 37:  10%|█         | 12/117 [00:01<00:11,  9.24it/s, loss=1.84, v_num=1, val_acc=0.706]
Epoch 37:  10%|█         | 12/117 [00:01<00:11,  9.06it/s, loss=1.8, v_num=1, val_acc=0.706]
Epoch 37:  11%|█         | 13/117 [00:01<00:10,  9.75it/s, loss=1.8, v_num=1, val_acc=0.706]
Epoch 37:  11%|█         | 13/117 [00:01<00:10,  9.57it/s, loss=1.81, v_num=1, val_acc=0.706]
Epoch 37:  12%|█▏        | 14/117 [00:01<00:10, 10.24it/s, loss=1.81, v_num=1, val_acc=0.706]
Epoch 37:  12%|█▏        | 14/117 [00:01<00:10, 10.06it/s, loss=1.84, v_num=1, val_acc=0.706]
Epoch 37:  13%|█▎        | 15/117 [00:01<00:09, 10.70it/s, loss=1.84, v_num=1, val_acc=0.706]
Epoch 37:  13%|█▎        | 15/117 [00:01<00:09, 10.51it/s, loss=1.84, v_num=1, val_acc=0.706]
Epoch 37:  14%|█▎        | 16/117 [00:01<00:09, 11.15it/s, loss=1.84, v_num=1, val_acc=0.706]
Epoch 37:  14%|█▎        | 16/117 [00:01<00:09, 10.96it/s, loss=1.87, v_num=1, val_acc=0.706]
Epoch 37:  15%|█▍        | 17/117 [00:01<00:08, 11.57it/s, loss=1.87, v_num=1, val_acc=0.706]
Epoch 37:  15%|█▍        | 17/117 [00:01<00:08, 11.37it/s, loss=1.85, v_num=1, val_acc=0.706]
Epoch 37:  15%|█▌        | 18/117 [00:01<00:08, 11.94it/s, loss=1.85, v_num=1, val_acc=0.706]
Epoch 37:  15%|█▌        | 18/117 [00:01<00:08, 11.75it/s, loss=1.81, v_num=1, val_acc=0.706]
Epoch 37:  16%|█▌        | 19/117 [00:01<00:07, 12.33it/s, loss=1.81, v_num=1, val_acc=0.706]
Epoch 37:  16%|█▌        | 19/117 [00:01<00:08, 12.13it/s, loss=1.8, v_num=1, val_acc=0.706]
Epoch 37:  17%|█▋        | 20/117 [00:01<00:07, 12.69it/s, loss=1.8, v_num=1, val_acc=0.706]
Epoch 37:  17%|█▋        | 20/117 [00:01<00:07, 12.50it/s, loss=1.83, v_num=1, val_acc=0.706]
Epoch 37:  18%|█▊        | 21/117 [00:01<00:07, 13.04it/s, loss=1.83, v_num=1, val_acc=0.706]
Epoch 37:  18%|█▊        | 21/117 [00:01<00:07, 12.84it/s, loss=1.83, v_num=1, val_acc=0.706]
Epoch 37:  19%|█▉        | 22/117 [00:01<00:07, 13.37it/s, loss=1.83, v_num=1, val_acc=0.706]
Epoch 37:  19%|█▉        | 22/117 [00:01<00:07, 13.17it/s, loss=1.81, v_num=1, val_acc=0.706]
Epoch 37:  20%|█▉        | 23/117 [00:01<00:06, 13.69it/s, loss=1.81, v_num=1, val_acc=0.706]
Epoch 37:  20%|█▉        | 23/117 [00:01<00:06, 13.49it/s, loss=1.8, v_num=1, val_acc=0.706]
Epoch 37:  21%|██        | 24/117 [00:01<00:06, 14.00it/s, loss=1.8, v_num=1, val_acc=0.706]
Epoch 37:  21%|██        | 24/117 [00:01<00:06, 13.80it/s, loss=1.8, v_num=1, val_acc=0.706]
Epoch 37:  21%|██▏       | 25/117 [00:01<00:06, 14.30it/s, loss=1.8, v_num=1, val_acc=0.706]
Epoch 37:  21%|██▏       | 25/117 [00:01<00:06, 14.09it/s, loss=1.81, v_num=1, val_acc=0.706]
Epoch 37:  22%|██▏       | 26/117 [00:01<00:06, 14.57it/s, loss=1.81, v_num=1, val_acc=0.706]
Epoch 37:  22%|██▏       | 26/117 [00:01<00:06, 14.37it/s, loss=1.81, v_num=1, val_acc=0.706]
Epoch 37:  23%|██▎       | 27/117 [00:01<00:06, 14.84it/s, loss=1.81, v_num=1, val_acc=0.706]
Epoch 37:  23%|██▎       | 27/117 [00:01<00:06, 14.64it/s, loss=1.81, v_num=1, val_acc=0.706]
Epoch 37:  24%|██▍       | 28/117 [00:01<00:05, 15.11it/s, loss=1.81, v_num=1, val_acc=0.706]
Epoch 37:  24%|██▍       | 28/117 [00:01<00:05, 14.90it/s, loss=1.82, v_num=1, val_acc=0.706]
Epoch 37:  25%|██▍       | 29/117 [00:01<00:05, 15.36it/s, loss=1.82, v_num=1, val_acc=0.706]
Epoch 37:  25%|██▍       | 29/117 [00:01<00:05, 15.16it/s, loss=1.8, v_num=1, val_acc=0.706]
Epoch 37:  26%|██▌       | 30/117 [00:01<00:05, 15.61it/s, loss=1.8, v_num=1, val_acc=0.706]
Epoch 37:  26%|██▌       | 30/117 [00:01<00:05, 15.40it/s, loss=1.77, v_num=1, val_acc=0.706]
Epoch 37:  26%|██▋       | 31/117 [00:01<00:05, 15.84it/s, loss=1.77, v_num=1, val_acc=0.706]
Epoch 37:  26%|██▋       | 31/117 [00:01<00:05, 15.64it/s, loss=1.73, v_num=1, val_acc=0.706]
Epoch 37:  27%|██▋       | 32/117 [00:01<00:05, 16.07it/s, loss=1.73, v_num=1, val_acc=0.706]
Epoch 37:  27%|██▋       | 32/117 [00:02<00:05, 15.87it/s, loss=1.79, v_num=1, val_acc=0.706]
Epoch 37:  28%|██▊       | 33/117 [00:02<00:05, 16.29it/s, loss=1.79, v_num=1, val_acc=0.706]
Epoch 37:  28%|██▊       | 33/117 [00:02<00:05, 16.09it/s, loss=1.8, v_num=1, val_acc=0.706]
Epoch 37:  29%|██▉       | 34/117 [00:02<00:05, 16.51it/s, loss=1.8, v_num=1, val_acc=0.706]
Epoch 37:  29%|██▉       | 34/117 [00:02<00:05, 16.30it/s, loss=1.79, v_num=1, val_acc=0.706]
Epoch 37:  30%|██▉       | 35/117 [00:02<00:04, 16.71it/s, loss=1.79, v_num=1, val_acc=0.706]
Epoch 37:  30%|██▉       | 35/117 [00:02<00:04, 16.51it/s, loss=1.8, v_num=1, val_acc=0.706]
Epoch 37:  31%|███       | 36/117 [00:02<00:04, 16.91it/s, loss=1.8, v_num=1, val_acc=0.706]
Epoch 37:  31%|███       | 36/117 [00:02<00:04, 16.71it/s, loss=1.77, v_num=1, val_acc=0.706]
Epoch 37:  32%|███▏      | 37/117 [00:02<00:04, 17.07it/s, loss=1.77, v_num=1, val_acc=0.706]
Epoch 37:  32%|███▏      | 37/117 [00:02<00:04, 16.88it/s, loss=1.8, v_num=1, val_acc=0.706]
Epoch 37:  32%|███▏      | 38/117 [00:02<00:04, 17.25it/s, loss=1.8, v_num=1, val_acc=0.706]
Epoch 37:  32%|███▏      | 38/117 [00:02<00:04, 17.06it/s, loss=1.82, v_num=1, val_acc=0.706]
Epoch 37:  33%|███▎      | 39/117 [00:02<00:04, 17.44it/s, loss=1.82, v_num=1, val_acc=0.706]
Epoch 37:  33%|███▎      | 39/117 [00:02<00:04, 17.24it/s, loss=1.88, v_num=1, val_acc=0.706]
Epoch 37:  34%|███▍      | 40/117 [00:02<00:04, 17.61it/s, loss=1.88, v_num=1, val_acc=0.706]
Epoch 37:  34%|███▍      | 40/117 [00:02<00:04, 17.42it/s, loss=1.86, v_num=1, val_acc=0.706]
Epoch 37:  35%|███▌      | 41/117 [00:02<00:04, 17.78it/s, loss=1.86, v_num=1, val_acc=0.706]
Epoch 37:  35%|███▌      | 41/117 [00:02<00:04, 17.59it/s, loss=1.87, v_num=1, val_acc=0.706]
Epoch 37:  36%|███▌      | 42/117 [00:02<00:04, 17.91it/s, loss=1.87, v_num=1, val_acc=0.706]
Epoch 37:  36%|███▌      | 42/117 [00:02<00:04, 17.74it/s, loss=1.86, v_num=1, val_acc=0.706]
Epoch 37:  37%|███▋      | 43/117 [00:02<00:04, 18.05it/s, loss=1.86, v_num=1, val_acc=0.706]
Epoch 37:  37%|███▋      | 43/117 [00:02<00:04, 17.87it/s, loss=1.87, v_num=1, val_acc=0.706]
Epoch 37:  38%|███▊      | 44/117 [00:02<00:04, 18.20it/s, loss=1.87, v_num=1, val_acc=0.706]
Epoch 37:  38%|███▊      | 44/117 [00:02<00:04, 18.02it/s, loss=1.83, v_num=1, val_acc=0.706]
Epoch 37:  38%|███▊      | 45/117 [00:02<00:03, 18.29it/s, loss=1.83, v_num=1, val_acc=0.706]
Epoch 37:  38%|███▊      | 45/117 [00:02<00:03, 18.16it/s, loss=1.8, v_num=1, val_acc=0.706]
Epoch 37:  39%|███▉      | 46/117 [00:02<00:03, 18.49it/s, loss=1.8, v_num=1, val_acc=0.706]
Epoch 37:  39%|███▉      | 46/117 [00:02<00:03, 18.31it/s, loss=1.75, v_num=1, val_acc=0.706]
Epoch 37:  40%|████      | 47/117 [00:02<00:03, 18.64it/s, loss=1.75, v_num=1, val_acc=0.706]
Epoch 37:  40%|████      | 47/117 [00:02<00:03, 18.45it/s, loss=1.74, v_num=1, val_acc=0.706]
Epoch 37:  41%|████      | 48/117 [00:02<00:03, 18.78it/s, loss=1.74, v_num=1, val_acc=0.706]
Epoch 37:  41%|████      | 48/117 [00:02<00:03, 18.60it/s, loss=1.71, v_num=1, val_acc=0.706]
Epoch 37:  42%|████▏     | 49/117 [00:02<00:03, 18.92it/s, loss=1.71, v_num=1, val_acc=0.706]
Epoch 37:  42%|████▏     | 49/117 [00:02<00:03, 18.73it/s, loss=1.7, v_num=1, val_acc=0.706]
Epoch 37:  43%|████▎     | 50/117 [00:02<00:03, 19.05it/s, loss=1.7, v_num=1, val_acc=0.706]
Epoch 37:  43%|████▎     | 50/117 [00:02<00:03, 18.87it/s, loss=1.72, v_num=1, val_acc=0.706]
Epoch 37:  44%|████▎     | 51/117 [00:02<00:03, 19.18it/s, loss=1.72, v_num=1, val_acc=0.706]
Epoch 37:  44%|████▎     | 51/117 [00:02<00:03, 19.00it/s, loss=1.72, v_num=1, val_acc=0.706]
Epoch 37:  44%|████▍     | 52/117 [00:02<00:03, 19.30it/s, loss=1.72, v_num=1, val_acc=0.706]
Epoch 37:  44%|████▍     | 52/117 [00:02<00:03, 19.12it/s, loss=1.68, v_num=1, val_acc=0.706]
Epoch 37:  45%|████▌     | 53/117 [00:02<00:03, 19.42it/s, loss=1.68, v_num=1, val_acc=0.706]
Epoch 37:  45%|████▌     | 53/117 [00:02<00:03, 19.25it/s, loss=1.65, v_num=1, val_acc=0.706]
Epoch 37:  46%|████▌     | 54/117 [00:02<00:03, 19.54it/s, loss=1.65, v_num=1, val_acc=0.706]
Epoch 37:  46%|████▌     | 54/117 [00:02<00:03, 19.37it/s, loss=1.64, v_num=1, val_acc=0.706]
Epoch 37:  47%|████▋     | 55/117 [00:02<00:03, 19.66it/s, loss=1.64, v_num=1, val_acc=0.706]
Epoch 37:  47%|████▋     | 55/117 [00:02<00:03, 19.48it/s, loss=1.65, v_num=1, val_acc=0.706]
Epoch 37:  48%|████▊     | 56/117 [00:02<00:03, 19.77it/s, loss=1.65, v_num=1, val_acc=0.706]
Epoch 37:  48%|████▊     | 56/117 [00:02<00:03, 19.59it/s, loss=1.64, v_num=1, val_acc=0.706]
Epoch 37:  49%|████▊     | 57/117 [00:02<00:03, 19.88it/s, loss=1.64, v_num=1, val_acc=0.706]
Epoch 37:  49%|████▊     | 57/117 [00:02<00:03, 19.71it/s, loss=1.63, v_num=1, val_acc=0.706]
Epoch 37:  50%|████▉     | 58/117 [00:02<00:02, 19.99it/s, loss=1.63, v_num=1, val_acc=0.706]
Epoch 37:  50%|████▉     | 58/117 [00:02<00:02, 19.82it/s, loss=1.64, v_num=1, val_acc=0.706]
Epoch 37:  50%|█████     | 59/117 [00:02<00:02, 20.09it/s, loss=1.64, v_num=1, val_acc=0.706]
Epoch 37:  50%|█████     | 59/117 [00:02<00:02, 19.92it/s, loss=1.59, v_num=1, val_acc=0.706]
Epoch 37:  51%|█████▏    | 60/117 [00:02<00:02, 20.16it/s, loss=1.59, v_num=1, val_acc=0.706]
Epoch 37:  51%|█████▏    | 60/117 [00:02<00:02, 20.01it/s, loss=1.64, v_num=1, val_acc=0.706]
Epoch 37:  52%|█████▏    | 61/117 [00:03<00:02, 20.27it/s, loss=1.64, v_num=1, val_acc=0.706]
Epoch 37:  52%|█████▏    | 61/117 [00:03<00:02, 20.11it/s, loss=1.67, v_num=1, val_acc=0.706]
Epoch 37:  53%|█████▎    | 62/117 [00:03<00:02, 20.33it/s, loss=1.67, v_num=1, val_acc=0.706]
Epoch 37:  53%|█████▎    | 62/117 [00:03<00:02, 20.17it/s, loss=1.67, v_num=1, val_acc=0.706]
Epoch 37:  54%|█████▍    | 63/117 [00:03<00:02, 20.44it/s, loss=1.67, v_num=1, val_acc=0.706]
Epoch 37:  54%|█████▍    | 63/117 [00:03<00:02, 20.27it/s, loss=1.66, v_num=1, val_acc=0.706]
Epoch 37:  55%|█████▍    | 64/117 [00:03<00:02, 20.53it/s, loss=1.66, v_num=1, val_acc=0.706]
Epoch 37:  55%|█████▍    | 64/117 [00:03<00:02, 20.36it/s, loss=1.67, v_num=1, val_acc=0.706]
Epoch 37:  56%|█████▌    | 65/117 [00:03<00:02, 20.57it/s, loss=1.67, v_num=1, val_acc=0.706]
Epoch 37:  56%|█████▌    | 65/117 [00:03<00:02, 20.43it/s, loss=1.65, v_num=1, val_acc=0.706]
Epoch 37:  56%|█████▋    | 66/117 [00:03<00:02, 20.65it/s, loss=1.65, v_num=1, val_acc=0.706]
Epoch 37:  56%|█████▋    | 66/117 [00:03<00:02, 20.50it/s, loss=1.67, v_num=1, val_acc=0.706]
Epoch 37:  57%|█████▋    | 67/117 [00:03<00:02, 20.72it/s, loss=1.67, v_num=1, val_acc=0.706]
Epoch 37:  57%|█████▋    | 67/117 [00:03<00:02, 20.56it/s, loss=1.68, v_num=1, val_acc=0.706]
Epoch 37:  58%|█████▊    | 68/117 [00:03<00:02, 20.80it/s, loss=1.68, v_num=1, val_acc=0.706]
Epoch 37:  58%|█████▊    | 68/117 [00:03<00:02, 20.64it/s, loss=1.68, v_num=1, val_acc=0.706]
Epoch 37:  59%|█████▉    | 69/117 [00:03<00:02, 20.89it/s, loss=1.68, v_num=1, val_acc=0.706]
Epoch 37:  59%|█████▉    | 69/117 [00:03<00:02, 20.73it/s, loss=1.71, v_num=1, val_acc=0.706]
Epoch 37:  60%|█████▉    | 70/117 [00:03<00:02, 20.97it/s, loss=1.71, v_num=1, val_acc=0.706]
Epoch 37:  60%|█████▉    | 70/117 [00:03<00:02, 20.81it/s, loss=1.7, v_num=1, val_acc=0.706]
Epoch 37:  61%|██████    | 71/117 [00:03<00:02, 21.05it/s, loss=1.7, v_num=1, val_acc=0.706]
Epoch 37:  61%|██████    | 71/117 [00:03<00:02, 20.89it/s, loss=1.69, v_num=1, val_acc=0.706]
Epoch 37:  62%|██████▏   | 72/117 [00:03<00:02, 21.13it/s, loss=1.69, v_num=1, val_acc=0.706]
Epoch 37:  62%|██████▏   | 72/117 [00:03<00:02, 20.97it/s, loss=1.69, v_num=1, val_acc=0.706]
Epoch 37:  62%|██████▏   | 73/117 [00:03<00:02, 21.21it/s, loss=1.69, v_num=1, val_acc=0.706]
Epoch 37:  62%|██████▏   | 73/117 [00:03<00:02, 21.05it/s, loss=1.72, v_num=1, val_acc=0.706]
Epoch 37:  63%|██████▎   | 74/117 [00:03<00:02, 21.28it/s, loss=1.72, v_num=1, val_acc=0.706]
Epoch 37:  63%|██████▎   | 74/117 [00:03<00:02, 21.13it/s, loss=1.72, v_num=1, val_acc=0.706]
Epoch 37:  64%|██████▍   | 75/117 [00:03<00:01, 21.36it/s, loss=1.72, v_num=1, val_acc=0.706]
Epoch 37:  64%|██████▍   | 75/117 [00:03<00:01, 21.21it/s, loss=1.72, v_num=1, val_acc=0.706]
Epoch 37:  65%|██████▍   | 76/117 [00:03<00:01, 21.44it/s, loss=1.72, v_num=1, val_acc=0.706]
Epoch 37:  65%|██████▍   | 76/117 [00:03<00:01, 21.28it/s, loss=1.72, v_num=1, val_acc=0.706]
Epoch 37:  66%|██████▌   | 77/117 [00:03<00:01, 21.51it/s, loss=1.72, v_num=1, val_acc=0.706]
Epoch 37:  66%|██████▌   | 77/117 [00:03<00:01, 21.36it/s, loss=1.73, v_num=1, val_acc=0.706]
Epoch 37:  67%|██████▋   | 78/117 [00:03<00:01, 21.58it/s, loss=1.73, v_num=1, val_acc=0.706]
Epoch 37:  67%|██████▋   | 78/117 [00:03<00:01, 21.43it/s, loss=1.72, v_num=1, val_acc=0.706]
Epoch 37:  68%|██████▊   | 79/117 [00:03<00:01, 21.65it/s, loss=1.72, v_num=1, val_acc=0.706]
Epoch 37:  68%|██████▊   | 79/117 [00:03<00:01, 21.50it/s, loss=1.73, v_num=1, val_acc=0.706]
Epoch 37:  68%|██████▊   | 80/117 [00:03<00:01, 21.71it/s, loss=1.73, v_num=1, val_acc=0.706]
Epoch 37:  68%|██████▊   | 80/117 [00:03<00:01, 21.57it/s, loss=1.71, v_num=1, val_acc=0.706]
Epoch 37:  69%|██████▉   | 81/117 [00:03<00:01, 21.78it/s, loss=1.71, v_num=1, val_acc=0.706]
Epoch 37:  69%|██████▉   | 81/117 [00:03<00:01, 21.63it/s, loss=1.71, v_num=1, val_acc=0.706]
Epoch 37:  70%|███████   | 82/117 [00:03<00:01, 21.82it/s, loss=1.71, v_num=1, val_acc=0.706]
Epoch 37:  70%|███████   | 82/117 [00:03<00:01, 21.68it/s, loss=1.75, v_num=1, val_acc=0.706]
Epoch 37:  71%|███████   | 83/117 [00:03<00:01, 21.89it/s, loss=1.75, v_num=1, val_acc=0.706]
Epoch 37:  71%|███████   | 83/117 [00:03<00:01, 21.74it/s, loss=1.79, v_num=1, val_acc=0.706]
Epoch 37:  72%|███████▏  | 84/117 [00:03<00:01, 21.95it/s, loss=1.79, v_num=1, val_acc=0.706]
Epoch 37:  72%|███████▏  | 84/117 [00:03<00:01, 21.81it/s, loss=1.82, v_num=1, val_acc=0.706]
Epoch 37:  73%|███████▎  | 85/117 [00:03<00:01, 22.01it/s, loss=1.82, v_num=1, val_acc=0.706]
Epoch 37:  73%|███████▎  | 85/117 [00:03<00:01, 21.87it/s, loss=1.84, v_num=1, val_acc=0.706]
Epoch 37:  74%|███████▎  | 86/117 [00:03<00:01, 22.06it/s, loss=1.84, v_num=1, val_acc=0.706]
Epoch 37:  74%|███████▎  | 86/117 [00:03<00:01, 21.92it/s, loss=1.83, v_num=1, val_acc=0.706]
Epoch 37:  74%|███████▍  | 87/117 [00:03<00:01, 22.13it/s, loss=1.83, v_num=1, val_acc=0.706]
Epoch 37:  74%|███████▍  | 87/117 [00:03<00:01, 21.98it/s, loss=1.84, v_num=1, val_acc=0.706]
Epoch 37:  75%|███████▌  | 88/117 [00:03<00:01, 22.19it/s, loss=1.84, v_num=1, val_acc=0.706]
Epoch 37:  75%|███████▌  | 88/117 [00:03<00:01, 22.05it/s, loss=1.86, v_num=1, val_acc=0.706]
Epoch 37:  76%|███████▌  | 89/117 [00:04<00:01, 22.25it/s, loss=1.86, v_num=1, val_acc=0.706]
Epoch 37:  76%|███████▌  | 89/117 [00:04<00:01, 22.11it/s, loss=1.85, v_num=1, val_acc=0.706]
Epoch 37:  77%|███████▋  | 90/117 [00:04<00:01, 22.31it/s, loss=1.85, v_num=1, val_acc=0.706]
Epoch 37:  77%|███████▋  | 90/117 [00:04<00:01, 22.17it/s, loss=1.87, v_num=1, val_acc=0.706]
Epoch 37:  78%|███████▊  | 91/117 [00:04<00:01, 22.36it/s, loss=1.87, v_num=1, val_acc=0.706]
Epoch 37:  78%|███████▊  | 91/117 [00:04<00:01, 22.22it/s, loss=1.89, v_num=1, val_acc=0.706]
Epoch 37:  79%|███████▊  | 92/117 [00:04<00:01, 22.42it/s, loss=1.89, v_num=1, val_acc=0.706]
Epoch 37:  79%|███████▊  | 92/117 [00:04<00:01, 22.28it/s, loss=1.87, v_num=1, val_acc=0.706]
Epoch 37:  79%|███████▉  | 93/117 [00:04<00:01, 22.48it/s, loss=1.87, v_num=1, val_acc=0.706]
Epoch 37:  79%|███████▉  | 93/117 [00:04<00:01, 22.34it/s, loss=1.85, v_num=1, val_acc=0.706]
Epoch 37:  80%|████████  | 94/117 [00:04<00:01, 22.53it/s, loss=1.85, v_num=1, val_acc=0.706]
Epoch 37:  80%|████████  | 94/117 [00:04<00:01, 22.39it/s, loss=1.85, v_num=1, val_acc=0.706]
Epoch 37:  81%|████████  | 95/117 [00:04<00:00, 22.59it/s, loss=1.85, v_num=1, val_acc=0.706]
Epoch 37:  81%|████████  | 95/117 [00:04<00:00, 22.45it/s, loss=1.87, v_num=1, val_acc=0.706]
Epoch 37:  82%|████████▏ | 96/117 [00:04<00:00, 22.64it/s, loss=1.87, v_num=1, val_acc=0.706]
Epoch 37:  82%|████████▏ | 96/117 [00:04<00:00, 22.50it/s, loss=1.92, v_num=1, val_acc=0.706]
Epoch 37:  83%|████████▎ | 97/117 [00:04<00:00, 22.69it/s, loss=1.92, v_num=1, val_acc=0.706]
Epoch 37:  83%|████████▎ | 97/117 [00:04<00:00, 22.56it/s, loss=1.9, v_num=1, val_acc=0.706]

Validation: 0it [00:00, ?it/s]

Validation:   0%|          | 0/20 [00:00<?, ?it/s]

Validation DataLoader 0:   0%|          | 0/20 [00:00<?, ?it/s]

Validation DataLoader 0:   5%|▌         | 1/20 [00:00<00:00, 188.31it/s]
Epoch 37:  84%|████████▍ | 98/117 [00:05<00:00, 19.04it/s, loss=1.9, v_num=1, val_acc=0.706]

Validation DataLoader 0:  10%|█         | 2/20 [00:00<00:00, 55.45it/s]
Epoch 37:  85%|████████▍ | 99/117 [00:05<00:00, 19.12it/s, loss=1.9, v_num=1, val_acc=0.706]

Validation DataLoader 0:  15%|█▌        | 3/20 [00:00<00:00, 43.68it/s]
Epoch 37:  85%|████████▌ | 100/117 [00:05<00:00, 19.19it/s, loss=1.9, v_num=1, val_acc=0.706]

Validation DataLoader 0:  20%|██        | 4/20 [00:00<00:00, 39.77it/s]
Epoch 37:  86%|████████▋ | 101/117 [00:05<00:00, 19.27it/s, loss=1.9, v_num=1, val_acc=0.706]

Validation DataLoader 0:  25%|██▌       | 5/20 [00:00<00:00, 37.69it/s]
Epoch 37:  87%|████████▋ | 102/117 [00:05<00:00, 19.34it/s, loss=1.9, v_num=1, val_acc=0.706]

Validation DataLoader 0:  30%|███       | 6/20 [00:00<00:00, 36.59it/s]
Epoch 37:  88%|████████▊ | 103/117 [00:05<00:00, 19.41it/s, loss=1.9, v_num=1, val_acc=0.706]

Validation DataLoader 0:  35%|███▌      | 7/20 [00:00<00:00, 35.79it/s]
Epoch 37:  89%|████████▉ | 104/117 [00:05<00:00, 19.48it/s, loss=1.9, v_num=1, val_acc=0.706]

Validation DataLoader 0:  40%|████      | 8/20 [00:00<00:00, 35.23it/s]
Epoch 37:  90%|████████▉ | 105/117 [00:05<00:00, 19.56it/s, loss=1.9, v_num=1, val_acc=0.706]

Validation DataLoader 0:  45%|████▌     | 9/20 [00:00<00:00, 34.56it/s]
Epoch 37:  91%|█████████ | 106/117 [00:05<00:00, 19.62it/s, loss=1.9, v_num=1, val_acc=0.706]

Validation DataLoader 0:  50%|█████     | 10/20 [00:00<00:00, 34.33it/s]
Epoch 37:  91%|█████████▏| 107/117 [00:05<00:00, 19.69it/s, loss=1.9, v_num=1, val_acc=0.706]

Validation DataLoader 0:  55%|█████▌    | 11/20 [00:00<00:00, 34.08it/s]
Epoch 37:  92%|█████████▏| 108/117 [00:05<00:00, 19.76it/s, loss=1.9, v_num=1, val_acc=0.706]

Validation DataLoader 0:  60%|██████    | 12/20 [00:00<00:00, 33.77it/s]
Epoch 37:  93%|█████████▎| 109/117 [00:05<00:00, 19.83it/s, loss=1.9, v_num=1, val_acc=0.706]

Validation DataLoader 0:  65%|██████▌   | 13/20 [00:00<00:00, 33.65it/s]
Epoch 37:  94%|█████████▍| 110/117 [00:05<00:00, 19.90it/s, loss=1.9, v_num=1, val_acc=0.706]

Validation DataLoader 0:  70%|███████   | 14/20 [00:00<00:00, 33.49it/s]
Epoch 37:  95%|█████████▍| 111/117 [00:05<00:00, 19.96it/s, loss=1.9, v_num=1, val_acc=0.706]

Validation DataLoader 0:  75%|███████▌  | 15/20 [00:00<00:00, 33.29it/s]
Epoch 37:  96%|█████████▌| 112/117 [00:05<00:00, 20.03it/s, loss=1.9, v_num=1, val_acc=0.706]

Validation DataLoader 0:  80%|████████  | 16/20 [00:00<00:00, 33.22it/s]
Epoch 37:  97%|█████████▋| 113/117 [00:05<00:00, 20.09it/s, loss=1.9, v_num=1, val_acc=0.706]

Validation DataLoader 0:  85%|████████▌ | 17/20 [00:00<00:00, 33.12it/s]
Epoch 37:  97%|█████████▋| 114/117 [00:05<00:00, 20.16it/s, loss=1.9, v_num=1, val_acc=0.706]

Validation DataLoader 0:  90%|█████████ | 18/20 [00:00<00:00, 32.98it/s]
Epoch 37:  98%|█████████▊| 115/117 [00:05<00:00, 20.22it/s, loss=1.9, v_num=1, val_acc=0.706]

Validation DataLoader 0:  95%|█████████▌| 19/20 [00:00<00:00, 32.94it/s]
Epoch 37:  99%|█████████▉| 116/117 [00:05<00:00, 20.28it/s, loss=1.9, v_num=1, val_acc=0.706]

Validation DataLoader 0: 100%|██████████| 20/20 [00:00<00:00, 32.94it/s]
Epoch 37: 100%|██████████| 117/117 [00:05<00:00, 20.35it/s, loss=1.9, v_num=1, val_acc=0.706]
Epoch 37: 100%|██████████| 117/117 [00:05<00:00, 20.28it/s, loss=1.9, v_num=1, val_acc=0.700]


Epoch 37: 100%|██████████| 117/117 [00:05<00:00, 20.28it/s, loss=1.9, v_num=1, val_acc=0.700]
Epoch 37:   0%|          | 0/117 [00:00<?, ?it/s, loss=1.9, v_num=1, val_acc=0.700]
Epoch 38:   0%|          | 0/117 [00:00<?, ?it/s, loss=1.9, v_num=1, val_acc=0.700]
Epoch 38:   1%|          | 1/117 [00:00<01:43,  1.12it/s, loss=1.9, v_num=1, val_acc=0.700]
Epoch 38:   1%|          | 1/117 [00:00<01:46,  1.09it/s, loss=1.88, v_num=1, val_acc=0.700]
Epoch 38:   2%|▏         | 2/117 [00:00<00:53,  2.15it/s, loss=1.88, v_num=1, val_acc=0.700]
Epoch 38:   2%|▏         | 2/117 [00:00<00:55,  2.09it/s, loss=1.86, v_num=1, val_acc=0.700]
Epoch 38:   3%|▎         | 3/117 [00:00<00:36,  3.10it/s, loss=1.86, v_num=1, val_acc=0.700]
Epoch 38:   3%|▎         | 3/117 [00:00<00:37,  3.02it/s, loss=1.84, v_num=1, val_acc=0.700]
Epoch 38:   3%|▎         | 4/117 [00:01<00:28,  3.99it/s, loss=1.84, v_num=1, val_acc=0.700]
Epoch 38:   3%|▎         | 4/117 [00:01<00:29,  3.89it/s, loss=1.79, v_num=1, val_acc=0.700]
Epoch 38:   4%|▍         | 5/117 [00:01<00:23,  4.83it/s, loss=1.79, v_num=1, val_acc=0.700]
Epoch 38:   4%|▍         | 5/117 [00:01<00:23,  4.71it/s, loss=1.71, v_num=1, val_acc=0.700]
Epoch 38:   5%|▌         | 6/117 [00:01<00:19,  5.60it/s, loss=1.71, v_num=1, val_acc=0.700]
Epoch 38:   5%|▌         | 6/117 [00:01<00:20,  5.47it/s, loss=1.63, v_num=1, val_acc=0.700]
Epoch 38:   6%|▌         | 7/117 [00:01<00:17,  6.34it/s, loss=1.63, v_num=1, val_acc=0.700]
Epoch 38:   6%|▌         | 7/117 [00:01<00:17,  6.19it/s, loss=1.58, v_num=1, val_acc=0.700]
Epoch 38:   7%|▋         | 8/117 [00:01<00:15,  7.03it/s, loss=1.58, v_num=1, val_acc=0.700]
Epoch 38:   7%|▋         | 8/117 [00:01<00:15,  6.87it/s, loss=1.58, v_num=1, val_acc=0.700]
Epoch 38:   8%|▊         | 9/117 [00:01<00:14,  7.65it/s, loss=1.58, v_num=1, val_acc=0.700]
Epoch 38:   8%|▊         | 9/117 [00:01<00:14,  7.49it/s, loss=1.6, v_num=1, val_acc=0.700]
Epoch 38:   9%|▊         | 10/117 [00:01<00:12,  8.25it/s, loss=1.6, v_num=1, val_acc=0.700]
Epoch 38:   9%|▊         | 10/117 [00:01<00:13,  8.09it/s, loss=1.61, v_num=1, val_acc=0.700]
Epoch 38:   9%|▉         | 11/117 [00:01<00:12,  8.83it/s, loss=1.61, v_num=1, val_acc=0.700]
Epoch 38:   9%|▉         | 11/117 [00:01<00:12,  8.66it/s, loss=1.6, v_num=1, val_acc=0.700]
Epoch 38:  10%|█         | 12/117 [00:01<00:11,  9.38it/s, loss=1.6, v_num=1, val_acc=0.700]
Epoch 38:  10%|█         | 12/117 [00:01<00:11,  9.20it/s, loss=1.58, v_num=1, val_acc=0.700]
Epoch 38:  11%|█         | 13/117 [00:01<00:10,  9.90it/s, loss=1.58, v_num=1, val_acc=0.700]
Epoch 38:  11%|█         | 13/117 [00:01<00:10,  9.72it/s, loss=1.54, v_num=1, val_acc=0.700]
Epoch 38:  12%|█▏        | 14/117 [00:01<00:09, 10.39it/s, loss=1.54, v_num=1, val_acc=0.700]
Epoch 38:  12%|█▏        | 14/117 [00:01<00:10, 10.20it/s, loss=1.51, v_num=1, val_acc=0.700]
Epoch 38:  13%|█▎        | 15/117 [00:01<00:09, 10.84it/s, loss=1.51, v_num=1, val_acc=0.700]
Epoch 38:  13%|█▎        | 15/117 [00:01<00:09, 10.65it/s, loss=1.52, v_num=1, val_acc=0.700]
Epoch 38:  14%|█▎        | 16/117 [00:01<00:08, 11.30it/s, loss=1.52, v_num=1, val_acc=0.700]
Epoch 38:  14%|█▎        | 16/117 [00:01<00:09, 11.10it/s, loss=1.53, v_num=1, val_acc=0.700]
Epoch 38:  15%|█▍        | 17/117 [00:01<00:08, 11.70it/s, loss=1.53, v_num=1, val_acc=0.700]
Epoch 38:  15%|█▍        | 17/117 [00:01<00:08, 11.50it/s, loss=1.53, v_num=1, val_acc=0.700]
Epoch 38:  15%|█▌        | 18/117 [00:01<00:08, 12.11it/s, loss=1.53, v_num=1, val_acc=0.700]
Epoch 38:  15%|█▌        | 18/117 [00:01<00:08, 11.90it/s, loss=1.53, v_num=1, val_acc=0.700]
Epoch 38:  16%|█▌        | 19/117 [00:01<00:07, 12.49it/s, loss=1.53, v_num=1, val_acc=0.700]
Epoch 38:  16%|█▌        | 19/117 [00:01<00:07, 12.28it/s, loss=1.5, v_num=1, val_acc=0.700]
Epoch 38:  17%|█▋        | 20/117 [00:01<00:07, 12.86it/s, loss=1.5, v_num=1, val_acc=0.700]
Epoch 38:  17%|█▋        | 20/117 [00:01<00:07, 12.65it/s, loss=1.53, v_num=1, val_acc=0.700]
Epoch 38:  18%|█▊        | 21/117 [00:01<00:07, 13.22it/s, loss=1.53, v_num=1, val_acc=0.700]
Epoch 38:  18%|█▊        | 21/117 [00:01<00:07, 13.01it/s, loss=1.57, v_num=1, val_acc=0.700]
Epoch 38:  19%|█▉        | 22/117 [00:01<00:07, 13.55it/s, loss=1.57, v_num=1, val_acc=0.700]
Epoch 38:  19%|█▉        | 22/117 [00:01<00:07, 13.34it/s, loss=1.6, v_num=1, val_acc=0.700]
Epoch 38:  20%|█▉        | 23/117 [00:01<00:06, 13.87it/s, loss=1.6, v_num=1, val_acc=0.700]
Epoch 38:  20%|█▉        | 23/117 [00:01<00:06, 13.66it/s, loss=1.62, v_num=1, val_acc=0.700]
Epoch 38:  21%|██        | 24/117 [00:01<00:06, 14.18it/s, loss=1.62, v_num=1, val_acc=0.700]
Epoch 38:  21%|██        | 24/117 [00:01<00:06, 13.97it/s, loss=1.61, v_num=1, val_acc=0.700]
Epoch 38:  21%|██▏       | 25/117 [00:01<00:06, 14.48it/s, loss=1.61, v_num=1, val_acc=0.700]
Epoch 38:  21%|██▏       | 25/117 [00:01<00:06, 14.27it/s, loss=1.63, v_num=1, val_acc=0.700]
Epoch 38:  22%|██▏       | 26/117 [00:01<00:06, 14.76it/s, loss=1.63, v_num=1, val_acc=0.700]
Epoch 38:  22%|██▏       | 26/117 [00:01<00:06, 14.55it/s, loss=1.71, v_num=1, val_acc=0.700]
Epoch 38:  23%|██▎       | 27/117 [00:01<00:05, 15.03it/s, loss=1.71, v_num=1, val_acc=0.700]
Epoch 38:  23%|██▎       | 27/117 [00:01<00:06, 14.83it/s, loss=1.71, v_num=1, val_acc=0.700]
Epoch 38:  24%|██▍       | 28/117 [00:01<00:05, 15.30it/s, loss=1.71, v_num=1, val_acc=0.700]
Epoch 38:  24%|██▍       | 28/117 [00:01<00:05, 15.09it/s, loss=1.71, v_num=1, val_acc=0.700]
Epoch 38:  25%|██▍       | 29/117 [00:01<00:05, 15.55it/s, loss=1.71, v_num=1, val_acc=0.700]
Epoch 38:  25%|██▍       | 29/117 [00:01<00:05, 15.35it/s, loss=1.71, v_num=1, val_acc=0.700]
Epoch 38:  26%|██▌       | 30/117 [00:01<00:05, 15.79it/s, loss=1.71, v_num=1, val_acc=0.700]
Epoch 38:  26%|██▌       | 30/117 [00:01<00:05, 15.59it/s, loss=1.74, v_num=1, val_acc=0.700]
Epoch 38:  26%|██▋       | 31/117 [00:01<00:05, 16.03it/s, loss=1.74, v_num=1, val_acc=0.700]
Epoch 38:  26%|██▋       | 31/117 [00:01<00:05, 15.82it/s, loss=1.73, v_num=1, val_acc=0.700]
Epoch 38:  27%|██▋       | 32/117 [00:01<00:05, 16.25it/s, loss=1.73, v_num=1, val_acc=0.700]
Epoch 38:  27%|██▋       | 32/117 [00:01<00:05, 16.05it/s, loss=1.74, v_num=1, val_acc=0.700]
Epoch 38:  28%|██▊       | 33/117 [00:02<00:05, 16.47it/s, loss=1.74, v_num=1, val_acc=0.700]
Epoch 38:  28%|██▊       | 33/117 [00:02<00:05, 16.27it/s, loss=1.74, v_num=1, val_acc=0.700]
Epoch 38:  29%|██▉       | 34/117 [00:02<00:04, 16.68it/s, loss=1.74, v_num=1, val_acc=0.700]
Epoch 38:  29%|██▉       | 34/117 [00:02<00:05, 16.48it/s, loss=1.74, v_num=1, val_acc=0.700]
Epoch 38:  30%|██▉       | 35/117 [00:02<00:04, 16.89it/s, loss=1.74, v_num=1, val_acc=0.700]
Epoch 38:  30%|██▉       | 35/117 [00:02<00:04, 16.68it/s, loss=1.73, v_num=1, val_acc=0.700]
Epoch 38:  31%|███       | 36/117 [00:02<00:04, 17.08it/s, loss=1.73, v_num=1, val_acc=0.700]
Epoch 38:  31%|███       | 36/117 [00:02<00:04, 16.88it/s, loss=1.71, v_num=1, val_acc=0.700]
Epoch 38:  32%|███▏      | 37/117 [00:02<00:04, 17.24it/s, loss=1.71, v_num=1, val_acc=0.700]
Epoch 38:  32%|███▏      | 37/117 [00:02<00:04, 17.07it/s, loss=1.68, v_num=1, val_acc=0.700]
Epoch 38:  32%|███▏      | 38/117 [00:02<00:04, 17.45it/s, loss=1.68, v_num=1, val_acc=0.700]
Epoch 38:  32%|███▏      | 38/117 [00:02<00:04, 17.25it/s, loss=1.62, v_num=1, val_acc=0.700]
Epoch 38:  33%|███▎      | 39/117 [00:02<00:04, 17.62it/s, loss=1.62, v_num=1, val_acc=0.700]
Epoch 38:  33%|███▎      | 39/117 [00:02<00:04, 17.43it/s, loss=1.57, v_num=1, val_acc=0.700]
Epoch 38:  34%|███▍      | 40/117 [00:02<00:04, 17.80it/s, loss=1.57, v_num=1, val_acc=0.700]
Epoch 38:  34%|███▍      | 40/117 [00:02<00:04, 17.60it/s, loss=1.52, v_num=1, val_acc=0.700]
Epoch 38:  35%|███▌      | 41/117 [00:02<00:04, 17.97it/s, loss=1.52, v_num=1, val_acc=0.700]
Epoch 38:  35%|███▌      | 41/117 [00:02<00:04, 17.77it/s, loss=1.49, v_num=1, val_acc=0.700]
Epoch 38:  36%|███▌      | 42/117 [00:02<00:04, 18.09it/s, loss=1.49, v_num=1, val_acc=0.700]
Epoch 38:  36%|███▌      | 42/117 [00:02<00:04, 17.92it/s, loss=1.5, v_num=1, val_acc=0.700]
Epoch 38:  37%|███▋      | 43/117 [00:02<00:04, 18.28it/s, loss=1.5, v_num=1, val_acc=0.700]
Epoch 38:  37%|███▋      | 43/117 [00:02<00:04, 18.08it/s, loss=1.47, v_num=1, val_acc=0.700]
Epoch 38:  38%|███▊      | 44/117 [00:02<00:03, 18.43it/s, loss=1.47, v_num=1, val_acc=0.700]
Epoch 38:  38%|███▊      | 44/117 [00:02<00:04, 18.24it/s, loss=1.46, v_num=1, val_acc=0.700]
Epoch 38:  38%|███▊      | 45/117 [00:02<00:03, 18.55it/s, loss=1.46, v_num=1, val_acc=0.700]
Epoch 38:  38%|███▊      | 45/117 [00:02<00:03, 18.39it/s, loss=1.42, v_num=1, val_acc=0.700]
Epoch 38:  39%|███▉      | 46/117 [00:02<00:03, 18.72it/s, loss=1.42, v_num=1, val_acc=0.700]
Epoch 38:  39%|███▉      | 46/117 [00:02<00:03, 18.53it/s, loss=1.36, v_num=1, val_acc=0.700]
Epoch 38:  40%|████      | 47/117 [00:02<00:03, 18.82it/s, loss=1.36, v_num=1, val_acc=0.700]
Epoch 38:  40%|████      | 47/117 [00:02<00:03, 18.67it/s, loss=1.37, v_num=1, val_acc=0.700]
Epoch 38:  41%|████      | 48/117 [00:02<00:03, 19.00it/s, loss=1.37, v_num=1, val_acc=0.700]
Epoch 38:  41%|████      | 48/117 [00:02<00:03, 18.81it/s, loss=1.4, v_num=1, val_acc=0.700]
Epoch 38:  42%|████▏     | 49/117 [00:02<00:03, 19.12it/s, loss=1.4, v_num=1, val_acc=0.700]
Epoch 38:  42%|████▏     | 49/117 [00:02<00:03, 18.93it/s, loss=1.39, v_num=1, val_acc=0.700]
Epoch 38:  43%|████▎     | 50/117 [00:02<00:03, 19.25it/s, loss=1.39, v_num=1, val_acc=0.700]
Epoch 38:  43%|████▎     | 50/117 [00:02<00:03, 19.06it/s, loss=1.34, v_num=1, val_acc=0.700]
Epoch 38:  44%|████▎     | 51/117 [00:02<00:03, 19.38it/s, loss=1.34, v_num=1, val_acc=0.700]
Epoch 38:  44%|████▎     | 51/117 [00:02<00:03, 19.19it/s, loss=1.35, v_num=1, val_acc=0.700]
Epoch 38:  44%|████▍     | 52/117 [00:02<00:03, 19.48it/s, loss=1.35, v_num=1, val_acc=0.700]
Epoch 38:  44%|████▍     | 52/117 [00:02<00:03, 19.32it/s, loss=1.39, v_num=1, val_acc=0.700]
Epoch 38:  45%|████▌     | 53/117 [00:02<00:03, 19.61it/s, loss=1.39, v_num=1, val_acc=0.700]
Epoch 38:  45%|████▌     | 53/117 [00:02<00:03, 19.43it/s, loss=1.45, v_num=1, val_acc=0.700]
Epoch 38:  46%|████▌     | 54/117 [00:02<00:03, 19.70it/s, loss=1.45, v_num=1, val_acc=0.700]
Epoch 38:  46%|████▌     | 54/117 [00:02<00:03, 19.54it/s, loss=1.53, v_num=1, val_acc=0.700]
Epoch 38:  47%|████▋     | 55/117 [00:02<00:03, 19.83it/s, loss=1.53, v_num=1, val_acc=0.700]
Epoch 38:  47%|████▋     | 55/117 [00:02<00:03, 19.65it/s, loss=1.54, v_num=1, val_acc=0.700]
Epoch 38:  48%|████▊     | 56/117 [00:02<00:03, 19.93it/s, loss=1.54, v_num=1, val_acc=0.700]
Epoch 38:  48%|████▊     | 56/117 [00:02<00:03, 19.76it/s, loss=1.55, v_num=1, val_acc=0.700]
Epoch 38:  49%|████▊     | 57/117 [00:02<00:02, 20.03it/s, loss=1.55, v_num=1, val_acc=0.700]
Epoch 38:  49%|████▊     | 57/117 [00:02<00:03, 19.86it/s, loss=1.56, v_num=1, val_acc=0.700]
Epoch 38:  50%|████▉     | 58/117 [00:02<00:02, 20.14it/s, loss=1.56, v_num=1, val_acc=0.700]
Epoch 38:  50%|████▉     | 58/117 [00:02<00:02, 19.96it/s, loss=1.58, v_num=1, val_acc=0.700]
Epoch 38:  50%|█████     | 59/117 [00:02<00:02, 20.23it/s, loss=1.58, v_num=1, val_acc=0.700]
Epoch 38:  50%|█████     | 59/117 [00:02<00:02, 20.06it/s, loss=1.59, v_num=1, val_acc=0.700]
Epoch 38:  51%|█████▏    | 60/117 [00:02<00:02, 20.32it/s, loss=1.59, v_num=1, val_acc=0.700]
Epoch 38:  51%|█████▏    | 60/117 [00:02<00:02, 20.15it/s, loss=1.63, v_num=1, val_acc=0.700]
Epoch 38:  52%|█████▏    | 61/117 [00:02<00:02, 20.41it/s, loss=1.63, v_num=1, val_acc=0.700]
Epoch 38:  52%|█████▏    | 61/117 [00:03<00:02, 20.24it/s, loss=1.61, v_num=1, val_acc=0.700]
Epoch 38:  53%|█████▎    | 62/117 [00:03<00:02, 20.46it/s, loss=1.61, v_num=1, val_acc=0.700]
Epoch 38:  53%|█████▎    | 62/117 [00:03<00:02, 20.33it/s, loss=1.6, v_num=1, val_acc=0.700]
Epoch 38:  54%|█████▍    | 63/117 [00:03<00:02, 20.59it/s, loss=1.6, v_num=1, val_acc=0.700]
Epoch 38:  54%|█████▍    | 63/117 [00:03<00:02, 20.42it/s, loss=1.62, v_num=1, val_acc=0.700]
Epoch 38:  55%|█████▍    | 64/117 [00:03<00:02, 20.67it/s, loss=1.62, v_num=1, val_acc=0.700]
Epoch 38:  55%|█████▍    | 64/117 [00:03<00:02, 20.50it/s, loss=1.67, v_num=1, val_acc=0.700]
Epoch 38:  56%|█████▌    | 65/117 [00:03<00:02, 20.75it/s, loss=1.67, v_num=1, val_acc=0.700]
Epoch 38:  56%|█████▌    | 65/117 [00:03<00:02, 20.59it/s, loss=1.69, v_num=1, val_acc=0.700]
Epoch 38:  56%|█████▋    | 66/117 [00:03<00:02, 20.81it/s, loss=1.69, v_num=1, val_acc=0.700]
Epoch 38:  56%|█████▋    | 66/117 [00:03<00:02, 20.66it/s, loss=1.68, v_num=1, val_acc=0.700]
Epoch 38:  57%|█████▋    | 67/117 [00:03<00:02, 20.88it/s, loss=1.68, v_num=1, val_acc=0.700]
Epoch 38:  57%|█████▋    | 67/117 [00:03<00:02, 20.73it/s, loss=1.68, v_num=1, val_acc=0.700]
Epoch 38:  58%|█████▊    | 68/117 [00:03<00:02, 20.94it/s, loss=1.68, v_num=1, val_acc=0.700]
Epoch 38:  58%|█████▊    | 68/117 [00:03<00:02, 20.80it/s, loss=1.64, v_num=1, val_acc=0.700]
Epoch 38:  59%|█████▉    | 69/117 [00:03<00:02, 21.00it/s, loss=1.64, v_num=1, val_acc=0.700]
Epoch 38:  59%|█████▉    | 69/117 [00:03<00:02, 20.86it/s, loss=1.71, v_num=1, val_acc=0.700]
Epoch 38:  60%|█████▉    | 70/117 [00:03<00:02, 21.03it/s, loss=1.71, v_num=1, val_acc=0.700]
Epoch 38:  60%|█████▉    | 70/117 [00:03<00:02, 20.92it/s, loss=1.77, v_num=1, val_acc=0.700]
Epoch 38:  61%|██████    | 71/117 [00:03<00:02, 21.15it/s, loss=1.77, v_num=1, val_acc=0.700]
Epoch 38:  61%|██████    | 71/117 [00:03<00:02, 21.00it/s, loss=1.81, v_num=1, val_acc=0.700]
Epoch 38:  62%|██████▏   | 72/117 [00:03<00:02, 21.23it/s, loss=1.81, v_num=1, val_acc=0.700]
Epoch 38:  62%|██████▏   | 72/117 [00:03<00:02, 21.07it/s, loss=1.76, v_num=1, val_acc=0.700]
Epoch 38:  62%|██████▏   | 73/117 [00:03<00:02, 21.27it/s, loss=1.76, v_num=1, val_acc=0.700]
Epoch 38:  62%|██████▏   | 73/117 [00:03<00:02, 21.13it/s, loss=1.69, v_num=1, val_acc=0.700]
Epoch 38:  63%|██████▎   | 74/117 [00:03<00:02, 21.36it/s, loss=1.69, v_num=1, val_acc=0.700]
Epoch 38:  63%|██████▎   | 74/117 [00:03<00:02, 21.21it/s, loss=1.62, v_num=1, val_acc=0.700]
Epoch 38:  64%|██████▍   | 75/117 [00:03<00:01, 21.38it/s, loss=1.62, v_num=1, val_acc=0.700]
Epoch 38:  64%|██████▍   | 75/117 [00:03<00:01, 21.26it/s, loss=1.61, v_num=1, val_acc=0.700]
Epoch 38:  65%|██████▍   | 76/117 [00:03<00:01, 21.48it/s, loss=1.61, v_num=1, val_acc=0.700]
Epoch 38:  65%|██████▍   | 76/117 [00:03<00:01, 21.33it/s, loss=1.62, v_num=1, val_acc=0.700]
Epoch 38:  66%|██████▌   | 77/117 [00:03<00:01, 21.54it/s, loss=1.62, v_num=1, val_acc=0.700]
Epoch 38:  66%|██████▌   | 77/117 [00:03<00:01, 21.40it/s, loss=1.61, v_num=1, val_acc=0.700]
Epoch 38:  67%|██████▋   | 78/117 [00:03<00:01, 21.56it/s, loss=1.61, v_num=1, val_acc=0.700]
Epoch 38:  67%|██████▋   | 78/117 [00:03<00:01, 21.46it/s, loss=1.6, v_num=1, val_acc=0.700]
Epoch 38:  68%|██████▊   | 79/117 [00:03<00:01, 21.65it/s, loss=1.6, v_num=1, val_acc=0.700]
Epoch 38:  68%|██████▊   | 79/117 [00:03<00:01, 21.51it/s, loss=1.59, v_num=1, val_acc=0.700]
Epoch 38:  68%|██████▊   | 80/117 [00:03<00:01, 21.70it/s, loss=1.59, v_num=1, val_acc=0.700]
Epoch 38:  68%|██████▊   | 80/117 [00:03<00:01, 21.57it/s, loss=1.57, v_num=1, val_acc=0.700]
Epoch 38:  69%|██████▉   | 81/117 [00:03<00:01, 21.77it/s, loss=1.57, v_num=1, val_acc=0.700]
Epoch 38:  69%|██████▉   | 81/117 [00:03<00:01, 21.62it/s, loss=1.57, v_num=1, val_acc=0.700]
Epoch 38:  70%|███████   | 82/117 [00:03<00:01, 21.81it/s, loss=1.57, v_num=1, val_acc=0.700]
Epoch 38:  70%|███████   | 82/117 [00:03<00:01, 21.67it/s, loss=1.56, v_num=1, val_acc=0.700]
Epoch 38:  71%|███████   | 83/117 [00:03<00:01, 21.86it/s, loss=1.56, v_num=1, val_acc=0.700]
Epoch 38:  71%|███████   | 83/117 [00:03<00:01, 21.73it/s, loss=1.56, v_num=1, val_acc=0.700]
Epoch 38:  72%|███████▏  | 84/117 [00:03<00:01, 21.94it/s, loss=1.56, v_num=1, val_acc=0.700]
Epoch 38:  72%|███████▏  | 84/117 [00:03<00:01, 21.79it/s, loss=1.55, v_num=1, val_acc=0.700]
Epoch 38:  73%|███████▎  | 85/117 [00:03<00:01, 22.00it/s, loss=1.55, v_num=1, val_acc=0.700]
Epoch 38:  73%|███████▎  | 85/117 [00:03<00:01, 21.86it/s, loss=1.59, v_num=1, val_acc=0.700]
Epoch 38:  74%|███████▎  | 86/117 [00:03<00:01, 22.06it/s, loss=1.59, v_num=1, val_acc=0.700]
Epoch 38:  74%|███████▎  | 86/117 [00:03<00:01, 21.92it/s, loss=1.58, v_num=1, val_acc=0.700]
Epoch 38:  74%|███████▍  | 87/117 [00:03<00:01, 22.13it/s, loss=1.58, v_num=1, val_acc=0.700]
Epoch 38:  74%|███████▍  | 87/117 [00:03<00:01, 21.98it/s, loss=1.56, v_num=1, val_acc=0.700]
Epoch 38:  75%|███████▌  | 88/117 [00:03<00:01, 22.19it/s, loss=1.56, v_num=1, val_acc=0.700]
Epoch 38:  75%|███████▌  | 88/117 [00:03<00:01, 22.05it/s, loss=1.54, v_num=1, val_acc=0.700]
Epoch 38:  76%|███████▌  | 89/117 [00:04<00:01, 22.24it/s, loss=1.54, v_num=1, val_acc=0.700]
Epoch 38:  76%|███████▌  | 89/117 [00:04<00:01, 22.10it/s, loss=1.47, v_num=1, val_acc=0.700]
Epoch 38:  77%|███████▋  | 90/117 [00:04<00:01, 22.31it/s, loss=1.47, v_num=1, val_acc=0.700]
Epoch 38:  77%|███████▋  | 90/117 [00:04<00:01, 22.17it/s, loss=1.49, v_num=1, val_acc=0.700]
Epoch 38:  78%|███████▊  | 91/117 [00:04<00:01, 22.37it/s, loss=1.49, v_num=1, val_acc=0.700]
Epoch 38:  78%|███████▊  | 91/117 [00:04<00:01, 22.23it/s, loss=1.46, v_num=1, val_acc=0.700]
Epoch 38:  79%|███████▊  | 92/117 [00:04<00:01, 22.42it/s, loss=1.46, v_num=1, val_acc=0.700]
Epoch 38:  79%|███████▊  | 92/117 [00:04<00:01, 22.29it/s, loss=1.47, v_num=1, val_acc=0.700]
Epoch 38:  79%|███████▉  | 93/117 [00:04<00:01, 22.48it/s, loss=1.47, v_num=1, val_acc=0.700]
Epoch 38:  79%|███████▉  | 93/117 [00:04<00:01, 22.34it/s, loss=1.47, v_num=1, val_acc=0.700]
Epoch 38:  80%|████████  | 94/117 [00:04<00:01, 22.54it/s, loss=1.47, v_num=1, val_acc=0.700]
Epoch 38:  80%|████████  | 94/117 [00:04<00:01, 22.40it/s, loss=1.47, v_num=1, val_acc=0.700]
Epoch 38:  81%|████████  | 95/117 [00:04<00:00, 22.59it/s, loss=1.47, v_num=1, val_acc=0.700]
Epoch 38:  81%|████████  | 95/117 [00:04<00:00, 22.46it/s, loss=1.44, v_num=1, val_acc=0.700]
Epoch 38:  82%|████████▏ | 96/117 [00:04<00:00, 22.64it/s, loss=1.44, v_num=1, val_acc=0.700]
Epoch 38:  82%|████████▏ | 96/117 [00:04<00:00, 22.51it/s, loss=1.44, v_num=1, val_acc=0.700]
Epoch 38:  83%|████████▎ | 97/117 [00:04<00:00, 22.69it/s, loss=1.44, v_num=1, val_acc=0.700]
Epoch 38:  83%|████████▎ | 97/117 [00:04<00:00, 22.56it/s, loss=1.45, v_num=1, val_acc=0.700]

Validation: 0it [00:00, ?it/s]

Validation:   0%|          | 0/20 [00:00<?, ?it/s]

Validation DataLoader 0:   0%|          | 0/20 [00:00<?, ?it/s]

Validation DataLoader 0:   5%|▌         | 1/20 [00:00<00:00, 180.29it/s]
Epoch 38:  84%|████████▍ | 98/117 [00:05<00:00, 19.09it/s, loss=1.45, v_num=1, val_acc=0.700]

Validation DataLoader 0:  10%|█         | 2/20 [00:00<00:00, 55.46it/s]
Epoch 38:  85%|████████▍ | 99/117 [00:05<00:00, 19.17it/s, loss=1.45, v_num=1, val_acc=0.700]

Validation DataLoader 0:  15%|█▌        | 3/20 [00:00<00:00, 44.57it/s]
Epoch 38:  85%|████████▌ | 100/117 [00:05<00:00, 19.24it/s, loss=1.45, v_num=1, val_acc=0.700]

Validation DataLoader 0:  20%|██        | 4/20 [00:00<00:00, 40.45it/s]
Epoch 38:  86%|████████▋ | 101/117 [00:05<00:00, 19.32it/s, loss=1.45, v_num=1, val_acc=0.700]

Validation DataLoader 0:  25%|██▌       | 5/20 [00:00<00:00, 38.34it/s]
Epoch 38:  87%|████████▋ | 102/117 [00:05<00:00, 19.39it/s, loss=1.45, v_num=1, val_acc=0.700]

Validation DataLoader 0:  30%|███       | 6/20 [00:00<00:00, 37.04it/s]
Epoch 38:  88%|████████▊ | 103/117 [00:05<00:00, 19.47it/s, loss=1.45, v_num=1, val_acc=0.700]

Validation DataLoader 0:  35%|███▌      | 7/20 [00:00<00:00, 35.33it/s]
Epoch 38:  89%|████████▉ | 104/117 [00:05<00:00, 19.52it/s, loss=1.45, v_num=1, val_acc=0.700]

Validation DataLoader 0:  40%|████      | 8/20 [00:00<00:00, 35.19it/s]
Epoch 38:  90%|████████▉ | 105/117 [00:05<00:00, 19.60it/s, loss=1.45, v_num=1, val_acc=0.700]

Validation DataLoader 0:  45%|████▌     | 9/20 [00:00<00:00, 34.74it/s]
Epoch 38:  91%|█████████ | 106/117 [00:05<00:00, 19.67it/s, loss=1.45, v_num=1, val_acc=0.700]

Validation DataLoader 0:  50%|█████     | 10/20 [00:00<00:00, 34.44it/s]
Epoch 38:  91%|█████████▏| 107/117 [00:05<00:00, 19.74it/s, loss=1.45, v_num=1, val_acc=0.700]

Validation DataLoader 0:  55%|█████▌    | 11/20 [00:00<00:00, 34.15it/s]
Epoch 38:  92%|█████████▏| 108/117 [00:05<00:00, 19.81it/s, loss=1.45, v_num=1, val_acc=0.700]

Validation DataLoader 0:  60%|██████    | 12/20 [00:00<00:00, 33.95it/s]
Epoch 38:  93%|█████████▎| 109/117 [00:05<00:00, 19.88it/s, loss=1.45, v_num=1, val_acc=0.700]

Validation DataLoader 0:  65%|██████▌   | 13/20 [00:00<00:00, 33.78it/s]
Epoch 38:  94%|█████████▍| 110/117 [00:05<00:00, 19.95it/s, loss=1.45, v_num=1, val_acc=0.700]

Validation DataLoader 0:  70%|███████   | 14/20 [00:00<00:00, 33.61it/s]
Epoch 38:  95%|█████████▍| 111/117 [00:05<00:00, 20.02it/s, loss=1.45, v_num=1, val_acc=0.700]

Validation DataLoader 0:  75%|███████▌  | 15/20 [00:00<00:00, 33.48it/s]
Epoch 38:  96%|█████████▌| 112/117 [00:05<00:00, 20.08it/s, loss=1.45, v_num=1, val_acc=0.700]

Validation DataLoader 0:  80%|████████  | 16/20 [00:00<00:00, 33.37it/s]
Epoch 38:  97%|█████████▋| 113/117 [00:05<00:00, 20.15it/s, loss=1.45, v_num=1, val_acc=0.700]

Validation DataLoader 0:  85%|████████▌ | 17/20 [00:00<00:00, 33.26it/s]
Epoch 38:  97%|█████████▋| 114/117 [00:05<00:00, 20.21it/s, loss=1.45, v_num=1, val_acc=0.700]

Validation DataLoader 0:  90%|█████████ | 18/20 [00:00<00:00, 33.18it/s]
Epoch 38:  98%|█████████▊| 115/117 [00:05<00:00, 20.28it/s, loss=1.45, v_num=1, val_acc=0.700]

Validation DataLoader 0:  95%|█████████▌| 19/20 [00:00<00:00, 33.09it/s]
Epoch 38:  99%|█████████▉| 116/117 [00:05<00:00, 20.34it/s, loss=1.45, v_num=1, val_acc=0.700]

Validation DataLoader 0: 100%|██████████| 20/20 [00:00<00:00, 33.09it/s]
Epoch 38: 100%|██████████| 117/117 [00:05<00:00, 20.41it/s, loss=1.45, v_num=1, val_acc=0.700]
Epoch 38: 100%|██████████| 117/117 [00:05<00:00, 20.34it/s, loss=1.45, v_num=1, val_acc=0.689]


Epoch 38: 100%|██████████| 117/117 [00:05<00:00, 20.33it/s, loss=1.45, v_num=1, val_acc=0.689]
Epoch 38:   0%|          | 0/117 [00:00<?, ?it/s, loss=1.45, v_num=1, val_acc=0.689]
Epoch 39:   0%|          | 0/117 [00:00<?, ?it/s, loss=1.45, v_num=1, val_acc=0.689]
Epoch 39:   1%|          | 1/117 [00:00<01:45,  1.10it/s, loss=1.45, v_num=1, val_acc=0.689]
Epoch 39:   1%|          | 1/117 [00:00<01:48,  1.07it/s, loss=1.48, v_num=1, val_acc=0.689]
Epoch 39:   2%|▏         | 2/117 [00:00<00:55,  2.09it/s, loss=1.48, v_num=1, val_acc=0.689]
Epoch 39:   2%|▏         | 2/117 [00:00<00:56,  2.04it/s, loss=1.53, v_num=1, val_acc=0.689]
Epoch 39:   3%|▎         | 3/117 [00:00<00:37,  3.03it/s, loss=1.53, v_num=1, val_acc=0.689]
Epoch 39:   3%|▎         | 3/117 [00:01<00:38,  2.96it/s, loss=1.54, v_num=1, val_acc=0.689]
Epoch 39:   3%|▎         | 4/117 [00:01<00:28,  3.91it/s, loss=1.54, v_num=1, val_acc=0.689]
Epoch 39:   3%|▎         | 4/117 [00:01<00:29,  3.82it/s, loss=1.53, v_num=1, val_acc=0.689]
Epoch 39:   4%|▍         | 5/117 [00:01<00:23,  4.73it/s, loss=1.53, v_num=1, val_acc=0.689]
Epoch 39:   4%|▍         | 5/117 [00:01<00:24,  4.62it/s, loss=1.53, v_num=1, val_acc=0.689]
Epoch 39:   5%|▌         | 6/117 [00:01<00:20,  5.50it/s, loss=1.53, v_num=1, val_acc=0.689]
Epoch 39:   5%|▌         | 6/117 [00:01<00:20,  5.37it/s, loss=1.54, v_num=1, val_acc=0.689]
Epoch 39:   6%|▌         | 7/117 [00:01<00:17,  6.22it/s, loss=1.54, v_num=1, val_acc=0.689]
Epoch 39:   6%|▌         | 7/117 [00:01<00:18,  6.08it/s, loss=1.54, v_num=1, val_acc=0.689]
Epoch 39:   7%|▋         | 8/117 [00:01<00:15,  6.91it/s, loss=1.54, v_num=1, val_acc=0.689]
Epoch 39:   7%|▋         | 8/117 [00:01<00:16,  6.76it/s, loss=1.54, v_num=1, val_acc=0.689]
Epoch 39:   8%|▊         | 9/117 [00:01<00:14,  7.54it/s, loss=1.54, v_num=1, val_acc=0.689]
Epoch 39:   8%|▊         | 9/117 [00:01<00:14,  7.38it/s, loss=1.59, v_num=1, val_acc=0.689]
Epoch 39:   9%|▊         | 10/117 [00:01<00:13,  8.10it/s, loss=1.59, v_num=1, val_acc=0.689]
Epoch 39:   9%|▊         | 10/117 [00:01<00:13,  7.95it/s, loss=1.59, v_num=1, val_acc=0.689]
Epoch 39:   9%|▉         | 11/117 [00:01<00:12,  8.68it/s, loss=1.59, v_num=1, val_acc=0.689]
Epoch 39:   9%|▉         | 11/117 [00:01<00:12,  8.51it/s, loss=1.6, v_num=1, val_acc=0.689]
Epoch 39:  10%|█         | 12/117 [00:01<00:11,  9.23it/s, loss=1.6, v_num=1, val_acc=0.689]
Epoch 39:  10%|█         | 12/117 [00:01<00:11,  9.05it/s, loss=1.58, v_num=1, val_acc=0.689]
Epoch 39:  11%|█         | 13/117 [00:01<00:10,  9.74it/s, loss=1.58, v_num=1, val_acc=0.689]
Epoch 39:  11%|█         | 13/117 [00:01<00:10,  9.56it/s, loss=1.52, v_num=1, val_acc=0.689]
Epoch 39:  12%|█▏        | 14/117 [00:01<00:10, 10.23it/s, loss=1.52, v_num=1, val_acc=0.689]
Epoch 39:  12%|█▏        | 14/117 [00:01<00:10, 10.05it/s, loss=1.52, v_num=1, val_acc=0.689]
Epoch 39:  13%|█▎        | 15/117 [00:01<00:09, 10.70it/s, loss=1.52, v_num=1, val_acc=0.689]
Epoch 39:  13%|█▎        | 15/117 [00:01<00:09, 10.51it/s, loss=1.59, v_num=1, val_acc=0.689]
Epoch 39:  14%|█▎        | 16/117 [00:01<00:09, 11.14it/s, loss=1.59, v_num=1, val_acc=0.689]
Epoch 39:  14%|█▎        | 16/117 [00:01<00:09, 10.95it/s, loss=1.59, v_num=1, val_acc=0.689]
Epoch 39:  15%|█▍        | 17/117 [00:01<00:08, 11.55it/s, loss=1.59, v_num=1, val_acc=0.689]
Epoch 39:  15%|█▍        | 17/117 [00:01<00:08, 11.36it/s, loss=1.59, v_num=1, val_acc=0.689]
Epoch 39:  15%|█▌        | 18/117 [00:01<00:08, 11.89it/s, loss=1.59, v_num=1, val_acc=0.689]
Epoch 39:  15%|█▌        | 18/117 [00:01<00:08, 11.72it/s, loss=1.61, v_num=1, val_acc=0.689]
Epoch 39:  16%|█▌        | 19/117 [00:01<00:07, 12.30it/s, loss=1.61, v_num=1, val_acc=0.689]
Epoch 39:  16%|█▌        | 19/117 [00:01<00:08, 12.10it/s, loss=1.63, v_num=1, val_acc=0.689]
Epoch 39:  17%|█▋        | 20/117 [00:01<00:07, 12.67it/s, loss=1.63, v_num=1, val_acc=0.689]
Epoch 39:  17%|█▋        | 20/117 [00:01<00:07, 12.47it/s, loss=1.66, v_num=1, val_acc=0.689]
Epoch 39:  18%|█▊        | 21/117 [00:01<00:07, 13.03it/s, loss=1.66, v_num=1, val_acc=0.689]
Epoch 39:  18%|█▊        | 21/117 [00:01<00:07, 12.83it/s, loss=1.64, v_num=1, val_acc=0.689]
Epoch 39:  19%|█▉        | 22/117 [00:01<00:07, 13.34it/s, loss=1.64, v_num=1, val_acc=0.689]
Epoch 39:  19%|█▉        | 22/117 [00:01<00:07, 13.15it/s, loss=1.61, v_num=1, val_acc=0.689]
Epoch 39:  20%|█▉        | 23/117 [00:01<00:06, 13.65it/s, loss=1.61, v_num=1, val_acc=0.689]
Epoch 39:  20%|█▉        | 23/117 [00:01<00:06, 13.45it/s, loss=1.61, v_num=1, val_acc=0.689]
Epoch 39:  21%|██        | 24/117 [00:01<00:06, 13.96it/s, loss=1.61, v_num=1, val_acc=0.689]
Epoch 39:  21%|██        | 24/117 [00:01<00:06, 13.76it/s, loss=1.64, v_num=1, val_acc=0.689]
Epoch 39:  21%|██▏       | 25/117 [00:01<00:06, 14.25it/s, loss=1.64, v_num=1, val_acc=0.689]
Epoch 39:  21%|██▏       | 25/117 [00:01<00:06, 14.05it/s, loss=1.66, v_num=1, val_acc=0.689]
Epoch 39:  22%|██▏       | 26/117 [00:01<00:06, 14.52it/s, loss=1.66, v_num=1, val_acc=0.689]
Epoch 39:  22%|██▏       | 26/117 [00:01<00:06, 14.32it/s, loss=1.65, v_num=1, val_acc=0.689]
Epoch 39:  23%|██▎       | 27/117 [00:01<00:06, 14.80it/s, loss=1.65, v_num=1, val_acc=0.689]
Epoch 39:  23%|██▎       | 27/117 [00:01<00:06, 14.60it/s, loss=1.62, v_num=1, val_acc=0.689]
Epoch 39:  24%|██▍       | 28/117 [00:01<00:05, 15.07it/s, loss=1.62, v_num=1, val_acc=0.689]
Epoch 39:  24%|██▍       | 28/117 [00:01<00:05, 14.87it/s, loss=1.6, v_num=1, val_acc=0.689]
Epoch 39:  25%|██▍       | 29/117 [00:01<00:05, 15.33it/s, loss=1.6, v_num=1, val_acc=0.689]
Epoch 39:  25%|██▍       | 29/117 [00:01<00:05, 15.12it/s, loss=1.58, v_num=1, val_acc=0.689]
Epoch 39:  26%|██▌       | 30/117 [00:01<00:05, 15.57it/s, loss=1.58, v_num=1, val_acc=0.689]
Epoch 39:  26%|██▌       | 30/117 [00:01<00:05, 15.37it/s, loss=1.64, v_num=1, val_acc=0.689]
Epoch 39:  26%|██▋       | 31/117 [00:01<00:05, 15.80it/s, loss=1.64, v_num=1, val_acc=0.689]
Epoch 39:  26%|██▋       | 31/117 [00:01<00:05, 15.61it/s, loss=1.65, v_num=1, val_acc=0.689]
Epoch 39:  27%|██▋       | 32/117 [00:01<00:05, 16.03it/s, loss=1.65, v_num=1, val_acc=0.689]
Epoch 39:  27%|██▋       | 32/117 [00:02<00:05, 15.83it/s, loss=1.67, v_num=1, val_acc=0.689]
Epoch 39:  28%|██▊       | 33/117 [00:02<00:05, 16.25it/s, loss=1.67, v_num=1, val_acc=0.689]
Epoch 39:  28%|██▊       | 33/117 [00:02<00:05, 16.05it/s, loss=1.69, v_num=1, val_acc=0.689]
Epoch 39:  29%|██▉       | 34/117 [00:02<00:05, 16.42it/s, loss=1.69, v_num=1, val_acc=0.689]
Epoch 39:  29%|██▉       | 34/117 [00:02<00:05, 16.23it/s, loss=1.72, v_num=1, val_acc=0.689]
Epoch 39:  30%|██▉       | 35/117 [00:02<00:04, 16.64it/s, loss=1.72, v_num=1, val_acc=0.689]
Epoch 39:  30%|██▉       | 35/117 [00:02<00:04, 16.44it/s, loss=1.65, v_num=1, val_acc=0.689]
Epoch 39:  31%|███       | 36/117 [00:02<00:04, 16.84it/s, loss=1.65, v_num=1, val_acc=0.689]
Epoch 39:  31%|███       | 36/117 [00:02<00:04, 16.65it/s, loss=1.65, v_num=1, val_acc=0.689]
Epoch 39:  32%|███▏      | 37/117 [00:02<00:04, 17.04it/s, loss=1.65, v_num=1, val_acc=0.689]
Epoch 39:  32%|███▏      | 37/117 [00:02<00:04, 16.84it/s, loss=1.64, v_num=1, val_acc=0.689]
Epoch 39:  32%|███▏      | 38/117 [00:02<00:04, 17.22it/s, loss=1.64, v_num=1, val_acc=0.689]
Epoch 39:  32%|███▏      | 38/117 [00:02<00:04, 17.03it/s, loss=1.64, v_num=1, val_acc=0.689]
Epoch 39:  33%|███▎      | 39/117 [00:02<00:04, 17.41it/s, loss=1.64, v_num=1, val_acc=0.689]
Epoch 39:  33%|███▎      | 39/117 [00:02<00:04, 17.21it/s, loss=1.64, v_num=1, val_acc=0.689]
Epoch 39:  34%|███▍      | 40/117 [00:02<00:04, 17.58it/s, loss=1.64, v_num=1, val_acc=0.689]
Epoch 39:  34%|███▍      | 40/117 [00:02<00:04, 17.39it/s, loss=1.67, v_num=1, val_acc=0.689]
Epoch 39:  35%|███▌      | 41/117 [00:02<00:04, 17.76it/s, loss=1.67, v_num=1, val_acc=0.689]
Epoch 39:  35%|███▌      | 41/117 [00:02<00:04, 17.56it/s, loss=1.67, v_num=1, val_acc=0.689]
Epoch 39:  36%|███▌      | 42/117 [00:02<00:04, 17.89it/s, loss=1.67, v_num=1, val_acc=0.689]
Epoch 39:  36%|███▌      | 42/117 [00:02<00:04, 17.71it/s, loss=1.67, v_num=1, val_acc=0.689]
Epoch 39:  37%|███▋      | 43/117 [00:02<00:04, 18.07it/s, loss=1.67, v_num=1, val_acc=0.689]
Epoch 39:  37%|███▋      | 43/117 [00:02<00:04, 17.88it/s, loss=1.66, v_num=1, val_acc=0.689]
Epoch 39:  38%|███▊      | 44/117 [00:02<00:04, 18.22it/s, loss=1.66, v_num=1, val_acc=0.689]
Epoch 39:  38%|███▊      | 44/117 [00:02<00:04, 18.03it/s, loss=1.62, v_num=1, val_acc=0.689]
Epoch 39:  38%|███▊      | 45/117 [00:02<00:03, 18.38it/s, loss=1.62, v_num=1, val_acc=0.689]
Epoch 39:  38%|███▊      | 45/117 [00:02<00:03, 18.19it/s, loss=1.59, v_num=1, val_acc=0.689]
Epoch 39:  39%|███▉      | 46/117 [00:02<00:03, 18.53it/s, loss=1.59, v_num=1, val_acc=0.689]
Epoch 39:  39%|███▉      | 46/117 [00:02<00:03, 18.34it/s, loss=1.6, v_num=1, val_acc=0.689]
Epoch 39:  40%|████      | 47/117 [00:02<00:03, 18.67it/s, loss=1.6, v_num=1, val_acc=0.689]
Epoch 39:  40%|████      | 47/117 [00:02<00:03, 18.49it/s, loss=1.64, v_num=1, val_acc=0.689]
Epoch 39:  41%|████      | 48/117 [00:02<00:03, 18.81it/s, loss=1.64, v_num=1, val_acc=0.689]
Epoch 39:  41%|████      | 48/117 [00:02<00:03, 18.63it/s, loss=1.67, v_num=1, val_acc=0.689]
Epoch 39:  42%|████▏     | 49/117 [00:02<00:03, 18.95it/s, loss=1.67, v_num=1, val_acc=0.689]
Epoch 39:  42%|████▏     | 49/117 [00:02<00:03, 18.77it/s, loss=1.7, v_num=1, val_acc=0.689]
Epoch 39:  43%|████▎     | 50/117 [00:02<00:03, 19.08it/s, loss=1.7, v_num=1, val_acc=0.689]
Epoch 39:  43%|████▎     | 50/117 [00:02<00:03, 18.90it/s, loss=1.74, v_num=1, val_acc=0.689]
Epoch 39:  44%|████▎     | 51/117 [00:02<00:03, 19.22it/s, loss=1.74, v_num=1, val_acc=0.689]
Epoch 39:  44%|████▎     | 51/117 [00:02<00:03, 19.03it/s, loss=1.74, v_num=1, val_acc=0.689]
Epoch 39:  44%|████▍     | 52/117 [00:02<00:03, 19.34it/s, loss=1.74, v_num=1, val_acc=0.689]
Epoch 39:  44%|████▍     | 52/117 [00:02<00:03, 19.16it/s, loss=1.73, v_num=1, val_acc=0.689]
Epoch 39:  45%|████▌     | 53/117 [00:02<00:03, 19.47it/s, loss=1.73, v_num=1, val_acc=0.689]
Epoch 39:  45%|████▌     | 53/117 [00:02<00:03, 19.29it/s, loss=1.72, v_num=1, val_acc=0.689]
Epoch 39:  46%|████▌     | 54/117 [00:02<00:03, 19.59it/s, loss=1.72, v_num=1, val_acc=0.689]
Epoch 39:  46%|████▌     | 54/117 [00:02<00:03, 19.41it/s, loss=1.67, v_num=1, val_acc=0.689]
Epoch 39:  47%|████▋     | 55/117 [00:02<00:03, 19.71it/s, loss=1.67, v_num=1, val_acc=0.689]
Epoch 39:  47%|████▋     | 55/117 [00:02<00:03, 19.53it/s, loss=1.67, v_num=1, val_acc=0.689]
Epoch 39:  48%|████▊     | 56/117 [00:02<00:03, 19.82it/s, loss=1.67, v_num=1, val_acc=0.689]
Epoch 39:  48%|████▊     | 56/117 [00:02<00:03, 19.65it/s, loss=1.69, v_num=1, val_acc=0.689]
Epoch 39:  49%|████▊     | 57/117 [00:02<00:03, 19.94it/s, loss=1.69, v_num=1, val_acc=0.689]
Epoch 39:  49%|████▊     | 57/117 [00:02<00:03, 19.76it/s, loss=1.76, v_num=1, val_acc=0.689]
Epoch 39:  50%|████▉     | 58/117 [00:02<00:02, 20.05it/s, loss=1.76, v_num=1, val_acc=0.689]
Epoch 39:  50%|████▉     | 58/117 [00:02<00:02, 19.87it/s, loss=1.79, v_num=1, val_acc=0.689]
Epoch 39:  50%|█████     | 59/117 [00:02<00:02, 20.15it/s, loss=1.79, v_num=1, val_acc=0.689]
Epoch 39:  50%|█████     | 59/117 [00:02<00:02, 19.98it/s, loss=1.79, v_num=1, val_acc=0.689]
Epoch 39:  51%|█████▏    | 60/117 [00:02<00:02, 20.26it/s, loss=1.79, v_num=1, val_acc=0.689]
Epoch 39:  51%|█████▏    | 60/117 [00:02<00:02, 20.09it/s, loss=1.76, v_num=1, val_acc=0.689]
Epoch 39:  52%|█████▏    | 61/117 [00:02<00:02, 20.36it/s, loss=1.76, v_num=1, val_acc=0.689]
Epoch 39:  52%|█████▏    | 61/117 [00:03<00:02, 20.19it/s, loss=1.82, v_num=1, val_acc=0.689]
Epoch 39:  53%|█████▎    | 62/117 [00:03<00:02, 20.46it/s, loss=1.82, v_num=1, val_acc=0.689]
Epoch 39:  53%|█████▎    | 62/117 [00:03<00:02, 20.29it/s, loss=1.83, v_num=1, val_acc=0.689]
Epoch 39:  54%|█████▍    | 63/117 [00:03<00:02, 20.54it/s, loss=1.83, v_num=1, val_acc=0.689]
Epoch 39:  54%|█████▍    | 63/117 [00:03<00:02, 20.37it/s, loss=1.85, v_num=1, val_acc=0.689]
Epoch 39:  55%|█████▍    | 64/117 [00:03<00:02, 20.63it/s, loss=1.85, v_num=1, val_acc=0.689]
Epoch 39:  55%|█████▍    | 64/117 [00:03<00:02, 20.47it/s, loss=1.84, v_num=1, val_acc=0.689]
Epoch 39:  56%|█████▌    | 65/117 [00:03<00:02, 20.72it/s, loss=1.84, v_num=1, val_acc=0.689]
Epoch 39:  56%|█████▌    | 65/117 [00:03<00:02, 20.56it/s, loss=1.84, v_num=1, val_acc=0.689]
Epoch 39:  56%|█████▋    | 66/117 [00:03<00:02, 20.81it/s, loss=1.84, v_num=1, val_acc=0.689]
Epoch 39:  56%|█████▋    | 66/117 [00:03<00:02, 20.65it/s, loss=1.82, v_num=1, val_acc=0.689]
Epoch 39:  57%|█████▋    | 67/117 [00:03<00:02, 20.90it/s, loss=1.82, v_num=1, val_acc=0.689]
Epoch 39:  57%|█████▋    | 67/117 [00:03<00:02, 20.74it/s, loss=1.76, v_num=1, val_acc=0.689]
Epoch 39:  58%|█████▊    | 68/117 [00:03<00:02, 20.98it/s, loss=1.76, v_num=1, val_acc=0.689]
Epoch 39:  58%|█████▊    | 68/117 [00:03<00:02, 20.82it/s, loss=1.71, v_num=1, val_acc=0.689]
Epoch 39:  59%|█████▉    | 69/117 [00:03<00:02, 21.06it/s, loss=1.71, v_num=1, val_acc=0.689]
Epoch 39:  59%|█████▉    | 69/117 [00:03<00:02, 20.90it/s, loss=1.65, v_num=1, val_acc=0.689]
Epoch 39:  60%|█████▉    | 70/117 [00:03<00:02, 21.15it/s, loss=1.65, v_num=1, val_acc=0.689]
Epoch 39:  60%|█████▉    | 70/117 [00:03<00:02, 20.99it/s, loss=1.56, v_num=1, val_acc=0.689]
Epoch 39:  61%|██████    | 71/117 [00:03<00:02, 21.23it/s, loss=1.56, v_num=1, val_acc=0.689]
Epoch 39:  61%|██████    | 71/117 [00:03<00:02, 21.07it/s, loss=1.56, v_num=1, val_acc=0.689]
Epoch 39:  62%|██████▏   | 72/117 [00:03<00:02, 21.31it/s, loss=1.56, v_num=1, val_acc=0.689]
Epoch 39:  62%|██████▏   | 72/117 [00:03<00:02, 21.15it/s, loss=1.55, v_num=1, val_acc=0.689]
Epoch 39:  62%|██████▏   | 73/117 [00:03<00:02, 21.38it/s, loss=1.55, v_num=1, val_acc=0.689]
Epoch 39:  62%|██████▏   | 73/117 [00:03<00:02, 21.23it/s, loss=1.55, v_num=1, val_acc=0.689]
Epoch 39:  63%|██████▎   | 74/117 [00:03<00:02, 21.46it/s, loss=1.55, v_num=1, val_acc=0.689]
Epoch 39:  63%|██████▎   | 74/117 [00:03<00:02, 21.31it/s, loss=1.59, v_num=1, val_acc=0.689]
Epoch 39:  64%|██████▍   | 75/117 [00:03<00:01, 21.53it/s, loss=1.59, v_num=1, val_acc=0.689]
Epoch 39:  64%|██████▍   | 75/117 [00:03<00:01, 21.38it/s, loss=1.69, v_num=1, val_acc=0.689]
Epoch 39:  65%|██████▍   | 76/117 [00:03<00:01, 21.61it/s, loss=1.69, v_num=1, val_acc=0.689]
Epoch 39:  65%|██████▍   | 76/117 [00:03<00:01, 21.45it/s, loss=1.7, v_num=1, val_acc=0.689]
Epoch 39:  66%|██████▌   | 77/117 [00:03<00:01, 21.68it/s, loss=1.7, v_num=1, val_acc=0.689]
Epoch 39:  66%|██████▌   | 77/117 [00:03<00:01, 21.52it/s, loss=1.65, v_num=1, val_acc=0.689]
Epoch 39:  67%|██████▋   | 78/117 [00:03<00:01, 21.75it/s, loss=1.65, v_num=1, val_acc=0.689]
Epoch 39:  67%|██████▋   | 78/117 [00:03<00:01, 21.60it/s, loss=1.6, v_num=1, val_acc=0.689]
Epoch 39:  68%|██████▊   | 79/117 [00:03<00:01, 21.82it/s, loss=1.6, v_num=1, val_acc=0.689]
Epoch 39:  68%|██████▊   | 79/117 [00:03<00:01, 21.67it/s, loss=1.59, v_num=1, val_acc=0.689]
Epoch 39:  68%|██████▊   | 80/117 [00:03<00:01, 21.89it/s, loss=1.59, v_num=1, val_acc=0.689]
Epoch 39:  68%|██████▊   | 80/117 [00:03<00:01, 21.74it/s, loss=1.6, v_num=1, val_acc=0.689]
Epoch 39:  69%|██████▉   | 81/117 [00:03<00:01, 21.95it/s, loss=1.6, v_num=1, val_acc=0.689]
Epoch 39:  69%|██████▉   | 81/117 [00:03<00:01, 21.80it/s, loss=1.55, v_num=1, val_acc=0.689]
Epoch 39:  70%|███████   | 82/117 [00:03<00:01, 22.00it/s, loss=1.55, v_num=1, val_acc=0.689]
Epoch 39:  70%|███████   | 82/117 [00:03<00:01, 21.85it/s, loss=1.54, v_num=1, val_acc=0.689]
Epoch 39:  71%|███████   | 83/117 [00:03<00:01, 22.06it/s, loss=1.54, v_num=1, val_acc=0.689]
Epoch 39:  71%|███████   | 83/117 [00:03<00:01, 21.92it/s, loss=1.54, v_num=1, val_acc=0.689]
Epoch 39:  72%|███████▏  | 84/117 [00:03<00:01, 22.13it/s, loss=1.54, v_num=1, val_acc=0.689]
Epoch 39:  72%|███████▏  | 84/117 [00:03<00:01, 21.98it/s, loss=1.57, v_num=1, val_acc=0.689]
Epoch 39:  73%|███████▎  | 85/117 [00:03<00:01, 22.19it/s, loss=1.57, v_num=1, val_acc=0.689]
Epoch 39:  73%|███████▎  | 85/117 [00:03<00:01, 22.04it/s, loss=1.58, v_num=1, val_acc=0.689]
Epoch 39:  74%|███████▎  | 86/117 [00:03<00:01, 22.25it/s, loss=1.58, v_num=1, val_acc=0.689]
Epoch 39:  74%|███████▎  | 86/117 [00:03<00:01, 22.11it/s, loss=1.59, v_num=1, val_acc=0.689]
Epoch 39:  74%|███████▍  | 87/117 [00:03<00:01, 22.31it/s, loss=1.59, v_num=1, val_acc=0.689]
Epoch 39:  74%|███████▍  | 87/117 [00:03<00:01, 22.17it/s, loss=1.62, v_num=1, val_acc=0.689]
Epoch 39:  75%|███████▌  | 88/117 [00:03<00:01, 22.38it/s, loss=1.62, v_num=1, val_acc=0.689]
Epoch 39:  75%|███████▌  | 88/117 [00:03<00:01, 22.23it/s, loss=1.66, v_num=1, val_acc=0.689]
Epoch 39:  76%|███████▌  | 89/117 [00:03<00:01, 22.44it/s, loss=1.66, v_num=1, val_acc=0.689]
Epoch 39:  76%|███████▌  | 89/117 [00:03<00:01, 22.29it/s, loss=1.67, v_num=1, val_acc=0.689]
Epoch 39:  77%|███████▋  | 90/117 [00:04<00:01, 22.49it/s, loss=1.67, v_num=1, val_acc=0.689]
Epoch 39:  77%|███████▋  | 90/117 [00:04<00:01, 22.35it/s, loss=1.67, v_num=1, val_acc=0.689]
Epoch 39:  78%|███████▊  | 91/117 [00:04<00:01, 22.55it/s, loss=1.67, v_num=1, val_acc=0.689]
Epoch 39:  78%|███████▊  | 91/117 [00:04<00:01, 22.41it/s, loss=1.66, v_num=1, val_acc=0.689]
Epoch 39:  79%|███████▊  | 92/117 [00:04<00:01, 22.61it/s, loss=1.66, v_num=1, val_acc=0.689]
Epoch 39:  79%|███████▊  | 92/117 [00:04<00:01, 22.47it/s, loss=1.69, v_num=1, val_acc=0.689]
Epoch 39:  79%|███████▉  | 93/117 [00:04<00:01, 22.66it/s, loss=1.69, v_num=1, val_acc=0.689]
Epoch 39:  79%|███████▉  | 93/117 [00:04<00:01, 22.52it/s, loss=1.74, v_num=1, val_acc=0.689]
Epoch 39:  80%|████████  | 94/117 [00:04<00:01, 22.71it/s, loss=1.74, v_num=1, val_acc=0.689]
Epoch 39:  80%|████████  | 94/117 [00:04<00:01, 22.57it/s, loss=1.74, v_num=1, val_acc=0.689]
Epoch 39:  81%|████████  | 95/117 [00:04<00:00, 22.76it/s, loss=1.74, v_num=1, val_acc=0.689]
Epoch 39:  81%|████████  | 95/117 [00:04<00:00, 22.63it/s, loss=1.65, v_num=1, val_acc=0.689]
Epoch 39:  82%|████████▏ | 96/117 [00:04<00:00, 22.82it/s, loss=1.65, v_num=1, val_acc=0.689]
Epoch 39:  82%|████████▏ | 96/117 [00:04<00:00, 22.68it/s, loss=1.64, v_num=1, val_acc=0.689]
Epoch 39:  83%|████████▎ | 97/117 [00:04<00:00, 22.87it/s, loss=1.64, v_num=1, val_acc=0.689]
Epoch 39:  83%|████████▎ | 97/117 [00:04<00:00, 22.73it/s, loss=1.65, v_num=1, val_acc=0.689]

Validation: 0it [00:00, ?it/s]

Validation:   0%|          | 0/20 [00:00<?, ?it/s]

Validation DataLoader 0:   0%|          | 0/20 [00:00<?, ?it/s]

Validation DataLoader 0:   5%|▌         | 1/20 [00:00<00:00, 181.60it/s]
Epoch 39:  84%|████████▍ | 98/117 [00:05<00:00, 19.10it/s, loss=1.65, v_num=1, val_acc=0.689]

Validation DataLoader 0:  10%|█         | 2/20 [00:00<00:00, 54.78it/s]
Epoch 39:  85%|████████▍ | 99/117 [00:05<00:00, 19.18it/s, loss=1.65, v_num=1, val_acc=0.689]

Validation DataLoader 0:  15%|█▌        | 3/20 [00:00<00:00, 44.17it/s]
Epoch 39:  85%|████████▌ | 100/117 [00:05<00:00, 19.25it/s, loss=1.65, v_num=1, val_acc=0.689]

Validation DataLoader 0:  20%|██        | 4/20 [00:00<00:00, 40.16it/s]
Epoch 39:  86%|████████▋ | 101/117 [00:05<00:00, 19.33it/s, loss=1.65, v_num=1, val_acc=0.689]

Validation DataLoader 0:  25%|██▌       | 5/20 [00:00<00:00, 38.09it/s]
Epoch 39:  87%|████████▋ | 102/117 [00:05<00:00, 19.40it/s, loss=1.65, v_num=1, val_acc=0.689]

Validation DataLoader 0:  30%|███       | 6/20 [00:00<00:00, 36.79it/s]
Epoch 39:  88%|████████▊ | 103/117 [00:05<00:00, 19.47it/s, loss=1.65, v_num=1, val_acc=0.689]

Validation DataLoader 0:  35%|███▌      | 7/20 [00:00<00:00, 36.04it/s]
Epoch 39:  89%|████████▉ | 104/117 [00:05<00:00, 19.55it/s, loss=1.65, v_num=1, val_acc=0.689]

Validation DataLoader 0:  40%|████      | 8/20 [00:00<00:00, 35.48it/s]
Epoch 39:  90%|████████▉ | 105/117 [00:05<00:00, 19.62it/s, loss=1.65, v_num=1, val_acc=0.689]

Validation DataLoader 0:  45%|████▌     | 9/20 [00:00<00:00, 35.01it/s]
Epoch 39:  91%|█████████ | 106/117 [00:05<00:00, 19.69it/s, loss=1.65, v_num=1, val_acc=0.689]

Validation DataLoader 0:  50%|█████     | 10/20 [00:00<00:00, 34.65it/s]
Epoch 39:  91%|█████████▏| 107/117 [00:05<00:00, 19.76it/s, loss=1.65, v_num=1, val_acc=0.689]

Validation DataLoader 0:  55%|█████▌    | 11/20 [00:00<00:00, 34.38it/s]
Epoch 39:  92%|█████████▏| 108/117 [00:05<00:00, 19.83it/s, loss=1.65, v_num=1, val_acc=0.689]

Validation DataLoader 0:  60%|██████    | 12/20 [00:00<00:00, 34.15it/s]
Epoch 39:  93%|█████████▎| 109/117 [00:05<00:00, 19.90it/s, loss=1.65, v_num=1, val_acc=0.689]

Validation DataLoader 0:  65%|██████▌   | 13/20 [00:00<00:00, 33.95it/s]
Epoch 39:  94%|█████████▍| 110/117 [00:05<00:00, 19.97it/s, loss=1.65, v_num=1, val_acc=0.689]

Validation DataLoader 0:  70%|███████   | 14/20 [00:00<00:00, 33.77it/s]
Epoch 39:  95%|█████████▍| 111/117 [00:05<00:00, 20.03it/s, loss=1.65, v_num=1, val_acc=0.689]

Validation DataLoader 0:  75%|███████▌  | 15/20 [00:00<00:00, 33.64it/s]
Epoch 39:  96%|█████████▌| 112/117 [00:05<00:00, 20.10it/s, loss=1.65, v_num=1, val_acc=0.689]

Validation DataLoader 0:  80%|████████  | 16/20 [00:00<00:00, 33.52it/s]
Epoch 39:  97%|█████████▋| 113/117 [00:05<00:00, 20.17it/s, loss=1.65, v_num=1, val_acc=0.689]

Validation DataLoader 0:  85%|████████▌ | 17/20 [00:00<00:00, 33.41it/s]
Epoch 39:  97%|█████████▋| 114/117 [00:05<00:00, 20.23it/s, loss=1.65, v_num=1, val_acc=0.689]

Validation DataLoader 0:  90%|█████████ | 18/20 [00:00<00:00, 33.31it/s]
Epoch 39:  98%|█████████▊| 115/117 [00:05<00:00, 20.29it/s, loss=1.65, v_num=1, val_acc=0.689]

Validation DataLoader 0:  95%|█████████▌| 19/20 [00:00<00:00, 33.20it/s]
Epoch 39:  99%|█████████▉| 116/117 [00:05<00:00, 20.36it/s, loss=1.65, v_num=1, val_acc=0.689]

Validation DataLoader 0: 100%|██████████| 20/20 [00:00<00:00, 33.19it/s]
Epoch 39: 100%|██████████| 117/117 [00:05<00:00, 20.42it/s, loss=1.65, v_num=1, val_acc=0.689]
Epoch 39: 100%|██████████| 117/117 [00:05<00:00, 20.35it/s, loss=1.65, v_num=1, val_acc=0.695]


Epoch 39: 100%|██████████| 117/117 [00:05<00:00, 20.35it/s, loss=1.65, v_num=1, val_acc=0.695]
Epoch 39:   0%|          | 0/117 [00:00<?, ?it/s, loss=1.65, v_num=1, val_acc=0.695]
Epoch 40:   0%|          | 0/117 [00:00<?, ?it/s, loss=1.65, v_num=1, val_acc=0.695]
Epoch 40:   1%|          | 1/117 [00:00<01:48,  1.07it/s, loss=1.65, v_num=1, val_acc=0.695]
Epoch 40:   1%|          | 1/117 [00:00<01:50,  1.05it/s, loss=1.69, v_num=1, val_acc=0.695]
Epoch 40:   2%|▏         | 2/117 [00:00<00:55,  2.07it/s, loss=1.69, v_num=1, val_acc=0.695]
Epoch 40:   2%|▏         | 2/117 [00:00<00:56,  2.02it/s, loss=1.69, v_num=1, val_acc=0.695]
Epoch 40:   3%|▎         | 3/117 [00:00<00:37,  3.00it/s, loss=1.69, v_num=1, val_acc=0.695]
Epoch 40:   3%|▎         | 3/117 [00:01<00:38,  2.93it/s, loss=1.64, v_num=1, val_acc=0.695]
Epoch 40:   3%|▎         | 4/117 [00:01<00:29,  3.87it/s, loss=1.64, v_num=1, val_acc=0.695]
Epoch 40:   3%|▎         | 4/117 [00:01<00:29,  3.78it/s, loss=1.63, v_num=1, val_acc=0.695]
Epoch 40:   4%|▍         | 5/117 [00:01<00:23,  4.69it/s, loss=1.63, v_num=1, val_acc=0.695]
Epoch 40:   4%|▍         | 5/117 [00:01<00:24,  4.58it/s, loss=1.61, v_num=1, val_acc=0.695]
Epoch 40:   5%|▌         | 6/117 [00:01<00:20,  5.46it/s, loss=1.61, v_num=1, val_acc=0.695]
Epoch 40:   5%|▌         | 6/117 [00:01<00:20,  5.33it/s, loss=1.6, v_num=1, val_acc=0.695]
Epoch 40:   6%|▌         | 7/117 [00:01<00:17,  6.18it/s, loss=1.6, v_num=1, val_acc=0.695]
Epoch 40:   6%|▌         | 7/117 [00:01<00:18,  6.04it/s, loss=1.61, v_num=1, val_acc=0.695]
Epoch 40:   7%|▋         | 8/117 [00:01<00:15,  6.86it/s, loss=1.61, v_num=1, val_acc=0.695]
Epoch 40:   7%|▋         | 8/117 [00:01<00:16,  6.71it/s, loss=1.58, v_num=1, val_acc=0.695]
Epoch 40:   8%|▊         | 9/117 [00:01<00:14,  7.45it/s, loss=1.58, v_num=1, val_acc=0.695]
Epoch 40:   8%|▊         | 9/117 [00:01<00:14,  7.30it/s, loss=1.56, v_num=1, val_acc=0.695]
Epoch 40:   9%|▊         | 10/117 [00:01<00:13,  8.05it/s, loss=1.56, v_num=1, val_acc=0.695]
Epoch 40:   9%|▊         | 10/117 [00:01<00:13,  7.89it/s, loss=1.53, v_num=1, val_acc=0.695]
Epoch 40:   9%|▉         | 11/117 [00:01<00:12,  8.62it/s, loss=1.53, v_num=1, val_acc=0.695]
Epoch 40:   9%|▉         | 11/117 [00:01<00:12,  8.46it/s, loss=1.48, v_num=1, val_acc=0.695]
Epoch 40:  10%|█         | 12/117 [00:01<00:11,  9.17it/s, loss=1.48, v_num=1, val_acc=0.695]
Epoch 40:  10%|█         | 12/117 [00:01<00:11,  8.99it/s, loss=1.47, v_num=1, val_acc=0.695]
Epoch 40:  11%|█         | 13/117 [00:01<00:10,  9.69it/s, loss=1.47, v_num=1, val_acc=0.695]
Epoch 40:  11%|█         | 13/117 [00:01<00:10,  9.51it/s, loss=1.46, v_num=1, val_acc=0.695]
Epoch 40:  12%|█▏        | 14/117 [00:01<00:10, 10.18it/s, loss=1.46, v_num=1, val_acc=0.695]
Epoch 40:  12%|█▏        | 14/117 [00:01<00:10,  9.99it/s, loss=1.48, v_num=1, val_acc=0.695]
Epoch 40:  13%|█▎        | 15/117 [00:01<00:09, 10.64it/s, loss=1.48, v_num=1, val_acc=0.695]
Epoch 40:  13%|█▎        | 15/117 [00:01<00:09, 10.46it/s, loss=1.46, v_num=1, val_acc=0.695]
Epoch 40:  14%|█▎        | 16/117 [00:01<00:09, 11.09it/s, loss=1.46, v_num=1, val_acc=0.695]
Epoch 40:  14%|█▎        | 16/117 [00:01<00:09, 10.90it/s, loss=1.41, v_num=1, val_acc=0.695]
Epoch 40:  15%|█▍        | 17/117 [00:01<00:08, 11.49it/s, loss=1.41, v_num=1, val_acc=0.695]
Epoch 40:  15%|█▍        | 17/117 [00:01<00:08, 11.30it/s, loss=1.35, v_num=1, val_acc=0.695]
Epoch 40:  15%|█▌        | 18/117 [00:01<00:08, 11.89it/s, loss=1.35, v_num=1, val_acc=0.695]
Epoch 40:  15%|█▌        | 18/117 [00:01<00:08, 11.70it/s, loss=1.33, v_num=1, val_acc=0.695]
Epoch 40:  16%|█▌        | 19/117 [00:01<00:07, 12.28it/s, loss=1.33, v_num=1, val_acc=0.695]
Epoch 40:  16%|█▌        | 19/117 [00:01<00:08, 12.08it/s, loss=1.3, v_num=1, val_acc=0.695]
Epoch 40:  17%|█▋        | 20/117 [00:01<00:07, 12.66it/s, loss=1.3, v_num=1, val_acc=0.695]
Epoch 40:  17%|█▋        | 20/117 [00:01<00:07, 12.45it/s, loss=1.28, v_num=1, val_acc=0.695]
Epoch 40:  18%|█▊        | 21/117 [00:01<00:07, 13.00it/s, loss=1.28, v_num=1, val_acc=0.695]
Epoch 40:  18%|█▊        | 21/117 [00:01<00:07, 12.80it/s, loss=1.26, v_num=1, val_acc=0.695]
Epoch 40:  19%|█▉        | 22/117 [00:01<00:07, 13.34it/s, loss=1.26, v_num=1, val_acc=0.695]
Epoch 40:  19%|█▉        | 22/117 [00:01<00:07, 13.14it/s, loss=1.28, v_num=1, val_acc=0.695]
Epoch 40:  20%|█▉        | 23/117 [00:01<00:06, 13.66it/s, loss=1.28, v_num=1, val_acc=0.695]
Epoch 40:  20%|█▉        | 23/117 [00:01<00:06, 13.46it/s, loss=1.34, v_num=1, val_acc=0.695]
Epoch 40:  21%|██        | 24/117 [00:01<00:06, 13.97it/s, loss=1.34, v_num=1, val_acc=0.695]
Epoch 40:  21%|██        | 24/117 [00:01<00:06, 13.77it/s, loss=1.36, v_num=1, val_acc=0.695]
Epoch 40:  21%|██▏       | 25/117 [00:01<00:06, 14.27it/s, loss=1.36, v_num=1, val_acc=0.695]
Epoch 40:  21%|██▏       | 25/117 [00:01<00:06, 14.07it/s, loss=1.37, v_num=1, val_acc=0.695]
Epoch 40:  22%|██▏       | 26/117 [00:01<00:06, 14.54it/s, loss=1.37, v_num=1, val_acc=0.695]
Epoch 40:  22%|██▏       | 26/117 [00:01<00:06, 14.34it/s, loss=1.36, v_num=1, val_acc=0.695]
Epoch 40:  23%|██▎       | 27/117 [00:01<00:06, 14.83it/s, loss=1.36, v_num=1, val_acc=0.695]
Epoch 40:  23%|██▎       | 27/117 [00:01<00:06, 14.62it/s, loss=1.33, v_num=1, val_acc=0.695]
Epoch 40:  24%|██▍       | 28/117 [00:01<00:05, 15.10it/s, loss=1.33, v_num=1, val_acc=0.695]
Epoch 40:  24%|██▍       | 28/117 [00:01<00:05, 14.89it/s, loss=1.38, v_num=1, val_acc=0.695]
Epoch 40:  25%|██▍       | 29/117 [00:01<00:05, 15.35it/s, loss=1.38, v_num=1, val_acc=0.695]
Epoch 40:  25%|██▍       | 29/117 [00:01<00:05, 15.15it/s, loss=1.41, v_num=1, val_acc=0.695]
Epoch 40:  26%|██▌       | 30/117 [00:01<00:05, 15.60it/s, loss=1.41, v_num=1, val_acc=0.695]
Epoch 40:  26%|██▌       | 30/117 [00:01<00:05, 15.39it/s, loss=1.43, v_num=1, val_acc=0.695]
Epoch 40:  26%|██▋       | 31/117 [00:01<00:05, 15.83it/s, loss=1.43, v_num=1, val_acc=0.695]
Epoch 40:  26%|██▋       | 31/117 [00:01<00:05, 15.63it/s, loss=1.46, v_num=1, val_acc=0.695]
Epoch 40:  27%|██▋       | 32/117 [00:01<00:05, 16.02it/s, loss=1.46, v_num=1, val_acc=0.695]
Epoch 40:  27%|██▋       | 32/117 [00:02<00:05, 15.85it/s, loss=1.52, v_num=1, val_acc=0.695]
Epoch 40:  28%|██▊       | 33/117 [00:02<00:05, 16.27it/s, loss=1.52, v_num=1, val_acc=0.695]
Epoch 40:  28%|██▊       | 33/117 [00:02<00:05, 16.07it/s, loss=1.53, v_num=1, val_acc=0.695]
Epoch 40:  29%|██▉       | 34/117 [00:02<00:05, 16.48it/s, loss=1.53, v_num=1, val_acc=0.695]
Epoch 40:  29%|██▉       | 34/117 [00:02<00:05, 16.28it/s, loss=1.52, v_num=1, val_acc=0.695]
Epoch 40:  30%|██▉       | 35/117 [00:02<00:04, 16.69it/s, loss=1.52, v_num=1, val_acc=0.695]
Epoch 40:  30%|██▉       | 35/117 [00:02<00:04, 16.49it/s, loss=1.52, v_num=1, val_acc=0.695]
Epoch 40:  31%|███       | 36/117 [00:02<00:04, 16.85it/s, loss=1.52, v_num=1, val_acc=0.695]
Epoch 40:  31%|███       | 36/117 [00:02<00:04, 16.67it/s, loss=1.54, v_num=1, val_acc=0.695]
Epoch 40:  32%|███▏      | 37/117 [00:02<00:04, 17.04it/s, loss=1.54, v_num=1, val_acc=0.695]
Epoch 40:  32%|███▏      | 37/117 [00:02<00:04, 16.86it/s, loss=1.56, v_num=1, val_acc=0.695]
Epoch 40:  32%|███▏      | 38/117 [00:02<00:04, 17.24it/s, loss=1.56, v_num=1, val_acc=0.695]
Epoch 40:  32%|███▏      | 38/117 [00:02<00:04, 17.04it/s, loss=1.57, v_num=1, val_acc=0.695]
Epoch 40:  33%|███▎      | 39/117 [00:02<00:04, 17.42it/s, loss=1.57, v_num=1, val_acc=0.695]
Epoch 40:  33%|███▎      | 39/117 [00:02<00:04, 17.23it/s, loss=1.59, v_num=1, val_acc=0.695]
Epoch 40:  34%|███▍      | 40/117 [00:02<00:04, 17.60it/s, loss=1.59, v_num=1, val_acc=0.695]
Epoch 40:  34%|███▍      | 40/117 [00:02<00:04, 17.40it/s, loss=1.59, v_num=1, val_acc=0.695]
Epoch 40:  35%|███▌      | 41/117 [00:02<00:04, 17.77it/s, loss=1.59, v_num=1, val_acc=0.695]
Epoch 40:  35%|███▌      | 41/117 [00:02<00:04, 17.58it/s, loss=1.62, v_num=1, val_acc=0.695]
Epoch 40:  36%|███▌      | 42/117 [00:02<00:04, 17.94it/s, loss=1.62, v_num=1, val_acc=0.695]
Epoch 40:  36%|███▌      | 42/117 [00:02<00:04, 17.74it/s, loss=1.64, v_num=1, val_acc=0.695]
Epoch 40:  37%|███▋      | 43/117 [00:02<00:04, 18.10it/s, loss=1.64, v_num=1, val_acc=0.695]
Epoch 40:  37%|███▋      | 43/117 [00:02<00:04, 17.91it/s, loss=1.66, v_num=1, val_acc=0.695]
Epoch 40:  38%|███▊      | 44/117 [00:02<00:03, 18.26it/s, loss=1.66, v_num=1, val_acc=0.695]
Epoch 40:  38%|███▊      | 44/117 [00:02<00:04, 18.07it/s, loss=1.69, v_num=1, val_acc=0.695]
Epoch 40:  38%|███▊      | 45/117 [00:02<00:03, 18.41it/s, loss=1.69, v_num=1, val_acc=0.695]
Epoch 40:  38%|███▊      | 45/117 [00:02<00:03, 18.22it/s, loss=1.74, v_num=1, val_acc=0.695]
Epoch 40:  39%|███▉      | 46/117 [00:02<00:03, 18.56it/s, loss=1.74, v_num=1, val_acc=0.695]
Epoch 40:  39%|███▉      | 46/117 [00:02<00:03, 18.37it/s, loss=1.76, v_num=1, val_acc=0.695]
Epoch 40:  40%|████      | 47/117 [00:02<00:03, 18.70it/s, loss=1.76, v_num=1, val_acc=0.695]
Epoch 40:  40%|████      | 47/117 [00:02<00:03, 18.52it/s, loss=1.8, v_num=1, val_acc=0.695]
Epoch 40:  41%|████      | 48/117 [00:02<00:03, 18.85it/s, loss=1.8, v_num=1, val_acc=0.695]
Epoch 40:  41%|████      | 48/117 [00:02<00:03, 18.66it/s, loss=1.77, v_num=1, val_acc=0.695]
Epoch 40:  42%|████▏     | 49/117 [00:02<00:03, 18.98it/s, loss=1.77, v_num=1, val_acc=0.695]
Epoch 40:  42%|████▏     | 49/117 [00:02<00:03, 18.80it/s, loss=1.73, v_num=1, val_acc=0.695]
Epoch 40:  43%|████▎     | 50/117 [00:02<00:03, 19.12it/s, loss=1.73, v_num=1, val_acc=0.695]
Epoch 40:  43%|████▎     | 50/117 [00:02<00:03, 18.93it/s, loss=1.72, v_num=1, val_acc=0.695]
Epoch 40:  44%|████▎     | 51/117 [00:02<00:03, 19.25it/s, loss=1.72, v_num=1, val_acc=0.695]
Epoch 40:  44%|████▎     | 51/117 [00:02<00:03, 19.06it/s, loss=1.68, v_num=1, val_acc=0.695]
Epoch 40:  44%|████▍     | 52/117 [00:02<00:03, 19.37it/s, loss=1.68, v_num=1, val_acc=0.695]
Epoch 40:  44%|████▍     | 52/117 [00:02<00:03, 19.19it/s, loss=1.62, v_num=1, val_acc=0.695]
Epoch 40:  45%|████▌     | 53/117 [00:02<00:03, 19.50it/s, loss=1.62, v_num=1, val_acc=0.695]
Epoch 40:  45%|████▌     | 53/117 [00:02<00:03, 19.32it/s, loss=1.61, v_num=1, val_acc=0.695]
Epoch 40:  46%|████▌     | 54/117 [00:02<00:03, 19.62it/s, loss=1.61, v_num=1, val_acc=0.695]
Epoch 40:  46%|████▌     | 54/117 [00:02<00:03, 19.44it/s, loss=1.61, v_num=1, val_acc=0.695]
Epoch 40:  47%|████▋     | 55/117 [00:02<00:03, 19.73it/s, loss=1.61, v_num=1, val_acc=0.695]
Epoch 40:  47%|████▋     | 55/117 [00:02<00:03, 19.56it/s, loss=1.62, v_num=1, val_acc=0.695]
Epoch 40:  48%|████▊     | 56/117 [00:02<00:03, 19.85it/s, loss=1.62, v_num=1, val_acc=0.695]
Epoch 40:  48%|████▊     | 56/117 [00:02<00:03, 19.67it/s, loss=1.64, v_num=1, val_acc=0.695]
Epoch 40:  49%|████▊     | 57/117 [00:02<00:03, 19.96it/s, loss=1.64, v_num=1, val_acc=0.695]
Epoch 40:  49%|████▊     | 57/117 [00:02<00:03, 19.79it/s, loss=1.67, v_num=1, val_acc=0.695]
Epoch 40:  50%|████▉     | 58/117 [00:02<00:02, 20.07it/s, loss=1.67, v_num=1, val_acc=0.695]
Epoch 40:  50%|████▉     | 58/117 [00:02<00:02, 19.90it/s, loss=1.7, v_num=1, val_acc=0.695]
Epoch 40:  50%|█████     | 59/117 [00:02<00:02, 20.17it/s, loss=1.7, v_num=1, val_acc=0.695]
Epoch 40:  50%|█████     | 59/117 [00:02<00:02, 20.00it/s, loss=1.72, v_num=1, val_acc=0.695]
Epoch 40:  51%|█████▏    | 60/117 [00:02<00:02, 20.28it/s, loss=1.72, v_num=1, val_acc=0.695]
Epoch 40:  51%|█████▏    | 60/117 [00:02<00:02, 20.11it/s, loss=1.76, v_num=1, val_acc=0.695]
Epoch 40:  52%|█████▏    | 61/117 [00:02<00:02, 20.38it/s, loss=1.76, v_num=1, val_acc=0.695]
Epoch 40:  52%|█████▏    | 61/117 [00:03<00:02, 20.21it/s, loss=1.73, v_num=1, val_acc=0.695]
Epoch 40:  53%|█████▎    | 62/117 [00:03<00:02, 20.47it/s, loss=1.73, v_num=1, val_acc=0.695]
Epoch 40:  53%|█████▎    | 62/117 [00:03<00:02, 20.31it/s, loss=1.72, v_num=1, val_acc=0.695]
Epoch 40:  54%|█████▍    | 63/117 [00:03<00:02, 20.54it/s, loss=1.72, v_num=1, val_acc=0.695]
Epoch 40:  54%|█████▍    | 63/117 [00:03<00:02, 20.39it/s, loss=1.68, v_num=1, val_acc=0.695]
Epoch 40:  55%|█████▍    | 64/117 [00:03<00:02, 20.65it/s, loss=1.68, v_num=1, val_acc=0.695]
Epoch 40:  55%|█████▍    | 64/117 [00:03<00:02, 20.48it/s, loss=1.69, v_num=1, val_acc=0.695]
Epoch 40:  56%|█████▌    | 65/117 [00:03<00:02, 20.74it/s, loss=1.69, v_num=1, val_acc=0.695]
Epoch 40:  56%|█████▌    | 65/117 [00:03<00:02, 20.58it/s, loss=1.67, v_num=1, val_acc=0.695]
Epoch 40:  56%|█████▋    | 66/117 [00:03<00:02, 20.83it/s, loss=1.67, v_num=1, val_acc=0.695]
Epoch 40:  56%|█████▋    | 66/117 [00:03<00:02, 20.67it/s, loss=1.67, v_num=1, val_acc=0.695]
Epoch 40:  57%|█████▋    | 67/117 [00:03<00:02, 20.92it/s, loss=1.67, v_num=1, val_acc=0.695]
Epoch 40:  57%|█████▋    | 67/117 [00:03<00:02, 20.76it/s, loss=1.61, v_num=1, val_acc=0.695]
Epoch 40:  58%|█████▊    | 68/117 [00:03<00:02, 21.00it/s, loss=1.61, v_num=1, val_acc=0.695]
Epoch 40:  58%|█████▊    | 68/117 [00:03<00:02, 20.84it/s, loss=1.61, v_num=1, val_acc=0.695]
Epoch 40:  59%|█████▉    | 69/117 [00:03<00:02, 21.09it/s, loss=1.61, v_num=1, val_acc=0.695]
Epoch 40:  59%|█████▉    | 69/117 [00:03<00:02, 20.93it/s, loss=1.62, v_num=1, val_acc=0.695]
Epoch 40:  60%|█████▉    | 70/117 [00:03<00:02, 21.17it/s, loss=1.62, v_num=1, val_acc=0.695]
Epoch 40:  60%|█████▉    | 70/117 [00:03<00:02, 21.01it/s, loss=1.65, v_num=1, val_acc=0.695]
Epoch 40:  61%|██████    | 71/117 [00:03<00:02, 21.25it/s, loss=1.65, v_num=1, val_acc=0.695]
Epoch 40:  61%|██████    | 71/117 [00:03<00:02, 21.09it/s, loss=1.65, v_num=1, val_acc=0.695]
Epoch 40:  62%|██████▏   | 72/117 [00:03<00:02, 21.31it/s, loss=1.65, v_num=1, val_acc=0.695]
Epoch 40:  62%|██████▏   | 72/117 [00:03<00:02, 21.16it/s, loss=1.66, v_num=1, val_acc=0.695]
Epoch 40:  62%|██████▏   | 73/117 [00:03<00:02, 21.40it/s, loss=1.66, v_num=1, val_acc=0.695]
Epoch 40:  62%|██████▏   | 73/117 [00:03<00:02, 21.24it/s, loss=1.67, v_num=1, val_acc=0.695]
Epoch 40:  63%|██████▎   | 74/117 [00:03<00:02, 21.45it/s, loss=1.67, v_num=1, val_acc=0.695]
Epoch 40:  63%|██████▎   | 74/117 [00:03<00:02, 21.31it/s, loss=1.67, v_num=1, val_acc=0.695]
Epoch 40:  64%|██████▍   | 75/117 [00:03<00:01, 21.54it/s, loss=1.67, v_num=1, val_acc=0.695]
Epoch 40:  64%|██████▍   | 75/117 [00:03<00:01, 21.39it/s, loss=1.68, v_num=1, val_acc=0.695]
Epoch 40:  65%|██████▍   | 76/117 [00:03<00:01, 21.61it/s, loss=1.68, v_num=1, val_acc=0.695]
Epoch 40:  65%|██████▍   | 76/117 [00:03<00:01, 21.46it/s, loss=1.67, v_num=1, val_acc=0.695]
Epoch 40:  66%|██████▌   | 77/117 [00:03<00:01, 21.66it/s, loss=1.67, v_num=1, val_acc=0.695]
Epoch 40:  66%|██████▌   | 77/117 [00:03<00:01, 21.52it/s, loss=1.63, v_num=1, val_acc=0.695]
Epoch 40:  67%|██████▋   | 78/117 [00:03<00:01, 21.73it/s, loss=1.63, v_num=1, val_acc=0.695]
Epoch 40:  67%|██████▋   | 78/117 [00:03<00:01, 21.58it/s, loss=1.61, v_num=1, val_acc=0.695]
Epoch 40:  68%|██████▊   | 79/117 [00:03<00:01, 21.77it/s, loss=1.61, v_num=1, val_acc=0.695]
Epoch 40:  68%|██████▊   | 79/117 [00:03<00:01, 21.64it/s, loss=1.56, v_num=1, val_acc=0.695]
Epoch 40:  68%|██████▊   | 80/117 [00:03<00:01, 21.82it/s, loss=1.56, v_num=1, val_acc=0.695]
Epoch 40:  68%|██████▊   | 80/117 [00:03<00:01, 21.69it/s, loss=1.53, v_num=1, val_acc=0.695]
Epoch 40:  69%|██████▉   | 81/117 [00:03<00:01, 21.91it/s, loss=1.53, v_num=1, val_acc=0.695]
Epoch 40:  69%|██████▉   | 81/117 [00:03<00:01, 21.76it/s, loss=1.53, v_num=1, val_acc=0.695]
Epoch 40:  70%|███████   | 82/117 [00:03<00:01, 21.93it/s, loss=1.53, v_num=1, val_acc=0.695]
Epoch 40:  70%|███████   | 82/117 [00:03<00:01, 21.78it/s, loss=1.57, v_num=1, val_acc=0.695]
Epoch 40:  71%|███████   | 83/117 [00:03<00:01, 22.00it/s, loss=1.57, v_num=1, val_acc=0.695]
Epoch 40:  71%|███████   | 83/117 [00:03<00:01, 21.85it/s, loss=1.54, v_num=1, val_acc=0.695]
Epoch 40:  72%|███████▏  | 84/117 [00:03<00:01, 22.07it/s, loss=1.54, v_num=1, val_acc=0.695]
Epoch 40:  72%|███████▏  | 84/117 [00:03<00:01, 21.92it/s, loss=1.49, v_num=1, val_acc=0.695]
Epoch 40:  73%|███████▎  | 85/117 [00:03<00:01, 22.13it/s, loss=1.49, v_num=1, val_acc=0.695]
Epoch 40:  73%|███████▎  | 85/117 [00:03<00:01, 21.99it/s, loss=1.48, v_num=1, val_acc=0.695]
Epoch 40:  74%|███████▎  | 86/117 [00:03<00:01, 22.20it/s, loss=1.48, v_num=1, val_acc=0.695]
Epoch 40:  74%|███████▎  | 86/117 [00:03<00:01, 22.05it/s, loss=1.5, v_num=1, val_acc=0.695]
Epoch 40:  74%|███████▍  | 87/117 [00:03<00:01, 22.26it/s, loss=1.5, v_num=1, val_acc=0.695]
Epoch 40:  74%|███████▍  | 87/117 [00:03<00:01, 22.12it/s, loss=1.5, v_num=1, val_acc=0.695]
Epoch 40:  75%|███████▌  | 88/117 [00:03<00:01, 22.32it/s, loss=1.5, v_num=1, val_acc=0.695]
Epoch 40:  75%|███████▌  | 88/117 [00:03<00:01, 22.18it/s, loss=1.5, v_num=1, val_acc=0.695]
Epoch 40:  76%|███████▌  | 89/117 [00:03<00:01, 22.38it/s, loss=1.5, v_num=1, val_acc=0.695]
Epoch 40:  76%|███████▌  | 89/117 [00:04<00:01, 22.24it/s, loss=1.5, v_num=1, val_acc=0.695]
Epoch 40:  77%|███████▋  | 90/117 [00:04<00:01, 22.44it/s, loss=1.5, v_num=1, val_acc=0.695]
Epoch 40:  77%|███████▋  | 90/117 [00:04<00:01, 22.30it/s, loss=1.49, v_num=1, val_acc=0.695]
Epoch 40:  78%|███████▊  | 91/117 [00:04<00:01, 22.50it/s, loss=1.49, v_num=1, val_acc=0.695]
Epoch 40:  78%|███████▊  | 91/117 [00:04<00:01, 22.36it/s, loss=1.52, v_num=1, val_acc=0.695]
Epoch 40:  79%|███████▊  | 92/117 [00:04<00:01, 22.56it/s, loss=1.52, v_num=1, val_acc=0.695]
Epoch 40:  79%|███████▊  | 92/117 [00:04<00:01, 22.42it/s, loss=1.53, v_num=1, val_acc=0.695]
Epoch 40:  79%|███████▉  | 93/117 [00:04<00:01, 22.61it/s, loss=1.53, v_num=1, val_acc=0.695]
Epoch 40:  79%|███████▉  | 93/117 [00:04<00:01, 22.47it/s, loss=1.53, v_num=1, val_acc=0.695]
Epoch 40:  80%|████████  | 94/117 [00:04<00:01, 22.67it/s, loss=1.53, v_num=1, val_acc=0.695]
Epoch 40:  80%|████████  | 94/117 [00:04<00:01, 22.53it/s, loss=1.52, v_num=1, val_acc=0.695]
Epoch 40:  81%|████████  | 95/117 [00:04<00:00, 22.72it/s, loss=1.52, v_num=1, val_acc=0.695]
Epoch 40:  81%|████████  | 95/117 [00:04<00:00, 22.58it/s, loss=1.51, v_num=1, val_acc=0.695]
Epoch 40:  82%|████████▏ | 96/117 [00:04<00:00, 22.77it/s, loss=1.51, v_num=1, val_acc=0.695]
Epoch 40:  82%|████████▏ | 96/117 [00:04<00:00, 22.64it/s, loss=1.54, v_num=1, val_acc=0.695]
Epoch 40:  83%|████████▎ | 97/117 [00:04<00:00, 22.83it/s, loss=1.54, v_num=1, val_acc=0.695]
Epoch 40:  83%|████████▎ | 97/117 [00:04<00:00, 22.69it/s, loss=1.55, v_num=1, val_acc=0.695]

Validation: 0it [00:00, ?it/s]

Validation:   0%|          | 0/20 [00:00<?, ?it/s]

Validation DataLoader 0:   0%|          | 0/20 [00:00<?, ?it/s]

Validation DataLoader 0:   5%|▌         | 1/20 [00:00<00:00, 139.29it/s]
Epoch 40:  84%|████████▍ | 98/117 [00:05<00:00, 19.09it/s, loss=1.55, v_num=1, val_acc=0.695]

Validation DataLoader 0:  10%|█         | 2/20 [00:00<00:00, 53.26it/s]
Epoch 40:  85%|████████▍ | 99/117 [00:05<00:00, 19.17it/s, loss=1.55, v_num=1, val_acc=0.695]

Validation DataLoader 0:  15%|█▌        | 3/20 [00:00<00:00, 42.87it/s]
Epoch 40:  85%|████████▌ | 100/117 [00:05<00:00, 19.25it/s, loss=1.55, v_num=1, val_acc=0.695]

Validation DataLoader 0:  20%|██        | 4/20 [00:00<00:00, 39.05it/s]
Epoch 40:  86%|████████▋ | 101/117 [00:05<00:00, 19.32it/s, loss=1.55, v_num=1, val_acc=0.695]

Validation DataLoader 0:  25%|██▌       | 5/20 [00:00<00:00, 36.94it/s]
Epoch 40:  87%|████████▋ | 102/117 [00:05<00:00, 19.39it/s, loss=1.55, v_num=1, val_acc=0.695]

Validation DataLoader 0:  30%|███       | 6/20 [00:00<00:00, 35.92it/s]
Epoch 40:  88%|████████▊ | 103/117 [00:05<00:00, 19.46it/s, loss=1.55, v_num=1, val_acc=0.695]

Validation DataLoader 0:  35%|███▌      | 7/20 [00:00<00:00, 35.15it/s]
Epoch 40:  89%|████████▉ | 104/117 [00:05<00:00, 19.53it/s, loss=1.55, v_num=1, val_acc=0.695]

Validation DataLoader 0:  40%|████      | 8/20 [00:00<00:00, 34.58it/s]
Epoch 40:  90%|████████▉ | 105/117 [00:05<00:00, 19.60it/s, loss=1.55, v_num=1, val_acc=0.695]

Validation DataLoader 0:  45%|████▌     | 9/20 [00:00<00:00, 32.73it/s]
Epoch 40:  91%|█████████ | 106/117 [00:05<00:00, 19.63it/s, loss=1.55, v_num=1, val_acc=0.695]

Validation DataLoader 0:  50%|█████     | 10/20 [00:00<00:00, 32.64it/s]
Epoch 40:  91%|█████████▏| 107/117 [00:05<00:00, 19.70it/s, loss=1.55, v_num=1, val_acc=0.695]

Validation DataLoader 0:  55%|█████▌    | 11/20 [00:00<00:00, 32.49it/s]
Epoch 40:  92%|█████████▏| 108/117 [00:05<00:00, 19.77it/s, loss=1.55, v_num=1, val_acc=0.695]

Validation DataLoader 0:  60%|██████    | 12/20 [00:00<00:00, 32.35it/s]
Epoch 40:  93%|█████████▎| 109/117 [00:05<00:00, 19.83it/s, loss=1.55, v_num=1, val_acc=0.695]

Validation DataLoader 0:  65%|██████▌   | 13/20 [00:00<00:00, 32.23it/s]
Epoch 40:  94%|█████████▍| 110/117 [00:05<00:00, 19.90it/s, loss=1.55, v_num=1, val_acc=0.695]

Validation DataLoader 0:  70%|███████   | 14/20 [00:00<00:00, 32.16it/s]
Epoch 40:  95%|█████████▍| 111/117 [00:05<00:00, 19.96it/s, loss=1.55, v_num=1, val_acc=0.695]

Validation DataLoader 0:  75%|███████▌  | 15/20 [00:00<00:00, 32.08it/s]
Epoch 40:  96%|█████████▌| 112/117 [00:05<00:00, 20.02it/s, loss=1.55, v_num=1, val_acc=0.695]

Validation DataLoader 0:  80%|████████  | 16/20 [00:00<00:00, 32.01it/s]
Epoch 40:  97%|█████████▋| 113/117 [00:05<00:00, 20.09it/s, loss=1.55, v_num=1, val_acc=0.695]

Validation DataLoader 0:  85%|████████▌ | 17/20 [00:00<00:00, 31.95it/s]
Epoch 40:  97%|█████████▋| 114/117 [00:05<00:00, 20.15it/s, loss=1.55, v_num=1, val_acc=0.695]

Validation DataLoader 0:  90%|█████████ | 18/20 [00:00<00:00, 31.90it/s]
Epoch 40:  98%|█████████▊| 115/117 [00:05<00:00, 20.21it/s, loss=1.55, v_num=1, val_acc=0.695]

Validation DataLoader 0:  95%|█████████▌| 19/20 [00:00<00:00, 31.85it/s]
Epoch 40:  99%|█████████▉| 116/117 [00:05<00:00, 20.27it/s, loss=1.55, v_num=1, val_acc=0.695]

Validation DataLoader 0: 100%|██████████| 20/20 [00:00<00:00, 31.87it/s]
Epoch 40: 100%|██████████| 117/117 [00:05<00:00, 20.34it/s, loss=1.55, v_num=1, val_acc=0.695]
Epoch 40: 100%|██████████| 117/117 [00:05<00:00, 20.27it/s, loss=1.55, v_num=1, val_acc=0.699]


Epoch 40: 100%|██████████| 117/117 [00:05<00:00, 20.26it/s, loss=1.55, v_num=1, val_acc=0.699]
Epoch 40:   0%|          | 0/117 [00:00<?, ?it/s, loss=1.55, v_num=1, val_acc=0.699]
Epoch 41:   0%|          | 0/117 [00:00<?, ?it/s, loss=1.55, v_num=1, val_acc=0.699]
Epoch 41:   1%|          | 1/117 [00:01<02:07,  1.10s/it, loss=1.55, v_num=1, val_acc=0.699]
Epoch 41:   1%|          | 1/117 [00:01<02:10,  1.12s/it, loss=1.55, v_num=1, val_acc=0.699]
Epoch 41:   2%|▏         | 2/117 [00:01<01:05,  1.77it/s, loss=1.55, v_num=1, val_acc=0.699]
Epoch 41:   2%|▏         | 2/117 [00:01<01:06,  1.73it/s, loss=1.54, v_num=1, val_acc=0.699]
Epoch 41:   3%|▎         | 3/117 [00:01<00:44,  2.57it/s, loss=1.54, v_num=1, val_acc=0.699]
Epoch 41:   3%|▎         | 3/117 [00:01<00:45,  2.52it/s, loss=1.52, v_num=1, val_acc=0.699]
Epoch 41:   3%|▎         | 4/117 [00:01<00:33,  3.33it/s, loss=1.52, v_num=1, val_acc=0.699]
Epoch 41:   3%|▎         | 4/117 [00:01<00:34,  3.26it/s, loss=1.52, v_num=1, val_acc=0.699]
Epoch 41:   4%|▍         | 5/117 [00:01<00:27,  4.04it/s, loss=1.52, v_num=1, val_acc=0.699]
Epoch 41:   4%|▍         | 5/117 [00:01<00:28,  3.96it/s, loss=1.47, v_num=1, val_acc=0.699]
Epoch 41:   5%|▌         | 6/117 [00:01<00:23,  4.72it/s, loss=1.47, v_num=1, val_acc=0.699]
Epoch 41:   5%|▌         | 6/117 [00:01<00:23,  4.63it/s, loss=1.5, v_num=1, val_acc=0.699]
Epoch 41:   6%|▌         | 7/117 [00:01<00:20,  5.36it/s, loss=1.5, v_num=1, val_acc=0.699]
Epoch 41:   6%|▌         | 7/117 [00:01<00:20,  5.26it/s, loss=1.51, v_num=1, val_acc=0.699]
Epoch 41:   7%|▋         | 8/117 [00:01<00:18,  5.96it/s, loss=1.51, v_num=1, val_acc=0.699]
Epoch 41:   7%|▋         | 8/117 [00:01<00:18,  5.86it/s, loss=1.52, v_num=1, val_acc=0.699]
Epoch 41:   8%|▊         | 9/117 [00:01<00:16,  6.42it/s, loss=1.52, v_num=1, val_acc=0.699]
Epoch 41:   8%|▊         | 9/117 [00:01<00:17,  6.31it/s, loss=1.47, v_num=1, val_acc=0.699]
Epoch 41:   9%|▊         | 10/117 [00:01<00:15,  6.96it/s, loss=1.47, v_num=1, val_acc=0.699]
Epoch 41:   9%|▊         | 10/117 [00:01<00:15,  6.84it/s, loss=1.47, v_num=1, val_acc=0.699]
Epoch 41:   9%|▉         | 11/117 [00:01<00:14,  7.48it/s, loss=1.47, v_num=1, val_acc=0.699]
Epoch 41:   9%|▉         | 11/117 [00:01<00:14,  7.35it/s, loss=1.46, v_num=1, val_acc=0.699]
Epoch 41:  10%|█         | 12/117 [00:01<00:13,  7.97it/s, loss=1.46, v_num=1, val_acc=0.699]
Epoch 41:  10%|█         | 12/117 [00:01<00:13,  7.84it/s, loss=1.47, v_num=1, val_acc=0.699]
Epoch 41:  11%|█         | 13/117 [00:01<00:12,  8.44it/s, loss=1.47, v_num=1, val_acc=0.699]
Epoch 41:  11%|█         | 13/117 [00:01<00:12,  8.31it/s, loss=1.5, v_num=1, val_acc=0.699]
Epoch 41:  12%|█▏        | 14/117 [00:01<00:11,  8.89it/s, loss=1.5, v_num=1, val_acc=0.699]
Epoch 41:  12%|█▏        | 14/117 [00:01<00:11,  8.75it/s, loss=1.54, v_num=1, val_acc=0.699]
Epoch 41:  13%|█▎        | 15/117 [00:01<00:10,  9.32it/s, loss=1.54, v_num=1, val_acc=0.699]
Epoch 41:  13%|█▎        | 15/117 [00:01<00:11,  9.18it/s, loss=1.53, v_num=1, val_acc=0.699]
Epoch 41:  14%|█▎        | 16/117 [00:01<00:10,  9.73it/s, loss=1.53, v_num=1, val_acc=0.699]
Epoch 41:  14%|█▎        | 16/117 [00:01<00:10,  9.59it/s, loss=1.53, v_num=1, val_acc=0.699]
Epoch 41:  15%|█▍        | 17/117 [00:01<00:09, 10.10it/s, loss=1.53, v_num=1, val_acc=0.699]
Epoch 41:  15%|█▍        | 17/117 [00:01<00:10,  9.96it/s, loss=1.55, v_num=1, val_acc=0.699]
Epoch 41:  15%|█▌        | 18/117 [00:01<00:09, 10.48it/s, loss=1.55, v_num=1, val_acc=0.699]
Epoch 41:  15%|█▌        | 18/117 [00:01<00:09, 10.33it/s, loss=1.56, v_num=1, val_acc=0.699]
Epoch 41:  16%|█▌        | 19/117 [00:01<00:09, 10.84it/s, loss=1.56, v_num=1, val_acc=0.699]
Epoch 41:  16%|█▌        | 19/117 [00:01<00:09, 10.69it/s, loss=1.54, v_num=1, val_acc=0.699]
Epoch 41:  17%|█▋        | 20/117 [00:01<00:08, 11.19it/s, loss=1.54, v_num=1, val_acc=0.699]
Epoch 41:  17%|█▋        | 20/117 [00:01<00:08, 11.04it/s, loss=1.55, v_num=1, val_acc=0.699]
Epoch 41:  18%|█▊        | 21/117 [00:01<00:08, 11.52it/s, loss=1.55, v_num=1, val_acc=0.699]
Epoch 41:  18%|█▊        | 21/117 [00:01<00:08, 11.36it/s, loss=1.55, v_num=1, val_acc=0.699]
Epoch 41:  19%|█▉        | 22/117 [00:01<00:08, 11.84it/s, loss=1.55, v_num=1, val_acc=0.699]
Epoch 41:  19%|█▉        | 22/117 [00:01<00:08, 11.69it/s, loss=1.55, v_num=1, val_acc=0.699]
Epoch 41:  20%|█▉        | 23/117 [00:01<00:07, 12.14it/s, loss=1.55, v_num=1, val_acc=0.699]
Epoch 41:  20%|█▉        | 23/117 [00:01<00:07, 11.99it/s, loss=1.54, v_num=1, val_acc=0.699]
Epoch 41:  21%|██        | 24/117 [00:01<00:07, 12.43it/s, loss=1.54, v_num=1, val_acc=0.699]
Epoch 41:  21%|██        | 24/117 [00:01<00:07, 12.27it/s, loss=1.52, v_num=1, val_acc=0.699]
Epoch 41:  21%|██▏       | 25/117 [00:01<00:07, 12.71it/s, loss=1.52, v_num=1, val_acc=0.699]
Epoch 41:  21%|██▏       | 25/117 [00:01<00:07, 12.55it/s, loss=1.49, v_num=1, val_acc=0.699]
Epoch 41:  22%|██▏       | 26/117 [00:02<00:07, 12.98it/s, loss=1.49, v_num=1, val_acc=0.699]
Epoch 41:  22%|██▏       | 26/117 [00:02<00:07, 12.82it/s, loss=1.45, v_num=1, val_acc=0.699]
Epoch 41:  23%|██▎       | 27/117 [00:02<00:06, 13.23it/s, loss=1.45, v_num=1, val_acc=0.699]
Epoch 41:  23%|██▎       | 27/117 [00:02<00:06, 13.08it/s, loss=1.43, v_num=1, val_acc=0.699]
Epoch 41:  24%|██▍       | 28/117 [00:02<00:06, 13.49it/s, loss=1.43, v_num=1, val_acc=0.699]
Epoch 41:  24%|██▍       | 28/117 [00:02<00:06, 13.34it/s, loss=1.4, v_num=1, val_acc=0.699]
Epoch 41:  25%|██▍       | 29/117 [00:02<00:06, 13.74it/s, loss=1.4, v_num=1, val_acc=0.699]
Epoch 41:  25%|██▍       | 29/117 [00:02<00:06, 13.58it/s, loss=1.4, v_num=1, val_acc=0.699]
Epoch 41:  26%|██▌       | 30/117 [00:02<00:06, 13.97it/s, loss=1.4, v_num=1, val_acc=0.699]
Epoch 41:  26%|██▌       | 30/117 [00:02<00:06, 13.82it/s, loss=1.41, v_num=1, val_acc=0.699]
Epoch 41:  26%|██▋       | 31/117 [00:02<00:06, 14.20it/s, loss=1.41, v_num=1, val_acc=0.699]
Epoch 41:  26%|██▋       | 31/117 [00:02<00:06, 14.05it/s, loss=1.43, v_num=1, val_acc=0.699]
Epoch 41:  27%|██▋       | 32/117 [00:02<00:05, 14.43it/s, loss=1.43, v_num=1, val_acc=0.699]
Epoch 41:  27%|██▋       | 32/117 [00:02<00:05, 14.27it/s, loss=1.48, v_num=1, val_acc=0.699]
Epoch 41:  28%|██▊       | 33/117 [00:02<00:05, 14.61it/s, loss=1.48, v_num=1, val_acc=0.699]
Epoch 41:  28%|██▊       | 33/117 [00:02<00:05, 14.46it/s, loss=1.49, v_num=1, val_acc=0.699]
Epoch 41:  29%|██▉       | 34/117 [00:02<00:05, 14.80it/s, loss=1.49, v_num=1, val_acc=0.699]
Epoch 41:  29%|██▉       | 34/117 [00:02<00:05, 14.66it/s, loss=1.44, v_num=1, val_acc=0.699]
Epoch 41:  30%|██▉       | 35/117 [00:02<00:05, 15.02it/s, loss=1.44, v_num=1, val_acc=0.699]
Epoch 41:  30%|██▉       | 35/117 [00:02<00:05, 14.86it/s, loss=1.45, v_num=1, val_acc=0.699]
Epoch 41:  31%|███       | 36/117 [00:02<00:05, 15.22it/s, loss=1.45, v_num=1, val_acc=0.699]
Epoch 41:  31%|███       | 36/117 [00:02<00:05, 15.06it/s, loss=1.44, v_num=1, val_acc=0.699]
Epoch 41:  32%|███▏      | 37/117 [00:02<00:05, 15.42it/s, loss=1.44, v_num=1, val_acc=0.699]
Epoch 41:  32%|███▏      | 37/117 [00:02<00:05, 15.26it/s, loss=1.41, v_num=1, val_acc=0.699]
Epoch 41:  32%|███▏      | 38/117 [00:02<00:05, 15.60it/s, loss=1.41, v_num=1, val_acc=0.699]
Epoch 41:  32%|███▏      | 38/117 [00:02<00:05, 15.44it/s, loss=1.37, v_num=1, val_acc=0.699]
Epoch 41:  33%|███▎      | 39/117 [00:02<00:04, 15.78it/s, loss=1.37, v_num=1, val_acc=0.699]
Epoch 41:  33%|███▎      | 39/117 [00:02<00:04, 15.63it/s, loss=1.33, v_num=1, val_acc=0.699]
Epoch 41:  34%|███▍      | 40/117 [00:02<00:04, 15.96it/s, loss=1.33, v_num=1, val_acc=0.699]
Epoch 41:  34%|███▍      | 40/117 [00:02<00:04, 15.80it/s, loss=1.32, v_num=1, val_acc=0.699]
Epoch 41:  35%|███▌      | 41/117 [00:02<00:04, 16.13it/s, loss=1.32, v_num=1, val_acc=0.699]
Epoch 41:  35%|███▌      | 41/117 [00:02<00:04, 15.97it/s, loss=1.35, v_num=1, val_acc=0.699]
Epoch 41:  36%|███▌      | 42/117 [00:02<00:04, 16.26it/s, loss=1.35, v_num=1, val_acc=0.699]
Epoch 41:  36%|███▌      | 42/117 [00:02<00:04, 16.11it/s, loss=1.39, v_num=1, val_acc=0.699]
Epoch 41:  37%|███▋      | 43/117 [00:02<00:04, 16.42it/s, loss=1.39, v_num=1, val_acc=0.699]
Epoch 41:  37%|███▋      | 43/117 [00:02<00:04, 16.27it/s, loss=1.42, v_num=1, val_acc=0.699]
Epoch 41:  38%|███▊      | 44/117 [00:02<00:04, 16.58it/s, loss=1.42, v_num=1, val_acc=0.699]
Epoch 41:  38%|███▊      | 44/117 [00:02<00:04, 16.43it/s, loss=1.47, v_num=1, val_acc=0.699]
Epoch 41:  38%|███▊      | 45/117 [00:02<00:04, 16.70it/s, loss=1.47, v_num=1, val_acc=0.699]
Epoch 41:  38%|███▊      | 45/117 [00:02<00:04, 16.55it/s, loss=1.49, v_num=1, val_acc=0.699]
Epoch 41:  39%|███▉      | 46/117 [00:02<00:04, 16.86it/s, loss=1.49, v_num=1, val_acc=0.699]
Epoch 41:  39%|███▉      | 46/117 [00:02<00:04, 16.70it/s, loss=1.52, v_num=1, val_acc=0.699]
Epoch 41:  40%|████      | 47/117 [00:02<00:04, 17.01it/s, loss=1.52, v_num=1, val_acc=0.699]
Epoch 41:  40%|████      | 47/117 [00:02<00:04, 16.86it/s, loss=1.57, v_num=1, val_acc=0.699]
Epoch 41:  41%|████      | 48/117 [00:02<00:04, 17.15it/s, loss=1.57, v_num=1, val_acc=0.699]
Epoch 41:  41%|████      | 48/117 [00:02<00:04, 17.00it/s, loss=1.59, v_num=1, val_acc=0.699]
Epoch 41:  42%|████▏     | 49/117 [00:02<00:03, 17.29it/s, loss=1.59, v_num=1, val_acc=0.699]
Epoch 41:  42%|████▏     | 49/117 [00:02<00:03, 17.15it/s, loss=1.59, v_num=1, val_acc=0.699]
Epoch 41:  43%|████▎     | 50/117 [00:02<00:03, 17.43it/s, loss=1.59, v_num=1, val_acc=0.699]
Epoch 41:  43%|████▎     | 50/117 [00:02<00:03, 17.29it/s, loss=1.6, v_num=1, val_acc=0.699]
Epoch 41:  44%|████▎     | 51/117 [00:02<00:03, 17.57it/s, loss=1.6, v_num=1, val_acc=0.699]
Epoch 41:  44%|████▎     | 51/117 [00:02<00:03, 17.42it/s, loss=1.6, v_num=1, val_acc=0.699]
Epoch 41:  44%|████▍     | 52/117 [00:02<00:03, 17.69it/s, loss=1.6, v_num=1, val_acc=0.699]
Epoch 41:  44%|████▍     | 52/117 [00:02<00:03, 17.54it/s, loss=1.55, v_num=1, val_acc=0.699]
Epoch 41:  45%|████▌     | 53/117 [00:02<00:03, 17.80it/s, loss=1.55, v_num=1, val_acc=0.699]
Epoch 41:  45%|████▌     | 53/117 [00:03<00:03, 17.65it/s, loss=1.56, v_num=1, val_acc=0.699]
Epoch 41:  46%|████▌     | 54/117 [00:03<00:03, 17.93it/s, loss=1.56, v_num=1, val_acc=0.699]
Epoch 41:  46%|████▌     | 54/117 [00:03<00:03, 17.78it/s, loss=1.58, v_num=1, val_acc=0.699]
Epoch 41:  47%|████▋     | 55/117 [00:03<00:03, 18.06it/s, loss=1.58, v_num=1, val_acc=0.699]
Epoch 41:  47%|████▋     | 55/117 [00:03<00:03, 17.91it/s, loss=1.58, v_num=1, val_acc=0.699]
Epoch 41:  48%|████▊     | 56/117 [00:03<00:03, 18.18it/s, loss=1.58, v_num=1, val_acc=0.699]
Epoch 41:  48%|████▊     | 56/117 [00:03<00:03, 18.03it/s, loss=1.57, v_num=1, val_acc=0.699]
Epoch 41:  49%|████▊     | 57/117 [00:03<00:03, 18.24it/s, loss=1.57, v_num=1, val_acc=0.699]
Epoch 41:  49%|████▊     | 57/117 [00:03<00:03, 18.14it/s, loss=1.58, v_num=1, val_acc=0.699]
Epoch 41:  50%|████▉     | 58/117 [00:03<00:03, 18.37it/s, loss=1.58, v_num=1, val_acc=0.699]
Epoch 41:  50%|████▉     | 58/117 [00:03<00:03, 18.24it/s, loss=1.59, v_num=1, val_acc=0.699]
Epoch 41:  50%|█████     | 59/117 [00:03<00:03, 18.50it/s, loss=1.59, v_num=1, val_acc=0.699]
Epoch 41:  50%|█████     | 59/117 [00:03<00:03, 18.36it/s, loss=1.61, v_num=1, val_acc=0.699]
Epoch 41:  51%|█████▏    | 60/117 [00:03<00:03, 18.59it/s, loss=1.61, v_num=1, val_acc=0.699]
Epoch 41:  51%|█████▏    | 60/117 [00:03<00:03, 18.45it/s, loss=1.64, v_num=1, val_acc=0.699]
Epoch 41:  52%|█████▏    | 61/117 [00:03<00:02, 18.70it/s, loss=1.64, v_num=1, val_acc=0.699]
Epoch 41:  52%|█████▏    | 61/117 [00:03<00:03, 18.56it/s, loss=1.63, v_num=1, val_acc=0.699]
Epoch 41:  53%|█████▎    | 62/117 [00:03<00:02, 18.81it/s, loss=1.63, v_num=1, val_acc=0.699]
Epoch 41:  53%|█████▎    | 62/117 [00:03<00:02, 18.67it/s, loss=1.61, v_num=1, val_acc=0.699]
Epoch 41:  54%|█████▍    | 63/117 [00:03<00:02, 18.91it/s, loss=1.61, v_num=1, val_acc=0.699]
Epoch 41:  54%|█████▍    | 63/117 [00:03<00:02, 18.77it/s, loss=1.65, v_num=1, val_acc=0.699]
Epoch 41:  55%|█████▍    | 64/117 [00:03<00:02, 19.02it/s, loss=1.65, v_num=1, val_acc=0.699]
Epoch 41:  55%|█████▍    | 64/117 [00:03<00:02, 18.88it/s, loss=1.67, v_num=1, val_acc=0.699]
Epoch 41:  56%|█████▌    | 65/117 [00:03<00:02, 19.10it/s, loss=1.67, v_num=1, val_acc=0.699]
Epoch 41:  56%|█████▌    | 65/117 [00:03<00:02, 18.96it/s, loss=1.69, v_num=1, val_acc=0.699]
Epoch 41:  56%|█████▋    | 66/117 [00:03<00:02, 19.17it/s, loss=1.69, v_num=1, val_acc=0.699]
Epoch 41:  56%|█████▋    | 66/117 [00:03<00:02, 19.05it/s, loss=1.69, v_num=1, val_acc=0.699]
Epoch 41:  57%|█████▋    | 67/117 [00:03<00:02, 19.28it/s, loss=1.69, v_num=1, val_acc=0.699]
Epoch 41:  57%|█████▋    | 67/117 [00:03<00:02, 19.14it/s, loss=1.67, v_num=1, val_acc=0.699]
Epoch 41:  58%|█████▊    | 68/117 [00:03<00:02, 19.38it/s, loss=1.67, v_num=1, val_acc=0.699]
Epoch 41:  58%|█████▊    | 68/117 [00:03<00:02, 19.24it/s, loss=1.69, v_num=1, val_acc=0.699]
Epoch 41:  59%|█████▉    | 69/117 [00:03<00:02, 19.47it/s, loss=1.69, v_num=1, val_acc=0.699]
Epoch 41:  59%|█████▉    | 69/117 [00:03<00:02, 19.33it/s, loss=1.69, v_num=1, val_acc=0.699]
Epoch 41:  60%|█████▉    | 70/117 [00:03<00:02, 19.55it/s, loss=1.69, v_num=1, val_acc=0.699]
Epoch 41:  60%|█████▉    | 70/117 [00:03<00:02, 19.42it/s, loss=1.68, v_num=1, val_acc=0.699]
Epoch 41:  61%|██████    | 71/117 [00:03<00:02, 19.62it/s, loss=1.68, v_num=1, val_acc=0.699]
Epoch 41:  61%|██████    | 71/117 [00:03<00:02, 19.50it/s, loss=1.66, v_num=1, val_acc=0.699]
Epoch 41:  62%|██████▏   | 72/117 [00:03<00:02, 19.68it/s, loss=1.66, v_num=1, val_acc=0.699]
Epoch 41:  62%|██████▏   | 72/117 [00:03<00:02, 19.55it/s, loss=1.65, v_num=1, val_acc=0.699]
Epoch 41:  62%|██████▏   | 73/117 [00:03<00:02, 19.77it/s, loss=1.65, v_num=1, val_acc=0.699]
Epoch 41:  62%|██████▏   | 73/117 [00:03<00:02, 19.64it/s, loss=1.6, v_num=1, val_acc=0.699]
Epoch 41:  63%|██████▎   | 74/117 [00:03<00:02, 19.83it/s, loss=1.6, v_num=1, val_acc=0.699]
Epoch 41:  63%|██████▎   | 74/117 [00:03<00:02, 19.71it/s, loss=1.6, v_num=1, val_acc=0.699]
Epoch 41:  64%|██████▍   | 75/117 [00:03<00:02, 19.91it/s, loss=1.6, v_num=1, val_acc=0.699]
Epoch 41:  64%|██████▍   | 75/117 [00:03<00:02, 19.78it/s, loss=1.61, v_num=1, val_acc=0.699]
Epoch 41:  65%|██████▍   | 76/117 [00:03<00:02, 19.98it/s, loss=1.61, v_num=1, val_acc=0.699]
Epoch 41:  65%|██████▍   | 76/117 [00:03<00:02, 19.86it/s, loss=1.64, v_num=1, val_acc=0.699]
Epoch 41:  66%|██████▌   | 77/117 [00:03<00:01, 20.04it/s, loss=1.64, v_num=1, val_acc=0.699]
Epoch 41:  66%|██████▌   | 77/117 [00:03<00:02, 19.92it/s, loss=1.66, v_num=1, val_acc=0.699]
Epoch 41:  67%|██████▋   | 78/117 [00:03<00:01, 20.13it/s, loss=1.66, v_num=1, val_acc=0.699]
Epoch 41:  67%|██████▋   | 78/117 [00:03<00:01, 20.00it/s, loss=1.65, v_num=1, val_acc=0.699]
Epoch 41:  68%|██████▊   | 79/117 [00:03<00:01, 20.20it/s, loss=1.65, v_num=1, val_acc=0.699]
Epoch 41:  68%|██████▊   | 79/117 [00:03<00:01, 20.08it/s, loss=1.64, v_num=1, val_acc=0.699]
Epoch 41:  68%|██████▊   | 80/117 [00:03<00:01, 20.27it/s, loss=1.64, v_num=1, val_acc=0.699]
Epoch 41:  68%|██████▊   | 80/117 [00:03<00:01, 20.14it/s, loss=1.6, v_num=1, val_acc=0.699]
Epoch 41:  69%|██████▉   | 81/117 [00:03<00:01, 20.35it/s, loss=1.6, v_num=1, val_acc=0.699]
Epoch 41:  69%|██████▉   | 81/117 [00:04<00:01, 20.22it/s, loss=1.6, v_num=1, val_acc=0.699]
Epoch 41:  70%|███████   | 82/117 [00:04<00:01, 20.42it/s, loss=1.6, v_num=1, val_acc=0.699]
Epoch 41:  70%|███████   | 82/117 [00:04<00:01, 20.29it/s, loss=1.58, v_num=1, val_acc=0.699]
Epoch 41:  71%|███████   | 83/117 [00:04<00:01, 20.50it/s, loss=1.58, v_num=1, val_acc=0.699]
Epoch 41:  71%|███████   | 83/117 [00:04<00:01, 20.37it/s, loss=1.55, v_num=1, val_acc=0.699]
Epoch 41:  72%|███████▏  | 84/117 [00:04<00:01, 20.57it/s, loss=1.55, v_num=1, val_acc=0.699]
Epoch 41:  72%|███████▏  | 84/117 [00:04<00:01, 20.44it/s, loss=1.54, v_num=1, val_acc=0.699]
Epoch 41:  73%|███████▎  | 85/117 [00:04<00:01, 20.64it/s, loss=1.54, v_num=1, val_acc=0.699]
Epoch 41:  73%|███████▎  | 85/117 [00:04<00:01, 20.52it/s, loss=1.54, v_num=1, val_acc=0.699]
Epoch 41:  74%|███████▎  | 86/117 [00:04<00:01, 20.71it/s, loss=1.54, v_num=1, val_acc=0.699]
Epoch 41:  74%|███████▎  | 86/117 [00:04<00:01, 20.59it/s, loss=1.54, v_num=1, val_acc=0.699]
Epoch 41:  74%|███████▍  | 87/117 [00:04<00:01, 20.78it/s, loss=1.54, v_num=1, val_acc=0.699]
Epoch 41:  74%|███████▍  | 87/117 [00:04<00:01, 20.66it/s, loss=1.53, v_num=1, val_acc=0.699]
Epoch 41:  75%|███████▌  | 88/117 [00:04<00:01, 20.85it/s, loss=1.53, v_num=1, val_acc=0.699]
Epoch 41:  75%|███████▌  | 88/117 [00:04<00:01, 20.72it/s, loss=1.49, v_num=1, val_acc=0.699]
Epoch 41:  76%|███████▌  | 89/117 [00:04<00:01, 20.92it/s, loss=1.49, v_num=1, val_acc=0.699]
Epoch 41:  76%|███████▌  | 89/117 [00:04<00:01, 20.79it/s, loss=1.53, v_num=1, val_acc=0.699]
Epoch 41:  77%|███████▋  | 90/117 [00:04<00:01, 20.99it/s, loss=1.53, v_num=1, val_acc=0.699]
Epoch 41:  77%|███████▋  | 90/117 [00:04<00:01, 20.86it/s, loss=1.53, v_num=1, val_acc=0.699]
Epoch 41:  78%|███████▊  | 91/117 [00:04<00:01, 21.05it/s, loss=1.53, v_num=1, val_acc=0.699]
Epoch 41:  78%|███████▊  | 91/117 [00:04<00:01, 20.93it/s, loss=1.53, v_num=1, val_acc=0.699]
Epoch 41:  79%|███████▊  | 92/117 [00:04<00:01, 21.11it/s, loss=1.53, v_num=1, val_acc=0.699]
Epoch 41:  79%|███████▊  | 92/117 [00:04<00:01, 20.99it/s, loss=1.54, v_num=1, val_acc=0.699]
Epoch 41:  79%|███████▉  | 93/117 [00:04<00:01, 21.18it/s, loss=1.54, v_num=1, val_acc=0.699]
Epoch 41:  79%|███████▉  | 93/117 [00:04<00:01, 21.05it/s, loss=1.56, v_num=1, val_acc=0.699]
Epoch 41:  80%|████████  | 94/117 [00:04<00:01, 21.24it/s, loss=1.56, v_num=1, val_acc=0.699]
Epoch 41:  80%|████████  | 94/117 [00:04<00:01, 21.12it/s, loss=1.55, v_num=1, val_acc=0.699]
Epoch 41:  81%|████████  | 95/117 [00:04<00:01, 21.30it/s, loss=1.55, v_num=1, val_acc=0.699]
Epoch 41:  81%|████████  | 95/117 [00:04<00:01, 21.18it/s, loss=1.56, v_num=1, val_acc=0.699]
Epoch 41:  82%|████████▏ | 96/117 [00:04<00:00, 21.36it/s, loss=1.56, v_num=1, val_acc=0.699]
Epoch 41:  82%|████████▏ | 96/117 [00:04<00:00, 21.24it/s, loss=1.57, v_num=1, val_acc=0.699]
Epoch 41:  83%|████████▎ | 97/117 [00:04<00:00, 21.42it/s, loss=1.57, v_num=1, val_acc=0.699]
Epoch 41:  83%|████████▎ | 97/117 [00:04<00:00, 21.30it/s, loss=1.56, v_num=1, val_acc=0.699]

Validation: 0it [00:00, ?it/s]

Validation:   0%|          | 0/20 [00:00<?, ?it/s]

Validation DataLoader 0:   0%|          | 0/20 [00:00<?, ?it/s]

Validation DataLoader 0:   5%|▌         | 1/20 [00:00<00:00, 191.35it/s]
Epoch 41:  84%|████████▍ | 98/117 [00:05<00:01, 18.22it/s, loss=1.56, v_num=1, val_acc=0.699]

Validation DataLoader 0:  10%|█         | 2/20 [00:00<00:00, 55.66it/s]
Epoch 41:  85%|████████▍ | 99/117 [00:05<00:00, 18.30it/s, loss=1.56, v_num=1, val_acc=0.699]

Validation DataLoader 0:  15%|█▌        | 3/20 [00:00<00:00, 44.46it/s]
Epoch 41:  85%|████████▌ | 100/117 [00:05<00:00, 18.38it/s, loss=1.56, v_num=1, val_acc=0.699]

Validation DataLoader 0:  20%|██        | 4/20 [00:00<00:00, 40.35it/s]
Epoch 41:  86%|████████▋ | 101/117 [00:05<00:00, 18.45it/s, loss=1.56, v_num=1, val_acc=0.699]

Validation DataLoader 0:  25%|██▌       | 5/20 [00:00<00:00, 38.24it/s]
Epoch 41:  87%|████████▋ | 102/117 [00:05<00:00, 18.53it/s, loss=1.56, v_num=1, val_acc=0.699]

Validation DataLoader 0:  30%|███       | 6/20 [00:00<00:00, 36.85it/s]
Epoch 41:  88%|████████▊ | 103/117 [00:05<00:00, 18.60it/s, loss=1.56, v_num=1, val_acc=0.699]

Validation DataLoader 0:  35%|███▌      | 7/20 [00:00<00:00, 36.12it/s]
Epoch 41:  89%|████████▉ | 104/117 [00:05<00:00, 18.68it/s, loss=1.56, v_num=1, val_acc=0.699]

Validation DataLoader 0:  40%|████      | 8/20 [00:00<00:00, 35.49it/s]
Epoch 41:  90%|████████▉ | 105/117 [00:05<00:00, 18.75it/s, loss=1.56, v_num=1, val_acc=0.699]

Validation DataLoader 0:  45%|████▌     | 9/20 [00:00<00:00, 35.00it/s]
Epoch 41:  91%|█████████ | 106/117 [00:05<00:00, 18.82it/s, loss=1.56, v_num=1, val_acc=0.699]

Validation DataLoader 0:  50%|█████     | 10/20 [00:00<00:00, 34.66it/s]
Epoch 41:  91%|█████████▏| 107/117 [00:05<00:00, 18.90it/s, loss=1.56, v_num=1, val_acc=0.699]

Validation DataLoader 0:  55%|█████▌    | 11/20 [00:00<00:00, 34.40it/s]
Epoch 41:  92%|█████████▏| 108/117 [00:05<00:00, 18.97it/s, loss=1.56, v_num=1, val_acc=0.699]

Validation DataLoader 0:  60%|██████    | 12/20 [00:00<00:00, 34.14it/s]
Epoch 41:  93%|█████████▎| 109/117 [00:05<00:00, 19.04it/s, loss=1.56, v_num=1, val_acc=0.699]

Validation DataLoader 0:  65%|██████▌   | 13/20 [00:00<00:00, 33.95it/s]
Epoch 41:  94%|█████████▍| 110/117 [00:05<00:00, 19.11it/s, loss=1.56, v_num=1, val_acc=0.699]

Validation DataLoader 0:  70%|███████   | 14/20 [00:00<00:00, 33.79it/s]
Epoch 41:  95%|█████████▍| 111/117 [00:05<00:00, 19.18it/s, loss=1.56, v_num=1, val_acc=0.699]

Validation DataLoader 0:  75%|███████▌  | 15/20 [00:00<00:00, 33.64it/s]
Epoch 41:  96%|█████████▌| 112/117 [00:05<00:00, 19.24it/s, loss=1.56, v_num=1, val_acc=0.699]

Validation DataLoader 0:  80%|████████  | 16/20 [00:00<00:00, 33.52it/s]
Epoch 41:  97%|█████████▋| 113/117 [00:05<00:00, 19.31it/s, loss=1.56, v_num=1, val_acc=0.699]

Validation DataLoader 0:  85%|████████▌ | 17/20 [00:00<00:00, 33.41it/s]
Epoch 41:  97%|█████████▋| 114/117 [00:05<00:00, 19.38it/s, loss=1.56, v_num=1, val_acc=0.699]

Validation DataLoader 0:  90%|█████████ | 18/20 [00:00<00:00, 33.32it/s]
Epoch 41:  98%|█████████▊| 115/117 [00:05<00:00, 19.44it/s, loss=1.56, v_num=1, val_acc=0.699]

Validation DataLoader 0:  95%|█████████▌| 19/20 [00:00<00:00, 33.23it/s]
Epoch 41:  99%|█████████▉| 116/117 [00:05<00:00, 19.51it/s, loss=1.56, v_num=1, val_acc=0.699]

Validation DataLoader 0: 100%|██████████| 20/20 [00:00<00:00, 33.22it/s]
Epoch 41: 100%|██████████| 117/117 [00:05<00:00, 19.58it/s, loss=1.56, v_num=1, val_acc=0.699]
Epoch 41: 100%|██████████| 117/117 [00:05<00:00, 19.51it/s, loss=1.56, v_num=1, val_acc=0.738]


Epoch 41: 100%|██████████| 117/117 [00:05<00:00, 19.51it/s, loss=1.56, v_num=1, val_acc=0.738]
Epoch 41:   0%|          | 0/117 [00:00<?, ?it/s, loss=1.56, v_num=1, val_acc=0.738]
Epoch 42:   0%|          | 0/117 [00:00<?, ?it/s, loss=1.56, v_num=1, val_acc=0.738]
Epoch 42:   1%|          | 1/117 [00:00<01:49,  1.06it/s, loss=1.56, v_num=1, val_acc=0.738]
Epoch 42:   1%|          | 1/117 [00:00<01:51,  1.04it/s, loss=1.54, v_num=1, val_acc=0.738]
Epoch 42:   2%|▏         | 2/117 [00:00<00:56,  2.05it/s, loss=1.54, v_num=1, val_acc=0.738]
Epoch 42:   2%|▏         | 2/117 [00:00<00:57,  2.00it/s, loss=1.54, v_num=1, val_acc=0.738]
Epoch 42:   3%|▎         | 3/117 [00:01<00:38,  2.98it/s, loss=1.54, v_num=1, val_acc=0.738]
Epoch 42:   3%|▎         | 3/117 [00:01<00:39,  2.90it/s, loss=1.54, v_num=1, val_acc=0.738]
Epoch 42:   3%|▎         | 4/117 [00:01<00:29,  3.84it/s, loss=1.54, v_num=1, val_acc=0.738]
Epoch 42:   3%|▎         | 4/117 [00:01<00:30,  3.75it/s, loss=1.59, v_num=1, val_acc=0.738]
Epoch 42:   4%|▍         | 5/117 [00:01<00:24,  4.65it/s, loss=1.59, v_num=1, val_acc=0.738]
Epoch 42:   4%|▍         | 5/117 [00:01<00:24,  4.54it/s, loss=1.6, v_num=1, val_acc=0.738]
Epoch 42:   5%|▌         | 6/117 [00:01<00:20,  5.40it/s, loss=1.6, v_num=1, val_acc=0.738]
Epoch 42:   5%|▌         | 6/117 [00:01<00:20,  5.29it/s, loss=1.59, v_num=1, val_acc=0.738]
Epoch 42:   6%|▌         | 7/117 [00:01<00:17,  6.12it/s, loss=1.59, v_num=1, val_acc=0.738]
Epoch 42:   6%|▌         | 7/117 [00:01<00:18,  5.99it/s, loss=1.56, v_num=1, val_acc=0.738]
Epoch 42:   7%|▋         | 8/117 [00:01<00:16,  6.79it/s, loss=1.56, v_num=1, val_acc=0.738]
Epoch 42:   7%|▋         | 8/117 [00:01<00:16,  6.65it/s, loss=1.53, v_num=1, val_acc=0.738]
Epoch 42:   8%|▊         | 9/117 [00:01<00:14,  7.37it/s, loss=1.53, v_num=1, val_acc=0.738]
Epoch 42:   8%|▊         | 9/117 [00:01<00:14,  7.23it/s, loss=1.53, v_num=1, val_acc=0.738]
Epoch 42:   9%|▊         | 10/117 [00:01<00:13,  7.97it/s, loss=1.53, v_num=1, val_acc=0.738]
Epoch 42:   9%|▊         | 10/117 [00:01<00:13,  7.82it/s, loss=1.55, v_num=1, val_acc=0.738]
Epoch 42:   9%|▉         | 11/117 [00:01<00:12,  8.54it/s, loss=1.55, v_num=1, val_acc=0.738]
Epoch 42:   9%|▉         | 11/117 [00:01<00:12,  8.38it/s, loss=1.57, v_num=1, val_acc=0.738]
Epoch 42:  10%|█         | 12/117 [00:01<00:11,  9.08it/s, loss=1.57, v_num=1, val_acc=0.738]
Epoch 42:  10%|█         | 12/117 [00:01<00:11,  8.91it/s, loss=1.56, v_num=1, val_acc=0.738]
Epoch 42:  11%|█         | 13/117 [00:01<00:10,  9.60it/s, loss=1.56, v_num=1, val_acc=0.738]
Epoch 42:  11%|█         | 13/117 [00:01<00:11,  9.42it/s, loss=1.6, v_num=1, val_acc=0.738]
Epoch 42:  12%|█▏        | 14/117 [00:01<00:10, 10.09it/s, loss=1.6, v_num=1, val_acc=0.738]
Epoch 42:  12%|█▏        | 14/117 [00:01<00:10,  9.90it/s, loss=1.66, v_num=1, val_acc=0.738]
Epoch 42:  13%|█▎        | 15/117 [00:01<00:09, 10.55it/s, loss=1.66, v_num=1, val_acc=0.738]
Epoch 42:  13%|█▎        | 15/117 [00:01<00:09, 10.37it/s, loss=1.65, v_num=1, val_acc=0.738]
Epoch 42:  14%|█▎        | 16/117 [00:01<00:09, 11.00it/s, loss=1.65, v_num=1, val_acc=0.738]
Epoch 42:  14%|█▎        | 16/117 [00:01<00:09, 10.81it/s, loss=1.63, v_num=1, val_acc=0.738]
Epoch 42:  15%|█▍        | 17/117 [00:01<00:08, 11.40it/s, loss=1.63, v_num=1, val_acc=0.738]
Epoch 42:  15%|█▍        | 17/117 [00:01<00:08, 11.21it/s, loss=1.62, v_num=1, val_acc=0.738]
Epoch 42:  15%|█▌        | 18/117 [00:01<00:08, 11.81it/s, loss=1.62, v_num=1, val_acc=0.738]
Epoch 42:  15%|█▌        | 18/117 [00:01<00:08, 11.61it/s, loss=1.59, v_num=1, val_acc=0.738]
Epoch 42:  16%|█▌        | 19/117 [00:01<00:08, 12.20it/s, loss=1.59, v_num=1, val_acc=0.738]
Epoch 42:  16%|█▌        | 19/117 [00:01<00:08, 12.00it/s, loss=1.57, v_num=1, val_acc=0.738]
Epoch 42:  17%|█▋        | 20/117 [00:01<00:07, 12.56it/s, loss=1.57, v_num=1, val_acc=0.738]
Epoch 42:  17%|█▋        | 20/117 [00:01<00:07, 12.36it/s, loss=1.58, v_num=1, val_acc=0.738]
Epoch 42:  18%|█▊        | 21/117 [00:01<00:07, 12.92it/s, loss=1.58, v_num=1, val_acc=0.738]
Epoch 42:  18%|█▊        | 21/117 [00:01<00:07, 12.72it/s, loss=1.64, v_num=1, val_acc=0.738]
Epoch 42:  19%|█▉        | 22/117 [00:01<00:07, 13.25it/s, loss=1.64, v_num=1, val_acc=0.738]
Epoch 42:  19%|█▉        | 22/117 [00:01<00:07, 13.05it/s, loss=1.65, v_num=1, val_acc=0.738]
Epoch 42:  20%|█▉        | 23/117 [00:01<00:06, 13.58it/s, loss=1.65, v_num=1, val_acc=0.738]
Epoch 42:  20%|█▉        | 23/117 [00:01<00:07, 13.38it/s, loss=1.64, v_num=1, val_acc=0.738]
Epoch 42:  21%|██        | 24/117 [00:01<00:06, 13.89it/s, loss=1.64, v_num=1, val_acc=0.738]
Epoch 42:  21%|██        | 24/117 [00:01<00:06, 13.68it/s, loss=1.58, v_num=1, val_acc=0.738]
Epoch 42:  21%|██▏       | 25/117 [00:01<00:06, 14.18it/s, loss=1.58, v_num=1, val_acc=0.738]
Epoch 42:  21%|██▏       | 25/117 [00:01<00:06, 13.98it/s, loss=1.59, v_num=1, val_acc=0.738]
Epoch 42:  22%|██▏       | 26/117 [00:01<00:06, 14.47it/s, loss=1.59, v_num=1, val_acc=0.738]
Epoch 42:  22%|██▏       | 26/117 [00:01<00:06, 14.27it/s, loss=1.6, v_num=1, val_acc=0.738]
Epoch 42:  23%|██▎       | 27/117 [00:01<00:06, 14.73it/s, loss=1.6, v_num=1, val_acc=0.738]
Epoch 42:  23%|██▎       | 27/117 [00:01<00:06, 14.53it/s, loss=1.62, v_num=1, val_acc=0.738]
Epoch 42:  24%|██▍       | 28/117 [00:01<00:05, 15.00it/s, loss=1.62, v_num=1, val_acc=0.738]
Epoch 42:  24%|██▍       | 28/117 [00:01<00:06, 14.80it/s, loss=1.6, v_num=1, val_acc=0.738]
Epoch 42:  25%|██▍       | 29/117 [00:01<00:05, 15.25it/s, loss=1.6, v_num=1, val_acc=0.738]
Epoch 42:  25%|██▍       | 29/117 [00:01<00:05, 15.05it/s, loss=1.58, v_num=1, val_acc=0.738]
Epoch 42:  26%|██▌       | 30/117 [00:01<00:05, 15.50it/s, loss=1.58, v_num=1, val_acc=0.738]
Epoch 42:  26%|██▌       | 30/117 [00:01<00:05, 15.30it/s, loss=1.54, v_num=1, val_acc=0.738]
Epoch 42:  26%|██▋       | 31/117 [00:01<00:05, 15.74it/s, loss=1.54, v_num=1, val_acc=0.738]
Epoch 42:  26%|██▋       | 31/117 [00:01<00:05, 15.54it/s, loss=1.5, v_num=1, val_acc=0.738]
Epoch 42:  27%|██▋       | 32/117 [00:02<00:05, 15.97it/s, loss=1.5, v_num=1, val_acc=0.738]
Epoch 42:  27%|██▋       | 32/117 [00:02<00:05, 15.77it/s, loss=1.49, v_num=1, val_acc=0.738]
Epoch 42:  28%|██▊       | 33/117 [00:02<00:05, 16.18it/s, loss=1.49, v_num=1, val_acc=0.738]
Epoch 42:  28%|██▊       | 33/117 [00:02<00:05, 15.99it/s, loss=1.45, v_num=1, val_acc=0.738]
Epoch 42:  29%|██▉       | 34/117 [00:02<00:05, 16.35it/s, loss=1.45, v_num=1, val_acc=0.738]
Epoch 42:  29%|██▉       | 34/117 [00:02<00:05, 16.17it/s, loss=1.37, v_num=1, val_acc=0.738]
Epoch 42:  30%|██▉       | 35/117 [00:02<00:04, 16.58it/s, loss=1.37, v_num=1, val_acc=0.738]
Epoch 42:  30%|██▉       | 35/117 [00:02<00:05, 16.38it/s, loss=1.36, v_num=1, val_acc=0.738]
Epoch 42:  31%|███       | 36/117 [00:02<00:04, 16.78it/s, loss=1.36, v_num=1, val_acc=0.738]
Epoch 42:  31%|███       | 36/117 [00:02<00:04, 16.59it/s, loss=1.35, v_num=1, val_acc=0.738]
Epoch 42:  32%|███▏      | 37/117 [00:02<00:04, 16.98it/s, loss=1.35, v_num=1, val_acc=0.738]
Epoch 42:  32%|███▏      | 37/117 [00:02<00:04, 16.78it/s, loss=1.35, v_num=1, val_acc=0.738]
Epoch 42:  32%|███▏      | 38/117 [00:02<00:04, 17.17it/s, loss=1.35, v_num=1, val_acc=0.738]
Epoch 42:  32%|███▏      | 38/117 [00:02<00:04, 16.97it/s, loss=1.38, v_num=1, val_acc=0.738]
Epoch 42:  33%|███▎      | 39/117 [00:02<00:04, 17.35it/s, loss=1.38, v_num=1, val_acc=0.738]
Epoch 42:  33%|███▎      | 39/117 [00:02<00:04, 17.16it/s, loss=1.42, v_num=1, val_acc=0.738]
Epoch 42:  34%|███▍      | 40/117 [00:02<00:04, 17.53it/s, loss=1.42, v_num=1, val_acc=0.738]
Epoch 42:  34%|███▍      | 40/117 [00:02<00:04, 17.34it/s, loss=1.42, v_num=1, val_acc=0.738]
Epoch 42:  35%|███▌      | 41/117 [00:02<00:04, 17.70it/s, loss=1.42, v_num=1, val_acc=0.738]
Epoch 42:  35%|███▌      | 41/117 [00:02<00:04, 17.51it/s, loss=1.38, v_num=1, val_acc=0.738]
Epoch 42:  36%|███▌      | 42/117 [00:02<00:04, 17.87it/s, loss=1.38, v_num=1, val_acc=0.738]
Epoch 42:  36%|███▌      | 42/117 [00:02<00:04, 17.68it/s, loss=1.39, v_num=1, val_acc=0.738]
Epoch 42:  37%|███▋      | 43/117 [00:02<00:04, 18.03it/s, loss=1.39, v_num=1, val_acc=0.738]
Epoch 42:  37%|███▋      | 43/117 [00:02<00:04, 17.84it/s, loss=1.42, v_num=1, val_acc=0.738]
Epoch 42:  38%|███▊      | 44/117 [00:02<00:04, 18.19it/s, loss=1.42, v_num=1, val_acc=0.738]
Epoch 42:  38%|███▊      | 44/117 [00:02<00:04, 18.00it/s, loss=1.44, v_num=1, val_acc=0.738]
Epoch 42:  38%|███▊      | 45/117 [00:02<00:03, 18.35it/s, loss=1.44, v_num=1, val_acc=0.738]
Epoch 42:  38%|███▊      | 45/117 [00:02<00:03, 18.16it/s, loss=1.42, v_num=1, val_acc=0.738]
Epoch 42:  39%|███▉      | 46/117 [00:02<00:03, 18.50it/s, loss=1.42, v_num=1, val_acc=0.738]
Epoch 42:  39%|███▉      | 46/117 [00:02<00:03, 18.31it/s, loss=1.39, v_num=1, val_acc=0.738]
Epoch 42:  40%|████      | 47/117 [00:02<00:03, 18.64it/s, loss=1.39, v_num=1, val_acc=0.738]
Epoch 42:  40%|████      | 47/117 [00:02<00:03, 18.46it/s, loss=1.35, v_num=1, val_acc=0.738]
Epoch 42:  41%|████      | 48/117 [00:02<00:03, 18.78it/s, loss=1.35, v_num=1, val_acc=0.738]
Epoch 42:  41%|████      | 48/117 [00:02<00:03, 18.60it/s, loss=1.36, v_num=1, val_acc=0.738]
Epoch 42:  42%|████▏     | 49/117 [00:02<00:03, 18.92it/s, loss=1.36, v_num=1, val_acc=0.738]
Epoch 42:  42%|████▏     | 49/117 [00:02<00:03, 18.74it/s, loss=1.38, v_num=1, val_acc=0.738]
Epoch 42:  43%|████▎     | 50/117 [00:02<00:03, 19.06it/s, loss=1.38, v_num=1, val_acc=0.738]
Epoch 42:  43%|████▎     | 50/117 [00:02<00:03, 18.87it/s, loss=1.45, v_num=1, val_acc=0.738]
Epoch 42:  44%|████▎     | 51/117 [00:02<00:03, 19.19it/s, loss=1.45, v_num=1, val_acc=0.738]
Epoch 42:  44%|████▎     | 51/117 [00:02<00:03, 19.01it/s, loss=1.47, v_num=1, val_acc=0.738]
Epoch 42:  44%|████▍     | 52/117 [00:02<00:03, 19.31it/s, loss=1.47, v_num=1, val_acc=0.738]
Epoch 42:  44%|████▍     | 52/117 [00:02<00:03, 19.13it/s, loss=1.46, v_num=1, val_acc=0.738]
Epoch 42:  45%|████▌     | 53/117 [00:02<00:03, 19.44it/s, loss=1.46, v_num=1, val_acc=0.738]
Epoch 42:  45%|████▌     | 53/117 [00:02<00:03, 19.26it/s, loss=1.48, v_num=1, val_acc=0.738]
Epoch 42:  46%|████▌     | 54/117 [00:02<00:03, 19.56it/s, loss=1.48, v_num=1, val_acc=0.738]
Epoch 42:  46%|████▌     | 54/117 [00:02<00:03, 19.38it/s, loss=1.51, v_num=1, val_acc=0.738]
Epoch 42:  47%|████▋     | 55/117 [00:02<00:03, 19.68it/s, loss=1.51, v_num=1, val_acc=0.738]
Epoch 42:  47%|████▋     | 55/117 [00:02<00:03, 19.50it/s, loss=1.54, v_num=1, val_acc=0.738]
Epoch 42:  48%|████▊     | 56/117 [00:02<00:03, 19.79it/s, loss=1.54, v_num=1, val_acc=0.738]
Epoch 42:  48%|████▊     | 56/117 [00:02<00:03, 19.62it/s, loss=1.56, v_num=1, val_acc=0.738]
Epoch 42:  49%|████▊     | 57/117 [00:02<00:03, 19.91it/s, loss=1.56, v_num=1, val_acc=0.738]
Epoch 42:  49%|████▊     | 57/117 [00:02<00:03, 19.73it/s, loss=1.56, v_num=1, val_acc=0.738]
Epoch 42:  50%|████▉     | 58/117 [00:02<00:02, 20.02it/s, loss=1.56, v_num=1, val_acc=0.738]
Epoch 42:  50%|████▉     | 58/117 [00:02<00:02, 19.84it/s, loss=1.53, v_num=1, val_acc=0.738]
Epoch 42:  50%|█████     | 59/117 [00:02<00:02, 20.12it/s, loss=1.53, v_num=1, val_acc=0.738]
Epoch 42:  50%|█████     | 59/117 [00:02<00:02, 19.95it/s, loss=1.52, v_num=1, val_acc=0.738]
Epoch 42:  51%|█████▏    | 60/117 [00:02<00:02, 20.23it/s, loss=1.52, v_num=1, val_acc=0.738]
Epoch 42:  51%|█████▏    | 60/117 [00:02<00:02, 20.06it/s, loss=1.52, v_num=1, val_acc=0.738]
Epoch 42:  52%|█████▏    | 61/117 [00:03<00:02, 20.33it/s, loss=1.52, v_num=1, val_acc=0.738]
Epoch 42:  52%|█████▏    | 61/117 [00:03<00:02, 20.16it/s, loss=1.52, v_num=1, val_acc=0.738]
Epoch 42:  53%|█████▎    | 62/117 [00:03<00:02, 20.43it/s, loss=1.52, v_num=1, val_acc=0.738]
Epoch 42:  53%|█████▎    | 62/117 [00:03<00:02, 20.26it/s, loss=1.5, v_num=1, val_acc=0.738]
Epoch 42:  54%|█████▍    | 63/117 [00:03<00:02, 20.53it/s, loss=1.5, v_num=1, val_acc=0.738]
Epoch 42:  54%|█████▍    | 63/117 [00:03<00:02, 20.36it/s, loss=1.51, v_num=1, val_acc=0.738]
Epoch 42:  55%|█████▍    | 64/117 [00:03<00:02, 20.63it/s, loss=1.51, v_num=1, val_acc=0.738]
Epoch 42:  55%|█████▍    | 64/117 [00:03<00:02, 20.46it/s, loss=1.51, v_num=1, val_acc=0.738]
Epoch 42:  56%|█████▌    | 65/117 [00:03<00:02, 20.72it/s, loss=1.51, v_num=1, val_acc=0.738]
Epoch 42:  56%|█████▌    | 65/117 [00:03<00:02, 20.55it/s, loss=1.51, v_num=1, val_acc=0.738]
Epoch 42:  56%|█████▋    | 66/117 [00:03<00:02, 20.81it/s, loss=1.51, v_num=1, val_acc=0.738]
Epoch 42:  56%|█████▋    | 66/117 [00:03<00:02, 20.65it/s, loss=1.5, v_num=1, val_acc=0.738]
Epoch 42:  57%|█████▋    | 67/117 [00:03<00:02, 20.90it/s, loss=1.5, v_num=1, val_acc=0.738]
Epoch 42:  57%|█████▋    | 67/117 [00:03<00:02, 20.74it/s, loss=1.51, v_num=1, val_acc=0.738]
Epoch 42:  58%|█████▊    | 68/117 [00:03<00:02, 20.99it/s, loss=1.51, v_num=1, val_acc=0.738]
Epoch 42:  58%|█████▊    | 68/117 [00:03<00:02, 20.83it/s, loss=1.53, v_num=1, val_acc=0.738]
Epoch 42:  59%|█████▉    | 69/117 [00:03<00:02, 21.07it/s, loss=1.53, v_num=1, val_acc=0.738]
Epoch 42:  59%|█████▉    | 69/117 [00:03<00:02, 20.91it/s, loss=1.6, v_num=1, val_acc=0.738]
Epoch 42:  60%|█████▉    | 70/117 [00:03<00:02, 21.16it/s, loss=1.6, v_num=1, val_acc=0.738]
Epoch 42:  60%|█████▉    | 70/117 [00:03<00:02, 21.00it/s, loss=1.55, v_num=1, val_acc=0.738]
Epoch 42:  61%|██████    | 71/117 [00:03<00:02, 21.24it/s, loss=1.55, v_num=1, val_acc=0.738]
Epoch 42:  61%|██████    | 71/117 [00:03<00:02, 21.08it/s, loss=1.53, v_num=1, val_acc=0.738]
Epoch 42:  62%|██████▏   | 72/117 [00:03<00:02, 21.32it/s, loss=1.53, v_num=1, val_acc=0.738]
Epoch 42:  62%|██████▏   | 72/117 [00:03<00:02, 21.16it/s, loss=1.53, v_num=1, val_acc=0.738]
Epoch 42:  62%|██████▏   | 73/117 [00:03<00:02, 21.40it/s, loss=1.53, v_num=1, val_acc=0.738]
Epoch 42:  62%|██████▏   | 73/117 [00:03<00:02, 21.24it/s, loss=1.51, v_num=1, val_acc=0.738]
Epoch 42:  63%|██████▎   | 74/117 [00:03<00:02, 21.48it/s, loss=1.51, v_num=1, val_acc=0.738]
Epoch 42:  63%|██████▎   | 74/117 [00:03<00:02, 21.32it/s, loss=1.49, v_num=1, val_acc=0.738]
Epoch 42:  64%|██████▍   | 75/117 [00:03<00:01, 21.56it/s, loss=1.49, v_num=1, val_acc=0.738]
Epoch 42:  64%|██████▍   | 75/117 [00:03<00:01, 21.40it/s, loss=1.46, v_num=1, val_acc=0.738]
Epoch 42:  65%|██████▍   | 76/117 [00:03<00:01, 21.63it/s, loss=1.46, v_num=1, val_acc=0.738]
Epoch 42:  65%|██████▍   | 76/117 [00:03<00:01, 21.48it/s, loss=1.47, v_num=1, val_acc=0.738]
Epoch 42:  66%|██████▌   | 77/117 [00:03<00:01, 21.70it/s, loss=1.47, v_num=1, val_acc=0.738]
Epoch 42:  66%|██████▌   | 77/117 [00:03<00:01, 21.55it/s, loss=1.5, v_num=1, val_acc=0.738]
Epoch 42:  67%|██████▋   | 78/117 [00:03<00:01, 21.77it/s, loss=1.5, v_num=1, val_acc=0.738]
Epoch 42:  67%|██████▋   | 78/117 [00:03<00:01, 21.62it/s, loss=1.5, v_num=1, val_acc=0.738]
Epoch 42:  68%|██████▊   | 79/117 [00:03<00:01, 21.84it/s, loss=1.5, v_num=1, val_acc=0.738]
Epoch 42:  68%|██████▊   | 79/117 [00:03<00:01, 21.69it/s, loss=1.46, v_num=1, val_acc=0.738]
Epoch 42:  68%|██████▊   | 80/117 [00:03<00:01, 21.91it/s, loss=1.46, v_num=1, val_acc=0.738]
Epoch 42:  68%|██████▊   | 80/117 [00:03<00:01, 21.76it/s, loss=1.45, v_num=1, val_acc=0.738]
Epoch 42:  69%|██████▉   | 81/117 [00:03<00:01, 21.98it/s, loss=1.45, v_num=1, val_acc=0.738]
Epoch 42:  69%|██████▉   | 81/117 [00:03<00:01, 21.83it/s, loss=1.47, v_num=1, val_acc=0.738]
Epoch 42:  70%|███████   | 82/117 [00:03<00:01, 22.02it/s, loss=1.47, v_num=1, val_acc=0.738]
Epoch 42:  70%|███████   | 82/117 [00:03<00:01, 21.88it/s, loss=1.5, v_num=1, val_acc=0.738]
Epoch 42:  71%|███████   | 83/117 [00:03<00:01, 22.09it/s, loss=1.5, v_num=1, val_acc=0.738]
Epoch 42:  71%|███████   | 83/117 [00:03<00:01, 21.94it/s, loss=1.5, v_num=1, val_acc=0.738]
Epoch 42:  72%|███████▏  | 84/117 [00:03<00:01, 22.16it/s, loss=1.5, v_num=1, val_acc=0.738]
Epoch 42:  72%|███████▏  | 84/117 [00:03<00:01, 22.01it/s, loss=1.51, v_num=1, val_acc=0.738]
Epoch 42:  73%|███████▎  | 85/117 [00:03<00:01, 22.22it/s, loss=1.51, v_num=1, val_acc=0.738]
Epoch 42:  73%|███████▎  | 85/117 [00:03<00:01, 22.07it/s, loss=1.56, v_num=1, val_acc=0.738]
Epoch 42:  74%|███████▎  | 86/117 [00:03<00:01, 22.28it/s, loss=1.56, v_num=1, val_acc=0.738]
Epoch 42:  74%|███████▎  | 86/117 [00:03<00:01, 22.14it/s, loss=1.57, v_num=1, val_acc=0.738]
Epoch 42:  74%|███████▍  | 87/117 [00:03<00:01, 22.34it/s, loss=1.57, v_num=1, val_acc=0.738]
Epoch 42:  74%|███████▍  | 87/117 [00:03<00:01, 22.20it/s, loss=1.56, v_num=1, val_acc=0.738]
Epoch 42:  75%|███████▌  | 88/117 [00:03<00:01, 22.40it/s, loss=1.56, v_num=1, val_acc=0.738]
Epoch 42:  75%|███████▌  | 88/117 [00:03<00:01, 22.26it/s, loss=1.55, v_num=1, val_acc=0.738]
Epoch 42:  76%|███████▌  | 89/117 [00:03<00:01, 22.46it/s, loss=1.55, v_num=1, val_acc=0.738]
Epoch 42:  76%|███████▌  | 89/117 [00:03<00:01, 22.32it/s, loss=1.47, v_num=1, val_acc=0.738]
Epoch 42:  77%|███████▋  | 90/117 [00:03<00:01, 22.52it/s, loss=1.47, v_num=1, val_acc=0.738]
Epoch 42:  77%|███████▋  | 90/117 [00:04<00:01, 22.38it/s, loss=1.53, v_num=1, val_acc=0.738]
Epoch 42:  78%|███████▊  | 91/117 [00:04<00:01, 22.57it/s, loss=1.53, v_num=1, val_acc=0.738]
Epoch 42:  78%|███████▊  | 91/117 [00:04<00:01, 22.43it/s, loss=1.56, v_num=1, val_acc=0.738]
Epoch 42:  79%|███████▊  | 92/117 [00:04<00:01, 22.63it/s, loss=1.56, v_num=1, val_acc=0.738]
Epoch 42:  79%|███████▊  | 92/117 [00:04<00:01, 22.49it/s, loss=1.59, v_num=1, val_acc=0.738]
Epoch 42:  79%|███████▉  | 93/117 [00:04<00:01, 22.69it/s, loss=1.59, v_num=1, val_acc=0.738]
Epoch 42:  79%|███████▉  | 93/117 [00:04<00:01, 22.55it/s, loss=1.62, v_num=1, val_acc=0.738]
Epoch 42:  80%|████████  | 94/117 [00:04<00:01, 22.74it/s, loss=1.62, v_num=1, val_acc=0.738]
Epoch 42:  80%|████████  | 94/117 [00:04<00:01, 22.60it/s, loss=1.67, v_num=1, val_acc=0.738]
Epoch 42:  81%|████████  | 95/117 [00:04<00:00, 22.79it/s, loss=1.67, v_num=1, val_acc=0.738]
Epoch 42:  81%|████████  | 95/117 [00:04<00:00, 22.65it/s, loss=1.7, v_num=1, val_acc=0.738]
Epoch 42:  82%|████████▏ | 96/117 [00:04<00:00, 22.84it/s, loss=1.7, v_num=1, val_acc=0.738]
Epoch 42:  82%|████████▏ | 96/117 [00:04<00:00, 22.71it/s, loss=1.76, v_num=1, val_acc=0.738]
Epoch 42:  83%|████████▎ | 97/117 [00:04<00:00, 22.86it/s, loss=1.76, v_num=1, val_acc=0.738]
Epoch 42:  83%|████████▎ | 97/117 [00:04<00:00, 22.74it/s, loss=1.73, v_num=1, val_acc=0.738]

Validation: 0it [00:00, ?it/s]

Validation:   0%|          | 0/20 [00:00<?, ?it/s]

Validation DataLoader 0:   0%|          | 0/20 [00:00<?, ?it/s]

Validation DataLoader 0:   5%|▌         | 1/20 [00:00<00:00, 175.70it/s]
Epoch 42:  84%|████████▍ | 98/117 [00:05<00:00, 19.17it/s, loss=1.73, v_num=1, val_acc=0.738]

Validation DataLoader 0:  10%|█         | 2/20 [00:00<00:00, 55.38it/s]
Epoch 42:  85%|████████▍ | 99/117 [00:05<00:00, 19.25it/s, loss=1.73, v_num=1, val_acc=0.738]

Validation DataLoader 0:  15%|█▌        | 3/20 [00:00<00:00, 44.35it/s]
Epoch 42:  85%|████████▌ | 100/117 [00:05<00:00, 19.32it/s, loss=1.73, v_num=1, val_acc=0.738]

Validation DataLoader 0:  20%|██        | 4/20 [00:00<00:00, 40.44it/s]
Epoch 42:  86%|████████▋ | 101/117 [00:05<00:00, 19.40it/s, loss=1.73, v_num=1, val_acc=0.738]

Validation DataLoader 0:  25%|██▌       | 5/20 [00:00<00:00, 38.31it/s]
Epoch 42:  87%|████████▋ | 102/117 [00:05<00:00, 19.47it/s, loss=1.73, v_num=1, val_acc=0.738]

Validation DataLoader 0:  30%|███       | 6/20 [00:00<00:00, 37.05it/s]
Epoch 42:  88%|████████▊ | 103/117 [00:05<00:00, 19.55it/s, loss=1.73, v_num=1, val_acc=0.738]

Validation DataLoader 0:  35%|███▌      | 7/20 [00:00<00:00, 36.21it/s]
Epoch 42:  89%|████████▉ | 104/117 [00:05<00:00, 19.62it/s, loss=1.73, v_num=1, val_acc=0.738]

Validation DataLoader 0:  40%|████      | 8/20 [00:00<00:00, 35.57it/s]
Epoch 42:  90%|████████▉ | 105/117 [00:05<00:00, 19.69it/s, loss=1.73, v_num=1, val_acc=0.738]

Validation DataLoader 0:  45%|████▌     | 9/20 [00:00<00:00, 35.09it/s]
Epoch 42:  91%|█████████ | 106/117 [00:05<00:00, 19.76it/s, loss=1.73, v_num=1, val_acc=0.738]

Validation DataLoader 0:  50%|█████     | 10/20 [00:00<00:00, 34.72it/s]
Epoch 42:  91%|█████████▏| 107/117 [00:05<00:00, 19.83it/s, loss=1.73, v_num=1, val_acc=0.738]

Validation DataLoader 0:  55%|█████▌    | 11/20 [00:00<00:00, 34.42it/s]
Epoch 42:  92%|█████████▏| 108/117 [00:05<00:00, 19.90it/s, loss=1.73, v_num=1, val_acc=0.738]

Validation DataLoader 0:  60%|██████    | 12/20 [00:00<00:00, 34.18it/s]
Epoch 42:  93%|█████████▎| 109/117 [00:05<00:00, 19.97it/s, loss=1.73, v_num=1, val_acc=0.738]

Validation DataLoader 0:  65%|██████▌   | 13/20 [00:00<00:00, 33.98it/s]
Epoch 42:  94%|█████████▍| 110/117 [00:05<00:00, 20.04it/s, loss=1.73, v_num=1, val_acc=0.738]

Validation DataLoader 0:  70%|███████   | 14/20 [00:00<00:00, 33.81it/s]
Epoch 42:  95%|█████████▍| 111/117 [00:05<00:00, 20.10it/s, loss=1.73, v_num=1, val_acc=0.738]

Validation DataLoader 0:  75%|███████▌  | 15/20 [00:00<00:00, 33.65it/s]
Epoch 42:  96%|█████████▌| 112/117 [00:05<00:00, 20.17it/s, loss=1.73, v_num=1, val_acc=0.738]

Validation DataLoader 0:  80%|████████  | 16/20 [00:00<00:00, 33.54it/s]
Epoch 42:  97%|█████████▋| 113/117 [00:05<00:00, 20.23it/s, loss=1.73, v_num=1, val_acc=0.738]

Validation DataLoader 0:  85%|████████▌ | 17/20 [00:00<00:00, 33.41it/s]
Epoch 42:  97%|█████████▋| 114/117 [00:05<00:00, 20.30it/s, loss=1.73, v_num=1, val_acc=0.738]

Validation DataLoader 0:  90%|█████████ | 18/20 [00:00<00:00, 33.32it/s]
Epoch 42:  98%|█████████▊| 115/117 [00:05<00:00, 20.36it/s, loss=1.73, v_num=1, val_acc=0.738]

Validation DataLoader 0:  95%|█████████▌| 19/20 [00:00<00:00, 33.23it/s]
Epoch 42:  99%|█████████▉| 116/117 [00:05<00:00, 20.43it/s, loss=1.73, v_num=1, val_acc=0.738]

Validation DataLoader 0: 100%|██████████| 20/20 [00:00<00:00, 33.22it/s]
Epoch 42: 100%|██████████| 117/117 [00:05<00:00, 20.49it/s, loss=1.73, v_num=1, val_acc=0.738]
Epoch 42: 100%|██████████| 117/117 [00:05<00:00, 20.42it/s, loss=1.73, v_num=1, val_acc=0.711]


Epoch 42: 100%|██████████| 117/117 [00:05<00:00, 20.42it/s, loss=1.73, v_num=1, val_acc=0.711]
Epoch 42:   0%|          | 0/117 [00:00<?, ?it/s, loss=1.73, v_num=1, val_acc=0.711]
Epoch 43:   0%|          | 0/117 [00:00<?, ?it/s, loss=1.73, v_num=1, val_acc=0.711]
Epoch 43:   1%|          | 1/117 [00:00<01:44,  1.11it/s, loss=1.73, v_num=1, val_acc=0.711]
Epoch 43:   1%|          | 1/117 [00:00<01:46,  1.09it/s, loss=1.74, v_num=1, val_acc=0.711]
Epoch 43:   2%|▏         | 2/117 [00:00<00:53,  2.15it/s, loss=1.74, v_num=1, val_acc=0.711]
Epoch 43:   2%|▏         | 2/117 [00:00<00:54,  2.10it/s, loss=1.73, v_num=1, val_acc=0.711]
Epoch 43:   3%|▎         | 3/117 [00:00<00:36,  3.12it/s, loss=1.73, v_num=1, val_acc=0.711]
Epoch 43:   3%|▎         | 3/117 [00:00<00:37,  3.04it/s, loss=1.72, v_num=1, val_acc=0.711]
Epoch 43:   3%|▎         | 4/117 [00:00<00:28,  4.02it/s, loss=1.72, v_num=1, val_acc=0.711]
Epoch 43:   3%|▎         | 4/117 [00:01<00:28,  3.92it/s, loss=1.69, v_num=1, val_acc=0.711]
Epoch 43:   4%|▍         | 5/117 [00:01<00:23,  4.86it/s, loss=1.69, v_num=1, val_acc=0.711]
Epoch 43:   4%|▍         | 5/117 [00:01<00:23,  4.74it/s, loss=1.67, v_num=1, val_acc=0.711]
Epoch 43:   5%|▌         | 6/117 [00:01<00:19,  5.65it/s, loss=1.67, v_num=1, val_acc=0.711]
Epoch 43:   5%|▌         | 6/117 [00:01<00:20,  5.51it/s, loss=1.64, v_num=1, val_acc=0.711]
Epoch 43:   6%|▌         | 7/117 [00:01<00:17,  6.38it/s, loss=1.64, v_num=1, val_acc=0.711]
Epoch 43:   6%|▌         | 7/117 [00:01<00:17,  6.24it/s, loss=1.62, v_num=1, val_acc=0.711]
Epoch 43:   7%|▋         | 8/117 [00:01<00:15,  7.08it/s, loss=1.62, v_num=1, val_acc=0.711]
Epoch 43:   7%|▋         | 8/117 [00:01<00:15,  6.92it/s, loss=1.59, v_num=1, val_acc=0.711]
Epoch 43:   8%|▊         | 9/117 [00:01<00:14,  7.70it/s, loss=1.59, v_num=1, val_acc=0.711]
Epoch 43:   8%|▊         | 9/117 [00:01<00:14,  7.54it/s, loss=1.59, v_num=1, val_acc=0.711]
Epoch 43:   9%|▊         | 10/117 [00:01<00:12,  8.32it/s, loss=1.59, v_num=1, val_acc=0.711]
Epoch 43:   9%|▊         | 10/117 [00:01<00:13,  8.15it/s, loss=1.64, v_num=1, val_acc=0.711]
Epoch 43:   9%|▉         | 11/117 [00:01<00:11,  8.90it/s, loss=1.64, v_num=1, val_acc=0.711]
Epoch 43:   9%|▉         | 11/117 [00:01<00:12,  8.73it/s, loss=1.62, v_num=1, val_acc=0.711]
Epoch 43:  10%|█         | 12/117 [00:01<00:11,  9.44it/s, loss=1.62, v_num=1, val_acc=0.711]
Epoch 43:  10%|█         | 12/117 [00:01<00:11,  9.25it/s, loss=1.61, v_num=1, val_acc=0.711]
Epoch 43:  11%|█         | 13/117 [00:01<00:10,  9.96it/s, loss=1.61, v_num=1, val_acc=0.711]
Epoch 43:  11%|█         | 13/117 [00:01<00:10,  9.77it/s, loss=1.56, v_num=1, val_acc=0.711]
Epoch 43:  12%|█▏        | 14/117 [00:01<00:09, 10.46it/s, loss=1.56, v_num=1, val_acc=0.711]
Epoch 43:  12%|█▏        | 14/117 [00:01<00:10, 10.27it/s, loss=1.53, v_num=1, val_acc=0.711]
Epoch 43:  13%|█▎        | 15/117 [00:01<00:09, 10.93it/s, loss=1.53, v_num=1, val_acc=0.711]
Epoch 43:  13%|█▎        | 15/117 [00:01<00:09, 10.73it/s, loss=1.49, v_num=1, val_acc=0.711]
Epoch 43:  14%|█▎        | 16/117 [00:01<00:08, 11.38it/s, loss=1.49, v_num=1, val_acc=0.711]
Epoch 43:  14%|█▎        | 16/117 [00:01<00:09, 11.18it/s, loss=1.47, v_num=1, val_acc=0.711]
Epoch 43:  15%|█▍        | 17/117 [00:01<00:08, 11.79it/s, loss=1.47, v_num=1, val_acc=0.711]
Epoch 43:  15%|█▍        | 17/117 [00:01<00:08, 11.59it/s, loss=1.43, v_num=1, val_acc=0.711]
Epoch 43:  15%|█▌        | 18/117 [00:01<00:08, 12.20it/s, loss=1.43, v_num=1, val_acc=0.711]
Epoch 43:  15%|█▌        | 18/117 [00:01<00:08, 12.00it/s, loss=1.4, v_num=1, val_acc=0.711]
Epoch 43:  16%|█▌        | 19/117 [00:01<00:07, 12.59it/s, loss=1.4, v_num=1, val_acc=0.711]
Epoch 43:  16%|█▌        | 19/117 [00:01<00:07, 12.39it/s, loss=1.36, v_num=1, val_acc=0.711]
Epoch 43:  17%|█▋        | 20/117 [00:01<00:07, 12.96it/s, loss=1.36, v_num=1, val_acc=0.711]
Epoch 43:  17%|█▋        | 20/117 [00:01<00:07, 12.75it/s, loss=1.34, v_num=1, val_acc=0.711]
Epoch 43:  18%|█▊        | 21/117 [00:01<00:07, 13.32it/s, loss=1.34, v_num=1, val_acc=0.711]
Epoch 43:  18%|█▊        | 21/117 [00:01<00:07, 13.10it/s, loss=1.33, v_num=1, val_acc=0.711]
Epoch 43:  19%|█▉        | 22/117 [00:01<00:06, 13.65it/s, loss=1.33, v_num=1, val_acc=0.711]
Epoch 43:  19%|█▉        | 22/117 [00:01<00:07, 13.44it/s, loss=1.33, v_num=1, val_acc=0.711]
Epoch 43:  20%|█▉        | 23/117 [00:01<00:06, 13.98it/s, loss=1.33, v_num=1, val_acc=0.711]
Epoch 43:  20%|█▉        | 23/117 [00:01<00:06, 13.77it/s, loss=1.36, v_num=1, val_acc=0.711]
Epoch 43:  21%|██        | 24/117 [00:01<00:06, 14.29it/s, loss=1.36, v_num=1, val_acc=0.711]
Epoch 43:  21%|██        | 24/117 [00:01<00:06, 14.07it/s, loss=1.41, v_num=1, val_acc=0.711]
Epoch 43:  21%|██▏       | 25/117 [00:01<00:06, 14.59it/s, loss=1.41, v_num=1, val_acc=0.711]
Epoch 43:  21%|██▏       | 25/117 [00:01<00:06, 14.37it/s, loss=1.49, v_num=1, val_acc=0.711]
Epoch 43:  22%|██▏       | 26/117 [00:01<00:06, 14.87it/s, loss=1.49, v_num=1, val_acc=0.711]
Epoch 43:  22%|██▏       | 26/117 [00:01<00:06, 14.66it/s, loss=1.54, v_num=1, val_acc=0.711]
Epoch 43:  23%|██▎       | 27/117 [00:01<00:05, 15.15it/s, loss=1.54, v_num=1, val_acc=0.711]
Epoch 43:  23%|██▎       | 27/117 [00:01<00:06, 14.94it/s, loss=1.53, v_num=1, val_acc=0.711]
Epoch 43:  24%|██▍       | 28/117 [00:01<00:05, 15.42it/s, loss=1.53, v_num=1, val_acc=0.711]
Epoch 43:  24%|██▍       | 28/117 [00:01<00:05, 15.20it/s, loss=1.52, v_num=1, val_acc=0.711]
Epoch 43:  25%|██▍       | 29/117 [00:01<00:05, 15.67it/s, loss=1.52, v_num=1, val_acc=0.711]
Epoch 43:  25%|██▍       | 29/117 [00:01<00:05, 15.46it/s, loss=1.54, v_num=1, val_acc=0.711]
Epoch 43:  26%|██▌       | 30/117 [00:01<00:05, 15.91it/s, loss=1.54, v_num=1, val_acc=0.711]
Epoch 43:  26%|██▌       | 30/117 [00:01<00:05, 15.70it/s, loss=1.5, v_num=1, val_acc=0.711]
Epoch 43:  26%|██▋       | 31/117 [00:01<00:05, 16.15it/s, loss=1.5, v_num=1, val_acc=0.711]
Epoch 43:  26%|██▋       | 31/117 [00:01<00:05, 15.94it/s, loss=1.5, v_num=1, val_acc=0.711]
Epoch 43:  27%|██▋       | 32/117 [00:01<00:05, 16.38it/s, loss=1.5, v_num=1, val_acc=0.711]
Epoch 43:  27%|██▋       | 32/117 [00:01<00:05, 16.17it/s, loss=1.51, v_num=1, val_acc=0.711]
Epoch 43:  28%|██▊       | 33/117 [00:01<00:05, 16.60it/s, loss=1.51, v_num=1, val_acc=0.711]
Epoch 43:  28%|██▊       | 33/117 [00:02<00:05, 16.39it/s, loss=1.51, v_num=1, val_acc=0.711]
Epoch 43:  29%|██▉       | 34/117 [00:02<00:04, 16.82it/s, loss=1.51, v_num=1, val_acc=0.711]
Epoch 43:  29%|██▉       | 34/117 [00:02<00:04, 16.61it/s, loss=1.51, v_num=1, val_acc=0.711]
Epoch 43:  30%|██▉       | 35/117 [00:02<00:04, 17.02it/s, loss=1.51, v_num=1, val_acc=0.711]
Epoch 43:  30%|██▉       | 35/117 [00:02<00:04, 16.81it/s, loss=1.55, v_num=1, val_acc=0.711]
Epoch 43:  31%|███       | 36/117 [00:02<00:04, 17.22it/s, loss=1.55, v_num=1, val_acc=0.711]
Epoch 43:  31%|███       | 36/117 [00:02<00:04, 17.01it/s, loss=1.59, v_num=1, val_acc=0.711]
Epoch 43:  32%|███▏      | 37/117 [00:02<00:04, 17.41it/s, loss=1.59, v_num=1, val_acc=0.711]
Epoch 43:  32%|███▏      | 37/117 [00:02<00:04, 17.21it/s, loss=1.61, v_num=1, val_acc=0.711]
Epoch 43:  32%|███▏      | 38/117 [00:02<00:04, 17.59it/s, loss=1.61, v_num=1, val_acc=0.711]
Epoch 43:  32%|███▏      | 38/117 [00:02<00:04, 17.39it/s, loss=1.63, v_num=1, val_acc=0.711]
Epoch 43:  33%|███▎      | 39/117 [00:02<00:04, 17.77it/s, loss=1.63, v_num=1, val_acc=0.711]
Epoch 43:  33%|███▎      | 39/117 [00:02<00:04, 17.57it/s, loss=1.61, v_num=1, val_acc=0.711]
Epoch 43:  34%|███▍      | 40/117 [00:02<00:04, 17.95it/s, loss=1.61, v_num=1, val_acc=0.711]
Epoch 43:  34%|███▍      | 40/117 [00:02<00:04, 17.75it/s, loss=1.63, v_num=1, val_acc=0.711]
Epoch 43:  35%|███▌      | 41/117 [00:02<00:04, 18.12it/s, loss=1.63, v_num=1, val_acc=0.711]
Epoch 43:  35%|███▌      | 41/117 [00:02<00:04, 17.92it/s, loss=1.63, v_num=1, val_acc=0.711]
Epoch 43:  36%|███▌      | 42/117 [00:02<00:04, 18.29it/s, loss=1.63, v_num=1, val_acc=0.711]
Epoch 43:  36%|███▌      | 42/117 [00:02<00:04, 18.09it/s, loss=1.64, v_num=1, val_acc=0.711]
Epoch 43:  37%|███▋      | 43/117 [00:02<00:04, 18.45it/s, loss=1.64, v_num=1, val_acc=0.711]
Epoch 43:  37%|███▋      | 43/117 [00:02<00:04, 18.25it/s, loss=1.62, v_num=1, val_acc=0.711]
Epoch 43:  38%|███▊      | 44/117 [00:02<00:03, 18.60it/s, loss=1.62, v_num=1, val_acc=0.711]
Epoch 43:  38%|███▊      | 44/117 [00:02<00:03, 18.41it/s, loss=1.6, v_num=1, val_acc=0.711]
Epoch 43:  38%|███▊      | 45/117 [00:02<00:03, 18.75it/s, loss=1.6, v_num=1, val_acc=0.711]
Epoch 43:  38%|███▊      | 45/117 [00:02<00:03, 18.56it/s, loss=1.51, v_num=1, val_acc=0.711]
Epoch 43:  39%|███▉      | 46/117 [00:02<00:03, 18.90it/s, loss=1.51, v_num=1, val_acc=0.711]
Epoch 43:  39%|███▉      | 46/117 [00:02<00:03, 18.71it/s, loss=1.47, v_num=1, val_acc=0.711]
Epoch 43:  40%|████      | 47/117 [00:02<00:03, 19.04it/s, loss=1.47, v_num=1, val_acc=0.711]
Epoch 43:  40%|████      | 47/117 [00:02<00:03, 18.85it/s, loss=1.47, v_num=1, val_acc=0.711]
Epoch 43:  41%|████      | 48/117 [00:02<00:03, 19.18it/s, loss=1.47, v_num=1, val_acc=0.711]
Epoch 43:  41%|████      | 48/117 [00:02<00:03, 18.99it/s, loss=1.45, v_num=1, val_acc=0.711]
Epoch 43:  42%|████▏     | 49/117 [00:02<00:03, 19.31it/s, loss=1.45, v_num=1, val_acc=0.711]
Epoch 43:  42%|████▏     | 49/117 [00:02<00:03, 19.12it/s, loss=1.42, v_num=1, val_acc=0.711]
Epoch 43:  43%|████▎     | 50/117 [00:02<00:03, 19.44it/s, loss=1.42, v_num=1, val_acc=0.711]
Epoch 43:  43%|████▎     | 50/117 [00:02<00:03, 19.25it/s, loss=1.43, v_num=1, val_acc=0.711]
Epoch 43:  44%|████▎     | 51/117 [00:02<00:03, 19.57it/s, loss=1.43, v_num=1, val_acc=0.711]
Epoch 43:  44%|████▎     | 51/117 [00:02<00:03, 19.38it/s, loss=1.45, v_num=1, val_acc=0.711]
Epoch 43:  44%|████▍     | 52/117 [00:02<00:03, 19.70it/s, loss=1.45, v_num=1, val_acc=0.711]
Epoch 43:  44%|████▍     | 52/117 [00:02<00:03, 19.51it/s, loss=1.49, v_num=1, val_acc=0.711]
Epoch 43:  45%|████▌     | 53/117 [00:02<00:03, 19.82it/s, loss=1.49, v_num=1, val_acc=0.711]
Epoch 43:  45%|████▌     | 53/117 [00:02<00:03, 19.63it/s, loss=1.55, v_num=1, val_acc=0.711]
Epoch 43:  46%|████▌     | 54/117 [00:02<00:03, 19.94it/s, loss=1.55, v_num=1, val_acc=0.711]
Epoch 43:  46%|████▌     | 54/117 [00:02<00:03, 19.75it/s, loss=1.54, v_num=1, val_acc=0.711]
Epoch 43:  47%|████▋     | 55/117 [00:02<00:03, 20.05it/s, loss=1.54, v_num=1, val_acc=0.711]
Epoch 43:  47%|████▋     | 55/117 [00:02<00:03, 19.87it/s, loss=1.52, v_num=1, val_acc=0.711]
Epoch 43:  48%|████▊     | 56/117 [00:02<00:03, 20.17it/s, loss=1.52, v_num=1, val_acc=0.711]
Epoch 43:  48%|████▊     | 56/117 [00:02<00:03, 19.98it/s, loss=1.47, v_num=1, val_acc=0.711]
Epoch 43:  49%|████▊     | 57/117 [00:02<00:02, 20.28it/s, loss=1.47, v_num=1, val_acc=0.711]
Epoch 43:  49%|████▊     | 57/117 [00:02<00:02, 20.10it/s, loss=1.43, v_num=1, val_acc=0.711]
Epoch 43:  50%|████▉     | 58/117 [00:02<00:02, 20.38it/s, loss=1.43, v_num=1, val_acc=0.711]
Epoch 43:  50%|████▉     | 58/117 [00:02<00:02, 20.20it/s, loss=1.42, v_num=1, val_acc=0.711]
Epoch 43:  50%|█████     | 59/117 [00:02<00:02, 20.49it/s, loss=1.42, v_num=1, val_acc=0.711]
Epoch 43:  50%|█████     | 59/117 [00:02<00:02, 20.31it/s, loss=1.42, v_num=1, val_acc=0.711]
Epoch 43:  51%|█████▏    | 60/117 [00:02<00:02, 20.59it/s, loss=1.42, v_num=1, val_acc=0.711]
Epoch 43:  51%|█████▏    | 60/117 [00:02<00:02, 20.41it/s, loss=1.44, v_num=1, val_acc=0.711]
Epoch 43:  52%|█████▏    | 61/117 [00:02<00:02, 20.69it/s, loss=1.44, v_num=1, val_acc=0.711]
Epoch 43:  52%|█████▏    | 61/117 [00:02<00:02, 20.52it/s, loss=1.47, v_num=1, val_acc=0.711]
Epoch 43:  53%|█████▎    | 62/117 [00:02<00:02, 20.79it/s, loss=1.47, v_num=1, val_acc=0.711]
Epoch 43:  53%|█████▎    | 62/117 [00:03<00:02, 20.61it/s, loss=1.48, v_num=1, val_acc=0.711]
Epoch 43:  54%|█████▍    | 63/117 [00:03<00:02, 20.88it/s, loss=1.48, v_num=1, val_acc=0.711]
Epoch 43:  54%|█████▍    | 63/117 [00:03<00:02, 20.71it/s, loss=1.47, v_num=1, val_acc=0.711]
Epoch 43:  55%|█████▍    | 64/117 [00:03<00:02, 20.98it/s, loss=1.47, v_num=1, val_acc=0.711]
Epoch 43:  55%|█████▍    | 64/117 [00:03<00:02, 20.80it/s, loss=1.44, v_num=1, val_acc=0.711]
Epoch 43:  56%|█████▌    | 65/117 [00:03<00:02, 21.07it/s, loss=1.44, v_num=1, val_acc=0.711]
Epoch 43:  56%|█████▌    | 65/117 [00:03<00:02, 20.90it/s, loss=1.43, v_num=1, val_acc=0.711]
Epoch 43:  56%|█████▋    | 66/117 [00:03<00:02, 21.16it/s, loss=1.43, v_num=1, val_acc=0.711]
Epoch 43:  56%|█████▋    | 66/117 [00:03<00:02, 20.99it/s, loss=1.44, v_num=1, val_acc=0.711]
Epoch 43:  57%|█████▋    | 67/117 [00:03<00:02, 21.24it/s, loss=1.44, v_num=1, val_acc=0.711]
Epoch 43:  57%|█████▋    | 67/117 [00:03<00:02, 21.07it/s, loss=1.47, v_num=1, val_acc=0.711]
Epoch 43:  58%|█████▊    | 68/117 [00:03<00:02, 21.33it/s, loss=1.47, v_num=1, val_acc=0.711]
Epoch 43:  58%|█████▊    | 68/117 [00:03<00:02, 21.16it/s, loss=1.52, v_num=1, val_acc=0.711]
Epoch 43:  59%|█████▉    | 69/117 [00:03<00:02, 21.41it/s, loss=1.52, v_num=1, val_acc=0.711]
Epoch 43:  59%|█████▉    | 69/117 [00:03<00:02, 21.25it/s, loss=1.53, v_num=1, val_acc=0.711]
Epoch 43:  60%|█████▉    | 70/117 [00:03<00:02, 21.50it/s, loss=1.53, v_num=1, val_acc=0.711]
Epoch 43:  60%|█████▉    | 70/117 [00:03<00:02, 21.33it/s, loss=1.53, v_num=1, val_acc=0.711]
Epoch 43:  61%|██████    | 71/117 [00:03<00:02, 21.57it/s, loss=1.53, v_num=1, val_acc=0.711]
Epoch 43:  61%|██████    | 71/117 [00:03<00:02, 21.41it/s, loss=1.52, v_num=1, val_acc=0.711]
Epoch 43:  62%|██████▏   | 72/117 [00:03<00:02, 21.63it/s, loss=1.52, v_num=1, val_acc=0.711]
Epoch 43:  62%|██████▏   | 72/117 [00:03<00:02, 21.47it/s, loss=1.48, v_num=1, val_acc=0.711]
Epoch 43:  62%|██████▏   | 73/117 [00:03<00:02, 21.68it/s, loss=1.48, v_num=1, val_acc=0.711]
Epoch 43:  62%|██████▏   | 73/117 [00:03<00:02, 21.53it/s, loss=1.43, v_num=1, val_acc=0.711]
Epoch 43:  63%|██████▎   | 74/117 [00:03<00:01, 21.77it/s, loss=1.43, v_num=1, val_acc=0.711]
Epoch 43:  63%|██████▎   | 74/117 [00:03<00:01, 21.61it/s, loss=1.43, v_num=1, val_acc=0.711]
Epoch 43:  64%|██████▍   | 75/117 [00:03<00:01, 21.85it/s, loss=1.43, v_num=1, val_acc=0.711]
Epoch 43:  64%|██████▍   | 75/117 [00:03<00:01, 21.69it/s, loss=1.42, v_num=1, val_acc=0.711]
Epoch 43:  65%|██████▍   | 76/117 [00:03<00:01, 21.92it/s, loss=1.42, v_num=1, val_acc=0.711]
Epoch 43:  65%|██████▍   | 76/117 [00:03<00:01, 21.76it/s, loss=1.45, v_num=1, val_acc=0.711]
Epoch 43:  66%|██████▌   | 77/117 [00:03<00:01, 21.99it/s, loss=1.45, v_num=1, val_acc=0.711]
Epoch 43:  66%|██████▌   | 77/117 [00:03<00:01, 21.83it/s, loss=1.44, v_num=1, val_acc=0.711]
Epoch 43:  67%|██████▋   | 78/117 [00:03<00:01, 22.06it/s, loss=1.44, v_num=1, val_acc=0.711]
Epoch 43:  67%|██████▋   | 78/117 [00:03<00:01, 21.90it/s, loss=1.43, v_num=1, val_acc=0.711]
Epoch 43:  68%|██████▊   | 79/117 [00:03<00:01, 22.13it/s, loss=1.43, v_num=1, val_acc=0.711]
Epoch 43:  68%|██████▊   | 79/117 [00:03<00:01, 21.97it/s, loss=1.42, v_num=1, val_acc=0.711]
Epoch 43:  68%|██████▊   | 80/117 [00:03<00:01, 22.19it/s, loss=1.42, v_num=1, val_acc=0.711]
Epoch 43:  68%|██████▊   | 80/117 [00:03<00:01, 22.04it/s, loss=1.38, v_num=1, val_acc=0.711]
Epoch 43:  69%|██████▉   | 81/117 [00:03<00:01, 22.25it/s, loss=1.38, v_num=1, val_acc=0.711]
Epoch 43:  69%|██████▉   | 81/117 [00:03<00:01, 22.10it/s, loss=1.35, v_num=1, val_acc=0.711]
Epoch 43:  70%|███████   | 82/117 [00:03<00:01, 22.31it/s, loss=1.35, v_num=1, val_acc=0.711]
Epoch 43:  70%|███████   | 82/117 [00:03<00:01, 22.16it/s, loss=1.35, v_num=1, val_acc=0.711]
Epoch 43:  71%|███████   | 83/117 [00:03<00:01, 22.37it/s, loss=1.35, v_num=1, val_acc=0.711]
Epoch 43:  71%|███████   | 83/117 [00:03<00:01, 22.22it/s, loss=1.39, v_num=1, val_acc=0.711]
Epoch 43:  72%|███████▏  | 84/117 [00:03<00:01, 22.44it/s, loss=1.39, v_num=1, val_acc=0.711]
Epoch 43:  72%|███████▏  | 84/117 [00:03<00:01, 22.29it/s, loss=1.43, v_num=1, val_acc=0.711]
Epoch 43:  73%|███████▎  | 85/117 [00:03<00:01, 22.50it/s, loss=1.43, v_num=1, val_acc=0.711]
Epoch 43:  73%|███████▎  | 85/117 [00:03<00:01, 22.35it/s, loss=1.45, v_num=1, val_acc=0.711]
Epoch 43:  74%|███████▎  | 86/117 [00:03<00:01, 22.56it/s, loss=1.45, v_num=1, val_acc=0.711]
Epoch 43:  74%|███████▎  | 86/117 [00:03<00:01, 22.41it/s, loss=1.45, v_num=1, val_acc=0.711]
Epoch 43:  74%|███████▍  | 87/117 [00:03<00:01, 22.62it/s, loss=1.45, v_num=1, val_acc=0.711]
Epoch 43:  74%|███████▍  | 87/117 [00:03<00:01, 22.47it/s, loss=1.41, v_num=1, val_acc=0.711]
Epoch 43:  75%|███████▌  | 88/117 [00:03<00:01, 22.68it/s, loss=1.41, v_num=1, val_acc=0.711]
Epoch 43:  75%|███████▌  | 88/117 [00:03<00:01, 22.53it/s, loss=1.38, v_num=1, val_acc=0.711]
Epoch 43:  76%|███████▌  | 89/117 [00:03<00:01, 22.74it/s, loss=1.38, v_num=1, val_acc=0.711]
Epoch 43:  76%|███████▌  | 89/117 [00:03<00:01, 22.59it/s, loss=1.37, v_num=1, val_acc=0.711]
Epoch 43:  77%|███████▋  | 90/117 [00:03<00:01, 22.79it/s, loss=1.37, v_num=1, val_acc=0.711]
Epoch 43:  77%|███████▋  | 90/117 [00:03<00:01, 22.65it/s, loss=1.37, v_num=1, val_acc=0.711]
Epoch 43:  78%|███████▊  | 91/117 [00:03<00:01, 22.85it/s, loss=1.37, v_num=1, val_acc=0.711]
Epoch 43:  78%|███████▊  | 91/117 [00:04<00:01, 22.70it/s, loss=1.36, v_num=1, val_acc=0.711]
Epoch 43:  79%|███████▊  | 92/117 [00:04<00:01, 22.91it/s, loss=1.36, v_num=1, val_acc=0.711]
Epoch 43:  79%|███████▊  | 92/117 [00:04<00:01, 22.76it/s, loss=1.34, v_num=1, val_acc=0.711]
Epoch 43:  79%|███████▉  | 93/117 [00:04<00:01, 22.96it/s, loss=1.34, v_num=1, val_acc=0.711]
Epoch 43:  79%|███████▉  | 93/117 [00:04<00:01, 22.82it/s, loss=1.32, v_num=1, val_acc=0.711]
Epoch 43:  80%|████████  | 94/117 [00:04<00:00, 23.01it/s, loss=1.32, v_num=1, val_acc=0.711]
Epoch 43:  80%|████████  | 94/117 [00:04<00:01, 22.87it/s, loss=1.3, v_num=1, val_acc=0.711]
Epoch 43:  81%|████████  | 95/117 [00:04<00:00, 23.07it/s, loss=1.3, v_num=1, val_acc=0.711]
Epoch 43:  81%|████████  | 95/117 [00:04<00:00, 22.92it/s, loss=1.33, v_num=1, val_acc=0.711]
Epoch 43:  82%|████████▏ | 96/117 [00:04<00:00, 23.12it/s, loss=1.33, v_num=1, val_acc=0.711]
Epoch 43:  82%|████████▏ | 96/117 [00:04<00:00, 22.98it/s, loss=1.33, v_num=1, val_acc=0.711]
Epoch 43:  83%|████████▎ | 97/117 [00:04<00:00, 23.17it/s, loss=1.33, v_num=1, val_acc=0.711]
Epoch 43:  83%|████████▎ | 97/117 [00:04<00:00, 23.03it/s, loss=1.33, v_num=1, val_acc=0.711]

Validation: 0it [00:00, ?it/s]

Validation:   0%|          | 0/20 [00:00<?, ?it/s]

Validation DataLoader 0:   0%|          | 0/20 [00:00<?, ?it/s]

Validation DataLoader 0:   5%|▌         | 1/20 [00:00<00:00, 195.51it/s]
Epoch 43:  84%|████████▍ | 98/117 [00:05<00:00, 19.54it/s, loss=1.33, v_num=1, val_acc=0.711]

Validation DataLoader 0:  10%|█         | 2/20 [00:00<00:00, 56.80it/s]
Epoch 43:  85%|████████▍ | 99/117 [00:05<00:00, 19.62it/s, loss=1.33, v_num=1, val_acc=0.711]

Validation DataLoader 0:  15%|█▌        | 3/20 [00:00<00:00, 44.65it/s]
Epoch 43:  85%|████████▌ | 100/117 [00:05<00:00, 19.69it/s, loss=1.33, v_num=1, val_acc=0.711]

Validation DataLoader 0:  20%|██        | 4/20 [00:00<00:00, 40.63it/s]
Epoch 43:  86%|████████▋ | 101/117 [00:05<00:00, 19.77it/s, loss=1.33, v_num=1, val_acc=0.711]

Validation DataLoader 0:  25%|██▌       | 5/20 [00:00<00:00, 38.01it/s]
Epoch 43:  87%|████████▋ | 102/117 [00:05<00:00, 19.83it/s, loss=1.33, v_num=1, val_acc=0.711]

Validation DataLoader 0:  30%|███       | 6/20 [00:00<00:00, 37.07it/s]
Epoch 43:  88%|████████▊ | 103/117 [00:05<00:00, 19.91it/s, loss=1.33, v_num=1, val_acc=0.711]

Validation DataLoader 0:  35%|███▌      | 7/20 [00:00<00:00, 36.22it/s]
Epoch 43:  89%|████████▉ | 104/117 [00:05<00:00, 19.98it/s, loss=1.33, v_num=1, val_acc=0.711]

Validation DataLoader 0:  40%|████      | 8/20 [00:00<00:00, 35.60it/s]
Epoch 43:  90%|████████▉ | 105/117 [00:05<00:00, 20.05it/s, loss=1.33, v_num=1, val_acc=0.711]

Validation DataLoader 0:  45%|████▌     | 9/20 [00:00<00:00, 35.07it/s]
Epoch 43:  91%|█████████ | 106/117 [00:05<00:00, 20.12it/s, loss=1.33, v_num=1, val_acc=0.711]

Validation DataLoader 0:  50%|█████     | 10/20 [00:00<00:00, 34.75it/s]
Epoch 43:  91%|█████████▏| 107/117 [00:05<00:00, 20.19it/s, loss=1.33, v_num=1, val_acc=0.711]

Validation DataLoader 0:  55%|█████▌    | 11/20 [00:00<00:00, 34.46it/s]
Epoch 43:  92%|█████████▏| 108/117 [00:05<00:00, 20.26it/s, loss=1.33, v_num=1, val_acc=0.711]

Validation DataLoader 0:  60%|██████    | 12/20 [00:00<00:00, 34.21it/s]
Epoch 43:  93%|█████████▎| 109/117 [00:05<00:00, 20.33it/s, loss=1.33, v_num=1, val_acc=0.711]

Validation DataLoader 0:  65%|██████▌   | 13/20 [00:00<00:00, 33.99it/s]
Epoch 43:  94%|█████████▍| 110/117 [00:05<00:00, 20.39it/s, loss=1.33, v_num=1, val_acc=0.711]

Validation DataLoader 0:  70%|███████   | 14/20 [00:00<00:00, 33.80it/s]
Epoch 43:  95%|█████████▍| 111/117 [00:05<00:00, 20.46it/s, loss=1.33, v_num=1, val_acc=0.711]

Validation DataLoader 0:  75%|███████▌  | 15/20 [00:00<00:00, 33.66it/s]
Epoch 43:  96%|█████████▌| 112/117 [00:05<00:00, 20.52it/s, loss=1.33, v_num=1, val_acc=0.711]

Validation DataLoader 0:  80%|████████  | 16/20 [00:00<00:00, 33.54it/s]
Epoch 43:  97%|█████████▋| 113/117 [00:05<00:00, 20.59it/s, loss=1.33, v_num=1, val_acc=0.711]

Validation DataLoader 0:  85%|████████▌ | 17/20 [00:00<00:00, 33.41it/s]
Epoch 43:  97%|█████████▋| 114/117 [00:05<00:00, 20.65it/s, loss=1.33, v_num=1, val_acc=0.711]

Validation DataLoader 0:  90%|█████████ | 18/20 [00:00<00:00, 33.29it/s]
Epoch 43:  98%|█████████▊| 115/117 [00:05<00:00, 20.71it/s, loss=1.33, v_num=1, val_acc=0.711]

Validation DataLoader 0:  95%|█████████▌| 19/20 [00:00<00:00, 33.22it/s]
Epoch 43:  99%|█████████▉| 116/117 [00:05<00:00, 20.78it/s, loss=1.33, v_num=1, val_acc=0.711]

Validation DataLoader 0: 100%|██████████| 20/20 [00:00<00:00, 33.22it/s]
Epoch 43: 100%|██████████| 117/117 [00:05<00:00, 20.84it/s, loss=1.33, v_num=1, val_acc=0.711]
Epoch 43: 100%|██████████| 117/117 [00:05<00:00, 20.77it/s, loss=1.33, v_num=1, val_acc=0.749]


Epoch 43: 100%|██████████| 117/117 [00:05<00:00, 20.77it/s, loss=1.33, v_num=1, val_acc=0.749]
Epoch 43:   0%|          | 0/117 [00:00<?, ?it/s, loss=1.33, v_num=1, val_acc=0.749]
Epoch 44:   0%|          | 0/117 [00:00<?, ?it/s, loss=1.33, v_num=1, val_acc=0.749]
Epoch 44:   1%|          | 1/117 [00:00<01:45,  1.10it/s, loss=1.33, v_num=1, val_acc=0.749]
Epoch 44:   1%|          | 1/117 [00:00<01:48,  1.07it/s, loss=1.32, v_num=1, val_acc=0.749]
Epoch 44:   2%|▏         | 2/117 [00:00<00:54,  2.11it/s, loss=1.32, v_num=1, val_acc=0.749]
Epoch 44:   2%|▏         | 2/117 [00:00<00:55,  2.06it/s, loss=1.31, v_num=1, val_acc=0.749]
Epoch 44:   3%|▎         | 3/117 [00:00<00:37,  3.06it/s, loss=1.31, v_num=1, val_acc=0.749]
Epoch 44:   3%|▎         | 3/117 [00:01<00:38,  2.98it/s, loss=1.3, v_num=1, val_acc=0.749]
Epoch 44:   3%|▎         | 4/117 [00:01<00:28,  3.94it/s, loss=1.3, v_num=1, val_acc=0.749]
Epoch 44:   3%|▎         | 4/117 [00:01<00:29,  3.85it/s, loss=1.29, v_num=1, val_acc=0.749]
Epoch 44:   4%|▍         | 5/117 [00:01<00:23,  4.77it/s, loss=1.29, v_num=1, val_acc=0.749]
Epoch 44:   4%|▍         | 5/117 [00:01<00:24,  4.66it/s, loss=1.27, v_num=1, val_acc=0.749]
Epoch 44:   5%|▌         | 6/117 [00:01<00:20,  5.55it/s, loss=1.27, v_num=1, val_acc=0.749]
Epoch 44:   5%|▌         | 6/117 [00:01<00:20,  5.42it/s, loss=1.23, v_num=1, val_acc=0.749]
Epoch 44:   6%|▌         | 7/117 [00:01<00:17,  6.28it/s, loss=1.23, v_num=1, val_acc=0.749]
Epoch 44:   6%|▌         | 7/117 [00:01<00:17,  6.14it/s, loss=1.18, v_num=1, val_acc=0.749]
Epoch 44:   7%|▋         | 8/117 [00:01<00:15,  6.96it/s, loss=1.18, v_num=1, val_acc=0.749]
Epoch 44:   7%|▋         | 8/117 [00:01<00:16,  6.81it/s, loss=1.15, v_num=1, val_acc=0.749]
Epoch 44:   8%|▊         | 9/117 [00:01<00:14,  7.57it/s, loss=1.15, v_num=1, val_acc=0.749]
Epoch 44:   8%|▊         | 9/117 [00:01<00:14,  7.42it/s, loss=1.14, v_num=1, val_acc=0.749]
Epoch 44:   9%|▊         | 10/117 [00:01<00:13,  8.19it/s, loss=1.14, v_num=1, val_acc=0.749]
Epoch 44:   9%|▊         | 10/117 [00:01<00:13,  8.02it/s, loss=1.15, v_num=1, val_acc=0.749]
Epoch 44:   9%|▉         | 11/117 [00:01<00:12,  8.76it/s, loss=1.15, v_num=1, val_acc=0.749]
Epoch 44:   9%|▉         | 11/117 [00:01<00:12,  8.59it/s, loss=1.16, v_num=1, val_acc=0.749]
Epoch 44:  10%|█         | 12/117 [00:01<00:11,  9.31it/s, loss=1.16, v_num=1, val_acc=0.749]
Epoch 44:  10%|█         | 12/117 [00:01<00:11,  9.13it/s, loss=1.14, v_num=1, val_acc=0.749]
Epoch 44:  11%|█         | 13/117 [00:01<00:10,  9.83it/s, loss=1.14, v_num=1, val_acc=0.749]
Epoch 44:  11%|█         | 13/117 [00:01<00:10,  9.65it/s, loss=1.14, v_num=1, val_acc=0.749]
Epoch 44:  12%|█▏        | 14/117 [00:01<00:09, 10.31it/s, loss=1.14, v_num=1, val_acc=0.749]
Epoch 44:  12%|█▏        | 14/117 [00:01<00:10, 10.12it/s, loss=1.13, v_num=1, val_acc=0.749]
Epoch 44:  13%|█▎        | 15/117 [00:01<00:09, 10.78it/s, loss=1.13, v_num=1, val_acc=0.749]
Epoch 44:  13%|█▎        | 15/117 [00:01<00:09, 10.59it/s, loss=1.14, v_num=1, val_acc=0.749]
Epoch 44:  14%|█▎        | 16/117 [00:01<00:09, 11.22it/s, loss=1.14, v_num=1, val_acc=0.749]
Epoch 44:  14%|█▎        | 16/117 [00:01<00:09, 11.02it/s, loss=1.16, v_num=1, val_acc=0.749]
Epoch 44:  15%|█▍        | 17/117 [00:01<00:08, 11.62it/s, loss=1.16, v_num=1, val_acc=0.749]
Epoch 44:  15%|█▍        | 17/117 [00:01<00:08, 11.42it/s, loss=1.18, v_num=1, val_acc=0.749]
Epoch 44:  15%|█▌        | 18/117 [00:01<00:08, 12.03it/s, loss=1.18, v_num=1, val_acc=0.749]
Epoch 44:  15%|█▌        | 18/117 [00:01<00:08, 11.83it/s, loss=1.17, v_num=1, val_acc=0.749]
Epoch 44:  16%|█▌        | 19/117 [00:01<00:07, 12.42it/s, loss=1.17, v_num=1, val_acc=0.749]
Epoch 44:  16%|█▌        | 19/117 [00:01<00:08, 12.21it/s, loss=1.16, v_num=1, val_acc=0.749]
Epoch 44:  17%|█▋        | 20/117 [00:01<00:07, 12.79it/s, loss=1.16, v_num=1, val_acc=0.749]
Epoch 44:  17%|█▋        | 20/117 [00:01<00:07, 12.59it/s, loss=1.17, v_num=1, val_acc=0.749]
Epoch 44:  18%|█▊        | 21/117 [00:01<00:07, 13.15it/s, loss=1.17, v_num=1, val_acc=0.749]
Epoch 44:  18%|█▊        | 21/117 [00:01<00:07, 12.94it/s, loss=1.19, v_num=1, val_acc=0.749]
Epoch 44:  19%|█▉        | 22/117 [00:01<00:07, 13.48it/s, loss=1.19, v_num=1, val_acc=0.749]
Epoch 44:  19%|█▉        | 22/117 [00:01<00:07, 13.28it/s, loss=1.21, v_num=1, val_acc=0.749]
Epoch 44:  20%|█▉        | 23/117 [00:01<00:06, 13.81it/s, loss=1.21, v_num=1, val_acc=0.749]
Epoch 44:  20%|█▉        | 23/117 [00:01<00:06, 13.60it/s, loss=1.26, v_num=1, val_acc=0.749]
Epoch 44:  21%|██        | 24/117 [00:01<00:06, 14.12it/s, loss=1.26, v_num=1, val_acc=0.749]
Epoch 44:  21%|██        | 24/117 [00:01<00:06, 13.91it/s, loss=1.27, v_num=1, val_acc=0.749]
Epoch 44:  21%|██▏       | 25/117 [00:01<00:06, 14.42it/s, loss=1.27, v_num=1, val_acc=0.749]
Epoch 44:  21%|██▏       | 25/117 [00:01<00:06, 14.21it/s, loss=1.31, v_num=1, val_acc=0.749]
Epoch 44:  22%|██▏       | 26/117 [00:01<00:06, 14.69it/s, loss=1.31, v_num=1, val_acc=0.749]
Epoch 44:  22%|██▏       | 26/117 [00:01<00:06, 14.49it/s, loss=1.31, v_num=1, val_acc=0.749]
Epoch 44:  23%|██▎       | 27/117 [00:01<00:06, 14.97it/s, loss=1.31, v_num=1, val_acc=0.749]
Epoch 44:  23%|██▎       | 27/117 [00:01<00:06, 14.77it/s, loss=1.32, v_num=1, val_acc=0.749]
Epoch 44:  24%|██▍       | 28/117 [00:01<00:05, 15.25it/s, loss=1.32, v_num=1, val_acc=0.749]
Epoch 44:  24%|██▍       | 28/117 [00:01<00:05, 15.04it/s, loss=1.32, v_num=1, val_acc=0.749]
Epoch 44:  25%|██▍       | 29/117 [00:01<00:05, 15.46it/s, loss=1.32, v_num=1, val_acc=0.749]
Epoch 44:  25%|██▍       | 29/117 [00:01<00:05, 15.29it/s, loss=1.35, v_num=1, val_acc=0.749]
Epoch 44:  26%|██▌       | 30/117 [00:01<00:05, 15.74it/s, loss=1.35, v_num=1, val_acc=0.749]
Epoch 44:  26%|██▌       | 30/117 [00:01<00:05, 15.53it/s, loss=1.34, v_num=1, val_acc=0.749]
Epoch 44:  26%|██▋       | 31/117 [00:01<00:05, 15.97it/s, loss=1.34, v_num=1, val_acc=0.749]
Epoch 44:  26%|██▋       | 31/117 [00:01<00:05, 15.76it/s, loss=1.32, v_num=1, val_acc=0.749]
Epoch 44:  27%|██▋       | 32/117 [00:01<00:05, 16.19it/s, loss=1.32, v_num=1, val_acc=0.749]
Epoch 44:  27%|██▋       | 32/117 [00:02<00:05, 15.99it/s, loss=1.33, v_num=1, val_acc=0.749]
Epoch 44:  28%|██▊       | 33/117 [00:02<00:05, 16.40it/s, loss=1.33, v_num=1, val_acc=0.749]
Epoch 44:  28%|██▊       | 33/117 [00:02<00:05, 16.20it/s, loss=1.33, v_num=1, val_acc=0.749]
Epoch 44:  29%|██▉       | 34/117 [00:02<00:04, 16.61it/s, loss=1.33, v_num=1, val_acc=0.749]
Epoch 44:  29%|██▉       | 34/117 [00:02<00:05, 16.40it/s, loss=1.39, v_num=1, val_acc=0.749]
Epoch 44:  30%|██▉       | 35/117 [00:02<00:04, 16.82it/s, loss=1.39, v_num=1, val_acc=0.749]
Epoch 44:  30%|██▉       | 35/117 [00:02<00:04, 16.62it/s, loss=1.39, v_num=1, val_acc=0.749]
Epoch 44:  31%|███       | 36/117 [00:02<00:04, 17.02it/s, loss=1.39, v_num=1, val_acc=0.749]
Epoch 44:  31%|███       | 36/117 [00:02<00:04, 16.82it/s, loss=1.37, v_num=1, val_acc=0.749]
Epoch 44:  32%|███▏      | 37/117 [00:02<00:04, 17.21it/s, loss=1.37, v_num=1, val_acc=0.749]
Epoch 44:  32%|███▏      | 37/117 [00:02<00:04, 17.01it/s, loss=1.35, v_num=1, val_acc=0.749]
Epoch 44:  32%|███▏      | 38/117 [00:02<00:04, 17.40it/s, loss=1.35, v_num=1, val_acc=0.749]
Epoch 44:  32%|███▏      | 38/117 [00:02<00:04, 17.20it/s, loss=1.34, v_num=1, val_acc=0.749]
Epoch 44:  33%|███▎      | 39/117 [00:02<00:04, 17.58it/s, loss=1.34, v_num=1, val_acc=0.749]
Epoch 44:  33%|███▎      | 39/117 [00:02<00:04, 17.39it/s, loss=1.35, v_num=1, val_acc=0.749]
Epoch 44:  34%|███▍      | 40/117 [00:02<00:04, 17.76it/s, loss=1.35, v_num=1, val_acc=0.749]
Epoch 44:  34%|███▍      | 40/117 [00:02<00:04, 17.57it/s, loss=1.39, v_num=1, val_acc=0.749]
Epoch 44:  35%|███▌      | 41/117 [00:02<00:04, 17.93it/s, loss=1.39, v_num=1, val_acc=0.749]
Epoch 44:  35%|███▌      | 41/117 [00:02<00:04, 17.74it/s, loss=1.38, v_num=1, val_acc=0.749]
Epoch 44:  36%|███▌      | 42/117 [00:02<00:04, 18.10it/s, loss=1.38, v_num=1, val_acc=0.749]
Epoch 44:  36%|███▌      | 42/117 [00:02<00:04, 17.91it/s, loss=1.38, v_num=1, val_acc=0.749]
Epoch 44:  37%|███▋      | 43/117 [00:02<00:04, 18.26it/s, loss=1.38, v_num=1, val_acc=0.749]
Epoch 44:  37%|███▋      | 43/117 [00:02<00:04, 18.07it/s, loss=1.35, v_num=1, val_acc=0.749]
Epoch 44:  38%|███▊      | 44/117 [00:02<00:03, 18.42it/s, loss=1.35, v_num=1, val_acc=0.749]
Epoch 44:  38%|███▊      | 44/117 [00:02<00:04, 18.22it/s, loss=1.34, v_num=1, val_acc=0.749]
Epoch 44:  38%|███▊      | 45/117 [00:02<00:03, 18.57it/s, loss=1.34, v_num=1, val_acc=0.749]
Epoch 44:  38%|███▊      | 45/117 [00:02<00:03, 18.38it/s, loss=1.32, v_num=1, val_acc=0.749]
Epoch 44:  39%|███▉      | 46/117 [00:02<00:03, 18.72it/s, loss=1.32, v_num=1, val_acc=0.749]
Epoch 44:  39%|███▉      | 46/117 [00:02<00:03, 18.53it/s, loss=1.35, v_num=1, val_acc=0.749]
Epoch 44:  40%|████      | 47/117 [00:02<00:03, 18.86it/s, loss=1.35, v_num=1, val_acc=0.749]
Epoch 44:  40%|████      | 47/117 [00:02<00:03, 18.67it/s, loss=1.38, v_num=1, val_acc=0.749]
Epoch 44:  41%|████      | 48/117 [00:02<00:03, 18.99it/s, loss=1.38, v_num=1, val_acc=0.749]
Epoch 44:  41%|████      | 48/117 [00:02<00:03, 18.81it/s, loss=1.42, v_num=1, val_acc=0.749]
Epoch 44:  42%|████▏     | 49/117 [00:02<00:03, 19.13it/s, loss=1.42, v_num=1, val_acc=0.749]
Epoch 44:  42%|████▏     | 49/117 [00:02<00:03, 18.94it/s, loss=1.41, v_num=1, val_acc=0.749]
Epoch 44:  43%|████▎     | 50/117 [00:02<00:03, 19.26it/s, loss=1.41, v_num=1, val_acc=0.749]
Epoch 44:  43%|████▎     | 50/117 [00:02<00:03, 19.08it/s, loss=1.44, v_num=1, val_acc=0.749]
Epoch 44:  44%|████▎     | 51/117 [00:02<00:03, 19.39it/s, loss=1.44, v_num=1, val_acc=0.749]
Epoch 44:  44%|████▎     | 51/117 [00:02<00:03, 19.21it/s, loss=1.46, v_num=1, val_acc=0.749]
Epoch 44:  44%|████▍     | 52/117 [00:02<00:03, 19.52it/s, loss=1.46, v_num=1, val_acc=0.749]
Epoch 44:  44%|████▍     | 52/117 [00:02<00:03, 19.33it/s, loss=1.51, v_num=1, val_acc=0.749]
Epoch 44:  45%|████▌     | 53/117 [00:02<00:03, 19.64it/s, loss=1.51, v_num=1, val_acc=0.749]
Epoch 44:  45%|████▌     | 53/117 [00:02<00:03, 19.46it/s, loss=1.52, v_num=1, val_acc=0.749]
Epoch 44:  46%|████▌     | 54/117 [00:02<00:03, 19.75it/s, loss=1.52, v_num=1, val_acc=0.749]
Epoch 44:  46%|████▌     | 54/117 [00:02<00:03, 19.58it/s, loss=1.49, v_num=1, val_acc=0.749]
Epoch 44:  47%|████▋     | 55/117 [00:02<00:03, 19.84it/s, loss=1.49, v_num=1, val_acc=0.749]
Epoch 44:  47%|████▋     | 55/117 [00:02<00:03, 19.68it/s, loss=1.5, v_num=1, val_acc=0.749]
Epoch 44:  48%|████▊     | 56/117 [00:02<00:03, 19.97it/s, loss=1.5, v_num=1, val_acc=0.749]
Epoch 44:  48%|████▊     | 56/117 [00:02<00:03, 19.79it/s, loss=1.51, v_num=1, val_acc=0.749]
Epoch 44:  49%|████▊     | 57/117 [00:02<00:02, 20.08it/s, loss=1.51, v_num=1, val_acc=0.749]
Epoch 44:  49%|████▊     | 57/117 [00:02<00:03, 19.91it/s, loss=1.51, v_num=1, val_acc=0.749]
Epoch 44:  50%|████▉     | 58/117 [00:02<00:02, 20.19it/s, loss=1.51, v_num=1, val_acc=0.749]
Epoch 44:  50%|████▉     | 58/117 [00:02<00:02, 20.02it/s, loss=1.52, v_num=1, val_acc=0.749]
Epoch 44:  50%|█████     | 59/117 [00:02<00:02, 20.30it/s, loss=1.52, v_num=1, val_acc=0.749]
Epoch 44:  50%|█████     | 59/117 [00:02<00:02, 20.13it/s, loss=1.5, v_num=1, val_acc=0.749]
Epoch 44:  51%|█████▏    | 60/117 [00:02<00:02, 20.40it/s, loss=1.5, v_num=1, val_acc=0.749]
Epoch 44:  51%|█████▏    | 60/117 [00:02<00:02, 20.23it/s, loss=1.47, v_num=1, val_acc=0.749]
Epoch 44:  52%|█████▏    | 61/117 [00:02<00:02, 20.51it/s, loss=1.47, v_num=1, val_acc=0.749]
Epoch 44:  52%|█████▏    | 61/117 [00:02<00:02, 20.33it/s, loss=1.48, v_num=1, val_acc=0.749]
Epoch 44:  53%|█████▎    | 62/117 [00:03<00:02, 20.61it/s, loss=1.48, v_num=1, val_acc=0.749]
Epoch 44:  53%|█████▎    | 62/117 [00:03<00:02, 20.43it/s, loss=1.5, v_num=1, val_acc=0.749]
Epoch 44:  54%|█████▍    | 63/117 [00:03<00:02, 20.70it/s, loss=1.5, v_num=1, val_acc=0.749]
Epoch 44:  54%|█████▍    | 63/117 [00:03<00:02, 20.53it/s, loss=1.49, v_num=1, val_acc=0.749]
Epoch 44:  55%|█████▍    | 64/117 [00:03<00:02, 20.80it/s, loss=1.49, v_num=1, val_acc=0.749]
Epoch 44:  55%|█████▍    | 64/117 [00:03<00:02, 20.63it/s, loss=1.49, v_num=1, val_acc=0.749]
Epoch 44:  56%|█████▌    | 65/117 [00:03<00:02, 20.89it/s, loss=1.49, v_num=1, val_acc=0.749]
Epoch 44:  56%|█████▌    | 65/117 [00:03<00:02, 20.72it/s, loss=1.47, v_num=1, val_acc=0.749]
Epoch 44:  56%|█████▋    | 66/117 [00:03<00:02, 20.98it/s, loss=1.47, v_num=1, val_acc=0.749]
Epoch 44:  56%|█████▋    | 66/117 [00:03<00:02, 20.81it/s, loss=1.45, v_num=1, val_acc=0.749]
Epoch 44:  57%|█████▋    | 67/117 [00:03<00:02, 21.07it/s, loss=1.45, v_num=1, val_acc=0.749]
Epoch 44:  57%|█████▋    | 67/117 [00:03<00:02, 20.90it/s, loss=1.43, v_num=1, val_acc=0.749]
Epoch 44:  58%|█████▊    | 68/117 [00:03<00:02, 21.16it/s, loss=1.43, v_num=1, val_acc=0.749]
Epoch 44:  58%|█████▊    | 68/117 [00:03<00:02, 20.99it/s, loss=1.39, v_num=1, val_acc=0.749]
Epoch 44:  59%|█████▉    | 69/117 [00:03<00:02, 21.24it/s, loss=1.39, v_num=1, val_acc=0.749]
Epoch 44:  59%|█████▉    | 69/117 [00:03<00:02, 21.08it/s, loss=1.36, v_num=1, val_acc=0.749]
Epoch 44:  60%|█████▉    | 70/117 [00:03<00:02, 21.32it/s, loss=1.36, v_num=1, val_acc=0.749]
Epoch 44:  60%|█████▉    | 70/117 [00:03<00:02, 21.16it/s, loss=1.33, v_num=1, val_acc=0.749]
Epoch 44:  61%|██████    | 71/117 [00:03<00:02, 21.40it/s, loss=1.33, v_num=1, val_acc=0.749]
Epoch 44:  61%|██████    | 71/117 [00:03<00:02, 21.24it/s, loss=1.3, v_num=1, val_acc=0.749]
Epoch 44:  62%|██████▏   | 72/117 [00:03<00:02, 21.48it/s, loss=1.3, v_num=1, val_acc=0.749]
Epoch 44:  62%|██████▏   | 72/117 [00:03<00:02, 21.32it/s, loss=1.26, v_num=1, val_acc=0.749]
Epoch 44:  62%|██████▏   | 73/117 [00:03<00:02, 21.56it/s, loss=1.26, v_num=1, val_acc=0.749]
Epoch 44:  62%|██████▏   | 73/117 [00:03<00:02, 21.40it/s, loss=1.23, v_num=1, val_acc=0.749]
Epoch 44:  63%|██████▎   | 74/117 [00:03<00:01, 21.64it/s, loss=1.23, v_num=1, val_acc=0.749]
Epoch 44:  63%|██████▎   | 74/117 [00:03<00:02, 21.48it/s, loss=1.2, v_num=1, val_acc=0.749]
Epoch 44:  64%|██████▍   | 75/117 [00:03<00:01, 21.71it/s, loss=1.2, v_num=1, val_acc=0.749]
Epoch 44:  64%|██████▍   | 75/117 [00:03<00:01, 21.55it/s, loss=1.21, v_num=1, val_acc=0.749]
Epoch 44:  65%|██████▍   | 76/117 [00:03<00:01, 21.79it/s, loss=1.21, v_num=1, val_acc=0.749]
Epoch 44:  65%|██████▍   | 76/117 [00:03<00:01, 21.63it/s, loss=1.24, v_num=1, val_acc=0.749]
Epoch 44:  66%|██████▌   | 77/117 [00:03<00:01, 21.86it/s, loss=1.24, v_num=1, val_acc=0.749]
Epoch 44:  66%|██████▌   | 77/117 [00:03<00:01, 21.70it/s, loss=1.27, v_num=1, val_acc=0.749]
Epoch 44:  67%|██████▋   | 78/117 [00:03<00:01, 21.93it/s, loss=1.27, v_num=1, val_acc=0.749]
Epoch 44:  67%|██████▋   | 78/117 [00:03<00:01, 21.77it/s, loss=1.27, v_num=1, val_acc=0.749]
Epoch 44:  68%|██████▊   | 79/117 [00:03<00:01, 22.00it/s, loss=1.27, v_num=1, val_acc=0.749]
Epoch 44:  68%|██████▊   | 79/117 [00:03<00:01, 21.84it/s, loss=1.27, v_num=1, val_acc=0.749]
Epoch 44:  68%|██████▊   | 80/117 [00:03<00:01, 22.07it/s, loss=1.27, v_num=1, val_acc=0.749]
Epoch 44:  68%|██████▊   | 80/117 [00:03<00:01, 21.91it/s, loss=1.25, v_num=1, val_acc=0.749]
Epoch 44:  69%|██████▉   | 81/117 [00:03<00:01, 22.13it/s, loss=1.25, v_num=1, val_acc=0.749]
Epoch 44:  69%|██████▉   | 81/117 [00:03<00:01, 21.98it/s, loss=1.24, v_num=1, val_acc=0.749]
Epoch 44:  70%|███████   | 82/117 [00:03<00:01, 22.18it/s, loss=1.24, v_num=1, val_acc=0.749]
Epoch 44:  70%|███████   | 82/117 [00:03<00:01, 22.03it/s, loss=1.23, v_num=1, val_acc=0.749]
Epoch 44:  71%|███████   | 83/117 [00:03<00:01, 22.24it/s, loss=1.23, v_num=1, val_acc=0.749]
Epoch 44:  71%|███████   | 83/117 [00:03<00:01, 22.09it/s, loss=1.24, v_num=1, val_acc=0.749]
Epoch 44:  72%|███████▏  | 84/117 [00:03<00:01, 22.31it/s, loss=1.24, v_num=1, val_acc=0.749]
Epoch 44:  72%|███████▏  | 84/117 [00:03<00:01, 22.16it/s, loss=1.25, v_num=1, val_acc=0.749]
Epoch 44:  73%|███████▎  | 85/117 [00:03<00:01, 22.37it/s, loss=1.25, v_num=1, val_acc=0.749]
Epoch 44:  73%|███████▎  | 85/117 [00:03<00:01, 22.22it/s, loss=1.25, v_num=1, val_acc=0.749]
Epoch 44:  74%|███████▎  | 86/117 [00:03<00:01, 22.43it/s, loss=1.25, v_num=1, val_acc=0.749]
Epoch 44:  74%|███████▎  | 86/117 [00:03<00:01, 22.28it/s, loss=1.29, v_num=1, val_acc=0.749]
Epoch 44:  74%|███████▍  | 87/117 [00:03<00:01, 22.49it/s, loss=1.29, v_num=1, val_acc=0.749]
Epoch 44:  74%|███████▍  | 87/117 [00:03<00:01, 22.35it/s, loss=1.3, v_num=1, val_acc=0.749]
Epoch 44:  75%|███████▌  | 88/117 [00:03<00:01, 22.55it/s, loss=1.3, v_num=1, val_acc=0.749]
Epoch 44:  75%|███████▌  | 88/117 [00:03<00:01, 22.41it/s, loss=1.3, v_num=1, val_acc=0.749]
Epoch 44:  76%|███████▌  | 89/117 [00:03<00:01, 22.61it/s, loss=1.3, v_num=1, val_acc=0.749]
Epoch 44:  76%|███████▌  | 89/117 [00:03<00:01, 22.47it/s, loss=1.31, v_num=1, val_acc=0.749]
Epoch 44:  77%|███████▋  | 90/117 [00:03<00:01, 22.67it/s, loss=1.31, v_num=1, val_acc=0.749]
Epoch 44:  77%|███████▋  | 90/117 [00:03<00:01, 22.53it/s, loss=1.34, v_num=1, val_acc=0.749]
Epoch 44:  78%|███████▊  | 91/117 [00:04<00:01, 22.73it/s, loss=1.34, v_num=1, val_acc=0.749]
Epoch 44:  78%|███████▊  | 91/117 [00:04<00:01, 22.58it/s, loss=1.35, v_num=1, val_acc=0.749]
Epoch 44:  79%|███████▊  | 92/117 [00:04<00:01, 22.78it/s, loss=1.35, v_num=1, val_acc=0.749]
Epoch 44:  79%|███████▊  | 92/117 [00:04<00:01, 22.64it/s, loss=1.37, v_num=1, val_acc=0.749]
Epoch 44:  79%|███████▉  | 93/117 [00:04<00:01, 22.84it/s, loss=1.37, v_num=1, val_acc=0.749]
Epoch 44:  79%|███████▉  | 93/117 [00:04<00:01, 22.69it/s, loss=1.39, v_num=1, val_acc=0.749]
Epoch 44:  80%|████████  | 94/117 [00:04<00:01, 22.89it/s, loss=1.39, v_num=1, val_acc=0.749]
Epoch 44:  80%|████████  | 94/117 [00:04<00:01, 22.75it/s, loss=1.38, v_num=1, val_acc=0.749]
Epoch 44:  81%|████████  | 95/117 [00:04<00:00, 22.94it/s, loss=1.38, v_num=1, val_acc=0.749]
Epoch 44:  81%|████████  | 95/117 [00:04<00:00, 22.80it/s, loss=1.36, v_num=1, val_acc=0.749]
Epoch 44:  82%|████████▏ | 96/117 [00:04<00:00, 22.99it/s, loss=1.36, v_num=1, val_acc=0.749]
Epoch 44:  82%|████████▏ | 96/117 [00:04<00:00, 22.85it/s, loss=1.31, v_num=1, val_acc=0.749]
Epoch 44:  83%|████████▎ | 97/117 [00:04<00:00, 23.04it/s, loss=1.31, v_num=1, val_acc=0.749]
Epoch 44:  83%|████████▎ | 97/117 [00:04<00:00, 22.91it/s, loss=1.27, v_num=1, val_acc=0.749]

Validation: 0it [00:00, ?it/s]

Validation:   0%|          | 0/20 [00:00<?, ?it/s]

Validation DataLoader 0:   0%|          | 0/20 [00:00<?, ?it/s]

Validation DataLoader 0:   5%|▌         | 1/20 [00:00<00:00, 168.98it/s]
Epoch 44:  84%|████████▍ | 98/117 [00:05<00:00, 19.28it/s, loss=1.27, v_num=1, val_acc=0.749]

Validation DataLoader 0:  10%|█         | 2/20 [00:00<00:00, 54.91it/s]
Epoch 44:  85%|████████▍ | 99/117 [00:05<00:00, 19.36it/s, loss=1.27, v_num=1, val_acc=0.749]

Validation DataLoader 0:  15%|█▌        | 3/20 [00:00<00:00, 42.92it/s]
Epoch 44:  85%|████████▌ | 100/117 [00:05<00:00, 19.43it/s, loss=1.27, v_num=1, val_acc=0.749]

Validation DataLoader 0:  20%|██        | 4/20 [00:00<00:00, 39.97it/s]
Epoch 44:  86%|████████▋ | 101/117 [00:05<00:00, 19.51it/s, loss=1.27, v_num=1, val_acc=0.749]

Validation DataLoader 0:  25%|██▌       | 5/20 [00:00<00:00, 37.92it/s]
Epoch 44:  87%|████████▋ | 102/117 [00:05<00:00, 19.58it/s, loss=1.27, v_num=1, val_acc=0.749]

Validation DataLoader 0:  30%|███       | 6/20 [00:00<00:00, 36.63it/s]
Epoch 44:  88%|████████▊ | 103/117 [00:05<00:00, 19.65it/s, loss=1.27, v_num=1, val_acc=0.749]

Validation DataLoader 0:  35%|███▌      | 7/20 [00:00<00:00, 35.96it/s]
Epoch 44:  89%|████████▉ | 104/117 [00:05<00:00, 19.73it/s, loss=1.27, v_num=1, val_acc=0.749]

Validation DataLoader 0:  40%|████      | 8/20 [00:00<00:00, 35.39it/s]
Epoch 44:  90%|████████▉ | 105/117 [00:05<00:00, 19.80it/s, loss=1.27, v_num=1, val_acc=0.749]

Validation DataLoader 0:  45%|████▌     | 9/20 [00:00<00:00, 34.93it/s]
Epoch 44:  91%|█████████ | 106/117 [00:05<00:00, 19.87it/s, loss=1.27, v_num=1, val_acc=0.749]

Validation DataLoader 0:  50%|█████     | 10/20 [00:00<00:00, 34.63it/s]
Epoch 44:  91%|█████████▏| 107/117 [00:05<00:00, 19.94it/s, loss=1.27, v_num=1, val_acc=0.749]

Validation DataLoader 0:  55%|█████▌    | 11/20 [00:00<00:00, 34.33it/s]
Epoch 44:  92%|█████████▏| 108/117 [00:05<00:00, 20.01it/s, loss=1.27, v_num=1, val_acc=0.749]

Validation DataLoader 0:  60%|██████    | 12/20 [00:00<00:00, 34.09it/s]
Epoch 44:  93%|█████████▎| 109/117 [00:05<00:00, 20.08it/s, loss=1.27, v_num=1, val_acc=0.749]

Validation DataLoader 0:  65%|██████▌   | 13/20 [00:00<00:00, 33.91it/s]
Epoch 44:  94%|█████████▍| 110/117 [00:05<00:00, 20.14it/s, loss=1.27, v_num=1, val_acc=0.749]

Validation DataLoader 0:  70%|███████   | 14/20 [00:00<00:00, 33.74it/s]
Epoch 44:  95%|█████████▍| 111/117 [00:05<00:00, 20.21it/s, loss=1.27, v_num=1, val_acc=0.749]

Validation DataLoader 0:  75%|███████▌  | 15/20 [00:00<00:00, 33.60it/s]
Epoch 44:  96%|█████████▌| 112/117 [00:05<00:00, 20.28it/s, loss=1.27, v_num=1, val_acc=0.749]

Validation DataLoader 0:  80%|████████  | 16/20 [00:00<00:00, 33.48it/s]
Epoch 44:  97%|█████████▋| 113/117 [00:05<00:00, 20.34it/s, loss=1.27, v_num=1, val_acc=0.749]

Validation DataLoader 0:  85%|████████▌ | 17/20 [00:00<00:00, 33.37it/s]
Epoch 44:  97%|█████████▋| 114/117 [00:05<00:00, 20.41it/s, loss=1.27, v_num=1, val_acc=0.749]

Validation DataLoader 0:  90%|█████████ | 18/20 [00:00<00:00, 33.29it/s]
Epoch 44:  98%|█████████▊| 115/117 [00:05<00:00, 20.47it/s, loss=1.27, v_num=1, val_acc=0.749]

Validation DataLoader 0:  95%|█████████▌| 19/20 [00:00<00:00, 33.19it/s]
Epoch 44:  99%|█████████▉| 116/117 [00:05<00:00, 20.53it/s, loss=1.27, v_num=1, val_acc=0.749]

Validation DataLoader 0: 100%|██████████| 20/20 [00:00<00:00, 33.19it/s]
Epoch 44: 100%|██████████| 117/117 [00:05<00:00, 20.60it/s, loss=1.27, v_num=1, val_acc=0.749]
Epoch 44: 100%|██████████| 117/117 [00:05<00:00, 20.53it/s, loss=1.27, v_num=1, val_acc=0.735]


Epoch 44: 100%|██████████| 117/117 [00:05<00:00, 20.52it/s, loss=1.27, v_num=1, val_acc=0.735]
Epoch 44:   0%|          | 0/117 [00:00<?, ?it/s, loss=1.27, v_num=1, val_acc=0.735]
Epoch 45:   0%|          | 0/117 [00:00<?, ?it/s, loss=1.27, v_num=1, val_acc=0.735]
Epoch 45:   1%|          | 1/117 [00:00<01:49,  1.06it/s, loss=1.27, v_num=1, val_acc=0.735]
Epoch 45:   1%|          | 1/117 [00:00<01:52,  1.03it/s, loss=1.23, v_num=1, val_acc=0.735]
Epoch 45:   2%|▏         | 2/117 [00:00<00:56,  2.05it/s, loss=1.23, v_num=1, val_acc=0.735]
Epoch 45:   2%|▏         | 2/117 [00:01<00:57,  2.00it/s, loss=1.23, v_num=1, val_acc=0.735]
Epoch 45:   3%|▎         | 3/117 [00:01<00:38,  2.97it/s, loss=1.23, v_num=1, val_acc=0.735]
Epoch 45:   3%|▎         | 3/117 [00:01<00:39,  2.90it/s, loss=1.24, v_num=1, val_acc=0.735]
Epoch 45:   3%|▎         | 4/117 [00:01<00:29,  3.83it/s, loss=1.24, v_num=1, val_acc=0.735]
Epoch 45:   3%|▎         | 4/117 [00:01<00:30,  3.74it/s, loss=1.24, v_num=1, val_acc=0.735]
Epoch 45:   4%|▍         | 5/117 [00:01<00:24,  4.64it/s, loss=1.24, v_num=1, val_acc=0.735]
Epoch 45:   4%|▍         | 5/117 [00:01<00:24,  4.53it/s, loss=1.21, v_num=1, val_acc=0.735]
Epoch 45:   5%|▌         | 6/117 [00:01<00:20,  5.40it/s, loss=1.21, v_num=1, val_acc=0.735]
Epoch 45:   5%|▌         | 6/117 [00:01<00:21,  5.28it/s, loss=1.2, v_num=1, val_acc=0.735]
Epoch 45:   6%|▌         | 7/117 [00:01<00:18,  6.11it/s, loss=1.2, v_num=1, val_acc=0.735]
Epoch 45:   6%|▌         | 7/117 [00:01<00:18,  5.98it/s, loss=1.19, v_num=1, val_acc=0.735]
Epoch 45:   7%|▋         | 8/117 [00:01<00:16,  6.78it/s, loss=1.19, v_num=1, val_acc=0.735]
Epoch 45:   7%|▋         | 8/117 [00:01<00:16,  6.64it/s, loss=1.19, v_num=1, val_acc=0.735]
Epoch 45:   8%|▊         | 9/117 [00:01<00:14,  7.38it/s, loss=1.19, v_num=1, val_acc=0.735]
Epoch 45:   8%|▊         | 9/117 [00:01<00:14,  7.23it/s, loss=1.15, v_num=1, val_acc=0.735]
Epoch 45:   9%|▊         | 10/117 [00:01<00:13,  7.99it/s, loss=1.15, v_num=1, val_acc=0.735]
Epoch 45:   9%|▊         | 10/117 [00:01<00:13,  7.83it/s, loss=1.13, v_num=1, val_acc=0.735]
Epoch 45:   9%|▉         | 11/117 [00:01<00:12,  8.55it/s, loss=1.13, v_num=1, val_acc=0.735]
Epoch 45:   9%|▉         | 11/117 [00:01<00:12,  8.39it/s, loss=1.11, v_num=1, val_acc=0.735]
Epoch 45:  10%|█         | 12/117 [00:01<00:11,  9.09it/s, loss=1.11, v_num=1, val_acc=0.735]
Epoch 45:  10%|█         | 12/117 [00:01<00:11,  8.92it/s, loss=1.11, v_num=1, val_acc=0.735]
Epoch 45:  11%|█         | 13/117 [00:01<00:10,  9.61it/s, loss=1.11, v_num=1, val_acc=0.735]
Epoch 45:  11%|█         | 13/117 [00:01<00:11,  9.43it/s, loss=1.09, v_num=1, val_acc=0.735]
Epoch 45:  12%|█▏        | 14/117 [00:01<00:10, 10.10it/s, loss=1.09, v_num=1, val_acc=0.735]
Epoch 45:  12%|█▏        | 14/117 [00:01<00:10,  9.91it/s, loss=1.08, v_num=1, val_acc=0.735]
Epoch 45:  13%|█▎        | 15/117 [00:01<00:09, 10.54it/s, loss=1.08, v_num=1, val_acc=0.735]
Epoch 45:  13%|█▎        | 15/117 [00:01<00:09, 10.37it/s, loss=1.07, v_num=1, val_acc=0.735]
Epoch 45:  14%|█▎        | 16/117 [00:01<00:09, 11.00it/s, loss=1.07, v_num=1, val_acc=0.735]
Epoch 45:  14%|█▎        | 16/117 [00:01<00:09, 10.81it/s, loss=1.07, v_num=1, val_acc=0.735]
Epoch 45:  15%|█▍        | 17/117 [00:01<00:08, 11.39it/s, loss=1.07, v_num=1, val_acc=0.735]
Epoch 45:  15%|█▍        | 17/117 [00:01<00:08, 11.21it/s, loss=1.11, v_num=1, val_acc=0.735]
Epoch 45:  15%|█▌        | 18/117 [00:01<00:08, 11.79it/s, loss=1.11, v_num=1, val_acc=0.735]
Epoch 45:  15%|█▌        | 18/117 [00:01<00:08, 11.61it/s, loss=1.13, v_num=1, val_acc=0.735]
Epoch 45:  16%|█▌        | 19/117 [00:01<00:08, 12.16it/s, loss=1.13, v_num=1, val_acc=0.735]
Epoch 45:  16%|█▌        | 19/117 [00:01<00:08, 11.98it/s, loss=1.18, v_num=1, val_acc=0.735]
Epoch 45:  17%|█▋        | 20/117 [00:01<00:07, 12.54it/s, loss=1.18, v_num=1, val_acc=0.735]
Epoch 45:  17%|█▋        | 20/117 [00:01<00:07, 12.35it/s, loss=1.21, v_num=1, val_acc=0.735]
Epoch 45:  18%|█▊        | 21/117 [00:01<00:07, 12.87it/s, loss=1.21, v_num=1, val_acc=0.735]
Epoch 45:  18%|█▊        | 21/117 [00:01<00:07, 12.68it/s, loss=1.24, v_num=1, val_acc=0.735]
Epoch 45:  19%|█▉        | 22/117 [00:01<00:07, 13.21it/s, loss=1.24, v_num=1, val_acc=0.735]
Epoch 45:  19%|█▉        | 22/117 [00:01<00:07, 13.01it/s, loss=1.24, v_num=1, val_acc=0.735]
Epoch 45:  20%|█▉        | 23/117 [00:01<00:06, 13.53it/s, loss=1.24, v_num=1, val_acc=0.735]
Epoch 45:  20%|█▉        | 23/117 [00:01<00:07, 13.33it/s, loss=1.23, v_num=1, val_acc=0.735]
Epoch 45:  21%|██        | 24/117 [00:01<00:06, 13.84it/s, loss=1.23, v_num=1, val_acc=0.735]
Epoch 45:  21%|██        | 24/117 [00:01<00:06, 13.64it/s, loss=1.22, v_num=1, val_acc=0.735]
Epoch 45:  21%|██▏       | 25/117 [00:01<00:06, 14.14it/s, loss=1.22, v_num=1, val_acc=0.735]
Epoch 45:  21%|██▏       | 25/117 [00:01<00:06, 13.94it/s, loss=1.23, v_num=1, val_acc=0.735]
Epoch 45:  22%|██▏       | 26/117 [00:01<00:06, 14.43it/s, loss=1.23, v_num=1, val_acc=0.735]
Epoch 45:  22%|██▏       | 26/117 [00:01<00:06, 14.23it/s, loss=1.25, v_num=1, val_acc=0.735]
Epoch 45:  23%|██▎       | 27/117 [00:01<00:06, 14.70it/s, loss=1.25, v_num=1, val_acc=0.735]
Epoch 45:  23%|██▎       | 27/117 [00:01<00:06, 14.50it/s, loss=1.28, v_num=1, val_acc=0.735]
Epoch 45:  24%|██▍       | 28/117 [00:01<00:05, 14.97it/s, loss=1.28, v_num=1, val_acc=0.735]
Epoch 45:  24%|██▍       | 28/117 [00:01<00:06, 14.77it/s, loss=1.29, v_num=1, val_acc=0.735]
Epoch 45:  25%|██▍       | 29/117 [00:01<00:05, 15.22it/s, loss=1.29, v_num=1, val_acc=0.735]
Epoch 45:  25%|██▍       | 29/117 [00:01<00:05, 15.02it/s, loss=1.29, v_num=1, val_acc=0.735]
Epoch 45:  26%|██▌       | 30/117 [00:01<00:05, 15.47it/s, loss=1.29, v_num=1, val_acc=0.735]
Epoch 45:  26%|██▌       | 30/117 [00:01<00:05, 15.27it/s, loss=1.3, v_num=1, val_acc=0.735]
Epoch 45:  26%|██▋       | 31/117 [00:01<00:05, 15.71it/s, loss=1.3, v_num=1, val_acc=0.735]
Epoch 45:  26%|██▋       | 31/117 [00:01<00:05, 15.51it/s, loss=1.29, v_num=1, val_acc=0.735]
Epoch 45:  27%|██▋       | 32/117 [00:02<00:05, 15.94it/s, loss=1.29, v_num=1, val_acc=0.735]
Epoch 45:  27%|██▋       | 32/117 [00:02<00:05, 15.74it/s, loss=1.27, v_num=1, val_acc=0.735]
Epoch 45:  28%|██▊       | 33/117 [00:02<00:05, 16.16it/s, loss=1.27, v_num=1, val_acc=0.735]
Epoch 45:  28%|██▊       | 33/117 [00:02<00:05, 15.96it/s, loss=1.27, v_num=1, val_acc=0.735]
Epoch 45:  29%|██▉       | 34/117 [00:02<00:05, 16.38it/s, loss=1.27, v_num=1, val_acc=0.735]
Epoch 45:  29%|██▉       | 34/117 [00:02<00:05, 16.18it/s, loss=1.27, v_num=1, val_acc=0.735]
Epoch 45:  30%|██▉       | 35/117 [00:02<00:04, 16.59it/s, loss=1.27, v_num=1, val_acc=0.735]
Epoch 45:  30%|██▉       | 35/117 [00:02<00:05, 16.39it/s, loss=1.27, v_num=1, val_acc=0.735]
Epoch 45:  31%|███       | 36/117 [00:02<00:04, 16.71it/s, loss=1.27, v_num=1, val_acc=0.735]
Epoch 45:  31%|███       | 36/117 [00:02<00:04, 16.54it/s, loss=1.28, v_num=1, val_acc=0.735]
Epoch 45:  32%|███▏      | 37/117 [00:02<00:04, 16.92it/s, loss=1.28, v_num=1, val_acc=0.735]
Epoch 45:  32%|███▏      | 37/117 [00:02<00:04, 16.73it/s, loss=1.25, v_num=1, val_acc=0.735]
Epoch 45:  32%|███▏      | 38/117 [00:02<00:04, 17.12it/s, loss=1.25, v_num=1, val_acc=0.735]
Epoch 45:  32%|███▏      | 38/117 [00:02<00:04, 16.92it/s, loss=1.26, v_num=1, val_acc=0.735]
Epoch 45:  33%|███▎      | 39/117 [00:02<00:04, 17.30it/s, loss=1.26, v_num=1, val_acc=0.735]
Epoch 45:  33%|███▎      | 39/117 [00:02<00:04, 17.11it/s, loss=1.26, v_num=1, val_acc=0.735]
Epoch 45:  34%|███▍      | 40/117 [00:02<00:04, 17.47it/s, loss=1.26, v_num=1, val_acc=0.735]
Epoch 45:  34%|███▍      | 40/117 [00:02<00:04, 17.28it/s, loss=1.26, v_num=1, val_acc=0.735]
Epoch 45:  35%|███▌      | 41/117 [00:02<00:04, 17.64it/s, loss=1.26, v_num=1, val_acc=0.735]
Epoch 45:  35%|███▌      | 41/117 [00:02<00:04, 17.45it/s, loss=1.32, v_num=1, val_acc=0.735]
Epoch 45:  36%|███▌      | 42/117 [00:02<00:04, 17.80it/s, loss=1.32, v_num=1, val_acc=0.735]
Epoch 45:  36%|███▌      | 42/117 [00:02<00:04, 17.62it/s, loss=1.4, v_num=1, val_acc=0.735]
Epoch 45:  37%|███▋      | 43/117 [00:02<00:04, 17.96it/s, loss=1.4, v_num=1, val_acc=0.735]
Epoch 45:  37%|███▋      | 43/117 [00:02<00:04, 17.77it/s, loss=1.41, v_num=1, val_acc=0.735]
Epoch 45:  38%|███▊      | 44/117 [00:02<00:04, 18.11it/s, loss=1.41, v_num=1, val_acc=0.735]
Epoch 45:  38%|███▊      | 44/117 [00:02<00:04, 17.93it/s, loss=1.43, v_num=1, val_acc=0.735]
Epoch 45:  38%|███▊      | 45/117 [00:02<00:03, 18.27it/s, loss=1.43, v_num=1, val_acc=0.735]
Epoch 45:  38%|███▊      | 45/117 [00:02<00:03, 18.08it/s, loss=1.44, v_num=1, val_acc=0.735]
Epoch 45:  39%|███▉      | 46/117 [00:02<00:03, 18.42it/s, loss=1.44, v_num=1, val_acc=0.735]
Epoch 45:  39%|███▉      | 46/117 [00:02<00:03, 18.23it/s, loss=1.44, v_num=1, val_acc=0.735]
Epoch 45:  40%|████      | 47/117 [00:02<00:03, 18.57it/s, loss=1.44, v_num=1, val_acc=0.735]
Epoch 45:  40%|████      | 47/117 [00:02<00:03, 18.38it/s, loss=1.48, v_num=1, val_acc=0.735]
Epoch 45:  41%|████      | 48/117 [00:02<00:03, 18.71it/s, loss=1.48, v_num=1, val_acc=0.735]
Epoch 45:  41%|████      | 48/117 [00:02<00:03, 18.53it/s, loss=1.47, v_num=1, val_acc=0.735]
Epoch 45:  42%|████▏     | 49/117 [00:02<00:03, 18.85it/s, loss=1.47, v_num=1, val_acc=0.735]
Epoch 45:  42%|████▏     | 49/117 [00:02<00:03, 18.66it/s, loss=1.47, v_num=1, val_acc=0.735]
Epoch 45:  43%|████▎     | 50/117 [00:02<00:03, 18.98it/s, loss=1.47, v_num=1, val_acc=0.735]
Epoch 45:  43%|████▎     | 50/117 [00:02<00:03, 18.80it/s, loss=1.46, v_num=1, val_acc=0.735]
Epoch 45:  44%|████▎     | 51/117 [00:02<00:03, 19.11it/s, loss=1.46, v_num=1, val_acc=0.735]
Epoch 45:  44%|████▎     | 51/117 [00:02<00:03, 18.93it/s, loss=1.47, v_num=1, val_acc=0.735]
Epoch 45:  44%|████▍     | 52/117 [00:02<00:03, 19.24it/s, loss=1.47, v_num=1, val_acc=0.735]
Epoch 45:  44%|████▍     | 52/117 [00:02<00:03, 19.06it/s, loss=1.49, v_num=1, val_acc=0.735]
Epoch 45:  45%|████▌     | 53/117 [00:02<00:03, 19.37it/s, loss=1.49, v_num=1, val_acc=0.735]
Epoch 45:  45%|████▌     | 53/117 [00:02<00:03, 19.19it/s, loss=1.5, v_num=1, val_acc=0.735]
Epoch 45:  46%|████▌     | 54/117 [00:02<00:03, 19.49it/s, loss=1.5, v_num=1, val_acc=0.735]
Epoch 45:  46%|████▌     | 54/117 [00:02<00:03, 19.31it/s, loss=1.5, v_num=1, val_acc=0.735]
Epoch 45:  47%|████▋     | 55/117 [00:02<00:03, 19.61it/s, loss=1.5, v_num=1, val_acc=0.735]
Epoch 45:  47%|████▋     | 55/117 [00:02<00:03, 19.43it/s, loss=1.49, v_num=1, val_acc=0.735]
Epoch 45:  48%|████▊     | 56/117 [00:02<00:03, 19.72it/s, loss=1.49, v_num=1, val_acc=0.735]
Epoch 45:  48%|████▊     | 56/117 [00:02<00:03, 19.54it/s, loss=1.48, v_num=1, val_acc=0.735]
Epoch 45:  49%|████▊     | 57/117 [00:02<00:03, 19.83it/s, loss=1.48, v_num=1, val_acc=0.735]
Epoch 45:  49%|████▊     | 57/117 [00:02<00:03, 19.66it/s, loss=1.5, v_num=1, val_acc=0.735]
Epoch 45:  50%|████▉     | 58/117 [00:02<00:02, 19.94it/s, loss=1.5, v_num=1, val_acc=0.735]
Epoch 45:  50%|████▉     | 58/117 [00:02<00:02, 19.77it/s, loss=1.48, v_num=1, val_acc=0.735]
Epoch 45:  50%|█████     | 59/117 [00:02<00:02, 20.05it/s, loss=1.48, v_num=1, val_acc=0.735]
Epoch 45:  50%|█████     | 59/117 [00:02<00:02, 19.88it/s, loss=1.46, v_num=1, val_acc=0.735]
Epoch 45:  51%|█████▏    | 60/117 [00:02<00:02, 20.15it/s, loss=1.46, v_num=1, val_acc=0.735]
Epoch 45:  51%|█████▏    | 60/117 [00:03<00:02, 19.98it/s, loss=1.43, v_num=1, val_acc=0.735]
Epoch 45:  52%|█████▏    | 61/117 [00:03<00:02, 20.26it/s, loss=1.43, v_num=1, val_acc=0.735]
Epoch 45:  52%|█████▏    | 61/117 [00:03<00:02, 20.09it/s, loss=1.39, v_num=1, val_acc=0.735]
Epoch 45:  53%|█████▎    | 62/117 [00:03<00:02, 20.36it/s, loss=1.39, v_num=1, val_acc=0.735]
Epoch 45:  53%|█████▎    | 62/117 [00:03<00:02, 20.19it/s, loss=1.35, v_num=1, val_acc=0.735]
Epoch 45:  54%|█████▍    | 63/117 [00:03<00:02, 20.46it/s, loss=1.35, v_num=1, val_acc=0.735]
Epoch 45:  54%|█████▍    | 63/117 [00:03<00:02, 20.29it/s, loss=1.34, v_num=1, val_acc=0.735]
Epoch 45:  55%|█████▍    | 64/117 [00:03<00:02, 20.55it/s, loss=1.34, v_num=1, val_acc=0.735]
Epoch 45:  55%|█████▍    | 64/117 [00:03<00:02, 20.39it/s, loss=1.34, v_num=1, val_acc=0.735]
Epoch 45:  56%|█████▌    | 65/117 [00:03<00:02, 20.65it/s, loss=1.34, v_num=1, val_acc=0.735]
Epoch 45:  56%|█████▌    | 65/117 [00:03<00:02, 20.48it/s, loss=1.32, v_num=1, val_acc=0.735]
Epoch 45:  56%|█████▋    | 66/117 [00:03<00:02, 20.74it/s, loss=1.32, v_num=1, val_acc=0.735]
Epoch 45:  56%|█████▋    | 66/117 [00:03<00:02, 20.58it/s, loss=1.29, v_num=1, val_acc=0.735]
Epoch 45:  57%|█████▋    | 67/117 [00:03<00:02, 20.83it/s, loss=1.29, v_num=1, val_acc=0.735]
Epoch 45:  57%|█████▋    | 67/117 [00:03<00:02, 20.66it/s, loss=1.21, v_num=1, val_acc=0.735]
Epoch 45:  58%|█████▊    | 68/117 [00:03<00:02, 20.91it/s, loss=1.21, v_num=1, val_acc=0.735]
Epoch 45:  58%|█████▊    | 68/117 [00:03<00:02, 20.75it/s, loss=1.21, v_num=1, val_acc=0.735]
Epoch 45:  59%|█████▉    | 69/117 [00:03<00:02, 21.00it/s, loss=1.21, v_num=1, val_acc=0.735]
Epoch 45:  59%|█████▉    | 69/117 [00:03<00:02, 20.84it/s, loss=1.22, v_num=1, val_acc=0.735]
Epoch 45:  60%|█████▉    | 70/117 [00:03<00:02, 21.09it/s, loss=1.22, v_num=1, val_acc=0.735]
Epoch 45:  60%|█████▉    | 70/117 [00:03<00:02, 20.93it/s, loss=1.22, v_num=1, val_acc=0.735]
Epoch 45:  61%|██████    | 71/117 [00:03<00:02, 21.17it/s, loss=1.22, v_num=1, val_acc=0.735]
Epoch 45:  61%|██████    | 71/117 [00:03<00:02, 21.01it/s, loss=1.21, v_num=1, val_acc=0.735]
Epoch 45:  62%|██████▏   | 72/117 [00:03<00:02, 21.25it/s, loss=1.21, v_num=1, val_acc=0.735]
Epoch 45:  62%|██████▏   | 72/117 [00:03<00:02, 21.09it/s, loss=1.21, v_num=1, val_acc=0.735]
Epoch 45:  62%|██████▏   | 73/117 [00:03<00:02, 21.33it/s, loss=1.21, v_num=1, val_acc=0.735]
Epoch 45:  62%|██████▏   | 73/117 [00:03<00:02, 21.18it/s, loss=1.2, v_num=1, val_acc=0.735]
Epoch 45:  63%|██████▎   | 74/117 [00:03<00:02, 21.41it/s, loss=1.2, v_num=1, val_acc=0.735]
Epoch 45:  63%|██████▎   | 74/117 [00:03<00:02, 21.25it/s, loss=1.22, v_num=1, val_acc=0.735]
Epoch 45:  64%|██████▍   | 75/117 [00:03<00:01, 21.49it/s, loss=1.22, v_num=1, val_acc=0.735]
Epoch 45:  64%|██████▍   | 75/117 [00:03<00:01, 21.33it/s, loss=1.24, v_num=1, val_acc=0.735]
Epoch 45:  65%|██████▍   | 76/117 [00:03<00:01, 21.56it/s, loss=1.24, v_num=1, val_acc=0.735]
Epoch 45:  65%|██████▍   | 76/117 [00:03<00:01, 21.41it/s, loss=1.26, v_num=1, val_acc=0.735]
Epoch 45:  66%|██████▌   | 77/117 [00:03<00:01, 21.64it/s, loss=1.26, v_num=1, val_acc=0.735]
Epoch 45:  66%|██████▌   | 77/117 [00:03<00:01, 21.48it/s, loss=1.21, v_num=1, val_acc=0.735]
Epoch 45:  67%|██████▋   | 78/117 [00:03<00:01, 21.71it/s, loss=1.21, v_num=1, val_acc=0.735]
Epoch 45:  67%|██████▋   | 78/117 [00:03<00:01, 21.56it/s, loss=1.2, v_num=1, val_acc=0.735]
Epoch 45:  68%|██████▊   | 79/117 [00:03<00:01, 21.78it/s, loss=1.2, v_num=1, val_acc=0.735]
Epoch 45:  68%|██████▊   | 79/117 [00:03<00:01, 21.63it/s, loss=1.17, v_num=1, val_acc=0.735]
Epoch 45:  68%|██████▊   | 80/117 [00:03<00:01, 21.85it/s, loss=1.17, v_num=1, val_acc=0.735]
Epoch 45:  68%|██████▊   | 80/117 [00:03<00:01, 21.70it/s, loss=1.15, v_num=1, val_acc=0.735]
Epoch 45:  69%|██████▉   | 81/117 [00:03<00:01, 21.92it/s, loss=1.15, v_num=1, val_acc=0.735]
Epoch 45:  69%|██████▉   | 81/117 [00:03<00:01, 21.77it/s, loss=1.12, v_num=1, val_acc=0.735]
Epoch 45:  70%|███████   | 82/117 [00:03<00:01, 21.97it/s, loss=1.12, v_num=1, val_acc=0.735]
Epoch 45:  70%|███████   | 82/117 [00:03<00:01, 21.83it/s, loss=1.09, v_num=1, val_acc=0.735]
Epoch 45:  71%|███████   | 83/117 [00:03<00:01, 22.04it/s, loss=1.09, v_num=1, val_acc=0.735]
Epoch 45:  71%|███████   | 83/117 [00:03<00:01, 21.89it/s, loss=1.12, v_num=1, val_acc=0.735]
Epoch 45:  72%|███████▏  | 84/117 [00:03<00:01, 22.11it/s, loss=1.12, v_num=1, val_acc=0.735]
Epoch 45:  72%|███████▏  | 84/117 [00:03<00:01, 21.96it/s, loss=1.15, v_num=1, val_acc=0.735]
Epoch 45:  73%|███████▎  | 85/117 [00:03<00:01, 22.17it/s, loss=1.15, v_num=1, val_acc=0.735]
Epoch 45:  73%|███████▎  | 85/117 [00:03<00:01, 22.02it/s, loss=1.17, v_num=1, val_acc=0.735]
Epoch 45:  74%|███████▎  | 86/117 [00:03<00:01, 22.23it/s, loss=1.17, v_num=1, val_acc=0.735]
Epoch 45:  74%|███████▎  | 86/117 [00:03<00:01, 22.08it/s, loss=1.19, v_num=1, val_acc=0.735]
Epoch 45:  74%|███████▍  | 87/117 [00:03<00:01, 22.29it/s, loss=1.19, v_num=1, val_acc=0.735]
Epoch 45:  74%|███████▍  | 87/117 [00:03<00:01, 22.15it/s, loss=1.2, v_num=1, val_acc=0.735]
Epoch 45:  75%|███████▌  | 88/117 [00:03<00:01, 22.35it/s, loss=1.2, v_num=1, val_acc=0.735]
Epoch 45:  75%|███████▌  | 88/117 [00:03<00:01, 22.21it/s, loss=1.2, v_num=1, val_acc=0.735]
Epoch 45:  76%|███████▌  | 89/117 [00:03<00:01, 22.41it/s, loss=1.2, v_num=1, val_acc=0.735]
Epoch 45:  76%|███████▌  | 89/117 [00:03<00:01, 22.27it/s, loss=1.25, v_num=1, val_acc=0.735]
Epoch 45:  77%|███████▋  | 90/117 [00:04<00:01, 22.47it/s, loss=1.25, v_num=1, val_acc=0.735]
Epoch 45:  77%|███████▋  | 90/117 [00:04<00:01, 22.33it/s, loss=1.25, v_num=1, val_acc=0.735]
Epoch 45:  78%|███████▊  | 91/117 [00:04<00:01, 22.53it/s, loss=1.25, v_num=1, val_acc=0.735]
Epoch 45:  78%|███████▊  | 91/117 [00:04<00:01, 22.39it/s, loss=1.26, v_num=1, val_acc=0.735]
Epoch 45:  79%|███████▊  | 92/117 [00:04<00:01, 22.59it/s, loss=1.26, v_num=1, val_acc=0.735]
Epoch 45:  79%|███████▊  | 92/117 [00:04<00:01, 22.45it/s, loss=1.27, v_num=1, val_acc=0.735]
Epoch 45:  79%|███████▉  | 93/117 [00:04<00:01, 22.64it/s, loss=1.27, v_num=1, val_acc=0.735]
Epoch 45:  79%|███████▉  | 93/117 [00:04<00:01, 22.50it/s, loss=1.29, v_num=1, val_acc=0.735]
Epoch 45:  80%|████████  | 94/117 [00:04<00:01, 22.70it/s, loss=1.29, v_num=1, val_acc=0.735]
Epoch 45:  80%|████████  | 94/117 [00:04<00:01, 22.56it/s, loss=1.27, v_num=1, val_acc=0.735]
Epoch 45:  81%|████████  | 95/117 [00:04<00:00, 22.75it/s, loss=1.27, v_num=1, val_acc=0.735]
Epoch 45:  81%|████████  | 95/117 [00:04<00:00, 22.61it/s, loss=1.24, v_num=1, val_acc=0.735]
Epoch 45:  82%|████████▏ | 96/117 [00:04<00:00, 22.80it/s, loss=1.24, v_num=1, val_acc=0.735]
Epoch 45:  82%|████████▏ | 96/117 [00:04<00:00, 22.67it/s, loss=1.21, v_num=1, val_acc=0.735]
Epoch 45:  83%|████████▎ | 97/117 [00:04<00:00, 22.86it/s, loss=1.21, v_num=1, val_acc=0.735]
Epoch 45:  83%|████████▎ | 97/117 [00:04<00:00, 22.72it/s, loss=1.24, v_num=1, val_acc=0.735]

Validation: 0it [00:00, ?it/s]

Validation:   0%|          | 0/20 [00:00<?, ?it/s]

Validation DataLoader 0:   0%|          | 0/20 [00:00<?, ?it/s]

Validation DataLoader 0:   5%|▌         | 1/20 [00:00<00:00, 162.10it/s]
Epoch 45:  84%|████████▍ | 98/117 [00:05<00:00, 19.17it/s, loss=1.24, v_num=1, val_acc=0.735]

Validation DataLoader 0:  10%|█         | 2/20 [00:00<00:00, 55.24it/s]
Epoch 45:  85%|████████▍ | 99/117 [00:05<00:00, 19.26it/s, loss=1.24, v_num=1, val_acc=0.735]

Validation DataLoader 0:  15%|█▌        | 3/20 [00:00<00:00, 44.30it/s]
Epoch 45:  85%|████████▌ | 100/117 [00:05<00:00, 19.33it/s, loss=1.24, v_num=1, val_acc=0.735]

Validation DataLoader 0:  20%|██        | 4/20 [00:00<00:00, 40.19it/s]
Epoch 45:  86%|████████▋ | 101/117 [00:05<00:00, 19.41it/s, loss=1.24, v_num=1, val_acc=0.735]

Validation DataLoader 0:  25%|██▌       | 5/20 [00:00<00:00, 38.03it/s]
Epoch 45:  87%|████████▋ | 102/117 [00:05<00:00, 19.48it/s, loss=1.24, v_num=1, val_acc=0.735]

Validation DataLoader 0:  30%|███       | 6/20 [00:00<00:00, 36.93it/s]
Epoch 45:  88%|████████▊ | 103/117 [00:05<00:00, 19.55it/s, loss=1.24, v_num=1, val_acc=0.735]

Validation DataLoader 0:  35%|███▌      | 7/20 [00:00<00:00, 36.11it/s]
Epoch 45:  89%|████████▉ | 104/117 [00:05<00:00, 19.63it/s, loss=1.24, v_num=1, val_acc=0.735]

Validation DataLoader 0:  40%|████      | 8/20 [00:00<00:00, 35.50it/s]
Epoch 45:  90%|████████▉ | 105/117 [00:05<00:00, 19.70it/s, loss=1.24, v_num=1, val_acc=0.735]

Validation DataLoader 0:  45%|████▌     | 9/20 [00:00<00:00, 34.98it/s]
Epoch 45:  91%|█████████ | 106/117 [00:05<00:00, 19.77it/s, loss=1.24, v_num=1, val_acc=0.735]

Validation DataLoader 0:  50%|█████     | 10/20 [00:00<00:00, 34.68it/s]
Epoch 45:  91%|█████████▏| 107/117 [00:05<00:00, 19.84it/s, loss=1.24, v_num=1, val_acc=0.735]

Validation DataLoader 0:  55%|█████▌    | 11/20 [00:00<00:00, 34.39it/s]
Epoch 45:  92%|█████████▏| 108/117 [00:05<00:00, 19.91it/s, loss=1.24, v_num=1, val_acc=0.735]

Validation DataLoader 0:  60%|██████    | 12/20 [00:00<00:00, 34.16it/s]
Epoch 45:  93%|█████████▎| 109/117 [00:05<00:00, 19.98it/s, loss=1.24, v_num=1, val_acc=0.735]

Validation DataLoader 0:  65%|██████▌   | 13/20 [00:00<00:00, 33.96it/s]
Epoch 45:  94%|█████████▍| 110/117 [00:05<00:00, 20.04it/s, loss=1.24, v_num=1, val_acc=0.735]

Validation DataLoader 0:  70%|███████   | 14/20 [00:00<00:00, 33.80it/s]
Epoch 45:  95%|█████████▍| 111/117 [00:05<00:00, 20.11it/s, loss=1.24, v_num=1, val_acc=0.735]

Validation DataLoader 0:  75%|███████▌  | 15/20 [00:00<00:00, 33.63it/s]
Epoch 45:  96%|█████████▌| 112/117 [00:05<00:00, 20.18it/s, loss=1.24, v_num=1, val_acc=0.735]

Validation DataLoader 0:  80%|████████  | 16/20 [00:00<00:00, 33.49it/s]
Epoch 45:  97%|█████████▋| 113/117 [00:05<00:00, 20.24it/s, loss=1.24, v_num=1, val_acc=0.735]

Validation DataLoader 0:  85%|████████▌ | 17/20 [00:00<00:00, 33.38it/s]
Epoch 45:  97%|█████████▋| 114/117 [00:05<00:00, 20.31it/s, loss=1.24, v_num=1, val_acc=0.735]

Validation DataLoader 0:  90%|█████████ | 18/20 [00:00<00:00, 33.29it/s]
Epoch 45:  98%|█████████▊| 115/117 [00:05<00:00, 20.37it/s, loss=1.24, v_num=1, val_acc=0.735]

Validation DataLoader 0:  95%|█████████▌| 19/20 [00:00<00:00, 33.21it/s]
Epoch 45:  99%|█████████▉| 116/117 [00:05<00:00, 20.43it/s, loss=1.24, v_num=1, val_acc=0.735]

Validation DataLoader 0: 100%|██████████| 20/20 [00:00<00:00, 33.20it/s]
Epoch 45: 100%|██████████| 117/117 [00:05<00:00, 20.50it/s, loss=1.24, v_num=1, val_acc=0.735]
Epoch 45: 100%|██████████| 117/117 [00:05<00:00, 20.43it/s, loss=1.24, v_num=1, val_acc=0.679]


Epoch 45: 100%|██████████| 117/117 [00:05<00:00, 20.42it/s, loss=1.24, v_num=1, val_acc=0.679]
Epoch 45:   0%|          | 0/117 [00:00<?, ?it/s, loss=1.24, v_num=1, val_acc=0.679]
Epoch 46:   0%|          | 0/117 [00:00<?, ?it/s, loss=1.24, v_num=1, val_acc=0.679]
Epoch 46:   1%|          | 1/117 [00:00<01:43,  1.12it/s, loss=1.24, v_num=1, val_acc=0.679]
Epoch 46:   1%|          | 1/117 [00:00<01:46,  1.09it/s, loss=1.28, v_num=1, val_acc=0.679]
Epoch 46:   2%|▏         | 2/117 [00:00<00:53,  2.15it/s, loss=1.28, v_num=1, val_acc=0.679]
Epoch 46:   2%|▏         | 2/117 [00:00<00:54,  2.10it/s, loss=1.34, v_num=1, val_acc=0.679]
Epoch 46:   3%|▎         | 3/117 [00:00<00:36,  3.12it/s, loss=1.34, v_num=1, val_acc=0.679]
Epoch 46:   3%|▎         | 3/117 [00:00<00:37,  3.04it/s, loss=1.38, v_num=1, val_acc=0.679]
Epoch 46:   3%|▎         | 4/117 [00:00<00:28,  4.01it/s, loss=1.38, v_num=1, val_acc=0.679]
Epoch 46:   3%|▎         | 4/117 [00:01<00:28,  3.91it/s, loss=1.4, v_num=1, val_acc=0.679]
Epoch 46:   4%|▍         | 5/117 [00:01<00:23,  4.83it/s, loss=1.4, v_num=1, val_acc=0.679]
Epoch 46:   4%|▍         | 5/117 [00:01<00:23,  4.72it/s, loss=1.41, v_num=1, val_acc=0.679]
Epoch 46:   5%|▌         | 6/117 [00:01<00:19,  5.62it/s, loss=1.41, v_num=1, val_acc=0.679]
Epoch 46:   5%|▌         | 6/117 [00:01<00:20,  5.49it/s, loss=1.4, v_num=1, val_acc=0.679]
Epoch 46:   6%|▌         | 7/117 [00:01<00:17,  6.36it/s, loss=1.4, v_num=1, val_acc=0.679]
Epoch 46:   6%|▌         | 7/117 [00:01<00:17,  6.22it/s, loss=1.38, v_num=1, val_acc=0.679]
Epoch 46:   7%|▋         | 8/117 [00:01<00:15,  7.05it/s, loss=1.38, v_num=1, val_acc=0.679]
Epoch 46:   7%|▋         | 8/117 [00:01<00:15,  6.90it/s, loss=1.39, v_num=1, val_acc=0.679]
Epoch 46:   8%|▊         | 9/117 [00:01<00:14,  7.69it/s, loss=1.39, v_num=1, val_acc=0.679]
Epoch 46:   8%|▊         | 9/117 [00:01<00:14,  7.53it/s, loss=1.37, v_num=1, val_acc=0.679]
Epoch 46:   9%|▊         | 10/117 [00:01<00:12,  8.31it/s, loss=1.37, v_num=1, val_acc=0.679]
Epoch 46:   9%|▊         | 10/117 [00:01<00:13,  8.14it/s, loss=1.38, v_num=1, val_acc=0.679]
Epoch 46:   9%|▉         | 11/117 [00:01<00:11,  8.87it/s, loss=1.38, v_num=1, val_acc=0.679]
Epoch 46:   9%|▉         | 11/117 [00:01<00:12,  8.69it/s, loss=1.42, v_num=1, val_acc=0.679]
Epoch 46:  10%|█         | 12/117 [00:01<00:11,  9.42it/s, loss=1.42, v_num=1, val_acc=0.679]
Epoch 46:  10%|█         | 12/117 [00:01<00:11,  9.24it/s, loss=1.38, v_num=1, val_acc=0.679]
Epoch 46:  11%|█         | 13/117 [00:01<00:10,  9.90it/s, loss=1.38, v_num=1, val_acc=0.679]
Epoch 46:  11%|█         | 13/117 [00:01<00:10,  9.73it/s, loss=1.38, v_num=1, val_acc=0.679]
Epoch 46:  12%|█▏        | 14/117 [00:01<00:09, 10.38it/s, loss=1.38, v_num=1, val_acc=0.679]
Epoch 46:  12%|█▏        | 14/117 [00:01<00:10, 10.21it/s, loss=1.37, v_num=1, val_acc=0.679]
Epoch 46:  13%|█▎        | 15/117 [00:01<00:09, 10.86it/s, loss=1.37, v_num=1, val_acc=0.679]
Epoch 46:  13%|█▎        | 15/117 [00:01<00:09, 10.67it/s, loss=1.35, v_num=1, val_acc=0.679]
Epoch 46:  14%|█▎        | 16/117 [00:01<00:08, 11.31it/s, loss=1.35, v_num=1, val_acc=0.679]
Epoch 46:  14%|█▎        | 16/117 [00:01<00:09, 11.11it/s, loss=1.32, v_num=1, val_acc=0.679]
Epoch 46:  15%|█▍        | 17/117 [00:01<00:08, 11.73it/s, loss=1.32, v_num=1, val_acc=0.679]
Epoch 46:  15%|█▍        | 17/117 [00:01<00:08, 11.53it/s, loss=1.34, v_num=1, val_acc=0.679]
Epoch 46:  15%|█▌        | 18/117 [00:01<00:08, 12.13it/s, loss=1.34, v_num=1, val_acc=0.679]
Epoch 46:  15%|█▌        | 18/117 [00:01<00:08, 11.93it/s, loss=1.36, v_num=1, val_acc=0.679]
Epoch 46:  16%|█▌        | 19/117 [00:01<00:07, 12.51it/s, loss=1.36, v_num=1, val_acc=0.679]
Epoch 46:  16%|█▌        | 19/117 [00:01<00:07, 12.31it/s, loss=1.39, v_num=1, val_acc=0.679]
Epoch 46:  17%|█▋        | 20/117 [00:01<00:07, 12.88it/s, loss=1.39, v_num=1, val_acc=0.679]
Epoch 46:  17%|█▋        | 20/117 [00:01<00:07, 12.68it/s, loss=1.41, v_num=1, val_acc=0.679]
Epoch 46:  18%|█▊        | 21/117 [00:01<00:07, 13.22it/s, loss=1.41, v_num=1, val_acc=0.679]
Epoch 46:  18%|█▊        | 21/117 [00:01<00:07, 13.02it/s, loss=1.38, v_num=1, val_acc=0.679]
Epoch 46:  19%|█▉        | 22/117 [00:01<00:07, 13.56it/s, loss=1.38, v_num=1, val_acc=0.679]
Epoch 46:  19%|█▉        | 22/117 [00:01<00:07, 13.36it/s, loss=1.31, v_num=1, val_acc=0.679]
Epoch 46:  20%|█▉        | 23/117 [00:01<00:06, 13.88it/s, loss=1.31, v_num=1, val_acc=0.679]
Epoch 46:  20%|█▉        | 23/117 [00:01<00:06, 13.68it/s, loss=1.27, v_num=1, val_acc=0.679]
Epoch 46:  21%|██        | 24/117 [00:01<00:06, 14.19it/s, loss=1.27, v_num=1, val_acc=0.679]
Epoch 46:  21%|██        | 24/117 [00:01<00:06, 13.99it/s, loss=1.24, v_num=1, val_acc=0.679]
Epoch 46:  21%|██▏       | 25/117 [00:01<00:06, 14.49it/s, loss=1.24, v_num=1, val_acc=0.679]
Epoch 46:  21%|██▏       | 25/117 [00:01<00:06, 14.28it/s, loss=1.21, v_num=1, val_acc=0.679]
Epoch 46:  22%|██▏       | 26/117 [00:01<00:06, 14.78it/s, loss=1.21, v_num=1, val_acc=0.679]
Epoch 46:  22%|██▏       | 26/117 [00:01<00:06, 14.57it/s, loss=1.18, v_num=1, val_acc=0.679]
Epoch 46:  23%|██▎       | 27/117 [00:01<00:05, 15.05it/s, loss=1.18, v_num=1, val_acc=0.679]
Epoch 46:  23%|██▎       | 27/117 [00:01<00:06, 14.84it/s, loss=1.14, v_num=1, val_acc=0.679]
Epoch 46:  24%|██▍       | 28/117 [00:01<00:05, 15.31it/s, loss=1.14, v_num=1, val_acc=0.679]
Epoch 46:  24%|██▍       | 28/117 [00:01<00:05, 15.11it/s, loss=1.13, v_num=1, val_acc=0.679]
Epoch 46:  25%|██▍       | 29/117 [00:01<00:05, 15.57it/s, loss=1.13, v_num=1, val_acc=0.679]
Epoch 46:  25%|██▍       | 29/117 [00:01<00:05, 15.36it/s, loss=1.13, v_num=1, val_acc=0.679]
Epoch 46:  26%|██▌       | 30/117 [00:01<00:05, 15.81it/s, loss=1.13, v_num=1, val_acc=0.679]
Epoch 46:  26%|██▌       | 30/117 [00:01<00:05, 15.60it/s, loss=1.12, v_num=1, val_acc=0.679]
Epoch 46:  26%|██▋       | 31/117 [00:01<00:05, 16.05it/s, loss=1.12, v_num=1, val_acc=0.679]
Epoch 46:  26%|██▋       | 31/117 [00:01<00:05, 15.84it/s, loss=1.1, v_num=1, val_acc=0.679]
Epoch 46:  27%|██▋       | 32/117 [00:01<00:05, 16.27it/s, loss=1.1, v_num=1, val_acc=0.679]
Epoch 46:  27%|██▋       | 32/117 [00:01<00:05, 16.07it/s, loss=1.14, v_num=1, val_acc=0.679]
Epoch 46:  28%|██▊       | 33/117 [00:02<00:05, 16.49it/s, loss=1.14, v_num=1, val_acc=0.679]
Epoch 46:  28%|██▊       | 33/117 [00:02<00:05, 16.29it/s, loss=1.21, v_num=1, val_acc=0.679]
Epoch 46:  29%|██▉       | 34/117 [00:02<00:04, 16.67it/s, loss=1.21, v_num=1, val_acc=0.679]
Epoch 46:  29%|██▉       | 34/117 [00:02<00:05, 16.47it/s, loss=1.21, v_num=1, val_acc=0.679]
Epoch 46:  30%|██▉       | 35/117 [00:02<00:04, 16.88it/s, loss=1.21, v_num=1, val_acc=0.679]
Epoch 46:  30%|██▉       | 35/117 [00:02<00:04, 16.68it/s, loss=1.2, v_num=1, val_acc=0.679]
Epoch 46:  31%|███       | 36/117 [00:02<00:04, 17.09it/s, loss=1.2, v_num=1, val_acc=0.679]
Epoch 46:  31%|███       | 36/117 [00:02<00:04, 16.88it/s, loss=1.21, v_num=1, val_acc=0.679]
Epoch 46:  32%|███▏      | 37/117 [00:02<00:04, 17.28it/s, loss=1.21, v_num=1, val_acc=0.679]
Epoch 46:  32%|███▏      | 37/117 [00:02<00:04, 17.08it/s, loss=1.2, v_num=1, val_acc=0.679]
Epoch 46:  32%|███▏      | 38/117 [00:02<00:04, 17.47it/s, loss=1.2, v_num=1, val_acc=0.679]
Epoch 46:  32%|███▏      | 38/117 [00:02<00:04, 17.27it/s, loss=1.2, v_num=1, val_acc=0.679]
Epoch 46:  33%|███▎      | 39/117 [00:02<00:04, 17.65it/s, loss=1.2, v_num=1, val_acc=0.679]
Epoch 46:  33%|███▎      | 39/117 [00:02<00:04, 17.45it/s, loss=1.2, v_num=1, val_acc=0.679]
Epoch 46:  34%|███▍      | 40/117 [00:02<00:04, 17.82it/s, loss=1.2, v_num=1, val_acc=0.679]
Epoch 46:  34%|███▍      | 40/117 [00:02<00:04, 17.62it/s, loss=1.16, v_num=1, val_acc=0.679]
Epoch 46:  35%|███▌      | 41/117 [00:02<00:04, 17.99it/s, loss=1.16, v_num=1, val_acc=0.679]
Epoch 46:  35%|███▌      | 41/117 [00:02<00:04, 17.80it/s, loss=1.17, v_num=1, val_acc=0.679]
Epoch 46:  36%|███▌      | 42/117 [00:02<00:04, 18.16it/s, loss=1.17, v_num=1, val_acc=0.679]
Epoch 46:  36%|███▌      | 42/117 [00:02<00:04, 17.96it/s, loss=1.18, v_num=1, val_acc=0.679]
Epoch 46:  37%|███▋      | 43/117 [00:02<00:04, 18.28it/s, loss=1.18, v_num=1, val_acc=0.679]
Epoch 46:  37%|███▋      | 43/117 [00:02<00:04, 18.10it/s, loss=1.21, v_num=1, val_acc=0.679]
Epoch 46:  38%|███▊      | 44/117 [00:02<00:03, 18.45it/s, loss=1.21, v_num=1, val_acc=0.679]
Epoch 46:  38%|███▊      | 44/117 [00:02<00:03, 18.25it/s, loss=1.26, v_num=1, val_acc=0.679]
Epoch 46:  38%|███▊      | 45/117 [00:02<00:03, 18.60it/s, loss=1.26, v_num=1, val_acc=0.679]
Epoch 46:  38%|███▊      | 45/117 [00:02<00:03, 18.41it/s, loss=1.28, v_num=1, val_acc=0.679]
Epoch 46:  39%|███▉      | 46/117 [00:02<00:03, 18.75it/s, loss=1.28, v_num=1, val_acc=0.679]
Epoch 46:  39%|███▉      | 46/117 [00:02<00:03, 18.56it/s, loss=1.28, v_num=1, val_acc=0.679]
Epoch 46:  40%|████      | 47/117 [00:02<00:03, 18.89it/s, loss=1.28, v_num=1, val_acc=0.679]
Epoch 46:  40%|████      | 47/117 [00:02<00:03, 18.70it/s, loss=1.29, v_num=1, val_acc=0.679]
Epoch 46:  41%|████      | 48/117 [00:02<00:03, 19.03it/s, loss=1.29, v_num=1, val_acc=0.679]
Epoch 46:  41%|████      | 48/117 [00:02<00:03, 18.84it/s, loss=1.29, v_num=1, val_acc=0.679]
Epoch 46:  42%|████▏     | 49/117 [00:02<00:03, 19.17it/s, loss=1.29, v_num=1, val_acc=0.679]
Epoch 46:  42%|████▏     | 49/117 [00:02<00:03, 18.98it/s, loss=1.31, v_num=1, val_acc=0.679]
Epoch 46:  43%|████▎     | 50/117 [00:02<00:03, 19.30it/s, loss=1.31, v_num=1, val_acc=0.679]
Epoch 46:  43%|████▎     | 50/117 [00:02<00:03, 19.11it/s, loss=1.32, v_num=1, val_acc=0.679]
Epoch 46:  44%|████▎     | 51/117 [00:02<00:03, 19.43it/s, loss=1.32, v_num=1, val_acc=0.679]
Epoch 46:  44%|████▎     | 51/117 [00:02<00:03, 19.24it/s, loss=1.31, v_num=1, val_acc=0.679]
Epoch 46:  44%|████▍     | 52/117 [00:02<00:03, 19.56it/s, loss=1.31, v_num=1, val_acc=0.679]
Epoch 46:  44%|████▍     | 52/117 [00:02<00:03, 19.37it/s, loss=1.27, v_num=1, val_acc=0.679]
Epoch 46:  45%|████▌     | 53/117 [00:02<00:03, 19.68it/s, loss=1.27, v_num=1, val_acc=0.679]
Epoch 46:  45%|████▌     | 53/117 [00:02<00:03, 19.49it/s, loss=1.2, v_num=1, val_acc=0.679]
Epoch 46:  46%|████▌     | 54/117 [00:02<00:03, 19.80it/s, loss=1.2, v_num=1, val_acc=0.679]
Epoch 46:  46%|████▌     | 54/117 [00:02<00:03, 19.61it/s, loss=1.23, v_num=1, val_acc=0.679]
Epoch 46:  47%|████▋     | 55/117 [00:02<00:03, 19.91it/s, loss=1.23, v_num=1, val_acc=0.679]
Epoch 46:  47%|████▋     | 55/117 [00:02<00:03, 19.73it/s, loss=1.24, v_num=1, val_acc=0.679]
Epoch 46:  48%|████▊     | 56/117 [00:02<00:03, 20.03it/s, loss=1.24, v_num=1, val_acc=0.679]
Epoch 46:  48%|████▊     | 56/117 [00:02<00:03, 19.85it/s, loss=1.25, v_num=1, val_acc=0.679]
Epoch 46:  49%|████▊     | 57/117 [00:02<00:02, 20.13it/s, loss=1.25, v_num=1, val_acc=0.679]
Epoch 46:  49%|████▊     | 57/117 [00:02<00:03, 19.96it/s, loss=1.28, v_num=1, val_acc=0.679]
Epoch 46:  50%|████▉     | 58/117 [00:02<00:02, 20.24it/s, loss=1.28, v_num=1, val_acc=0.679]
Epoch 46:  50%|████▉     | 58/117 [00:02<00:02, 20.07it/s, loss=1.33, v_num=1, val_acc=0.679]
Epoch 46:  50%|█████     | 59/117 [00:02<00:02, 20.35it/s, loss=1.33, v_num=1, val_acc=0.679]
Epoch 46:  50%|█████     | 59/117 [00:02<00:02, 20.17it/s, loss=1.33, v_num=1, val_acc=0.679]
Epoch 46:  51%|█████▏    | 60/117 [00:02<00:02, 20.45it/s, loss=1.33, v_num=1, val_acc=0.679]
Epoch 46:  51%|█████▏    | 60/117 [00:02<00:02, 20.28it/s, loss=1.32, v_num=1, val_acc=0.679]
Epoch 46:  52%|█████▏    | 61/117 [00:02<00:02, 20.55it/s, loss=1.32, v_num=1, val_acc=0.679]
Epoch 46:  52%|█████▏    | 61/117 [00:02<00:02, 20.38it/s, loss=1.32, v_num=1, val_acc=0.679]
Epoch 46:  53%|█████▎    | 62/117 [00:03<00:02, 20.65it/s, loss=1.32, v_num=1, val_acc=0.679]
Epoch 46:  53%|█████▎    | 62/117 [00:03<00:02, 20.48it/s, loss=1.34, v_num=1, val_acc=0.679]
Epoch 46:  54%|█████▍    | 63/117 [00:03<00:02, 20.75it/s, loss=1.34, v_num=1, val_acc=0.679]
Epoch 46:  54%|█████▍    | 63/117 [00:03<00:02, 20.58it/s, loss=1.34, v_num=1, val_acc=0.679]
Epoch 46:  55%|█████▍    | 64/117 [00:03<00:02, 20.84it/s, loss=1.34, v_num=1, val_acc=0.679]
Epoch 46:  55%|█████▍    | 64/117 [00:03<00:02, 20.67it/s, loss=1.31, v_num=1, val_acc=0.679]
Epoch 46:  56%|█████▌    | 65/117 [00:03<00:02, 20.93it/s, loss=1.31, v_num=1, val_acc=0.679]
Epoch 46:  56%|█████▌    | 65/117 [00:03<00:02, 20.76it/s, loss=1.33, v_num=1, val_acc=0.679]
Epoch 46:  56%|█████▋    | 66/117 [00:03<00:02, 21.02it/s, loss=1.33, v_num=1, val_acc=0.679]
Epoch 46:  56%|█████▋    | 66/117 [00:03<00:02, 20.85it/s, loss=1.36, v_num=1, val_acc=0.679]
Epoch 46:  57%|█████▋    | 67/117 [00:03<00:02, 21.11it/s, loss=1.36, v_num=1, val_acc=0.679]
Epoch 46:  57%|█████▋    | 67/117 [00:03<00:02, 20.94it/s, loss=1.4, v_num=1, val_acc=0.679]
Epoch 46:  58%|█████▊    | 68/117 [00:03<00:02, 21.19it/s, loss=1.4, v_num=1, val_acc=0.679]
Epoch 46:  58%|█████▊    | 68/117 [00:03<00:02, 21.03it/s, loss=1.41, v_num=1, val_acc=0.679]
Epoch 46:  59%|█████▉    | 69/117 [00:03<00:02, 21.28it/s, loss=1.41, v_num=1, val_acc=0.679]
Epoch 46:  59%|█████▉    | 69/117 [00:03<00:02, 21.11it/s, loss=1.4, v_num=1, val_acc=0.679]
Epoch 46:  60%|█████▉    | 70/117 [00:03<00:02, 21.36it/s, loss=1.4, v_num=1, val_acc=0.679]
Epoch 46:  60%|█████▉    | 70/117 [00:03<00:02, 21.20it/s, loss=1.4, v_num=1, val_acc=0.679]
Epoch 46:  61%|██████    | 71/117 [00:03<00:02, 21.44it/s, loss=1.4, v_num=1, val_acc=0.679]
Epoch 46:  61%|██████    | 71/117 [00:03<00:02, 21.28it/s, loss=1.41, v_num=1, val_acc=0.679]
Epoch 46:  62%|██████▏   | 72/117 [00:03<00:02, 21.52it/s, loss=1.41, v_num=1, val_acc=0.679]
Epoch 46:  62%|██████▏   | 72/117 [00:03<00:02, 21.36it/s, loss=1.41, v_num=1, val_acc=0.679]
Epoch 46:  62%|██████▏   | 73/117 [00:03<00:02, 21.60it/s, loss=1.41, v_num=1, val_acc=0.679]
Epoch 46:  62%|██████▏   | 73/117 [00:03<00:02, 21.44it/s, loss=1.43, v_num=1, val_acc=0.679]
Epoch 46:  63%|██████▎   | 74/117 [00:03<00:01, 21.68it/s, loss=1.43, v_num=1, val_acc=0.679]
Epoch 46:  63%|██████▎   | 74/117 [00:03<00:01, 21.51it/s, loss=1.41, v_num=1, val_acc=0.679]
Epoch 46:  64%|██████▍   | 75/117 [00:03<00:01, 21.75it/s, loss=1.41, v_num=1, val_acc=0.679]
Epoch 46:  64%|██████▍   | 75/117 [00:03<00:01, 21.59it/s, loss=1.43, v_num=1, val_acc=0.679]
Epoch 46:  65%|██████▍   | 76/117 [00:03<00:01, 21.82it/s, loss=1.43, v_num=1, val_acc=0.679]
Epoch 46:  65%|██████▍   | 76/117 [00:03<00:01, 21.66it/s, loss=1.46, v_num=1, val_acc=0.679]
Epoch 46:  66%|██████▌   | 77/117 [00:03<00:01, 21.89it/s, loss=1.46, v_num=1, val_acc=0.679]
Epoch 46:  66%|██████▌   | 77/117 [00:03<00:01, 21.74it/s, loss=1.45, v_num=1, val_acc=0.679]
Epoch 46:  67%|██████▋   | 78/117 [00:03<00:01, 21.96it/s, loss=1.45, v_num=1, val_acc=0.679]
Epoch 46:  67%|██████▋   | 78/117 [00:03<00:01, 21.81it/s, loss=1.4, v_num=1, val_acc=0.679]
Epoch 46:  68%|██████▊   | 79/117 [00:03<00:01, 22.03it/s, loss=1.4, v_num=1, val_acc=0.679]
Epoch 46:  68%|██████▊   | 79/117 [00:03<00:01, 21.88it/s, loss=1.39, v_num=1, val_acc=0.679]
Epoch 46:  68%|██████▊   | 80/117 [00:03<00:01, 22.10it/s, loss=1.39, v_num=1, val_acc=0.679]
Epoch 46:  68%|██████▊   | 80/117 [00:03<00:01, 21.95it/s, loss=1.41, v_num=1, val_acc=0.679]
Epoch 46:  69%|██████▉   | 81/117 [00:03<00:01, 22.17it/s, loss=1.41, v_num=1, val_acc=0.679]
Epoch 46:  69%|██████▉   | 81/117 [00:03<00:01, 22.01it/s, loss=1.42, v_num=1, val_acc=0.679]
Epoch 46:  70%|███████   | 82/117 [00:03<00:01, 22.21it/s, loss=1.42, v_num=1, val_acc=0.679]
Epoch 46:  70%|███████   | 82/117 [00:03<00:01, 22.06it/s, loss=1.41, v_num=1, val_acc=0.679]
Epoch 46:  71%|███████   | 83/117 [00:03<00:01, 22.28it/s, loss=1.41, v_num=1, val_acc=0.679]
Epoch 46:  71%|███████   | 83/117 [00:03<00:01, 22.13it/s, loss=1.4, v_num=1, val_acc=0.679]
Epoch 46:  72%|███████▏  | 84/117 [00:03<00:01, 22.34it/s, loss=1.4, v_num=1, val_acc=0.679]
Epoch 46:  72%|███████▏  | 84/117 [00:03<00:01, 22.19it/s, loss=1.41, v_num=1, val_acc=0.679]
Epoch 46:  73%|███████▎  | 85/117 [00:03<00:01, 22.41it/s, loss=1.41, v_num=1, val_acc=0.679]
Epoch 46:  73%|███████▎  | 85/117 [00:03<00:01, 22.26it/s, loss=1.4, v_num=1, val_acc=0.679]
Epoch 46:  74%|███████▎  | 86/117 [00:03<00:01, 22.47it/s, loss=1.4, v_num=1, val_acc=0.679]
Epoch 46:  74%|███████▎  | 86/117 [00:03<00:01, 22.32it/s, loss=1.38, v_num=1, val_acc=0.679]
Epoch 46:  74%|███████▍  | 87/117 [00:03<00:01, 22.53it/s, loss=1.38, v_num=1, val_acc=0.679]
Epoch 46:  74%|███████▍  | 87/117 [00:03<00:01, 22.38it/s, loss=1.34, v_num=1, val_acc=0.679]
Epoch 46:  75%|███████▌  | 88/117 [00:03<00:01, 22.59it/s, loss=1.34, v_num=1, val_acc=0.679]
Epoch 46:  75%|███████▌  | 88/117 [00:03<00:01, 22.44it/s, loss=1.33, v_num=1, val_acc=0.679]
Epoch 46:  76%|███████▌  | 89/117 [00:03<00:01, 22.64it/s, loss=1.33, v_num=1, val_acc=0.679]
Epoch 46:  76%|███████▌  | 89/117 [00:03<00:01, 22.50it/s, loss=1.32, v_num=1, val_acc=0.679]
Epoch 46:  77%|███████▋  | 90/117 [00:03<00:01, 22.70it/s, loss=1.32, v_num=1, val_acc=0.679]
Epoch 46:  77%|███████▋  | 90/117 [00:03<00:01, 22.56it/s, loss=1.32, v_num=1, val_acc=0.679]
Epoch 46:  78%|███████▊  | 91/117 [00:03<00:01, 22.75it/s, loss=1.32, v_num=1, val_acc=0.679]
Epoch 46:  78%|███████▊  | 91/117 [00:04<00:01, 22.61it/s, loss=1.3, v_num=1, val_acc=0.679]
Epoch 46:  79%|███████▊  | 92/117 [00:04<00:01, 22.81it/s, loss=1.3, v_num=1, val_acc=0.679]
Epoch 46:  79%|███████▊  | 92/117 [00:04<00:01, 22.67it/s, loss=1.29, v_num=1, val_acc=0.679]
Epoch 46:  79%|███████▉  | 93/117 [00:04<00:01, 22.86it/s, loss=1.29, v_num=1, val_acc=0.679]
Epoch 46:  79%|███████▉  | 93/117 [00:04<00:01, 22.72it/s, loss=1.27, v_num=1, val_acc=0.679]
Epoch 46:  80%|████████  | 94/117 [00:04<00:01, 22.91it/s, loss=1.27, v_num=1, val_acc=0.679]
Epoch 46:  80%|████████  | 94/117 [00:04<00:01, 22.77it/s, loss=1.28, v_num=1, val_acc=0.679]
Epoch 46:  81%|████████  | 95/117 [00:04<00:00, 22.97it/s, loss=1.28, v_num=1, val_acc=0.679]
Epoch 46:  81%|████████  | 95/117 [00:04<00:00, 22.82it/s, loss=1.25, v_num=1, val_acc=0.679]
Epoch 46:  82%|████████▏ | 96/117 [00:04<00:00, 23.02it/s, loss=1.25, v_num=1, val_acc=0.679]
Epoch 46:  82%|████████▏ | 96/117 [00:04<00:00, 22.88it/s, loss=1.23, v_num=1, val_acc=0.679]
Epoch 46:  83%|████████▎ | 97/117 [00:04<00:00, 23.07it/s, loss=1.23, v_num=1, val_acc=0.679]
Epoch 46:  83%|████████▎ | 97/117 [00:04<00:00, 22.93it/s, loss=1.23, v_num=1, val_acc=0.679]

Validation: 0it [00:00, ?it/s]

Validation:   0%|          | 0/20 [00:00<?, ?it/s]

Validation DataLoader 0:   0%|          | 0/20 [00:00<?, ?it/s]

Validation DataLoader 0:   5%|▌         | 1/20 [00:00<00:00, 195.06it/s]
Epoch 46:  84%|████████▍ | 98/117 [00:05<00:00, 19.32it/s, loss=1.23, v_num=1, val_acc=0.679]

Validation DataLoader 0:  10%|█         | 2/20 [00:00<00:00, 56.80it/s]
Epoch 46:  85%|████████▍ | 99/117 [00:05<00:00, 19.40it/s, loss=1.23, v_num=1, val_acc=0.679]

Validation DataLoader 0:  15%|█▌        | 3/20 [00:00<00:00, 44.92it/s]
Epoch 46:  85%|████████▌ | 100/117 [00:05<00:00, 19.48it/s, loss=1.23, v_num=1, val_acc=0.679]

Validation DataLoader 0:  20%|██        | 4/20 [00:00<00:00, 40.71it/s]
Epoch 46:  86%|████████▋ | 101/117 [00:05<00:00, 19.55it/s, loss=1.23, v_num=1, val_acc=0.679]

Validation DataLoader 0:  25%|██▌       | 5/20 [00:00<00:00, 38.57it/s]
Epoch 46:  87%|████████▋ | 102/117 [00:05<00:00, 19.63it/s, loss=1.23, v_num=1, val_acc=0.679]

Validation DataLoader 0:  30%|███       | 6/20 [00:00<00:00, 37.22it/s]
Epoch 46:  88%|████████▊ | 103/117 [00:05<00:00, 19.70it/s, loss=1.23, v_num=1, val_acc=0.679]

Validation DataLoader 0:  35%|███▌      | 7/20 [00:00<00:00, 36.33it/s]
Epoch 46:  89%|████████▉ | 104/117 [00:05<00:00, 19.77it/s, loss=1.23, v_num=1, val_acc=0.679]

Validation DataLoader 0:  40%|████      | 8/20 [00:00<00:00, 35.68it/s]
Epoch 46:  90%|████████▉ | 105/117 [00:05<00:00, 19.85it/s, loss=1.23, v_num=1, val_acc=0.679]

Validation DataLoader 0:  45%|████▌     | 9/20 [00:00<00:00, 35.17it/s]
Epoch 46:  91%|█████████ | 106/117 [00:05<00:00, 19.91it/s, loss=1.23, v_num=1, val_acc=0.679]

Validation DataLoader 0:  50%|█████     | 10/20 [00:00<00:00, 34.80it/s]
Epoch 46:  91%|█████████▏| 107/117 [00:05<00:00, 19.98it/s, loss=1.23, v_num=1, val_acc=0.679]

Validation DataLoader 0:  55%|█████▌    | 11/20 [00:00<00:00, 34.52it/s]
Epoch 46:  92%|█████████▏| 108/117 [00:05<00:00, 20.05it/s, loss=1.23, v_num=1, val_acc=0.679]

Validation DataLoader 0:  60%|██████    | 12/20 [00:00<00:00, 34.28it/s]
Epoch 46:  93%|█████████▎| 109/117 [00:05<00:00, 20.12it/s, loss=1.23, v_num=1, val_acc=0.679]

Validation DataLoader 0:  65%|██████▌   | 13/20 [00:00<00:00, 34.07it/s]
Epoch 46:  94%|█████████▍| 110/117 [00:05<00:00, 20.19it/s, loss=1.23, v_num=1, val_acc=0.679]

Validation DataLoader 0:  70%|███████   | 14/20 [00:00<00:00, 33.91it/s]
Epoch 46:  95%|█████████▍| 111/117 [00:05<00:00, 20.26it/s, loss=1.23, v_num=1, val_acc=0.679]

Validation DataLoader 0:  75%|███████▌  | 15/20 [00:00<00:00, 33.76it/s]
Epoch 46:  96%|█████████▌| 112/117 [00:05<00:00, 20.32it/s, loss=1.23, v_num=1, val_acc=0.679]

Validation DataLoader 0:  80%|████████  | 16/20 [00:00<00:00, 33.62it/s]
Epoch 46:  97%|█████████▋| 113/117 [00:05<00:00, 20.39it/s, loss=1.23, v_num=1, val_acc=0.679]

Validation DataLoader 0:  85%|████████▌ | 17/20 [00:00<00:00, 33.51it/s]
Epoch 46:  97%|█████████▋| 114/117 [00:05<00:00, 20.45it/s, loss=1.23, v_num=1, val_acc=0.679]

Validation DataLoader 0:  90%|█████████ | 18/20 [00:00<00:00, 33.41it/s]
Epoch 46:  98%|█████████▊| 115/117 [00:05<00:00, 20.52it/s, loss=1.23, v_num=1, val_acc=0.679]

Validation DataLoader 0:  95%|█████████▌| 19/20 [00:00<00:00, 33.32it/s]
Epoch 46:  99%|█████████▉| 116/117 [00:05<00:00, 20.58it/s, loss=1.23, v_num=1, val_acc=0.679]

Validation DataLoader 0: 100%|██████████| 20/20 [00:00<00:00, 33.30it/s]
Epoch 46: 100%|██████████| 117/117 [00:05<00:00, 20.64it/s, loss=1.23, v_num=1, val_acc=0.679]
Epoch 46: 100%|██████████| 117/117 [00:05<00:00, 20.57it/s, loss=1.23, v_num=1, val_acc=0.708]


Epoch 46: 100%|██████████| 117/117 [00:05<00:00, 20.57it/s, loss=1.23, v_num=1, val_acc=0.708]
Epoch 46:   0%|          | 0/117 [00:00<?, ?it/s, loss=1.23, v_num=1, val_acc=0.708]
Epoch 47:   0%|          | 0/117 [00:00<?, ?it/s, loss=1.23, v_num=1, val_acc=0.708]
Epoch 47:   1%|          | 1/117 [00:00<01:44,  1.11it/s, loss=1.23, v_num=1, val_acc=0.708]
Epoch 47:   1%|          | 1/117 [00:00<01:47,  1.08it/s, loss=1.26, v_num=1, val_acc=0.708]
Epoch 47:   2%|▏         | 2/117 [00:00<00:53,  2.14it/s, loss=1.26, v_num=1, val_acc=0.708]
Epoch 47:   2%|▏         | 2/117 [00:00<00:55,  2.08it/s, loss=1.25, v_num=1, val_acc=0.708]
Epoch 47:   3%|▎         | 3/117 [00:00<00:36,  3.09it/s, loss=1.25, v_num=1, val_acc=0.708]
Epoch 47:   3%|▎         | 3/117 [00:00<00:37,  3.01it/s, loss=1.25, v_num=1, val_acc=0.708]
Epoch 47:   3%|▎         | 4/117 [00:01<00:28,  3.96it/s, loss=1.25, v_num=1, val_acc=0.708]
Epoch 47:   3%|▎         | 4/117 [00:01<00:29,  3.87it/s, loss=1.23, v_num=1, val_acc=0.708]
Epoch 47:   4%|▍         | 5/117 [00:01<00:23,  4.79it/s, loss=1.23, v_num=1, val_acc=0.708]
Epoch 47:   4%|▍         | 5/117 [00:01<00:23,  4.68it/s, loss=1.24, v_num=1, val_acc=0.708]
Epoch 47:   5%|▌         | 6/117 [00:01<00:19,  5.57it/s, loss=1.24, v_num=1, val_acc=0.708]
Epoch 47:   5%|▌         | 6/117 [00:01<00:20,  5.45it/s, loss=1.24, v_num=1, val_acc=0.708]
Epoch 47:   6%|▌         | 7/117 [00:01<00:17,  6.31it/s, loss=1.24, v_num=1, val_acc=0.708]
Epoch 47:   6%|▌         | 7/117 [00:01<00:17,  6.17it/s, loss=1.22, v_num=1, val_acc=0.708]
Epoch 47:   7%|▋         | 8/117 [00:01<00:15,  7.00it/s, loss=1.22, v_num=1, val_acc=0.708]
Epoch 47:   7%|▋         | 8/117 [00:01<00:15,  6.85it/s, loss=1.2, v_num=1, val_acc=0.708]
Epoch 47:   8%|▊         | 9/117 [00:01<00:14,  7.63it/s, loss=1.2, v_num=1, val_acc=0.708]
Epoch 47:   8%|▊         | 9/117 [00:01<00:14,  7.47it/s, loss=1.2, v_num=1, val_acc=0.708]
Epoch 47:   9%|▊         | 10/117 [00:01<00:12,  8.25it/s, loss=1.2, v_num=1, val_acc=0.708]
Epoch 47:   9%|▊         | 10/117 [00:01<00:13,  8.08it/s, loss=1.21, v_num=1, val_acc=0.708]
Epoch 47:   9%|▉         | 11/117 [00:01<00:12,  8.83it/s, loss=1.21, v_num=1, val_acc=0.708]
Epoch 47:   9%|▉         | 11/117 [00:01<00:12,  8.65it/s, loss=1.22, v_num=1, val_acc=0.708]
Epoch 47:  10%|█         | 12/117 [00:01<00:11,  9.35it/s, loss=1.22, v_num=1, val_acc=0.708]
Epoch 47:  10%|█         | 12/117 [00:01<00:11,  9.17it/s, loss=1.25, v_num=1, val_acc=0.708]
Epoch 47:  11%|█         | 13/117 [00:01<00:10,  9.87it/s, loss=1.25, v_num=1, val_acc=0.708]
Epoch 47:  11%|█         | 13/117 [00:01<00:10,  9.68it/s, loss=1.25, v_num=1, val_acc=0.708]
Epoch 47:  12%|█▏        | 14/117 [00:01<00:09, 10.36it/s, loss=1.25, v_num=1, val_acc=0.708]
Epoch 47:  12%|█▏        | 14/117 [00:01<00:10, 10.17it/s, loss=1.27, v_num=1, val_acc=0.708]
Epoch 47:  13%|█▎        | 15/117 [00:01<00:09, 10.83it/s, loss=1.27, v_num=1, val_acc=0.708]
Epoch 47:  13%|█▎        | 15/117 [00:01<00:09, 10.64it/s, loss=1.28, v_num=1, val_acc=0.708]
Epoch 47:  14%|█▎        | 16/117 [00:01<00:08, 11.28it/s, loss=1.28, v_num=1, val_acc=0.708]
Epoch 47:  14%|█▎        | 16/117 [00:01<00:09, 11.08it/s, loss=1.3, v_num=1, val_acc=0.708]
Epoch 47:  15%|█▍        | 17/117 [00:01<00:08, 11.69it/s, loss=1.3, v_num=1, val_acc=0.708]
Epoch 47:  15%|█▍        | 17/117 [00:01<00:08, 11.50it/s, loss=1.3, v_num=1, val_acc=0.708]
Epoch 47:  15%|█▌        | 18/117 [00:01<00:08, 12.10it/s, loss=1.3, v_num=1, val_acc=0.708]
Epoch 47:  15%|█▌        | 18/117 [00:01<00:08, 11.90it/s, loss=1.31, v_num=1, val_acc=0.708]
Epoch 47:  16%|█▌        | 19/117 [00:01<00:07, 12.49it/s, loss=1.31, v_num=1, val_acc=0.708]
Epoch 47:  16%|█▌        | 19/117 [00:01<00:07, 12.29it/s, loss=1.3, v_num=1, val_acc=0.708]
Epoch 47:  17%|█▋        | 20/117 [00:01<00:07, 12.85it/s, loss=1.3, v_num=1, val_acc=0.708]
Epoch 47:  17%|█▋        | 20/117 [00:01<00:07, 12.65it/s, loss=1.27, v_num=1, val_acc=0.708]
Epoch 47:  18%|█▊        | 21/117 [00:01<00:07, 13.19it/s, loss=1.27, v_num=1, val_acc=0.708]
Epoch 47:  18%|█▊        | 21/117 [00:01<00:07, 12.99it/s, loss=1.22, v_num=1, val_acc=0.708]
Epoch 47:  19%|█▉        | 22/117 [00:01<00:07, 13.53it/s, loss=1.22, v_num=1, val_acc=0.708]
Epoch 47:  19%|█▉        | 22/117 [00:01<00:07, 13.33it/s, loss=1.22, v_num=1, val_acc=0.708]
Epoch 47:  20%|█▉        | 23/117 [00:01<00:06, 13.86it/s, loss=1.22, v_num=1, val_acc=0.708]
Epoch 47:  20%|█▉        | 23/117 [00:01<00:06, 13.66it/s, loss=1.23, v_num=1, val_acc=0.708]
Epoch 47:  21%|██        | 24/117 [00:01<00:06, 14.17it/s, loss=1.23, v_num=1, val_acc=0.708]
Epoch 47:  21%|██        | 24/117 [00:01<00:06, 13.96it/s, loss=1.27, v_num=1, val_acc=0.708]
Epoch 47:  21%|██▏       | 25/117 [00:01<00:06, 14.46it/s, loss=1.27, v_num=1, val_acc=0.708]
Epoch 47:  21%|██▏       | 25/117 [00:01<00:06, 14.26it/s, loss=1.33, v_num=1, val_acc=0.708]
Epoch 47:  22%|██▏       | 26/117 [00:01<00:06, 14.76it/s, loss=1.33, v_num=1, val_acc=0.708]
Epoch 47:  22%|██▏       | 26/117 [00:01<00:06, 14.55it/s, loss=1.36, v_num=1, val_acc=0.708]
Epoch 47:  23%|██▎       | 27/117 [00:01<00:05, 15.03it/s, loss=1.36, v_num=1, val_acc=0.708]
Epoch 47:  23%|██▎       | 27/117 [00:01<00:06, 14.82it/s, loss=1.42, v_num=1, val_acc=0.708]
Epoch 47:  24%|██▍       | 28/117 [00:01<00:05, 15.29it/s, loss=1.42, v_num=1, val_acc=0.708]
Epoch 47:  24%|██▍       | 28/117 [00:01<00:05, 15.08it/s, loss=1.46, v_num=1, val_acc=0.708]
Epoch 47:  25%|██▍       | 29/117 [00:01<00:05, 15.54it/s, loss=1.46, v_num=1, val_acc=0.708]
Epoch 47:  25%|██▍       | 29/117 [00:01<00:05, 15.34it/s, loss=1.48, v_num=1, val_acc=0.708]
Epoch 47:  26%|██▌       | 30/117 [00:01<00:05, 15.78it/s, loss=1.48, v_num=1, val_acc=0.708]
Epoch 47:  26%|██▌       | 30/117 [00:01<00:05, 15.58it/s, loss=1.51, v_num=1, val_acc=0.708]
Epoch 47:  26%|██▋       | 31/117 [00:01<00:05, 16.02it/s, loss=1.51, v_num=1, val_acc=0.708]
Epoch 47:  26%|██▋       | 31/117 [00:01<00:05, 15.82it/s, loss=1.49, v_num=1, val_acc=0.708]
Epoch 47:  27%|██▋       | 32/117 [00:01<00:05, 16.25it/s, loss=1.49, v_num=1, val_acc=0.708]
Epoch 47:  27%|██▋       | 32/117 [00:01<00:05, 16.04it/s, loss=1.46, v_num=1, val_acc=0.708]
Epoch 47:  28%|██▊       | 33/117 [00:02<00:05, 16.47it/s, loss=1.46, v_num=1, val_acc=0.708]
Epoch 47:  28%|██▊       | 33/117 [00:02<00:05, 16.26it/s, loss=1.46, v_num=1, val_acc=0.708]
Epoch 47:  29%|██▉       | 34/117 [00:02<00:04, 16.68it/s, loss=1.46, v_num=1, val_acc=0.708]
Epoch 47:  29%|██▉       | 34/117 [00:02<00:05, 16.47it/s, loss=1.45, v_num=1, val_acc=0.708]
Epoch 47:  30%|██▉       | 35/117 [00:02<00:04, 16.88it/s, loss=1.45, v_num=1, val_acc=0.708]
Epoch 47:  30%|██▉       | 35/117 [00:02<00:04, 16.68it/s, loss=1.47, v_num=1, val_acc=0.708]
Epoch 47:  31%|███       | 36/117 [00:02<00:04, 17.08it/s, loss=1.47, v_num=1, val_acc=0.708]
Epoch 47:  31%|███       | 36/117 [00:02<00:04, 16.88it/s, loss=1.48, v_num=1, val_acc=0.708]
Epoch 47:  32%|███▏      | 37/117 [00:02<00:04, 17.27it/s, loss=1.48, v_num=1, val_acc=0.708]
Epoch 47:  32%|███▏      | 37/117 [00:02<00:04, 17.07it/s, loss=1.5, v_num=1, val_acc=0.708]
Epoch 47:  32%|███▏      | 38/117 [00:02<00:04, 17.46it/s, loss=1.5, v_num=1, val_acc=0.708]
Epoch 47:  32%|███▏      | 38/117 [00:02<00:04, 17.26it/s, loss=1.48, v_num=1, val_acc=0.708]
Epoch 47:  33%|███▎      | 39/117 [00:02<00:04, 17.64it/s, loss=1.48, v_num=1, val_acc=0.708]
Epoch 47:  33%|███▎      | 39/117 [00:02<00:04, 17.44it/s, loss=1.51, v_num=1, val_acc=0.708]
Epoch 47:  34%|███▍      | 40/117 [00:02<00:04, 17.82it/s, loss=1.51, v_num=1, val_acc=0.708]
Epoch 47:  34%|███▍      | 40/117 [00:02<00:04, 17.62it/s, loss=1.56, v_num=1, val_acc=0.708]
Epoch 47:  35%|███▌      | 41/117 [00:02<00:04, 17.98it/s, loss=1.56, v_num=1, val_acc=0.708]
Epoch 47:  35%|███▌      | 41/117 [00:02<00:04, 17.79it/s, loss=1.58, v_num=1, val_acc=0.708]
Epoch 47:  36%|███▌      | 42/117 [00:02<00:04, 18.14it/s, loss=1.58, v_num=1, val_acc=0.708]
Epoch 47:  36%|███▌      | 42/117 [00:02<00:04, 17.94it/s, loss=1.58, v_num=1, val_acc=0.708]
Epoch 47:  37%|███▋      | 43/117 [00:02<00:04, 18.30it/s, loss=1.58, v_num=1, val_acc=0.708]
Epoch 47:  37%|███▋      | 43/117 [00:02<00:04, 18.10it/s, loss=1.55, v_num=1, val_acc=0.708]
Epoch 47:  38%|███▊      | 44/117 [00:02<00:03, 18.45it/s, loss=1.55, v_num=1, val_acc=0.708]
Epoch 47:  38%|███▊      | 44/117 [00:02<00:03, 18.25it/s, loss=1.5, v_num=1, val_acc=0.708]
Epoch 47:  38%|███▊      | 45/117 [00:02<00:03, 18.59it/s, loss=1.5, v_num=1, val_acc=0.708]
Epoch 47:  38%|███▊      | 45/117 [00:02<00:03, 18.40it/s, loss=1.43, v_num=1, val_acc=0.708]
Epoch 47:  39%|███▉      | 46/117 [00:02<00:03, 18.74it/s, loss=1.43, v_num=1, val_acc=0.708]
Epoch 47:  39%|███▉      | 46/117 [00:02<00:03, 18.55it/s, loss=1.4, v_num=1, val_acc=0.708]
Epoch 47:  40%|████      | 47/117 [00:02<00:03, 18.88it/s, loss=1.4, v_num=1, val_acc=0.708]
Epoch 47:  40%|████      | 47/117 [00:02<00:03, 18.69it/s, loss=1.37, v_num=1, val_acc=0.708]
Epoch 47:  41%|████      | 48/117 [00:02<00:03, 19.02it/s, loss=1.37, v_num=1, val_acc=0.708]
Epoch 47:  41%|████      | 48/117 [00:02<00:03, 18.83it/s, loss=1.34, v_num=1, val_acc=0.708]
Epoch 47:  42%|████▏     | 49/117 [00:02<00:03, 19.15it/s, loss=1.34, v_num=1, val_acc=0.708]
Epoch 47:  42%|████▏     | 49/117 [00:02<00:03, 18.97it/s, loss=1.32, v_num=1, val_acc=0.708]
Epoch 47:  43%|████▎     | 50/117 [00:02<00:03, 19.28it/s, loss=1.32, v_num=1, val_acc=0.708]
Epoch 47:  43%|████▎     | 50/117 [00:02<00:03, 19.10it/s, loss=1.31, v_num=1, val_acc=0.708]
Epoch 47:  44%|████▎     | 51/117 [00:02<00:03, 19.41it/s, loss=1.31, v_num=1, val_acc=0.708]
Epoch 47:  44%|████▎     | 51/117 [00:02<00:03, 19.23it/s, loss=1.32, v_num=1, val_acc=0.708]
Epoch 47:  44%|████▍     | 52/117 [00:02<00:03, 19.54it/s, loss=1.32, v_num=1, val_acc=0.708]
Epoch 47:  44%|████▍     | 52/117 [00:02<00:03, 19.35it/s, loss=1.33, v_num=1, val_acc=0.708]
Epoch 47:  45%|████▌     | 53/117 [00:02<00:03, 19.66it/s, loss=1.33, v_num=1, val_acc=0.708]
Epoch 47:  45%|████▌     | 53/117 [00:02<00:03, 19.47it/s, loss=1.35, v_num=1, val_acc=0.708]
Epoch 47:  46%|████▌     | 54/117 [00:02<00:03, 19.77it/s, loss=1.35, v_num=1, val_acc=0.708]
Epoch 47:  46%|████▌     | 54/117 [00:02<00:03, 19.59it/s, loss=1.35, v_num=1, val_acc=0.708]
Epoch 47:  47%|████▋     | 55/117 [00:02<00:03, 19.89it/s, loss=1.35, v_num=1, val_acc=0.708]
Epoch 47:  47%|████▋     | 55/117 [00:02<00:03, 19.71it/s, loss=1.33, v_num=1, val_acc=0.708]
Epoch 47:  48%|████▊     | 56/117 [00:02<00:03, 20.00it/s, loss=1.33, v_num=1, val_acc=0.708]
Epoch 47:  48%|████▊     | 56/117 [00:02<00:03, 19.82it/s, loss=1.29, v_num=1, val_acc=0.708]
Epoch 47:  49%|████▊     | 57/117 [00:02<00:02, 20.11it/s, loss=1.29, v_num=1, val_acc=0.708]
Epoch 47:  49%|████▊     | 57/117 [00:02<00:03, 19.93it/s, loss=1.26, v_num=1, val_acc=0.708]
Epoch 47:  50%|████▉     | 58/117 [00:02<00:02, 20.21it/s, loss=1.26, v_num=1, val_acc=0.708]
Epoch 47:  50%|████▉     | 58/117 [00:02<00:02, 20.04it/s, loss=1.25, v_num=1, val_acc=0.708]
Epoch 47:  50%|█████     | 59/117 [00:02<00:02, 20.32it/s, loss=1.25, v_num=1, val_acc=0.708]
Epoch 47:  50%|█████     | 59/117 [00:02<00:02, 20.14it/s, loss=1.23, v_num=1, val_acc=0.708]
Epoch 47:  51%|█████▏    | 60/117 [00:02<00:02, 20.42it/s, loss=1.23, v_num=1, val_acc=0.708]
Epoch 47:  51%|█████▏    | 60/117 [00:02<00:02, 20.24it/s, loss=1.18, v_num=1, val_acc=0.708]
Epoch 47:  52%|█████▏    | 61/117 [00:02<00:02, 20.51it/s, loss=1.18, v_num=1, val_acc=0.708]
Epoch 47:  52%|█████▏    | 61/117 [00:02<00:02, 20.34it/s, loss=1.16, v_num=1, val_acc=0.708]
Epoch 47:  53%|█████▎    | 62/117 [00:03<00:02, 20.58it/s, loss=1.16, v_num=1, val_acc=0.708]
Epoch 47:  53%|█████▎    | 62/117 [00:03<00:02, 20.43it/s, loss=1.17, v_num=1, val_acc=0.708]
Epoch 47:  54%|█████▍    | 63/117 [00:03<00:02, 20.69it/s, loss=1.17, v_num=1, val_acc=0.708]
Epoch 47:  54%|█████▍    | 63/117 [00:03<00:02, 20.52it/s, loss=1.17, v_num=1, val_acc=0.708]
Epoch 47:  55%|█████▍    | 64/117 [00:03<00:02, 20.79it/s, loss=1.17, v_num=1, val_acc=0.708]
Epoch 47:  55%|█████▍    | 64/117 [00:03<00:02, 20.62it/s, loss=1.2, v_num=1, val_acc=0.708]
Epoch 47:  56%|█████▌    | 65/117 [00:03<00:02, 20.88it/s, loss=1.2, v_num=1, val_acc=0.708]
Epoch 47:  56%|█████▌    | 65/117 [00:03<00:02, 20.71it/s, loss=1.21, v_num=1, val_acc=0.708]
Epoch 47:  56%|█████▋    | 66/117 [00:03<00:02, 20.96it/s, loss=1.21, v_num=1, val_acc=0.708]
Epoch 47:  56%|█████▋    | 66/117 [00:03<00:02, 20.80it/s, loss=1.19, v_num=1, val_acc=0.708]
Epoch 47:  57%|█████▋    | 67/117 [00:03<00:02, 21.05it/s, loss=1.19, v_num=1, val_acc=0.708]
Epoch 47:  57%|█████▋    | 67/117 [00:03<00:02, 20.89it/s, loss=1.17, v_num=1, val_acc=0.708]
Epoch 47:  58%|█████▊    | 68/117 [00:03<00:02, 21.14it/s, loss=1.17, v_num=1, val_acc=0.708]
Epoch 47:  58%|█████▊    | 68/117 [00:03<00:02, 20.97it/s, loss=1.17, v_num=1, val_acc=0.708]
Epoch 47:  59%|█████▉    | 69/117 [00:03<00:02, 21.22it/s, loss=1.17, v_num=1, val_acc=0.708]
Epoch 47:  59%|█████▉    | 69/117 [00:03<00:02, 21.06it/s, loss=1.2, v_num=1, val_acc=0.708]
Epoch 47:  60%|█████▉    | 70/117 [00:03<00:02, 21.28it/s, loss=1.2, v_num=1, val_acc=0.708]
Epoch 47:  60%|█████▉    | 70/117 [00:03<00:02, 21.12it/s, loss=1.23, v_num=1, val_acc=0.708]
Epoch 47:  61%|██████    | 71/117 [00:03<00:02, 21.36it/s, loss=1.23, v_num=1, val_acc=0.708]
Epoch 47:  61%|██████    | 71/117 [00:03<00:02, 21.20it/s, loss=1.23, v_num=1, val_acc=0.708]
Epoch 47:  62%|██████▏   | 72/117 [00:03<00:02, 21.43it/s, loss=1.23, v_num=1, val_acc=0.708]
Epoch 47:  62%|██████▏   | 72/117 [00:03<00:02, 21.27it/s, loss=1.21, v_num=1, val_acc=0.708]
Epoch 47:  62%|██████▏   | 73/117 [00:03<00:02, 21.51it/s, loss=1.21, v_num=1, val_acc=0.708]
Epoch 47:  62%|██████▏   | 73/117 [00:03<00:02, 21.35it/s, loss=1.19, v_num=1, val_acc=0.708]
Epoch 47:  63%|██████▎   | 74/117 [00:03<00:01, 21.58it/s, loss=1.19, v_num=1, val_acc=0.708]
Epoch 47:  63%|██████▎   | 74/117 [00:03<00:02, 21.43it/s, loss=1.17, v_num=1, val_acc=0.708]
Epoch 47:  64%|██████▍   | 75/117 [00:03<00:01, 21.66it/s, loss=1.17, v_num=1, val_acc=0.708]
Epoch 47:  64%|██████▍   | 75/117 [00:03<00:01, 21.50it/s, loss=1.17, v_num=1, val_acc=0.708]
Epoch 47:  65%|██████▍   | 76/117 [00:03<00:01, 21.72it/s, loss=1.17, v_num=1, val_acc=0.708]
Epoch 47:  65%|██████▍   | 76/117 [00:03<00:01, 21.56it/s, loss=1.17, v_num=1, val_acc=0.708]
Epoch 47:  66%|██████▌   | 77/117 [00:03<00:01, 21.79it/s, loss=1.17, v_num=1, val_acc=0.708]
Epoch 47:  66%|██████▌   | 77/117 [00:03<00:01, 21.63it/s, loss=1.19, v_num=1, val_acc=0.708]
Epoch 47:  67%|██████▋   | 78/117 [00:03<00:01, 21.85it/s, loss=1.19, v_num=1, val_acc=0.708]
Epoch 47:  67%|██████▋   | 78/117 [00:03<00:01, 21.70it/s, loss=1.22, v_num=1, val_acc=0.708]
Epoch 47:  68%|██████▊   | 79/117 [00:03<00:01, 21.92it/s, loss=1.22, v_num=1, val_acc=0.708]
Epoch 47:  68%|██████▊   | 79/117 [00:03<00:01, 21.77it/s, loss=1.27, v_num=1, val_acc=0.708]
Epoch 47:  68%|██████▊   | 80/117 [00:03<00:01, 21.98it/s, loss=1.27, v_num=1, val_acc=0.708]
Epoch 47:  68%|██████▊   | 80/117 [00:03<00:01, 21.83it/s, loss=1.27, v_num=1, val_acc=0.708]
Epoch 47:  69%|██████▉   | 81/117 [00:03<00:01, 22.05it/s, loss=1.27, v_num=1, val_acc=0.708]
Epoch 47:  69%|██████▉   | 81/117 [00:03<00:01, 21.90it/s, loss=1.28, v_num=1, val_acc=0.708]
Epoch 47:  70%|███████   | 82/117 [00:03<00:01, 22.10it/s, loss=1.28, v_num=1, val_acc=0.708]
Epoch 47:  70%|███████   | 82/117 [00:03<00:01, 21.95it/s, loss=1.31, v_num=1, val_acc=0.708]
Epoch 47:  71%|███████   | 83/117 [00:03<00:01, 22.16it/s, loss=1.31, v_num=1, val_acc=0.708]
Epoch 47:  71%|███████   | 83/117 [00:03<00:01, 22.01it/s, loss=1.33, v_num=1, val_acc=0.708]
Epoch 47:  72%|███████▏  | 84/117 [00:03<00:01, 22.22it/s, loss=1.33, v_num=1, val_acc=0.708]
Epoch 47:  72%|███████▏  | 84/117 [00:03<00:01, 22.08it/s, loss=1.31, v_num=1, val_acc=0.708]
Epoch 47:  73%|███████▎  | 85/117 [00:03<00:01, 22.28it/s, loss=1.31, v_num=1, val_acc=0.708]
Epoch 47:  73%|███████▎  | 85/117 [00:03<00:01, 22.14it/s, loss=1.33, v_num=1, val_acc=0.708]
Epoch 47:  74%|███████▎  | 86/117 [00:03<00:01, 22.35it/s, loss=1.33, v_num=1, val_acc=0.708]
Epoch 47:  74%|███████▎  | 86/117 [00:03<00:01, 22.20it/s, loss=1.35, v_num=1, val_acc=0.708]
Epoch 47:  74%|███████▍  | 87/117 [00:03<00:01, 22.41it/s, loss=1.35, v_num=1, val_acc=0.708]
Epoch 47:  74%|███████▍  | 87/117 [00:03<00:01, 22.26it/s, loss=1.37, v_num=1, val_acc=0.708]
Epoch 47:  75%|███████▌  | 88/117 [00:03<00:01, 22.46it/s, loss=1.37, v_num=1, val_acc=0.708]
Epoch 47:  75%|███████▌  | 88/117 [00:03<00:01, 22.32it/s, loss=1.37, v_num=1, val_acc=0.708]
Epoch 47:  76%|███████▌  | 89/117 [00:03<00:01, 22.52it/s, loss=1.37, v_num=1, val_acc=0.708]
Epoch 47:  76%|███████▌  | 89/117 [00:03<00:01, 22.38it/s, loss=1.34, v_num=1, val_acc=0.708]
Epoch 47:  77%|███████▋  | 90/117 [00:03<00:01, 22.58it/s, loss=1.34, v_num=1, val_acc=0.708]
Epoch 47:  77%|███████▋  | 90/117 [00:04<00:01, 22.44it/s, loss=1.28, v_num=1, val_acc=0.708]
Epoch 47:  78%|███████▊  | 91/117 [00:04<00:01, 22.64it/s, loss=1.28, v_num=1, val_acc=0.708]
Epoch 47:  78%|███████▊  | 91/117 [00:04<00:01, 22.49it/s, loss=1.29, v_num=1, val_acc=0.708]
Epoch 47:  79%|███████▊  | 92/117 [00:04<00:01, 22.69it/s, loss=1.29, v_num=1, val_acc=0.708]
Epoch 47:  79%|███████▊  | 92/117 [00:04<00:01, 22.55it/s, loss=1.29, v_num=1, val_acc=0.708]
Epoch 47:  79%|███████▉  | 93/117 [00:04<00:01, 22.74it/s, loss=1.29, v_num=1, val_acc=0.708]
Epoch 47:  79%|███████▉  | 93/117 [00:04<00:01, 22.60it/s, loss=1.31, v_num=1, val_acc=0.708]
Epoch 47:  80%|████████  | 94/117 [00:04<00:01, 22.80it/s, loss=1.31, v_num=1, val_acc=0.708]
Epoch 47:  80%|████████  | 94/117 [00:04<00:01, 22.66it/s, loss=1.31, v_num=1, val_acc=0.708]
Epoch 47:  81%|████████  | 95/117 [00:04<00:00, 22.85it/s, loss=1.31, v_num=1, val_acc=0.708]
Epoch 47:  81%|████████  | 95/117 [00:04<00:00, 22.71it/s, loss=1.31, v_num=1, val_acc=0.708]
Epoch 47:  82%|████████▏ | 96/117 [00:04<00:00, 22.90it/s, loss=1.31, v_num=1, val_acc=0.708]
Epoch 47:  82%|████████▏ | 96/117 [00:04<00:00, 22.76it/s, loss=1.31, v_num=1, val_acc=0.708]
Epoch 47:  83%|████████▎ | 97/117 [00:04<00:00, 22.95it/s, loss=1.31, v_num=1, val_acc=0.708]
Epoch 47:  83%|████████▎ | 97/117 [00:04<00:00, 22.81it/s, loss=1.32, v_num=1, val_acc=0.708]

Validation: 0it [00:00, ?it/s]

Validation:   0%|          | 0/20 [00:00<?, ?it/s]

Validation DataLoader 0:   0%|          | 0/20 [00:00<?, ?it/s]

Validation DataLoader 0:   5%|▌         | 1/20 [00:00<00:00, 158.87it/s]
Epoch 47:  84%|████████▍ | 98/117 [00:05<00:00, 19.22it/s, loss=1.32, v_num=1, val_acc=0.708]

Validation DataLoader 0:  10%|█         | 2/20 [00:00<00:00, 55.50it/s]
Epoch 47:  85%|████████▍ | 99/117 [00:05<00:00, 19.31it/s, loss=1.32, v_num=1, val_acc=0.708]

Validation DataLoader 0:  15%|█▌        | 3/20 [00:00<00:00, 44.47it/s]
Epoch 47:  85%|████████▌ | 100/117 [00:05<00:00, 19.38it/s, loss=1.32, v_num=1, val_acc=0.708]

Validation DataLoader 0:  20%|██        | 4/20 [00:00<00:00, 39.97it/s]
Epoch 47:  86%|████████▋ | 101/117 [00:05<00:00, 19.45it/s, loss=1.32, v_num=1, val_acc=0.708]

Validation DataLoader 0:  25%|██▌       | 5/20 [00:00<00:00, 37.97it/s]
Epoch 47:  87%|████████▋ | 102/117 [00:05<00:00, 19.53it/s, loss=1.32, v_num=1, val_acc=0.708]

Validation DataLoader 0:  30%|███       | 6/20 [00:00<00:00, 36.73it/s]
Epoch 47:  88%|████████▊ | 103/117 [00:05<00:00, 19.60it/s, loss=1.32, v_num=1, val_acc=0.708]

Validation DataLoader 0:  35%|███▌      | 7/20 [00:00<00:00, 35.91it/s]
Epoch 47:  89%|████████▉ | 104/117 [00:05<00:00, 19.67it/s, loss=1.32, v_num=1, val_acc=0.708]

Validation DataLoader 0:  40%|████      | 8/20 [00:00<00:00, 35.30it/s]
Epoch 47:  90%|████████▉ | 105/117 [00:05<00:00, 19.74it/s, loss=1.32, v_num=1, val_acc=0.708]

Validation DataLoader 0:  45%|████▌     | 9/20 [00:00<00:00, 34.84it/s]
Epoch 47:  91%|█████████ | 106/117 [00:05<00:00, 19.81it/s, loss=1.32, v_num=1, val_acc=0.708]

Validation DataLoader 0:  50%|█████     | 10/20 [00:00<00:00, 34.50it/s]
Epoch 47:  91%|█████████▏| 107/117 [00:05<00:00, 19.88it/s, loss=1.32, v_num=1, val_acc=0.708]

Validation DataLoader 0:  55%|█████▌    | 11/20 [00:00<00:00, 34.22it/s]
Epoch 47:  92%|█████████▏| 108/117 [00:05<00:00, 19.95it/s, loss=1.32, v_num=1, val_acc=0.708]

Validation DataLoader 0:  60%|██████    | 12/20 [00:00<00:00, 33.91it/s]
Epoch 47:  93%|█████████▎| 109/117 [00:05<00:00, 20.01it/s, loss=1.32, v_num=1, val_acc=0.708]

Validation DataLoader 0:  65%|██████▌   | 13/20 [00:00<00:00, 33.75it/s]
Epoch 47:  94%|█████████▍| 110/117 [00:05<00:00, 20.08it/s, loss=1.32, v_num=1, val_acc=0.708]

Validation DataLoader 0:  70%|███████   | 14/20 [00:00<00:00, 33.57it/s]
Epoch 47:  95%|█████████▍| 111/117 [00:05<00:00, 20.15it/s, loss=1.32, v_num=1, val_acc=0.708]

Validation DataLoader 0:  75%|███████▌  | 15/20 [00:00<00:00, 33.43it/s]
Epoch 47:  96%|█████████▌| 112/117 [00:05<00:00, 20.21it/s, loss=1.32, v_num=1, val_acc=0.708]

Validation DataLoader 0:  80%|████████  | 16/20 [00:00<00:00, 33.27it/s]
Epoch 47:  97%|█████████▋| 113/117 [00:05<00:00, 20.28it/s, loss=1.32, v_num=1, val_acc=0.708]

Validation DataLoader 0:  85%|████████▌ | 17/20 [00:00<00:00, 33.16it/s]
Epoch 47:  97%|█████████▋| 114/117 [00:05<00:00, 20.34it/s, loss=1.32, v_num=1, val_acc=0.708]

Validation DataLoader 0:  90%|█████████ | 18/20 [00:00<00:00, 33.08it/s]
Epoch 47:  98%|█████████▊| 115/117 [00:05<00:00, 20.40it/s, loss=1.32, v_num=1, val_acc=0.708]

Validation DataLoader 0:  95%|█████████▌| 19/20 [00:00<00:00, 32.97it/s]
Epoch 47:  99%|█████████▉| 116/117 [00:05<00:00, 20.46it/s, loss=1.32, v_num=1, val_acc=0.708]

Validation DataLoader 0: 100%|██████████| 20/20 [00:00<00:00, 32.98it/s]
Epoch 47: 100%|██████████| 117/117 [00:05<00:00, 20.53it/s, loss=1.32, v_num=1, val_acc=0.708]
Epoch 47: 100%|██████████| 117/117 [00:05<00:00, 20.46it/s, loss=1.32, v_num=1, val_acc=0.700]


Epoch 47: 100%|██████████| 117/117 [00:05<00:00, 20.46it/s, loss=1.32, v_num=1, val_acc=0.700]
Epoch 47:   0%|          | 0/117 [00:00<?, ?it/s, loss=1.32, v_num=1, val_acc=0.700]
Epoch 48:   0%|          | 0/117 [00:00<?, ?it/s, loss=1.32, v_num=1, val_acc=0.700]
Epoch 48:   1%|          | 1/117 [00:00<01:42,  1.13it/s, loss=1.32, v_num=1, val_acc=0.700]
Epoch 48:   1%|          | 1/117 [00:00<01:45,  1.10it/s, loss=1.32, v_num=1, val_acc=0.700]
Epoch 48:   2%|▏         | 2/117 [00:00<00:52,  2.17it/s, loss=1.32, v_num=1, val_acc=0.700]
Epoch 48:   2%|▏         | 2/117 [00:00<00:54,  2.12it/s, loss=1.3, v_num=1, val_acc=0.700]
Epoch 48:   3%|▎         | 3/117 [00:00<00:36,  3.13it/s, loss=1.3, v_num=1, val_acc=0.700]
Epoch 48:   3%|▎         | 3/117 [00:00<00:37,  3.05it/s, loss=1.29, v_num=1, val_acc=0.700]
Epoch 48:   3%|▎         | 4/117 [00:00<00:28,  4.03it/s, loss=1.29, v_num=1, val_acc=0.700]
Epoch 48:   3%|▎         | 4/117 [00:01<00:28,  3.94it/s, loss=1.28, v_num=1, val_acc=0.700]
Epoch 48:   4%|▍         | 5/117 [00:01<00:22,  4.88it/s, loss=1.28, v_num=1, val_acc=0.700]
Epoch 48:   4%|▍         | 5/117 [00:01<00:23,  4.76it/s, loss=1.26, v_num=1, val_acc=0.700]
Epoch 48:   5%|▌         | 6/117 [00:01<00:19,  5.67it/s, loss=1.26, v_num=1, val_acc=0.700]
Epoch 48:   5%|▌         | 6/117 [00:01<00:20,  5.53it/s, loss=1.25, v_num=1, val_acc=0.700]
Epoch 48:   6%|▌         | 7/117 [00:01<00:17,  6.41it/s, loss=1.25, v_num=1, val_acc=0.700]
Epoch 48:   6%|▌         | 7/117 [00:01<00:17,  6.26it/s, loss=1.27, v_num=1, val_acc=0.700]
Epoch 48:   7%|▋         | 8/117 [00:01<00:15,  7.10it/s, loss=1.27, v_num=1, val_acc=0.700]
Epoch 48:   7%|▋         | 8/117 [00:01<00:15,  6.95it/s, loss=1.27, v_num=1, val_acc=0.700]
Epoch 48:   8%|▊         | 9/117 [00:01<00:13,  7.75it/s, loss=1.27, v_num=1, val_acc=0.700]
Epoch 48:   8%|▊         | 9/117 [00:01<00:14,  7.59it/s, loss=1.31, v_num=1, val_acc=0.700]
Epoch 48:   9%|▊         | 10/117 [00:01<00:12,  8.36it/s, loss=1.31, v_num=1, val_acc=0.700]
Epoch 48:   9%|▊         | 10/117 [00:01<00:13,  8.19it/s, loss=1.31, v_num=1, val_acc=0.700]
Epoch 48:   9%|▉         | 11/117 [00:01<00:11,  8.92it/s, loss=1.31, v_num=1, val_acc=0.700]
Epoch 48:   9%|▉         | 11/117 [00:01<00:12,  8.75it/s, loss=1.3, v_num=1, val_acc=0.700]
Epoch 48:  10%|█         | 12/117 [00:01<00:11,  9.48it/s, loss=1.3, v_num=1, val_acc=0.700]
Epoch 48:  10%|█         | 12/117 [00:01<00:11,  9.29it/s, loss=1.33, v_num=1, val_acc=0.700]
Epoch 48:  11%|█         | 13/117 [00:01<00:10, 10.01it/s, loss=1.33, v_num=1, val_acc=0.700]
Epoch 48:  11%|█         | 13/117 [00:01<00:10,  9.81it/s, loss=1.33, v_num=1, val_acc=0.700]
Epoch 48:  12%|█▏        | 14/117 [00:01<00:09, 10.49it/s, loss=1.33, v_num=1, val_acc=0.700]
Epoch 48:  12%|█▏        | 14/117 [00:01<00:10, 10.29it/s, loss=1.3, v_num=1, val_acc=0.700]
Epoch 48:  13%|█▎        | 15/117 [00:01<00:09, 10.96it/s, loss=1.3, v_num=1, val_acc=0.700]
Epoch 48:  13%|█▎        | 15/117 [00:01<00:09, 10.76it/s, loss=1.3, v_num=1, val_acc=0.700]
Epoch 48:  14%|█▎        | 16/117 [00:01<00:08, 11.41it/s, loss=1.3, v_num=1, val_acc=0.700]
Epoch 48:  14%|█▎        | 16/117 [00:01<00:09, 11.21it/s, loss=1.29, v_num=1, val_acc=0.700]
Epoch 48:  15%|█▍        | 17/117 [00:01<00:08, 11.83it/s, loss=1.29, v_num=1, val_acc=0.700]
Epoch 48:  15%|█▍        | 17/117 [00:01<00:08, 11.62it/s, loss=1.3, v_num=1, val_acc=0.700]
Epoch 48:  15%|█▌        | 18/117 [00:01<00:08, 12.23it/s, loss=1.3, v_num=1, val_acc=0.700]
Epoch 48:  15%|█▌        | 18/117 [00:01<00:08, 12.02it/s, loss=1.3, v_num=1, val_acc=0.700]
Epoch 48:  16%|█▌        | 19/117 [00:01<00:07, 12.60it/s, loss=1.3, v_num=1, val_acc=0.700]
Epoch 48:  16%|█▌        | 19/117 [00:01<00:07, 12.40it/s, loss=1.3, v_num=1, val_acc=0.700]
Epoch 48:  17%|█▋        | 20/117 [00:01<00:07, 12.97it/s, loss=1.3, v_num=1, val_acc=0.700]
Epoch 48:  17%|█▋        | 20/117 [00:01<00:07, 12.76it/s, loss=1.27, v_num=1, val_acc=0.700]
Epoch 48:  18%|█▊        | 21/117 [00:01<00:07, 13.32it/s, loss=1.27, v_num=1, val_acc=0.700]
Epoch 48:  18%|█▊        | 21/117 [00:01<00:07, 13.11it/s, loss=1.26, v_num=1, val_acc=0.700]
Epoch 48:  19%|█▉        | 22/117 [00:01<00:06, 13.66it/s, loss=1.26, v_num=1, val_acc=0.700]
Epoch 48:  19%|█▉        | 22/117 [00:01<00:07, 13.45it/s, loss=1.25, v_num=1, val_acc=0.700]
Epoch 48:  20%|█▉        | 23/117 [00:01<00:06, 13.97it/s, loss=1.25, v_num=1, val_acc=0.700]
Epoch 48:  20%|█▉        | 23/117 [00:01<00:06, 13.76it/s, loss=1.27, v_num=1, val_acc=0.700]
Epoch 48:  21%|██        | 24/117 [00:01<00:06, 14.28it/s, loss=1.27, v_num=1, val_acc=0.700]
Epoch 48:  21%|██        | 24/117 [00:01<00:06, 14.07it/s, loss=1.3, v_num=1, val_acc=0.700]
Epoch 48:  21%|██▏       | 25/117 [00:01<00:06, 14.57it/s, loss=1.3, v_num=1, val_acc=0.700]
Epoch 48:  21%|██▏       | 25/117 [00:01<00:06, 14.36it/s, loss=1.31, v_num=1, val_acc=0.700]
Epoch 48:  22%|██▏       | 26/117 [00:01<00:06, 14.85it/s, loss=1.31, v_num=1, val_acc=0.700]
Epoch 48:  22%|██▏       | 26/117 [00:01<00:06, 14.65it/s, loss=1.32, v_num=1, val_acc=0.700]
Epoch 48:  23%|██▎       | 27/117 [00:01<00:05, 15.12it/s, loss=1.32, v_num=1, val_acc=0.700]
Epoch 48:  23%|██▎       | 27/117 [00:01<00:06, 14.92it/s, loss=1.31, v_num=1, val_acc=0.700]
Epoch 48:  24%|██▍       | 28/117 [00:01<00:05, 15.39it/s, loss=1.31, v_num=1, val_acc=0.700]
Epoch 48:  24%|██▍       | 28/117 [00:01<00:05, 15.18it/s, loss=1.29, v_num=1, val_acc=0.700]
Epoch 48:  25%|██▍       | 29/117 [00:01<00:05, 15.60it/s, loss=1.29, v_num=1, val_acc=0.700]
Epoch 48:  25%|██▍       | 29/117 [00:01<00:05, 15.40it/s, loss=1.27, v_num=1, val_acc=0.700]
Epoch 48:  26%|██▌       | 30/117 [00:01<00:05, 15.85it/s, loss=1.27, v_num=1, val_acc=0.700]
Epoch 48:  26%|██▌       | 30/117 [00:01<00:05, 15.64it/s, loss=1.28, v_num=1, val_acc=0.700]
Epoch 48:  26%|██▋       | 31/117 [00:01<00:05, 16.08it/s, loss=1.28, v_num=1, val_acc=0.700]
Epoch 48:  26%|██▋       | 31/117 [00:01<00:05, 15.87it/s, loss=1.29, v_num=1, val_acc=0.700]
Epoch 48:  27%|██▋       | 32/117 [00:01<00:05, 16.31it/s, loss=1.29, v_num=1, val_acc=0.700]
Epoch 48:  27%|██▋       | 32/117 [00:01<00:05, 16.10it/s, loss=1.28, v_num=1, val_acc=0.700]
Epoch 48:  28%|██▊       | 33/117 [00:01<00:05, 16.53it/s, loss=1.28, v_num=1, val_acc=0.700]
Epoch 48:  28%|██▊       | 33/117 [00:02<00:05, 16.32it/s, loss=1.3, v_num=1, val_acc=0.700]
Epoch 48:  29%|██▉       | 34/117 [00:02<00:04, 16.74it/s, loss=1.3, v_num=1, val_acc=0.700]
Epoch 48:  29%|██▉       | 34/117 [00:02<00:05, 16.53it/s, loss=1.33, v_num=1, val_acc=0.700]
Epoch 48:  30%|██▉       | 35/117 [00:02<00:04, 16.94it/s, loss=1.33, v_num=1, val_acc=0.700]
Epoch 48:  30%|██▉       | 35/117 [00:02<00:04, 16.73it/s, loss=1.33, v_num=1, val_acc=0.700]
Epoch 48:  31%|███       | 36/117 [00:02<00:04, 17.13it/s, loss=1.33, v_num=1, val_acc=0.700]
Epoch 48:  31%|███       | 36/117 [00:02<00:04, 16.93it/s, loss=1.32, v_num=1, val_acc=0.700]
Epoch 48:  32%|███▏      | 37/117 [00:02<00:04, 17.32it/s, loss=1.32, v_num=1, val_acc=0.700]
Epoch 48:  32%|███▏      | 37/117 [00:02<00:04, 17.12it/s, loss=1.3, v_num=1, val_acc=0.700]
Epoch 48:  32%|███▏      | 38/117 [00:02<00:04, 17.50it/s, loss=1.3, v_num=1, val_acc=0.700]
Epoch 48:  32%|███▏      | 38/117 [00:02<00:04, 17.30it/s, loss=1.28, v_num=1, val_acc=0.700]
Epoch 48:  33%|███▎      | 39/117 [00:02<00:04, 17.68it/s, loss=1.28, v_num=1, val_acc=0.700]
Epoch 48:  33%|███▎      | 39/117 [00:02<00:04, 17.48it/s, loss=1.28, v_num=1, val_acc=0.700]
Epoch 48:  34%|███▍      | 40/117 [00:02<00:04, 17.86it/s, loss=1.28, v_num=1, val_acc=0.700]
Epoch 48:  34%|███▍      | 40/117 [00:02<00:04, 17.66it/s, loss=1.28, v_num=1, val_acc=0.700]
Epoch 48:  35%|███▌      | 41/117 [00:02<00:04, 18.02it/s, loss=1.28, v_num=1, val_acc=0.700]
Epoch 48:  35%|███▌      | 41/117 [00:02<00:04, 17.83it/s, loss=1.27, v_num=1, val_acc=0.700]
Epoch 48:  36%|███▌      | 42/117 [00:02<00:04, 18.19it/s, loss=1.27, v_num=1, val_acc=0.700]
Epoch 48:  36%|███▌      | 42/117 [00:02<00:04, 17.99it/s, loss=1.28, v_num=1, val_acc=0.700]
Epoch 48:  37%|███▋      | 43/117 [00:02<00:04, 18.34it/s, loss=1.28, v_num=1, val_acc=0.700]
Epoch 48:  37%|███▋      | 43/117 [00:02<00:04, 18.15it/s, loss=1.3, v_num=1, val_acc=0.700]
Epoch 48:  38%|███▊      | 44/117 [00:02<00:03, 18.49it/s, loss=1.3, v_num=1, val_acc=0.700]
Epoch 48:  38%|███▊      | 44/117 [00:02<00:03, 18.30it/s, loss=1.3, v_num=1, val_acc=0.700]
Epoch 48:  38%|███▊      | 45/117 [00:02<00:03, 18.47it/s, loss=1.3, v_num=1, val_acc=0.700]
Epoch 48:  38%|███▊      | 45/117 [00:02<00:03, 18.30it/s, loss=1.3, v_num=1, val_acc=0.700]
Epoch 48:  39%|███▉      | 46/117 [00:02<00:03, 18.63it/s, loss=1.3, v_num=1, val_acc=0.700]
Epoch 48:  39%|███▉      | 46/117 [00:02<00:03, 18.44it/s, loss=1.28, v_num=1, val_acc=0.700]
Epoch 48:  40%|████      | 47/117 [00:02<00:03, 18.77it/s, loss=1.28, v_num=1, val_acc=0.700]
Epoch 48:  40%|████      | 47/117 [00:02<00:03, 18.59it/s, loss=1.26, v_num=1, val_acc=0.700]
Epoch 48:  41%|████      | 48/117 [00:02<00:03, 18.91it/s, loss=1.26, v_num=1, val_acc=0.700]
Epoch 48:  41%|████      | 48/117 [00:02<00:03, 18.73it/s, loss=1.27, v_num=1, val_acc=0.700]
Epoch 48:  42%|████▏     | 49/117 [00:02<00:03, 19.05it/s, loss=1.27, v_num=1, val_acc=0.700]
Epoch 48:  42%|████▏     | 49/117 [00:02<00:03, 18.86it/s, loss=1.26, v_num=1, val_acc=0.700]
Epoch 48:  43%|████▎     | 50/117 [00:02<00:03, 19.15it/s, loss=1.26, v_num=1, val_acc=0.700]
Epoch 48:  43%|████▎     | 50/117 [00:02<00:03, 18.98it/s, loss=1.24, v_num=1, val_acc=0.700]
Epoch 48:  44%|████▎     | 51/117 [00:02<00:03, 19.29it/s, loss=1.24, v_num=1, val_acc=0.700]
Epoch 48:  44%|████▎     | 51/117 [00:02<00:03, 19.11it/s, loss=1.22, v_num=1, val_acc=0.700]
Epoch 48:  44%|████▍     | 52/117 [00:02<00:03, 19.42it/s, loss=1.22, v_num=1, val_acc=0.700]
Epoch 48:  44%|████▍     | 52/117 [00:02<00:03, 19.23it/s, loss=1.2, v_num=1, val_acc=0.700]
Epoch 48:  45%|████▌     | 53/117 [00:02<00:03, 19.54it/s, loss=1.2, v_num=1, val_acc=0.700]
Epoch 48:  45%|████▌     | 53/117 [00:02<00:03, 19.36it/s, loss=1.17, v_num=1, val_acc=0.700]
Epoch 48:  46%|████▌     | 54/117 [00:02<00:03, 19.65it/s, loss=1.17, v_num=1, val_acc=0.700]
Epoch 48:  46%|████▌     | 54/117 [00:02<00:03, 19.47it/s, loss=1.14, v_num=1, val_acc=0.700]
Epoch 48:  47%|████▋     | 55/117 [00:02<00:03, 19.77it/s, loss=1.14, v_num=1, val_acc=0.700]
Epoch 48:  47%|████▋     | 55/117 [00:02<00:03, 19.59it/s, loss=1.13, v_num=1, val_acc=0.700]
Epoch 48:  48%|████▊     | 56/117 [00:02<00:03, 19.88it/s, loss=1.13, v_num=1, val_acc=0.700]
Epoch 48:  48%|████▊     | 56/117 [00:02<00:03, 19.70it/s, loss=1.12, v_num=1, val_acc=0.700]
Epoch 48:  49%|████▊     | 57/117 [00:02<00:03, 19.99it/s, loss=1.12, v_num=1, val_acc=0.700]
Epoch 48:  49%|████▊     | 57/117 [00:02<00:03, 19.82it/s, loss=1.14, v_num=1, val_acc=0.700]
Epoch 48:  50%|████▉     | 58/117 [00:02<00:02, 20.10it/s, loss=1.14, v_num=1, val_acc=0.700]
Epoch 48:  50%|████▉     | 58/117 [00:02<00:02, 19.92it/s, loss=1.15, v_num=1, val_acc=0.700]
Epoch 48:  50%|█████     | 59/117 [00:02<00:02, 20.20it/s, loss=1.15, v_num=1, val_acc=0.700]
Epoch 48:  50%|█████     | 59/117 [00:02<00:02, 20.03it/s, loss=1.15, v_num=1, val_acc=0.700]
Epoch 48:  51%|█████▏    | 60/117 [00:02<00:02, 20.31it/s, loss=1.15, v_num=1, val_acc=0.700]
Epoch 48:  51%|█████▏    | 60/117 [00:02<00:02, 20.13it/s, loss=1.16, v_num=1, val_acc=0.700]
Epoch 48:  52%|█████▏    | 61/117 [00:02<00:02, 20.41it/s, loss=1.16, v_num=1, val_acc=0.700]
Epoch 48:  52%|█████▏    | 61/117 [00:03<00:02, 20.23it/s, loss=1.17, v_num=1, val_acc=0.700]
Epoch 48:  53%|█████▎    | 62/117 [00:03<00:02, 20.50it/s, loss=1.17, v_num=1, val_acc=0.700]
Epoch 48:  53%|█████▎    | 62/117 [00:03<00:02, 20.33it/s, loss=1.17, v_num=1, val_acc=0.700]
Epoch 48:  54%|█████▍    | 63/117 [00:03<00:02, 20.60it/s, loss=1.17, v_num=1, val_acc=0.700]
Epoch 48:  54%|█████▍    | 63/117 [00:03<00:02, 20.43it/s, loss=1.13, v_num=1, val_acc=0.700]
Epoch 48:  55%|█████▍    | 64/117 [00:03<00:02, 20.69it/s, loss=1.13, v_num=1, val_acc=0.700]
Epoch 48:  55%|█████▍    | 64/117 [00:03<00:02, 20.53it/s, loss=1.11, v_num=1, val_acc=0.700]
Epoch 48:  56%|█████▌    | 65/117 [00:03<00:02, 20.78it/s, loss=1.11, v_num=1, val_acc=0.700]
Epoch 48:  56%|█████▌    | 65/117 [00:03<00:02, 20.62it/s, loss=1.11, v_num=1, val_acc=0.700]
Epoch 48:  56%|█████▋    | 66/117 [00:03<00:02, 20.87it/s, loss=1.11, v_num=1, val_acc=0.700]
Epoch 48:  56%|█████▋    | 66/117 [00:03<00:02, 20.71it/s, loss=1.12, v_num=1, val_acc=0.700]
Epoch 48:  57%|█████▋    | 67/117 [00:03<00:02, 20.96it/s, loss=1.12, v_num=1, val_acc=0.700]
Epoch 48:  57%|█████▋    | 67/117 [00:03<00:02, 20.80it/s, loss=1.12, v_num=1, val_acc=0.700]
Epoch 48:  58%|█████▊    | 68/117 [00:03<00:02, 21.05it/s, loss=1.12, v_num=1, val_acc=0.700]
Epoch 48:  58%|█████▊    | 68/117 [00:03<00:02, 20.88it/s, loss=1.14, v_num=1, val_acc=0.700]
Epoch 48:  59%|█████▉    | 69/117 [00:03<00:02, 21.13it/s, loss=1.14, v_num=1, val_acc=0.700]
Epoch 48:  59%|█████▉    | 69/117 [00:03<00:02, 20.97it/s, loss=1.16, v_num=1, val_acc=0.700]
Epoch 48:  60%|█████▉    | 70/117 [00:03<00:02, 21.21it/s, loss=1.16, v_num=1, val_acc=0.700]
Epoch 48:  60%|█████▉    | 70/117 [00:03<00:02, 21.05it/s, loss=1.15, v_num=1, val_acc=0.700]
Epoch 48:  61%|██████    | 71/117 [00:03<00:02, 21.29it/s, loss=1.15, v_num=1, val_acc=0.700]
Epoch 48:  61%|██████    | 71/117 [00:03<00:02, 21.13it/s, loss=1.16, v_num=1, val_acc=0.700]
Epoch 48:  62%|██████▏   | 72/117 [00:03<00:02, 21.37it/s, loss=1.16, v_num=1, val_acc=0.700]
Epoch 48:  62%|██████▏   | 72/117 [00:03<00:02, 21.21it/s, loss=1.17, v_num=1, val_acc=0.700]
Epoch 48:  62%|██████▏   | 73/117 [00:03<00:02, 21.45it/s, loss=1.17, v_num=1, val_acc=0.700]
Epoch 48:  62%|██████▏   | 73/117 [00:03<00:02, 21.29it/s, loss=1.19, v_num=1, val_acc=0.700]
Epoch 48:  63%|██████▎   | 74/117 [00:03<00:01, 21.52it/s, loss=1.19, v_num=1, val_acc=0.700]
Epoch 48:  63%|██████▎   | 74/117 [00:03<00:02, 21.36it/s, loss=1.2, v_num=1, val_acc=0.700]
Epoch 48:  64%|██████▍   | 75/117 [00:03<00:01, 21.59it/s, loss=1.2, v_num=1, val_acc=0.700]
Epoch 48:  64%|██████▍   | 75/117 [00:03<00:01, 21.44it/s, loss=1.23, v_num=1, val_acc=0.700]
Epoch 48:  65%|██████▍   | 76/117 [00:03<00:01, 21.66it/s, loss=1.23, v_num=1, val_acc=0.700]
Epoch 48:  65%|██████▍   | 76/117 [00:03<00:01, 21.50it/s, loss=1.25, v_num=1, val_acc=0.700]
Epoch 48:  66%|██████▌   | 77/117 [00:03<00:01, 21.73it/s, loss=1.25, v_num=1, val_acc=0.700]
Epoch 48:  66%|██████▌   | 77/117 [00:03<00:01, 21.57it/s, loss=1.24, v_num=1, val_acc=0.700]
Epoch 48:  67%|██████▋   | 78/117 [00:03<00:01, 21.80it/s, loss=1.24, v_num=1, val_acc=0.700]
Epoch 48:  67%|██████▋   | 78/117 [00:03<00:01, 21.65it/s, loss=1.23, v_num=1, val_acc=0.700]
Epoch 48:  68%|██████▊   | 79/117 [00:03<00:01, 21.87it/s, loss=1.23, v_num=1, val_acc=0.700]
Epoch 48:  68%|██████▊   | 79/117 [00:03<00:01, 21.71it/s, loss=1.22, v_num=1, val_acc=0.700]
Epoch 48:  68%|██████▊   | 80/117 [00:03<00:01, 21.93it/s, loss=1.22, v_num=1, val_acc=0.700]
Epoch 48:  68%|██████▊   | 80/117 [00:03<00:01, 21.78it/s, loss=1.22, v_num=1, val_acc=0.700]
Epoch 48:  69%|██████▉   | 81/117 [00:03<00:01, 21.99it/s, loss=1.22, v_num=1, val_acc=0.700]
Epoch 48:  69%|██████▉   | 81/117 [00:03<00:01, 21.85it/s, loss=1.22, v_num=1, val_acc=0.700]
Epoch 48:  70%|███████   | 82/117 [00:03<00:01, 22.05it/s, loss=1.22, v_num=1, val_acc=0.700]
Epoch 48:  70%|███████   | 82/117 [00:03<00:01, 21.90it/s, loss=1.22, v_num=1, val_acc=0.700]
Epoch 48:  71%|███████   | 83/117 [00:03<00:01, 22.10it/s, loss=1.22, v_num=1, val_acc=0.700]
Epoch 48:  71%|███████   | 83/117 [00:03<00:01, 21.96it/s, loss=1.22, v_num=1, val_acc=0.700]
Epoch 48:  72%|███████▏  | 84/117 [00:03<00:01, 22.17it/s, loss=1.22, v_num=1, val_acc=0.700]
Epoch 48:  72%|███████▏  | 84/117 [00:03<00:01, 22.02it/s, loss=1.2, v_num=1, val_acc=0.700]
Epoch 48:  73%|███████▎  | 85/117 [00:03<00:01, 22.23it/s, loss=1.2, v_num=1, val_acc=0.700]
Epoch 48:  73%|███████▎  | 85/117 [00:03<00:01, 22.09it/s, loss=1.19, v_num=1, val_acc=0.700]
Epoch 48:  74%|███████▎  | 86/117 [00:03<00:01, 22.29it/s, loss=1.19, v_num=1, val_acc=0.700]
Epoch 48:  74%|███████▎  | 86/117 [00:03<00:01, 22.15it/s, loss=1.19, v_num=1, val_acc=0.700]
Epoch 48:  74%|███████▍  | 87/117 [00:03<00:01, 22.35it/s, loss=1.19, v_num=1, val_acc=0.700]
Epoch 48:  74%|███████▍  | 87/117 [00:03<00:01, 22.21it/s, loss=1.16, v_num=1, val_acc=0.700]
Epoch 48:  75%|███████▌  | 88/117 [00:03<00:01, 22.41it/s, loss=1.16, v_num=1, val_acc=0.700]
Epoch 48:  75%|███████▌  | 88/117 [00:03<00:01, 22.27it/s, loss=1.13, v_num=1, val_acc=0.700]
Epoch 48:  76%|███████▌  | 89/117 [00:03<00:01, 22.47it/s, loss=1.13, v_num=1, val_acc=0.700]
Epoch 48:  76%|███████▌  | 89/117 [00:03<00:01, 22.33it/s, loss=1.09, v_num=1, val_acc=0.700]
Epoch 48:  77%|███████▋  | 90/117 [00:03<00:01, 22.53it/s, loss=1.09, v_num=1, val_acc=0.700]
Epoch 48:  77%|███████▋  | 90/117 [00:04<00:01, 22.39it/s, loss=1.09, v_num=1, val_acc=0.700]
Epoch 48:  78%|███████▊  | 91/117 [00:04<00:01, 22.58it/s, loss=1.09, v_num=1, val_acc=0.700]
Epoch 48:  78%|███████▊  | 91/117 [00:04<00:01, 22.44it/s, loss=1.08, v_num=1, val_acc=0.700]
Epoch 48:  79%|███████▊  | 92/117 [00:04<00:01, 22.64it/s, loss=1.08, v_num=1, val_acc=0.700]
Epoch 48:  79%|███████▊  | 92/117 [00:04<00:01, 22.50it/s, loss=1.07, v_num=1, val_acc=0.700]
Epoch 48:  79%|███████▉  | 93/117 [00:04<00:01, 22.70it/s, loss=1.07, v_num=1, val_acc=0.700]
Epoch 48:  79%|███████▉  | 93/117 [00:04<00:01, 22.55it/s, loss=1.1, v_num=1, val_acc=0.700]
Epoch 48:  80%|████████  | 94/117 [00:04<00:01, 22.75it/s, loss=1.1, v_num=1, val_acc=0.700]
Epoch 48:  80%|████████  | 94/117 [00:04<00:01, 22.61it/s, loss=1.13, v_num=1, val_acc=0.700]
Epoch 48:  81%|████████  | 95/117 [00:04<00:00, 22.80it/s, loss=1.13, v_num=1, val_acc=0.700]
Epoch 48:  81%|████████  | 95/117 [00:04<00:00, 22.66it/s, loss=1.12, v_num=1, val_acc=0.700]
Epoch 48:  82%|████████▏ | 96/117 [00:04<00:00, 22.85it/s, loss=1.12, v_num=1, val_acc=0.700]
Epoch 48:  82%|████████▏ | 96/117 [00:04<00:00, 22.71it/s, loss=1.11, v_num=1, val_acc=0.700]
Epoch 48:  83%|████████▎ | 97/117 [00:04<00:00, 22.90it/s, loss=1.11, v_num=1, val_acc=0.700]
Epoch 48:  83%|████████▎ | 97/117 [00:04<00:00, 22.76it/s, loss=1.09, v_num=1, val_acc=0.700]

Validation: 0it [00:00, ?it/s]

Validation:   0%|          | 0/20 [00:00<?, ?it/s]

Validation DataLoader 0:   0%|          | 0/20 [00:00<?, ?it/s]

Validation DataLoader 0:   5%|▌         | 1/20 [00:00<00:00, 183.61it/s]
Epoch 48:  84%|████████▍ | 98/117 [00:05<00:00, 19.16it/s, loss=1.09, v_num=1, val_acc=0.700]

Validation DataLoader 0:  10%|█         | 2/20 [00:00<00:00, 55.90it/s]
Epoch 48:  85%|████████▍ | 99/117 [00:05<00:00, 19.24it/s, loss=1.09, v_num=1, val_acc=0.700]

Validation DataLoader 0:  15%|█▌        | 3/20 [00:00<00:00, 44.63it/s]
Epoch 48:  85%|████████▌ | 100/117 [00:05<00:00, 19.32it/s, loss=1.09, v_num=1, val_acc=0.700]

Validation DataLoader 0:  20%|██        | 4/20 [00:00<00:00, 40.40it/s]
Epoch 48:  86%|████████▋ | 101/117 [00:05<00:00, 19.39it/s, loss=1.09, v_num=1, val_acc=0.700]

Validation DataLoader 0:  25%|██▌       | 5/20 [00:00<00:00, 38.26it/s]
Epoch 48:  87%|████████▋ | 102/117 [00:05<00:00, 19.47it/s, loss=1.09, v_num=1, val_acc=0.700]

Validation DataLoader 0:  30%|███       | 6/20 [00:00<00:00, 36.93it/s]
Epoch 48:  88%|████████▊ | 103/117 [00:05<00:00, 19.54it/s, loss=1.09, v_num=1, val_acc=0.700]

Validation DataLoader 0:  35%|███▌      | 7/20 [00:00<00:00, 36.08it/s]
Epoch 48:  89%|████████▉ | 104/117 [00:05<00:00, 19.61it/s, loss=1.09, v_num=1, val_acc=0.700]

Validation DataLoader 0:  40%|████      | 8/20 [00:00<00:00, 35.42it/s]
Epoch 48:  90%|████████▉ | 105/117 [00:05<00:00, 19.68it/s, loss=1.09, v_num=1, val_acc=0.700]

Validation DataLoader 0:  45%|████▌     | 9/20 [00:00<00:00, 34.91it/s]
Epoch 48:  91%|█████████ | 106/117 [00:05<00:00, 19.75it/s, loss=1.09, v_num=1, val_acc=0.700]

Validation DataLoader 0:  50%|█████     | 10/20 [00:00<00:00, 34.59it/s]
Epoch 48:  91%|█████████▏| 107/117 [00:05<00:00, 19.82it/s, loss=1.09, v_num=1, val_acc=0.700]

Validation DataLoader 0:  55%|█████▌    | 11/20 [00:00<00:00, 34.29it/s]
Epoch 48:  92%|█████████▏| 108/117 [00:05<00:00, 19.89it/s, loss=1.09, v_num=1, val_acc=0.700]

Validation DataLoader 0:  60%|██████    | 12/20 [00:00<00:00, 34.03it/s]
Epoch 48:  93%|█████████▎| 109/117 [00:05<00:00, 19.96it/s, loss=1.09, v_num=1, val_acc=0.700]

Validation DataLoader 0:  65%|██████▌   | 13/20 [00:00<00:00, 33.84it/s]
Epoch 48:  94%|█████████▍| 110/117 [00:05<00:00, 20.03it/s, loss=1.09, v_num=1, val_acc=0.700]

Validation DataLoader 0:  70%|███████   | 14/20 [00:00<00:00, 33.68it/s]
Epoch 48:  95%|█████████▍| 111/117 [00:05<00:00, 20.09it/s, loss=1.09, v_num=1, val_acc=0.700]

Validation DataLoader 0:  75%|███████▌  | 15/20 [00:00<00:00, 33.52it/s]
Epoch 48:  96%|█████████▌| 112/117 [00:05<00:00, 20.16it/s, loss=1.09, v_num=1, val_acc=0.700]

Validation DataLoader 0:  80%|████████  | 16/20 [00:00<00:00, 33.30it/s]
Epoch 48:  97%|█████████▋| 113/117 [00:05<00:00, 20.22it/s, loss=1.09, v_num=1, val_acc=0.700]

Validation DataLoader 0:  85%|████████▌ | 17/20 [00:00<00:00, 33.20it/s]
Epoch 48:  97%|█████████▋| 114/117 [00:05<00:00, 20.28it/s, loss=1.09, v_num=1, val_acc=0.700]

Validation DataLoader 0:  90%|█████████ | 18/20 [00:00<00:00, 33.11it/s]
Epoch 48:  98%|█████████▊| 115/117 [00:05<00:00, 20.35it/s, loss=1.09, v_num=1, val_acc=0.700]

Validation DataLoader 0:  95%|█████████▌| 19/20 [00:00<00:00, 33.03it/s]
Epoch 48:  99%|█████████▉| 116/117 [00:05<00:00, 20.41it/s, loss=1.09, v_num=1, val_acc=0.700]

Validation DataLoader 0: 100%|██████████| 20/20 [00:00<00:00, 33.02it/s]
Epoch 48: 100%|██████████| 117/117 [00:05<00:00, 20.47it/s, loss=1.09, v_num=1, val_acc=0.700]
Epoch 48: 100%|██████████| 117/117 [00:05<00:00, 20.40it/s, loss=1.09, v_num=1, val_acc=0.739]


Epoch 48: 100%|██████████| 117/117 [00:05<00:00, 20.40it/s, loss=1.09, v_num=1, val_acc=0.739]
Epoch 48:   0%|          | 0/117 [00:00<?, ?it/s, loss=1.09, v_num=1, val_acc=0.739]
Epoch 49:   0%|          | 0/117 [00:00<?, ?it/s, loss=1.09, v_num=1, val_acc=0.739]
Epoch 49:   1%|          | 1/117 [00:00<01:46,  1.09it/s, loss=1.09, v_num=1, val_acc=0.739]
Epoch 49:   1%|          | 1/117 [00:00<01:49,  1.06it/s, loss=1.1, v_num=1, val_acc=0.739]
Epoch 49:   2%|▏         | 2/117 [00:00<00:54,  2.10it/s, loss=1.1, v_num=1, val_acc=0.739]
Epoch 49:   2%|▏         | 2/117 [00:00<00:56,  2.05it/s, loss=1.11, v_num=1, val_acc=0.739]
Epoch 49:   3%|▎         | 3/117 [00:00<00:37,  3.03it/s, loss=1.11, v_num=1, val_acc=0.739]
Epoch 49:   3%|▎         | 3/117 [00:01<00:38,  2.95it/s, loss=1.09, v_num=1, val_acc=0.739]
Epoch 49:   3%|▎         | 4/117 [00:01<00:28,  3.91it/s, loss=1.09, v_num=1, val_acc=0.739]
Epoch 49:   3%|▎         | 4/117 [00:01<00:29,  3.81it/s, loss=1.07, v_num=1, val_acc=0.739]
Epoch 49:   4%|▍         | 5/117 [00:01<00:23,  4.73it/s, loss=1.07, v_num=1, val_acc=0.739]
Epoch 49:   4%|▍         | 5/117 [00:01<00:24,  4.62it/s, loss=1.05, v_num=1, val_acc=0.739]
Epoch 49:   5%|▌         | 6/117 [00:01<00:20,  5.50it/s, loss=1.05, v_num=1, val_acc=0.739]
Epoch 49:   5%|▌         | 6/117 [00:01<00:20,  5.37it/s, loss=1.05, v_num=1, val_acc=0.739]
Epoch 49:   6%|▌         | 7/117 [00:01<00:17,  6.22it/s, loss=1.05, v_num=1, val_acc=0.739]
Epoch 49:   6%|▌         | 7/117 [00:01<00:18,  6.08it/s, loss=1.07, v_num=1, val_acc=0.739]
Epoch 49:   7%|▋         | 8/117 [00:01<00:15,  6.90it/s, loss=1.07, v_num=1, val_acc=0.739]
Epoch 49:   7%|▋         | 8/117 [00:01<00:16,  6.75it/s, loss=1.1, v_num=1, val_acc=0.739]
Epoch 49:   8%|▊         | 9/117 [00:01<00:14,  7.54it/s, loss=1.1, v_num=1, val_acc=0.739]
Epoch 49:   8%|▊         | 9/117 [00:01<00:14,  7.38it/s, loss=1.11, v_num=1, val_acc=0.739]
Epoch 49:   9%|▊         | 10/117 [00:01<00:13,  8.14it/s, loss=1.11, v_num=1, val_acc=0.739]
Epoch 49:   9%|▊         | 10/117 [00:01<00:13,  7.97it/s, loss=1.12, v_num=1, val_acc=0.739]
Epoch 49:   9%|▉         | 11/117 [00:01<00:12,  8.68it/s, loss=1.12, v_num=1, val_acc=0.739]
Epoch 49:   9%|▉         | 11/117 [00:01<00:12,  8.51it/s, loss=1.12, v_num=1, val_acc=0.739]
Epoch 49:  10%|█         | 12/117 [00:01<00:11,  9.23it/s, loss=1.12, v_num=1, val_acc=0.739]
Epoch 49:  10%|█         | 12/117 [00:01<00:11,  9.05it/s, loss=1.12, v_num=1, val_acc=0.739]
Epoch 49:  11%|█         | 13/117 [00:01<00:10,  9.75it/s, loss=1.12, v_num=1, val_acc=0.739]
Epoch 49:  11%|█         | 13/117 [00:01<00:10,  9.56it/s, loss=1.12, v_num=1, val_acc=0.739]
Epoch 49:  12%|█▏        | 14/117 [00:01<00:10, 10.24it/s, loss=1.12, v_num=1, val_acc=0.739]
Epoch 49:  12%|█▏        | 14/117 [00:01<00:10, 10.05it/s, loss=1.13, v_num=1, val_acc=0.739]
Epoch 49:  13%|█▎        | 15/117 [00:01<00:09, 10.70it/s, loss=1.13, v_num=1, val_acc=0.739]
Epoch 49:  13%|█▎        | 15/117 [00:01<00:09, 10.51it/s, loss=1.16, v_num=1, val_acc=0.739]
Epoch 49:  14%|█▎        | 16/117 [00:01<00:09, 11.15it/s, loss=1.16, v_num=1, val_acc=0.739]
Epoch 49:  14%|█▎        | 16/117 [00:01<00:09, 10.95it/s, loss=1.13, v_num=1, val_acc=0.739]
Epoch 49:  15%|█▍        | 17/117 [00:01<00:08, 11.57it/s, loss=1.13, v_num=1, val_acc=0.739]
Epoch 49:  15%|█▍        | 17/117 [00:01<00:08, 11.37it/s, loss=1.1, v_num=1, val_acc=0.739]
Epoch 49:  15%|█▌        | 18/117 [00:01<00:08, 11.96it/s, loss=1.1, v_num=1, val_acc=0.739]
Epoch 49:  15%|█▌        | 18/117 [00:01<00:08, 11.77it/s, loss=1.11, v_num=1, val_acc=0.739]
Epoch 49:  16%|█▌        | 19/117 [00:01<00:07, 12.33it/s, loss=1.11, v_num=1, val_acc=0.739]
Epoch 49:  16%|█▌        | 19/117 [00:01<00:08, 12.13it/s, loss=1.1, v_num=1, val_acc=0.739]
Epoch 49:  17%|█▋        | 20/117 [00:01<00:07, 12.70it/s, loss=1.1, v_num=1, val_acc=0.739]
Epoch 49:  17%|█▋        | 20/117 [00:01<00:07, 12.50it/s, loss=1.11, v_num=1, val_acc=0.739]
Epoch 49:  18%|█▊        | 21/117 [00:01<00:07, 13.06it/s, loss=1.11, v_num=1, val_acc=0.739]
Epoch 49:  18%|█▊        | 21/117 [00:01<00:07, 12.86it/s, loss=1.12, v_num=1, val_acc=0.739]
Epoch 49:  19%|█▉        | 22/117 [00:01<00:07, 13.40it/s, loss=1.12, v_num=1, val_acc=0.739]
Epoch 49:  19%|█▉        | 22/117 [00:01<00:07, 13.20it/s, loss=1.14, v_num=1, val_acc=0.739]
Epoch 49:  20%|█▉        | 23/117 [00:01<00:06, 13.72it/s, loss=1.14, v_num=1, val_acc=0.739]
Epoch 49:  20%|█▉        | 23/117 [00:01<00:06, 13.52it/s, loss=1.15, v_num=1, val_acc=0.739]
Epoch 49:  21%|██        | 24/117 [00:01<00:06, 14.03it/s, loss=1.15, v_num=1, val_acc=0.739]
Epoch 49:  21%|██        | 24/117 [00:01<00:06, 13.82it/s, loss=1.16, v_num=1, val_acc=0.739]
Epoch 49:  21%|██▏       | 25/117 [00:01<00:06, 14.32it/s, loss=1.16, v_num=1, val_acc=0.739]
Epoch 49:  21%|██▏       | 25/117 [00:01<00:06, 14.12it/s, loss=1.16, v_num=1, val_acc=0.739]
Epoch 49:  22%|██▏       | 26/117 [00:01<00:06, 14.61it/s, loss=1.16, v_num=1, val_acc=0.739]
Epoch 49:  22%|██▏       | 26/117 [00:01<00:06, 14.40it/s, loss=1.17, v_num=1, val_acc=0.739]
Epoch 49:  23%|██▎       | 27/117 [00:01<00:06, 14.87it/s, loss=1.17, v_num=1, val_acc=0.739]
Epoch 49:  23%|██▎       | 27/117 [00:01<00:06, 14.67it/s, loss=1.17, v_num=1, val_acc=0.739]
Epoch 49:  24%|██▍       | 28/117 [00:01<00:05, 15.14it/s, loss=1.17, v_num=1, val_acc=0.739]
Epoch 49:  24%|██▍       | 28/117 [00:01<00:05, 14.93it/s, loss=1.15, v_num=1, val_acc=0.739]
Epoch 49:  25%|██▍       | 29/117 [00:01<00:05, 15.40it/s, loss=1.15, v_num=1, val_acc=0.739]
Epoch 49:  25%|██▍       | 29/117 [00:01<00:05, 15.20it/s, loss=1.14, v_num=1, val_acc=0.739]
Epoch 49:  26%|██▌       | 30/117 [00:01<00:05, 15.64it/s, loss=1.14, v_num=1, val_acc=0.739]
Epoch 49:  26%|██▌       | 30/117 [00:01<00:05, 15.44it/s, loss=1.13, v_num=1, val_acc=0.739]
Epoch 49:  26%|██▋       | 31/117 [00:01<00:05, 15.88it/s, loss=1.13, v_num=1, val_acc=0.739]
Epoch 49:  26%|██▋       | 31/117 [00:01<00:05, 15.68it/s, loss=1.14, v_num=1, val_acc=0.739]
Epoch 49:  27%|██▋       | 32/117 [00:01<00:05, 16.11it/s, loss=1.14, v_num=1, val_acc=0.739]
Epoch 49:  27%|██▋       | 32/117 [00:02<00:05, 15.90it/s, loss=1.14, v_num=1, val_acc=0.739]
Epoch 49:  28%|██▊       | 33/117 [00:02<00:05, 16.33it/s, loss=1.14, v_num=1, val_acc=0.739]
Epoch 49:  28%|██▊       | 33/117 [00:02<00:05, 16.13it/s, loss=1.13, v_num=1, val_acc=0.739]
Epoch 49:  29%|██▉       | 34/117 [00:02<00:05, 16.53it/s, loss=1.13, v_num=1, val_acc=0.739]
Epoch 49:  29%|██▉       | 34/117 [00:02<00:05, 16.33it/s, loss=1.11, v_num=1, val_acc=0.739]
Epoch 49:  30%|██▉       | 35/117 [00:02<00:04, 16.73it/s, loss=1.11, v_num=1, val_acc=0.739]
Epoch 49:  30%|██▉       | 35/117 [00:02<00:04, 16.53it/s, loss=1.09, v_num=1, val_acc=0.739]
Epoch 49:  31%|███       | 36/117 [00:02<00:04, 16.94it/s, loss=1.09, v_num=1, val_acc=0.739]
Epoch 49:  31%|███       | 36/117 [00:02<00:04, 16.74it/s, loss=1.09, v_num=1, val_acc=0.739]
Epoch 49:  32%|███▏      | 37/117 [00:02<00:04, 17.13it/s, loss=1.09, v_num=1, val_acc=0.739]
Epoch 49:  32%|███▏      | 37/117 [00:02<00:04, 16.93it/s, loss=1.11, v_num=1, val_acc=0.739]
Epoch 49:  32%|███▏      | 38/117 [00:02<00:04, 17.31it/s, loss=1.11, v_num=1, val_acc=0.739]
Epoch 49:  32%|███▏      | 38/117 [00:02<00:04, 17.12it/s, loss=1.13, v_num=1, val_acc=0.739]
Epoch 49:  33%|███▎      | 39/117 [00:02<00:04, 17.49it/s, loss=1.13, v_num=1, val_acc=0.739]
Epoch 49:  33%|███▎      | 39/117 [00:02<00:04, 17.30it/s, loss=1.15, v_num=1, val_acc=0.739]
Epoch 49:  34%|███▍      | 40/117 [00:02<00:04, 17.67it/s, loss=1.15, v_num=1, val_acc=0.739]
Epoch 49:  34%|███▍      | 40/117 [00:02<00:04, 17.47it/s, loss=1.17, v_num=1, val_acc=0.739]
Epoch 49:  35%|███▌      | 41/117 [00:02<00:04, 17.84it/s, loss=1.17, v_num=1, val_acc=0.739]
Epoch 49:  35%|███▌      | 41/117 [00:02<00:04, 17.65it/s, loss=1.18, v_num=1, val_acc=0.739]
Epoch 49:  36%|███▌      | 42/117 [00:02<00:04, 18.00it/s, loss=1.18, v_num=1, val_acc=0.739]
Epoch 49:  36%|███▌      | 42/117 [00:02<00:04, 17.81it/s, loss=1.16, v_num=1, val_acc=0.739]
Epoch 49:  37%|███▋      | 43/117 [00:02<00:04, 18.16it/s, loss=1.16, v_num=1, val_acc=0.739]
Epoch 49:  37%|███▋      | 43/117 [00:02<00:04, 17.97it/s, loss=1.18, v_num=1, val_acc=0.739]
Epoch 49:  38%|███▊      | 44/117 [00:02<00:03, 18.32it/s, loss=1.18, v_num=1, val_acc=0.739]
Epoch 49:  38%|███▊      | 44/117 [00:02<00:04, 18.13it/s, loss=1.21, v_num=1, val_acc=0.739]
Epoch 49:  38%|███▊      | 45/117 [00:02<00:03, 18.47it/s, loss=1.21, v_num=1, val_acc=0.739]
Epoch 49:  38%|███▊      | 45/117 [00:02<00:03, 18.28it/s, loss=1.21, v_num=1, val_acc=0.739]
Epoch 49:  39%|███▉      | 46/117 [00:02<00:03, 18.62it/s, loss=1.21, v_num=1, val_acc=0.739]
Epoch 49:  39%|███▉      | 46/117 [00:02<00:03, 18.43it/s, loss=1.2, v_num=1, val_acc=0.739]
Epoch 49:  40%|████      | 47/117 [00:02<00:03, 18.76it/s, loss=1.2, v_num=1, val_acc=0.739]
Epoch 49:  40%|████      | 47/117 [00:02<00:03, 18.57it/s, loss=1.18, v_num=1, val_acc=0.739]
Epoch 49:  41%|████      | 48/117 [00:02<00:03, 18.89it/s, loss=1.18, v_num=1, val_acc=0.739]
Epoch 49:  41%|████      | 48/117 [00:02<00:03, 18.70it/s, loss=1.19, v_num=1, val_acc=0.739]
Epoch 49:  42%|████▏     | 49/117 [00:02<00:03, 19.02it/s, loss=1.19, v_num=1, val_acc=0.739]
Epoch 49:  42%|████▏     | 49/117 [00:02<00:03, 18.84it/s, loss=1.22, v_num=1, val_acc=0.739]
Epoch 49:  43%|████▎     | 50/117 [00:02<00:03, 19.16it/s, loss=1.22, v_num=1, val_acc=0.739]
Epoch 49:  43%|████▎     | 50/117 [00:02<00:03, 18.97it/s, loss=1.28, v_num=1, val_acc=0.739]
Epoch 49:  44%|████▎     | 51/117 [00:02<00:03, 19.28it/s, loss=1.28, v_num=1, val_acc=0.739]
Epoch 49:  44%|████▎     | 51/117 [00:02<00:03, 19.10it/s, loss=1.28, v_num=1, val_acc=0.739]
Epoch 49:  44%|████▍     | 52/117 [00:02<00:03, 19.41it/s, loss=1.28, v_num=1, val_acc=0.739]
Epoch 49:  44%|████▍     | 52/117 [00:02<00:03, 19.23it/s, loss=1.29, v_num=1, val_acc=0.739]
Epoch 49:  45%|████▌     | 53/117 [00:02<00:03, 19.53it/s, loss=1.29, v_num=1, val_acc=0.739]
Epoch 49:  45%|████▌     | 53/117 [00:02<00:03, 19.35it/s, loss=1.28, v_num=1, val_acc=0.739]
Epoch 49:  46%|████▌     | 54/117 [00:02<00:03, 19.65it/s, loss=1.28, v_num=1, val_acc=0.739]
Epoch 49:  46%|████▌     | 54/117 [00:02<00:03, 19.47it/s, loss=1.28, v_num=1, val_acc=0.739]
Epoch 49:  47%|████▋     | 55/117 [00:02<00:03, 19.76it/s, loss=1.28, v_num=1, val_acc=0.739]
Epoch 49:  47%|████▋     | 55/117 [00:02<00:03, 19.59it/s, loss=1.3, v_num=1, val_acc=0.739]
Epoch 49:  48%|████▊     | 56/117 [00:02<00:03, 19.88it/s, loss=1.3, v_num=1, val_acc=0.739]
Epoch 49:  48%|████▊     | 56/117 [00:02<00:03, 19.70it/s, loss=1.31, v_num=1, val_acc=0.739]
Epoch 49:  49%|████▊     | 57/117 [00:02<00:03, 19.98it/s, loss=1.31, v_num=1, val_acc=0.739]
Epoch 49:  49%|████▊     | 57/117 [00:02<00:03, 19.81it/s, loss=1.31, v_num=1, val_acc=0.739]
Epoch 49:  50%|████▉     | 58/117 [00:02<00:02, 20.09it/s, loss=1.31, v_num=1, val_acc=0.739]
Epoch 49:  50%|████▉     | 58/117 [00:02<00:02, 19.92it/s, loss=1.31, v_num=1, val_acc=0.739]
Epoch 49:  50%|█████     | 59/117 [00:02<00:02, 20.20it/s, loss=1.31, v_num=1, val_acc=0.739]
Epoch 49:  50%|█████     | 59/117 [00:02<00:02, 20.03it/s, loss=1.29, v_num=1, val_acc=0.739]
Epoch 49:  51%|█████▏    | 60/117 [00:02<00:02, 20.30it/s, loss=1.29, v_num=1, val_acc=0.739]
Epoch 49:  51%|█████▏    | 60/117 [00:02<00:02, 20.13it/s, loss=1.27, v_num=1, val_acc=0.739]
Epoch 49:  52%|█████▏    | 61/117 [00:02<00:02, 20.40it/s, loss=1.27, v_num=1, val_acc=0.739]
Epoch 49:  52%|█████▏    | 61/117 [00:03<00:02, 20.23it/s, loss=1.28, v_num=1, val_acc=0.739]
Epoch 49:  53%|█████▎    | 62/117 [00:03<00:02, 20.50it/s, loss=1.28, v_num=1, val_acc=0.739]
Epoch 49:  53%|█████▎    | 62/117 [00:03<00:02, 20.33it/s, loss=1.33, v_num=1, val_acc=0.739]
Epoch 49:  54%|█████▍    | 63/117 [00:03<00:02, 20.55it/s, loss=1.33, v_num=1, val_acc=0.739]
Epoch 49:  54%|█████▍    | 63/117 [00:03<00:02, 20.40it/s, loss=1.34, v_num=1, val_acc=0.739]
Epoch 49:  55%|█████▍    | 64/117 [00:03<00:02, 20.66it/s, loss=1.34, v_num=1, val_acc=0.739]
Epoch 49:  55%|█████▍    | 64/117 [00:03<00:02, 20.50it/s, loss=1.33, v_num=1, val_acc=0.739]
Epoch 49:  56%|█████▌    | 65/117 [00:03<00:02, 20.75it/s, loss=1.33, v_num=1, val_acc=0.739]
Epoch 49:  56%|█████▌    | 65/117 [00:03<00:02, 20.59it/s, loss=1.34, v_num=1, val_acc=0.739]
Epoch 49:  56%|█████▋    | 66/117 [00:03<00:02, 20.84it/s, loss=1.34, v_num=1, val_acc=0.739]
Epoch 49:  56%|█████▋    | 66/117 [00:03<00:02, 20.67it/s, loss=1.33, v_num=1, val_acc=0.739]
Epoch 49:  57%|█████▋    | 67/117 [00:03<00:02, 20.93it/s, loss=1.33, v_num=1, val_acc=0.739]
Epoch 49:  57%|█████▋    | 67/117 [00:03<00:02, 20.76it/s, loss=1.33, v_num=1, val_acc=0.739]
Epoch 49:  58%|█████▊    | 68/117 [00:03<00:02, 21.01it/s, loss=1.33, v_num=1, val_acc=0.739]
Epoch 49:  58%|█████▊    | 68/117 [00:03<00:02, 20.85it/s, loss=1.32, v_num=1, val_acc=0.739]
Epoch 49:  59%|█████▉    | 69/117 [00:03<00:02, 21.10it/s, loss=1.32, v_num=1, val_acc=0.739]
Epoch 49:  59%|█████▉    | 69/117 [00:03<00:02, 20.94it/s, loss=1.3, v_num=1, val_acc=0.739]
Epoch 49:  60%|█████▉    | 70/117 [00:03<00:02, 21.18it/s, loss=1.3, v_num=1, val_acc=0.739]
Epoch 49:  60%|█████▉    | 70/117 [00:03<00:02, 21.02it/s, loss=1.28, v_num=1, val_acc=0.739]
Epoch 49:  61%|██████    | 71/117 [00:03<00:02, 21.26it/s, loss=1.28, v_num=1, val_acc=0.739]
Epoch 49:  61%|██████    | 71/117 [00:03<00:02, 21.10it/s, loss=1.33, v_num=1, val_acc=0.739]
Epoch 49:  62%|██████▏   | 72/117 [00:03<00:02, 21.34it/s, loss=1.33, v_num=1, val_acc=0.739]
Epoch 49:  62%|██████▏   | 72/117 [00:03<00:02, 21.18it/s, loss=1.33, v_num=1, val_acc=0.739]
Epoch 49:  62%|██████▏   | 73/117 [00:03<00:02, 21.41it/s, loss=1.33, v_num=1, val_acc=0.739]
Epoch 49:  62%|██████▏   | 73/117 [00:03<00:02, 21.26it/s, loss=1.35, v_num=1, val_acc=0.739]
Epoch 49:  63%|██████▎   | 74/117 [00:03<00:02, 21.49it/s, loss=1.35, v_num=1, val_acc=0.739]
Epoch 49:  63%|██████▎   | 74/117 [00:03<00:02, 21.33it/s, loss=1.37, v_num=1, val_acc=0.739]
Epoch 49:  64%|██████▍   | 75/117 [00:03<00:01, 21.56it/s, loss=1.37, v_num=1, val_acc=0.739]
Epoch 49:  64%|██████▍   | 75/117 [00:03<00:01, 21.40it/s, loss=1.39, v_num=1, val_acc=0.739]
Epoch 49:  65%|██████▍   | 76/117 [00:03<00:01, 21.63it/s, loss=1.39, v_num=1, val_acc=0.739]
Epoch 49:  65%|██████▍   | 76/117 [00:03<00:01, 21.47it/s, loss=1.4, v_num=1, val_acc=0.739]
Epoch 49:  66%|██████▌   | 77/117 [00:03<00:01, 21.69it/s, loss=1.4, v_num=1, val_acc=0.739]
Epoch 49:  66%|██████▌   | 77/117 [00:03<00:01, 21.54it/s, loss=1.39, v_num=1, val_acc=0.739]
Epoch 49:  67%|██████▋   | 78/117 [00:03<00:01, 21.76it/s, loss=1.39, v_num=1, val_acc=0.739]
Epoch 49:  67%|██████▋   | 78/117 [00:03<00:01, 21.61it/s, loss=1.34, v_num=1, val_acc=0.739]
Epoch 49:  68%|██████▊   | 79/117 [00:03<00:01, 21.84it/s, loss=1.34, v_num=1, val_acc=0.739]
Epoch 49:  68%|██████▊   | 79/117 [00:03<00:01, 21.68it/s, loss=1.34, v_num=1, val_acc=0.739]
Epoch 49:  68%|██████▊   | 80/117 [00:03<00:01, 21.90it/s, loss=1.34, v_num=1, val_acc=0.739]
Epoch 49:  68%|██████▊   | 80/117 [00:03<00:01, 21.75it/s, loss=1.34, v_num=1, val_acc=0.739]
Epoch 49:  69%|██████▉   | 81/117 [00:03<00:01, 21.96it/s, loss=1.34, v_num=1, val_acc=0.739]
Epoch 49:  69%|██████▉   | 81/117 [00:03<00:01, 21.81it/s, loss=1.35, v_num=1, val_acc=0.739]
Epoch 49:  70%|███████   | 82/117 [00:03<00:01, 22.01it/s, loss=1.35, v_num=1, val_acc=0.739]
Epoch 49:  70%|███████   | 82/117 [00:03<00:01, 21.86it/s, loss=1.31, v_num=1, val_acc=0.739]
Epoch 49:  71%|███████   | 83/117 [00:03<00:01, 22.07it/s, loss=1.31, v_num=1, val_acc=0.739]
Epoch 49:  71%|███████   | 83/117 [00:03<00:01, 21.92it/s, loss=1.3, v_num=1, val_acc=0.739]
Epoch 49:  72%|███████▏  | 84/117 [00:03<00:01, 22.13it/s, loss=1.3, v_num=1, val_acc=0.739]
Epoch 49:  72%|███████▏  | 84/117 [00:03<00:01, 21.99it/s, loss=1.29, v_num=1, val_acc=0.739]
Epoch 49:  73%|███████▎  | 85/117 [00:03<00:01, 22.20it/s, loss=1.29, v_num=1, val_acc=0.739]
Epoch 49:  73%|███████▎  | 85/117 [00:03<00:01, 22.05it/s, loss=1.29, v_num=1, val_acc=0.739]
Epoch 49:  74%|███████▎  | 86/117 [00:03<00:01, 22.26it/s, loss=1.29, v_num=1, val_acc=0.739]
Epoch 49:  74%|███████▎  | 86/117 [00:03<00:01, 22.11it/s, loss=1.28, v_num=1, val_acc=0.739]
Epoch 49:  74%|███████▍  | 87/117 [00:03<00:01, 22.32it/s, loss=1.28, v_num=1, val_acc=0.739]
Epoch 49:  74%|███████▍  | 87/117 [00:03<00:01, 22.17it/s, loss=1.28, v_num=1, val_acc=0.739]
Epoch 49:  75%|███████▌  | 88/117 [00:03<00:01, 22.38it/s, loss=1.28, v_num=1, val_acc=0.739]
Epoch 49:  75%|███████▌  | 88/117 [00:03<00:01, 22.23it/s, loss=1.28, v_num=1, val_acc=0.739]
Epoch 49:  76%|███████▌  | 89/117 [00:03<00:01, 22.44it/s, loss=1.28, v_num=1, val_acc=0.739]
Epoch 49:  76%|███████▌  | 89/117 [00:03<00:01, 22.29it/s, loss=1.27, v_num=1, val_acc=0.739]
Epoch 49:  77%|███████▋  | 90/117 [00:04<00:01, 22.50it/s, loss=1.27, v_num=1, val_acc=0.739]
Epoch 49:  77%|███████▋  | 90/117 [00:04<00:01, 22.35it/s, loss=1.24, v_num=1, val_acc=0.739]
Epoch 49:  78%|███████▊  | 91/117 [00:04<00:01, 22.55it/s, loss=1.24, v_num=1, val_acc=0.739]
Epoch 49:  78%|███████▊  | 91/117 [00:04<00:01, 22.41it/s, loss=1.19, v_num=1, val_acc=0.739]
Epoch 49:  79%|███████▊  | 92/117 [00:04<00:01, 22.61it/s, loss=1.19, v_num=1, val_acc=0.739]
Epoch 49:  79%|███████▊  | 92/117 [00:04<00:01, 22.47it/s, loss=1.18, v_num=1, val_acc=0.739]
Epoch 49:  79%|███████▉  | 93/117 [00:04<00:01, 22.66it/s, loss=1.18, v_num=1, val_acc=0.739]
Epoch 49:  79%|███████▉  | 93/117 [00:04<00:01, 22.52it/s, loss=1.17, v_num=1, val_acc=0.739]
Epoch 49:  80%|████████  | 94/117 [00:04<00:01, 22.71it/s, loss=1.17, v_num=1, val_acc=0.739]
Epoch 49:  80%|████████  | 94/117 [00:04<00:01, 22.58it/s, loss=1.14, v_num=1, val_acc=0.739]
Epoch 49:  81%|████████  | 95/117 [00:04<00:00, 22.77it/s, loss=1.14, v_num=1, val_acc=0.739]
Epoch 49:  81%|████████  | 95/117 [00:04<00:00, 22.63it/s, loss=1.12, v_num=1, val_acc=0.739]
Epoch 49:  82%|████████▏ | 96/117 [00:04<00:00, 22.82it/s, loss=1.12, v_num=1, val_acc=0.739]
Epoch 49:  82%|████████▏ | 96/117 [00:04<00:00, 22.68it/s, loss=1.09, v_num=1, val_acc=0.739]
Epoch 49:  83%|████████▎ | 97/117 [00:04<00:00, 22.87it/s, loss=1.09, v_num=1, val_acc=0.739]
Epoch 49:  83%|████████▎ | 97/117 [00:04<00:00, 22.73it/s, loss=1.1, v_num=1, val_acc=0.739]

Validation: 0it [00:00, ?it/s]

Validation:   0%|          | 0/20 [00:00<?, ?it/s]

Validation DataLoader 0:   0%|          | 0/20 [00:00<?, ?it/s]

Validation DataLoader 0:   5%|▌         | 1/20 [00:00<00:00, 190.78it/s]
Epoch 49:  84%|████████▍ | 98/117 [00:05<00:00, 19.15it/s, loss=1.1, v_num=1, val_acc=0.739]

Validation DataLoader 0:  10%|█         | 2/20 [00:00<00:00, 55.26it/s]
Epoch 49:  85%|████████▍ | 99/117 [00:05<00:00, 19.23it/s, loss=1.1, v_num=1, val_acc=0.739]

Validation DataLoader 0:  15%|█▌        | 3/20 [00:00<00:00, 44.10it/s]
Epoch 49:  85%|████████▌ | 100/117 [00:05<00:00, 19.30it/s, loss=1.1, v_num=1, val_acc=0.739]

Validation DataLoader 0:  20%|██        | 4/20 [00:00<00:00, 40.11it/s]
Epoch 49:  86%|████████▋ | 101/117 [00:05<00:00, 19.38it/s, loss=1.1, v_num=1, val_acc=0.739]

Validation DataLoader 0:  25%|██▌       | 5/20 [00:00<00:00, 37.85it/s]
Epoch 49:  87%|████████▋ | 102/117 [00:05<00:00, 19.45it/s, loss=1.1, v_num=1, val_acc=0.739]

Validation DataLoader 0:  30%|███       | 6/20 [00:00<00:00, 36.69it/s]
Epoch 49:  88%|████████▊ | 103/117 [00:05<00:00, 19.52it/s, loss=1.1, v_num=1, val_acc=0.739]

Validation DataLoader 0:  35%|███▌      | 7/20 [00:00<00:00, 35.87it/s]
Epoch 49:  89%|████████▉ | 104/117 [00:05<00:00, 19.60it/s, loss=1.1, v_num=1, val_acc=0.739]

Validation DataLoader 0:  40%|████      | 8/20 [00:00<00:00, 35.29it/s]
Epoch 49:  90%|████████▉ | 105/117 [00:05<00:00, 19.67it/s, loss=1.1, v_num=1, val_acc=0.739]

Validation DataLoader 0:  45%|████▌     | 9/20 [00:00<00:00, 34.83it/s]
Epoch 49:  91%|█████████ | 106/117 [00:05<00:00, 19.74it/s, loss=1.1, v_num=1, val_acc=0.739]

Validation DataLoader 0:  50%|█████     | 10/20 [00:00<00:00, 34.52it/s]
Epoch 49:  91%|█████████▏| 107/117 [00:05<00:00, 19.81it/s, loss=1.1, v_num=1, val_acc=0.739]

Validation DataLoader 0:  55%|█████▌    | 11/20 [00:00<00:00, 34.24it/s]
Epoch 49:  92%|█████████▏| 108/117 [00:05<00:00, 19.88it/s, loss=1.1, v_num=1, val_acc=0.739]

Validation DataLoader 0:  60%|██████    | 12/20 [00:00<00:00, 34.00it/s]
Epoch 49:  93%|█████████▎| 109/117 [00:05<00:00, 19.95it/s, loss=1.1, v_num=1, val_acc=0.739]

Validation DataLoader 0:  65%|██████▌   | 13/20 [00:00<00:00, 33.81it/s]
Epoch 49:  94%|█████████▍| 110/117 [00:05<00:00, 20.01it/s, loss=1.1, v_num=1, val_acc=0.739]

Validation DataLoader 0:  70%|███████   | 14/20 [00:00<00:00, 33.63it/s]
Epoch 49:  95%|█████████▍| 111/117 [00:05<00:00, 20.08it/s, loss=1.1, v_num=1, val_acc=0.739]

Validation DataLoader 0:  75%|███████▌  | 15/20 [00:00<00:00, 33.49it/s]
Epoch 49:  96%|█████████▌| 112/117 [00:05<00:00, 20.14it/s, loss=1.1, v_num=1, val_acc=0.739]

Validation DataLoader 0:  80%|████████  | 16/20 [00:00<00:00, 33.35it/s]
Epoch 49:  97%|█████████▋| 113/117 [00:05<00:00, 20.21it/s, loss=1.1, v_num=1, val_acc=0.739]

Validation DataLoader 0:  85%|████████▌ | 17/20 [00:00<00:00, 33.23it/s]
Epoch 49:  97%|█████████▋| 114/117 [00:05<00:00, 20.27it/s, loss=1.1, v_num=1, val_acc=0.739]

Validation DataLoader 0:  90%|█████████ | 18/20 [00:00<00:00, 33.15it/s]
Epoch 49:  98%|█████████▊| 115/117 [00:05<00:00, 20.34it/s, loss=1.1, v_num=1, val_acc=0.739]

Validation DataLoader 0:  95%|█████████▌| 19/20 [00:00<00:00, 33.07it/s]
Epoch 49:  99%|█████████▉| 116/117 [00:05<00:00, 20.40it/s, loss=1.1, v_num=1, val_acc=0.739]

Validation DataLoader 0: 100%|██████████| 20/20 [00:00<00:00, 33.06it/s]
Epoch 49: 100%|██████████| 117/117 [00:05<00:00, 20.47it/s, loss=1.1, v_num=1, val_acc=0.739]
Epoch 49: 100%|██████████| 117/117 [00:05<00:00, 20.39it/s, loss=1.1, v_num=1, val_acc=0.701]


Epoch 49: 100%|██████████| 117/117 [00:05<00:00, 20.39it/s, loss=1.1, v_num=1, val_acc=0.701]
Epoch 49:   0%|          | 0/117 [00:00<?, ?it/s, loss=1.1, v_num=1, val_acc=0.701]
Epoch 50:   0%|          | 0/117 [00:00<?, ?it/s, loss=1.1, v_num=1, val_acc=0.701]
Epoch 50:   1%|          | 1/117 [00:00<01:44,  1.11it/s, loss=1.1, v_num=1, val_acc=0.701]
Epoch 50:   1%|          | 1/117 [00:00<01:47,  1.08it/s, loss=1.13, v_num=1, val_acc=0.701]
Epoch 50:   2%|▏         | 2/117 [00:00<00:53,  2.14it/s, loss=1.13, v_num=1, val_acc=0.701]
Epoch 50:   2%|▏         | 2/117 [00:00<00:55,  2.08it/s, loss=1.14, v_num=1, val_acc=0.701]
Epoch 50:   3%|▎         | 3/117 [00:00<00:37,  3.08it/s, loss=1.14, v_num=1, val_acc=0.701]
Epoch 50:   3%|▎         | 3/117 [00:00<00:37,  3.00it/s, loss=1.14, v_num=1, val_acc=0.701]
Epoch 50:   3%|▎         | 4/117 [00:01<00:28,  3.96it/s, loss=1.14, v_num=1, val_acc=0.701]
Epoch 50:   3%|▎         | 4/117 [00:01<00:29,  3.87it/s, loss=1.13, v_num=1, val_acc=0.701]
Epoch 50:   4%|▍         | 5/117 [00:01<00:23,  4.79it/s, loss=1.13, v_num=1, val_acc=0.701]
Epoch 50:   4%|▍         | 5/117 [00:01<00:23,  4.68it/s, loss=1.12, v_num=1, val_acc=0.701]
Epoch 50:   5%|▌         | 6/117 [00:01<00:19,  5.56it/s, loss=1.12, v_num=1, val_acc=0.701]
Epoch 50:   5%|▌         | 6/117 [00:01<00:20,  5.44it/s, loss=1.09, v_num=1, val_acc=0.701]
Epoch 50:   6%|▌         | 7/117 [00:01<00:17,  6.29it/s, loss=1.09, v_num=1, val_acc=0.701]
Epoch 50:   6%|▌         | 7/117 [00:01<00:17,  6.16it/s, loss=1.11, v_num=1, val_acc=0.701]
Epoch 50:   7%|▋         | 8/117 [00:01<00:15,  6.98it/s, loss=1.11, v_num=1, val_acc=0.701]
Epoch 50:   7%|▋         | 8/117 [00:01<00:15,  6.83it/s, loss=1.15, v_num=1, val_acc=0.701]
Epoch 50:   8%|▊         | 9/117 [00:01<00:14,  7.60it/s, loss=1.15, v_num=1, val_acc=0.701]
Epoch 50:   8%|▊         | 9/117 [00:01<00:14,  7.44it/s, loss=1.17, v_num=1, val_acc=0.701]
Epoch 50:   9%|▊         | 10/117 [00:01<00:13,  8.19it/s, loss=1.17, v_num=1, val_acc=0.701]
Epoch 50:   9%|▊         | 10/117 [00:01<00:13,  8.03it/s, loss=1.16, v_num=1, val_acc=0.701]
Epoch 50:   9%|▉         | 11/117 [00:01<00:12,  8.77it/s, loss=1.16, v_num=1, val_acc=0.701]
Epoch 50:   9%|▉         | 11/117 [00:01<00:12,  8.60it/s, loss=1.17, v_num=1, val_acc=0.701]
Epoch 50:  10%|█         | 12/117 [00:01<00:11,  9.30it/s, loss=1.17, v_num=1, val_acc=0.701]
Epoch 50:  10%|█         | 12/117 [00:01<00:11,  9.13it/s, loss=1.19, v_num=1, val_acc=0.701]
Epoch 50:  11%|█         | 13/117 [00:01<00:10,  9.82it/s, loss=1.19, v_num=1, val_acc=0.701]
Epoch 50:  11%|█         | 13/117 [00:01<00:10,  9.64it/s, loss=1.19, v_num=1, val_acc=0.701]
Epoch 50:  12%|█▏        | 14/117 [00:01<00:09, 10.32it/s, loss=1.19, v_num=1, val_acc=0.701]
Epoch 50:  12%|█▏        | 14/117 [00:01<00:10, 10.13it/s, loss=1.19, v_num=1, val_acc=0.701]
Epoch 50:  13%|█▎        | 15/117 [00:01<00:09, 10.79it/s, loss=1.19, v_num=1, val_acc=0.701]
Epoch 50:  13%|█▎        | 15/117 [00:01<00:09, 10.59it/s, loss=1.2, v_num=1, val_acc=0.701]
Epoch 50:  14%|█▎        | 16/117 [00:01<00:08, 11.23it/s, loss=1.2, v_num=1, val_acc=0.701]
Epoch 50:  14%|█▎        | 16/117 [00:01<00:09, 11.04it/s, loss=1.21, v_num=1, val_acc=0.701]
Epoch 50:  15%|█▍        | 17/117 [00:01<00:08, 11.64it/s, loss=1.21, v_num=1, val_acc=0.701]
Epoch 50:  15%|█▍        | 17/117 [00:01<00:08, 11.44it/s, loss=1.22, v_num=1, val_acc=0.701]
Epoch 50:  15%|█▌        | 18/117 [00:01<00:08, 12.04it/s, loss=1.22, v_num=1, val_acc=0.701]
Epoch 50:  15%|█▌        | 18/117 [00:01<00:08, 11.84it/s, loss=1.23, v_num=1, val_acc=0.701]
Epoch 50:  16%|█▌        | 19/117 [00:01<00:07, 12.43it/s, loss=1.23, v_num=1, val_acc=0.701]
Epoch 50:  16%|█▌        | 19/117 [00:01<00:08, 12.23it/s, loss=1.23, v_num=1, val_acc=0.701]
Epoch 50:  17%|█▋        | 20/117 [00:01<00:07, 12.80it/s, loss=1.23, v_num=1, val_acc=0.701]
Epoch 50:  17%|█▋        | 20/117 [00:01<00:07, 12.59it/s, loss=1.23, v_num=1, val_acc=0.701]
Epoch 50:  18%|█▊        | 21/117 [00:01<00:07, 13.16it/s, loss=1.23, v_num=1, val_acc=0.701]
Epoch 50:  18%|█▊        | 21/117 [00:01<00:07, 12.95it/s, loss=1.22, v_num=1, val_acc=0.701]
Epoch 50:  19%|█▉        | 22/117 [00:01<00:07, 13.49it/s, loss=1.22, v_num=1, val_acc=0.701]
Epoch 50:  19%|█▉        | 22/117 [00:01<00:07, 13.29it/s, loss=1.22, v_num=1, val_acc=0.701]
Epoch 50:  20%|█▉        | 23/117 [00:01<00:06, 13.81it/s, loss=1.22, v_num=1, val_acc=0.701]
Epoch 50:  20%|█▉        | 23/117 [00:01<00:06, 13.61it/s, loss=1.24, v_num=1, val_acc=0.701]
Epoch 50:  21%|██        | 24/117 [00:01<00:06, 14.12it/s, loss=1.24, v_num=1, val_acc=0.701]
Epoch 50:  21%|██        | 24/117 [00:01<00:06, 13.92it/s, loss=1.25, v_num=1, val_acc=0.701]
Epoch 50:  21%|██▏       | 25/117 [00:01<00:06, 14.42it/s, loss=1.25, v_num=1, val_acc=0.701]
Epoch 50:  21%|██▏       | 25/117 [00:01<00:06, 14.21it/s, loss=1.26, v_num=1, val_acc=0.701]
Epoch 50:  22%|██▏       | 26/117 [00:01<00:06, 14.71it/s, loss=1.26, v_num=1, val_acc=0.701]
Epoch 50:  22%|██▏       | 26/117 [00:01<00:06, 14.50it/s, loss=1.27, v_num=1, val_acc=0.701]
Epoch 50:  23%|██▎       | 27/117 [00:01<00:06, 14.98it/s, loss=1.27, v_num=1, val_acc=0.701]
Epoch 50:  23%|██▎       | 27/117 [00:01<00:06, 14.77it/s, loss=1.26, v_num=1, val_acc=0.701]
Epoch 50:  24%|██▍       | 28/117 [00:01<00:05, 15.25it/s, loss=1.26, v_num=1, val_acc=0.701]
Epoch 50:  24%|██▍       | 28/117 [00:01<00:05, 15.04it/s, loss=1.2, v_num=1, val_acc=0.701]
Epoch 50:  25%|██▍       | 29/117 [00:01<00:05, 15.46it/s, loss=1.2, v_num=1, val_acc=0.701]
Epoch 50:  25%|██▍       | 29/117 [00:01<00:05, 15.27it/s, loss=1.18, v_num=1, val_acc=0.701]
Epoch 50:  26%|██▌       | 30/117 [00:01<00:05, 15.71it/s, loss=1.18, v_num=1, val_acc=0.701]
Epoch 50:  26%|██▌       | 30/117 [00:01<00:05, 15.51it/s, loss=1.18, v_num=1, val_acc=0.701]
Epoch 50:  26%|██▋       | 31/117 [00:01<00:05, 15.94it/s, loss=1.18, v_num=1, val_acc=0.701]
Epoch 50:  26%|██▋       | 31/117 [00:01<00:05, 15.74it/s, loss=1.17, v_num=1, val_acc=0.701]
Epoch 50:  27%|██▋       | 32/117 [00:01<00:05, 16.14it/s, loss=1.17, v_num=1, val_acc=0.701]
Epoch 50:  27%|██▋       | 32/117 [00:02<00:05, 15.95it/s, loss=1.15, v_num=1, val_acc=0.701]
Epoch 50:  28%|██▊       | 33/117 [00:02<00:05, 16.37it/s, loss=1.15, v_num=1, val_acc=0.701]
Epoch 50:  28%|██▊       | 33/117 [00:02<00:05, 16.17it/s, loss=1.16, v_num=1, val_acc=0.701]
Epoch 50:  29%|██▉       | 34/117 [00:02<00:05, 16.58it/s, loss=1.16, v_num=1, val_acc=0.701]
Epoch 50:  29%|██▉       | 34/117 [00:02<00:05, 16.38it/s, loss=1.17, v_num=1, val_acc=0.701]
Epoch 50:  30%|██▉       | 35/117 [00:02<00:04, 16.79it/s, loss=1.17, v_num=1, val_acc=0.701]
Epoch 50:  30%|██▉       | 35/117 [00:02<00:04, 16.59it/s, loss=1.17, v_num=1, val_acc=0.701]
Epoch 50:  31%|███       | 36/117 [00:02<00:04, 16.98it/s, loss=1.17, v_num=1, val_acc=0.701]
Epoch 50:  31%|███       | 36/117 [00:02<00:04, 16.78it/s, loss=1.14, v_num=1, val_acc=0.701]
Epoch 50:  32%|███▏      | 37/117 [00:02<00:04, 17.17it/s, loss=1.14, v_num=1, val_acc=0.701]
Epoch 50:  32%|███▏      | 37/117 [00:02<00:04, 16.98it/s, loss=1.14, v_num=1, val_acc=0.701]
Epoch 50:  32%|███▏      | 38/117 [00:02<00:04, 17.35it/s, loss=1.14, v_num=1, val_acc=0.701]
Epoch 50:  32%|███▏      | 38/117 [00:02<00:04, 17.16it/s, loss=1.16, v_num=1, val_acc=0.701]
Epoch 50:  33%|███▎      | 39/117 [00:02<00:04, 17.54it/s, loss=1.16, v_num=1, val_acc=0.701]
Epoch 50:  33%|███▎      | 39/117 [00:02<00:04, 17.34it/s, loss=1.15, v_num=1, val_acc=0.701]
Epoch 50:  34%|███▍      | 40/117 [00:02<00:04, 17.72it/s, loss=1.15, v_num=1, val_acc=0.701]
Epoch 50:  34%|███▍      | 40/117 [00:02<00:04, 17.52it/s, loss=1.14, v_num=1, val_acc=0.701]
Epoch 50:  35%|███▌      | 41/117 [00:02<00:04, 17.89it/s, loss=1.14, v_num=1, val_acc=0.701]
Epoch 50:  35%|███▌      | 41/117 [00:02<00:04, 17.69it/s, loss=1.15, v_num=1, val_acc=0.701]
Epoch 50:  36%|███▌      | 42/117 [00:02<00:04, 18.05it/s, loss=1.15, v_num=1, val_acc=0.701]
Epoch 50:  36%|███▌      | 42/117 [00:02<00:04, 17.86it/s, loss=1.18, v_num=1, val_acc=0.701]
Epoch 50:  37%|███▋      | 43/117 [00:02<00:04, 18.22it/s, loss=1.18, v_num=1, val_acc=0.701]
Epoch 50:  37%|███▋      | 43/117 [00:02<00:04, 18.02it/s, loss=1.16, v_num=1, val_acc=0.701]
Epoch 50:  38%|███▊      | 44/117 [00:02<00:03, 18.37it/s, loss=1.16, v_num=1, val_acc=0.701]
Epoch 50:  38%|███▊      | 44/117 [00:02<00:04, 18.18it/s, loss=1.13, v_num=1, val_acc=0.701]
Epoch 50:  38%|███▊      | 45/117 [00:02<00:03, 18.51it/s, loss=1.13, v_num=1, val_acc=0.701]
Epoch 50:  38%|███▊      | 45/117 [00:02<00:03, 18.32it/s, loss=1.11, v_num=1, val_acc=0.701]
Epoch 50:  39%|███▉      | 46/117 [00:02<00:03, 18.66it/s, loss=1.11, v_num=1, val_acc=0.701]
Epoch 50:  39%|███▉      | 46/117 [00:02<00:03, 18.47it/s, loss=1.1, v_num=1, val_acc=0.701]
Epoch 50:  40%|████      | 47/117 [00:02<00:03, 18.81it/s, loss=1.1, v_num=1, val_acc=0.701]
Epoch 50:  40%|████      | 47/117 [00:02<00:03, 18.62it/s, loss=1.09, v_num=1, val_acc=0.701]
Epoch 50:  41%|████      | 48/117 [00:02<00:03, 18.94it/s, loss=1.09, v_num=1, val_acc=0.701]
Epoch 50:  41%|████      | 48/117 [00:02<00:03, 18.76it/s, loss=1.1, v_num=1, val_acc=0.701]
Epoch 50:  42%|████▏     | 49/117 [00:02<00:03, 19.08it/s, loss=1.1, v_num=1, val_acc=0.701]
Epoch 50:  42%|████▏     | 49/117 [00:02<00:03, 18.89it/s, loss=1.1, v_num=1, val_acc=0.701]
Epoch 50:  43%|████▎     | 50/117 [00:02<00:03, 19.21it/s, loss=1.1, v_num=1, val_acc=0.701]
Epoch 50:  43%|████▎     | 50/117 [00:02<00:03, 19.03it/s, loss=1.11, v_num=1, val_acc=0.701]
Epoch 50:  44%|████▎     | 51/117 [00:02<00:03, 19.33it/s, loss=1.11, v_num=1, val_acc=0.701]
Epoch 50:  44%|████▎     | 51/117 [00:02<00:03, 19.15it/s, loss=1.12, v_num=1, val_acc=0.701]
Epoch 50:  44%|████▍     | 52/117 [00:02<00:03, 19.46it/s, loss=1.12, v_num=1, val_acc=0.701]
Epoch 50:  44%|████▍     | 52/117 [00:02<00:03, 19.28it/s, loss=1.14, v_num=1, val_acc=0.701]
Epoch 50:  45%|████▌     | 53/117 [00:02<00:03, 19.58it/s, loss=1.14, v_num=1, val_acc=0.701]
Epoch 50:  45%|████▌     | 53/117 [00:02<00:03, 19.40it/s, loss=1.15, v_num=1, val_acc=0.701]
Epoch 50:  46%|████▌     | 54/117 [00:02<00:03, 19.70it/s, loss=1.15, v_num=1, val_acc=0.701]
Epoch 50:  46%|████▌     | 54/117 [00:02<00:03, 19.52it/s, loss=1.15, v_num=1, val_acc=0.701]
Epoch 50:  47%|████▋     | 55/117 [00:02<00:03, 19.82it/s, loss=1.15, v_num=1, val_acc=0.701]
Epoch 50:  47%|████▋     | 55/117 [00:02<00:03, 19.64it/s, loss=1.16, v_num=1, val_acc=0.701]
Epoch 50:  48%|████▊     | 56/117 [00:02<00:03, 19.93it/s, loss=1.16, v_num=1, val_acc=0.701]
Epoch 50:  48%|████▊     | 56/117 [00:02<00:03, 19.75it/s, loss=1.2, v_num=1, val_acc=0.701]
Epoch 50:  49%|████▊     | 57/117 [00:02<00:02, 20.04it/s, loss=1.2, v_num=1, val_acc=0.701]
Epoch 50:  49%|████▊     | 57/117 [00:02<00:03, 19.87it/s, loss=1.23, v_num=1, val_acc=0.701]
Epoch 50:  50%|████▉     | 58/117 [00:02<00:02, 20.15it/s, loss=1.23, v_num=1, val_acc=0.701]
Epoch 50:  50%|████▉     | 58/117 [00:02<00:02, 19.97it/s, loss=1.21, v_num=1, val_acc=0.701]
Epoch 50:  50%|█████     | 59/117 [00:02<00:02, 20.26it/s, loss=1.21, v_num=1, val_acc=0.701]
Epoch 50:  50%|█████     | 59/117 [00:02<00:02, 20.08it/s, loss=1.24, v_num=1, val_acc=0.701]
Epoch 50:  51%|█████▏    | 60/117 [00:02<00:02, 20.36it/s, loss=1.24, v_num=1, val_acc=0.701]
Epoch 50:  51%|█████▏    | 60/117 [00:02<00:02, 20.19it/s, loss=1.28, v_num=1, val_acc=0.701]
Epoch 50:  52%|█████▏    | 61/117 [00:02<00:02, 20.46it/s, loss=1.28, v_num=1, val_acc=0.701]
Epoch 50:  52%|█████▏    | 61/117 [00:03<00:02, 20.29it/s, loss=1.27, v_num=1, val_acc=0.701]
Epoch 50:  53%|█████▎    | 62/117 [00:03<00:02, 20.56it/s, loss=1.27, v_num=1, val_acc=0.701]
Epoch 50:  53%|█████▎    | 62/117 [00:03<00:02, 20.39it/s, loss=1.23, v_num=1, val_acc=0.701]
Epoch 50:  54%|█████▍    | 63/117 [00:03<00:02, 20.66it/s, loss=1.23, v_num=1, val_acc=0.701]
Epoch 50:  54%|█████▍    | 63/117 [00:03<00:02, 20.48it/s, loss=1.23, v_num=1, val_acc=0.701]
Epoch 50:  55%|█████▍    | 64/117 [00:03<00:02, 20.75it/s, loss=1.23, v_num=1, val_acc=0.701]
Epoch 50:  55%|█████▍    | 64/117 [00:03<00:02, 20.58it/s, loss=1.25, v_num=1, val_acc=0.701]
Epoch 50:  56%|█████▌    | 65/117 [00:03<00:02, 20.84it/s, loss=1.25, v_num=1, val_acc=0.701]
Epoch 50:  56%|█████▌    | 65/117 [00:03<00:02, 20.67it/s, loss=1.26, v_num=1, val_acc=0.701]
Epoch 50:  56%|█████▋    | 66/117 [00:03<00:02, 20.93it/s, loss=1.26, v_num=1, val_acc=0.701]
Epoch 50:  56%|█████▋    | 66/117 [00:03<00:02, 20.76it/s, loss=1.26, v_num=1, val_acc=0.701]
Epoch 50:  57%|█████▋    | 67/117 [00:03<00:02, 21.02it/s, loss=1.26, v_num=1, val_acc=0.701]
Epoch 50:  57%|█████▋    | 67/117 [00:03<00:02, 20.85it/s, loss=1.27, v_num=1, val_acc=0.701]
Epoch 50:  58%|█████▊    | 68/117 [00:03<00:02, 21.11it/s, loss=1.27, v_num=1, val_acc=0.701]
Epoch 50:  58%|█████▊    | 68/117 [00:03<00:02, 20.94it/s, loss=1.3, v_num=1, val_acc=0.701]
Epoch 50:  59%|█████▉    | 69/117 [00:03<00:02, 21.19it/s, loss=1.3, v_num=1, val_acc=0.701]
Epoch 50:  59%|█████▉    | 69/117 [00:03<00:02, 21.03it/s, loss=1.3, v_num=1, val_acc=0.701]
Epoch 50:  60%|█████▉    | 70/117 [00:03<00:02, 21.27it/s, loss=1.3, v_num=1, val_acc=0.701]
Epoch 50:  60%|█████▉    | 70/117 [00:03<00:02, 21.11it/s, loss=1.29, v_num=1, val_acc=0.701]
Epoch 50:  61%|██████    | 71/117 [00:03<00:02, 21.35it/s, loss=1.29, v_num=1, val_acc=0.701]
Epoch 50:  61%|██████    | 71/117 [00:03<00:02, 21.19it/s, loss=1.28, v_num=1, val_acc=0.701]
Epoch 50:  62%|██████▏   | 72/117 [00:03<00:02, 21.43it/s, loss=1.28, v_num=1, val_acc=0.701]
Epoch 50:  62%|██████▏   | 72/117 [00:03<00:02, 21.27it/s, loss=1.27, v_num=1, val_acc=0.701]
Epoch 50:  62%|██████▏   | 73/117 [00:03<00:02, 21.51it/s, loss=1.27, v_num=1, val_acc=0.701]
Epoch 50:  62%|██████▏   | 73/117 [00:03<00:02, 21.35it/s, loss=1.28, v_num=1, val_acc=0.701]
Epoch 50:  63%|██████▎   | 74/117 [00:03<00:01, 21.58it/s, loss=1.28, v_num=1, val_acc=0.701]
Epoch 50:  63%|██████▎   | 74/117 [00:03<00:02, 21.43it/s, loss=1.27, v_num=1, val_acc=0.701]
Epoch 50:  64%|██████▍   | 75/117 [00:03<00:01, 21.66it/s, loss=1.27, v_num=1, val_acc=0.701]
Epoch 50:  64%|██████▍   | 75/117 [00:03<00:01, 21.50it/s, loss=1.26, v_num=1, val_acc=0.701]
Epoch 50:  65%|██████▍   | 76/117 [00:03<00:01, 21.73it/s, loss=1.26, v_num=1, val_acc=0.701]
Epoch 50:  65%|██████▍   | 76/117 [00:03<00:01, 21.57it/s, loss=1.24, v_num=1, val_acc=0.701]
Epoch 50:  66%|██████▌   | 77/117 [00:03<00:01, 21.80it/s, loss=1.24, v_num=1, val_acc=0.701]
Epoch 50:  66%|██████▌   | 77/117 [00:03<00:01, 21.65it/s, loss=1.22, v_num=1, val_acc=0.701]
Epoch 50:  67%|██████▋   | 78/117 [00:03<00:01, 21.87it/s, loss=1.22, v_num=1, val_acc=0.701]
Epoch 50:  67%|██████▋   | 78/117 [00:03<00:01, 21.72it/s, loss=1.23, v_num=1, val_acc=0.701]
Epoch 50:  68%|██████▊   | 79/117 [00:03<00:01, 21.94it/s, loss=1.23, v_num=1, val_acc=0.701]
Epoch 50:  68%|██████▊   | 79/117 [00:03<00:01, 21.79it/s, loss=1.21, v_num=1, val_acc=0.701]
Epoch 50:  68%|██████▊   | 80/117 [00:03<00:01, 22.01it/s, loss=1.21, v_num=1, val_acc=0.701]
Epoch 50:  68%|██████▊   | 80/117 [00:03<00:01, 21.86it/s, loss=1.17, v_num=1, val_acc=0.701]
Epoch 50:  69%|██████▉   | 81/117 [00:03<00:01, 22.04it/s, loss=1.17, v_num=1, val_acc=0.701]
Epoch 50:  69%|██████▉   | 81/117 [00:03<00:01, 21.90it/s, loss=1.16, v_num=1, val_acc=0.701]
Epoch 50:  70%|███████   | 82/117 [00:03<00:01, 22.10it/s, loss=1.16, v_num=1, val_acc=0.701]
Epoch 50:  70%|███████   | 82/117 [00:03<00:01, 21.96it/s, loss=1.16, v_num=1, val_acc=0.701]
Epoch 50:  71%|███████   | 83/117 [00:03<00:01, 22.16it/s, loss=1.16, v_num=1, val_acc=0.701]
Epoch 50:  71%|███████   | 83/117 [00:03<00:01, 22.02it/s, loss=1.16, v_num=1, val_acc=0.701]
Epoch 50:  72%|███████▏  | 84/117 [00:03<00:01, 22.23it/s, loss=1.16, v_num=1, val_acc=0.701]
Epoch 50:  72%|███████▏  | 84/117 [00:03<00:01, 22.08it/s, loss=1.14, v_num=1, val_acc=0.701]
Epoch 50:  73%|███████▎  | 85/117 [00:03<00:01, 22.29it/s, loss=1.14, v_num=1, val_acc=0.701]
Epoch 50:  73%|███████▎  | 85/117 [00:03<00:01, 22.14it/s, loss=1.15, v_num=1, val_acc=0.701]
Epoch 50:  74%|███████▎  | 86/117 [00:03<00:01, 22.35it/s, loss=1.15, v_num=1, val_acc=0.701]
Epoch 50:  74%|███████▎  | 86/117 [00:03<00:01, 22.21it/s, loss=1.15, v_num=1, val_acc=0.701]
Epoch 50:  74%|███████▍  | 87/117 [00:03<00:01, 22.41it/s, loss=1.15, v_num=1, val_acc=0.701]
Epoch 50:  74%|███████▍  | 87/117 [00:03<00:01, 22.27it/s, loss=1.15, v_num=1, val_acc=0.701]
Epoch 50:  75%|███████▌  | 88/117 [00:03<00:01, 22.47it/s, loss=1.15, v_num=1, val_acc=0.701]
Epoch 50:  75%|███████▌  | 88/117 [00:03<00:01, 22.33it/s, loss=1.14, v_num=1, val_acc=0.701]
Epoch 50:  76%|███████▌  | 89/117 [00:03<00:01, 22.53it/s, loss=1.14, v_num=1, val_acc=0.701]
Epoch 50:  76%|███████▌  | 89/117 [00:03<00:01, 22.39it/s, loss=1.18, v_num=1, val_acc=0.701]
Epoch 50:  77%|███████▋  | 90/117 [00:03<00:01, 22.58it/s, loss=1.18, v_num=1, val_acc=0.701]
Epoch 50:  77%|███████▋  | 90/117 [00:04<00:01, 22.44it/s, loss=1.19, v_num=1, val_acc=0.701]
Epoch 50:  78%|███████▊  | 91/117 [00:04<00:01, 22.64it/s, loss=1.19, v_num=1, val_acc=0.701]
Epoch 50:  78%|███████▊  | 91/117 [00:04<00:01, 22.49it/s, loss=1.19, v_num=1, val_acc=0.701]
Epoch 50:  79%|███████▊  | 92/117 [00:04<00:01, 22.69it/s, loss=1.19, v_num=1, val_acc=0.701]
Epoch 50:  79%|███████▊  | 92/117 [00:04<00:01, 22.55it/s, loss=1.19, v_num=1, val_acc=0.701]
Epoch 50:  79%|███████▉  | 93/117 [00:04<00:01, 22.75it/s, loss=1.19, v_num=1, val_acc=0.701]
Epoch 50:  79%|███████▉  | 93/117 [00:04<00:01, 22.60it/s, loss=1.18, v_num=1, val_acc=0.701]
Epoch 50:  80%|████████  | 94/117 [00:04<00:01, 22.80it/s, loss=1.18, v_num=1, val_acc=0.701]
Epoch 50:  80%|████████  | 94/117 [00:04<00:01, 22.66it/s, loss=1.17, v_num=1, val_acc=0.701]
Epoch 50:  81%|████████  | 95/117 [00:04<00:00, 22.85it/s, loss=1.17, v_num=1, val_acc=0.701]
Epoch 50:  81%|████████  | 95/117 [00:04<00:00, 22.71it/s, loss=1.17, v_num=1, val_acc=0.701]
Epoch 50:  82%|████████▏ | 96/117 [00:04<00:00, 22.90it/s, loss=1.17, v_num=1, val_acc=0.701]
Epoch 50:  82%|████████▏ | 96/117 [00:04<00:00, 22.76it/s, loss=1.16, v_num=1, val_acc=0.701]
Epoch 50:  83%|████████▎ | 97/117 [00:04<00:00, 22.95it/s, loss=1.16, v_num=1, val_acc=0.701]
Epoch 50:  83%|████████▎ | 97/117 [00:04<00:00, 22.81it/s, loss=1.16, v_num=1, val_acc=0.701]

Validation: 0it [00:00, ?it/s]

Validation:   0%|          | 0/20 [00:00<?, ?it/s]

Validation DataLoader 0:   0%|          | 0/20 [00:00<?, ?it/s]

Validation DataLoader 0:   5%|▌         | 1/20 [00:00<00:00, 127.49it/s]
Epoch 50:  84%|████████▍ | 98/117 [00:05<00:00, 19.17it/s, loss=1.16, v_num=1, val_acc=0.701]

Validation DataLoader 0:  10%|█         | 2/20 [00:00<00:00, 54.47it/s]
Epoch 50:  85%|████████▍ | 99/117 [00:05<00:00, 19.26it/s, loss=1.16, v_num=1, val_acc=0.701]

Validation DataLoader 0:  15%|█▌        | 3/20 [00:00<00:00, 43.66it/s]
Epoch 50:  85%|████████▌ | 100/117 [00:05<00:00, 19.33it/s, loss=1.16, v_num=1, val_acc=0.701]

Validation DataLoader 0:  20%|██        | 4/20 [00:00<00:00, 39.71it/s]
Epoch 50:  86%|████████▋ | 101/117 [00:05<00:00, 19.40it/s, loss=1.16, v_num=1, val_acc=0.701]

Validation DataLoader 0:  25%|██▌       | 5/20 [00:00<00:00, 37.30it/s]
Epoch 50:  87%|████████▋ | 102/117 [00:05<00:00, 19.47it/s, loss=1.16, v_num=1, val_acc=0.701]

Validation DataLoader 0:  30%|███       | 6/20 [00:00<00:00, 36.33it/s]
Epoch 50:  88%|████████▊ | 103/117 [00:05<00:00, 19.55it/s, loss=1.16, v_num=1, val_acc=0.701]

Validation DataLoader 0:  35%|███▌      | 7/20 [00:00<00:00, 35.60it/s]
Epoch 50:  89%|████████▉ | 104/117 [00:05<00:00, 19.62it/s, loss=1.16, v_num=1, val_acc=0.701]

Validation DataLoader 0:  40%|████      | 8/20 [00:00<00:00, 35.06it/s]
Epoch 50:  90%|████████▉ | 105/117 [00:05<00:00, 19.69it/s, loss=1.16, v_num=1, val_acc=0.701]

Validation DataLoader 0:  45%|████▌     | 9/20 [00:00<00:00, 34.60it/s]
Epoch 50:  91%|█████████ | 106/117 [00:05<00:00, 19.76it/s, loss=1.16, v_num=1, val_acc=0.701]

Validation DataLoader 0:  50%|█████     | 10/20 [00:00<00:00, 34.30it/s]
Epoch 50:  91%|█████████▏| 107/117 [00:05<00:00, 19.83it/s, loss=1.16, v_num=1, val_acc=0.701]

Validation DataLoader 0:  55%|█████▌    | 11/20 [00:00<00:00, 34.05it/s]
Epoch 50:  92%|█████████▏| 108/117 [00:05<00:00, 19.90it/s, loss=1.16, v_num=1, val_acc=0.701]

Validation DataLoader 0:  60%|██████    | 12/20 [00:00<00:00, 33.83it/s]
Epoch 50:  93%|█████████▎| 109/117 [00:05<00:00, 19.97it/s, loss=1.16, v_num=1, val_acc=0.701]

Validation DataLoader 0:  65%|██████▌   | 13/20 [00:00<00:00, 33.63it/s]
Epoch 50:  94%|█████████▍| 110/117 [00:05<00:00, 20.03it/s, loss=1.16, v_num=1, val_acc=0.701]

Validation DataLoader 0:  70%|███████   | 14/20 [00:00<00:00, 33.49it/s]
Epoch 50:  95%|█████████▍| 111/117 [00:05<00:00, 20.10it/s, loss=1.16, v_num=1, val_acc=0.701]

Validation DataLoader 0:  75%|███████▌  | 15/20 [00:00<00:00, 33.34it/s]
Epoch 50:  96%|█████████▌| 112/117 [00:05<00:00, 20.16it/s, loss=1.16, v_num=1, val_acc=0.701]

Validation DataLoader 0:  80%|████████  | 16/20 [00:00<00:00, 33.22it/s]
Epoch 50:  97%|█████████▋| 113/117 [00:05<00:00, 20.23it/s, loss=1.16, v_num=1, val_acc=0.701]

Validation DataLoader 0:  85%|████████▌ | 17/20 [00:00<00:00, 32.99it/s]
Epoch 50:  97%|█████████▋| 114/117 [00:05<00:00, 20.29it/s, loss=1.16, v_num=1, val_acc=0.701]

Validation DataLoader 0:  90%|█████████ | 18/20 [00:00<00:00, 32.94it/s]
Epoch 50:  98%|█████████▊| 115/117 [00:05<00:00, 20.35it/s, loss=1.16, v_num=1, val_acc=0.701]

Validation DataLoader 0:  95%|█████████▌| 19/20 [00:00<00:00, 32.87it/s]
Epoch 50:  99%|█████████▉| 116/117 [00:05<00:00, 20.41it/s, loss=1.16, v_num=1, val_acc=0.701]

Validation DataLoader 0: 100%|██████████| 20/20 [00:00<00:00, 32.86it/s]
Epoch 50: 100%|██████████| 117/117 [00:05<00:00, 20.48it/s, loss=1.16, v_num=1, val_acc=0.701]
Epoch 50: 100%|██████████| 117/117 [00:05<00:00, 20.41it/s, loss=1.16, v_num=1, val_acc=0.704]


Epoch 50: 100%|██████████| 117/117 [00:05<00:00, 20.40it/s, loss=1.16, v_num=1, val_acc=0.704]
Epoch 50:   0%|          | 0/117 [00:00<?, ?it/s, loss=1.16, v_num=1, val_acc=0.704]
Epoch 51:   0%|          | 0/117 [00:00<?, ?it/s, loss=1.16, v_num=1, val_acc=0.704]
Epoch 51:   1%|          | 1/117 [00:00<01:47,  1.08it/s, loss=1.16, v_num=1, val_acc=0.704]
Epoch 51:   1%|          | 1/117 [00:00<01:49,  1.06it/s, loss=1.15, v_num=1, val_acc=0.704]
Epoch 51:   2%|▏         | 2/117 [00:00<00:54,  2.09it/s, loss=1.15, v_num=1, val_acc=0.704]
Epoch 51:   2%|▏         | 2/117 [00:00<00:56,  2.04it/s, loss=1.15, v_num=1, val_acc=0.704]
Epoch 51:   3%|▎         | 3/117 [00:00<00:37,  3.01it/s, loss=1.15, v_num=1, val_acc=0.704]
Epoch 51:   3%|▎         | 3/117 [00:01<00:38,  2.94it/s, loss=1.14, v_num=1, val_acc=0.704]
Epoch 51:   3%|▎         | 4/117 [00:01<00:29,  3.88it/s, loss=1.14, v_num=1, val_acc=0.704]
Epoch 51:   3%|▎         | 4/117 [00:01<00:29,  3.79it/s, loss=1.15, v_num=1, val_acc=0.704]
Epoch 51:   4%|▍         | 5/117 [00:01<00:23,  4.70it/s, loss=1.15, v_num=1, val_acc=0.704]
Epoch 51:   4%|▍         | 5/117 [00:01<00:24,  4.59it/s, loss=1.16, v_num=1, val_acc=0.704]
Epoch 51:   5%|▌         | 6/117 [00:01<00:20,  5.46it/s, loss=1.16, v_num=1, val_acc=0.704]
Epoch 51:   5%|▌         | 6/117 [00:01<00:20,  5.34it/s, loss=1.15, v_num=1, val_acc=0.704]
Epoch 51:   6%|▌         | 7/117 [00:01<00:17,  6.18it/s, loss=1.15, v_num=1, val_acc=0.704]
Epoch 51:   6%|▌         | 7/117 [00:01<00:18,  6.05it/s, loss=1.15, v_num=1, val_acc=0.704]
Epoch 51:   7%|▋         | 8/117 [00:01<00:15,  6.86it/s, loss=1.15, v_num=1, val_acc=0.704]
Epoch 51:   7%|▋         | 8/117 [00:01<00:16,  6.71it/s, loss=1.15, v_num=1, val_acc=0.704]
Epoch 51:   8%|▊         | 9/117 [00:01<00:14,  7.47it/s, loss=1.15, v_num=1, val_acc=0.704]
Epoch 51:   8%|▊         | 9/117 [00:01<00:14,  7.32it/s, loss=1.15, v_num=1, val_acc=0.704]
Epoch 51:   9%|▊         | 10/117 [00:01<00:13,  8.07it/s, loss=1.15, v_num=1, val_acc=0.704]
Epoch 51:   9%|▊         | 10/117 [00:01<00:13,  7.91it/s, loss=1.14, v_num=1, val_acc=0.704]
Epoch 51:   9%|▉         | 11/117 [00:01<00:12,  8.64it/s, loss=1.14, v_num=1, val_acc=0.704]
Epoch 51:   9%|▉         | 11/117 [00:01<00:12,  8.47it/s, loss=1.13, v_num=1, val_acc=0.704]
Epoch 51:  10%|█         | 12/117 [00:01<00:11,  9.19it/s, loss=1.13, v_num=1, val_acc=0.704]
Epoch 51:  10%|█         | 12/117 [00:01<00:11,  9.01it/s, loss=1.1, v_num=1, val_acc=0.704]
Epoch 51:  11%|█         | 13/117 [00:01<00:10,  9.70it/s, loss=1.1, v_num=1, val_acc=0.704]
Epoch 51:  11%|█         | 13/117 [00:01<00:10,  9.52it/s, loss=1.1, v_num=1, val_acc=0.704]
Epoch 51:  12%|█▏        | 14/117 [00:01<00:10, 10.18it/s, loss=1.1, v_num=1, val_acc=0.704]
Epoch 51:  12%|█▏        | 14/117 [00:01<00:10, 10.00it/s, loss=1.1, v_num=1, val_acc=0.704]
Epoch 51:  13%|█▎        | 15/117 [00:01<00:09, 10.65it/s, loss=1.1, v_num=1, val_acc=0.704]
Epoch 51:  13%|█▎        | 15/117 [00:01<00:09, 10.46it/s, loss=1.09, v_num=1, val_acc=0.704]
Epoch 51:  14%|█▎        | 16/117 [00:01<00:09, 11.09it/s, loss=1.09, v_num=1, val_acc=0.704]
Epoch 51:  14%|█▎        | 16/117 [00:01<00:09, 10.90it/s, loss=1.09, v_num=1, val_acc=0.704]
Epoch 51:  15%|█▍        | 17/117 [00:01<00:08, 11.49it/s, loss=1.09, v_num=1, val_acc=0.704]
Epoch 51:  15%|█▍        | 17/117 [00:01<00:08, 11.30it/s, loss=1.09, v_num=1, val_acc=0.704]
Epoch 51:  15%|█▌        | 18/117 [00:01<00:08, 11.89it/s, loss=1.09, v_num=1, val_acc=0.704]
Epoch 51:  15%|█▌        | 18/117 [00:01<00:08, 11.70it/s, loss=1.08, v_num=1, val_acc=0.704]
Epoch 51:  16%|█▌        | 19/117 [00:01<00:07, 12.28it/s, loss=1.08, v_num=1, val_acc=0.704]
Epoch 51:  16%|█▌        | 19/117 [00:01<00:08, 12.08it/s, loss=1.08, v_num=1, val_acc=0.704]
Epoch 51:  17%|█▋        | 20/117 [00:01<00:07, 12.65it/s, loss=1.08, v_num=1, val_acc=0.704]
Epoch 51:  17%|█▋        | 20/117 [00:01<00:07, 12.45it/s, loss=1.06, v_num=1, val_acc=0.704]
Epoch 51:  18%|█▊        | 21/117 [00:01<00:07, 13.00it/s, loss=1.06, v_num=1, val_acc=0.704]
Epoch 51:  18%|█▊        | 21/117 [00:01<00:07, 12.80it/s, loss=1.05, v_num=1, val_acc=0.704]
Epoch 51:  19%|█▉        | 22/117 [00:01<00:07, 13.34it/s, loss=1.05, v_num=1, val_acc=0.704]
Epoch 51:  19%|█▉        | 22/117 [00:01<00:07, 13.14it/s, loss=1.04, v_num=1, val_acc=0.704]
Epoch 51:  20%|█▉        | 23/117 [00:01<00:06, 13.66it/s, loss=1.04, v_num=1, val_acc=0.704]
Epoch 51:  20%|█▉        | 23/117 [00:01<00:06, 13.46it/s, loss=1.04, v_num=1, val_acc=0.704]
Epoch 51:  21%|██        | 24/117 [00:01<00:06, 13.97it/s, loss=1.04, v_num=1, val_acc=0.704]
Epoch 51:  21%|██        | 24/117 [00:01<00:06, 13.77it/s, loss=1.04, v_num=1, val_acc=0.704]
Epoch 51:  21%|██▏       | 25/117 [00:01<00:06, 14.27it/s, loss=1.04, v_num=1, val_acc=0.704]
Epoch 51:  21%|██▏       | 25/117 [00:01<00:06, 14.06it/s, loss=1.03, v_num=1, val_acc=0.704]
Epoch 51:  22%|██▏       | 26/117 [00:01<00:06, 14.54it/s, loss=1.03, v_num=1, val_acc=0.704]
Epoch 51:  22%|██▏       | 26/117 [00:01<00:06, 14.34it/s, loss=1.03, v_num=1, val_acc=0.704]
Epoch 51:  23%|██▎       | 27/117 [00:01<00:06, 14.82it/s, loss=1.03, v_num=1, val_acc=0.704]
Epoch 51:  23%|██▎       | 27/117 [00:01<00:06, 14.62it/s, loss=1.03, v_num=1, val_acc=0.704]
Epoch 51:  24%|██▍       | 28/117 [00:01<00:05, 15.09it/s, loss=1.03, v_num=1, val_acc=0.704]
Epoch 51:  24%|██▍       | 28/117 [00:01<00:05, 14.89it/s, loss=1.03, v_num=1, val_acc=0.704]
Epoch 51:  25%|██▍       | 29/117 [00:01<00:05, 15.34it/s, loss=1.03, v_num=1, val_acc=0.704]
Epoch 51:  25%|██▍       | 29/117 [00:01<00:05, 15.14it/s, loss=1.02, v_num=1, val_acc=0.704]
Epoch 51:  26%|██▌       | 30/117 [00:01<00:05, 15.59it/s, loss=1.02, v_num=1, val_acc=0.704]
Epoch 51:  26%|██▌       | 30/117 [00:01<00:05, 15.39it/s, loss=1.01, v_num=1, val_acc=0.704]
Epoch 51:  26%|██▋       | 31/117 [00:01<00:05, 15.82it/s, loss=1.01, v_num=1, val_acc=0.704]
Epoch 51:  26%|██▋       | 31/117 [00:01<00:05, 15.62it/s, loss=1, v_num=1, val_acc=0.704]
Epoch 51:  27%|██▋       | 32/117 [00:01<00:05, 16.05it/s, loss=1, v_num=1, val_acc=0.704]
Epoch 51:  27%|██▋       | 32/117 [00:02<00:05, 15.85it/s, loss=1.02, v_num=1, val_acc=0.704]
Epoch 51:  28%|██▊       | 33/117 [00:02<00:05, 16.27it/s, loss=1.02, v_num=1, val_acc=0.704]
Epoch 51:  28%|██▊       | 33/117 [00:02<00:05, 16.07it/s, loss=1.01, v_num=1, val_acc=0.704]
Epoch 51:  29%|██▉       | 34/117 [00:02<00:05, 16.48it/s, loss=1.01, v_num=1, val_acc=0.704]
Epoch 51:  29%|██▉       | 34/117 [00:02<00:05, 16.28it/s, loss=1.04, v_num=1, val_acc=0.704]
Epoch 51:  30%|██▉       | 35/117 [00:02<00:04, 16.69it/s, loss=1.04, v_num=1, val_acc=0.704]
Epoch 51:  30%|██▉       | 35/117 [00:02<00:04, 16.49it/s, loss=1.05, v_num=1, val_acc=0.704]
Epoch 51:  31%|███       | 36/117 [00:02<00:04, 16.87it/s, loss=1.05, v_num=1, val_acc=0.704]
Epoch 51:  31%|███       | 36/117 [00:02<00:04, 16.69it/s, loss=1.06, v_num=1, val_acc=0.704]
Epoch 51:  32%|███▏      | 37/117 [00:02<00:04, 17.08it/s, loss=1.06, v_num=1, val_acc=0.704]
Epoch 51:  32%|███▏      | 37/117 [00:02<00:04, 16.88it/s, loss=1.06, v_num=1, val_acc=0.704]
Epoch 51:  32%|███▏      | 38/117 [00:02<00:04, 17.27it/s, loss=1.06, v_num=1, val_acc=0.704]
Epoch 51:  32%|███▏      | 38/117 [00:02<00:04, 17.07it/s, loss=1.06, v_num=1, val_acc=0.704]
Epoch 51:  33%|███▎      | 39/117 [00:02<00:04, 17.44it/s, loss=1.06, v_num=1, val_acc=0.704]
Epoch 51:  33%|███▎      | 39/117 [00:02<00:04, 17.25it/s, loss=1.07, v_num=1, val_acc=0.704]
Epoch 51:  34%|███▍      | 40/117 [00:02<00:04, 17.62it/s, loss=1.07, v_num=1, val_acc=0.704]
Epoch 51:  34%|███▍      | 40/117 [00:02<00:04, 17.42it/s, loss=1.07, v_num=1, val_acc=0.704]
Epoch 51:  35%|███▌      | 41/117 [00:02<00:04, 17.78it/s, loss=1.07, v_num=1, val_acc=0.704]
Epoch 51:  35%|███▌      | 41/117 [00:02<00:04, 17.59it/s, loss=1.08, v_num=1, val_acc=0.704]
Epoch 51:  36%|███▌      | 42/117 [00:02<00:04, 17.95it/s, loss=1.08, v_num=1, val_acc=0.704]
Epoch 51:  36%|███▌      | 42/117 [00:02<00:04, 17.76it/s, loss=1.09, v_num=1, val_acc=0.704]
Epoch 51:  37%|███▋      | 43/117 [00:02<00:04, 18.11it/s, loss=1.09, v_num=1, val_acc=0.704]
Epoch 51:  37%|███▋      | 43/117 [00:02<00:04, 17.92it/s, loss=1.1, v_num=1, val_acc=0.704]
Epoch 51:  38%|███▊      | 44/117 [00:02<00:03, 18.26it/s, loss=1.1, v_num=1, val_acc=0.704]
Epoch 51:  38%|███▊      | 44/117 [00:02<00:04, 18.07it/s, loss=1.1, v_num=1, val_acc=0.704]
Epoch 51:  38%|███▊      | 45/117 [00:02<00:03, 18.42it/s, loss=1.1, v_num=1, val_acc=0.704]
Epoch 51:  38%|███▊      | 45/117 [00:02<00:03, 18.23it/s, loss=1.11, v_num=1, val_acc=0.704]
Epoch 51:  39%|███▉      | 46/117 [00:02<00:03, 18.56it/s, loss=1.11, v_num=1, val_acc=0.704]
Epoch 51:  39%|███▉      | 46/117 [00:02<00:03, 18.38it/s, loss=1.12, v_num=1, val_acc=0.704]
Epoch 51:  40%|████      | 47/117 [00:02<00:03, 18.71it/s, loss=1.12, v_num=1, val_acc=0.704]
Epoch 51:  40%|████      | 47/117 [00:02<00:03, 18.52it/s, loss=1.13, v_num=1, val_acc=0.704]
Epoch 51:  41%|████      | 48/117 [00:02<00:03, 18.85it/s, loss=1.13, v_num=1, val_acc=0.704]
Epoch 51:  41%|████      | 48/117 [00:02<00:03, 18.66it/s, loss=1.15, v_num=1, val_acc=0.704]
Epoch 51:  42%|████▏     | 49/117 [00:02<00:03, 18.98it/s, loss=1.15, v_num=1, val_acc=0.704]
Epoch 51:  42%|████▏     | 49/117 [00:02<00:03, 18.80it/s, loss=1.14, v_num=1, val_acc=0.704]
Epoch 51:  43%|████▎     | 50/117 [00:02<00:03, 19.11it/s, loss=1.14, v_num=1, val_acc=0.704]
Epoch 51:  43%|████▎     | 50/117 [00:02<00:03, 18.93it/s, loss=1.15, v_num=1, val_acc=0.704]
Epoch 51:  44%|████▎     | 51/117 [00:02<00:03, 19.24it/s, loss=1.15, v_num=1, val_acc=0.704]
Epoch 51:  44%|████▎     | 51/117 [00:02<00:03, 19.06it/s, loss=1.13, v_num=1, val_acc=0.704]
Epoch 51:  44%|████▍     | 52/117 [00:02<00:03, 19.37it/s, loss=1.13, v_num=1, val_acc=0.704]
Epoch 51:  44%|████▍     | 52/117 [00:02<00:03, 19.19it/s, loss=1.1, v_num=1, val_acc=0.704]
Epoch 51:  45%|████▌     | 53/117 [00:02<00:03, 19.48it/s, loss=1.1, v_num=1, val_acc=0.704]
Epoch 51:  45%|████▌     | 53/117 [00:02<00:03, 19.30it/s, loss=1.08, v_num=1, val_acc=0.704]
Epoch 51:  46%|████▌     | 54/117 [00:02<00:03, 19.60it/s, loss=1.08, v_num=1, val_acc=0.704]
Epoch 51:  46%|████▌     | 54/117 [00:02<00:03, 19.42it/s, loss=1.04, v_num=1, val_acc=0.704]
Epoch 51:  47%|████▋     | 55/117 [00:02<00:03, 19.70it/s, loss=1.04, v_num=1, val_acc=0.704]
Epoch 51:  47%|████▋     | 55/117 [00:02<00:03, 19.53it/s, loss=1.03, v_num=1, val_acc=0.704]
Epoch 51:  48%|████▊     | 56/117 [00:02<00:03, 19.82it/s, loss=1.03, v_num=1, val_acc=0.704]
Epoch 51:  48%|████▊     | 56/117 [00:02<00:03, 19.64it/s, loss=1.01, v_num=1, val_acc=0.704]
Epoch 51:  49%|████▊     | 57/117 [00:02<00:03, 19.93it/s, loss=1.01, v_num=1, val_acc=0.704]
Epoch 51:  49%|████▊     | 57/117 [00:02<00:03, 19.75it/s, loss=1.02, v_num=1, val_acc=0.704]
Epoch 51:  50%|████▉     | 58/117 [00:02<00:02, 20.01it/s, loss=1.02, v_num=1, val_acc=0.704]
Epoch 51:  50%|████▉     | 58/117 [00:02<00:02, 19.85it/s, loss=1.03, v_num=1, val_acc=0.704]
Epoch 51:  50%|█████     | 59/117 [00:02<00:02, 20.10it/s, loss=1.03, v_num=1, val_acc=0.704]
Epoch 51:  50%|█████     | 59/117 [00:02<00:02, 19.93it/s, loss=1.05, v_num=1, val_acc=0.704]
Epoch 51:  51%|█████▏    | 60/117 [00:02<00:02, 20.20it/s, loss=1.05, v_num=1, val_acc=0.704]
Epoch 51:  51%|█████▏    | 60/117 [00:02<00:02, 20.03it/s, loss=1.08, v_num=1, val_acc=0.704]
Epoch 51:  52%|█████▏    | 61/117 [00:03<00:02, 20.30it/s, loss=1.08, v_num=1, val_acc=0.704]
Epoch 51:  52%|█████▏    | 61/117 [00:03<00:02, 20.14it/s, loss=1.08, v_num=1, val_acc=0.704]
Epoch 51:  53%|█████▎    | 62/117 [00:03<00:02, 20.40it/s, loss=1.08, v_num=1, val_acc=0.704]
Epoch 51:  53%|█████▎    | 62/117 [00:03<00:02, 20.24it/s, loss=1.08, v_num=1, val_acc=0.704]
Epoch 51:  54%|█████▍    | 63/117 [00:03<00:02, 20.50it/s, loss=1.08, v_num=1, val_acc=0.704]
Epoch 51:  54%|█████▍    | 63/117 [00:03<00:02, 20.33it/s, loss=1.08, v_num=1, val_acc=0.704]
Epoch 51:  55%|█████▍    | 64/117 [00:03<00:02, 20.59it/s, loss=1.08, v_num=1, val_acc=0.704]
Epoch 51:  55%|█████▍    | 64/117 [00:03<00:02, 20.43it/s, loss=1.07, v_num=1, val_acc=0.704]
Epoch 51:  56%|█████▌    | 65/117 [00:03<00:02, 20.69it/s, loss=1.07, v_num=1, val_acc=0.704]
Epoch 51:  56%|█████▌    | 65/117 [00:03<00:02, 20.52it/s, loss=1.07, v_num=1, val_acc=0.704]
Epoch 51:  56%|█████▋    | 66/117 [00:03<00:02, 20.78it/s, loss=1.07, v_num=1, val_acc=0.704]
Epoch 51:  56%|█████▋    | 66/117 [00:03<00:02, 20.61it/s, loss=1.05, v_num=1, val_acc=0.704]
Epoch 51:  57%|█████▋    | 67/117 [00:03<00:02, 20.86it/s, loss=1.05, v_num=1, val_acc=0.704]
Epoch 51:  57%|█████▋    | 67/117 [00:03<00:02, 20.70it/s, loss=1.04, v_num=1, val_acc=0.704]
Epoch 51:  58%|█████▊    | 68/117 [00:03<00:02, 20.95it/s, loss=1.04, v_num=1, val_acc=0.704]
Epoch 51:  58%|█████▊    | 68/117 [00:03<00:02, 20.79it/s, loss=1.01, v_num=1, val_acc=0.704]
Epoch 51:  59%|█████▉    | 69/117 [00:03<00:02, 21.03it/s, loss=1.01, v_num=1, val_acc=0.704]
Epoch 51:  59%|█████▉    | 69/117 [00:03<00:02, 20.87it/s, loss=1.02, v_num=1, val_acc=0.704]
Epoch 51:  60%|█████▉    | 70/117 [00:03<00:02, 21.12it/s, loss=1.02, v_num=1, val_acc=0.704]
Epoch 51:  60%|█████▉    | 70/117 [00:03<00:02, 20.96it/s, loss=1.02, v_num=1, val_acc=0.704]
Epoch 51:  61%|██████    | 71/117 [00:03<00:02, 21.20it/s, loss=1.02, v_num=1, val_acc=0.704]
Epoch 51:  61%|██████    | 71/117 [00:03<00:02, 21.04it/s, loss=1.03, v_num=1, val_acc=0.704]
Epoch 51:  62%|██████▏   | 72/117 [00:03<00:02, 21.28it/s, loss=1.03, v_num=1, val_acc=0.704]
Epoch 51:  62%|██████▏   | 72/117 [00:03<00:02, 21.12it/s, loss=1.05, v_num=1, val_acc=0.704]
Epoch 51:  62%|██████▏   | 73/117 [00:03<00:02, 21.36it/s, loss=1.05, v_num=1, val_acc=0.704]
Epoch 51:  62%|██████▏   | 73/117 [00:03<00:02, 21.20it/s, loss=1.07, v_num=1, val_acc=0.704]
Epoch 51:  63%|██████▎   | 74/117 [00:03<00:02, 21.43it/s, loss=1.07, v_num=1, val_acc=0.704]
Epoch 51:  63%|██████▎   | 74/117 [00:03<00:02, 21.28it/s, loss=1.11, v_num=1, val_acc=0.704]
Epoch 51:  64%|██████▍   | 75/117 [00:03<00:01, 21.51it/s, loss=1.11, v_num=1, val_acc=0.704]
Epoch 51:  64%|██████▍   | 75/117 [00:03<00:01, 21.35it/s, loss=1.1, v_num=1, val_acc=0.704]
Epoch 51:  65%|██████▍   | 76/117 [00:03<00:01, 21.58it/s, loss=1.1, v_num=1, val_acc=0.704]
Epoch 51:  65%|██████▍   | 76/117 [00:03<00:01, 21.43it/s, loss=1.11, v_num=1, val_acc=0.704]
Epoch 51:  66%|██████▌   | 77/117 [00:03<00:01, 21.65it/s, loss=1.11, v_num=1, val_acc=0.704]
Epoch 51:  66%|██████▌   | 77/117 [00:03<00:01, 21.50it/s, loss=1.1, v_num=1, val_acc=0.704]
Epoch 51:  67%|██████▋   | 78/117 [00:03<00:01, 21.72it/s, loss=1.1, v_num=1, val_acc=0.704]
Epoch 51:  67%|██████▋   | 78/117 [00:03<00:01, 21.57it/s, loss=1.09, v_num=1, val_acc=0.704]
Epoch 51:  68%|██████▊   | 79/117 [00:03<00:01, 21.79it/s, loss=1.09, v_num=1, val_acc=0.704]
Epoch 51:  68%|██████▊   | 79/117 [00:03<00:01, 21.64it/s, loss=1.05, v_num=1, val_acc=0.704]
Epoch 51:  68%|██████▊   | 80/117 [00:03<00:01, 21.86it/s, loss=1.05, v_num=1, val_acc=0.704]
Epoch 51:  68%|██████▊   | 80/117 [00:03<00:01, 21.71it/s, loss=1, v_num=1, val_acc=0.704]
Epoch 51:  69%|██████▉   | 81/117 [00:03<00:01, 21.92it/s, loss=1, v_num=1, val_acc=0.704]
Epoch 51:  69%|██████▉   | 81/117 [00:03<00:01, 21.77it/s, loss=0.984, v_num=1, val_acc=0.704]
Epoch 51:  70%|███████   | 82/117 [00:03<00:01, 21.98it/s, loss=0.984, v_num=1, val_acc=0.704]
Epoch 51:  70%|███████   | 82/117 [00:03<00:01, 21.83it/s, loss=0.977, v_num=1, val_acc=0.704]
Epoch 51:  71%|███████   | 83/117 [00:03<00:01, 22.04it/s, loss=0.977, v_num=1, val_acc=0.704]
Epoch 51:  71%|███████   | 83/117 [00:03<00:01, 21.90it/s, loss=0.981, v_num=1, val_acc=0.704]
Epoch 51:  72%|███████▏  | 84/117 [00:03<00:01, 22.11it/s, loss=0.981, v_num=1, val_acc=0.704]
Epoch 51:  72%|███████▏  | 84/117 [00:03<00:01, 21.96it/s, loss=0.979, v_num=1, val_acc=0.704]
Epoch 51:  73%|███████▎  | 85/117 [00:03<00:01, 22.17it/s, loss=0.979, v_num=1, val_acc=0.704]
Epoch 51:  73%|███████▎  | 85/117 [00:03<00:01, 22.03it/s, loss=0.989, v_num=1, val_acc=0.704]
Epoch 51:  74%|███████▎  | 86/117 [00:03<00:01, 22.23it/s, loss=0.989, v_num=1, val_acc=0.704]
Epoch 51:  74%|███████▎  | 86/117 [00:03<00:01, 22.09it/s, loss=1.01, v_num=1, val_acc=0.704]
Epoch 51:  74%|███████▍  | 87/117 [00:03<00:01, 22.29it/s, loss=1.01, v_num=1, val_acc=0.704]
Epoch 51:  74%|███████▍  | 87/117 [00:03<00:01, 22.15it/s, loss=1.05, v_num=1, val_acc=0.704]
Epoch 51:  75%|███████▌  | 88/117 [00:03<00:01, 22.36it/s, loss=1.05, v_num=1, val_acc=0.704]
Epoch 51:  75%|███████▌  | 88/117 [00:03<00:01, 22.21it/s, loss=1.06, v_num=1, val_acc=0.704]
Epoch 51:  76%|███████▌  | 89/117 [00:03<00:01, 22.42it/s, loss=1.06, v_num=1, val_acc=0.704]
Epoch 51:  76%|███████▌  | 89/117 [00:03<00:01, 22.27it/s, loss=1.06, v_num=1, val_acc=0.704]
Epoch 51:  77%|███████▋  | 90/117 [00:04<00:01, 22.47it/s, loss=1.06, v_num=1, val_acc=0.704]
Epoch 51:  77%|███████▋  | 90/117 [00:04<00:01, 22.33it/s, loss=1.07, v_num=1, val_acc=0.704]
Epoch 51:  78%|███████▊  | 91/117 [00:04<00:01, 22.53it/s, loss=1.07, v_num=1, val_acc=0.704]
Epoch 51:  78%|███████▊  | 91/117 [00:04<00:01, 22.39it/s, loss=1.07, v_num=1, val_acc=0.704]
Epoch 51:  79%|███████▊  | 92/117 [00:04<00:01, 22.58it/s, loss=1.07, v_num=1, val_acc=0.704]
Epoch 51:  79%|███████▊  | 92/117 [00:04<00:01, 22.44it/s, loss=1.07, v_num=1, val_acc=0.704]
Epoch 51:  79%|███████▉  | 93/117 [00:04<00:01, 22.64it/s, loss=1.07, v_num=1, val_acc=0.704]
Epoch 51:  79%|███████▉  | 93/117 [00:04<00:01, 22.50it/s, loss=1.08, v_num=1, val_acc=0.704]
Epoch 51:  80%|████████  | 94/117 [00:04<00:01, 22.69it/s, loss=1.08, v_num=1, val_acc=0.704]
Epoch 51:  80%|████████  | 94/117 [00:04<00:01, 22.55it/s, loss=1.07, v_num=1, val_acc=0.704]
Epoch 51:  81%|████████  | 95/117 [00:04<00:00, 22.74it/s, loss=1.07, v_num=1, val_acc=0.704]
Epoch 51:  81%|████████  | 95/117 [00:04<00:00, 22.61it/s, loss=1.11, v_num=1, val_acc=0.704]
Epoch 51:  82%|████████▏ | 96/117 [00:04<00:00, 22.80it/s, loss=1.11, v_num=1, val_acc=0.704]
Epoch 51:  82%|████████▏ | 96/117 [00:04<00:00, 22.66it/s, loss=1.13, v_num=1, val_acc=0.704]
Epoch 51:  83%|████████▎ | 97/117 [00:04<00:00, 22.85it/s, loss=1.13, v_num=1, val_acc=0.704]
Epoch 51:  83%|████████▎ | 97/117 [00:04<00:00, 22.71it/s, loss=1.16, v_num=1, val_acc=0.704]

Validation: 0it [00:00, ?it/s]

Validation:   0%|          | 0/20 [00:00<?, ?it/s]

Validation DataLoader 0:   0%|          | 0/20 [00:00<?, ?it/s]

Validation DataLoader 0:   5%|▌         | 1/20 [00:00<00:00, 158.51it/s]
Epoch 51:  84%|████████▍ | 98/117 [00:05<00:00, 19.17it/s, loss=1.16, v_num=1, val_acc=0.704]

Validation DataLoader 0:  10%|█         | 2/20 [00:00<00:00, 55.08it/s]
Epoch 51:  85%|████████▍ | 99/117 [00:05<00:00, 19.25it/s, loss=1.16, v_num=1, val_acc=0.704]

Validation DataLoader 0:  15%|█▌        | 3/20 [00:00<00:00, 44.00it/s]
Epoch 51:  85%|████████▌ | 100/117 [00:05<00:00, 19.33it/s, loss=1.16, v_num=1, val_acc=0.704]

Validation DataLoader 0:  20%|██        | 4/20 [00:00<00:00, 40.04it/s]
Epoch 51:  86%|████████▋ | 101/117 [00:05<00:00, 19.40it/s, loss=1.16, v_num=1, val_acc=0.704]

Validation DataLoader 0:  25%|██▌       | 5/20 [00:00<00:00, 37.79it/s]
Epoch 51:  87%|████████▋ | 102/117 [00:05<00:00, 19.47it/s, loss=1.16, v_num=1, val_acc=0.704]

Validation DataLoader 0:  30%|███       | 6/20 [00:00<00:00, 36.68it/s]
Epoch 51:  88%|████████▊ | 103/117 [00:05<00:00, 19.54it/s, loss=1.16, v_num=1, val_acc=0.704]

Validation DataLoader 0:  35%|███▌      | 7/20 [00:00<00:00, 35.90it/s]
Epoch 51:  89%|████████▉ | 104/117 [00:05<00:00, 19.62it/s, loss=1.16, v_num=1, val_acc=0.704]

Validation DataLoader 0:  40%|████      | 8/20 [00:00<00:00, 35.29it/s]
Epoch 51:  90%|████████▉ | 105/117 [00:05<00:00, 19.69it/s, loss=1.16, v_num=1, val_acc=0.704]

Validation DataLoader 0:  45%|████▌     | 9/20 [00:00<00:00, 34.73it/s]
Epoch 51:  91%|█████████ | 106/117 [00:05<00:00, 19.76it/s, loss=1.16, v_num=1, val_acc=0.704]

Validation DataLoader 0:  50%|█████     | 10/20 [00:00<00:00, 34.45it/s]
Epoch 51:  91%|█████████▏| 107/117 [00:05<00:00, 19.83it/s, loss=1.16, v_num=1, val_acc=0.704]

Validation DataLoader 0:  55%|█████▌    | 11/20 [00:00<00:00, 34.17it/s]
Epoch 51:  92%|█████████▏| 108/117 [00:05<00:00, 19.90it/s, loss=1.16, v_num=1, val_acc=0.704]

Validation DataLoader 0:  60%|██████    | 12/20 [00:00<00:00, 33.94it/s]
Epoch 51:  93%|█████████▎| 109/117 [00:05<00:00, 19.96it/s, loss=1.16, v_num=1, val_acc=0.704]

Validation DataLoader 0:  65%|██████▌   | 13/20 [00:00<00:00, 33.74it/s]
Epoch 51:  94%|█████████▍| 110/117 [00:05<00:00, 20.03it/s, loss=1.16, v_num=1, val_acc=0.704]

Validation DataLoader 0:  70%|███████   | 14/20 [00:00<00:00, 33.58it/s]
Epoch 51:  95%|█████████▍| 111/117 [00:05<00:00, 20.10it/s, loss=1.16, v_num=1, val_acc=0.704]

Validation DataLoader 0:  75%|███████▌  | 15/20 [00:00<00:00, 33.45it/s]
Epoch 51:  96%|█████████▌| 112/117 [00:05<00:00, 20.16it/s, loss=1.16, v_num=1, val_acc=0.704]

Validation DataLoader 0:  80%|████████  | 16/20 [00:00<00:00, 33.32it/s]
Epoch 51:  97%|█████████▋| 113/117 [00:05<00:00, 20.23it/s, loss=1.16, v_num=1, val_acc=0.704]

Validation DataLoader 0:  85%|████████▌ | 17/20 [00:00<00:00, 33.19it/s]
Epoch 51:  97%|█████████▋| 114/117 [00:05<00:00, 20.29it/s, loss=1.16, v_num=1, val_acc=0.704]

Validation DataLoader 0:  90%|█████████ | 18/20 [00:00<00:00, 33.11it/s]
Epoch 51:  98%|█████████▊| 115/117 [00:05<00:00, 20.35it/s, loss=1.16, v_num=1, val_acc=0.704]

Validation DataLoader 0:  95%|█████████▌| 19/20 [00:00<00:00, 33.02it/s]
Epoch 51:  99%|█████████▉| 116/117 [00:05<00:00, 20.42it/s, loss=1.16, v_num=1, val_acc=0.704]

Validation DataLoader 0: 100%|██████████| 20/20 [00:00<00:00, 33.01it/s]
Epoch 51: 100%|██████████| 117/117 [00:05<00:00, 20.48it/s, loss=1.16, v_num=1, val_acc=0.704]
Epoch 51: 100%|██████████| 117/117 [00:05<00:00, 20.41it/s, loss=1.16, v_num=1, val_acc=0.730]


Epoch 51: 100%|██████████| 117/117 [00:05<00:00, 20.41it/s, loss=1.16, v_num=1, val_acc=0.730]
Epoch 51:   0%|          | 0/117 [00:00<?, ?it/s, loss=1.16, v_num=1, val_acc=0.730]
Epoch 52:   0%|          | 0/117 [00:00<?, ?it/s, loss=1.16, v_num=1, val_acc=0.730]
Epoch 52:   1%|          | 1/117 [00:00<01:46,  1.09it/s, loss=1.16, v_num=1, val_acc=0.730]
Epoch 52:   1%|          | 1/117 [00:00<01:49,  1.06it/s, loss=1.17, v_num=1, val_acc=0.730]
Epoch 52:   2%|▏         | 2/117 [00:00<00:54,  2.10it/s, loss=1.17, v_num=1, val_acc=0.730]
Epoch 52:   2%|▏         | 2/117 [00:00<00:56,  2.05it/s, loss=1.19, v_num=1, val_acc=0.730]
Epoch 52:   3%|▎         | 3/117 [00:00<00:37,  3.01it/s, loss=1.19, v_num=1, val_acc=0.730]
Epoch 52:   3%|▎         | 3/117 [00:01<00:38,  2.94it/s, loss=1.2, v_num=1, val_acc=0.730]
Epoch 52:   3%|▎         | 4/117 [00:01<00:29,  3.89it/s, loss=1.2, v_num=1, val_acc=0.730]
Epoch 52:   3%|▎         | 4/117 [00:01<00:29,  3.79it/s, loss=1.21, v_num=1, val_acc=0.730]
Epoch 52:   4%|▍         | 5/117 [00:01<00:23,  4.69it/s, loss=1.21, v_num=1, val_acc=0.730]
Epoch 52:   4%|▍         | 5/117 [00:01<00:24,  4.59it/s, loss=1.2, v_num=1, val_acc=0.730]
Epoch 52:   5%|▌         | 6/117 [00:01<00:20,  5.46it/s, loss=1.2, v_num=1, val_acc=0.730]
Epoch 52:   5%|▌         | 6/117 [00:01<00:20,  5.34it/s, loss=1.18, v_num=1, val_acc=0.730]
Epoch 52:   6%|▌         | 7/117 [00:01<00:17,  6.18it/s, loss=1.18, v_num=1, val_acc=0.730]
Epoch 52:   6%|▌         | 7/117 [00:01<00:18,  6.04it/s, loss=1.19, v_num=1, val_acc=0.730]
Epoch 52:   7%|▋         | 8/117 [00:01<00:15,  6.85it/s, loss=1.19, v_num=1, val_acc=0.730]
Epoch 52:   7%|▋         | 8/117 [00:01<00:16,  6.70it/s, loss=1.17, v_num=1, val_acc=0.730]
Epoch 52:   8%|▊         | 9/117 [00:01<00:14,  7.48it/s, loss=1.17, v_num=1, val_acc=0.730]
Epoch 52:   8%|▊         | 9/117 [00:01<00:14,  7.32it/s, loss=1.15, v_num=1, val_acc=0.730]
Epoch 52:   9%|▊         | 10/117 [00:01<00:13,  8.07it/s, loss=1.15, v_num=1, val_acc=0.730]
Epoch 52:   9%|▊         | 10/117 [00:01<00:13,  7.91it/s, loss=1.11, v_num=1, val_acc=0.730]
Epoch 52:   9%|▉         | 11/117 [00:01<00:12,  8.64it/s, loss=1.11, v_num=1, val_acc=0.730]
Epoch 52:   9%|▉         | 11/117 [00:01<00:12,  8.47it/s, loss=1.1, v_num=1, val_acc=0.730]
Epoch 52:  10%|█         | 12/117 [00:01<00:11,  9.17it/s, loss=1.1, v_num=1, val_acc=0.730]
Epoch 52:  10%|█         | 12/117 [00:01<00:11,  9.00it/s, loss=1.09, v_num=1, val_acc=0.730]
Epoch 52:  11%|█         | 13/117 [00:01<00:10,  9.69it/s, loss=1.09, v_num=1, val_acc=0.730]
Epoch 52:  11%|█         | 13/117 [00:01<00:10,  9.51it/s, loss=1.11, v_num=1, val_acc=0.730]
Epoch 52:  12%|█▏        | 14/117 [00:01<00:10, 10.18it/s, loss=1.11, v_num=1, val_acc=0.730]
Epoch 52:  12%|█▏        | 14/117 [00:01<00:10,  9.99it/s, loss=1.14, v_num=1, val_acc=0.730]
Epoch 52:  13%|█▎        | 15/117 [00:01<00:09, 10.65it/s, loss=1.14, v_num=1, val_acc=0.730]
Epoch 52:  13%|█▎        | 15/117 [00:01<00:09, 10.46it/s, loss=1.15, v_num=1, val_acc=0.730]
Epoch 52:  14%|█▎        | 16/117 [00:01<00:09, 11.08it/s, loss=1.15, v_num=1, val_acc=0.730]
Epoch 52:  14%|█▎        | 16/117 [00:01<00:09, 10.89it/s, loss=1.15, v_num=1, val_acc=0.730]
Epoch 52:  15%|█▍        | 17/117 [00:01<00:08, 11.50it/s, loss=1.15, v_num=1, val_acc=0.730]
Epoch 52:  15%|█▍        | 17/117 [00:01<00:08, 11.30it/s, loss=1.15, v_num=1, val_acc=0.730]
Epoch 52:  15%|█▌        | 18/117 [00:01<00:08, 11.90it/s, loss=1.15, v_num=1, val_acc=0.730]
Epoch 52:  15%|█▌        | 18/117 [00:01<00:08, 11.70it/s, loss=1.17, v_num=1, val_acc=0.730]
Epoch 52:  16%|█▌        | 19/117 [00:01<00:07, 12.28it/s, loss=1.17, v_num=1, val_acc=0.730]
Epoch 52:  16%|█▌        | 19/117 [00:01<00:08, 12.08it/s, loss=1.15, v_num=1, val_acc=0.730]
Epoch 52:  17%|█▋        | 20/117 [00:01<00:07, 12.64it/s, loss=1.15, v_num=1, val_acc=0.730]
Epoch 52:  17%|█▋        | 20/117 [00:01<00:07, 12.44it/s, loss=1.14, v_num=1, val_acc=0.730]
Epoch 52:  18%|█▊        | 21/117 [00:01<00:07, 13.00it/s, loss=1.14, v_num=1, val_acc=0.730]
Epoch 52:  18%|█▊        | 21/117 [00:01<00:07, 12.80it/s, loss=1.13, v_num=1, val_acc=0.730]
Epoch 52:  19%|█▉        | 22/117 [00:01<00:07, 13.33it/s, loss=1.13, v_num=1, val_acc=0.730]
Epoch 52:  19%|█▉        | 22/117 [00:01<00:07, 13.13it/s, loss=1.11, v_num=1, val_acc=0.730]
Epoch 52:  20%|█▉        | 23/117 [00:01<00:06, 13.66it/s, loss=1.11, v_num=1, val_acc=0.730]
Epoch 52:  20%|█▉        | 23/117 [00:01<00:06, 13.45it/s, loss=1.11, v_num=1, val_acc=0.730]
Epoch 52:  21%|██        | 24/117 [00:01<00:06, 13.96it/s, loss=1.11, v_num=1, val_acc=0.730]
Epoch 52:  21%|██        | 24/117 [00:01<00:06, 13.76it/s, loss=1.11, v_num=1, val_acc=0.730]
Epoch 52:  21%|██▏       | 25/117 [00:01<00:06, 14.26it/s, loss=1.11, v_num=1, val_acc=0.730]
Epoch 52:  21%|██▏       | 25/117 [00:01<00:06, 14.06it/s, loss=1.14, v_num=1, val_acc=0.730]
Epoch 52:  22%|██▏       | 26/117 [00:01<00:06, 14.55it/s, loss=1.14, v_num=1, val_acc=0.730]
Epoch 52:  22%|██▏       | 26/117 [00:01<00:06, 14.34it/s, loss=1.16, v_num=1, val_acc=0.730]
Epoch 52:  23%|██▎       | 27/117 [00:01<00:06, 14.82it/s, loss=1.16, v_num=1, val_acc=0.730]
Epoch 52:  23%|██▎       | 27/117 [00:01<00:06, 14.62it/s, loss=1.17, v_num=1, val_acc=0.730]
Epoch 52:  24%|██▍       | 28/117 [00:01<00:05, 15.09it/s, loss=1.17, v_num=1, val_acc=0.730]
Epoch 52:  24%|██▍       | 28/117 [00:01<00:05, 14.88it/s, loss=1.19, v_num=1, val_acc=0.730]
Epoch 52:  25%|██▍       | 29/117 [00:01<00:05, 15.34it/s, loss=1.19, v_num=1, val_acc=0.730]
Epoch 52:  25%|██▍       | 29/117 [00:01<00:05, 15.14it/s, loss=1.2, v_num=1, val_acc=0.730]
Epoch 52:  26%|██▌       | 30/117 [00:01<00:05, 15.59it/s, loss=1.2, v_num=1, val_acc=0.730]
Epoch 52:  26%|██▌       | 30/117 [00:01<00:05, 15.38it/s, loss=1.21, v_num=1, val_acc=0.730]
Epoch 52:  26%|██▋       | 31/117 [00:01<00:05, 15.82it/s, loss=1.21, v_num=1, val_acc=0.730]
Epoch 52:  26%|██▋       | 31/117 [00:01<00:05, 15.62it/s, loss=1.2, v_num=1, val_acc=0.730]
Epoch 52:  27%|██▋       | 32/117 [00:01<00:05, 16.05it/s, loss=1.2, v_num=1, val_acc=0.730]
Epoch 52:  27%|██▋       | 32/117 [00:02<00:05, 15.85it/s, loss=1.2, v_num=1, val_acc=0.730]
Epoch 52:  28%|██▊       | 33/117 [00:02<00:05, 16.27it/s, loss=1.2, v_num=1, val_acc=0.730]
Epoch 52:  28%|██▊       | 33/117 [00:02<00:05, 16.07it/s, loss=1.19, v_num=1, val_acc=0.730]
Epoch 52:  29%|██▉       | 34/117 [00:02<00:05, 16.49it/s, loss=1.19, v_num=1, val_acc=0.730]
Epoch 52:  29%|██▉       | 34/117 [00:02<00:05, 16.28it/s, loss=1.15, v_num=1, val_acc=0.730]
Epoch 52:  30%|██▉       | 35/117 [00:02<00:04, 16.69it/s, loss=1.15, v_num=1, val_acc=0.730]
Epoch 52:  30%|██▉       | 35/117 [00:02<00:04, 16.49it/s, loss=1.13, v_num=1, val_acc=0.730]
Epoch 52:  31%|███       | 36/117 [00:02<00:04, 16.89it/s, loss=1.13, v_num=1, val_acc=0.730]
Epoch 52:  31%|███       | 36/117 [00:02<00:04, 16.69it/s, loss=1.11, v_num=1, val_acc=0.730]
Epoch 52:  32%|███▏      | 37/117 [00:02<00:04, 17.08it/s, loss=1.11, v_num=1, val_acc=0.730]
Epoch 52:  32%|███▏      | 37/117 [00:02<00:04, 16.89it/s, loss=1.08, v_num=1, val_acc=0.730]
Epoch 52:  32%|███▏      | 38/117 [00:02<00:04, 17.27it/s, loss=1.08, v_num=1, val_acc=0.730]
Epoch 52:  32%|███▏      | 38/117 [00:02<00:04, 17.08it/s, loss=1.03, v_num=1, val_acc=0.730]
Epoch 52:  33%|███▎      | 39/117 [00:02<00:04, 17.45it/s, loss=1.03, v_num=1, val_acc=0.730]
Epoch 52:  33%|███▎      | 39/117 [00:02<00:04, 17.26it/s, loss=1.02, v_num=1, val_acc=0.730]
Epoch 52:  34%|███▍      | 40/117 [00:02<00:04, 17.63it/s, loss=1.02, v_num=1, val_acc=0.730]
Epoch 52:  34%|███▍      | 40/117 [00:02<00:04, 17.44it/s, loss=1, v_num=1, val_acc=0.730]
Epoch 52:  35%|███▌      | 41/117 [00:02<00:04, 17.80it/s, loss=1, v_num=1, val_acc=0.730]
Epoch 52:  35%|███▌      | 41/117 [00:02<00:04, 17.61it/s, loss=0.993, v_num=1, val_acc=0.730]
Epoch 52:  36%|███▌      | 42/117 [00:02<00:04, 17.97it/s, loss=0.993, v_num=1, val_acc=0.730]
Epoch 52:  36%|███▌      | 42/117 [00:02<00:04, 17.77it/s, loss=0.997, v_num=1, val_acc=0.730]
Epoch 52:  37%|███▋      | 43/117 [00:02<00:04, 18.13it/s, loss=0.997, v_num=1, val_acc=0.730]
Epoch 52:  37%|███▋      | 43/117 [00:02<00:04, 17.94it/s, loss=1.01, v_num=1, val_acc=0.730]
Epoch 52:  38%|███▊      | 44/117 [00:02<00:03, 18.28it/s, loss=1.01, v_num=1, val_acc=0.730]
Epoch 52:  38%|███▊      | 44/117 [00:02<00:04, 18.09it/s, loss=1.01, v_num=1, val_acc=0.730]
Epoch 52:  38%|███▊      | 45/117 [00:02<00:03, 18.44it/s, loss=1.01, v_num=1, val_acc=0.730]
Epoch 52:  38%|███▊      | 45/117 [00:02<00:03, 18.25it/s, loss=0.983, v_num=1, val_acc=0.730]
Epoch 52:  39%|███▉      | 46/117 [00:02<00:03, 18.58it/s, loss=0.983, v_num=1, val_acc=0.730]
Epoch 52:  39%|███▉      | 46/117 [00:02<00:03, 18.40it/s, loss=0.957, v_num=1, val_acc=0.730]
Epoch 52:  40%|████      | 47/117 [00:02<00:03, 18.73it/s, loss=0.957, v_num=1, val_acc=0.730]
Epoch 52:  40%|████      | 47/117 [00:02<00:03, 18.54it/s, loss=0.955, v_num=1, val_acc=0.730]
Epoch 52:  41%|████      | 48/117 [00:02<00:03, 18.87it/s, loss=0.955, v_num=1, val_acc=0.730]
Epoch 52:  41%|████      | 48/117 [00:02<00:03, 18.68it/s, loss=0.96, v_num=1, val_acc=0.730]
Epoch 52:  42%|████▏     | 49/117 [00:02<00:03, 19.01it/s, loss=0.96, v_num=1, val_acc=0.730]
Epoch 52:  42%|████▏     | 49/117 [00:02<00:03, 18.82it/s, loss=0.969, v_num=1, val_acc=0.730]
Epoch 52:  43%|████▎     | 50/117 [00:02<00:03, 19.14it/s, loss=0.969, v_num=1, val_acc=0.730]
Epoch 52:  43%|████▎     | 50/117 [00:02<00:03, 18.95it/s, loss=0.982, v_num=1, val_acc=0.730]
Epoch 52:  44%|████▎     | 51/117 [00:02<00:03, 19.27it/s, loss=0.982, v_num=1, val_acc=0.730]
Epoch 52:  44%|████▎     | 51/117 [00:02<00:03, 19.08it/s, loss=1, v_num=1, val_acc=0.730]
Epoch 52:  44%|████▍     | 52/117 [00:02<00:03, 19.39it/s, loss=1, v_num=1, val_acc=0.730]
Epoch 52:  44%|████▍     | 52/117 [00:02<00:03, 19.21it/s, loss=1.02, v_num=1, val_acc=0.730]
Epoch 52:  45%|████▌     | 53/117 [00:02<00:03, 19.52it/s, loss=1.02, v_num=1, val_acc=0.730]
Epoch 52:  45%|████▌     | 53/117 [00:02<00:03, 19.34it/s, loss=1.02, v_num=1, val_acc=0.730]
Epoch 52:  46%|████▌     | 54/117 [00:02<00:03, 19.64it/s, loss=1.02, v_num=1, val_acc=0.730]
Epoch 52:  46%|████▌     | 54/117 [00:02<00:03, 19.46it/s, loss=1.03, v_num=1, val_acc=0.730]
Epoch 52:  47%|████▋     | 55/117 [00:02<00:03, 19.75it/s, loss=1.03, v_num=1, val_acc=0.730]
Epoch 52:  47%|████▋     | 55/117 [00:02<00:03, 19.57it/s, loss=1.05, v_num=1, val_acc=0.730]
Epoch 52:  48%|████▊     | 56/117 [00:02<00:03, 19.87it/s, loss=1.05, v_num=1, val_acc=0.730]
Epoch 52:  48%|████▊     | 56/117 [00:02<00:03, 19.69it/s, loss=1.08, v_num=1, val_acc=0.730]
Epoch 52:  49%|████▊     | 57/117 [00:02<00:03, 19.97it/s, loss=1.08, v_num=1, val_acc=0.730]
Epoch 52:  49%|████▊     | 57/117 [00:02<00:03, 19.80it/s, loss=1.08, v_num=1, val_acc=0.730]
Epoch 52:  50%|████▉     | 58/117 [00:02<00:02, 20.08it/s, loss=1.08, v_num=1, val_acc=0.730]
Epoch 52:  50%|████▉     | 58/117 [00:02<00:02, 19.91it/s, loss=1.09, v_num=1, val_acc=0.730]
Epoch 52:  50%|█████     | 59/117 [00:02<00:02, 20.19it/s, loss=1.09, v_num=1, val_acc=0.730]
Epoch 52:  50%|█████     | 59/117 [00:02<00:02, 20.01it/s, loss=1.09, v_num=1, val_acc=0.730]
Epoch 52:  51%|█████▏    | 60/117 [00:02<00:02, 20.29it/s, loss=1.09, v_num=1, val_acc=0.730]
Epoch 52:  51%|█████▏    | 60/117 [00:02<00:02, 20.12it/s, loss=1.1, v_num=1, val_acc=0.730]
Epoch 52:  52%|█████▏    | 61/117 [00:02<00:02, 20.38it/s, loss=1.1, v_num=1, val_acc=0.730]
Epoch 52:  52%|█████▏    | 61/117 [00:03<00:02, 20.21it/s, loss=1.1, v_num=1, val_acc=0.730]
Epoch 52:  53%|█████▎    | 62/117 [00:03<00:02, 20.48it/s, loss=1.1, v_num=1, val_acc=0.730]
Epoch 52:  53%|█████▎    | 62/117 [00:03<00:02, 20.31it/s, loss=1.1, v_num=1, val_acc=0.730]
Epoch 52:  54%|█████▍    | 63/117 [00:03<00:02, 20.58it/s, loss=1.1, v_num=1, val_acc=0.730]
Epoch 52:  54%|█████▍    | 63/117 [00:03<00:02, 20.41it/s, loss=1.1, v_num=1, val_acc=0.730]
Epoch 52:  55%|█████▍    | 64/117 [00:03<00:02, 20.67it/s, loss=1.1, v_num=1, val_acc=0.730]
Epoch 52:  55%|█████▍    | 64/117 [00:03<00:02, 20.51it/s, loss=1.09, v_num=1, val_acc=0.730]
Epoch 52:  56%|█████▌    | 65/117 [00:03<00:02, 20.77it/s, loss=1.09, v_num=1, val_acc=0.730]
Epoch 52:  56%|█████▌    | 65/117 [00:03<00:02, 20.60it/s, loss=1.11, v_num=1, val_acc=0.730]
Epoch 52:  56%|█████▋    | 66/117 [00:03<00:02, 20.86it/s, loss=1.11, v_num=1, val_acc=0.730]
Epoch 52:  56%|█████▋    | 66/117 [00:03<00:02, 20.69it/s, loss=1.11, v_num=1, val_acc=0.730]
Epoch 52:  57%|█████▋    | 67/117 [00:03<00:02, 20.94it/s, loss=1.11, v_num=1, val_acc=0.730]
Epoch 52:  57%|█████▋    | 67/117 [00:03<00:02, 20.78it/s, loss=1.11, v_num=1, val_acc=0.730]
Epoch 52:  58%|█████▊    | 68/117 [00:03<00:02, 21.03it/s, loss=1.11, v_num=1, val_acc=0.730]
Epoch 52:  58%|█████▊    | 68/117 [00:03<00:02, 20.87it/s, loss=1.1, v_num=1, val_acc=0.730]
Epoch 52:  59%|█████▉    | 69/117 [00:03<00:02, 21.12it/s, loss=1.1, v_num=1, val_acc=0.730]
Epoch 52:  59%|█████▉    | 69/117 [00:03<00:02, 20.95it/s, loss=1.11, v_num=1, val_acc=0.730]
Epoch 52:  60%|█████▉    | 70/117 [00:03<00:02, 21.20it/s, loss=1.11, v_num=1, val_acc=0.730]
Epoch 52:  60%|█████▉    | 70/117 [00:03<00:02, 21.04it/s, loss=1.09, v_num=1, val_acc=0.730]
Epoch 52:  61%|██████    | 71/117 [00:03<00:02, 21.28it/s, loss=1.09, v_num=1, val_acc=0.730]
Epoch 52:  61%|██████    | 71/117 [00:03<00:02, 21.12it/s, loss=1.08, v_num=1, val_acc=0.730]
Epoch 52:  62%|██████▏   | 72/117 [00:03<00:02, 21.36it/s, loss=1.08, v_num=1, val_acc=0.730]
Epoch 52:  62%|██████▏   | 72/117 [00:03<00:02, 21.20it/s, loss=1.07, v_num=1, val_acc=0.730]
Epoch 52:  62%|██████▏   | 73/117 [00:03<00:02, 21.44it/s, loss=1.07, v_num=1, val_acc=0.730]
Epoch 52:  62%|██████▏   | 73/117 [00:03<00:02, 21.28it/s, loss=1.06, v_num=1, val_acc=0.730]
Epoch 52:  63%|██████▎   | 74/117 [00:03<00:01, 21.51it/s, loss=1.06, v_num=1, val_acc=0.730]
Epoch 52:  63%|██████▎   | 74/117 [00:03<00:02, 21.36it/s, loss=1.03, v_num=1, val_acc=0.730]
Epoch 52:  64%|██████▍   | 75/117 [00:03<00:01, 21.59it/s, loss=1.03, v_num=1, val_acc=0.730]
Epoch 52:  64%|██████▍   | 75/117 [00:03<00:01, 21.43it/s, loss=1, v_num=1, val_acc=0.730]
Epoch 52:  65%|██████▍   | 76/117 [00:03<00:01, 21.66it/s, loss=1, v_num=1, val_acc=0.730]
Epoch 52:  65%|██████▍   | 76/117 [00:03<00:01, 21.50it/s, loss=0.983, v_num=1, val_acc=0.730]
Epoch 52:  66%|██████▌   | 77/117 [00:03<00:01, 21.73it/s, loss=0.983, v_num=1, val_acc=0.730]
Epoch 52:  66%|██████▌   | 77/117 [00:03<00:01, 21.58it/s, loss=0.968, v_num=1, val_acc=0.730]
Epoch 52:  67%|██████▋   | 78/117 [00:03<00:01, 21.80it/s, loss=0.968, v_num=1, val_acc=0.730]
Epoch 52:  67%|██████▋   | 78/117 [00:03<00:01, 21.65it/s, loss=0.963, v_num=1, val_acc=0.730]
Epoch 52:  68%|██████▊   | 79/117 [00:03<00:01, 21.87it/s, loss=0.963, v_num=1, val_acc=0.730]
Epoch 52:  68%|██████▊   | 79/117 [00:03<00:01, 21.72it/s, loss=0.984, v_num=1, val_acc=0.730]
Epoch 52:  68%|██████▊   | 80/117 [00:03<00:01, 21.94it/s, loss=0.984, v_num=1, val_acc=0.730]
Epoch 52:  68%|██████▊   | 80/117 [00:03<00:01, 21.79it/s, loss=0.989, v_num=1, val_acc=0.730]
Epoch 52:  69%|██████▉   | 81/117 [00:03<00:01, 22.00it/s, loss=0.989, v_num=1, val_acc=0.730]
Epoch 52:  69%|██████▉   | 81/117 [00:03<00:01, 21.86it/s, loss=0.988, v_num=1, val_acc=0.730]
Epoch 52:  70%|███████   | 82/117 [00:03<00:01, 22.03it/s, loss=0.988, v_num=1, val_acc=0.730]
Epoch 52:  70%|███████   | 82/117 [00:03<00:01, 21.88it/s, loss=0.995, v_num=1, val_acc=0.730]
Epoch 52:  71%|███████   | 83/117 [00:03<00:01, 22.10it/s, loss=0.995, v_num=1, val_acc=0.730]
Epoch 52:  71%|███████   | 83/117 [00:03<00:01, 21.95it/s, loss=0.99, v_num=1, val_acc=0.730]
Epoch 52:  72%|███████▏  | 84/117 [00:03<00:01, 22.16it/s, loss=0.99, v_num=1, val_acc=0.730]
Epoch 52:  72%|███████▏  | 84/117 [00:03<00:01, 22.01it/s, loss=0.993, v_num=1, val_acc=0.730]
Epoch 52:  73%|███████▎  | 85/117 [00:03<00:01, 22.22it/s, loss=0.993, v_num=1, val_acc=0.730]
Epoch 52:  73%|███████▎  | 85/117 [00:03<00:01, 22.08it/s, loss=0.985, v_num=1, val_acc=0.730]
Epoch 52:  74%|███████▎  | 86/117 [00:03<00:01, 22.28it/s, loss=0.985, v_num=1, val_acc=0.730]
Epoch 52:  74%|███████▎  | 86/117 [00:03<00:01, 22.14it/s, loss=1.01, v_num=1, val_acc=0.730]
Epoch 52:  74%|███████▍  | 87/117 [00:03<00:01, 22.35it/s, loss=1.01, v_num=1, val_acc=0.730]
Epoch 52:  74%|███████▍  | 87/117 [00:03<00:01, 22.20it/s, loss=1, v_num=1, val_acc=0.730]
Epoch 52:  75%|███████▌  | 88/117 [00:03<00:01, 22.40it/s, loss=1, v_num=1, val_acc=0.730]
Epoch 52:  75%|███████▌  | 88/117 [00:03<00:01, 22.26it/s, loss=0.994, v_num=1, val_acc=0.730]
Epoch 52:  76%|███████▌  | 89/117 [00:03<00:01, 22.46it/s, loss=0.994, v_num=1, val_acc=0.730]
Epoch 52:  76%|███████▌  | 89/117 [00:03<00:01, 22.32it/s, loss=0.982, v_num=1, val_acc=0.730]
Epoch 52:  77%|███████▋  | 90/117 [00:03<00:01, 22.52it/s, loss=0.982, v_num=1, val_acc=0.730]
Epoch 52:  77%|███████▋  | 90/117 [00:04<00:01, 22.38it/s, loss=0.99, v_num=1, val_acc=0.730]
Epoch 52:  78%|███████▊  | 91/117 [00:04<00:01, 22.57it/s, loss=0.99, v_num=1, val_acc=0.730]
Epoch 52:  78%|███████▊  | 91/117 [00:04<00:01, 22.43it/s, loss=1, v_num=1, val_acc=0.730]
Epoch 52:  79%|███████▊  | 92/117 [00:04<00:01, 22.63it/s, loss=1, v_num=1, val_acc=0.730]
Epoch 52:  79%|███████▊  | 92/117 [00:04<00:01, 22.49it/s, loss=1.01, v_num=1, val_acc=0.730]
Epoch 52:  79%|███████▉  | 93/117 [00:04<00:01, 22.68it/s, loss=1.01, v_num=1, val_acc=0.730]
Epoch 52:  79%|███████▉  | 93/117 [00:04<00:01, 22.54it/s, loss=1.02, v_num=1, val_acc=0.730]
Epoch 52:  80%|████████  | 94/117 [00:04<00:01, 22.74it/s, loss=1.02, v_num=1, val_acc=0.730]
Epoch 52:  80%|████████  | 94/117 [00:04<00:01, 22.60it/s, loss=1.03, v_num=1, val_acc=0.730]
Epoch 52:  81%|████████  | 95/117 [00:04<00:00, 22.79it/s, loss=1.03, v_num=1, val_acc=0.730]
Epoch 52:  81%|████████  | 95/117 [00:04<00:00, 22.65it/s, loss=1.05, v_num=1, val_acc=0.730]
Epoch 52:  82%|████████▏ | 96/117 [00:04<00:00, 22.84it/s, loss=1.05, v_num=1, val_acc=0.730]
Epoch 52:  82%|████████▏ | 96/117 [00:04<00:00, 22.70it/s, loss=1.07, v_num=1, val_acc=0.730]
Epoch 52:  83%|████████▎ | 97/117 [00:04<00:00, 22.89it/s, loss=1.07, v_num=1, val_acc=0.730]
Epoch 52:  83%|████████▎ | 97/117 [00:04<00:00, 22.75it/s, loss=1.08, v_num=1, val_acc=0.730]

Validation: 0it [00:00, ?it/s]

Validation:   0%|          | 0/20 [00:00<?, ?it/s]

Validation DataLoader 0:   0%|          | 0/20 [00:00<?, ?it/s]

Validation DataLoader 0:   5%|▌         | 1/20 [00:00<00:00, 138.68it/s]
Epoch 52:  84%|████████▍ | 98/117 [00:05<00:00, 19.22it/s, loss=1.08, v_num=1, val_acc=0.730]

Validation DataLoader 0:  10%|█         | 2/20 [00:00<00:00, 55.49it/s]
Epoch 52:  85%|████████▍ | 99/117 [00:05<00:00, 19.31it/s, loss=1.08, v_num=1, val_acc=0.730]

Validation DataLoader 0:  15%|█▌        | 3/20 [00:00<00:00, 44.36it/s]
Epoch 52:  85%|████████▌ | 100/117 [00:05<00:00, 19.38it/s, loss=1.08, v_num=1, val_acc=0.730]

Validation DataLoader 0:  20%|██        | 4/20 [00:00<00:00, 40.30it/s]
Epoch 52:  86%|████████▋ | 101/117 [00:05<00:00, 19.46it/s, loss=1.08, v_num=1, val_acc=0.730]

Validation DataLoader 0:  25%|██▌       | 5/20 [00:00<00:00, 38.17it/s]
Epoch 52:  87%|████████▋ | 102/117 [00:05<00:00, 19.53it/s, loss=1.08, v_num=1, val_acc=0.730]

Validation DataLoader 0:  30%|███       | 6/20 [00:00<00:00, 36.91it/s]
Epoch 52:  88%|████████▊ | 103/117 [00:05<00:00, 19.60it/s, loss=1.08, v_num=1, val_acc=0.730]

Validation DataLoader 0:  35%|███▌      | 7/20 [00:00<00:00, 36.04it/s]
Epoch 52:  89%|████████▉ | 104/117 [00:05<00:00, 19.68it/s, loss=1.08, v_num=1, val_acc=0.730]

Validation DataLoader 0:  40%|████      | 8/20 [00:00<00:00, 35.43it/s]
Epoch 52:  90%|████████▉ | 105/117 [00:05<00:00, 19.75it/s, loss=1.08, v_num=1, val_acc=0.730]

Validation DataLoader 0:  45%|████▌     | 9/20 [00:00<00:00, 34.94it/s]
Epoch 52:  91%|█████████ | 106/117 [00:05<00:00, 19.82it/s, loss=1.08, v_num=1, val_acc=0.730]

Validation DataLoader 0:  50%|█████     | 10/20 [00:00<00:00, 34.61it/s]
Epoch 52:  91%|█████████▏| 107/117 [00:05<00:00, 19.89it/s, loss=1.08, v_num=1, val_acc=0.730]

Validation DataLoader 0:  55%|█████▌    | 11/20 [00:00<00:00, 34.34it/s]
Epoch 52:  92%|█████████▏| 108/117 [00:05<00:00, 19.96it/s, loss=1.08, v_num=1, val_acc=0.730]

Validation DataLoader 0:  60%|██████    | 12/20 [00:00<00:00, 34.11it/s]
Epoch 52:  93%|█████████▎| 109/117 [00:05<00:00, 20.02it/s, loss=1.08, v_num=1, val_acc=0.730]

Validation DataLoader 0:  65%|██████▌   | 13/20 [00:00<00:00, 33.89it/s]
Epoch 52:  94%|█████████▍| 110/117 [00:05<00:00, 20.09it/s, loss=1.08, v_num=1, val_acc=0.730]

Validation DataLoader 0:  70%|███████   | 14/20 [00:00<00:00, 33.72it/s]
Epoch 52:  95%|█████████▍| 111/117 [00:05<00:00, 20.16it/s, loss=1.08, v_num=1, val_acc=0.730]

Validation DataLoader 0:  75%|███████▌  | 15/20 [00:00<00:00, 33.57it/s]
Epoch 52:  96%|█████████▌| 112/117 [00:05<00:00, 20.22it/s, loss=1.08, v_num=1, val_acc=0.730]

Validation DataLoader 0:  80%|████████  | 16/20 [00:00<00:00, 33.44it/s]
Epoch 52:  97%|█████████▋| 113/117 [00:05<00:00, 20.29it/s, loss=1.08, v_num=1, val_acc=0.730]

Validation DataLoader 0:  85%|████████▌ | 17/20 [00:00<00:00, 33.30it/s]
Epoch 52:  97%|█████████▋| 114/117 [00:05<00:00, 20.35it/s, loss=1.08, v_num=1, val_acc=0.730]

Validation DataLoader 0:  90%|█████████ | 18/20 [00:00<00:00, 33.20it/s]
Epoch 52:  98%|█████████▊| 115/117 [00:05<00:00, 20.41it/s, loss=1.08, v_num=1, val_acc=0.730]

Validation DataLoader 0:  95%|█████████▌| 19/20 [00:00<00:00, 33.11it/s]
Epoch 52:  99%|█████████▉| 116/117 [00:05<00:00, 20.48it/s, loss=1.08, v_num=1, val_acc=0.730]

Validation DataLoader 0: 100%|██████████| 20/20 [00:00<00:00, 33.10it/s]
Epoch 52: 100%|██████████| 117/117 [00:05<00:00, 20.54it/s, loss=1.08, v_num=1, val_acc=0.730]
Epoch 52: 100%|██████████| 117/117 [00:05<00:00, 20.47it/s, loss=1.08, v_num=1, val_acc=0.730]


Epoch 52: 100%|██████████| 117/117 [00:05<00:00, 20.47it/s, loss=1.08, v_num=1, val_acc=0.730]
Epoch 52:   0%|          | 0/117 [00:00<?, ?it/s, loss=1.08, v_num=1, val_acc=0.730]
Epoch 53:   0%|          | 0/117 [00:00<?, ?it/s, loss=1.08, v_num=1, val_acc=0.730]
Epoch 53:   1%|          | 1/117 [00:00<01:50,  1.05it/s, loss=1.08, v_num=1, val_acc=0.730]
Epoch 53:   1%|          | 1/117 [00:00<01:53,  1.03it/s, loss=1.08, v_num=1, val_acc=0.730]
Epoch 53:   2%|▏         | 2/117 [00:00<00:56,  2.03it/s, loss=1.08, v_num=1, val_acc=0.730]
Epoch 53:   2%|▏         | 2/117 [00:01<00:58,  1.98it/s, loss=1.06, v_num=1, val_acc=0.730]
Epoch 53:   3%|▎         | 3/117 [00:01<00:38,  2.94it/s, loss=1.06, v_num=1, val_acc=0.730]
Epoch 53:   3%|▎         | 3/117 [00:01<00:39,  2.87it/s, loss=1.07, v_num=1, val_acc=0.730]
Epoch 53:   3%|▎         | 4/117 [00:01<00:29,  3.80it/s, loss=1.07, v_num=1, val_acc=0.730]
Epoch 53:   3%|▎         | 4/117 [00:01<00:30,  3.71it/s, loss=1.07, v_num=1, val_acc=0.730]
Epoch 53:   4%|▍         | 5/117 [00:01<00:24,  4.60it/s, loss=1.07, v_num=1, val_acc=0.730]
Epoch 53:   4%|▍         | 5/117 [00:01<00:24,  4.49it/s, loss=1.07, v_num=1, val_acc=0.730]
Epoch 53:   5%|▌         | 6/117 [00:01<00:20,  5.35it/s, loss=1.07, v_num=1, val_acc=0.730]
Epoch 53:   5%|▌         | 6/117 [00:01<00:21,  5.23it/s, loss=1.07, v_num=1, val_acc=0.730]
Epoch 53:   6%|▌         | 7/117 [00:01<00:18,  6.06it/s, loss=1.07, v_num=1, val_acc=0.730]
Epoch 53:   6%|▌         | 7/117 [00:01<00:18,  5.93it/s, loss=1.06, v_num=1, val_acc=0.730]
Epoch 53:   7%|▋         | 8/117 [00:01<00:16,  6.73it/s, loss=1.06, v_num=1, val_acc=0.730]
Epoch 53:   7%|▋         | 8/117 [00:01<00:16,  6.59it/s, loss=1.06, v_num=1, val_acc=0.730]
Epoch 53:   8%|▊         | 9/117 [00:01<00:14,  7.30it/s, loss=1.06, v_num=1, val_acc=0.730]
Epoch 53:   8%|▊         | 9/117 [00:01<00:15,  7.17it/s, loss=1.03, v_num=1, val_acc=0.730]
Epoch 53:   9%|▊         | 10/117 [00:01<00:13,  7.90it/s, loss=1.03, v_num=1, val_acc=0.730]
Epoch 53:   9%|▊         | 10/117 [00:01<00:13,  7.75it/s, loss=1.03, v_num=1, val_acc=0.730]
Epoch 53:   9%|▉         | 11/117 [00:01<00:12,  8.47it/s, loss=1.03, v_num=1, val_acc=0.730]
Epoch 53:   9%|▉         | 11/117 [00:01<00:12,  8.31it/s, loss=1.03, v_num=1, val_acc=0.730]
Epoch 53:  10%|█         | 12/117 [00:01<00:11,  9.00it/s, loss=1.03, v_num=1, val_acc=0.730]
Epoch 53:  10%|█         | 12/117 [00:01<00:11,  8.84it/s, loss=1.03, v_num=1, val_acc=0.730]
Epoch 53:  11%|█         | 13/117 [00:01<00:10,  9.52it/s, loss=1.03, v_num=1, val_acc=0.730]
Epoch 53:  11%|█         | 13/117 [00:01<00:11,  9.34it/s, loss=1.02, v_num=1, val_acc=0.730]
Epoch 53:  12%|█▏        | 14/117 [00:01<00:10, 10.00it/s, loss=1.02, v_num=1, val_acc=0.730]
Epoch 53:  12%|█▏        | 14/117 [00:01<00:10,  9.82it/s, loss=1.01, v_num=1, val_acc=0.730]
Epoch 53:  13%|█▎        | 15/117 [00:01<00:09, 10.46it/s, loss=1.01, v_num=1, val_acc=0.730]
Epoch 53:  13%|█▎        | 15/117 [00:01<00:09, 10.28it/s, loss=0.998, v_num=1, val_acc=0.730]
Epoch 53:  14%|█▎        | 16/117 [00:01<00:09, 10.90it/s, loss=0.998, v_num=1, val_acc=0.730]
Epoch 53:  14%|█▎        | 16/117 [00:01<00:09, 10.71it/s, loss=1, v_num=1, val_acc=0.730]
Epoch 53:  15%|█▍        | 17/117 [00:01<00:08, 11.26it/s, loss=1, v_num=1, val_acc=0.730]
Epoch 53:  15%|█▍        | 17/117 [00:01<00:09, 11.08it/s, loss=1.01, v_num=1, val_acc=0.730]
Epoch 53:  15%|█▌        | 18/117 [00:01<00:08, 11.66it/s, loss=1.01, v_num=1, val_acc=0.730]
Epoch 53:  15%|█▌        | 18/117 [00:01<00:08, 11.48it/s, loss=1, v_num=1, val_acc=0.730]
Epoch 53:  16%|█▌        | 19/117 [00:01<00:08, 12.05it/s, loss=1, v_num=1, val_acc=0.730]
Epoch 53:  16%|█▌        | 19/117 [00:01<00:08, 11.86it/s, loss=0.997, v_num=1, val_acc=0.730]
Epoch 53:  17%|█▋        | 20/117 [00:01<00:07, 12.42it/s, loss=0.997, v_num=1, val_acc=0.730]
Epoch 53:  17%|█▋        | 20/117 [00:01<00:07, 12.22it/s, loss=1.01, v_num=1, val_acc=0.730]
Epoch 53:  18%|█▊        | 21/117 [00:01<00:07, 12.77it/s, loss=1.01, v_num=1, val_acc=0.730]
Epoch 53:  18%|█▊        | 21/117 [00:01<00:07, 12.57it/s, loss=1.04, v_num=1, val_acc=0.730]
Epoch 53:  19%|█▉        | 22/117 [00:01<00:07, 13.09it/s, loss=1.04, v_num=1, val_acc=0.730]
Epoch 53:  19%|█▉        | 22/117 [00:01<00:07, 12.90it/s, loss=1.09, v_num=1, val_acc=0.730]
Epoch 53:  20%|█▉        | 23/117 [00:01<00:07, 13.41it/s, loss=1.09, v_num=1, val_acc=0.730]
Epoch 53:  20%|█▉        | 23/117 [00:01<00:07, 13.22it/s, loss=1.11, v_num=1, val_acc=0.730]
Epoch 53:  21%|██        | 24/117 [00:01<00:06, 13.72it/s, loss=1.11, v_num=1, val_acc=0.730]
Epoch 53:  21%|██        | 24/117 [00:01<00:06, 13.52it/s, loss=1.12, v_num=1, val_acc=0.730]
Epoch 53:  21%|██▏       | 25/117 [00:01<00:06, 14.00it/s, loss=1.12, v_num=1, val_acc=0.730]
Epoch 53:  21%|██▏       | 25/117 [00:01<00:06, 13.80it/s, loss=1.1, v_num=1, val_acc=0.730]
Epoch 53:  22%|██▏       | 26/117 [00:01<00:06, 14.29it/s, loss=1.1, v_num=1, val_acc=0.730]
Epoch 53:  22%|██▏       | 26/117 [00:01<00:06, 14.09it/s, loss=1.1, v_num=1, val_acc=0.730]
Epoch 53:  23%|██▎       | 27/117 [00:01<00:06, 14.57it/s, loss=1.1, v_num=1, val_acc=0.730]
Epoch 53:  23%|██▎       | 27/117 [00:01<00:06, 14.37it/s, loss=1.09, v_num=1, val_acc=0.730]
Epoch 53:  24%|██▍       | 28/117 [00:01<00:05, 14.84it/s, loss=1.09, v_num=1, val_acc=0.730]
Epoch 53:  24%|██▍       | 28/117 [00:01<00:06, 14.64it/s, loss=1.09, v_num=1, val_acc=0.730]
Epoch 53:  25%|██▍       | 29/117 [00:01<00:05, 15.09it/s, loss=1.09, v_num=1, val_acc=0.730]
Epoch 53:  25%|██▍       | 29/117 [00:01<00:05, 14.90it/s, loss=1.09, v_num=1, val_acc=0.730]
Epoch 53:  26%|██▌       | 30/117 [00:01<00:05, 15.33it/s, loss=1.09, v_num=1, val_acc=0.730]
Epoch 53:  26%|██▌       | 30/117 [00:01<00:05, 15.14it/s, loss=1.09, v_num=1, val_acc=0.730]
Epoch 53:  26%|██▋       | 31/117 [00:01<00:05, 15.57it/s, loss=1.09, v_num=1, val_acc=0.730]
Epoch 53:  26%|██▋       | 31/117 [00:02<00:05, 15.37it/s, loss=1.07, v_num=1, val_acc=0.730]
Epoch 53:  27%|██▋       | 32/117 [00:02<00:05, 15.79it/s, loss=1.07, v_num=1, val_acc=0.730]
Epoch 53:  27%|██▋       | 32/117 [00:02<00:05, 15.60it/s, loss=1.07, v_num=1, val_acc=0.730]
Epoch 53:  28%|██▊       | 33/117 [00:02<00:05, 15.97it/s, loss=1.07, v_num=1, val_acc=0.730]
Epoch 53:  28%|██▊       | 33/117 [00:02<00:05, 15.79it/s, loss=1.06, v_num=1, val_acc=0.730]
Epoch 53:  29%|██▉       | 34/117 [00:02<00:05, 16.20it/s, loss=1.06, v_num=1, val_acc=0.730]
Epoch 53:  29%|██▉       | 34/117 [00:02<00:05, 16.01it/s, loss=1.06, v_num=1, val_acc=0.730]
Epoch 53:  30%|██▉       | 35/117 [00:02<00:04, 16.41it/s, loss=1.06, v_num=1, val_acc=0.730]
Epoch 53:  30%|██▉       | 35/117 [00:02<00:05, 16.22it/s, loss=1.05, v_num=1, val_acc=0.730]
Epoch 53:  31%|███       | 36/117 [00:02<00:04, 16.61it/s, loss=1.05, v_num=1, val_acc=0.730]
Epoch 53:  31%|███       | 36/117 [00:02<00:04, 16.42it/s, loss=1.03, v_num=1, val_acc=0.730]
Epoch 53:  32%|███▏      | 37/117 [00:02<00:04, 16.80it/s, loss=1.03, v_num=1, val_acc=0.730]
Epoch 53:  32%|███▏      | 37/117 [00:02<00:04, 16.61it/s, loss=1.01, v_num=1, val_acc=0.730]
Epoch 53:  32%|███▏      | 38/117 [00:02<00:04, 16.99it/s, loss=1.01, v_num=1, val_acc=0.730]
Epoch 53:  32%|███▏      | 38/117 [00:02<00:04, 16.80it/s, loss=1, v_num=1, val_acc=0.730]
Epoch 53:  33%|███▎      | 39/117 [00:02<00:04, 17.17it/s, loss=1, v_num=1, val_acc=0.730]
Epoch 53:  33%|███▎      | 39/117 [00:02<00:04, 16.98it/s, loss=0.984, v_num=1, val_acc=0.730]
Epoch 53:  34%|███▍      | 40/117 [00:02<00:04, 17.35it/s, loss=0.984, v_num=1, val_acc=0.730]
Epoch 53:  34%|███▍      | 40/117 [00:02<00:04, 17.16it/s, loss=0.971, v_num=1, val_acc=0.730]
Epoch 53:  35%|███▌      | 41/117 [00:02<00:04, 17.52it/s, loss=0.971, v_num=1, val_acc=0.730]
Epoch 53:  35%|███▌      | 41/117 [00:02<00:04, 17.33it/s, loss=0.936, v_num=1, val_acc=0.730]
Epoch 53:  36%|███▌      | 42/117 [00:02<00:04, 17.69it/s, loss=0.936, v_num=1, val_acc=0.730]
Epoch 53:  36%|███▌      | 42/117 [00:02<00:04, 17.50it/s, loss=0.891, v_num=1, val_acc=0.730]
Epoch 53:  37%|███▋      | 43/117 [00:02<00:04, 17.85it/s, loss=0.891, v_num=1, val_acc=0.730]
Epoch 53:  37%|███▋      | 43/117 [00:02<00:04, 17.66it/s, loss=0.865, v_num=1, val_acc=0.730]
Epoch 53:  38%|███▊      | 44/117 [00:02<00:04, 18.01it/s, loss=0.865, v_num=1, val_acc=0.730]
Epoch 53:  38%|███▊      | 44/117 [00:02<00:04, 17.82it/s, loss=0.874, v_num=1, val_acc=0.730]
Epoch 53:  38%|███▊      | 45/117 [00:02<00:03, 18.16it/s, loss=0.874, v_num=1, val_acc=0.730]
Epoch 53:  38%|███▊      | 45/117 [00:02<00:04, 17.98it/s, loss=0.887, v_num=1, val_acc=0.730]
Epoch 53:  39%|███▉      | 46/117 [00:02<00:03, 18.31it/s, loss=0.887, v_num=1, val_acc=0.730]
Epoch 53:  39%|███▉      | 46/117 [00:02<00:03, 18.12it/s, loss=0.902, v_num=1, val_acc=0.730]
Epoch 53:  40%|████      | 47/117 [00:02<00:03, 18.45it/s, loss=0.902, v_num=1, val_acc=0.730]
Epoch 53:  40%|████      | 47/117 [00:02<00:03, 18.27it/s, loss=0.906, v_num=1, val_acc=0.730]
Epoch 53:  41%|████      | 48/117 [00:02<00:03, 18.59it/s, loss=0.906, v_num=1, val_acc=0.730]
Epoch 53:  41%|████      | 48/117 [00:02<00:03, 18.41it/s, loss=0.929, v_num=1, val_acc=0.730]
Epoch 53:  42%|████▏     | 49/117 [00:02<00:03, 18.73it/s, loss=0.929, v_num=1, val_acc=0.730]
Epoch 53:  42%|████▏     | 49/117 [00:02<00:03, 18.55it/s, loss=0.94, v_num=1, val_acc=0.730]
Epoch 53:  43%|████▎     | 50/117 [00:02<00:03, 18.86it/s, loss=0.94, v_num=1, val_acc=0.730]
Epoch 53:  43%|████▎     | 50/117 [00:02<00:03, 18.68it/s, loss=0.942, v_num=1, val_acc=0.730]
Epoch 53:  44%|████▎     | 51/117 [00:02<00:03, 18.99it/s, loss=0.942, v_num=1, val_acc=0.730]
Epoch 53:  44%|████▎     | 51/117 [00:02<00:03, 18.81it/s, loss=0.946, v_num=1, val_acc=0.730]
Epoch 53:  44%|████▍     | 52/117 [00:02<00:03, 19.12it/s, loss=0.946, v_num=1, val_acc=0.730]
Epoch 53:  44%|████▍     | 52/117 [00:02<00:03, 18.94it/s, loss=0.957, v_num=1, val_acc=0.730]
Epoch 53:  45%|████▌     | 53/117 [00:02<00:03, 19.24it/s, loss=0.957, v_num=1, val_acc=0.730]
Epoch 53:  45%|████▌     | 53/117 [00:02<00:03, 19.06it/s, loss=0.97, v_num=1, val_acc=0.730]
Epoch 53:  46%|████▌     | 54/117 [00:02<00:03, 19.36it/s, loss=0.97, v_num=1, val_acc=0.730]
Epoch 53:  46%|████▌     | 54/117 [00:02<00:03, 19.19it/s, loss=0.989, v_num=1, val_acc=0.730]
Epoch 53:  47%|████▋     | 55/117 [00:02<00:03, 19.48it/s, loss=0.989, v_num=1, val_acc=0.730]
Epoch 53:  47%|████▋     | 55/117 [00:02<00:03, 19.30it/s, loss=0.992, v_num=1, val_acc=0.730]
Epoch 53:  48%|████▊     | 56/117 [00:02<00:03, 19.59it/s, loss=0.992, v_num=1, val_acc=0.730]
Epoch 53:  48%|████▊     | 56/117 [00:02<00:03, 19.42it/s, loss=0.998, v_num=1, val_acc=0.730]
Epoch 53:  49%|████▊     | 57/117 [00:02<00:03, 19.70it/s, loss=0.998, v_num=1, val_acc=0.730]
Epoch 53:  49%|████▊     | 57/117 [00:02<00:03, 19.53it/s, loss=0.995, v_num=1, val_acc=0.730]
Epoch 53:  50%|████▉     | 58/117 [00:02<00:02, 19.81it/s, loss=0.995, v_num=1, val_acc=0.730]
Epoch 53:  50%|████▉     | 58/117 [00:02<00:03, 19.64it/s, loss=0.998, v_num=1, val_acc=0.730]
Epoch 53:  50%|█████     | 59/117 [00:02<00:02, 19.92it/s, loss=0.998, v_num=1, val_acc=0.730]
Epoch 53:  50%|█████     | 59/117 [00:02<00:02, 19.75it/s, loss=1.01, v_num=1, val_acc=0.730]
Epoch 53:  51%|█████▏    | 60/117 [00:02<00:02, 20.02it/s, loss=1.01, v_num=1, val_acc=0.730]
Epoch 53:  51%|█████▏    | 60/117 [00:03<00:02, 19.85it/s, loss=1.03, v_num=1, val_acc=0.730]
Epoch 53:  52%|█████▏    | 61/117 [00:03<00:02, 20.12it/s, loss=1.03, v_num=1, val_acc=0.730]
Epoch 53:  52%|█████▏    | 61/117 [00:03<00:02, 19.96it/s, loss=1.03, v_num=1, val_acc=0.730]
Epoch 53:  53%|█████▎    | 62/117 [00:03<00:02, 20.22it/s, loss=1.03, v_num=1, val_acc=0.730]
Epoch 53:  53%|█████▎    | 62/117 [00:03<00:02, 20.06it/s, loss=1.03, v_num=1, val_acc=0.730]
Epoch 53:  54%|█████▍    | 63/117 [00:03<00:02, 20.32it/s, loss=1.03, v_num=1, val_acc=0.730]
Epoch 53:  54%|█████▍    | 63/117 [00:03<00:02, 20.16it/s, loss=1.02, v_num=1, val_acc=0.730]
Epoch 53:  55%|█████▍    | 64/117 [00:03<00:02, 20.42it/s, loss=1.02, v_num=1, val_acc=0.730]
Epoch 53:  55%|█████▍    | 64/117 [00:03<00:02, 20.25it/s, loss=1.01, v_num=1, val_acc=0.730]
Epoch 53:  56%|█████▌    | 65/117 [00:03<00:02, 20.51it/s, loss=1.01, v_num=1, val_acc=0.730]
Epoch 53:  56%|█████▌    | 65/117 [00:03<00:02, 20.35it/s, loss=1.01, v_num=1, val_acc=0.730]
Epoch 53:  56%|█████▋    | 66/117 [00:03<00:02, 20.60it/s, loss=1.01, v_num=1, val_acc=0.730]
Epoch 53:  56%|█████▋    | 66/117 [00:03<00:02, 20.44it/s, loss=1.03, v_num=1, val_acc=0.730]
Epoch 53:  57%|█████▋    | 67/117 [00:03<00:02, 20.69it/s, loss=1.03, v_num=1, val_acc=0.730]
Epoch 53:  57%|█████▋    | 67/117 [00:03<00:02, 20.53it/s, loss=1.02, v_num=1, val_acc=0.730]
Epoch 53:  58%|█████▊    | 68/117 [00:03<00:02, 20.78it/s, loss=1.02, v_num=1, val_acc=0.730]
Epoch 53:  58%|█████▊    | 68/117 [00:03<00:02, 20.62it/s, loss=1, v_num=1, val_acc=0.730]
Epoch 53:  59%|█████▉    | 69/117 [00:03<00:02, 20.86it/s, loss=1, v_num=1, val_acc=0.730]
Epoch 53:  59%|█████▉    | 69/117 [00:03<00:02, 20.70it/s, loss=0.992, v_num=1, val_acc=0.730]
Epoch 53:  60%|█████▉    | 70/117 [00:03<00:02, 20.94it/s, loss=0.992, v_num=1, val_acc=0.730]
Epoch 53:  60%|█████▉    | 70/117 [00:03<00:02, 20.79it/s, loss=0.992, v_num=1, val_acc=0.730]
Epoch 53:  61%|██████    | 71/117 [00:03<00:02, 21.03it/s, loss=0.992, v_num=1, val_acc=0.730]
Epoch 53:  61%|██████    | 71/117 [00:03<00:02, 20.87it/s, loss=0.984, v_num=1, val_acc=0.730]
Epoch 53:  62%|██████▏   | 72/117 [00:03<00:02, 21.11it/s, loss=0.984, v_num=1, val_acc=0.730]
Epoch 53:  62%|██████▏   | 72/117 [00:03<00:02, 20.95it/s, loss=0.969, v_num=1, val_acc=0.730]
Epoch 53:  62%|██████▏   | 73/117 [00:03<00:02, 21.19it/s, loss=0.969, v_num=1, val_acc=0.730]
Epoch 53:  62%|██████▏   | 73/117 [00:03<00:02, 21.03it/s, loss=0.958, v_num=1, val_acc=0.730]
Epoch 53:  63%|██████▎   | 74/117 [00:03<00:02, 21.26it/s, loss=0.958, v_num=1, val_acc=0.730]
Epoch 53:  63%|██████▎   | 74/117 [00:03<00:02, 21.11it/s, loss=0.941, v_num=1, val_acc=0.730]
Epoch 53:  64%|██████▍   | 75/117 [00:03<00:01, 21.34it/s, loss=0.941, v_num=1, val_acc=0.730]
Epoch 53:  64%|██████▍   | 75/117 [00:03<00:01, 21.19it/s, loss=0.946, v_num=1, val_acc=0.730]
Epoch 53:  65%|██████▍   | 76/117 [00:03<00:01, 21.42it/s, loss=0.946, v_num=1, val_acc=0.730]
Epoch 53:  65%|██████▍   | 76/117 [00:03<00:01, 21.26it/s, loss=0.959, v_num=1, val_acc=0.730]
Epoch 53:  66%|██████▌   | 77/117 [00:03<00:01, 21.49it/s, loss=0.959, v_num=1, val_acc=0.730]
Epoch 53:  66%|██████▌   | 77/117 [00:03<00:01, 21.34it/s, loss=0.965, v_num=1, val_acc=0.730]
Epoch 53:  67%|██████▋   | 78/117 [00:03<00:01, 21.54it/s, loss=0.965, v_num=1, val_acc=0.730]
Epoch 53:  67%|██████▋   | 78/117 [00:03<00:01, 21.39it/s, loss=0.965, v_num=1, val_acc=0.730]
Epoch 53:  68%|██████▊   | 79/117 [00:03<00:01, 21.62it/s, loss=0.965, v_num=1, val_acc=0.730]
Epoch 53:  68%|██████▊   | 79/117 [00:03<00:01, 21.47it/s, loss=0.954, v_num=1, val_acc=0.730]
Epoch 53:  68%|██████▊   | 80/117 [00:03<00:01, 21.68it/s, loss=0.954, v_num=1, val_acc=0.730]
Epoch 53:  68%|██████▊   | 80/117 [00:03<00:01, 21.54it/s, loss=0.94, v_num=1, val_acc=0.730]
Epoch 53:  69%|██████▉   | 81/117 [00:03<00:01, 21.75it/s, loss=0.94, v_num=1, val_acc=0.730]
Epoch 53:  69%|██████▉   | 81/117 [00:03<00:01, 21.61it/s, loss=0.94, v_num=1, val_acc=0.730]
Epoch 53:  70%|███████   | 82/117 [00:03<00:01, 21.80it/s, loss=0.94, v_num=1, val_acc=0.730]
Epoch 53:  70%|███████   | 82/117 [00:03<00:01, 21.66it/s, loss=0.951, v_num=1, val_acc=0.730]
Epoch 53:  71%|███████   | 83/117 [00:03<00:01, 21.87it/s, loss=0.951, v_num=1, val_acc=0.730]
Epoch 53:  71%|███████   | 83/117 [00:03<00:01, 21.72it/s, loss=0.944, v_num=1, val_acc=0.730]
Epoch 53:  72%|███████▏  | 84/117 [00:03<00:01, 21.94it/s, loss=0.944, v_num=1, val_acc=0.730]
Epoch 53:  72%|███████▏  | 84/117 [00:03<00:01, 21.79it/s, loss=0.948, v_num=1, val_acc=0.730]
Epoch 53:  73%|███████▎  | 85/117 [00:03<00:01, 22.00it/s, loss=0.948, v_num=1, val_acc=0.730]
Epoch 53:  73%|███████▎  | 85/117 [00:03<00:01, 21.86it/s, loss=0.976, v_num=1, val_acc=0.730]
Epoch 53:  74%|███████▎  | 86/117 [00:03<00:01, 22.06it/s, loss=0.976, v_num=1, val_acc=0.730]
Epoch 53:  74%|███████▎  | 86/117 [00:03<00:01, 21.92it/s, loss=0.995, v_num=1, val_acc=0.730]
Epoch 53:  74%|███████▍  | 87/117 [00:03<00:01, 22.12it/s, loss=0.995, v_num=1, val_acc=0.730]
Epoch 53:  74%|███████▍  | 87/117 [00:03<00:01, 21.98it/s, loss=1.01, v_num=1, val_acc=0.730]
Epoch 53:  75%|███████▌  | 88/117 [00:03<00:01, 22.18it/s, loss=1.01, v_num=1, val_acc=0.730]
Epoch 53:  75%|███████▌  | 88/117 [00:03<00:01, 22.04it/s, loss=1.03, v_num=1, val_acc=0.730]
Epoch 53:  76%|███████▌  | 89/117 [00:04<00:01, 22.25it/s, loss=1.03, v_num=1, val_acc=0.730]
Epoch 53:  76%|███████▌  | 89/117 [00:04<00:01, 22.10it/s, loss=1.04, v_num=1, val_acc=0.730]
Epoch 53:  77%|███████▋  | 90/117 [00:04<00:01, 22.31it/s, loss=1.04, v_num=1, val_acc=0.730]
Epoch 53:  77%|███████▋  | 90/117 [00:04<00:01, 22.17it/s, loss=1.03, v_num=1, val_acc=0.730]
Epoch 53:  78%|███████▊  | 91/117 [00:04<00:01, 22.36it/s, loss=1.03, v_num=1, val_acc=0.730]
Epoch 53:  78%|███████▊  | 91/117 [00:04<00:01, 22.22it/s, loss=1.03, v_num=1, val_acc=0.730]
Epoch 53:  79%|███████▊  | 92/117 [00:04<00:01, 22.42it/s, loss=1.03, v_num=1, val_acc=0.730]
Epoch 53:  79%|███████▊  | 92/117 [00:04<00:01, 22.28it/s, loss=1.04, v_num=1, val_acc=0.730]
Epoch 53:  79%|███████▉  | 93/117 [00:04<00:01, 22.47it/s, loss=1.04, v_num=1, val_acc=0.730]
Epoch 53:  79%|███████▉  | 93/117 [00:04<00:01, 22.34it/s, loss=1.04, v_num=1, val_acc=0.730]
Epoch 53:  80%|████████  | 94/117 [00:04<00:01, 22.53it/s, loss=1.04, v_num=1, val_acc=0.730]
Epoch 53:  80%|████████  | 94/117 [00:04<00:01, 22.39it/s, loss=1.05, v_num=1, val_acc=0.730]
Epoch 53:  81%|████████  | 95/117 [00:04<00:00, 22.58it/s, loss=1.05, v_num=1, val_acc=0.730]
Epoch 53:  81%|████████  | 95/117 [00:04<00:00, 22.45it/s, loss=1.04, v_num=1, val_acc=0.730]
Epoch 53:  82%|████████▏ | 96/117 [00:04<00:00, 22.63it/s, loss=1.04, v_num=1, val_acc=0.730]
Epoch 53:  82%|████████▏ | 96/117 [00:04<00:00, 22.50it/s, loss=1.04, v_num=1, val_acc=0.730]
Epoch 53:  83%|████████▎ | 97/117 [00:04<00:00, 22.68it/s, loss=1.04, v_num=1, val_acc=0.730]
Epoch 53:  83%|████████▎ | 97/117 [00:04<00:00, 22.55it/s, loss=1.06, v_num=1, val_acc=0.730]

Validation: 0it [00:00, ?it/s]

Validation:   0%|          | 0/20 [00:00<?, ?it/s]

Validation DataLoader 0:   0%|          | 0/20 [00:00<?, ?it/s]

Validation DataLoader 0:   5%|▌         | 1/20 [00:00<00:00, 186.29it/s]
Epoch 53:  84%|████████▍ | 98/117 [00:05<00:01, 18.99it/s, loss=1.06, v_num=1, val_acc=0.730]

Validation DataLoader 0:  10%|█         | 2/20 [00:00<00:00, 55.80it/s]
Epoch 53:  85%|████████▍ | 99/117 [00:05<00:00, 19.07it/s, loss=1.06, v_num=1, val_acc=0.730]

Validation DataLoader 0:  15%|█▌        | 3/20 [00:00<00:00, 43.19it/s]
Epoch 53:  85%|████████▌ | 100/117 [00:05<00:00, 19.14it/s, loss=1.06, v_num=1, val_acc=0.730]

Validation DataLoader 0:  20%|██        | 4/20 [00:00<00:00, 39.65it/s]
Epoch 53:  86%|████████▋ | 101/117 [00:05<00:00, 19.21it/s, loss=1.06, v_num=1, val_acc=0.730]

Validation DataLoader 0:  25%|██▌       | 5/20 [00:00<00:00, 37.55it/s]
Epoch 53:  87%|████████▋ | 102/117 [00:05<00:00, 19.29it/s, loss=1.06, v_num=1, val_acc=0.730]

Validation DataLoader 0:  30%|███       | 6/20 [00:00<00:00, 36.39it/s]
Epoch 53:  88%|████████▊ | 103/117 [00:05<00:00, 19.36it/s, loss=1.06, v_num=1, val_acc=0.730]

Validation DataLoader 0:  35%|███▌      | 7/20 [00:00<00:00, 35.61it/s]
Epoch 53:  89%|████████▉ | 104/117 [00:05<00:00, 19.43it/s, loss=1.06, v_num=1, val_acc=0.730]

Validation DataLoader 0:  40%|████      | 8/20 [00:00<00:00, 35.07it/s]
Epoch 53:  90%|████████▉ | 105/117 [00:05<00:00, 19.50it/s, loss=1.06, v_num=1, val_acc=0.730]

Validation DataLoader 0:  45%|████▌     | 9/20 [00:00<00:00, 34.65it/s]
Epoch 53:  91%|█████████ | 106/117 [00:05<00:00, 19.57it/s, loss=1.06, v_num=1, val_acc=0.730]

Validation DataLoader 0:  50%|█████     | 10/20 [00:00<00:00, 34.34it/s]
Epoch 53:  91%|█████████▏| 107/117 [00:05<00:00, 19.64it/s, loss=1.06, v_num=1, val_acc=0.730]

Validation DataLoader 0:  55%|█████▌    | 11/20 [00:00<00:00, 34.08it/s]
Epoch 53:  92%|█████████▏| 108/117 [00:05<00:00, 19.71it/s, loss=1.06, v_num=1, val_acc=0.730]

Validation DataLoader 0:  60%|██████    | 12/20 [00:00<00:00, 33.89it/s]
Epoch 53:  93%|█████████▎| 109/117 [00:05<00:00, 19.78it/s, loss=1.06, v_num=1, val_acc=0.730]

Validation DataLoader 0:  65%|██████▌   | 13/20 [00:00<00:00, 33.69it/s]
Epoch 53:  94%|█████████▍| 110/117 [00:05<00:00, 19.85it/s, loss=1.06, v_num=1, val_acc=0.730]

Validation DataLoader 0:  70%|███████   | 14/20 [00:00<00:00, 33.52it/s]
Epoch 53:  95%|█████████▍| 111/117 [00:05<00:00, 19.92it/s, loss=1.06, v_num=1, val_acc=0.730]

Validation DataLoader 0:  75%|███████▌  | 15/20 [00:00<00:00, 33.41it/s]
Epoch 53:  96%|█████████▌| 112/117 [00:05<00:00, 19.98it/s, loss=1.06, v_num=1, val_acc=0.730]

Validation DataLoader 0:  80%|████████  | 16/20 [00:00<00:00, 33.27it/s]
Epoch 53:  97%|█████████▋| 113/117 [00:05<00:00, 20.05it/s, loss=1.06, v_num=1, val_acc=0.730]

Validation DataLoader 0:  85%|████████▌ | 17/20 [00:00<00:00, 33.16it/s]
Epoch 53:  97%|█████████▋| 114/117 [00:05<00:00, 20.11it/s, loss=1.06, v_num=1, val_acc=0.730]

Validation DataLoader 0:  90%|█████████ | 18/20 [00:00<00:00, 33.07it/s]
Epoch 53:  98%|█████████▊| 115/117 [00:05<00:00, 20.18it/s, loss=1.06, v_num=1, val_acc=0.730]

Validation DataLoader 0:  95%|█████████▌| 19/20 [00:00<00:00, 33.00it/s]
Epoch 53:  99%|█████████▉| 116/117 [00:05<00:00, 20.24it/s, loss=1.06, v_num=1, val_acc=0.730]

Validation DataLoader 0: 100%|██████████| 20/20 [00:00<00:00, 33.00it/s]
Epoch 53: 100%|██████████| 117/117 [00:05<00:00, 20.31it/s, loss=1.06, v_num=1, val_acc=0.730]
Epoch 53: 100%|██████████| 117/117 [00:05<00:00, 20.24it/s, loss=1.06, v_num=1, val_acc=0.680]


Epoch 53: 100%|██████████| 117/117 [00:05<00:00, 20.23it/s, loss=1.06, v_num=1, val_acc=0.680]
Epoch 53:   0%|          | 0/117 [00:00<?, ?it/s, loss=1.06, v_num=1, val_acc=0.680]
Epoch 54:   0%|          | 0/117 [00:00<?, ?it/s, loss=1.06, v_num=1, val_acc=0.680]
Epoch 54:   1%|          | 1/117 [00:00<01:50,  1.05it/s, loss=1.06, v_num=1, val_acc=0.680]
Epoch 54:   1%|          | 1/117 [00:00<01:53,  1.02it/s, loss=1.11, v_num=1, val_acc=0.680]
Epoch 54:   2%|▏         | 2/117 [00:00<00:56,  2.03it/s, loss=1.11, v_num=1, val_acc=0.680]
Epoch 54:   2%|▏         | 2/117 [00:01<00:58,  1.98it/s, loss=1.13, v_num=1, val_acc=0.680]
Epoch 54:   3%|▎         | 3/117 [00:01<00:38,  2.94it/s, loss=1.13, v_num=1, val_acc=0.680]
Epoch 54:   3%|▎         | 3/117 [00:01<00:39,  2.87it/s, loss=1.14, v_num=1, val_acc=0.680]
Epoch 54:   3%|▎         | 4/117 [00:01<00:29,  3.79it/s, loss=1.14, v_num=1, val_acc=0.680]
Epoch 54:   3%|▎         | 4/117 [00:01<00:30,  3.70it/s, loss=1.16, v_num=1, val_acc=0.680]
Epoch 54:   4%|▍         | 5/117 [00:01<00:24,  4.59it/s, loss=1.16, v_num=1, val_acc=0.680]
Epoch 54:   4%|▍         | 5/117 [00:01<00:24,  4.49it/s, loss=1.14, v_num=1, val_acc=0.680]
Epoch 54:   5%|▌         | 6/117 [00:01<00:20,  5.35it/s, loss=1.14, v_num=1, val_acc=0.680]
Epoch 54:   5%|▌         | 6/117 [00:01<00:21,  5.23it/s, loss=1.15, v_num=1, val_acc=0.680]
Epoch 54:   6%|▌         | 7/117 [00:01<00:18,  6.06it/s, loss=1.15, v_num=1, val_acc=0.680]
Epoch 54:   6%|▌         | 7/117 [00:01<00:18,  5.93it/s, loss=1.14, v_num=1, val_acc=0.680]
Epoch 54:   7%|▋         | 8/117 [00:01<00:16,  6.73it/s, loss=1.14, v_num=1, val_acc=0.680]
Epoch 54:   7%|▋         | 8/117 [00:01<00:16,  6.59it/s, loss=1.11, v_num=1, val_acc=0.680]
Epoch 54:   8%|▊         | 9/117 [00:01<00:14,  7.30it/s, loss=1.11, v_num=1, val_acc=0.680]
Epoch 54:   8%|▊         | 9/117 [00:01<00:15,  7.17it/s, loss=1.07, v_num=1, val_acc=0.680]
Epoch 54:   9%|▊         | 10/117 [00:01<00:13,  7.90it/s, loss=1.07, v_num=1, val_acc=0.680]
Epoch 54:   9%|▊         | 10/117 [00:01<00:13,  7.74it/s, loss=1.07, v_num=1, val_acc=0.680]
Epoch 54:   9%|▉         | 11/117 [00:01<00:12,  8.47it/s, loss=1.07, v_num=1, val_acc=0.680]
Epoch 54:   9%|▉         | 11/117 [00:01<00:12,  8.30it/s, loss=1.08, v_num=1, val_acc=0.680]
Epoch 54:  10%|█         | 12/117 [00:01<00:11,  9.00it/s, loss=1.08, v_num=1, val_acc=0.680]
Epoch 54:  10%|█         | 12/117 [00:01<00:11,  8.83it/s, loss=1.09, v_num=1, val_acc=0.680]
Epoch 54:  11%|█         | 13/117 [00:01<00:10,  9.50it/s, loss=1.09, v_num=1, val_acc=0.680]
Epoch 54:  11%|█         | 13/117 [00:01<00:11,  9.33it/s, loss=1.09, v_num=1, val_acc=0.680]
Epoch 54:  12%|█▏        | 14/117 [00:01<00:10,  9.99it/s, loss=1.09, v_num=1, val_acc=0.680]
Epoch 54:  12%|█▏        | 14/117 [00:01<00:10,  9.81it/s, loss=1.11, v_num=1, val_acc=0.680]
Epoch 54:  13%|█▎        | 15/117 [00:01<00:09, 10.45it/s, loss=1.11, v_num=1, val_acc=0.680]
Epoch 54:  13%|█▎        | 15/117 [00:01<00:09, 10.27it/s, loss=1.12, v_num=1, val_acc=0.680]
Epoch 54:  14%|█▎        | 16/117 [00:01<00:09, 10.89it/s, loss=1.12, v_num=1, val_acc=0.680]
Epoch 54:  14%|█▎        | 16/117 [00:01<00:09, 10.71it/s, loss=1.13, v_num=1, val_acc=0.680]
Epoch 54:  15%|█▍        | 17/117 [00:01<00:08, 11.29it/s, loss=1.13, v_num=1, val_acc=0.680]
Epoch 54:  15%|█▍        | 17/117 [00:01<00:09, 11.10it/s, loss=1.12, v_num=1, val_acc=0.680]
Epoch 54:  15%|█▌        | 18/117 [00:01<00:08, 11.69it/s, loss=1.12, v_num=1, val_acc=0.680]
Epoch 54:  15%|█▌        | 18/117 [00:01<00:08, 11.50it/s, loss=1.13, v_num=1, val_acc=0.680]
Epoch 54:  16%|█▌        | 19/117 [00:01<00:08, 12.07it/s, loss=1.13, v_num=1, val_acc=0.680]
Epoch 54:  16%|█▌        | 19/117 [00:01<00:08, 11.88it/s, loss=1.12, v_num=1, val_acc=0.680]
Epoch 54:  17%|█▋        | 20/117 [00:01<00:07, 12.44it/s, loss=1.12, v_num=1, val_acc=0.680]
Epoch 54:  17%|█▋        | 20/117 [00:01<00:07, 12.25it/s, loss=1.12, v_num=1, val_acc=0.680]
Epoch 54:  18%|█▊        | 21/117 [00:01<00:07, 12.80it/s, loss=1.12, v_num=1, val_acc=0.680]
Epoch 54:  18%|█▊        | 21/117 [00:01<00:07, 12.60it/s, loss=1.09, v_num=1, val_acc=0.680]
Epoch 54:  19%|█▉        | 22/117 [00:01<00:07, 13.13it/s, loss=1.09, v_num=1, val_acc=0.680]
Epoch 54:  19%|█▉        | 22/117 [00:01<00:07, 12.93it/s, loss=1.08, v_num=1, val_acc=0.680]
Epoch 54:  20%|█▉        | 23/117 [00:01<00:06, 13.45it/s, loss=1.08, v_num=1, val_acc=0.680]
Epoch 54:  20%|█▉        | 23/117 [00:01<00:07, 13.25it/s, loss=1.08, v_num=1, val_acc=0.680]
Epoch 54:  21%|██        | 24/117 [00:01<00:06, 13.76it/s, loss=1.08, v_num=1, val_acc=0.680]
Epoch 54:  21%|██        | 24/117 [00:01<00:06, 13.56it/s, loss=1.06, v_num=1, val_acc=0.680]
Epoch 54:  21%|██▏       | 25/117 [00:01<00:06, 14.05it/s, loss=1.06, v_num=1, val_acc=0.680]
Epoch 54:  21%|██▏       | 25/117 [00:01<00:06, 13.86it/s, loss=1.05, v_num=1, val_acc=0.680]
Epoch 54:  22%|██▏       | 26/117 [00:01<00:06, 14.33it/s, loss=1.05, v_num=1, val_acc=0.680]
Epoch 54:  22%|██▏       | 26/117 [00:01<00:06, 14.13it/s, loss=1.05, v_num=1, val_acc=0.680]
Epoch 54:  23%|██▎       | 27/117 [00:01<00:06, 14.61it/s, loss=1.05, v_num=1, val_acc=0.680]
Epoch 54:  23%|██▎       | 27/117 [00:01<00:06, 14.41it/s, loss=1.03, v_num=1, val_acc=0.680]
Epoch 54:  24%|██▍       | 28/117 [00:01<00:05, 14.88it/s, loss=1.03, v_num=1, val_acc=0.680]
Epoch 54:  24%|██▍       | 28/117 [00:01<00:06, 14.68it/s, loss=1.04, v_num=1, val_acc=0.680]
Epoch 54:  25%|██▍       | 29/117 [00:01<00:05, 15.13it/s, loss=1.04, v_num=1, val_acc=0.680]
Epoch 54:  25%|██▍       | 29/117 [00:01<00:05, 14.94it/s, loss=1.04, v_num=1, val_acc=0.680]
Epoch 54:  26%|██▌       | 30/117 [00:01<00:05, 15.38it/s, loss=1.04, v_num=1, val_acc=0.680]
Epoch 54:  26%|██▌       | 30/117 [00:01<00:05, 15.18it/s, loss=1.06, v_num=1, val_acc=0.680]
Epoch 54:  26%|██▋       | 31/117 [00:01<00:05, 15.61it/s, loss=1.06, v_num=1, val_acc=0.680]
Epoch 54:  26%|██▋       | 31/117 [00:02<00:05, 15.41it/s, loss=1.04, v_num=1, val_acc=0.680]
Epoch 54:  27%|██▋       | 32/117 [00:02<00:05, 15.84it/s, loss=1.04, v_num=1, val_acc=0.680]
Epoch 54:  27%|██▋       | 32/117 [00:02<00:05, 15.64it/s, loss=1.04, v_num=1, val_acc=0.680]
Epoch 54:  28%|██▊       | 33/117 [00:02<00:05, 16.06it/s, loss=1.04, v_num=1, val_acc=0.680]
Epoch 54:  28%|██▊       | 33/117 [00:02<00:05, 15.87it/s, loss=1.04, v_num=1, val_acc=0.680]
Epoch 54:  29%|██▉       | 34/117 [00:02<00:05, 16.27it/s, loss=1.04, v_num=1, val_acc=0.680]
Epoch 54:  29%|██▉       | 34/117 [00:02<00:05, 16.08it/s, loss=1.02, v_num=1, val_acc=0.680]
Epoch 54:  30%|██▉       | 35/117 [00:02<00:04, 16.49it/s, loss=1.02, v_num=1, val_acc=0.680]
Epoch 54:  30%|██▉       | 35/117 [00:02<00:05, 16.29it/s, loss=1.02, v_num=1, val_acc=0.680]
Epoch 54:  31%|███       | 36/117 [00:02<00:04, 16.68it/s, loss=1.02, v_num=1, val_acc=0.680]
Epoch 54:  31%|███       | 36/117 [00:02<00:04, 16.49it/s, loss=1.03, v_num=1, val_acc=0.680]
Epoch 54:  32%|███▏      | 37/117 [00:02<00:04, 16.88it/s, loss=1.03, v_num=1, val_acc=0.680]
Epoch 54:  32%|███▏      | 37/117 [00:02<00:04, 16.69it/s, loss=1.03, v_num=1, val_acc=0.680]
Epoch 54:  32%|███▏      | 38/117 [00:02<00:04, 17.07it/s, loss=1.03, v_num=1, val_acc=0.680]
Epoch 54:  32%|███▏      | 38/117 [00:02<00:04, 16.87it/s, loss=1.02, v_num=1, val_acc=0.680]
Epoch 54:  33%|███▎      | 39/117 [00:02<00:04, 17.25it/s, loss=1.02, v_num=1, val_acc=0.680]
Epoch 54:  33%|███▎      | 39/117 [00:02<00:04, 17.06it/s, loss=1.02, v_num=1, val_acc=0.680]
Epoch 54:  34%|███▍      | 40/117 [00:02<00:04, 17.43it/s, loss=1.02, v_num=1, val_acc=0.680]
Epoch 54:  34%|███▍      | 40/117 [00:02<00:04, 17.24it/s, loss=1.02, v_num=1, val_acc=0.680]
Epoch 54:  35%|███▌      | 41/117 [00:02<00:04, 17.60it/s, loss=1.02, v_num=1, val_acc=0.680]
Epoch 54:  35%|███▌      | 41/117 [00:02<00:04, 17.41it/s, loss=1.03, v_num=1, val_acc=0.680]
Epoch 54:  36%|███▌      | 42/117 [00:02<00:04, 17.77it/s, loss=1.03, v_num=1, val_acc=0.680]
Epoch 54:  36%|███▌      | 42/117 [00:02<00:04, 17.58it/s, loss=1.03, v_num=1, val_acc=0.680]
Epoch 54:  37%|███▋      | 43/117 [00:02<00:04, 17.93it/s, loss=1.03, v_num=1, val_acc=0.680]
Epoch 54:  37%|███▋      | 43/117 [00:02<00:04, 17.74it/s, loss=1.01, v_num=1, val_acc=0.680]
Epoch 54:  38%|███▊      | 44/117 [00:02<00:04, 18.08it/s, loss=1.01, v_num=1, val_acc=0.680]
Epoch 54:  38%|███▊      | 44/117 [00:02<00:04, 17.90it/s, loss=1.02, v_num=1, val_acc=0.680]
Epoch 54:  38%|███▊      | 45/117 [00:02<00:03, 18.24it/s, loss=1.02, v_num=1, val_acc=0.680]
Epoch 54:  38%|███▊      | 45/117 [00:02<00:03, 18.05it/s, loss=1.02, v_num=1, val_acc=0.680]
Epoch 54:  39%|███▉      | 46/117 [00:02<00:03, 18.39it/s, loss=1.02, v_num=1, val_acc=0.680]
Epoch 54:  39%|███▉      | 46/117 [00:02<00:03, 18.20it/s, loss=1.02, v_num=1, val_acc=0.680]
Epoch 54:  40%|████      | 47/117 [00:02<00:03, 18.53it/s, loss=1.02, v_num=1, val_acc=0.680]
Epoch 54:  40%|████      | 47/117 [00:02<00:03, 18.35it/s, loss=1.02, v_num=1, val_acc=0.680]
Epoch 54:  41%|████      | 48/117 [00:02<00:03, 18.67it/s, loss=1.02, v_num=1, val_acc=0.680]
Epoch 54:  41%|████      | 48/117 [00:02<00:03, 18.49it/s, loss=1.01, v_num=1, val_acc=0.680]
Epoch 54:  42%|████▏     | 49/117 [00:02<00:03, 18.81it/s, loss=1.01, v_num=1, val_acc=0.680]
Epoch 54:  42%|████▏     | 49/117 [00:02<00:03, 18.63it/s, loss=0.995, v_num=1, val_acc=0.680]
Epoch 54:  43%|████▎     | 50/117 [00:02<00:03, 18.94it/s, loss=0.995, v_num=1, val_acc=0.680]
Epoch 54:  43%|████▎     | 50/117 [00:02<00:03, 18.76it/s, loss=0.977, v_num=1, val_acc=0.680]
Epoch 54:  44%|████▎     | 51/117 [00:02<00:03, 19.07it/s, loss=0.977, v_num=1, val_acc=0.680]
Epoch 54:  44%|████▎     | 51/117 [00:02<00:03, 18.89it/s, loss=0.99, v_num=1, val_acc=0.680]
Epoch 54:  44%|████▍     | 52/117 [00:02<00:03, 19.20it/s, loss=0.99, v_num=1, val_acc=0.680]
Epoch 54:  44%|████▍     | 52/117 [00:02<00:03, 19.02it/s, loss=0.99, v_num=1, val_acc=0.680]
Epoch 54:  45%|████▌     | 53/117 [00:02<00:03, 19.32it/s, loss=0.99, v_num=1, val_acc=0.680]
Epoch 54:  45%|████▌     | 53/117 [00:02<00:03, 19.15it/s, loss=0.989, v_num=1, val_acc=0.680]
Epoch 54:  46%|████▌     | 54/117 [00:02<00:03, 19.44it/s, loss=0.989, v_num=1, val_acc=0.680]
Epoch 54:  46%|████▌     | 54/117 [00:02<00:03, 19.27it/s, loss=0.983, v_num=1, val_acc=0.680]
Epoch 54:  47%|████▋     | 55/117 [00:02<00:03, 19.56it/s, loss=0.983, v_num=1, val_acc=0.680]
Epoch 54:  47%|████▋     | 55/117 [00:02<00:03, 19.39it/s, loss=0.968, v_num=1, val_acc=0.680]
Epoch 54:  48%|████▊     | 56/117 [00:02<00:03, 19.68it/s, loss=0.968, v_num=1, val_acc=0.680]
Epoch 54:  48%|████▊     | 56/117 [00:02<00:03, 19.50it/s, loss=0.961, v_num=1, val_acc=0.680]
Epoch 54:  49%|████▊     | 57/117 [00:02<00:03, 19.79it/s, loss=0.961, v_num=1, val_acc=0.680]
Epoch 54:  49%|████▊     | 57/117 [00:02<00:03, 19.61it/s, loss=0.959, v_num=1, val_acc=0.680]
Epoch 54:  50%|████▉     | 58/117 [00:02<00:02, 19.90it/s, loss=0.959, v_num=1, val_acc=0.680]
Epoch 54:  50%|████▉     | 58/117 [00:02<00:02, 19.73it/s, loss=0.953, v_num=1, val_acc=0.680]
Epoch 54:  50%|█████     | 59/117 [00:02<00:02, 20.00it/s, loss=0.953, v_num=1, val_acc=0.680]
Epoch 54:  50%|█████     | 59/117 [00:02<00:02, 19.83it/s, loss=0.952, v_num=1, val_acc=0.680]
Epoch 54:  51%|█████▏    | 60/117 [00:02<00:02, 20.11it/s, loss=0.952, v_num=1, val_acc=0.680]
Epoch 54:  51%|█████▏    | 60/117 [00:03<00:02, 19.94it/s, loss=0.937, v_num=1, val_acc=0.680]
Epoch 54:  52%|█████▏    | 61/117 [00:03<00:02, 20.21it/s, loss=0.937, v_num=1, val_acc=0.680]
Epoch 54:  52%|█████▏    | 61/117 [00:03<00:02, 20.04it/s, loss=0.93, v_num=1, val_acc=0.680]
Epoch 54:  53%|█████▎    | 62/117 [00:03<00:02, 20.31it/s, loss=0.93, v_num=1, val_acc=0.680]
Epoch 54:  53%|█████▎    | 62/117 [00:03<00:02, 20.14it/s, loss=0.919, v_num=1, val_acc=0.680]
Epoch 54:  54%|█████▍    | 63/117 [00:03<00:02, 20.40it/s, loss=0.919, v_num=1, val_acc=0.680]
Epoch 54:  54%|█████▍    | 63/117 [00:03<00:02, 20.24it/s, loss=0.925, v_num=1, val_acc=0.680]
Epoch 54:  55%|█████▍    | 64/117 [00:03<00:02, 20.50it/s, loss=0.925, v_num=1, val_acc=0.680]
Epoch 54:  55%|█████▍    | 64/117 [00:03<00:02, 20.33it/s, loss=0.919, v_num=1, val_acc=0.680]
Epoch 54:  56%|█████▌    | 65/117 [00:03<00:02, 20.59it/s, loss=0.919, v_num=1, val_acc=0.680]
Epoch 54:  56%|█████▌    | 65/117 [00:03<00:02, 20.42it/s, loss=0.925, v_num=1, val_acc=0.680]
Epoch 54:  56%|█████▋    | 66/117 [00:03<00:02, 20.68it/s, loss=0.925, v_num=1, val_acc=0.680]
Epoch 54:  56%|█████▋    | 66/117 [00:03<00:02, 20.52it/s, loss=0.94, v_num=1, val_acc=0.680]
Epoch 54:  57%|█████▋    | 67/117 [00:03<00:02, 20.77it/s, loss=0.94, v_num=1, val_acc=0.680]
Epoch 54:  57%|█████▋    | 67/117 [00:03<00:02, 20.60it/s, loss=0.981, v_num=1, val_acc=0.680]
Epoch 54:  58%|█████▊    | 68/117 [00:03<00:02, 20.85it/s, loss=0.981, v_num=1, val_acc=0.680]
Epoch 54:  58%|█████▊    | 68/117 [00:03<00:02, 20.69it/s, loss=0.996, v_num=1, val_acc=0.680]
Epoch 54:  59%|█████▉    | 69/117 [00:03<00:02, 20.94it/s, loss=0.996, v_num=1, val_acc=0.680]
Epoch 54:  59%|█████▉    | 69/117 [00:03<00:02, 20.78it/s, loss=0.996, v_num=1, val_acc=0.680]
Epoch 54:  60%|█████▉    | 70/117 [00:03<00:02, 21.02it/s, loss=0.996, v_num=1, val_acc=0.680]
Epoch 54:  60%|█████▉    | 70/117 [00:03<00:02, 20.86it/s, loss=0.991, v_num=1, val_acc=0.680]
Epoch 54:  61%|██████    | 71/117 [00:03<00:02, 21.11it/s, loss=0.991, v_num=1, val_acc=0.680]
Epoch 54:  61%|██████    | 71/117 [00:03<00:02, 20.95it/s, loss=0.96, v_num=1, val_acc=0.680]
Epoch 54:  62%|██████▏   | 72/117 [00:03<00:02, 21.19it/s, loss=0.96, v_num=1, val_acc=0.680]
Epoch 54:  62%|██████▏   | 72/117 [00:03<00:02, 21.03it/s, loss=0.944, v_num=1, val_acc=0.680]
Epoch 54:  62%|██████▏   | 73/117 [00:03<00:02, 21.26it/s, loss=0.944, v_num=1, val_acc=0.680]
Epoch 54:  62%|██████▏   | 73/117 [00:03<00:02, 21.10it/s, loss=0.944, v_num=1, val_acc=0.680]
Epoch 54:  63%|██████▎   | 74/117 [00:03<00:02, 21.34it/s, loss=0.944, v_num=1, val_acc=0.680]
Epoch 54:  63%|██████▎   | 74/117 [00:03<00:02, 21.18it/s, loss=0.948, v_num=1, val_acc=0.680]
Epoch 54:  64%|██████▍   | 75/117 [00:03<00:01, 21.41it/s, loss=0.948, v_num=1, val_acc=0.680]
Epoch 54:  64%|██████▍   | 75/117 [00:03<00:01, 21.26it/s, loss=0.965, v_num=1, val_acc=0.680]
Epoch 54:  65%|██████▍   | 76/117 [00:03<00:01, 21.49it/s, loss=0.965, v_num=1, val_acc=0.680]
Epoch 54:  65%|██████▍   | 76/117 [00:03<00:01, 21.33it/s, loss=0.97, v_num=1, val_acc=0.680]
Epoch 54:  66%|██████▌   | 77/117 [00:03<00:01, 21.56it/s, loss=0.97, v_num=1, val_acc=0.680]
Epoch 54:  66%|██████▌   | 77/117 [00:03<00:01, 21.41it/s, loss=0.973, v_num=1, val_acc=0.680]
Epoch 54:  67%|██████▋   | 78/117 [00:03<00:01, 21.63it/s, loss=0.973, v_num=1, val_acc=0.680]
Epoch 54:  67%|██████▋   | 78/117 [00:03<00:01, 21.48it/s, loss=0.985, v_num=1, val_acc=0.680]
Epoch 54:  68%|██████▊   | 79/117 [00:03<00:01, 21.70it/s, loss=0.985, v_num=1, val_acc=0.680]
Epoch 54:  68%|██████▊   | 79/117 [00:03<00:01, 21.55it/s, loss=0.993, v_num=1, val_acc=0.680]
Epoch 54:  68%|██████▊   | 80/117 [00:03<00:01, 21.77it/s, loss=0.993, v_num=1, val_acc=0.680]
Epoch 54:  68%|██████▊   | 80/117 [00:03<00:01, 21.62it/s, loss=0.993, v_num=1, val_acc=0.680]
Epoch 54:  69%|██████▉   | 81/117 [00:03<00:01, 21.84it/s, loss=0.993, v_num=1, val_acc=0.680]
Epoch 54:  69%|██████▉   | 81/117 [00:03<00:01, 21.69it/s, loss=0.98, v_num=1, val_acc=0.680]
Epoch 54:  70%|███████   | 82/117 [00:03<00:01, 21.89it/s, loss=0.98, v_num=1, val_acc=0.680]
Epoch 54:  70%|███████   | 82/117 [00:03<00:01, 21.74it/s, loss=0.967, v_num=1, val_acc=0.680]
Epoch 54:  71%|███████   | 83/117 [00:03<00:01, 21.96it/s, loss=0.967, v_num=1, val_acc=0.680]
Epoch 54:  71%|███████   | 83/117 [00:03<00:01, 21.81it/s, loss=0.98, v_num=1, val_acc=0.680]
Epoch 54:  72%|███████▏  | 84/117 [00:03<00:01, 22.02it/s, loss=0.98, v_num=1, val_acc=0.680]
Epoch 54:  72%|███████▏  | 84/117 [00:03<00:01, 21.88it/s, loss=0.989, v_num=1, val_acc=0.680]
Epoch 54:  73%|███████▎  | 85/117 [00:03<00:01, 22.08it/s, loss=0.989, v_num=1, val_acc=0.680]
Epoch 54:  73%|███████▎  | 85/117 [00:03<00:01, 21.94it/s, loss=1.01, v_num=1, val_acc=0.680]
Epoch 54:  74%|███████▎  | 86/117 [00:03<00:01, 22.15it/s, loss=1.01, v_num=1, val_acc=0.680]
Epoch 54:  74%|███████▎  | 86/117 [00:03<00:01, 22.00it/s, loss=0.998, v_num=1, val_acc=0.680]
Epoch 54:  74%|███████▍  | 87/117 [00:03<00:01, 22.21it/s, loss=0.998, v_num=1, val_acc=0.680]
Epoch 54:  74%|███████▍  | 87/117 [00:03<00:01, 22.07it/s, loss=0.999, v_num=1, val_acc=0.680]
Epoch 54:  75%|███████▌  | 88/117 [00:03<00:01, 22.26it/s, loss=0.999, v_num=1, val_acc=0.680]
Epoch 54:  75%|███████▌  | 88/117 [00:03<00:01, 22.12it/s, loss=1, v_num=1, val_acc=0.680]
Epoch 54:  76%|███████▌  | 89/117 [00:03<00:01, 22.32it/s, loss=1, v_num=1, val_acc=0.680]
Epoch 54:  76%|███████▌  | 89/117 [00:04<00:01, 22.18it/s, loss=0.997, v_num=1, val_acc=0.680]
Epoch 54:  77%|███████▋  | 90/117 [00:04<00:01, 22.38it/s, loss=0.997, v_num=1, val_acc=0.680]
Epoch 54:  77%|███████▋  | 90/117 [00:04<00:01, 22.24it/s, loss=0.987, v_num=1, val_acc=0.680]
Epoch 54:  78%|███████▊  | 91/117 [00:04<00:01, 22.43it/s, loss=0.987, v_num=1, val_acc=0.680]
Epoch 54:  78%|███████▊  | 91/117 [00:04<00:01, 22.29it/s, loss=0.989, v_num=1, val_acc=0.680]
Epoch 54:  79%|███████▊  | 92/117 [00:04<00:01, 22.47it/s, loss=0.989, v_num=1, val_acc=0.680]
Epoch 54:  79%|███████▊  | 92/117 [00:04<00:01, 22.34it/s, loss=0.993, v_num=1, val_acc=0.680]
Epoch 54:  79%|███████▉  | 93/117 [00:04<00:01, 22.53it/s, loss=0.993, v_num=1, val_acc=0.680]
Epoch 54:  79%|███████▉  | 93/117 [00:04<00:01, 22.39it/s, loss=0.985, v_num=1, val_acc=0.680]
Epoch 54:  80%|████████  | 94/117 [00:04<00:01, 22.58it/s, loss=0.985, v_num=1, val_acc=0.680]
Epoch 54:  80%|████████  | 94/117 [00:04<00:01, 22.45it/s, loss=0.979, v_num=1, val_acc=0.680]
Epoch 54:  81%|████████  | 95/117 [00:04<00:00, 22.64it/s, loss=0.979, v_num=1, val_acc=0.680]
Epoch 54:  81%|████████  | 95/117 [00:04<00:00, 22.50it/s, loss=0.968, v_num=1, val_acc=0.680]
Epoch 54:  82%|████████▏ | 96/117 [00:04<00:00, 22.69it/s, loss=0.968, v_num=1, val_acc=0.680]
Epoch 54:  82%|████████▏ | 96/117 [00:04<00:00, 22.55it/s, loss=0.952, v_num=1, val_acc=0.680]
Epoch 54:  83%|████████▎ | 97/117 [00:04<00:00, 22.74it/s, loss=0.952, v_num=1, val_acc=0.680]
Epoch 54:  83%|████████▎ | 97/117 [00:04<00:00, 22.61it/s, loss=0.956, v_num=1, val_acc=0.680]

Validation: 0it [00:00, ?it/s]

Validation:   0%|          | 0/20 [00:00<?, ?it/s]

Validation DataLoader 0:   0%|          | 0/20 [00:00<?, ?it/s]

Validation DataLoader 0:   5%|▌         | 1/20 [00:00<00:00, 130.90it/s]
Epoch 54:  84%|████████▍ | 98/117 [00:05<00:00, 19.07it/s, loss=0.956, v_num=1, val_acc=0.680]

Validation DataLoader 0:  10%|█         | 2/20 [00:00<00:00, 54.83it/s]
Epoch 54:  85%|████████▍ | 99/117 [00:05<00:00, 19.16it/s, loss=0.956, v_num=1, val_acc=0.680]

Validation DataLoader 0:  15%|█▌        | 3/20 [00:00<00:00, 43.88it/s]
Epoch 54:  85%|████████▌ | 100/117 [00:05<00:00, 19.23it/s, loss=0.956, v_num=1, val_acc=0.680]

Validation DataLoader 0:  20%|██        | 4/20 [00:00<00:00, 39.98it/s]
Epoch 54:  86%|████████▋ | 101/117 [00:05<00:00, 19.31it/s, loss=0.956, v_num=1, val_acc=0.680]

Validation DataLoader 0:  25%|██▌       | 5/20 [00:00<00:00, 37.80it/s]
Epoch 54:  87%|████████▋ | 102/117 [00:05<00:00, 19.38it/s, loss=0.956, v_num=1, val_acc=0.680]

Validation DataLoader 0:  30%|███       | 6/20 [00:00<00:00, 36.58it/s]
Epoch 54:  88%|████████▊ | 103/117 [00:05<00:00, 19.45it/s, loss=0.956, v_num=1, val_acc=0.680]

Validation DataLoader 0:  35%|███▌      | 7/20 [00:00<00:00, 35.67it/s]
Epoch 54:  89%|████████▉ | 104/117 [00:05<00:00, 19.52it/s, loss=0.956, v_num=1, val_acc=0.680]

Validation DataLoader 0:  40%|████      | 8/20 [00:00<00:00, 35.16it/s]
Epoch 54:  90%|████████▉ | 105/117 [00:05<00:00, 19.60it/s, loss=0.956, v_num=1, val_acc=0.680]

Validation DataLoader 0:  45%|████▌     | 9/20 [00:00<00:00, 34.69it/s]
Epoch 54:  91%|█████████ | 106/117 [00:05<00:00, 19.67it/s, loss=0.956, v_num=1, val_acc=0.680]

Validation DataLoader 0:  50%|█████     | 10/20 [00:00<00:00, 34.37it/s]
Epoch 54:  91%|█████████▏| 107/117 [00:05<00:00, 19.74it/s, loss=0.956, v_num=1, val_acc=0.680]

Validation DataLoader 0:  55%|█████▌    | 11/20 [00:00<00:00, 34.13it/s]
Epoch 54:  92%|█████████▏| 108/117 [00:05<00:00, 19.81it/s, loss=0.956, v_num=1, val_acc=0.680]

Validation DataLoader 0:  60%|██████    | 12/20 [00:00<00:00, 33.91it/s]
Epoch 54:  93%|█████████▎| 109/117 [00:05<00:00, 19.87it/s, loss=0.956, v_num=1, val_acc=0.680]

Validation DataLoader 0:  65%|██████▌   | 13/20 [00:00<00:00, 33.70it/s]
Epoch 54:  94%|█████████▍| 110/117 [00:05<00:00, 19.94it/s, loss=0.956, v_num=1, val_acc=0.680]

Validation DataLoader 0:  70%|███████   | 14/20 [00:00<00:00, 33.55it/s]
Epoch 54:  95%|█████████▍| 111/117 [00:05<00:00, 20.01it/s, loss=0.956, v_num=1, val_acc=0.680]

Validation DataLoader 0:  75%|███████▌  | 15/20 [00:00<00:00, 33.41it/s]
Epoch 54:  96%|█████████▌| 112/117 [00:05<00:00, 20.07it/s, loss=0.956, v_num=1, val_acc=0.680]

Validation DataLoader 0:  80%|████████  | 16/20 [00:00<00:00, 33.29it/s]
Epoch 54:  97%|█████████▋| 113/117 [00:05<00:00, 20.14it/s, loss=0.956, v_num=1, val_acc=0.680]

Validation DataLoader 0:  85%|████████▌ | 17/20 [00:00<00:00, 33.18it/s]
Epoch 54:  97%|█████████▋| 114/117 [00:05<00:00, 20.20it/s, loss=0.956, v_num=1, val_acc=0.680]

Validation DataLoader 0:  90%|█████████ | 18/20 [00:00<00:00, 33.08it/s]
Epoch 54:  98%|█████████▊| 115/117 [00:05<00:00, 20.26it/s, loss=0.956, v_num=1, val_acc=0.680]

Validation DataLoader 0:  95%|█████████▌| 19/20 [00:00<00:00, 33.00it/s]
Epoch 54:  99%|█████████▉| 116/117 [00:05<00:00, 20.33it/s, loss=0.956, v_num=1, val_acc=0.680]

Validation DataLoader 0: 100%|██████████| 20/20 [00:00<00:00, 33.00it/s]
Epoch 54: 100%|██████████| 117/117 [00:05<00:00, 20.39it/s, loss=0.956, v_num=1, val_acc=0.680]
Epoch 54: 100%|██████████| 117/117 [00:05<00:00, 20.32it/s, loss=0.956, v_num=1, val_acc=0.720]


Epoch 54: 100%|██████████| 117/117 [00:05<00:00, 20.32it/s, loss=0.956, v_num=1, val_acc=0.720]
Epoch 54:   0%|          | 0/117 [00:00<?, ?it/s, loss=0.956, v_num=1, val_acc=0.720]
Epoch 55:   0%|          | 0/117 [00:00<?, ?it/s, loss=0.956, v_num=1, val_acc=0.720]
Epoch 55:   1%|          | 1/117 [00:00<01:45,  1.10it/s, loss=0.956, v_num=1, val_acc=0.720]
Epoch 55:   1%|          | 1/117 [00:00<01:48,  1.07it/s, loss=0.961, v_num=1, val_acc=0.720]
Epoch 55:   2%|▏         | 2/117 [00:00<00:54,  2.11it/s, loss=0.961, v_num=1, val_acc=0.720]
Epoch 55:   2%|▏         | 2/117 [00:00<00:55,  2.06it/s, loss=0.99, v_num=1, val_acc=0.720]
Epoch 55:   3%|▎         | 3/117 [00:00<00:37,  3.06it/s, loss=0.99, v_num=1, val_acc=0.720]
Epoch 55:   3%|▎         | 3/117 [00:01<00:38,  2.98it/s, loss=0.997, v_num=1, val_acc=0.720]
Epoch 55:   3%|▎         | 4/117 [00:01<00:28,  3.94it/s, loss=0.997, v_num=1, val_acc=0.720]
Epoch 55:   3%|▎         | 4/117 [00:01<00:29,  3.85it/s, loss=1, v_num=1, val_acc=0.720]
Epoch 55:   4%|▍         | 5/117 [00:01<00:23,  4.77it/s, loss=1, v_num=1, val_acc=0.720]
Epoch 55:   4%|▍         | 5/117 [00:01<00:24,  4.66it/s, loss=1, v_num=1, val_acc=0.720]
Epoch 55:   5%|▌         | 6/117 [00:01<00:20,  5.54it/s, loss=1, v_num=1, val_acc=0.720]
Epoch 55:   5%|▌         | 6/117 [00:01<00:20,  5.42it/s, loss=0.984, v_num=1, val_acc=0.720]
Epoch 55:   6%|▌         | 7/117 [00:01<00:17,  6.27it/s, loss=0.984, v_num=1, val_acc=0.720]
Epoch 55:   6%|▌         | 7/117 [00:01<00:17,  6.13it/s, loss=0.974, v_num=1, val_acc=0.720]
Epoch 55:   7%|▋         | 8/117 [00:01<00:15,  6.96it/s, loss=0.974, v_num=1, val_acc=0.720]
Epoch 55:   7%|▋         | 8/117 [00:01<00:16,  6.81it/s, loss=0.946, v_num=1, val_acc=0.720]
Epoch 55:   8%|▊         | 9/117 [00:01<00:14,  7.60it/s, loss=0.946, v_num=1, val_acc=0.720]
Epoch 55:   8%|▊         | 9/117 [00:01<00:14,  7.44it/s, loss=0.933, v_num=1, val_acc=0.720]
Epoch 55:   9%|▊         | 10/117 [00:01<00:13,  8.16it/s, loss=0.933, v_num=1, val_acc=0.720]
Epoch 55:   9%|▊         | 10/117 [00:01<00:13,  8.00it/s, loss=0.892, v_num=1, val_acc=0.720]
Epoch 55:   9%|▉         | 11/117 [00:01<00:12,  8.74it/s, loss=0.892, v_num=1, val_acc=0.720]
Epoch 55:   9%|▉         | 11/117 [00:01<00:12,  8.57it/s, loss=0.882, v_num=1, val_acc=0.720]
Epoch 55:  10%|█         | 12/117 [00:01<00:11,  9.29it/s, loss=0.882, v_num=1, val_acc=0.720]
Epoch 55:  10%|█         | 12/117 [00:01<00:11,  9.11it/s, loss=0.887, v_num=1, val_acc=0.720]
Epoch 55:  11%|█         | 13/117 [00:01<00:10,  9.81it/s, loss=0.887, v_num=1, val_acc=0.720]
Epoch 55:  11%|█         | 13/117 [00:01<00:10,  9.62it/s, loss=0.899, v_num=1, val_acc=0.720]
Epoch 55:  12%|█▏        | 14/117 [00:01<00:09, 10.30it/s, loss=0.899, v_num=1, val_acc=0.720]
Epoch 55:  12%|█▏        | 14/117 [00:01<00:10, 10.11it/s, loss=0.904, v_num=1, val_acc=0.720]
Epoch 55:  13%|█▎        | 15/117 [00:01<00:09, 10.77it/s, loss=0.904, v_num=1, val_acc=0.720]
Epoch 55:  13%|█▎        | 15/117 [00:01<00:09, 10.57it/s, loss=0.912, v_num=1, val_acc=0.720]
Epoch 55:  14%|█▎        | 16/117 [00:01<00:09, 11.21it/s, loss=0.912, v_num=1, val_acc=0.720]
Epoch 55:  14%|█▎        | 16/117 [00:01<00:09, 11.01it/s, loss=0.925, v_num=1, val_acc=0.720]
Epoch 55:  15%|█▍        | 17/117 [00:01<00:08, 11.62it/s, loss=0.925, v_num=1, val_acc=0.720]
Epoch 55:  15%|█▍        | 17/117 [00:01<00:08, 11.43it/s, loss=0.928, v_num=1, val_acc=0.720]
Epoch 55:  15%|█▌        | 18/117 [00:01<00:08, 11.99it/s, loss=0.928, v_num=1, val_acc=0.720]
Epoch 55:  15%|█▌        | 18/117 [00:01<00:08, 11.79it/s, loss=0.938, v_num=1, val_acc=0.720]
Epoch 55:  16%|█▌        | 19/117 [00:01<00:07, 12.38it/s, loss=0.938, v_num=1, val_acc=0.720]
Epoch 55:  16%|█▌        | 19/117 [00:01<00:08, 12.18it/s, loss=0.95, v_num=1, val_acc=0.720]
Epoch 55:  17%|█▋        | 20/117 [00:01<00:07, 12.75it/s, loss=0.95, v_num=1, val_acc=0.720]
Epoch 55:  17%|█▋        | 20/117 [00:01<00:07, 12.55it/s, loss=0.946, v_num=1, val_acc=0.720]
Epoch 55:  18%|█▊        | 21/117 [00:01<00:07, 13.11it/s, loss=0.946, v_num=1, val_acc=0.720]
Epoch 55:  18%|█▊        | 21/117 [00:01<00:07, 12.90it/s, loss=0.939, v_num=1, val_acc=0.720]
Epoch 55:  19%|█▉        | 22/117 [00:01<00:07, 13.44it/s, loss=0.939, v_num=1, val_acc=0.720]
Epoch 55:  19%|█▉        | 22/117 [00:01<00:07, 13.24it/s, loss=0.901, v_num=1, val_acc=0.720]
Epoch 55:  20%|█▉        | 23/117 [00:01<00:06, 13.76it/s, loss=0.901, v_num=1, val_acc=0.720]
Epoch 55:  20%|█▉        | 23/117 [00:01<00:06, 13.56it/s, loss=0.896, v_num=1, val_acc=0.720]
Epoch 55:  21%|██        | 24/117 [00:01<00:06, 14.03it/s, loss=0.896, v_num=1, val_acc=0.720]
Epoch 55:  21%|██        | 24/117 [00:01<00:06, 13.85it/s, loss=0.908, v_num=1, val_acc=0.720]
Epoch 55:  21%|██▏       | 25/117 [00:01<00:06, 14.34it/s, loss=0.908, v_num=1, val_acc=0.720]
Epoch 55:  21%|██▏       | 25/117 [00:01<00:06, 14.13it/s, loss=0.937, v_num=1, val_acc=0.720]
Epoch 55:  22%|██▏       | 26/117 [00:01<00:06, 14.60it/s, loss=0.937, v_num=1, val_acc=0.720]
Epoch 55:  22%|██▏       | 26/117 [00:01<00:06, 14.40it/s, loss=0.973, v_num=1, val_acc=0.720]
Epoch 55:  23%|██▎       | 27/117 [00:01<00:06, 14.88it/s, loss=0.973, v_num=1, val_acc=0.720]
Epoch 55:  23%|██▎       | 27/117 [00:01<00:06, 14.68it/s, loss=0.975, v_num=1, val_acc=0.720]
Epoch 55:  24%|██▍       | 28/117 [00:01<00:05, 15.15it/s, loss=0.975, v_num=1, val_acc=0.720]
Epoch 55:  24%|██▍       | 28/117 [00:01<00:05, 14.95it/s, loss=0.981, v_num=1, val_acc=0.720]
Epoch 55:  25%|██▍       | 29/117 [00:01<00:05, 15.40it/s, loss=0.981, v_num=1, val_acc=0.720]
Epoch 55:  25%|██▍       | 29/117 [00:01<00:05, 15.20it/s, loss=0.994, v_num=1, val_acc=0.720]
Epoch 55:  26%|██▌       | 30/117 [00:01<00:05, 15.65it/s, loss=0.994, v_num=1, val_acc=0.720]
Epoch 55:  26%|██▌       | 30/117 [00:01<00:05, 15.45it/s, loss=0.996, v_num=1, val_acc=0.720]
Epoch 55:  26%|██▋       | 31/117 [00:01<00:05, 15.88it/s, loss=0.996, v_num=1, val_acc=0.720]
Epoch 55:  26%|██▋       | 31/117 [00:01<00:05, 15.68it/s, loss=1.01, v_num=1, val_acc=0.720]
Epoch 55:  27%|██▋       | 32/117 [00:01<00:05, 16.11it/s, loss=1.01, v_num=1, val_acc=0.720]
Epoch 55:  27%|██▋       | 32/117 [00:02<00:05, 15.91it/s, loss=1.01, v_num=1, val_acc=0.720]
Epoch 55:  28%|██▊       | 33/117 [00:02<00:05, 16.33it/s, loss=1.01, v_num=1, val_acc=0.720]
Epoch 55:  28%|██▊       | 33/117 [00:02<00:05, 16.13it/s, loss=1.01, v_num=1, val_acc=0.720]
Epoch 55:  29%|██▉       | 34/117 [00:02<00:05, 16.54it/s, loss=1.01, v_num=1, val_acc=0.720]
Epoch 55:  29%|██▉       | 34/117 [00:02<00:05, 16.34it/s, loss=1.02, v_num=1, val_acc=0.720]
Epoch 55:  30%|██▉       | 35/117 [00:02<00:04, 16.75it/s, loss=1.02, v_num=1, val_acc=0.720]
Epoch 55:  30%|██▉       | 35/117 [00:02<00:04, 16.55it/s, loss=1.02, v_num=1, val_acc=0.720]
Epoch 55:  31%|███       | 36/117 [00:02<00:04, 16.95it/s, loss=1.02, v_num=1, val_acc=0.720]
Epoch 55:  31%|███       | 36/117 [00:02<00:04, 16.75it/s, loss=1.02, v_num=1, val_acc=0.720]
Epoch 55:  32%|███▏      | 37/117 [00:02<00:04, 17.14it/s, loss=1.02, v_num=1, val_acc=0.720]
Epoch 55:  32%|███▏      | 37/117 [00:02<00:04, 16.94it/s, loss=1.03, v_num=1, val_acc=0.720]
Epoch 55:  32%|███▏      | 38/117 [00:02<00:04, 17.33it/s, loss=1.03, v_num=1, val_acc=0.720]
Epoch 55:  32%|███▏      | 38/117 [00:02<00:04, 17.13it/s, loss=1.02, v_num=1, val_acc=0.720]
Epoch 55:  33%|███▎      | 39/117 [00:02<00:04, 17.51it/s, loss=1.02, v_num=1, val_acc=0.720]
Epoch 55:  33%|███▎      | 39/117 [00:02<00:04, 17.31it/s, loss=1.03, v_num=1, val_acc=0.720]
Epoch 55:  34%|███▍      | 40/117 [00:02<00:04, 17.68it/s, loss=1.03, v_num=1, val_acc=0.720]
Epoch 55:  34%|███▍      | 40/117 [00:02<00:04, 17.49it/s, loss=1.05, v_num=1, val_acc=0.720]
Epoch 55:  35%|███▌      | 41/117 [00:02<00:04, 17.85it/s, loss=1.05, v_num=1, val_acc=0.720]
Epoch 55:  35%|███▌      | 41/117 [00:02<00:04, 17.66it/s, loss=1.04, v_num=1, val_acc=0.720]
Epoch 55:  36%|███▌      | 42/117 [00:02<00:04, 18.02it/s, loss=1.04, v_num=1, val_acc=0.720]
Epoch 55:  36%|███▌      | 42/117 [00:02<00:04, 17.83it/s, loss=1.05, v_num=1, val_acc=0.720]
Epoch 55:  37%|███▋      | 43/117 [00:02<00:04, 18.18it/s, loss=1.05, v_num=1, val_acc=0.720]
Epoch 55:  37%|███▋      | 43/117 [00:02<00:04, 17.99it/s, loss=1.04, v_num=1, val_acc=0.720]
Epoch 55:  38%|███▊      | 44/117 [00:02<00:03, 18.34it/s, loss=1.04, v_num=1, val_acc=0.720]
Epoch 55:  38%|███▊      | 44/117 [00:02<00:04, 18.14it/s, loss=1.03, v_num=1, val_acc=0.720]
Epoch 55:  38%|███▊      | 45/117 [00:02<00:03, 18.49it/s, loss=1.03, v_num=1, val_acc=0.720]
Epoch 55:  38%|███▊      | 45/117 [00:02<00:03, 18.30it/s, loss=1.02, v_num=1, val_acc=0.720]
Epoch 55:  39%|███▉      | 46/117 [00:02<00:03, 18.63it/s, loss=1.02, v_num=1, val_acc=0.720]
Epoch 55:  39%|███▉      | 46/117 [00:02<00:03, 18.45it/s, loss=1.03, v_num=1, val_acc=0.720]
Epoch 55:  40%|████      | 47/117 [00:02<00:03, 18.78it/s, loss=1.03, v_num=1, val_acc=0.720]
Epoch 55:  40%|████      | 47/117 [00:02<00:03, 18.59it/s, loss=1.03, v_num=1, val_acc=0.720]
Epoch 55:  41%|████      | 48/117 [00:02<00:03, 18.91it/s, loss=1.03, v_num=1, val_acc=0.720]
Epoch 55:  41%|████      | 48/117 [00:02<00:03, 18.73it/s, loss=1.04, v_num=1, val_acc=0.720]
Epoch 55:  42%|████▏     | 49/117 [00:02<00:03, 19.05it/s, loss=1.04, v_num=1, val_acc=0.720]
Epoch 55:  42%|████▏     | 49/117 [00:02<00:03, 18.86it/s, loss=1.03, v_num=1, val_acc=0.720]
Epoch 55:  43%|████▎     | 50/117 [00:02<00:03, 19.18it/s, loss=1.03, v_num=1, val_acc=0.720]
Epoch 55:  43%|████▎     | 50/117 [00:02<00:03, 19.00it/s, loss=1.03, v_num=1, val_acc=0.720]
Epoch 55:  44%|████▎     | 51/117 [00:02<00:03, 19.31it/s, loss=1.03, v_num=1, val_acc=0.720]
Epoch 55:  44%|████▎     | 51/117 [00:02<00:03, 19.13it/s, loss=1, v_num=1, val_acc=0.720]
Epoch 55:  44%|████▍     | 52/117 [00:02<00:03, 19.43it/s, loss=1, v_num=1, val_acc=0.720]
Epoch 55:  44%|████▍     | 52/117 [00:02<00:03, 19.25it/s, loss=0.997, v_num=1, val_acc=0.720]
Epoch 55:  45%|████▌     | 53/117 [00:02<00:03, 19.56it/s, loss=0.997, v_num=1, val_acc=0.720]
Epoch 55:  45%|████▌     | 53/117 [00:02<00:03, 19.38it/s, loss=0.984, v_num=1, val_acc=0.720]
Epoch 55:  46%|████▌     | 54/117 [00:02<00:03, 19.67it/s, loss=0.984, v_num=1, val_acc=0.720]
Epoch 55:  46%|████▌     | 54/117 [00:02<00:03, 19.49it/s, loss=0.976, v_num=1, val_acc=0.720]
Epoch 55:  47%|████▋     | 55/117 [00:02<00:03, 19.79it/s, loss=0.976, v_num=1, val_acc=0.720]
Epoch 55:  47%|████▋     | 55/117 [00:02<00:03, 19.61it/s, loss=0.971, v_num=1, val_acc=0.720]
Epoch 55:  48%|████▊     | 56/117 [00:02<00:03, 19.87it/s, loss=0.971, v_num=1, val_acc=0.720]
Epoch 55:  48%|████▊     | 56/117 [00:02<00:03, 19.72it/s, loss=0.969, v_num=1, val_acc=0.720]
Epoch 55:  49%|████▊     | 57/117 [00:02<00:02, 20.01it/s, loss=0.969, v_num=1, val_acc=0.720]
Epoch 55:  49%|████▊     | 57/117 [00:02<00:03, 19.83it/s, loss=0.998, v_num=1, val_acc=0.720]
Epoch 55:  50%|████▉     | 58/117 [00:02<00:02, 20.11it/s, loss=0.998, v_num=1, val_acc=0.720]
Epoch 55:  50%|████▉     | 58/117 [00:02<00:02, 19.94it/s, loss=1.01, v_num=1, val_acc=0.720]
Epoch 55:  50%|█████     | 59/117 [00:02<00:02, 20.21it/s, loss=1.01, v_num=1, val_acc=0.720]
Epoch 55:  50%|█████     | 59/117 [00:02<00:02, 20.04it/s, loss=0.994, v_num=1, val_acc=0.720]
Epoch 55:  51%|█████▏    | 60/117 [00:02<00:02, 20.32it/s, loss=0.994, v_num=1, val_acc=0.720]
Epoch 55:  51%|█████▏    | 60/117 [00:02<00:02, 20.15it/s, loss=0.969, v_num=1, val_acc=0.720]
Epoch 55:  52%|█████▏    | 61/117 [00:02<00:02, 20.42it/s, loss=0.969, v_num=1, val_acc=0.720]
Epoch 55:  52%|█████▏    | 61/117 [00:03<00:02, 20.25it/s, loss=0.977, v_num=1, val_acc=0.720]
Epoch 55:  53%|█████▎    | 62/117 [00:03<00:02, 20.51it/s, loss=0.977, v_num=1, val_acc=0.720]
Epoch 55:  53%|█████▎    | 62/117 [00:03<00:02, 20.34it/s, loss=0.978, v_num=1, val_acc=0.720]
Epoch 55:  54%|█████▍    | 63/117 [00:03<00:02, 20.61it/s, loss=0.978, v_num=1, val_acc=0.720]
Epoch 55:  54%|█████▍    | 63/117 [00:03<00:02, 20.44it/s, loss=0.982, v_num=1, val_acc=0.720]
Epoch 55:  55%|█████▍    | 64/117 [00:03<00:02, 20.70it/s, loss=0.982, v_num=1, val_acc=0.720]
Epoch 55:  55%|█████▍    | 64/117 [00:03<00:02, 20.53it/s, loss=0.972, v_num=1, val_acc=0.720]
Epoch 55:  56%|█████▌    | 65/117 [00:03<00:02, 20.79it/s, loss=0.972, v_num=1, val_acc=0.720]
Epoch 55:  56%|█████▌    | 65/117 [00:03<00:02, 20.63it/s, loss=0.958, v_num=1, val_acc=0.720]
Epoch 55:  56%|█████▋    | 66/117 [00:03<00:02, 20.88it/s, loss=0.958, v_num=1, val_acc=0.720]
Epoch 55:  56%|█████▋    | 66/117 [00:03<00:02, 20.71it/s, loss=0.926, v_num=1, val_acc=0.720]
Epoch 55:  57%|█████▋    | 67/117 [00:03<00:02, 20.96it/s, loss=0.926, v_num=1, val_acc=0.720]
Epoch 55:  57%|█████▋    | 67/117 [00:03<00:02, 20.80it/s, loss=0.919, v_num=1, val_acc=0.720]
Epoch 55:  58%|█████▊    | 68/117 [00:03<00:02, 21.02it/s, loss=0.919, v_num=1, val_acc=0.720]
Epoch 55:  58%|█████▊    | 68/117 [00:03<00:02, 20.86it/s, loss=0.905, v_num=1, val_acc=0.720]
Epoch 55:  59%|█████▉    | 69/117 [00:03<00:02, 21.11it/s, loss=0.905, v_num=1, val_acc=0.720]
Epoch 55:  59%|█████▉    | 69/117 [00:03<00:02, 20.95it/s, loss=0.899, v_num=1, val_acc=0.720]
Epoch 55:  60%|█████▉    | 70/117 [00:03<00:02, 21.19it/s, loss=0.899, v_num=1, val_acc=0.720]
Epoch 55:  60%|█████▉    | 70/117 [00:03<00:02, 21.03it/s, loss=0.899, v_num=1, val_acc=0.720]
Epoch 55:  61%|██████    | 71/117 [00:03<00:02, 21.25it/s, loss=0.899, v_num=1, val_acc=0.720]
Epoch 55:  61%|██████    | 71/117 [00:03<00:02, 21.10it/s, loss=0.908, v_num=1, val_acc=0.720]
Epoch 55:  62%|██████▏   | 72/117 [00:03<00:02, 21.34it/s, loss=0.908, v_num=1, val_acc=0.720]
Epoch 55:  62%|██████▏   | 72/117 [00:03<00:02, 21.18it/s, loss=0.897, v_num=1, val_acc=0.720]
Epoch 55:  62%|██████▏   | 73/117 [00:03<00:02, 21.41it/s, loss=0.897, v_num=1, val_acc=0.720]
Epoch 55:  62%|██████▏   | 73/117 [00:03<00:02, 21.26it/s, loss=0.902, v_num=1, val_acc=0.720]
Epoch 55:  63%|██████▎   | 74/117 [00:03<00:02, 21.49it/s, loss=0.902, v_num=1, val_acc=0.720]
Epoch 55:  63%|██████▎   | 74/117 [00:03<00:02, 21.33it/s, loss=0.903, v_num=1, val_acc=0.720]
Epoch 55:  64%|██████▍   | 75/117 [00:03<00:01, 21.56it/s, loss=0.903, v_num=1, val_acc=0.720]
Epoch 55:  64%|██████▍   | 75/117 [00:03<00:01, 21.40it/s, loss=0.907, v_num=1, val_acc=0.720]
Epoch 55:  65%|██████▍   | 76/117 [00:03<00:01, 21.63it/s, loss=0.907, v_num=1, val_acc=0.720]
Epoch 55:  65%|██████▍   | 76/117 [00:03<00:01, 21.48it/s, loss=0.9, v_num=1, val_acc=0.720]
Epoch 55:  66%|██████▌   | 77/117 [00:03<00:01, 21.70it/s, loss=0.9, v_num=1, val_acc=0.720]
Epoch 55:  66%|██████▌   | 77/117 [00:03<00:01, 21.55it/s, loss=0.863, v_num=1, val_acc=0.720]
Epoch 55:  67%|██████▋   | 78/117 [00:03<00:01, 21.77it/s, loss=0.863, v_num=1, val_acc=0.720]
Epoch 55:  67%|██████▋   | 78/117 [00:03<00:01, 21.62it/s, loss=0.844, v_num=1, val_acc=0.720]
Epoch 55:  68%|██████▊   | 79/117 [00:03<00:01, 21.84it/s, loss=0.844, v_num=1, val_acc=0.720]
Epoch 55:  68%|██████▊   | 79/117 [00:03<00:01, 21.69it/s, loss=0.837, v_num=1, val_acc=0.720]
Epoch 55:  68%|██████▊   | 80/117 [00:03<00:01, 21.91it/s, loss=0.837, v_num=1, val_acc=0.720]
Epoch 55:  68%|██████▊   | 80/117 [00:03<00:01, 21.76it/s, loss=0.845, v_num=1, val_acc=0.720]
Epoch 55:  69%|██████▉   | 81/117 [00:03<00:01, 21.97it/s, loss=0.845, v_num=1, val_acc=0.720]
Epoch 55:  69%|██████▉   | 81/117 [00:03<00:01, 21.82it/s, loss=0.841, v_num=1, val_acc=0.720]
Epoch 55:  70%|███████   | 82/117 [00:03<00:01, 22.02it/s, loss=0.841, v_num=1, val_acc=0.720]
Epoch 55:  70%|███████   | 82/117 [00:03<00:01, 21.87it/s, loss=0.845, v_num=1, val_acc=0.720]
Epoch 55:  71%|███████   | 83/117 [00:03<00:01, 22.07it/s, loss=0.845, v_num=1, val_acc=0.720]
Epoch 55:  71%|███████   | 83/117 [00:03<00:01, 21.93it/s, loss=0.854, v_num=1, val_acc=0.720]
Epoch 55:  72%|███████▏  | 84/117 [00:03<00:01, 22.14it/s, loss=0.854, v_num=1, val_acc=0.720]
Epoch 55:  72%|███████▏  | 84/117 [00:03<00:01, 21.99it/s, loss=0.856, v_num=1, val_acc=0.720]
Epoch 55:  73%|███████▎  | 85/117 [00:03<00:01, 22.20it/s, loss=0.856, v_num=1, val_acc=0.720]
Epoch 55:  73%|███████▎  | 85/117 [00:03<00:01, 22.06it/s, loss=0.854, v_num=1, val_acc=0.720]
Epoch 55:  74%|███████▎  | 86/117 [00:03<00:01, 22.27it/s, loss=0.854, v_num=1, val_acc=0.720]
Epoch 55:  74%|███████▎  | 86/117 [00:03<00:01, 22.12it/s, loss=0.857, v_num=1, val_acc=0.720]
Epoch 55:  74%|███████▍  | 87/117 [00:03<00:01, 22.33it/s, loss=0.857, v_num=1, val_acc=0.720]
Epoch 55:  74%|███████▍  | 87/117 [00:03<00:01, 22.18it/s, loss=0.855, v_num=1, val_acc=0.720]
Epoch 55:  75%|███████▌  | 88/117 [00:03<00:01, 22.39it/s, loss=0.855, v_num=1, val_acc=0.720]
Epoch 55:  75%|███████▌  | 88/117 [00:03<00:01, 22.24it/s, loss=0.857, v_num=1, val_acc=0.720]
Epoch 55:  76%|███████▌  | 89/117 [00:03<00:01, 22.45it/s, loss=0.857, v_num=1, val_acc=0.720]
Epoch 55:  76%|███████▌  | 89/117 [00:03<00:01, 22.30it/s, loss=0.857, v_num=1, val_acc=0.720]
Epoch 55:  77%|███████▋  | 90/117 [00:03<00:01, 22.50it/s, loss=0.857, v_num=1, val_acc=0.720]
Epoch 55:  77%|███████▋  | 90/117 [00:04<00:01, 22.36it/s, loss=0.869, v_num=1, val_acc=0.720]
Epoch 55:  78%|███████▊  | 91/117 [00:04<00:01, 22.56it/s, loss=0.869, v_num=1, val_acc=0.720]
Epoch 55:  78%|███████▊  | 91/117 [00:04<00:01, 22.42it/s, loss=0.872, v_num=1, val_acc=0.720]
Epoch 55:  79%|███████▊  | 92/117 [00:04<00:01, 22.62it/s, loss=0.872, v_num=1, val_acc=0.720]
Epoch 55:  79%|███████▊  | 92/117 [00:04<00:01, 22.48it/s, loss=0.893, v_num=1, val_acc=0.720]
Epoch 55:  79%|███████▉  | 93/117 [00:04<00:01, 22.67it/s, loss=0.893, v_num=1, val_acc=0.720]
Epoch 55:  79%|███████▉  | 93/117 [00:04<00:01, 22.53it/s, loss=0.915, v_num=1, val_acc=0.720]
Epoch 55:  80%|████████  | 94/117 [00:04<00:01, 22.72it/s, loss=0.915, v_num=1, val_acc=0.720]
Epoch 55:  80%|████████  | 94/117 [00:04<00:01, 22.58it/s, loss=0.928, v_num=1, val_acc=0.720]
Epoch 55:  81%|████████  | 95/117 [00:04<00:00, 22.77it/s, loss=0.928, v_num=1, val_acc=0.720]
Epoch 55:  81%|████████  | 95/117 [00:04<00:00, 22.64it/s, loss=0.928, v_num=1, val_acc=0.720]
Epoch 55:  82%|████████▏ | 96/117 [00:04<00:00, 22.83it/s, loss=0.928, v_num=1, val_acc=0.720]
Epoch 55:  82%|████████▏ | 96/117 [00:04<00:00, 22.69it/s, loss=0.943, v_num=1, val_acc=0.720]
Epoch 55:  83%|████████▎ | 97/117 [00:04<00:00, 22.88it/s, loss=0.943, v_num=1, val_acc=0.720]
Epoch 55:  83%|████████▎ | 97/117 [00:04<00:00, 22.74it/s, loss=0.959, v_num=1, val_acc=0.720]

Validation: 0it [00:00, ?it/s]

Validation:   0%|          | 0/20 [00:00<?, ?it/s]

Validation DataLoader 0:   0%|          | 0/20 [00:00<?, ?it/s]

Validation DataLoader 0:   5%|▌         | 1/20 [00:00<00:00, 135.45it/s]
Epoch 55:  84%|████████▍ | 98/117 [00:05<00:00, 19.12it/s, loss=0.959, v_num=1, val_acc=0.720]

Validation DataLoader 0:  10%|█         | 2/20 [00:00<00:00, 54.58it/s]
Epoch 55:  85%|████████▍ | 99/117 [00:05<00:00, 19.21it/s, loss=0.959, v_num=1, val_acc=0.720]

Validation DataLoader 0:  15%|█▌        | 3/20 [00:00<00:00, 43.85it/s]
Epoch 55:  85%|████████▌ | 100/117 [00:05<00:00, 19.28it/s, loss=0.959, v_num=1, val_acc=0.720]

Validation DataLoader 0:  20%|██        | 4/20 [00:00<00:00, 39.88it/s]
Epoch 55:  86%|████████▋ | 101/117 [00:05<00:00, 19.36it/s, loss=0.959, v_num=1, val_acc=0.720]

Validation DataLoader 0:  25%|██▌       | 5/20 [00:00<00:00, 37.68it/s]
Epoch 55:  87%|████████▋ | 102/117 [00:05<00:00, 19.43it/s, loss=0.959, v_num=1, val_acc=0.720]

Validation DataLoader 0:  30%|███       | 6/20 [00:00<00:00, 36.48it/s]
Epoch 55:  88%|████████▊ | 103/117 [00:05<00:00, 19.50it/s, loss=0.959, v_num=1, val_acc=0.720]

Validation DataLoader 0:  35%|███▌      | 7/20 [00:00<00:00, 35.73it/s]
Epoch 55:  89%|████████▉ | 104/117 [00:05<00:00, 19.57it/s, loss=0.959, v_num=1, val_acc=0.720]

Validation DataLoader 0:  40%|████      | 8/20 [00:00<00:00, 35.17it/s]
Epoch 55:  90%|████████▉ | 105/117 [00:05<00:00, 19.65it/s, loss=0.959, v_num=1, val_acc=0.720]

Validation DataLoader 0:  45%|████▌     | 9/20 [00:00<00:00, 34.71it/s]
Epoch 55:  91%|█████████ | 106/117 [00:05<00:00, 19.72it/s, loss=0.959, v_num=1, val_acc=0.720]

Validation DataLoader 0:  50%|█████     | 10/20 [00:00<00:00, 34.39it/s]
Epoch 55:  91%|█████████▏| 107/117 [00:05<00:00, 19.79it/s, loss=0.959, v_num=1, val_acc=0.720]

Validation DataLoader 0:  55%|█████▌    | 11/20 [00:00<00:00, 34.13it/s]
Epoch 55:  92%|█████████▏| 108/117 [00:05<00:00, 19.86it/s, loss=0.959, v_num=1, val_acc=0.720]

Validation DataLoader 0:  60%|██████    | 12/20 [00:00<00:00, 33.90it/s]
Epoch 55:  93%|█████████▎| 109/117 [00:05<00:00, 19.92it/s, loss=0.959, v_num=1, val_acc=0.720]

Validation DataLoader 0:  65%|██████▌   | 13/20 [00:00<00:00, 33.70it/s]
Epoch 55:  94%|█████████▍| 110/117 [00:05<00:00, 19.99it/s, loss=0.959, v_num=1, val_acc=0.720]

Validation DataLoader 0:  70%|███████   | 14/20 [00:00<00:00, 33.56it/s]
Epoch 55:  95%|█████████▍| 111/117 [00:05<00:00, 20.06it/s, loss=0.959, v_num=1, val_acc=0.720]

Validation DataLoader 0:  75%|███████▌  | 15/20 [00:00<00:00, 33.41it/s]
Epoch 55:  96%|█████████▌| 112/117 [00:05<00:00, 20.12it/s, loss=0.959, v_num=1, val_acc=0.720]

Validation DataLoader 0:  80%|████████  | 16/20 [00:00<00:00, 33.28it/s]
Epoch 55:  97%|█████████▋| 113/117 [00:05<00:00, 20.19it/s, loss=0.959, v_num=1, val_acc=0.720]

Validation DataLoader 0:  85%|████████▌ | 17/20 [00:00<00:00, 33.18it/s]
Epoch 55:  97%|█████████▋| 114/117 [00:05<00:00, 20.25it/s, loss=0.959, v_num=1, val_acc=0.720]

Validation DataLoader 0:  90%|█████████ | 18/20 [00:00<00:00, 33.08it/s]
Epoch 55:  98%|█████████▊| 115/117 [00:05<00:00, 20.31it/s, loss=0.959, v_num=1, val_acc=0.720]

Validation DataLoader 0:  95%|█████████▌| 19/20 [00:00<00:00, 32.99it/s]
Epoch 55:  99%|█████████▉| 116/117 [00:05<00:00, 20.38it/s, loss=0.959, v_num=1, val_acc=0.720]

Validation DataLoader 0: 100%|██████████| 20/20 [00:00<00:00, 32.99it/s]
Epoch 55: 100%|██████████| 117/117 [00:05<00:00, 20.44it/s, loss=0.959, v_num=1, val_acc=0.720]
Epoch 55: 100%|██████████| 117/117 [00:05<00:00, 20.37it/s, loss=0.959, v_num=1, val_acc=0.727]


Epoch 55: 100%|██████████| 117/117 [00:05<00:00, 20.37it/s, loss=0.959, v_num=1, val_acc=0.727]
Epoch 55:   0%|          | 0/117 [00:00<?, ?it/s, loss=0.959, v_num=1, val_acc=0.727]
Epoch 56:   0%|          | 0/117 [00:00<?, ?it/s, loss=0.959, v_num=1, val_acc=0.727]
Epoch 56:   1%|          | 1/117 [00:00<01:45,  1.10it/s, loss=0.959, v_num=1, val_acc=0.727]
Epoch 56:   1%|          | 1/117 [00:00<01:48,  1.07it/s, loss=0.966, v_num=1, val_acc=0.727]
Epoch 56:   2%|▏         | 2/117 [00:00<00:54,  2.11it/s, loss=0.966, v_num=1, val_acc=0.727]
Epoch 56:   2%|▏         | 2/117 [00:00<00:55,  2.06it/s, loss=0.986, v_num=1, val_acc=0.727]
Epoch 56:   3%|▎         | 3/117 [00:00<00:37,  3.06it/s, loss=0.986, v_num=1, val_acc=0.727]
Epoch 56:   3%|▎         | 3/117 [00:01<00:38,  2.98it/s, loss=0.986, v_num=1, val_acc=0.727]
Epoch 56:   3%|▎         | 4/117 [00:01<00:28,  3.93it/s, loss=0.986, v_num=1, val_acc=0.727]
Epoch 56:   3%|▎         | 4/117 [00:01<00:29,  3.84it/s, loss=0.996, v_num=1, val_acc=0.727]
Epoch 56:   4%|▍         | 5/117 [00:01<00:23,  4.76it/s, loss=0.996, v_num=1, val_acc=0.727]
Epoch 56:   4%|▍         | 5/117 [00:01<00:24,  4.64it/s, loss=1, v_num=1, val_acc=0.727]
Epoch 56:   5%|▌         | 6/117 [00:01<00:20,  5.53it/s, loss=1, v_num=1, val_acc=0.727]
Epoch 56:   5%|▌         | 6/117 [00:01<00:20,  5.40it/s, loss=1.01, v_num=1, val_acc=0.727]
Epoch 56:   6%|▌         | 7/117 [00:01<00:17,  6.25it/s, loss=1.01, v_num=1, val_acc=0.727]
Epoch 56:   6%|▌         | 7/117 [00:01<00:17,  6.11it/s, loss=1.01, v_num=1, val_acc=0.727]
Epoch 56:   7%|▋         | 8/117 [00:01<00:15,  6.93it/s, loss=1.01, v_num=1, val_acc=0.727]
Epoch 56:   7%|▋         | 8/117 [00:01<00:16,  6.78it/s, loss=1, v_num=1, val_acc=0.727]
Epoch 56:   8%|▊         | 9/117 [00:01<00:14,  7.57it/s, loss=1, v_num=1, val_acc=0.727]
Epoch 56:   8%|▊         | 9/117 [00:01<00:14,  7.41it/s, loss=0.999, v_num=1, val_acc=0.727]
Epoch 56:   9%|▊         | 10/117 [00:01<00:13,  8.18it/s, loss=0.999, v_num=1, val_acc=0.727]
Epoch 56:   9%|▊         | 10/117 [00:01<00:13,  8.01it/s, loss=1, v_num=1, val_acc=0.727]
Epoch 56:   9%|▉         | 11/117 [00:01<00:12,  8.72it/s, loss=1, v_num=1, val_acc=0.727]
Epoch 56:   9%|▉         | 11/117 [00:01<00:12,  8.55it/s, loss=1, v_num=1, val_acc=0.727]
Epoch 56:  10%|█         | 12/117 [00:01<00:11,  9.27it/s, loss=1, v_num=1, val_acc=0.727]
Epoch 56:  10%|█         | 12/117 [00:01<00:11,  9.09it/s, loss=1.01, v_num=1, val_acc=0.727]
Epoch 56:  11%|█         | 13/117 [00:01<00:10,  9.78it/s, loss=1.01, v_num=1, val_acc=0.727]
Epoch 56:  11%|█         | 13/117 [00:01<00:10,  9.60it/s, loss=0.998, v_num=1, val_acc=0.727]
Epoch 56:  12%|█▏        | 14/117 [00:01<00:10, 10.27it/s, loss=0.998, v_num=1, val_acc=0.727]
Epoch 56:  12%|█▏        | 14/117 [00:01<00:10, 10.08it/s, loss=1, v_num=1, val_acc=0.727]
Epoch 56:  13%|█▎        | 15/117 [00:01<00:09, 10.74it/s, loss=1, v_num=1, val_acc=0.727]
Epoch 56:  13%|█▎        | 15/117 [00:01<00:09, 10.55it/s, loss=0.999, v_num=1, val_acc=0.727]
Epoch 56:  14%|█▎        | 16/117 [00:01<00:09, 11.18it/s, loss=0.999, v_num=1, val_acc=0.727]
Epoch 56:  14%|█▎        | 16/117 [00:01<00:09, 10.99it/s, loss=0.986, v_num=1, val_acc=0.727]
Epoch 56:  15%|█▍        | 17/117 [00:01<00:08, 11.59it/s, loss=0.986, v_num=1, val_acc=0.727]
Epoch 56:  15%|█▍        | 17/117 [00:01<00:08, 11.39it/s, loss=0.971, v_num=1, val_acc=0.727]
Epoch 56:  15%|█▌        | 18/117 [00:01<00:08, 12.00it/s, loss=0.971, v_num=1, val_acc=0.727]
Epoch 56:  15%|█▌        | 18/117 [00:01<00:08, 11.79it/s, loss=0.961, v_num=1, val_acc=0.727]
Epoch 56:  16%|█▌        | 19/117 [00:01<00:07, 12.35it/s, loss=0.961, v_num=1, val_acc=0.727]
Epoch 56:  16%|█▌        | 19/117 [00:01<00:08, 12.15it/s, loss=0.955, v_num=1, val_acc=0.727]
Epoch 56:  17%|█▋        | 20/117 [00:01<00:07, 12.69it/s, loss=0.955, v_num=1, val_acc=0.727]
Epoch 56:  17%|█▋        | 20/117 [00:01<00:07, 12.52it/s, loss=0.952, v_num=1, val_acc=0.727]
Epoch 56:  18%|█▊        | 21/117 [00:01<00:07, 13.08it/s, loss=0.952, v_num=1, val_acc=0.727]
Epoch 56:  18%|█▊        | 21/117 [00:01<00:07, 12.87it/s, loss=0.95, v_num=1, val_acc=0.727]
Epoch 56:  19%|█▉        | 22/117 [00:01<00:07, 13.42it/s, loss=0.95, v_num=1, val_acc=0.727]
Epoch 56:  19%|█▉        | 22/117 [00:01<00:07, 13.22it/s, loss=0.931, v_num=1, val_acc=0.727]
Epoch 56:  20%|█▉        | 23/117 [00:01<00:06, 13.68it/s, loss=0.931, v_num=1, val_acc=0.727]
Epoch 56:  20%|█▉        | 23/117 [00:01<00:06, 13.49it/s, loss=0.922, v_num=1, val_acc=0.727]
Epoch 56:  21%|██        | 24/117 [00:01<00:06, 14.01it/s, loss=0.922, v_num=1, val_acc=0.727]
Epoch 56:  21%|██        | 24/117 [00:01<00:06, 13.80it/s, loss=0.898, v_num=1, val_acc=0.727]
Epoch 56:  21%|██▏       | 25/117 [00:01<00:06, 14.31it/s, loss=0.898, v_num=1, val_acc=0.727]
Epoch 56:  21%|██▏       | 25/117 [00:01<00:06, 14.11it/s, loss=0.887, v_num=1, val_acc=0.727]
Epoch 56:  22%|██▏       | 26/117 [00:01<00:06, 14.60it/s, loss=0.887, v_num=1, val_acc=0.727]
Epoch 56:  22%|██▏       | 26/117 [00:01<00:06, 14.40it/s, loss=0.872, v_num=1, val_acc=0.727]
Epoch 56:  23%|██▎       | 27/117 [00:01<00:06, 14.87it/s, loss=0.872, v_num=1, val_acc=0.727]
Epoch 56:  23%|██▎       | 27/117 [00:01<00:06, 14.67it/s, loss=0.863, v_num=1, val_acc=0.727]
Epoch 56:  24%|██▍       | 28/117 [00:01<00:05, 15.15it/s, loss=0.863, v_num=1, val_acc=0.727]
Epoch 56:  24%|██▍       | 28/117 [00:01<00:05, 14.94it/s, loss=0.862, v_num=1, val_acc=0.727]
Epoch 56:  25%|██▍       | 29/117 [00:01<00:05, 15.39it/s, loss=0.862, v_num=1, val_acc=0.727]
Epoch 56:  25%|██▍       | 29/117 [00:01<00:05, 15.18it/s, loss=0.87, v_num=1, val_acc=0.727]
Epoch 56:  26%|██▌       | 30/117 [00:01<00:05, 15.63it/s, loss=0.87, v_num=1, val_acc=0.727]
Epoch 56:  26%|██▌       | 30/117 [00:01<00:05, 15.43it/s, loss=0.884, v_num=1, val_acc=0.727]
Epoch 56:  26%|██▋       | 31/117 [00:01<00:05, 15.85it/s, loss=0.884, v_num=1, val_acc=0.727]
Epoch 56:  26%|██▋       | 31/117 [00:01<00:05, 15.65it/s, loss=0.899, v_num=1, val_acc=0.727]
Epoch 56:  27%|██▋       | 32/117 [00:01<00:05, 16.09it/s, loss=0.899, v_num=1, val_acc=0.727]
Epoch 56:  27%|██▋       | 32/117 [00:02<00:05, 15.89it/s, loss=0.912, v_num=1, val_acc=0.727]
Epoch 56:  28%|██▊       | 33/117 [00:02<00:05, 16.31it/s, loss=0.912, v_num=1, val_acc=0.727]
Epoch 56:  28%|██▊       | 33/117 [00:02<00:05, 16.11it/s, loss=0.914, v_num=1, val_acc=0.727]
Epoch 56:  29%|██▉       | 34/117 [00:02<00:05, 16.53it/s, loss=0.914, v_num=1, val_acc=0.727]
Epoch 56:  29%|██▉       | 34/117 [00:02<00:05, 16.33it/s, loss=0.93, v_num=1, val_acc=0.727]
Epoch 56:  30%|██▉       | 35/117 [00:02<00:04, 16.73it/s, loss=0.93, v_num=1, val_acc=0.727]
Epoch 56:  30%|██▉       | 35/117 [00:02<00:04, 16.54it/s, loss=0.927, v_num=1, val_acc=0.727]
Epoch 56:  31%|███       | 36/117 [00:02<00:04, 16.94it/s, loss=0.927, v_num=1, val_acc=0.727]
Epoch 56:  31%|███       | 36/117 [00:02<00:04, 16.74it/s, loss=0.937, v_num=1, val_acc=0.727]
Epoch 56:  32%|███▏      | 37/117 [00:02<00:04, 17.13it/s, loss=0.937, v_num=1, val_acc=0.727]
Epoch 56:  32%|███▏      | 37/117 [00:02<00:04, 16.93it/s, loss=0.932, v_num=1, val_acc=0.727]
Epoch 56:  32%|███▏      | 38/117 [00:02<00:04, 17.32it/s, loss=0.932, v_num=1, val_acc=0.727]
Epoch 56:  32%|███▏      | 38/117 [00:02<00:04, 17.12it/s, loss=0.944, v_num=1, val_acc=0.727]
Epoch 56:  33%|███▎      | 39/117 [00:02<00:04, 17.49it/s, loss=0.944, v_num=1, val_acc=0.727]
Epoch 56:  33%|███▎      | 39/117 [00:02<00:04, 17.29it/s, loss=0.942, v_num=1, val_acc=0.727]
Epoch 56:  34%|███▍      | 40/117 [00:02<00:04, 17.67it/s, loss=0.942, v_num=1, val_acc=0.727]
Epoch 56:  34%|███▍      | 40/117 [00:02<00:04, 17.47it/s, loss=0.945, v_num=1, val_acc=0.727]
Epoch 56:  35%|███▌      | 41/117 [00:02<00:04, 17.85it/s, loss=0.945, v_num=1, val_acc=0.727]
Epoch 56:  35%|███▌      | 41/117 [00:02<00:04, 17.65it/s, loss=0.957, v_num=1, val_acc=0.727]
Epoch 56:  36%|███▌      | 42/117 [00:02<00:04, 18.01it/s, loss=0.957, v_num=1, val_acc=0.727]
Epoch 56:  36%|███▌      | 42/117 [00:02<00:04, 17.82it/s, loss=0.977, v_num=1, val_acc=0.727]
Epoch 56:  37%|███▋      | 43/117 [00:02<00:04, 18.17it/s, loss=0.977, v_num=1, val_acc=0.727]
Epoch 56:  37%|███▋      | 43/117 [00:02<00:04, 17.98it/s, loss=0.986, v_num=1, val_acc=0.727]
Epoch 56:  38%|███▊      | 44/117 [00:02<00:03, 18.33it/s, loss=0.986, v_num=1, val_acc=0.727]
Epoch 56:  38%|███▊      | 44/117 [00:02<00:04, 18.13it/s, loss=1.01, v_num=1, val_acc=0.727]
Epoch 56:  38%|███▊      | 45/117 [00:02<00:03, 18.46it/s, loss=1.01, v_num=1, val_acc=0.727]
Epoch 56:  38%|███▊      | 45/117 [00:02<00:03, 18.28it/s, loss=1.02, v_num=1, val_acc=0.727]
Epoch 56:  39%|███▉      | 46/117 [00:02<00:03, 18.61it/s, loss=1.02, v_num=1, val_acc=0.727]
Epoch 56:  39%|███▉      | 46/117 [00:02<00:03, 18.42it/s, loss=1.03, v_num=1, val_acc=0.727]
Epoch 56:  40%|████      | 47/117 [00:02<00:03, 18.74it/s, loss=1.03, v_num=1, val_acc=0.727]
Epoch 56:  40%|████      | 47/117 [00:02<00:03, 18.56it/s, loss=1.04, v_num=1, val_acc=0.727]
Epoch 56:  41%|████      | 48/117 [00:02<00:03, 18.89it/s, loss=1.04, v_num=1, val_acc=0.727]
Epoch 56:  41%|████      | 48/117 [00:02<00:03, 18.70it/s, loss=1.06, v_num=1, val_acc=0.727]
Epoch 56:  42%|████▏     | 49/117 [00:02<00:03, 19.02it/s, loss=1.06, v_num=1, val_acc=0.727]
Epoch 56:  42%|████▏     | 49/117 [00:02<00:03, 18.84it/s, loss=1.06, v_num=1, val_acc=0.727]
Epoch 56:  43%|████▎     | 50/117 [00:02<00:03, 19.14it/s, loss=1.06, v_num=1, val_acc=0.727]
Epoch 56:  43%|████▎     | 50/117 [00:02<00:03, 18.96it/s, loss=1.06, v_num=1, val_acc=0.727]
Epoch 56:  44%|████▎     | 51/117 [00:02<00:03, 19.28it/s, loss=1.06, v_num=1, val_acc=0.727]
Epoch 56:  44%|████▎     | 51/117 [00:02<00:03, 19.09it/s, loss=1.06, v_num=1, val_acc=0.727]
Epoch 56:  44%|████▍     | 52/117 [00:02<00:03, 19.40it/s, loss=1.06, v_num=1, val_acc=0.727]
Epoch 56:  44%|████▍     | 52/117 [00:02<00:03, 19.22it/s, loss=1.05, v_num=1, val_acc=0.727]
Epoch 56:  45%|████▌     | 53/117 [00:02<00:03, 19.52it/s, loss=1.05, v_num=1, val_acc=0.727]
Epoch 56:  45%|████▌     | 53/117 [00:02<00:03, 19.34it/s, loss=1.05, v_num=1, val_acc=0.727]
Epoch 56:  46%|████▌     | 54/117 [00:02<00:03, 19.64it/s, loss=1.05, v_num=1, val_acc=0.727]
Epoch 56:  46%|████▌     | 54/117 [00:02<00:03, 19.46it/s, loss=1.03, v_num=1, val_acc=0.727]
Epoch 56:  47%|████▋     | 55/117 [00:02<00:03, 19.75it/s, loss=1.03, v_num=1, val_acc=0.727]
Epoch 56:  47%|████▋     | 55/117 [00:02<00:03, 19.58it/s, loss=1.02, v_num=1, val_acc=0.727]
Epoch 56:  48%|████▊     | 56/117 [00:02<00:03, 19.87it/s, loss=1.02, v_num=1, val_acc=0.727]
Epoch 56:  48%|████▊     | 56/117 [00:02<00:03, 19.69it/s, loss=0.994, v_num=1, val_acc=0.727]
Epoch 56:  49%|████▊     | 57/117 [00:02<00:03, 19.97it/s, loss=0.994, v_num=1, val_acc=0.727]
Epoch 56:  49%|████▊     | 57/117 [00:02<00:03, 19.80it/s, loss=0.999, v_num=1, val_acc=0.727]
Epoch 56:  50%|████▉     | 58/117 [00:02<00:02, 20.08it/s, loss=0.999, v_num=1, val_acc=0.727]
Epoch 56:  50%|████▉     | 58/117 [00:02<00:02, 19.91it/s, loss=0.994, v_num=1, val_acc=0.727]
Epoch 56:  50%|█████     | 59/117 [00:02<00:02, 20.19it/s, loss=0.994, v_num=1, val_acc=0.727]
Epoch 56:  50%|█████     | 59/117 [00:02<00:02, 20.02it/s, loss=0.995, v_num=1, val_acc=0.727]
Epoch 56:  51%|█████▏    | 60/117 [00:02<00:02, 20.29it/s, loss=0.995, v_num=1, val_acc=0.727]
Epoch 56:  51%|█████▏    | 60/117 [00:02<00:02, 20.12it/s, loss=0.998, v_num=1, val_acc=0.727]
Epoch 56:  52%|█████▏    | 61/117 [00:02<00:02, 20.39it/s, loss=0.998, v_num=1, val_acc=0.727]
Epoch 56:  52%|█████▏    | 61/117 [00:03<00:02, 20.22it/s, loss=0.996, v_num=1, val_acc=0.727]
Epoch 56:  53%|█████▎    | 62/117 [00:03<00:02, 20.49it/s, loss=0.996, v_num=1, val_acc=0.727]
Epoch 56:  53%|█████▎    | 62/117 [00:03<00:02, 20.32it/s, loss=0.991, v_num=1, val_acc=0.727]
Epoch 56:  54%|█████▍    | 63/117 [00:03<00:02, 20.56it/s, loss=0.991, v_num=1, val_acc=0.727]
Epoch 56:  54%|█████▍    | 63/117 [00:03<00:02, 20.41it/s, loss=1, v_num=1, val_acc=0.727]
Epoch 56:  55%|█████▍    | 64/117 [00:03<00:02, 20.67it/s, loss=1, v_num=1, val_acc=0.727]
Epoch 56:  55%|█████▍    | 64/117 [00:03<00:02, 20.51it/s, loss=1.01, v_num=1, val_acc=0.727]
Epoch 56:  56%|█████▌    | 65/117 [00:03<00:02, 20.77it/s, loss=1.01, v_num=1, val_acc=0.727]
Epoch 56:  56%|█████▌    | 65/117 [00:03<00:02, 20.60it/s, loss=1.01, v_num=1, val_acc=0.727]
Epoch 56:  56%|█████▋    | 66/117 [00:03<00:02, 20.85it/s, loss=1.01, v_num=1, val_acc=0.727]
Epoch 56:  56%|█████▋    | 66/117 [00:03<00:02, 20.69it/s, loss=1, v_num=1, val_acc=0.727]
Epoch 56:  57%|█████▋    | 67/117 [00:03<00:02, 20.94it/s, loss=1, v_num=1, val_acc=0.727]
Epoch 56:  57%|█████▋    | 67/117 [00:03<00:02, 20.78it/s, loss=1, v_num=1, val_acc=0.727]
Epoch 56:  58%|█████▊    | 68/117 [00:03<00:02, 21.03it/s, loss=1, v_num=1, val_acc=0.727]
Epoch 56:  58%|█████▊    | 68/117 [00:03<00:02, 20.86it/s, loss=1, v_num=1, val_acc=0.727]
Epoch 56:  59%|█████▉    | 69/117 [00:03<00:02, 21.11it/s, loss=1, v_num=1, val_acc=0.727]
Epoch 56:  59%|█████▉    | 69/117 [00:03<00:02, 20.95it/s, loss=0.996, v_num=1, val_acc=0.727]
Epoch 56:  60%|█████▉    | 70/117 [00:03<00:02, 21.19it/s, loss=0.996, v_num=1, val_acc=0.727]
Epoch 56:  60%|█████▉    | 70/117 [00:03<00:02, 21.03it/s, loss=0.993, v_num=1, val_acc=0.727]
Epoch 56:  61%|██████    | 71/117 [00:03<00:02, 21.27it/s, loss=0.993, v_num=1, val_acc=0.727]
Epoch 56:  61%|██████    | 71/117 [00:03<00:02, 21.11it/s, loss=0.993, v_num=1, val_acc=0.727]
Epoch 56:  62%|██████▏   | 72/117 [00:03<00:02, 21.35it/s, loss=0.993, v_num=1, val_acc=0.727]
Epoch 56:  62%|██████▏   | 72/117 [00:03<00:02, 21.19it/s, loss=1, v_num=1, val_acc=0.727]
Epoch 56:  62%|██████▏   | 73/117 [00:03<00:02, 21.43it/s, loss=1, v_num=1, val_acc=0.727]
Epoch 56:  62%|██████▏   | 73/117 [00:03<00:02, 21.27it/s, loss=0.996, v_num=1, val_acc=0.727]
Epoch 56:  63%|██████▎   | 74/117 [00:03<00:01, 21.50it/s, loss=0.996, v_num=1, val_acc=0.727]
Epoch 56:  63%|██████▎   | 74/117 [00:03<00:02, 21.34it/s, loss=0.989, v_num=1, val_acc=0.727]
Epoch 56:  64%|██████▍   | 75/117 [00:03<00:01, 21.57it/s, loss=0.989, v_num=1, val_acc=0.727]
Epoch 56:  64%|██████▍   | 75/117 [00:03<00:01, 21.42it/s, loss=0.992, v_num=1, val_acc=0.727]
Epoch 56:  65%|██████▍   | 76/117 [00:03<00:01, 21.65it/s, loss=0.992, v_num=1, val_acc=0.727]
Epoch 56:  65%|██████▍   | 76/117 [00:03<00:01, 21.49it/s, loss=0.986, v_num=1, val_acc=0.727]
Epoch 56:  66%|██████▌   | 77/117 [00:03<00:01, 21.72it/s, loss=0.986, v_num=1, val_acc=0.727]
Epoch 56:  66%|██████▌   | 77/117 [00:03<00:01, 21.57it/s, loss=0.983, v_num=1, val_acc=0.727]
Epoch 56:  67%|██████▋   | 78/117 [00:03<00:01, 21.79it/s, loss=0.983, v_num=1, val_acc=0.727]
Epoch 56:  67%|██████▋   | 78/117 [00:03<00:01, 21.64it/s, loss=0.977, v_num=1, val_acc=0.727]
Epoch 56:  68%|██████▊   | 79/117 [00:03<00:01, 21.86it/s, loss=0.977, v_num=1, val_acc=0.727]
Epoch 56:  68%|██████▊   | 79/117 [00:03<00:01, 21.71it/s, loss=0.969, v_num=1, val_acc=0.727]
Epoch 56:  68%|██████▊   | 80/117 [00:03<00:01, 21.93it/s, loss=0.969, v_num=1, val_acc=0.727]
Epoch 56:  68%|██████▊   | 80/117 [00:03<00:01, 21.78it/s, loss=0.954, v_num=1, val_acc=0.727]
Epoch 56:  69%|██████▉   | 81/117 [00:03<00:01, 21.99it/s, loss=0.954, v_num=1, val_acc=0.727]
Epoch 56:  69%|██████▉   | 81/117 [00:03<00:01, 21.84it/s, loss=0.936, v_num=1, val_acc=0.727]
Epoch 56:  70%|███████   | 82/117 [00:03<00:01, 22.04it/s, loss=0.936, v_num=1, val_acc=0.727]
Epoch 56:  70%|███████   | 82/117 [00:03<00:01, 21.89it/s, loss=0.925, v_num=1, val_acc=0.727]
Epoch 56:  71%|███████   | 83/117 [00:03<00:01, 22.10it/s, loss=0.925, v_num=1, val_acc=0.727]
Epoch 56:  71%|███████   | 83/117 [00:03<00:01, 21.96it/s, loss=0.914, v_num=1, val_acc=0.727]
Epoch 56:  72%|███████▏  | 84/117 [00:03<00:01, 22.17it/s, loss=0.914, v_num=1, val_acc=0.727]
Epoch 56:  72%|███████▏  | 84/117 [00:03<00:01, 22.02it/s, loss=0.899, v_num=1, val_acc=0.727]
Epoch 56:  73%|███████▎  | 85/117 [00:03<00:01, 22.23it/s, loss=0.899, v_num=1, val_acc=0.727]
Epoch 56:  73%|███████▎  | 85/117 [00:03<00:01, 22.08it/s, loss=0.898, v_num=1, val_acc=0.727]
Epoch 56:  74%|███████▎  | 86/117 [00:03<00:01, 22.29it/s, loss=0.898, v_num=1, val_acc=0.727]
Epoch 56:  74%|███████▎  | 86/117 [00:03<00:01, 22.15it/s, loss=0.906, v_num=1, val_acc=0.727]
Epoch 56:  74%|███████▍  | 87/117 [00:03<00:01, 22.35it/s, loss=0.906, v_num=1, val_acc=0.727]
Epoch 56:  74%|███████▍  | 87/117 [00:03<00:01, 22.21it/s, loss=0.903, v_num=1, val_acc=0.727]
Epoch 56:  75%|███████▌  | 88/117 [00:03<00:01, 22.41it/s, loss=0.903, v_num=1, val_acc=0.727]
Epoch 56:  75%|███████▌  | 88/117 [00:03<00:01, 22.27it/s, loss=0.904, v_num=1, val_acc=0.727]
Epoch 56:  76%|███████▌  | 89/117 [00:03<00:01, 22.47it/s, loss=0.904, v_num=1, val_acc=0.727]
Epoch 56:  76%|███████▌  | 89/117 [00:03<00:01, 22.33it/s, loss=0.924, v_num=1, val_acc=0.727]
Epoch 56:  77%|███████▋  | 90/117 [00:03<00:01, 22.53it/s, loss=0.924, v_num=1, val_acc=0.727]
Epoch 56:  77%|███████▋  | 90/117 [00:04<00:01, 22.39it/s, loss=0.963, v_num=1, val_acc=0.727]
Epoch 56:  78%|███████▊  | 91/117 [00:04<00:01, 22.59it/s, loss=0.963, v_num=1, val_acc=0.727]
Epoch 56:  78%|███████▊  | 91/117 [00:04<00:01, 22.44it/s, loss=0.968, v_num=1, val_acc=0.727]
Epoch 56:  79%|███████▊  | 92/117 [00:04<00:01, 22.64it/s, loss=0.968, v_num=1, val_acc=0.727]
Epoch 56:  79%|███████▊  | 92/117 [00:04<00:01, 22.50it/s, loss=0.969, v_num=1, val_acc=0.727]
Epoch 56:  79%|███████▉  | 93/117 [00:04<00:01, 22.69it/s, loss=0.969, v_num=1, val_acc=0.727]
Epoch 56:  79%|███████▉  | 93/117 [00:04<00:01, 22.55it/s, loss=0.976, v_num=1, val_acc=0.727]
Epoch 56:  80%|████████  | 94/117 [00:04<00:01, 22.74it/s, loss=0.976, v_num=1, val_acc=0.727]
Epoch 56:  80%|████████  | 94/117 [00:04<00:01, 22.60it/s, loss=0.981, v_num=1, val_acc=0.727]
Epoch 56:  81%|████████  | 95/117 [00:04<00:00, 22.79it/s, loss=0.981, v_num=1, val_acc=0.727]
Epoch 56:  81%|████████  | 95/117 [00:04<00:00, 22.66it/s, loss=0.985, v_num=1, val_acc=0.727]
Epoch 56:  82%|████████▏ | 96/117 [00:04<00:00, 22.85it/s, loss=0.985, v_num=1, val_acc=0.727]
Epoch 56:  82%|████████▏ | 96/117 [00:04<00:00, 22.71it/s, loss=1, v_num=1, val_acc=0.727]
Epoch 56:  83%|████████▎ | 97/117 [00:04<00:00, 22.90it/s, loss=1, v_num=1, val_acc=0.727]
Epoch 56:  83%|████████▎ | 97/117 [00:04<00:00, 22.76it/s, loss=0.998, v_num=1, val_acc=0.727]

Validation: 0it [00:00, ?it/s]

Validation:   0%|          | 0/20 [00:00<?, ?it/s]

Validation DataLoader 0:   0%|          | 0/20 [00:00<?, ?it/s]

Validation DataLoader 0:   5%|▌         | 1/20 [00:00<00:00, 161.89it/s]
Epoch 56:  84%|████████▍ | 98/117 [00:05<00:00, 19.17it/s, loss=0.998, v_num=1, val_acc=0.727]

Validation DataLoader 0:  10%|█         | 2/20 [00:00<00:00, 55.89it/s]
Epoch 56:  85%|████████▍ | 99/117 [00:05<00:00, 19.26it/s, loss=0.998, v_num=1, val_acc=0.727]

Validation DataLoader 0:  15%|█▌        | 3/20 [00:00<00:00, 44.50it/s]
Epoch 56:  85%|████████▌ | 100/117 [00:05<00:00, 19.33it/s, loss=0.998, v_num=1, val_acc=0.727]

Validation DataLoader 0:  20%|██        | 4/20 [00:00<00:00, 40.47it/s]
Epoch 56:  86%|████████▋ | 101/117 [00:05<00:00, 19.41it/s, loss=0.998, v_num=1, val_acc=0.727]

Validation DataLoader 0:  25%|██▌       | 5/20 [00:00<00:00, 38.20it/s]
Epoch 56:  87%|████████▋ | 102/117 [00:05<00:00, 19.48it/s, loss=0.998, v_num=1, val_acc=0.727]

Validation DataLoader 0:  30%|███       | 6/20 [00:00<00:00, 36.96it/s]
Epoch 56:  88%|████████▊ | 103/117 [00:05<00:00, 19.56it/s, loss=0.998, v_num=1, val_acc=0.727]

Validation DataLoader 0:  35%|███▌      | 7/20 [00:00<00:00, 36.12it/s]
Epoch 56:  89%|████████▉ | 104/117 [00:05<00:00, 19.63it/s, loss=0.998, v_num=1, val_acc=0.727]

Validation DataLoader 0:  40%|████      | 8/20 [00:00<00:00, 35.44it/s]
Epoch 56:  90%|████████▉ | 105/117 [00:05<00:00, 19.70it/s, loss=0.998, v_num=1, val_acc=0.727]

Validation DataLoader 0:  45%|████▌     | 9/20 [00:00<00:00, 34.93it/s]
Epoch 56:  91%|█████████ | 106/117 [00:05<00:00, 19.77it/s, loss=0.998, v_num=1, val_acc=0.727]

Validation DataLoader 0:  50%|█████     | 10/20 [00:00<00:00, 34.60it/s]
Epoch 56:  91%|█████████▏| 107/117 [00:05<00:00, 19.84it/s, loss=0.998, v_num=1, val_acc=0.727]

Validation DataLoader 0:  55%|█████▌    | 11/20 [00:00<00:00, 34.30it/s]
Epoch 56:  92%|█████████▏| 108/117 [00:05<00:00, 19.91it/s, loss=0.998, v_num=1, val_acc=0.727]

Validation DataLoader 0:  60%|██████    | 12/20 [00:00<00:00, 34.06it/s]
Epoch 56:  93%|█████████▎| 109/117 [00:05<00:00, 19.97it/s, loss=0.998, v_num=1, val_acc=0.727]

Validation DataLoader 0:  65%|██████▌   | 13/20 [00:00<00:00, 33.85it/s]
Epoch 56:  94%|█████████▍| 110/117 [00:05<00:00, 20.04it/s, loss=0.998, v_num=1, val_acc=0.727]

Validation DataLoader 0:  70%|███████   | 14/20 [00:00<00:00, 33.69it/s]
Epoch 56:  95%|█████████▍| 111/117 [00:05<00:00, 20.11it/s, loss=0.998, v_num=1, val_acc=0.727]

Validation DataLoader 0:  75%|███████▌  | 15/20 [00:00<00:00, 33.54it/s]
Epoch 56:  96%|█████████▌| 112/117 [00:05<00:00, 20.17it/s, loss=0.998, v_num=1, val_acc=0.727]

Validation DataLoader 0:  80%|████████  | 16/20 [00:00<00:00, 33.41it/s]
Epoch 56:  97%|█████████▋| 113/117 [00:05<00:00, 20.24it/s, loss=0.998, v_num=1, val_acc=0.727]

Validation DataLoader 0:  85%|████████▌ | 17/20 [00:00<00:00, 33.28it/s]
Epoch 56:  97%|█████████▋| 114/117 [00:05<00:00, 20.30it/s, loss=0.998, v_num=1, val_acc=0.727]

Validation DataLoader 0:  90%|█████████ | 18/20 [00:00<00:00, 33.18it/s]
Epoch 56:  98%|█████████▊| 115/117 [00:05<00:00, 20.36it/s, loss=0.998, v_num=1, val_acc=0.727]

Validation DataLoader 0:  95%|█████████▌| 19/20 [00:00<00:00, 33.09it/s]
Epoch 56:  99%|█████████▉| 116/117 [00:05<00:00, 20.43it/s, loss=0.998, v_num=1, val_acc=0.727]

Validation DataLoader 0: 100%|██████████| 20/20 [00:00<00:00, 33.08it/s]
Epoch 56: 100%|██████████| 117/117 [00:05<00:00, 20.49it/s, loss=0.998, v_num=1, val_acc=0.727]
Epoch 56: 100%|██████████| 117/117 [00:05<00:00, 20.42it/s, loss=0.998, v_num=1, val_acc=0.745]


Epoch 56: 100%|██████████| 117/117 [00:05<00:00, 20.42it/s, loss=0.998, v_num=1, val_acc=0.745]
Epoch 56:   0%|          | 0/117 [00:00<?, ?it/s, loss=0.998, v_num=1, val_acc=0.745]
Epoch 57:   0%|          | 0/117 [00:00<?, ?it/s, loss=0.998, v_num=1, val_acc=0.745]
Epoch 57:   1%|          | 1/117 [00:00<01:46,  1.09it/s, loss=0.998, v_num=1, val_acc=0.745]
Epoch 57:   1%|          | 1/117 [00:00<01:48,  1.07it/s, loss=1.01, v_num=1, val_acc=0.745]
Epoch 57:   2%|▏         | 2/117 [00:00<00:54,  2.11it/s, loss=1.01, v_num=1, val_acc=0.745]
Epoch 57:   2%|▏         | 2/117 [00:00<00:55,  2.06it/s, loss=1.02, v_num=1, val_acc=0.745]
Epoch 57:   3%|▎         | 3/117 [00:00<00:37,  3.03it/s, loss=1.02, v_num=1, val_acc=0.745]
Epoch 57:   3%|▎         | 3/117 [00:01<00:38,  2.97it/s, loss=1.04, v_num=1, val_acc=0.745]
Epoch 57:   3%|▎         | 4/117 [00:01<00:28,  3.91it/s, loss=1.04, v_num=1, val_acc=0.745]
Epoch 57:   3%|▎         | 4/117 [00:01<00:29,  3.82it/s, loss=1.05, v_num=1, val_acc=0.745]
Epoch 57:   4%|▍         | 5/117 [00:01<00:23,  4.73it/s, loss=1.05, v_num=1, val_acc=0.745]
Epoch 57:   4%|▍         | 5/117 [00:01<00:24,  4.62it/s, loss=1.06, v_num=1, val_acc=0.745]
Epoch 57:   5%|▌         | 6/117 [00:01<00:20,  5.50it/s, loss=1.06, v_num=1, val_acc=0.745]
Epoch 57:   5%|▌         | 6/117 [00:01<00:20,  5.37it/s, loss=1.06, v_num=1, val_acc=0.745]
Epoch 57:   6%|▌         | 7/117 [00:01<00:17,  6.22it/s, loss=1.06, v_num=1, val_acc=0.745]
Epoch 57:   6%|▌         | 7/117 [00:01<00:18,  6.09it/s, loss=1.06, v_num=1, val_acc=0.745]
Epoch 57:   7%|▋         | 8/117 [00:01<00:15,  6.90it/s, loss=1.06, v_num=1, val_acc=0.745]
Epoch 57:   7%|▋         | 8/117 [00:01<00:16,  6.76it/s, loss=1.06, v_num=1, val_acc=0.745]
Epoch 57:   8%|▊         | 9/117 [00:01<00:14,  7.49it/s, loss=1.06, v_num=1, val_acc=0.745]
Epoch 57:   8%|▊         | 9/117 [00:01<00:14,  7.35it/s, loss=1.06, v_num=1, val_acc=0.745]
Epoch 57:   9%|▊         | 10/117 [00:01<00:13,  8.11it/s, loss=1.06, v_num=1, val_acc=0.745]
Epoch 57:   9%|▊         | 10/117 [00:01<00:13,  7.95it/s, loss=1.06, v_num=1, val_acc=0.745]
Epoch 57:   9%|▉         | 11/117 [00:01<00:12,  8.68it/s, loss=1.06, v_num=1, val_acc=0.745]
Epoch 57:   9%|▉         | 11/117 [00:01<00:12,  8.51it/s, loss=1.04, v_num=1, val_acc=0.745]
Epoch 57:  10%|█         | 12/117 [00:01<00:11,  9.23it/s, loss=1.04, v_num=1, val_acc=0.745]
Epoch 57:  10%|█         | 12/117 [00:01<00:11,  9.05it/s, loss=1.02, v_num=1, val_acc=0.745]
Epoch 57:  11%|█         | 13/117 [00:01<00:10,  9.74it/s, loss=1.02, v_num=1, val_acc=0.745]
Epoch 57:  11%|█         | 13/117 [00:01<00:10,  9.56it/s, loss=0.963, v_num=1, val_acc=0.745]
Epoch 57:  12%|█▏        | 14/117 [00:01<00:10, 10.23it/s, loss=0.963, v_num=1, val_acc=0.745]
Epoch 57:  12%|█▏        | 14/117 [00:01<00:10, 10.04it/s, loss=0.955, v_num=1, val_acc=0.745]
Epoch 57:  13%|█▎        | 15/117 [00:01<00:09, 10.69it/s, loss=0.955, v_num=1, val_acc=0.745]
Epoch 57:  13%|█▎        | 15/117 [00:01<00:09, 10.50it/s, loss=0.946, v_num=1, val_acc=0.745]
Epoch 57:  14%|█▎        | 16/117 [00:01<00:09, 11.13it/s, loss=0.946, v_num=1, val_acc=0.745]
Epoch 57:  14%|█▎        | 16/117 [00:01<00:09, 10.94it/s, loss=0.939, v_num=1, val_acc=0.745]
Epoch 57:  15%|█▍        | 17/117 [00:01<00:08, 11.53it/s, loss=0.939, v_num=1, val_acc=0.745]
Epoch 57:  15%|█▍        | 17/117 [00:01<00:08, 11.33it/s, loss=0.934, v_num=1, val_acc=0.745]
Epoch 57:  15%|█▌        | 18/117 [00:01<00:08, 11.91it/s, loss=0.934, v_num=1, val_acc=0.745]
Epoch 57:  15%|█▌        | 18/117 [00:01<00:08, 11.73it/s, loss=0.928, v_num=1, val_acc=0.745]
Epoch 57:  16%|█▌        | 19/117 [00:01<00:07, 12.31it/s, loss=0.928, v_num=1, val_acc=0.745]
Epoch 57:  16%|█▌        | 19/117 [00:01<00:08, 12.11it/s, loss=0.92, v_num=1, val_acc=0.745]
Epoch 57:  17%|█▋        | 20/117 [00:01<00:07, 12.68it/s, loss=0.92, v_num=1, val_acc=0.745]
Epoch 57:  17%|█▋        | 20/117 [00:01<00:07, 12.48it/s, loss=0.921, v_num=1, val_acc=0.745]
Epoch 57:  18%|█▊        | 21/117 [00:01<00:07, 13.04it/s, loss=0.921, v_num=1, val_acc=0.745]
Epoch 57:  18%|█▊        | 21/117 [00:01<00:07, 12.83it/s, loss=0.916, v_num=1, val_acc=0.745]
Epoch 57:  19%|█▉        | 22/117 [00:01<00:07, 13.36it/s, loss=0.916, v_num=1, val_acc=0.745]
Epoch 57:  19%|█▉        | 22/117 [00:01<00:07, 13.16it/s, loss=0.905, v_num=1, val_acc=0.745]
Epoch 57:  20%|█▉        | 23/117 [00:01<00:06, 13.68it/s, loss=0.905, v_num=1, val_acc=0.745]
Epoch 57:  20%|█▉        | 23/117 [00:01<00:06, 13.48it/s, loss=0.881, v_num=1, val_acc=0.745]
Epoch 57:  21%|██        | 24/117 [00:01<00:06, 13.99it/s, loss=0.881, v_num=1, val_acc=0.745]
Epoch 57:  21%|██        | 24/117 [00:01<00:06, 13.79it/s, loss=0.865, v_num=1, val_acc=0.745]
Epoch 57:  21%|██▏       | 25/117 [00:01<00:06, 14.27it/s, loss=0.865, v_num=1, val_acc=0.745]
Epoch 57:  21%|██▏       | 25/117 [00:01<00:06, 14.07it/s, loss=0.856, v_num=1, val_acc=0.745]
Epoch 57:  22%|██▏       | 26/117 [00:01<00:06, 14.56it/s, loss=0.856, v_num=1, val_acc=0.745]
Epoch 57:  22%|██▏       | 26/117 [00:01<00:06, 14.35it/s, loss=0.848, v_num=1, val_acc=0.745]
Epoch 57:  23%|██▎       | 27/117 [00:01<00:06, 14.84it/s, loss=0.848, v_num=1, val_acc=0.745]
Epoch 57:  23%|██▎       | 27/117 [00:01<00:06, 14.63it/s, loss=0.856, v_num=1, val_acc=0.745]
Epoch 57:  24%|██▍       | 28/117 [00:01<00:05, 15.11it/s, loss=0.856, v_num=1, val_acc=0.745]
Epoch 57:  24%|██▍       | 28/117 [00:01<00:05, 14.90it/s, loss=0.851, v_num=1, val_acc=0.745]
Epoch 57:  25%|██▍       | 29/117 [00:01<00:05, 15.36it/s, loss=0.851, v_num=1, val_acc=0.745]
Epoch 57:  25%|██▍       | 29/117 [00:01<00:05, 15.16it/s, loss=0.842, v_num=1, val_acc=0.745]
Epoch 57:  26%|██▌       | 30/117 [00:01<00:05, 15.61it/s, loss=0.842, v_num=1, val_acc=0.745]
Epoch 57:  26%|██▌       | 30/117 [00:01<00:05, 15.40it/s, loss=0.846, v_num=1, val_acc=0.745]
Epoch 57:  26%|██▋       | 31/117 [00:01<00:05, 15.84it/s, loss=0.846, v_num=1, val_acc=0.745]
Epoch 57:  26%|██▋       | 31/117 [00:01<00:05, 15.64it/s, loss=0.849, v_num=1, val_acc=0.745]
Epoch 57:  27%|██▋       | 32/117 [00:01<00:05, 16.07it/s, loss=0.849, v_num=1, val_acc=0.745]
Epoch 57:  27%|██▋       | 32/117 [00:02<00:05, 15.87it/s, loss=0.855, v_num=1, val_acc=0.745]
Epoch 57:  28%|██▊       | 33/117 [00:02<00:05, 16.28it/s, loss=0.855, v_num=1, val_acc=0.745]
Epoch 57:  28%|██▊       | 33/117 [00:02<00:05, 16.08it/s, loss=0.856, v_num=1, val_acc=0.745]
Epoch 57:  29%|██▉       | 34/117 [00:02<00:05, 16.50it/s, loss=0.856, v_num=1, val_acc=0.745]
Epoch 57:  29%|██▉       | 34/117 [00:02<00:05, 16.30it/s, loss=0.856, v_num=1, val_acc=0.745]
Epoch 57:  30%|██▉       | 35/117 [00:02<00:04, 16.71it/s, loss=0.856, v_num=1, val_acc=0.745]
Epoch 57:  30%|██▉       | 35/117 [00:02<00:04, 16.51it/s, loss=0.851, v_num=1, val_acc=0.745]
Epoch 57:  31%|███       | 36/117 [00:02<00:04, 16.91it/s, loss=0.851, v_num=1, val_acc=0.745]
Epoch 57:  31%|███       | 36/117 [00:02<00:04, 16.71it/s, loss=0.862, v_num=1, val_acc=0.745]
Epoch 57:  32%|███▏      | 37/117 [00:02<00:04, 17.10it/s, loss=0.862, v_num=1, val_acc=0.745]
Epoch 57:  32%|███▏      | 37/117 [00:02<00:04, 16.90it/s, loss=0.872, v_num=1, val_acc=0.745]
Epoch 57:  32%|███▏      | 38/117 [00:02<00:04, 17.29it/s, loss=0.872, v_num=1, val_acc=0.745]
Epoch 57:  32%|███▏      | 38/117 [00:02<00:04, 17.09it/s, loss=0.876, v_num=1, val_acc=0.745]
Epoch 57:  33%|███▎      | 39/117 [00:02<00:04, 17.47it/s, loss=0.876, v_num=1, val_acc=0.745]
Epoch 57:  33%|███▎      | 39/117 [00:02<00:04, 17.27it/s, loss=0.871, v_num=1, val_acc=0.745]
Epoch 57:  34%|███▍      | 40/117 [00:02<00:04, 17.64it/s, loss=0.871, v_num=1, val_acc=0.745]
Epoch 57:  34%|███▍      | 40/117 [00:02<00:04, 17.44it/s, loss=0.868, v_num=1, val_acc=0.745]
Epoch 57:  35%|███▌      | 41/117 [00:02<00:04, 17.80it/s, loss=0.868, v_num=1, val_acc=0.745]
Epoch 57:  35%|███▌      | 41/117 [00:02<00:04, 17.61it/s, loss=0.865, v_num=1, val_acc=0.745]
Epoch 57:  36%|███▌      | 42/117 [00:02<00:04, 17.96it/s, loss=0.865, v_num=1, val_acc=0.745]
Epoch 57:  36%|███▌      | 42/117 [00:02<00:04, 17.77it/s, loss=0.869, v_num=1, val_acc=0.745]
Epoch 57:  37%|███▋      | 43/117 [00:02<00:04, 18.13it/s, loss=0.869, v_num=1, val_acc=0.745]
Epoch 57:  37%|███▋      | 43/117 [00:02<00:04, 17.94it/s, loss=0.879, v_num=1, val_acc=0.745]
Epoch 57:  38%|███▊      | 44/117 [00:02<00:03, 18.28it/s, loss=0.879, v_num=1, val_acc=0.745]
Epoch 57:  38%|███▊      | 44/117 [00:02<00:04, 18.09it/s, loss=0.896, v_num=1, val_acc=0.745]
Epoch 57:  38%|███▊      | 45/117 [00:02<00:03, 18.43it/s, loss=0.896, v_num=1, val_acc=0.745]
Epoch 57:  38%|███▊      | 45/117 [00:02<00:03, 18.24it/s, loss=0.933, v_num=1, val_acc=0.745]
Epoch 57:  39%|███▉      | 46/117 [00:02<00:03, 18.58it/s, loss=0.933, v_num=1, val_acc=0.745]
Epoch 57:  39%|███▉      | 46/117 [00:02<00:03, 18.39it/s, loss=0.946, v_num=1, val_acc=0.745]
Epoch 57:  40%|████      | 47/117 [00:02<00:03, 18.69it/s, loss=0.946, v_num=1, val_acc=0.745]
Epoch 57:  40%|████      | 47/117 [00:02<00:03, 18.51it/s, loss=0.942, v_num=1, val_acc=0.745]
Epoch 57:  41%|████      | 48/117 [00:02<00:03, 18.83it/s, loss=0.942, v_num=1, val_acc=0.745]
Epoch 57:  41%|████      | 48/117 [00:02<00:03, 18.65it/s, loss=0.944, v_num=1, val_acc=0.745]
Epoch 57:  42%|████▏     | 49/117 [00:02<00:03, 18.97it/s, loss=0.944, v_num=1, val_acc=0.745]
Epoch 57:  42%|████▏     | 49/117 [00:02<00:03, 18.78it/s, loss=0.951, v_num=1, val_acc=0.745]
Epoch 57:  43%|████▎     | 50/117 [00:02<00:03, 19.10it/s, loss=0.951, v_num=1, val_acc=0.745]
Epoch 57:  43%|████▎     | 50/117 [00:02<00:03, 18.92it/s, loss=0.949, v_num=1, val_acc=0.745]
Epoch 57:  44%|████▎     | 51/117 [00:02<00:03, 19.22it/s, loss=0.949, v_num=1, val_acc=0.745]
Epoch 57:  44%|████▎     | 51/117 [00:02<00:03, 19.05it/s, loss=0.955, v_num=1, val_acc=0.745]
Epoch 57:  44%|████▍     | 52/117 [00:02<00:03, 19.35it/s, loss=0.955, v_num=1, val_acc=0.745]
Epoch 57:  44%|████▍     | 52/117 [00:02<00:03, 19.17it/s, loss=0.949, v_num=1, val_acc=0.745]
Epoch 57:  45%|████▌     | 53/117 [00:02<00:03, 19.48it/s, loss=0.949, v_num=1, val_acc=0.745]
Epoch 57:  45%|████▌     | 53/117 [00:02<00:03, 19.30it/s, loss=0.946, v_num=1, val_acc=0.745]
Epoch 57:  46%|████▌     | 54/117 [00:02<00:03, 19.60it/s, loss=0.946, v_num=1, val_acc=0.745]
Epoch 57:  46%|████▌     | 54/117 [00:02<00:03, 19.42it/s, loss=0.948, v_num=1, val_acc=0.745]
Epoch 57:  47%|████▋     | 55/117 [00:02<00:03, 19.71it/s, loss=0.948, v_num=1, val_acc=0.745]
Epoch 57:  47%|████▋     | 55/117 [00:02<00:03, 19.53it/s, loss=0.959, v_num=1, val_acc=0.745]
Epoch 57:  48%|████▊     | 56/117 [00:02<00:03, 19.82it/s, loss=0.959, v_num=1, val_acc=0.745]
Epoch 57:  48%|████▊     | 56/117 [00:02<00:03, 19.65it/s, loss=0.963, v_num=1, val_acc=0.745]
Epoch 57:  49%|████▊     | 57/117 [00:02<00:03, 19.93it/s, loss=0.963, v_num=1, val_acc=0.745]
Epoch 57:  49%|████▊     | 57/117 [00:02<00:03, 19.75it/s, loss=0.961, v_num=1, val_acc=0.745]
Epoch 57:  50%|████▉     | 58/117 [00:02<00:02, 20.03it/s, loss=0.961, v_num=1, val_acc=0.745]
Epoch 57:  50%|████▉     | 58/117 [00:02<00:02, 19.86it/s, loss=0.961, v_num=1, val_acc=0.745]
Epoch 57:  50%|█████     | 59/117 [00:02<00:02, 20.14it/s, loss=0.961, v_num=1, val_acc=0.745]
Epoch 57:  50%|█████     | 59/117 [00:02<00:02, 19.97it/s, loss=0.965, v_num=1, val_acc=0.745]
Epoch 57:  51%|█████▏    | 60/117 [00:02<00:02, 20.20it/s, loss=0.965, v_num=1, val_acc=0.745]
Epoch 57:  51%|█████▏    | 60/117 [00:02<00:02, 20.06it/s, loss=0.968, v_num=1, val_acc=0.745]
Epoch 57:  52%|█████▏    | 61/117 [00:03<00:02, 20.33it/s, loss=0.968, v_num=1, val_acc=0.745]
Epoch 57:  52%|█████▏    | 61/117 [00:03<00:02, 20.16it/s, loss=0.966, v_num=1, val_acc=0.745]
Epoch 57:  53%|█████▎    | 62/117 [00:03<00:02, 20.42it/s, loss=0.966, v_num=1, val_acc=0.745]
Epoch 57:  53%|█████▎    | 62/117 [00:03<00:02, 20.26it/s, loss=0.959, v_num=1, val_acc=0.745]
Epoch 57:  54%|█████▍    | 63/117 [00:03<00:02, 20.52it/s, loss=0.959, v_num=1, val_acc=0.745]
Epoch 57:  54%|█████▍    | 63/117 [00:03<00:02, 20.35it/s, loss=0.952, v_num=1, val_acc=0.745]
Epoch 57:  55%|█████▍    | 64/117 [00:03<00:02, 20.61it/s, loss=0.952, v_num=1, val_acc=0.745]
Epoch 57:  55%|█████▍    | 64/117 [00:03<00:02, 20.45it/s, loss=0.944, v_num=1, val_acc=0.745]
Epoch 57:  56%|█████▌    | 65/117 [00:03<00:02, 20.71it/s, loss=0.944, v_num=1, val_acc=0.745]
Epoch 57:  56%|█████▌    | 65/117 [00:03<00:02, 20.54it/s, loss=0.915, v_num=1, val_acc=0.745]
Epoch 57:  56%|█████▋    | 66/117 [00:03<00:02, 20.80it/s, loss=0.915, v_num=1, val_acc=0.745]
Epoch 57:  56%|█████▋    | 66/117 [00:03<00:02, 20.63it/s, loss=0.908, v_num=1, val_acc=0.745]
Epoch 57:  57%|█████▋    | 67/117 [00:03<00:02, 20.88it/s, loss=0.908, v_num=1, val_acc=0.745]
Epoch 57:  57%|█████▋    | 67/117 [00:03<00:02, 20.72it/s, loss=0.911, v_num=1, val_acc=0.745]
Epoch 57:  58%|█████▊    | 68/117 [00:03<00:02, 20.97it/s, loss=0.911, v_num=1, val_acc=0.745]
Epoch 57:  58%|█████▊    | 68/117 [00:03<00:02, 20.81it/s, loss=0.91, v_num=1, val_acc=0.745]
Epoch 57:  59%|█████▉    | 69/117 [00:03<00:02, 21.06it/s, loss=0.91, v_num=1, val_acc=0.745]
Epoch 57:  59%|█████▉    | 69/117 [00:03<00:02, 20.89it/s, loss=0.902, v_num=1, val_acc=0.745]
Epoch 57:  60%|█████▉    | 70/117 [00:03<00:02, 21.14it/s, loss=0.902, v_num=1, val_acc=0.745]
Epoch 57:  60%|█████▉    | 70/117 [00:03<00:02, 20.98it/s, loss=0.9, v_num=1, val_acc=0.745]
Epoch 57:  61%|██████    | 71/117 [00:03<00:02, 21.22it/s, loss=0.9, v_num=1, val_acc=0.745]
Epoch 57:  61%|██████    | 71/117 [00:03<00:02, 21.06it/s, loss=0.905, v_num=1, val_acc=0.745]
Epoch 57:  62%|██████▏   | 72/117 [00:03<00:02, 21.30it/s, loss=0.905, v_num=1, val_acc=0.745]
Epoch 57:  62%|██████▏   | 72/117 [00:03<00:02, 21.14it/s, loss=0.919, v_num=1, val_acc=0.745]
Epoch 57:  62%|██████▏   | 73/117 [00:03<00:02, 21.37it/s, loss=0.919, v_num=1, val_acc=0.745]
Epoch 57:  62%|██████▏   | 73/117 [00:03<00:02, 21.22it/s, loss=0.938, v_num=1, val_acc=0.745]
Epoch 57:  63%|██████▎   | 74/117 [00:03<00:02, 21.45it/s, loss=0.938, v_num=1, val_acc=0.745]
Epoch 57:  63%|██████▎   | 74/117 [00:03<00:02, 21.29it/s, loss=0.939, v_num=1, val_acc=0.745]
Epoch 57:  64%|██████▍   | 75/117 [00:03<00:01, 21.52it/s, loss=0.939, v_num=1, val_acc=0.745]
Epoch 57:  64%|██████▍   | 75/117 [00:03<00:01, 21.37it/s, loss=0.93, v_num=1, val_acc=0.745]
Epoch 57:  65%|██████▍   | 76/117 [00:03<00:01, 21.60it/s, loss=0.93, v_num=1, val_acc=0.745]
Epoch 57:  65%|██████▍   | 76/117 [00:03<00:01, 21.44it/s, loss=0.918, v_num=1, val_acc=0.745]
Epoch 57:  66%|██████▌   | 77/117 [00:03<00:01, 21.67it/s, loss=0.918, v_num=1, val_acc=0.745]
Epoch 57:  66%|██████▌   | 77/117 [00:03<00:01, 21.51it/s, loss=0.913, v_num=1, val_acc=0.745]
Epoch 57:  67%|██████▋   | 78/117 [00:03<00:01, 21.74it/s, loss=0.913, v_num=1, val_acc=0.745]
Epoch 57:  67%|██████▋   | 78/117 [00:03<00:01, 21.59it/s, loss=0.906, v_num=1, val_acc=0.745]
Epoch 57:  68%|██████▊   | 79/117 [00:03<00:01, 21.81it/s, loss=0.906, v_num=1, val_acc=0.745]
Epoch 57:  68%|██████▊   | 79/117 [00:03<00:01, 21.66it/s, loss=0.906, v_num=1, val_acc=0.745]
Epoch 57:  68%|██████▊   | 80/117 [00:03<00:01, 21.87it/s, loss=0.906, v_num=1, val_acc=0.745]
Epoch 57:  68%|██████▊   | 80/117 [00:03<00:01, 21.72it/s, loss=0.914, v_num=1, val_acc=0.745]
Epoch 57:  69%|██████▉   | 81/117 [00:03<00:01, 21.94it/s, loss=0.914, v_num=1, val_acc=0.745]
Epoch 57:  69%|██████▉   | 81/117 [00:03<00:01, 21.79it/s, loss=0.933, v_num=1, val_acc=0.745]
Epoch 57:  70%|███████   | 82/117 [00:03<00:01, 21.97it/s, loss=0.933, v_num=1, val_acc=0.745]
Epoch 57:  70%|███████   | 82/117 [00:03<00:01, 21.82it/s, loss=0.96, v_num=1, val_acc=0.745]
Epoch 57:  71%|███████   | 83/117 [00:03<00:01, 22.04it/s, loss=0.96, v_num=1, val_acc=0.745]
Epoch 57:  71%|███████   | 83/117 [00:03<00:01, 21.89it/s, loss=0.971, v_num=1, val_acc=0.745]
Epoch 57:  72%|███████▏  | 84/117 [00:03<00:01, 22.10it/s, loss=0.971, v_num=1, val_acc=0.745]
Epoch 57:  72%|███████▏  | 84/117 [00:03<00:01, 21.95it/s, loss=0.969, v_num=1, val_acc=0.745]
Epoch 57:  73%|███████▎  | 85/117 [00:03<00:01, 22.16it/s, loss=0.969, v_num=1, val_acc=0.745]
Epoch 57:  73%|███████▎  | 85/117 [00:03<00:01, 22.02it/s, loss=0.963, v_num=1, val_acc=0.745]
Epoch 57:  74%|███████▎  | 86/117 [00:03<00:01, 22.23it/s, loss=0.963, v_num=1, val_acc=0.745]
Epoch 57:  74%|███████▎  | 86/117 [00:03<00:01, 22.08it/s, loss=0.957, v_num=1, val_acc=0.745]
Epoch 57:  74%|███████▍  | 87/117 [00:03<00:01, 22.29it/s, loss=0.957, v_num=1, val_acc=0.745]
Epoch 57:  74%|███████▍  | 87/117 [00:03<00:01, 22.14it/s, loss=0.949, v_num=1, val_acc=0.745]
Epoch 57:  75%|███████▌  | 88/117 [00:03<00:01, 22.35it/s, loss=0.949, v_num=1, val_acc=0.745]
Epoch 57:  75%|███████▌  | 88/117 [00:03<00:01, 22.20it/s, loss=0.942, v_num=1, val_acc=0.745]
Epoch 57:  76%|███████▌  | 89/117 [00:03<00:01, 22.41it/s, loss=0.942, v_num=1, val_acc=0.745]
Epoch 57:  76%|███████▌  | 89/117 [00:03<00:01, 22.27it/s, loss=0.937, v_num=1, val_acc=0.745]
Epoch 57:  77%|███████▋  | 90/117 [00:04<00:01, 22.47it/s, loss=0.937, v_num=1, val_acc=0.745]
Epoch 57:  77%|███████▋  | 90/117 [00:04<00:01, 22.32it/s, loss=0.942, v_num=1, val_acc=0.745]
Epoch 57:  78%|███████▊  | 91/117 [00:04<00:01, 22.52it/s, loss=0.942, v_num=1, val_acc=0.745]
Epoch 57:  78%|███████▊  | 91/117 [00:04<00:01, 22.38it/s, loss=0.936, v_num=1, val_acc=0.745]
Epoch 57:  79%|███████▊  | 92/117 [00:04<00:01, 22.58it/s, loss=0.936, v_num=1, val_acc=0.745]
Epoch 57:  79%|███████▊  | 92/117 [00:04<00:01, 22.44it/s, loss=0.92, v_num=1, val_acc=0.745]
Epoch 57:  79%|███████▉  | 93/117 [00:04<00:01, 22.63it/s, loss=0.92, v_num=1, val_acc=0.745]
Epoch 57:  79%|███████▉  | 93/117 [00:04<00:01, 22.49it/s, loss=0.902, v_num=1, val_acc=0.745]
Epoch 57:  80%|████████  | 94/117 [00:04<00:01, 22.69it/s, loss=0.902, v_num=1, val_acc=0.745]
Epoch 57:  80%|████████  | 94/117 [00:04<00:01, 22.55it/s, loss=0.895, v_num=1, val_acc=0.745]
Epoch 57:  81%|████████  | 95/117 [00:04<00:00, 22.74it/s, loss=0.895, v_num=1, val_acc=0.745]
Epoch 57:  81%|████████  | 95/117 [00:04<00:00, 22.60it/s, loss=0.902, v_num=1, val_acc=0.745]
Epoch 57:  82%|████████▏ | 96/117 [00:04<00:00, 22.79it/s, loss=0.902, v_num=1, val_acc=0.745]
Epoch 57:  82%|████████▏ | 96/117 [00:04<00:00, 22.65it/s, loss=0.929, v_num=1, val_acc=0.745]
Epoch 57:  83%|████████▎ | 97/117 [00:04<00:00, 22.84it/s, loss=0.929, v_num=1, val_acc=0.745]
Epoch 57:  83%|████████▎ | 97/117 [00:04<00:00, 22.71it/s, loss=0.934, v_num=1, val_acc=0.745]

Validation: 0it [00:00, ?it/s]

Validation:   0%|          | 0/20 [00:00<?, ?it/s]

Validation DataLoader 0:   0%|          | 0/20 [00:00<?, ?it/s]

Validation DataLoader 0:   5%|▌         | 1/20 [00:00<00:00, 130.56it/s]
Epoch 57:  84%|████████▍ | 98/117 [00:05<00:00, 19.16it/s, loss=0.934, v_num=1, val_acc=0.745]

Validation DataLoader 0:  10%|█         | 2/20 [00:00<00:00, 54.64it/s]
Epoch 57:  85%|████████▍ | 99/117 [00:05<00:00, 19.25it/s, loss=0.934, v_num=1, val_acc=0.745]

Validation DataLoader 0:  15%|█▌        | 3/20 [00:00<00:00, 43.91it/s]
Epoch 57:  85%|████████▌ | 100/117 [00:05<00:00, 19.32it/s, loss=0.934, v_num=1, val_acc=0.745]

Validation DataLoader 0:  20%|██        | 4/20 [00:00<00:00, 39.95it/s]
Epoch 57:  86%|████████▋ | 101/117 [00:05<00:00, 19.40it/s, loss=0.934, v_num=1, val_acc=0.745]

Validation DataLoader 0:  25%|██▌       | 5/20 [00:00<00:00, 37.80it/s]
Epoch 57:  87%|████████▋ | 102/117 [00:05<00:00, 19.47it/s, loss=0.934, v_num=1, val_acc=0.745]

Validation DataLoader 0:  30%|███       | 6/20 [00:00<00:00, 36.54it/s]
Epoch 57:  88%|████████▊ | 103/117 [00:05<00:00, 19.54it/s, loss=0.934, v_num=1, val_acc=0.745]

Validation DataLoader 0:  35%|███▌      | 7/20 [00:00<00:00, 35.80it/s]
Epoch 57:  89%|████████▉ | 104/117 [00:05<00:00, 19.62it/s, loss=0.934, v_num=1, val_acc=0.745]

Validation DataLoader 0:  40%|████      | 8/20 [00:00<00:00, 35.24it/s]
Epoch 57:  90%|████████▉ | 105/117 [00:05<00:00, 19.69it/s, loss=0.934, v_num=1, val_acc=0.745]

Validation DataLoader 0:  45%|████▌     | 9/20 [00:00<00:00, 34.78it/s]
Epoch 57:  91%|█████████ | 106/117 [00:05<00:00, 19.76it/s, loss=0.934, v_num=1, val_acc=0.745]

Validation DataLoader 0:  50%|█████     | 10/20 [00:00<00:00, 34.43it/s]
Epoch 57:  91%|█████████▏| 107/117 [00:05<00:00, 19.83it/s, loss=0.934, v_num=1, val_acc=0.745]

Validation DataLoader 0:  55%|█████▌    | 11/20 [00:00<00:00, 34.16it/s]
Epoch 57:  92%|█████████▏| 108/117 [00:05<00:00, 19.90it/s, loss=0.934, v_num=1, val_acc=0.745]

Validation DataLoader 0:  60%|██████    | 12/20 [00:00<00:00, 33.92it/s]
Epoch 57:  93%|█████████▎| 109/117 [00:05<00:00, 19.96it/s, loss=0.934, v_num=1, val_acc=0.745]

Validation DataLoader 0:  65%|██████▌   | 13/20 [00:00<00:00, 33.75it/s]
Epoch 57:  94%|█████████▍| 110/117 [00:05<00:00, 20.03it/s, loss=0.934, v_num=1, val_acc=0.745]

Validation DataLoader 0:  70%|███████   | 14/20 [00:00<00:00, 33.59it/s]
Epoch 57:  95%|█████████▍| 111/117 [00:05<00:00, 20.10it/s, loss=0.934, v_num=1, val_acc=0.745]

Validation DataLoader 0:  75%|███████▌  | 15/20 [00:00<00:00, 33.45it/s]
Epoch 57:  96%|█████████▌| 112/117 [00:05<00:00, 20.16it/s, loss=0.934, v_num=1, val_acc=0.745]

Validation DataLoader 0:  80%|████████  | 16/20 [00:00<00:00, 33.32it/s]
Epoch 57:  97%|█████████▋| 113/117 [00:05<00:00, 20.23it/s, loss=0.934, v_num=1, val_acc=0.745]

Validation DataLoader 0:  85%|████████▌ | 17/20 [00:00<00:00, 33.21it/s]
Epoch 57:  97%|█████████▋| 114/117 [00:05<00:00, 20.29it/s, loss=0.934, v_num=1, val_acc=0.745]

Validation DataLoader 0:  90%|█████████ | 18/20 [00:00<00:00, 33.11it/s]
Epoch 57:  98%|█████████▊| 115/117 [00:05<00:00, 20.35it/s, loss=0.934, v_num=1, val_acc=0.745]

Validation DataLoader 0:  95%|█████████▌| 19/20 [00:00<00:00, 33.03it/s]
Epoch 57:  99%|█████████▉| 116/117 [00:05<00:00, 20.42it/s, loss=0.934, v_num=1, val_acc=0.745]

Validation DataLoader 0: 100%|██████████| 20/20 [00:00<00:00, 33.02it/s]
Epoch 57: 100%|██████████| 117/117 [00:05<00:00, 20.48it/s, loss=0.934, v_num=1, val_acc=0.745]
Epoch 57: 100%|██████████| 117/117 [00:05<00:00, 20.41it/s, loss=0.934, v_num=1, val_acc=0.749]


Epoch 57: 100%|██████████| 117/117 [00:05<00:00, 20.41it/s, loss=0.934, v_num=1, val_acc=0.749]
Epoch 57:   0%|          | 0/117 [00:00<?, ?it/s, loss=0.934, v_num=1, val_acc=0.749]
Epoch 58:   0%|          | 0/117 [00:00<?, ?it/s, loss=0.934, v_num=1, val_acc=0.749]
Epoch 58:   1%|          | 1/117 [00:00<01:49,  1.06it/s, loss=0.934, v_num=1, val_acc=0.749]
Epoch 58:   1%|          | 1/117 [00:00<01:52,  1.03it/s, loss=0.939, v_num=1, val_acc=0.749]
Epoch 58:   2%|▏         | 2/117 [00:00<00:56,  2.04it/s, loss=0.939, v_num=1, val_acc=0.749]
Epoch 58:   2%|▏         | 2/117 [00:01<00:57,  1.99it/s, loss=0.943, v_num=1, val_acc=0.749]
Epoch 58:   3%|▎         | 3/117 [00:01<00:38,  2.96it/s, loss=0.943, v_num=1, val_acc=0.749]
Epoch 58:   3%|▎         | 3/117 [00:01<00:39,  2.89it/s, loss=0.938, v_num=1, val_acc=0.749]
Epoch 58:   3%|▎         | 4/117 [00:01<00:29,  3.82it/s, loss=0.938, v_num=1, val_acc=0.749]
Epoch 58:   3%|▎         | 4/117 [00:01<00:30,  3.73it/s, loss=0.921, v_num=1, val_acc=0.749]
Epoch 58:   4%|▍         | 5/117 [00:01<00:24,  4.63it/s, loss=0.921, v_num=1, val_acc=0.749]
Epoch 58:   4%|▍         | 5/117 [00:01<00:24,  4.52it/s, loss=0.891, v_num=1, val_acc=0.749]
Epoch 58:   5%|▌         | 6/117 [00:01<00:20,  5.38it/s, loss=0.891, v_num=1, val_acc=0.749]
Epoch 58:   5%|▌         | 6/117 [00:01<00:21,  5.26it/s, loss=0.882, v_num=1, val_acc=0.749]
Epoch 58:   6%|▌         | 7/117 [00:01<00:18,  6.09it/s, loss=0.882, v_num=1, val_acc=0.749]
Epoch 58:   6%|▌         | 7/117 [00:01<00:18,  5.96it/s, loss=0.872, v_num=1, val_acc=0.749]
Epoch 58:   7%|▋         | 8/117 [00:01<00:16,  6.76it/s, loss=0.872, v_num=1, val_acc=0.749]
Epoch 58:   7%|▋         | 8/117 [00:01<00:16,  6.62it/s, loss=0.867, v_num=1, val_acc=0.749]
Epoch 58:   8%|▊         | 9/117 [00:01<00:14,  7.33it/s, loss=0.867, v_num=1, val_acc=0.749]
Epoch 58:   8%|▊         | 9/117 [00:01<00:15,  7.20it/s, loss=0.857, v_num=1, val_acc=0.749]
Epoch 58:   9%|▊         | 10/117 [00:01<00:13,  7.93it/s, loss=0.857, v_num=1, val_acc=0.749]
Epoch 58:   9%|▊         | 10/117 [00:01<00:13,  7.78it/s, loss=0.852, v_num=1, val_acc=0.749]
Epoch 58:   9%|▉         | 11/117 [00:01<00:12,  8.50it/s, loss=0.852, v_num=1, val_acc=0.749]
Epoch 58:   9%|▉         | 11/117 [00:01<00:12,  8.34it/s, loss=0.853, v_num=1, val_acc=0.749]
Epoch 58:  10%|█         | 12/117 [00:01<00:11,  9.04it/s, loss=0.853, v_num=1, val_acc=0.749]
Epoch 58:  10%|█         | 12/117 [00:01<00:11,  8.87it/s, loss=0.852, v_num=1, val_acc=0.749]
Epoch 58:  11%|█         | 13/117 [00:01<00:10,  9.51it/s, loss=0.852, v_num=1, val_acc=0.749]
Epoch 58:  11%|█         | 13/117 [00:01<00:11,  9.36it/s, loss=0.848, v_num=1, val_acc=0.749]
Epoch 58:  12%|█▏        | 14/117 [00:01<00:10, 10.00it/s, loss=0.848, v_num=1, val_acc=0.749]
Epoch 58:  12%|█▏        | 14/117 [00:01<00:10,  9.83it/s, loss=0.844, v_num=1, val_acc=0.749]
Epoch 58:  13%|█▎        | 15/117 [00:01<00:09, 10.46it/s, loss=0.844, v_num=1, val_acc=0.749]
Epoch 58:  13%|█▎        | 15/117 [00:01<00:09, 10.28it/s, loss=0.86, v_num=1, val_acc=0.749]
Epoch 58:  14%|█▎        | 16/117 [00:01<00:09, 10.90it/s, loss=0.86, v_num=1, val_acc=0.749]
Epoch 58:  14%|█▎        | 16/117 [00:01<00:09, 10.72it/s, loss=0.864, v_num=1, val_acc=0.749]
Epoch 58:  15%|█▍        | 17/117 [00:01<00:08, 11.29it/s, loss=0.864, v_num=1, val_acc=0.749]
Epoch 58:  15%|█▍        | 17/117 [00:01<00:09, 11.11it/s, loss=0.86, v_num=1, val_acc=0.749]
Epoch 58:  15%|█▌        | 18/117 [00:01<00:08, 11.69it/s, loss=0.86, v_num=1, val_acc=0.749]
Epoch 58:  15%|█▌        | 18/117 [00:01<00:08, 11.51it/s, loss=0.856, v_num=1, val_acc=0.749]
Epoch 58:  16%|█▌        | 19/117 [00:01<00:08, 12.08it/s, loss=0.856, v_num=1, val_acc=0.749]
Epoch 58:  16%|█▌        | 19/117 [00:01<00:08, 11.89it/s, loss=0.826, v_num=1, val_acc=0.749]
Epoch 58:  17%|█▋        | 20/117 [00:01<00:07, 12.44it/s, loss=0.826, v_num=1, val_acc=0.749]
Epoch 58:  17%|█▋        | 20/117 [00:01<00:07, 12.25it/s, loss=0.826, v_num=1, val_acc=0.749]
Epoch 58:  18%|█▊        | 21/117 [00:01<00:07, 12.79it/s, loss=0.826, v_num=1, val_acc=0.749]
Epoch 58:  18%|█▊        | 21/117 [00:01<00:07, 12.60it/s, loss=0.829, v_num=1, val_acc=0.749]
Epoch 58:  19%|█▉        | 22/117 [00:01<00:07, 13.12it/s, loss=0.829, v_num=1, val_acc=0.749]
Epoch 58:  19%|█▉        | 22/117 [00:01<00:07, 12.93it/s, loss=0.835, v_num=1, val_acc=0.749]
Epoch 58:  20%|█▉        | 23/117 [00:01<00:06, 13.44it/s, loss=0.835, v_num=1, val_acc=0.749]
Epoch 58:  20%|█▉        | 23/117 [00:01<00:07, 13.25it/s, loss=0.841, v_num=1, val_acc=0.749]
Epoch 58:  21%|██        | 24/117 [00:01<00:06, 13.75it/s, loss=0.841, v_num=1, val_acc=0.749]
Epoch 58:  21%|██        | 24/117 [00:01<00:06, 13.55it/s, loss=0.848, v_num=1, val_acc=0.749]
Epoch 58:  21%|██▏       | 25/117 [00:01<00:06, 14.02it/s, loss=0.848, v_num=1, val_acc=0.749]
Epoch 58:  21%|██▏       | 25/117 [00:01<00:06, 13.83it/s, loss=0.864, v_num=1, val_acc=0.749]
Epoch 58:  22%|██▏       | 26/117 [00:01<00:06, 14.31it/s, loss=0.864, v_num=1, val_acc=0.749]
Epoch 58:  22%|██▏       | 26/117 [00:01<00:06, 14.11it/s, loss=0.867, v_num=1, val_acc=0.749]
Epoch 58:  23%|██▎       | 27/117 [00:01<00:06, 14.59it/s, loss=0.867, v_num=1, val_acc=0.749]
Epoch 58:  23%|██▎       | 27/117 [00:01<00:06, 14.39it/s, loss=0.877, v_num=1, val_acc=0.749]
Epoch 58:  24%|██▍       | 28/117 [00:01<00:05, 14.85it/s, loss=0.877, v_num=1, val_acc=0.749]
Epoch 58:  24%|██▍       | 28/117 [00:01<00:06, 14.66it/s, loss=0.882, v_num=1, val_acc=0.749]
Epoch 58:  25%|██▍       | 29/117 [00:01<00:05, 15.10it/s, loss=0.882, v_num=1, val_acc=0.749]
Epoch 58:  25%|██▍       | 29/117 [00:01<00:05, 14.91it/s, loss=0.894, v_num=1, val_acc=0.749]
Epoch 58:  26%|██▌       | 30/117 [00:01<00:05, 15.34it/s, loss=0.894, v_num=1, val_acc=0.749]
Epoch 58:  26%|██▌       | 30/117 [00:01<00:05, 15.14it/s, loss=0.901, v_num=1, val_acc=0.749]
Epoch 58:  26%|██▋       | 31/117 [00:01<00:05, 15.57it/s, loss=0.901, v_num=1, val_acc=0.749]
Epoch 58:  26%|██▋       | 31/117 [00:02<00:05, 15.38it/s, loss=0.91, v_num=1, val_acc=0.749]
Epoch 58:  27%|██▋       | 32/117 [00:02<00:05, 15.80it/s, loss=0.91, v_num=1, val_acc=0.749]
Epoch 58:  27%|██▋       | 32/117 [00:02<00:05, 15.61it/s, loss=0.908, v_num=1, val_acc=0.749]
Epoch 58:  28%|██▊       | 33/117 [00:02<00:05, 16.01it/s, loss=0.908, v_num=1, val_acc=0.749]
Epoch 58:  28%|██▊       | 33/117 [00:02<00:05, 15.82it/s, loss=0.902, v_num=1, val_acc=0.749]
Epoch 58:  29%|██▉       | 34/117 [00:02<00:05, 16.23it/s, loss=0.902, v_num=1, val_acc=0.749]
Epoch 58:  29%|██▉       | 34/117 [00:02<00:05, 16.04it/s, loss=0.905, v_num=1, val_acc=0.749]
Epoch 58:  30%|██▉       | 35/117 [00:02<00:04, 16.45it/s, loss=0.905, v_num=1, val_acc=0.749]
Epoch 58:  30%|██▉       | 35/117 [00:02<00:05, 16.25it/s, loss=0.899, v_num=1, val_acc=0.749]
Epoch 58:  31%|███       | 36/117 [00:02<00:04, 16.64it/s, loss=0.899, v_num=1, val_acc=0.749]
Epoch 58:  31%|███       | 36/117 [00:02<00:04, 16.45it/s, loss=0.913, v_num=1, val_acc=0.749]
Epoch 58:  32%|███▏      | 37/117 [00:02<00:04, 16.84it/s, loss=0.913, v_num=1, val_acc=0.749]
Epoch 58:  32%|███▏      | 37/117 [00:02<00:04, 16.64it/s, loss=0.942, v_num=1, val_acc=0.749]
Epoch 58:  32%|███▏      | 38/117 [00:02<00:04, 17.02it/s, loss=0.942, v_num=1, val_acc=0.749]
Epoch 58:  32%|███▏      | 38/117 [00:02<00:04, 16.83it/s, loss=0.961, v_num=1, val_acc=0.749]
Epoch 58:  33%|███▎      | 39/117 [00:02<00:04, 17.21it/s, loss=0.961, v_num=1, val_acc=0.749]
Epoch 58:  33%|███▎      | 39/117 [00:02<00:04, 17.02it/s, loss=0.984, v_num=1, val_acc=0.749]
Epoch 58:  34%|███▍      | 40/117 [00:02<00:04, 17.38it/s, loss=0.984, v_num=1, val_acc=0.749]
Epoch 58:  34%|███▍      | 40/117 [00:02<00:04, 17.19it/s, loss=0.985, v_num=1, val_acc=0.749]
Epoch 58:  35%|███▌      | 41/117 [00:02<00:04, 17.55it/s, loss=0.985, v_num=1, val_acc=0.749]
Epoch 58:  35%|███▌      | 41/117 [00:02<00:04, 17.37it/s, loss=0.993, v_num=1, val_acc=0.749]
Epoch 58:  36%|███▌      | 42/117 [00:02<00:04, 17.72it/s, loss=0.993, v_num=1, val_acc=0.749]
Epoch 58:  36%|███▌      | 42/117 [00:02<00:04, 17.53it/s, loss=0.983, v_num=1, val_acc=0.749]
Epoch 58:  37%|███▋      | 43/117 [00:02<00:04, 17.88it/s, loss=0.983, v_num=1, val_acc=0.749]
Epoch 58:  37%|███▋      | 43/117 [00:02<00:04, 17.70it/s, loss=0.977, v_num=1, val_acc=0.749]
Epoch 58:  38%|███▊      | 44/117 [00:02<00:04, 18.04it/s, loss=0.977, v_num=1, val_acc=0.749]
Epoch 58:  38%|███▊      | 44/117 [00:02<00:04, 17.86it/s, loss=0.975, v_num=1, val_acc=0.749]
Epoch 58:  38%|███▊      | 45/117 [00:02<00:03, 18.19it/s, loss=0.975, v_num=1, val_acc=0.749]
Epoch 58:  38%|███▊      | 45/117 [00:02<00:03, 18.01it/s, loss=0.98, v_num=1, val_acc=0.749]
Epoch 58:  39%|███▉      | 46/117 [00:02<00:03, 18.34it/s, loss=0.98, v_num=1, val_acc=0.749]
Epoch 58:  39%|███▉      | 46/117 [00:02<00:03, 18.16it/s, loss=0.978, v_num=1, val_acc=0.749]
Epoch 58:  40%|████      | 47/117 [00:02<00:03, 18.48it/s, loss=0.978, v_num=1, val_acc=0.749]
Epoch 58:  40%|████      | 47/117 [00:02<00:03, 18.30it/s, loss=0.992, v_num=1, val_acc=0.749]
Epoch 58:  41%|████      | 48/117 [00:02<00:03, 18.62it/s, loss=0.992, v_num=1, val_acc=0.749]
Epoch 58:  41%|████      | 48/117 [00:02<00:03, 18.44it/s, loss=1, v_num=1, val_acc=0.749]
Epoch 58:  42%|████▏     | 49/117 [00:02<00:03, 18.76it/s, loss=1, v_num=1, val_acc=0.749]
Epoch 58:  42%|████▏     | 49/117 [00:02<00:03, 18.58it/s, loss=1.01, v_num=1, val_acc=0.749]
Epoch 58:  43%|████▎     | 50/117 [00:02<00:03, 18.89it/s, loss=1.01, v_num=1, val_acc=0.749]
Epoch 58:  43%|████▎     | 50/117 [00:02<00:03, 18.71it/s, loss=1, v_num=1, val_acc=0.749]
Epoch 58:  44%|████▎     | 51/117 [00:02<00:03, 19.02it/s, loss=1, v_num=1, val_acc=0.749]
Epoch 58:  44%|████▎     | 51/117 [00:02<00:03, 18.84it/s, loss=1, v_num=1, val_acc=0.749]
Epoch 58:  44%|████▍     | 52/117 [00:02<00:03, 19.15it/s, loss=1, v_num=1, val_acc=0.749]
Epoch 58:  44%|████▍     | 52/117 [00:02<00:03, 18.97it/s, loss=0.998, v_num=1, val_acc=0.749]
Epoch 58:  45%|████▌     | 53/117 [00:02<00:03, 19.27it/s, loss=0.998, v_num=1, val_acc=0.749]
Epoch 58:  45%|████▌     | 53/117 [00:02<00:03, 19.10it/s, loss=0.997, v_num=1, val_acc=0.749]
Epoch 58:  46%|████▌     | 54/117 [00:02<00:03, 19.39it/s, loss=0.997, v_num=1, val_acc=0.749]
Epoch 58:  46%|████▌     | 54/117 [00:02<00:03, 19.22it/s, loss=0.989, v_num=1, val_acc=0.749]
Epoch 58:  47%|████▋     | 55/117 [00:02<00:03, 19.51it/s, loss=0.989, v_num=1, val_acc=0.749]
Epoch 58:  47%|████▋     | 55/117 [00:02<00:03, 19.33it/s, loss=0.978, v_num=1, val_acc=0.749]
Epoch 58:  48%|████▊     | 56/117 [00:02<00:03, 19.62it/s, loss=0.978, v_num=1, val_acc=0.749]
Epoch 58:  48%|████▊     | 56/117 [00:02<00:03, 19.45it/s, loss=0.961, v_num=1, val_acc=0.749]
Epoch 58:  49%|████▊     | 57/117 [00:02<00:03, 19.73it/s, loss=0.961, v_num=1, val_acc=0.749]
Epoch 58:  49%|████▊     | 57/117 [00:02<00:03, 19.56it/s, loss=0.935, v_num=1, val_acc=0.749]
Epoch 58:  50%|████▉     | 58/117 [00:02<00:02, 19.84it/s, loss=0.935, v_num=1, val_acc=0.749]
Epoch 58:  50%|████▉     | 58/117 [00:02<00:02, 19.67it/s, loss=0.919, v_num=1, val_acc=0.749]
Epoch 58:  50%|█████     | 59/117 [00:02<00:02, 19.95it/s, loss=0.919, v_num=1, val_acc=0.749]
Epoch 58:  50%|█████     | 59/117 [00:02<00:02, 19.78it/s, loss=0.909, v_num=1, val_acc=0.749]
Epoch 58:  51%|█████▏    | 60/117 [00:02<00:02, 20.06it/s, loss=0.909, v_num=1, val_acc=0.749]
Epoch 58:  51%|█████▏    | 60/117 [00:03<00:02, 19.89it/s, loss=0.908, v_num=1, val_acc=0.749]
Epoch 58:  52%|█████▏    | 61/117 [00:03<00:02, 20.16it/s, loss=0.908, v_num=1, val_acc=0.749]
Epoch 58:  52%|█████▏    | 61/117 [00:03<00:02, 19.99it/s, loss=0.898, v_num=1, val_acc=0.749]
Epoch 58:  53%|█████▎    | 62/117 [00:03<00:02, 20.26it/s, loss=0.898, v_num=1, val_acc=0.749]
Epoch 58:  53%|█████▎    | 62/117 [00:03<00:02, 20.09it/s, loss=0.899, v_num=1, val_acc=0.749]
Epoch 58:  54%|█████▍    | 63/117 [00:03<00:02, 20.35it/s, loss=0.899, v_num=1, val_acc=0.749]
Epoch 58:  54%|█████▍    | 63/117 [00:03<00:02, 20.18it/s, loss=0.891, v_num=1, val_acc=0.749]
Epoch 58:  55%|█████▍    | 64/117 [00:03<00:02, 20.44it/s, loss=0.891, v_num=1, val_acc=0.749]
Epoch 58:  55%|█████▍    | 64/117 [00:03<00:02, 20.28it/s, loss=0.884, v_num=1, val_acc=0.749]
Epoch 58:  56%|█████▌    | 65/117 [00:03<00:02, 20.53it/s, loss=0.884, v_num=1, val_acc=0.749]
Epoch 58:  56%|█████▌    | 65/117 [00:03<00:02, 20.37it/s, loss=0.862, v_num=1, val_acc=0.749]
Epoch 58:  56%|█████▋    | 66/117 [00:03<00:02, 20.62it/s, loss=0.862, v_num=1, val_acc=0.749]
Epoch 58:  56%|█████▋    | 66/117 [00:03<00:02, 20.46it/s, loss=0.858, v_num=1, val_acc=0.749]
Epoch 58:  57%|█████▋    | 67/117 [00:03<00:02, 20.71it/s, loss=0.858, v_num=1, val_acc=0.749]
Epoch 58:  57%|█████▋    | 67/117 [00:03<00:02, 20.55it/s, loss=0.842, v_num=1, val_acc=0.749]
Epoch 58:  58%|█████▊    | 68/117 [00:03<00:02, 20.78it/s, loss=0.842, v_num=1, val_acc=0.749]
Epoch 58:  58%|█████▊    | 68/117 [00:03<00:02, 20.62it/s, loss=0.834, v_num=1, val_acc=0.749]
Epoch 58:  59%|█████▉    | 69/117 [00:03<00:02, 20.87it/s, loss=0.834, v_num=1, val_acc=0.749]
Epoch 58:  59%|█████▉    | 69/117 [00:03<00:02, 20.71it/s, loss=0.826, v_num=1, val_acc=0.749]
Epoch 58:  60%|█████▉    | 70/117 [00:03<00:02, 20.95it/s, loss=0.826, v_num=1, val_acc=0.749]
Epoch 58:  60%|█████▉    | 70/117 [00:03<00:02, 20.80it/s, loss=0.836, v_num=1, val_acc=0.749]
Epoch 58:  61%|██████    | 71/117 [00:03<00:02, 21.04it/s, loss=0.836, v_num=1, val_acc=0.749]
Epoch 58:  61%|██████    | 71/117 [00:03<00:02, 20.88it/s, loss=0.834, v_num=1, val_acc=0.749]
Epoch 58:  62%|██████▏   | 72/117 [00:03<00:02, 21.11it/s, loss=0.834, v_num=1, val_acc=0.749]
Epoch 58:  62%|██████▏   | 72/117 [00:03<00:02, 20.96it/s, loss=0.852, v_num=1, val_acc=0.749]
Epoch 58:  62%|██████▏   | 73/117 [00:03<00:02, 21.19it/s, loss=0.852, v_num=1, val_acc=0.749]
Epoch 58:  62%|██████▏   | 73/117 [00:03<00:02, 21.04it/s, loss=0.841, v_num=1, val_acc=0.749]
Epoch 58:  63%|██████▎   | 74/117 [00:03<00:02, 21.27it/s, loss=0.841, v_num=1, val_acc=0.749]
Epoch 58:  63%|██████▎   | 74/117 [00:03<00:02, 21.12it/s, loss=0.834, v_num=1, val_acc=0.749]
Epoch 58:  64%|██████▍   | 75/117 [00:03<00:01, 21.35it/s, loss=0.834, v_num=1, val_acc=0.749]
Epoch 58:  64%|██████▍   | 75/117 [00:03<00:01, 21.19it/s, loss=0.831, v_num=1, val_acc=0.749]
Epoch 58:  65%|██████▍   | 76/117 [00:03<00:01, 21.42it/s, loss=0.831, v_num=1, val_acc=0.749]
Epoch 58:  65%|██████▍   | 76/117 [00:03<00:01, 21.27it/s, loss=0.827, v_num=1, val_acc=0.749]
Epoch 58:  66%|██████▌   | 77/117 [00:03<00:01, 21.49it/s, loss=0.827, v_num=1, val_acc=0.749]
Epoch 58:  66%|██████▌   | 77/117 [00:03<00:01, 21.34it/s, loss=0.824, v_num=1, val_acc=0.749]
Epoch 58:  67%|██████▋   | 78/117 [00:03<00:01, 21.56it/s, loss=0.824, v_num=1, val_acc=0.749]
Epoch 58:  67%|██████▋   | 78/117 [00:03<00:01, 21.41it/s, loss=0.817, v_num=1, val_acc=0.749]
Epoch 58:  68%|██████▊   | 79/117 [00:03<00:01, 21.63it/s, loss=0.817, v_num=1, val_acc=0.749]
Epoch 58:  68%|██████▊   | 79/117 [00:03<00:01, 21.48it/s, loss=0.809, v_num=1, val_acc=0.749]
Epoch 58:  68%|██████▊   | 80/117 [00:03<00:01, 21.70it/s, loss=0.809, v_num=1, val_acc=0.749]
Epoch 58:  68%|██████▊   | 80/117 [00:03<00:01, 21.55it/s, loss=0.814, v_num=1, val_acc=0.749]
Epoch 58:  69%|██████▉   | 81/117 [00:03<00:01, 21.77it/s, loss=0.814, v_num=1, val_acc=0.749]
Epoch 58:  69%|██████▉   | 81/117 [00:03<00:01, 21.62it/s, loss=0.831, v_num=1, val_acc=0.749]
Epoch 58:  70%|███████   | 82/117 [00:03<00:01, 21.82it/s, loss=0.831, v_num=1, val_acc=0.749]
Epoch 58:  70%|███████   | 82/117 [00:03<00:01, 21.67it/s, loss=0.849, v_num=1, val_acc=0.749]
Epoch 58:  71%|███████   | 83/117 [00:03<00:01, 21.88it/s, loss=0.849, v_num=1, val_acc=0.749]
Epoch 58:  71%|███████   | 83/117 [00:03<00:01, 21.74it/s, loss=0.856, v_num=1, val_acc=0.749]
Epoch 58:  72%|███████▏  | 84/117 [00:03<00:01, 21.95it/s, loss=0.856, v_num=1, val_acc=0.749]
Epoch 58:  72%|███████▏  | 84/117 [00:03<00:01, 21.80it/s, loss=0.856, v_num=1, val_acc=0.749]
Epoch 58:  73%|███████▎  | 85/117 [00:03<00:01, 22.01it/s, loss=0.856, v_num=1, val_acc=0.749]
Epoch 58:  73%|███████▎  | 85/117 [00:03<00:01, 21.87it/s, loss=0.866, v_num=1, val_acc=0.749]
Epoch 58:  74%|███████▎  | 86/117 [00:03<00:01, 22.08it/s, loss=0.866, v_num=1, val_acc=0.749]
Epoch 58:  74%|███████▎  | 86/117 [00:03<00:01, 21.93it/s, loss=0.871, v_num=1, val_acc=0.749]
Epoch 58:  74%|███████▍  | 87/117 [00:03<00:01, 22.14it/s, loss=0.871, v_num=1, val_acc=0.749]
Epoch 58:  74%|███████▍  | 87/117 [00:03<00:01, 22.00it/s, loss=0.889, v_num=1, val_acc=0.749]
Epoch 58:  75%|███████▌  | 88/117 [00:03<00:01, 22.20it/s, loss=0.889, v_num=1, val_acc=0.749]
Epoch 58:  75%|███████▌  | 88/117 [00:03<00:01, 22.06it/s, loss=0.915, v_num=1, val_acc=0.749]
Epoch 58:  76%|███████▌  | 89/117 [00:03<00:01, 22.26it/s, loss=0.915, v_num=1, val_acc=0.749]
Epoch 58:  76%|███████▌  | 89/117 [00:04<00:01, 22.12it/s, loss=0.913, v_num=1, val_acc=0.749]
Epoch 58:  77%|███████▋  | 90/117 [00:04<00:01, 22.32it/s, loss=0.913, v_num=1, val_acc=0.749]
Epoch 58:  77%|███████▋  | 90/117 [00:04<00:01, 22.18it/s, loss=0.904, v_num=1, val_acc=0.749]
Epoch 58:  78%|███████▊  | 91/117 [00:04<00:01, 22.38it/s, loss=0.904, v_num=1, val_acc=0.749]
Epoch 58:  78%|███████▊  | 91/117 [00:04<00:01, 22.24it/s, loss=0.899, v_num=1, val_acc=0.749]
Epoch 58:  79%|███████▊  | 92/117 [00:04<00:01, 22.43it/s, loss=0.899, v_num=1, val_acc=0.749]
Epoch 58:  79%|███████▊  | 92/117 [00:04<00:01, 22.30it/s, loss=0.891, v_num=1, val_acc=0.749]
Epoch 58:  79%|███████▉  | 93/117 [00:04<00:01, 22.49it/s, loss=0.891, v_num=1, val_acc=0.749]
Epoch 58:  79%|███████▉  | 93/117 [00:04<00:01, 22.35it/s, loss=0.897, v_num=1, val_acc=0.749]
Epoch 58:  80%|████████  | 94/117 [00:04<00:01, 22.54it/s, loss=0.897, v_num=1, val_acc=0.749]
Epoch 58:  80%|████████  | 94/117 [00:04<00:01, 22.41it/s, loss=0.91, v_num=1, val_acc=0.749]
Epoch 58:  81%|████████  | 95/117 [00:04<00:00, 22.60it/s, loss=0.91, v_num=1, val_acc=0.749]
Epoch 58:  81%|████████  | 95/117 [00:04<00:00, 22.46it/s, loss=0.913, v_num=1, val_acc=0.749]
Epoch 58:  82%|████████▏ | 96/117 [00:04<00:00, 22.65it/s, loss=0.913, v_num=1, val_acc=0.749]
Epoch 58:  82%|████████▏ | 96/117 [00:04<00:00, 22.51it/s, loss=0.917, v_num=1, val_acc=0.749]
Epoch 58:  83%|████████▎ | 97/117 [00:04<00:00, 22.70it/s, loss=0.917, v_num=1, val_acc=0.749]
Epoch 58:  83%|████████▎ | 97/117 [00:04<00:00, 22.57it/s, loss=0.916, v_num=1, val_acc=0.749]

Validation: 0it [00:00, ?it/s]

Validation:   0%|          | 0/20 [00:00<?, ?it/s]

Validation DataLoader 0:   0%|          | 0/20 [00:00<?, ?it/s]

Validation DataLoader 0:   5%|▌         | 1/20 [00:00<00:00, 176.19it/s]
Epoch 58:  84%|████████▍ | 98/117 [00:05<00:00, 19.03it/s, loss=0.916, v_num=1, val_acc=0.749]

Validation DataLoader 0:  10%|█         | 2/20 [00:00<00:00, 55.39it/s]
Epoch 58:  85%|████████▍ | 99/117 [00:05<00:00, 19.11it/s, loss=0.916, v_num=1, val_acc=0.749]

Validation DataLoader 0:  15%|█▌        | 3/20 [00:00<00:00, 44.66it/s]
Epoch 58:  85%|████████▌ | 100/117 [00:05<00:00, 19.18it/s, loss=0.916, v_num=1, val_acc=0.749]

Validation DataLoader 0:  20%|██        | 4/20 [00:00<00:00, 40.45it/s]
Epoch 58:  86%|████████▋ | 101/117 [00:05<00:00, 19.26it/s, loss=0.916, v_num=1, val_acc=0.749]

Validation DataLoader 0:  25%|██▌       | 5/20 [00:00<00:00, 38.24it/s]
Epoch 58:  87%|████████▋ | 102/117 [00:05<00:00, 19.33it/s, loss=0.916, v_num=1, val_acc=0.749]

Validation DataLoader 0:  30%|███       | 6/20 [00:00<00:00, 36.95it/s]
Epoch 58:  88%|████████▊ | 103/117 [00:05<00:00, 19.41it/s, loss=0.916, v_num=1, val_acc=0.749]

Validation DataLoader 0:  35%|███▌      | 7/20 [00:00<00:00, 36.07it/s]
Epoch 58:  89%|████████▉ | 104/117 [00:05<00:00, 19.48it/s, loss=0.916, v_num=1, val_acc=0.749]

Validation DataLoader 0:  40%|████      | 8/20 [00:00<00:00, 35.44it/s]
Epoch 58:  90%|████████▉ | 105/117 [00:05<00:00, 19.55it/s, loss=0.916, v_num=1, val_acc=0.749]

Validation DataLoader 0:  45%|████▌     | 9/20 [00:00<00:00, 34.97it/s]
Epoch 58:  91%|█████████ | 106/117 [00:05<00:00, 19.62it/s, loss=0.916, v_num=1, val_acc=0.749]

Validation DataLoader 0:  50%|█████     | 10/20 [00:00<00:00, 34.59it/s]
Epoch 58:  91%|█████████▏| 107/117 [00:05<00:00, 19.69it/s, loss=0.916, v_num=1, val_acc=0.749]

Validation DataLoader 0:  55%|█████▌    | 11/20 [00:00<00:00, 34.31it/s]
Epoch 58:  92%|█████████▏| 108/117 [00:05<00:00, 19.76it/s, loss=0.916, v_num=1, val_acc=0.749]

Validation DataLoader 0:  60%|██████    | 12/20 [00:00<00:00, 34.08it/s]
Epoch 58:  93%|█████████▎| 109/117 [00:05<00:00, 19.83it/s, loss=0.916, v_num=1, val_acc=0.749]

Validation DataLoader 0:  65%|██████▌   | 13/20 [00:00<00:00, 33.87it/s]
Epoch 58:  94%|█████████▍| 110/117 [00:05<00:00, 19.89it/s, loss=0.916, v_num=1, val_acc=0.749]

Validation DataLoader 0:  70%|███████   | 14/20 [00:00<00:00, 33.70it/s]
Epoch 58:  95%|█████████▍| 111/117 [00:05<00:00, 19.96it/s, loss=0.916, v_num=1, val_acc=0.749]

Validation DataLoader 0:  75%|███████▌  | 15/20 [00:00<00:00, 33.55it/s]
Epoch 58:  96%|█████████▌| 112/117 [00:05<00:00, 20.03it/s, loss=0.916, v_num=1, val_acc=0.749]

Validation DataLoader 0:  80%|████████  | 16/20 [00:00<00:00, 33.41it/s]
Epoch 58:  97%|█████████▋| 113/117 [00:05<00:00, 20.09it/s, loss=0.916, v_num=1, val_acc=0.749]

Validation DataLoader 0:  85%|████████▌ | 17/20 [00:00<00:00, 33.25it/s]
Epoch 58:  97%|█████████▋| 114/117 [00:05<00:00, 20.15it/s, loss=0.916, v_num=1, val_acc=0.749]

Validation DataLoader 0:  90%|█████████ | 18/20 [00:00<00:00, 33.16it/s]
Epoch 58:  98%|█████████▊| 115/117 [00:05<00:00, 20.22it/s, loss=0.916, v_num=1, val_acc=0.749]

Validation DataLoader 0:  95%|█████████▌| 19/20 [00:00<00:00, 33.07it/s]
Epoch 58:  99%|█████████▉| 116/117 [00:05<00:00, 20.28it/s, loss=0.916, v_num=1, val_acc=0.749]

Validation DataLoader 0: 100%|██████████| 20/20 [00:00<00:00, 33.07it/s]
Epoch 58: 100%|██████████| 117/117 [00:05<00:00, 20.35it/s, loss=0.916, v_num=1, val_acc=0.749]
Epoch 58: 100%|██████████| 117/117 [00:05<00:00, 20.28it/s, loss=0.916, v_num=1, val_acc=0.740]


Epoch 58: 100%|██████████| 117/117 [00:05<00:00, 20.27it/s, loss=0.916, v_num=1, val_acc=0.740]
Epoch 58:   0%|          | 0/117 [00:00<?, ?it/s, loss=0.916, v_num=1, val_acc=0.740]
Epoch 59:   0%|          | 0/117 [00:00<?, ?it/s, loss=0.916, v_num=1, val_acc=0.740]
Epoch 59:   1%|          | 1/117 [00:00<01:45,  1.10it/s, loss=0.916, v_num=1, val_acc=0.740]
Epoch 59:   1%|          | 1/117 [00:00<01:48,  1.07it/s, loss=0.912, v_num=1, val_acc=0.740]
Epoch 59:   2%|▏         | 2/117 [00:00<00:54,  2.11it/s, loss=0.912, v_num=1, val_acc=0.740]
Epoch 59:   2%|▏         | 2/117 [00:00<00:55,  2.06it/s, loss=0.914, v_num=1, val_acc=0.740]
Epoch 59:   3%|▎         | 3/117 [00:00<00:37,  3.06it/s, loss=0.914, v_num=1, val_acc=0.740]
Epoch 59:   3%|▎         | 3/117 [00:01<00:38,  2.98it/s, loss=0.907, v_num=1, val_acc=0.740]
Epoch 59:   3%|▎         | 4/117 [00:01<00:28,  3.94it/s, loss=0.907, v_num=1, val_acc=0.740]
Epoch 59:   3%|▎         | 4/117 [00:01<00:29,  3.84it/s, loss=0.896, v_num=1, val_acc=0.740]
Epoch 59:   4%|▍         | 5/117 [00:01<00:23,  4.75it/s, loss=0.896, v_num=1, val_acc=0.740]
Epoch 59:   4%|▍         | 5/117 [00:01<00:24,  4.64it/s, loss=0.885, v_num=1, val_acc=0.740]
Epoch 59:   5%|▌         | 6/117 [00:01<00:20,  5.52it/s, loss=0.885, v_num=1, val_acc=0.740]
Epoch 59:   5%|▌         | 6/117 [00:01<00:20,  5.40it/s, loss=0.887, v_num=1, val_acc=0.740]
Epoch 59:   6%|▌         | 7/117 [00:01<00:17,  6.24it/s, loss=0.887, v_num=1, val_acc=0.740]
Epoch 59:   6%|▌         | 7/117 [00:01<00:18,  6.10it/s, loss=0.9, v_num=1, val_acc=0.740]
Epoch 59:   7%|▋         | 8/117 [00:01<00:15,  6.92it/s, loss=0.9, v_num=1, val_acc=0.740]
Epoch 59:   7%|▋         | 8/117 [00:01<00:16,  6.78it/s, loss=0.906, v_num=1, val_acc=0.740]
Epoch 59:   8%|▊         | 9/117 [00:01<00:14,  7.56it/s, loss=0.906, v_num=1, val_acc=0.740]
Epoch 59:   8%|▊         | 9/117 [00:01<00:14,  7.40it/s, loss=0.907, v_num=1, val_acc=0.740]
Epoch 59:   9%|▊         | 10/117 [00:01<00:13,  8.15it/s, loss=0.907, v_num=1, val_acc=0.740]
Epoch 59:   9%|▊         | 10/117 [00:01<00:13,  7.98it/s, loss=0.893, v_num=1, val_acc=0.740]
Epoch 59:   9%|▉         | 11/117 [00:01<00:12,  8.72it/s, loss=0.893, v_num=1, val_acc=0.740]
Epoch 59:   9%|▉         | 11/117 [00:01<00:12,  8.55it/s, loss=0.871, v_num=1, val_acc=0.740]
Epoch 59:  10%|█         | 12/117 [00:01<00:11,  9.26it/s, loss=0.871, v_num=1, val_acc=0.740]
Epoch 59:  10%|█         | 12/117 [00:01<00:11,  9.08it/s, loss=0.871, v_num=1, val_acc=0.740]
Epoch 59:  11%|█         | 13/117 [00:01<00:10,  9.78it/s, loss=0.871, v_num=1, val_acc=0.740]
Epoch 59:  11%|█         | 13/117 [00:01<00:10,  9.59it/s, loss=0.868, v_num=1, val_acc=0.740]
Epoch 59:  12%|█▏        | 14/117 [00:01<00:10, 10.27it/s, loss=0.868, v_num=1, val_acc=0.740]
Epoch 59:  12%|█▏        | 14/117 [00:01<00:10, 10.08it/s, loss=0.866, v_num=1, val_acc=0.740]
Epoch 59:  13%|█▎        | 15/117 [00:01<00:09, 10.73it/s, loss=0.866, v_num=1, val_acc=0.740]
Epoch 59:  13%|█▎        | 15/117 [00:01<00:09, 10.54it/s, loss=0.867, v_num=1, val_acc=0.740]
Epoch 59:  14%|█▎        | 16/117 [00:01<00:09, 11.18it/s, loss=0.867, v_num=1, val_acc=0.740]
Epoch 59:  14%|█▎        | 16/117 [00:01<00:09, 10.98it/s, loss=0.865, v_num=1, val_acc=0.740]
Epoch 59:  15%|█▍        | 17/117 [00:01<00:08, 11.60it/s, loss=0.865, v_num=1, val_acc=0.740]
Epoch 59:  15%|█▍        | 17/117 [00:01<00:08, 11.40it/s, loss=0.864, v_num=1, val_acc=0.740]
Epoch 59:  15%|█▌        | 18/117 [00:01<00:08, 11.95it/s, loss=0.864, v_num=1, val_acc=0.740]
Epoch 59:  15%|█▌        | 18/117 [00:01<00:08, 11.76it/s, loss=0.869, v_num=1, val_acc=0.740]
Epoch 59:  16%|█▌        | 19/117 [00:01<00:07, 12.34it/s, loss=0.869, v_num=1, val_acc=0.740]
Epoch 59:  16%|█▌        | 19/117 [00:01<00:08, 12.14it/s, loss=0.87, v_num=1, val_acc=0.740]
Epoch 59:  17%|█▋        | 20/117 [00:01<00:07, 12.71it/s, loss=0.87, v_num=1, val_acc=0.740]
Epoch 59:  17%|█▋        | 20/117 [00:01<00:07, 12.51it/s, loss=0.884, v_num=1, val_acc=0.740]
Epoch 59:  18%|█▊        | 21/117 [00:01<00:07, 13.07it/s, loss=0.884, v_num=1, val_acc=0.740]
Epoch 59:  18%|█▊        | 21/117 [00:01<00:07, 12.87it/s, loss=0.9, v_num=1, val_acc=0.740]
Epoch 59:  19%|█▉        | 22/117 [00:01<00:07, 13.40it/s, loss=0.9, v_num=1, val_acc=0.740]
Epoch 59:  19%|█▉        | 22/117 [00:01<00:07, 13.20it/s, loss=0.901, v_num=1, val_acc=0.740]
Epoch 59:  20%|█▉        | 23/117 [00:01<00:06, 13.72it/s, loss=0.901, v_num=1, val_acc=0.740]
Epoch 59:  20%|█▉        | 23/117 [00:01<00:06, 13.52it/s, loss=0.895, v_num=1, val_acc=0.740]
Epoch 59:  21%|██        | 24/117 [00:01<00:06, 14.03it/s, loss=0.895, v_num=1, val_acc=0.740]
Epoch 59:  21%|██        | 24/117 [00:01<00:06, 13.83it/s, loss=0.891, v_num=1, val_acc=0.740]
Epoch 59:  21%|██▏       | 25/117 [00:01<00:06, 14.33it/s, loss=0.891, v_num=1, val_acc=0.740]
Epoch 59:  21%|██▏       | 25/117 [00:01<00:06, 14.12it/s, loss=0.88, v_num=1, val_acc=0.740]
Epoch 59:  22%|██▏       | 26/117 [00:01<00:06, 14.61it/s, loss=0.88, v_num=1, val_acc=0.740]
Epoch 59:  22%|██▏       | 26/117 [00:01<00:06, 14.41it/s, loss=0.876, v_num=1, val_acc=0.740]
Epoch 59:  23%|██▎       | 27/117 [00:01<00:06, 14.88it/s, loss=0.876, v_num=1, val_acc=0.740]
Epoch 59:  23%|██▎       | 27/117 [00:01<00:06, 14.68it/s, loss=0.868, v_num=1, val_acc=0.740]
Epoch 59:  24%|██▍       | 28/117 [00:01<00:05, 15.14it/s, loss=0.868, v_num=1, val_acc=0.740]
Epoch 59:  24%|██▍       | 28/117 [00:01<00:05, 14.94it/s, loss=0.858, v_num=1, val_acc=0.740]
Epoch 59:  25%|██▍       | 29/117 [00:01<00:05, 15.39it/s, loss=0.858, v_num=1, val_acc=0.740]
Epoch 59:  25%|██▍       | 29/117 [00:01<00:05, 15.19it/s, loss=0.849, v_num=1, val_acc=0.740]
Epoch 59:  26%|██▌       | 30/117 [00:01<00:05, 15.64it/s, loss=0.849, v_num=1, val_acc=0.740]
Epoch 59:  26%|██▌       | 30/117 [00:01<00:05, 15.44it/s, loss=0.845, v_num=1, val_acc=0.740]
Epoch 59:  26%|██▋       | 31/117 [00:01<00:05, 15.88it/s, loss=0.845, v_num=1, val_acc=0.740]
Epoch 59:  26%|██▋       | 31/117 [00:01<00:05, 15.67it/s, loss=0.836, v_num=1, val_acc=0.740]
Epoch 59:  27%|██▋       | 32/117 [00:01<00:05, 16.11it/s, loss=0.836, v_num=1, val_acc=0.740]
Epoch 59:  27%|██▋       | 32/117 [00:02<00:05, 15.90it/s, loss=0.832, v_num=1, val_acc=0.740]
Epoch 59:  28%|██▊       | 33/117 [00:02<00:05, 16.33it/s, loss=0.832, v_num=1, val_acc=0.740]
Epoch 59:  28%|██▊       | 33/117 [00:02<00:05, 16.12it/s, loss=0.829, v_num=1, val_acc=0.740]
Epoch 59:  29%|██▉       | 34/117 [00:02<00:05, 16.54it/s, loss=0.829, v_num=1, val_acc=0.740]
Epoch 59:  29%|██▉       | 34/117 [00:02<00:05, 16.34it/s, loss=0.832, v_num=1, val_acc=0.740]
Epoch 59:  30%|██▉       | 35/117 [00:02<00:04, 16.75it/s, loss=0.832, v_num=1, val_acc=0.740]
Epoch 59:  30%|██▉       | 35/117 [00:02<00:04, 16.55it/s, loss=0.834, v_num=1, val_acc=0.740]
Epoch 59:  31%|███       | 36/117 [00:02<00:04, 16.94it/s, loss=0.834, v_num=1, val_acc=0.740]
Epoch 59:  31%|███       | 36/117 [00:02<00:04, 16.74it/s, loss=0.851, v_num=1, val_acc=0.740]
Epoch 59:  32%|███▏      | 37/117 [00:02<00:04, 17.14it/s, loss=0.851, v_num=1, val_acc=0.740]
Epoch 59:  32%|███▏      | 37/117 [00:02<00:04, 16.94it/s, loss=0.852, v_num=1, val_acc=0.740]
Epoch 59:  32%|███▏      | 38/117 [00:02<00:04, 17.30it/s, loss=0.852, v_num=1, val_acc=0.740]
Epoch 59:  32%|███▏      | 38/117 [00:02<00:04, 17.11it/s, loss=0.853, v_num=1, val_acc=0.740]
Epoch 59:  33%|███▎      | 39/117 [00:02<00:04, 17.49it/s, loss=0.853, v_num=1, val_acc=0.740]
Epoch 59:  33%|███▎      | 39/117 [00:02<00:04, 17.29it/s, loss=0.856, v_num=1, val_acc=0.740]
Epoch 59:  34%|███▍      | 40/117 [00:02<00:04, 17.66it/s, loss=0.856, v_num=1, val_acc=0.740]
Epoch 59:  34%|███▍      | 40/117 [00:02<00:04, 17.47it/s, loss=0.845, v_num=1, val_acc=0.740]
Epoch 59:  35%|███▌      | 41/117 [00:02<00:04, 17.83it/s, loss=0.845, v_num=1, val_acc=0.740]
Epoch 59:  35%|███▌      | 41/117 [00:02<00:04, 17.64it/s, loss=0.843, v_num=1, val_acc=0.740]
Epoch 59:  36%|███▌      | 42/117 [00:02<00:04, 18.00it/s, loss=0.843, v_num=1, val_acc=0.740]
Epoch 59:  36%|███▌      | 42/117 [00:02<00:04, 17.81it/s, loss=0.849, v_num=1, val_acc=0.740]
Epoch 59:  37%|███▋      | 43/117 [00:02<00:04, 18.16it/s, loss=0.849, v_num=1, val_acc=0.740]
Epoch 59:  37%|███▋      | 43/117 [00:02<00:04, 17.97it/s, loss=0.858, v_num=1, val_acc=0.740]
Epoch 59:  38%|███▊      | 44/117 [00:02<00:03, 18.32it/s, loss=0.858, v_num=1, val_acc=0.740]
Epoch 59:  38%|███▊      | 44/117 [00:02<00:04, 18.13it/s, loss=0.866, v_num=1, val_acc=0.740]
Epoch 59:  38%|███▊      | 45/117 [00:02<00:03, 18.44it/s, loss=0.866, v_num=1, val_acc=0.740]
Epoch 59:  38%|███▊      | 45/117 [00:02<00:03, 18.26it/s, loss=0.88, v_num=1, val_acc=0.740]
Epoch 59:  39%|███▉      | 46/117 [00:02<00:03, 18.60it/s, loss=0.88, v_num=1, val_acc=0.740]
Epoch 59:  39%|███▉      | 46/117 [00:02<00:03, 18.41it/s, loss=0.884, v_num=1, val_acc=0.740]
Epoch 59:  40%|████      | 47/117 [00:02<00:03, 18.74it/s, loss=0.884, v_num=1, val_acc=0.740]
Epoch 59:  40%|████      | 47/117 [00:02<00:03, 18.56it/s, loss=0.887, v_num=1, val_acc=0.740]
Epoch 59:  41%|████      | 48/117 [00:02<00:03, 18.88it/s, loss=0.887, v_num=1, val_acc=0.740]
Epoch 59:  41%|████      | 48/117 [00:02<00:03, 18.70it/s, loss=0.901, v_num=1, val_acc=0.740]
Epoch 59:  42%|████▏     | 49/117 [00:02<00:03, 19.02it/s, loss=0.901, v_num=1, val_acc=0.740]
Epoch 59:  42%|████▏     | 49/117 [00:02<00:03, 18.83it/s, loss=0.909, v_num=1, val_acc=0.740]
Epoch 59:  43%|████▎     | 50/117 [00:02<00:03, 19.15it/s, loss=0.909, v_num=1, val_acc=0.740]
Epoch 59:  43%|████▎     | 50/117 [00:02<00:03, 18.97it/s, loss=0.925, v_num=1, val_acc=0.740]
Epoch 59:  44%|████▎     | 51/117 [00:02<00:03, 19.28it/s, loss=0.925, v_num=1, val_acc=0.740]
Epoch 59:  44%|████▎     | 51/117 [00:02<00:03, 19.10it/s, loss=0.946, v_num=1, val_acc=0.740]
Epoch 59:  44%|████▍     | 52/117 [00:02<00:03, 19.40it/s, loss=0.946, v_num=1, val_acc=0.740]
Epoch 59:  44%|████▍     | 52/117 [00:02<00:03, 19.22it/s, loss=0.978, v_num=1, val_acc=0.740]
Epoch 59:  45%|████▌     | 53/117 [00:02<00:03, 19.52it/s, loss=0.978, v_num=1, val_acc=0.740]
Epoch 59:  45%|████▌     | 53/117 [00:02<00:03, 19.35it/s, loss=0.997, v_num=1, val_acc=0.740]
Epoch 59:  46%|████▌     | 54/117 [00:02<00:03, 19.65it/s, loss=0.997, v_num=1, val_acc=0.740]
Epoch 59:  46%|████▌     | 54/117 [00:02<00:03, 19.47it/s, loss=0.999, v_num=1, val_acc=0.740]
Epoch 59:  47%|████▋     | 55/117 [00:02<00:03, 19.76it/s, loss=0.999, v_num=1, val_acc=0.740]
Epoch 59:  47%|████▋     | 55/117 [00:02<00:03, 19.58it/s, loss=1, v_num=1, val_acc=0.740]
Epoch 59:  48%|████▊     | 56/117 [00:02<00:03, 19.87it/s, loss=1, v_num=1, val_acc=0.740]
Epoch 59:  48%|████▊     | 56/117 [00:02<00:03, 19.70it/s, loss=0.994, v_num=1, val_acc=0.740]
Epoch 59:  49%|████▊     | 57/117 [00:02<00:03, 19.99it/s, loss=0.994, v_num=1, val_acc=0.740]
Epoch 59:  49%|████▊     | 57/117 [00:02<00:03, 19.81it/s, loss=0.993, v_num=1, val_acc=0.740]
Epoch 59:  50%|████▉     | 58/117 [00:02<00:02, 20.09it/s, loss=0.993, v_num=1, val_acc=0.740]
Epoch 59:  50%|████▉     | 58/117 [00:02<00:02, 19.92it/s, loss=0.994, v_num=1, val_acc=0.740]
Epoch 59:  50%|█████     | 59/117 [00:02<00:02, 20.20it/s, loss=0.994, v_num=1, val_acc=0.740]
Epoch 59:  50%|█████     | 59/117 [00:02<00:02, 20.03it/s, loss=0.985, v_num=1, val_acc=0.740]
Epoch 59:  51%|█████▏    | 60/117 [00:02<00:02, 20.30it/s, loss=0.985, v_num=1, val_acc=0.740]
Epoch 59:  51%|█████▏    | 60/117 [00:02<00:02, 20.13it/s, loss=0.983, v_num=1, val_acc=0.740]
Epoch 59:  52%|█████▏    | 61/117 [00:02<00:02, 20.39it/s, loss=0.983, v_num=1, val_acc=0.740]
Epoch 59:  52%|█████▏    | 61/117 [00:03<00:02, 20.22it/s, loss=0.975, v_num=1, val_acc=0.740]
Epoch 59:  53%|█████▎    | 62/117 [00:03<00:02, 20.49it/s, loss=0.975, v_num=1, val_acc=0.740]
Epoch 59:  53%|█████▎    | 62/117 [00:03<00:02, 20.32it/s, loss=0.97, v_num=1, val_acc=0.740]
Epoch 59:  54%|█████▍    | 63/117 [00:03<00:02, 20.59it/s, loss=0.97, v_num=1, val_acc=0.740]
Epoch 59:  54%|█████▍    | 63/117 [00:03<00:02, 20.42it/s, loss=0.969, v_num=1, val_acc=0.740]
Epoch 59:  55%|█████▍    | 64/117 [00:03<00:02, 20.68it/s, loss=0.969, v_num=1, val_acc=0.740]
Epoch 59:  55%|█████▍    | 64/117 [00:03<00:02, 20.51it/s, loss=0.957, v_num=1, val_acc=0.740]
Epoch 59:  56%|█████▌    | 65/117 [00:03<00:02, 20.77it/s, loss=0.957, v_num=1, val_acc=0.740]
Epoch 59:  56%|█████▌    | 65/117 [00:03<00:02, 20.61it/s, loss=0.942, v_num=1, val_acc=0.740]
Epoch 59:  56%|█████▋    | 66/117 [00:03<00:02, 20.86it/s, loss=0.942, v_num=1, val_acc=0.740]
Epoch 59:  56%|█████▋    | 66/117 [00:03<00:02, 20.70it/s, loss=0.937, v_num=1, val_acc=0.740]
Epoch 59:  57%|█████▋    | 67/117 [00:03<00:02, 20.95it/s, loss=0.937, v_num=1, val_acc=0.740]
Epoch 59:  57%|█████▋    | 67/117 [00:03<00:02, 20.79it/s, loss=0.932, v_num=1, val_acc=0.740]
Epoch 59:  58%|█████▊    | 68/117 [00:03<00:02, 21.04it/s, loss=0.932, v_num=1, val_acc=0.740]
Epoch 59:  58%|█████▊    | 68/117 [00:03<00:02, 20.87it/s, loss=0.926, v_num=1, val_acc=0.740]
Epoch 59:  59%|█████▉    | 69/117 [00:03<00:02, 21.12it/s, loss=0.926, v_num=1, val_acc=0.740]
Epoch 59:  59%|█████▉    | 69/117 [00:03<00:02, 20.96it/s, loss=0.927, v_num=1, val_acc=0.740]
Epoch 59:  60%|█████▉    | 70/117 [00:03<00:02, 21.20it/s, loss=0.927, v_num=1, val_acc=0.740]
Epoch 59:  60%|█████▉    | 70/117 [00:03<00:02, 21.04it/s, loss=0.911, v_num=1, val_acc=0.740]
Epoch 59:  61%|██████    | 71/117 [00:03<00:02, 21.28it/s, loss=0.911, v_num=1, val_acc=0.740]
Epoch 59:  61%|██████    | 71/117 [00:03<00:02, 21.12it/s, loss=0.894, v_num=1, val_acc=0.740]
Epoch 59:  62%|██████▏   | 72/117 [00:03<00:02, 21.36it/s, loss=0.894, v_num=1, val_acc=0.740]
Epoch 59:  62%|██████▏   | 72/117 [00:03<00:02, 21.20it/s, loss=0.866, v_num=1, val_acc=0.740]
Epoch 59:  62%|██████▏   | 73/117 [00:03<00:02, 21.44it/s, loss=0.866, v_num=1, val_acc=0.740]
Epoch 59:  62%|██████▏   | 73/117 [00:03<00:02, 21.28it/s, loss=0.859, v_num=1, val_acc=0.740]
Epoch 59:  63%|██████▎   | 74/117 [00:03<00:02, 21.49it/s, loss=0.859, v_num=1, val_acc=0.740]
Epoch 59:  63%|██████▎   | 74/117 [00:03<00:02, 21.34it/s, loss=0.856, v_num=1, val_acc=0.740]
Epoch 59:  64%|██████▍   | 75/117 [00:03<00:01, 21.57it/s, loss=0.856, v_num=1, val_acc=0.740]
Epoch 59:  64%|██████▍   | 75/117 [00:03<00:01, 21.42it/s, loss=0.846, v_num=1, val_acc=0.740]
Epoch 59:  65%|██████▍   | 76/117 [00:03<00:01, 21.65it/s, loss=0.846, v_num=1, val_acc=0.740]
Epoch 59:  65%|██████▍   | 76/117 [00:03<00:01, 21.49it/s, loss=0.833, v_num=1, val_acc=0.740]
Epoch 59:  66%|██████▌   | 77/117 [00:03<00:01, 21.72it/s, loss=0.833, v_num=1, val_acc=0.740]
Epoch 59:  66%|██████▌   | 77/117 [00:03<00:01, 21.57it/s, loss=0.828, v_num=1, val_acc=0.740]
Epoch 59:  67%|██████▋   | 78/117 [00:03<00:01, 21.79it/s, loss=0.828, v_num=1, val_acc=0.740]
Epoch 59:  67%|██████▋   | 78/117 [00:03<00:01, 21.63it/s, loss=0.821, v_num=1, val_acc=0.740]
Epoch 59:  68%|██████▊   | 79/117 [00:03<00:01, 21.85it/s, loss=0.821, v_num=1, val_acc=0.740]
Epoch 59:  68%|██████▊   | 79/117 [00:03<00:01, 21.70it/s, loss=0.823, v_num=1, val_acc=0.740]
Epoch 59:  68%|██████▊   | 80/117 [00:03<00:01, 21.92it/s, loss=0.823, v_num=1, val_acc=0.740]
Epoch 59:  68%|██████▊   | 80/117 [00:03<00:01, 21.77it/s, loss=0.822, v_num=1, val_acc=0.740]
Epoch 59:  69%|██████▉   | 81/117 [00:03<00:01, 21.99it/s, loss=0.822, v_num=1, val_acc=0.740]
Epoch 59:  69%|██████▉   | 81/117 [00:03<00:01, 21.84it/s, loss=0.821, v_num=1, val_acc=0.740]
Epoch 59:  70%|███████   | 82/117 [00:03<00:01, 22.02it/s, loss=0.821, v_num=1, val_acc=0.740]
Epoch 59:  70%|███████   | 82/117 [00:03<00:01, 21.87it/s, loss=0.814, v_num=1, val_acc=0.740]
Epoch 59:  71%|███████   | 83/117 [00:03<00:01, 22.09it/s, loss=0.814, v_num=1, val_acc=0.740]
Epoch 59:  71%|███████   | 83/117 [00:03<00:01, 21.94it/s, loss=0.815, v_num=1, val_acc=0.740]
Epoch 59:  72%|███████▏  | 84/117 [00:03<00:01, 22.15it/s, loss=0.815, v_num=1, val_acc=0.740]
Epoch 59:  72%|███████▏  | 84/117 [00:03<00:01, 22.00it/s, loss=0.823, v_num=1, val_acc=0.740]
Epoch 59:  73%|███████▎  | 85/117 [00:03<00:01, 22.18it/s, loss=0.823, v_num=1, val_acc=0.740]
Epoch 59:  73%|███████▎  | 85/117 [00:03<00:01, 22.04it/s, loss=0.836, v_num=1, val_acc=0.740]
Epoch 59:  74%|███████▎  | 86/117 [00:03<00:01, 22.25it/s, loss=0.836, v_num=1, val_acc=0.740]
Epoch 59:  74%|███████▎  | 86/117 [00:03<00:01, 22.11it/s, loss=0.837, v_num=1, val_acc=0.740]
Epoch 59:  74%|███████▍  | 87/117 [00:03<00:01, 22.31it/s, loss=0.837, v_num=1, val_acc=0.740]
Epoch 59:  74%|███████▍  | 87/117 [00:03<00:01, 22.17it/s, loss=0.834, v_num=1, val_acc=0.740]
Epoch 59:  75%|███████▌  | 88/117 [00:03<00:01, 22.37it/s, loss=0.834, v_num=1, val_acc=0.740]
Epoch 59:  75%|███████▌  | 88/117 [00:03<00:01, 22.23it/s, loss=0.833, v_num=1, val_acc=0.740]
Epoch 59:  76%|███████▌  | 89/117 [00:03<00:01, 22.43it/s, loss=0.833, v_num=1, val_acc=0.740]
Epoch 59:  76%|███████▌  | 89/117 [00:03<00:01, 22.29it/s, loss=0.828, v_num=1, val_acc=0.740]
Epoch 59:  77%|███████▋  | 90/117 [00:04<00:01, 22.49it/s, loss=0.828, v_num=1, val_acc=0.740]
Epoch 59:  77%|███████▋  | 90/117 [00:04<00:01, 22.35it/s, loss=0.828, v_num=1, val_acc=0.740]
Epoch 59:  78%|███████▊  | 91/117 [00:04<00:01, 22.55it/s, loss=0.828, v_num=1, val_acc=0.740]
Epoch 59:  78%|███████▊  | 91/117 [00:04<00:01, 22.40it/s, loss=0.828, v_num=1, val_acc=0.740]
Epoch 59:  79%|███████▊  | 92/117 [00:04<00:01, 22.60it/s, loss=0.828, v_num=1, val_acc=0.740]
Epoch 59:  79%|███████▊  | 92/117 [00:04<00:01, 22.46it/s, loss=0.825, v_num=1, val_acc=0.740]
Epoch 59:  79%|███████▉  | 93/117 [00:04<00:01, 22.66it/s, loss=0.825, v_num=1, val_acc=0.740]
Epoch 59:  79%|███████▉  | 93/117 [00:04<00:01, 22.52it/s, loss=0.814, v_num=1, val_acc=0.740]
Epoch 59:  80%|████████  | 94/117 [00:04<00:01, 22.71it/s, loss=0.814, v_num=1, val_acc=0.740]
Epoch 59:  80%|████████  | 94/117 [00:04<00:01, 22.57it/s, loss=0.807, v_num=1, val_acc=0.740]
Epoch 59:  81%|████████  | 95/117 [00:04<00:00, 22.76it/s, loss=0.807, v_num=1, val_acc=0.740]
Epoch 59:  81%|████████  | 95/117 [00:04<00:00, 22.62it/s, loss=0.809, v_num=1, val_acc=0.740]
Epoch 59:  82%|████████▏ | 96/117 [00:04<00:00, 22.81it/s, loss=0.809, v_num=1, val_acc=0.740]
Epoch 59:  82%|████████▏ | 96/117 [00:04<00:00, 22.68it/s, loss=0.813, v_num=1, val_acc=0.740]
Epoch 59:  83%|████████▎ | 97/117 [00:04<00:00, 22.86it/s, loss=0.813, v_num=1, val_acc=0.740]
Epoch 59:  83%|████████▎ | 97/117 [00:04<00:00, 22.73it/s, loss=0.811, v_num=1, val_acc=0.740]

Validation: 0it [00:00, ?it/s]

Validation:   0%|          | 0/20 [00:00<?, ?it/s]

Validation DataLoader 0:   0%|          | 0/20 [00:00<?, ?it/s]

Validation DataLoader 0:   5%|▌         | 1/20 [00:00<00:00, 183.79it/s]
Epoch 59:  84%|████████▍ | 98/117 [00:05<00:00, 19.23it/s, loss=0.811, v_num=1, val_acc=0.740]

Validation DataLoader 0:  10%|█         | 2/20 [00:00<00:00, 55.71it/s]
Epoch 59:  85%|████████▍ | 99/117 [00:05<00:00, 19.31it/s, loss=0.811, v_num=1, val_acc=0.740]

Validation DataLoader 0:  15%|█▌        | 3/20 [00:00<00:00, 44.14it/s]
Epoch 59:  85%|████████▌ | 100/117 [00:05<00:00, 19.39it/s, loss=0.811, v_num=1, val_acc=0.740]

Validation DataLoader 0:  20%|██        | 4/20 [00:00<00:00, 40.04it/s]
Epoch 59:  86%|████████▋ | 101/117 [00:05<00:00, 19.46it/s, loss=0.811, v_num=1, val_acc=0.740]

Validation DataLoader 0:  25%|██▌       | 5/20 [00:00<00:00, 37.85it/s]
Epoch 59:  87%|████████▋ | 102/117 [00:05<00:00, 19.53it/s, loss=0.811, v_num=1, val_acc=0.740]

Validation DataLoader 0:  30%|███       | 6/20 [00:00<00:00, 36.59it/s]
Epoch 59:  88%|████████▊ | 103/117 [00:05<00:00, 19.60it/s, loss=0.811, v_num=1, val_acc=0.740]

Validation DataLoader 0:  35%|███▌      | 7/20 [00:00<00:00, 35.78it/s]
Epoch 59:  89%|████████▉ | 104/117 [00:05<00:00, 19.68it/s, loss=0.811, v_num=1, val_acc=0.740]

Validation DataLoader 0:  40%|████      | 8/20 [00:00<00:00, 34.67it/s]
Epoch 59:  90%|████████▉ | 105/117 [00:05<00:00, 19.74it/s, loss=0.811, v_num=1, val_acc=0.740]

Validation DataLoader 0:  45%|████▌     | 9/20 [00:00<00:00, 34.12it/s]
Epoch 59:  91%|█████████ | 106/117 [00:05<00:00, 19.80it/s, loss=0.811, v_num=1, val_acc=0.740]

Validation DataLoader 0:  50%|█████     | 10/20 [00:00<00:00, 34.14it/s]
Epoch 59:  91%|█████████▏| 107/117 [00:05<00:00, 19.88it/s, loss=0.811, v_num=1, val_acc=0.740]

Validation DataLoader 0:  55%|█████▌    | 11/20 [00:00<00:00, 33.90it/s]
Epoch 59:  92%|█████████▏| 108/117 [00:05<00:00, 19.95it/s, loss=0.811, v_num=1, val_acc=0.740]

Validation DataLoader 0:  60%|██████    | 12/20 [00:00<00:00, 33.70it/s]
Epoch 59:  93%|█████████▎| 109/117 [00:05<00:00, 20.02it/s, loss=0.811, v_num=1, val_acc=0.740]

Validation DataLoader 0:  65%|██████▌   | 13/20 [00:00<00:00, 33.53it/s]
Epoch 59:  94%|█████████▍| 110/117 [00:05<00:00, 20.08it/s, loss=0.811, v_num=1, val_acc=0.740]

Validation DataLoader 0:  70%|███████   | 14/20 [00:00<00:00, 33.38it/s]
Epoch 59:  95%|█████████▍| 111/117 [00:05<00:00, 20.15it/s, loss=0.811, v_num=1, val_acc=0.740]

Validation DataLoader 0:  75%|███████▌  | 15/20 [00:00<00:00, 33.26it/s]
Epoch 59:  96%|█████████▌| 112/117 [00:05<00:00, 20.21it/s, loss=0.811, v_num=1, val_acc=0.740]

Validation DataLoader 0:  80%|████████  | 16/20 [00:00<00:00, 33.15it/s]
Epoch 59:  97%|█████████▋| 113/117 [00:05<00:00, 20.28it/s, loss=0.811, v_num=1, val_acc=0.740]

Validation DataLoader 0:  85%|████████▌ | 17/20 [00:00<00:00, 33.04it/s]
Epoch 59:  97%|█████████▋| 114/117 [00:05<00:00, 20.34it/s, loss=0.811, v_num=1, val_acc=0.740]

Validation DataLoader 0:  90%|█████████ | 18/20 [00:00<00:00, 32.95it/s]
Epoch 59:  98%|█████████▊| 115/117 [00:05<00:00, 20.40it/s, loss=0.811, v_num=1, val_acc=0.740]

Validation DataLoader 0:  95%|█████████▌| 19/20 [00:00<00:00, 32.87it/s]
Epoch 59:  99%|█████████▉| 116/117 [00:05<00:00, 20.47it/s, loss=0.811, v_num=1, val_acc=0.740]

Validation DataLoader 0: 100%|██████████| 20/20 [00:00<00:00, 32.88it/s]
Epoch 59: 100%|██████████| 117/117 [00:05<00:00, 20.53it/s, loss=0.811, v_num=1, val_acc=0.740]
Epoch 59: 100%|██████████| 117/117 [00:05<00:00, 20.46it/s, loss=0.811, v_num=1, val_acc=0.756]


Epoch 59: 100%|██████████| 117/117 [00:05<00:00, 20.46it/s, loss=0.811, v_num=1, val_acc=0.756]
Epoch 59:   0%|          | 0/117 [00:00<?, ?it/s, loss=0.811, v_num=1, val_acc=0.756]
Epoch 60:   0%|          | 0/117 [00:00<?, ?it/s, loss=0.811, v_num=1, val_acc=0.756]
Epoch 60:   1%|          | 1/117 [00:00<01:44,  1.10it/s, loss=0.811, v_num=1, val_acc=0.756]
Epoch 60:   1%|          | 1/117 [00:00<01:47,  1.08it/s, loss=0.812, v_num=1, val_acc=0.756]
Epoch 60:   2%|▏         | 2/117 [00:00<00:53,  2.14it/s, loss=0.812, v_num=1, val_acc=0.756]
Epoch 60:   2%|▏         | 2/117 [00:00<00:55,  2.08it/s, loss=0.805, v_num=1, val_acc=0.756]
Epoch 60:   3%|▎         | 3/117 [00:00<00:36,  3.09it/s, loss=0.805, v_num=1, val_acc=0.756]
Epoch 60:   3%|▎         | 3/117 [00:00<00:37,  3.01it/s, loss=0.807, v_num=1, val_acc=0.756]
Epoch 60:   3%|▎         | 4/117 [00:01<00:28,  3.98it/s, loss=0.807, v_num=1, val_acc=0.756]
Epoch 60:   3%|▎         | 4/117 [00:01<00:29,  3.88it/s, loss=0.801, v_num=1, val_acc=0.756]
Epoch 60:   4%|▍         | 5/117 [00:01<00:23,  4.81it/s, loss=0.801, v_num=1, val_acc=0.756]
Epoch 60:   4%|▍         | 5/117 [00:01<00:23,  4.69it/s, loss=0.801, v_num=1, val_acc=0.756]
Epoch 60:   5%|▌         | 6/117 [00:01<00:19,  5.57it/s, loss=0.801, v_num=1, val_acc=0.756]
Epoch 60:   5%|▌         | 6/117 [00:01<00:20,  5.44it/s, loss=0.796, v_num=1, val_acc=0.756]
Epoch 60:   6%|▌         | 7/117 [00:01<00:17,  6.30it/s, loss=0.796, v_num=1, val_acc=0.756]
Epoch 60:   6%|▌         | 7/117 [00:01<00:17,  6.16it/s, loss=0.788, v_num=1, val_acc=0.756]
Epoch 60:   7%|▋         | 8/117 [00:01<00:15,  6.98it/s, loss=0.788, v_num=1, val_acc=0.756]
Epoch 60:   7%|▋         | 8/117 [00:01<00:15,  6.83it/s, loss=0.781, v_num=1, val_acc=0.756]
Epoch 60:   8%|▊         | 9/117 [00:01<00:14,  7.62it/s, loss=0.781, v_num=1, val_acc=0.756]
Epoch 60:   8%|▊         | 9/117 [00:01<00:14,  7.46it/s, loss=0.784, v_num=1, val_acc=0.756]
Epoch 60:   9%|▊         | 10/117 [00:01<00:13,  8.19it/s, loss=0.784, v_num=1, val_acc=0.756]
Epoch 60:   9%|▊         | 10/117 [00:01<00:13,  8.04it/s, loss=0.797, v_num=1, val_acc=0.756]
Epoch 60:   9%|▉         | 11/117 [00:01<00:12,  8.76it/s, loss=0.797, v_num=1, val_acc=0.756]
Epoch 60:   9%|▉         | 11/117 [00:01<00:12,  8.59it/s, loss=0.799, v_num=1, val_acc=0.756]
Epoch 60:  10%|█         | 12/117 [00:01<00:11,  9.31it/s, loss=0.799, v_num=1, val_acc=0.756]
Epoch 60:  10%|█         | 12/117 [00:01<00:11,  9.13it/s, loss=0.804, v_num=1, val_acc=0.756]
Epoch 60:  11%|█         | 13/117 [00:01<00:10,  9.83it/s, loss=0.804, v_num=1, val_acc=0.756]
Epoch 60:  11%|█         | 13/117 [00:01<00:10,  9.65it/s, loss=0.813, v_num=1, val_acc=0.756]
Epoch 60:  12%|█▏        | 14/117 [00:01<00:09, 10.33it/s, loss=0.813, v_num=1, val_acc=0.756]
Epoch 60:  12%|█▏        | 14/117 [00:01<00:10, 10.13it/s, loss=0.828, v_num=1, val_acc=0.756]
Epoch 60:  13%|█▎        | 15/117 [00:01<00:09, 10.79it/s, loss=0.828, v_num=1, val_acc=0.756]
Epoch 60:  13%|█▎        | 15/117 [00:01<00:09, 10.60it/s, loss=0.838, v_num=1, val_acc=0.756]
Epoch 60:  14%|█▎        | 16/117 [00:01<00:08, 11.24it/s, loss=0.838, v_num=1, val_acc=0.756]
Epoch 60:  14%|█▎        | 16/117 [00:01<00:09, 11.04it/s, loss=0.85, v_num=1, val_acc=0.756]
Epoch 60:  15%|█▍        | 17/117 [00:01<00:08, 11.64it/s, loss=0.85, v_num=1, val_acc=0.756]
Epoch 60:  15%|█▍        | 17/117 [00:01<00:08, 11.45it/s, loss=0.86, v_num=1, val_acc=0.756]
Epoch 60:  15%|█▌        | 18/117 [00:01<00:08, 12.05it/s, loss=0.86, v_num=1, val_acc=0.756]
Epoch 60:  15%|█▌        | 18/117 [00:01<00:08, 11.85it/s, loss=0.862, v_num=1, val_acc=0.756]
Epoch 60:  16%|█▌        | 19/117 [00:01<00:07, 12.42it/s, loss=0.862, v_num=1, val_acc=0.756]
Epoch 60:  16%|█▌        | 19/117 [00:01<00:08, 12.23it/s, loss=0.865, v_num=1, val_acc=0.756]
Epoch 60:  17%|█▋        | 20/117 [00:01<00:07, 12.80it/s, loss=0.865, v_num=1, val_acc=0.756]
Epoch 60:  17%|█▋        | 20/117 [00:01<00:07, 12.59it/s, loss=0.863, v_num=1, val_acc=0.756]
Epoch 60:  18%|█▊        | 21/117 [00:01<00:07, 13.16it/s, loss=0.863, v_num=1, val_acc=0.756]
Epoch 60:  18%|█▊        | 21/117 [00:01<00:07, 12.95it/s, loss=0.866, v_num=1, val_acc=0.756]
Epoch 60:  19%|█▉        | 22/117 [00:01<00:07, 13.49it/s, loss=0.866, v_num=1, val_acc=0.756]
Epoch 60:  19%|█▉        | 22/117 [00:01<00:07, 13.28it/s, loss=0.873, v_num=1, val_acc=0.756]
Epoch 60:  20%|█▉        | 23/117 [00:01<00:06, 13.81it/s, loss=0.873, v_num=1, val_acc=0.756]
Epoch 60:  20%|█▉        | 23/117 [00:01<00:06, 13.61it/s, loss=0.873, v_num=1, val_acc=0.756]
Epoch 60:  21%|██        | 24/117 [00:01<00:06, 14.12it/s, loss=0.873, v_num=1, val_acc=0.756]
Epoch 60:  21%|██        | 24/117 [00:01<00:06, 13.92it/s, loss=0.877, v_num=1, val_acc=0.756]
Epoch 60:  21%|██▏       | 25/117 [00:01<00:06, 14.33it/s, loss=0.877, v_num=1, val_acc=0.756]
Epoch 60:  21%|██▏       | 25/117 [00:01<00:06, 14.15it/s, loss=0.874, v_num=1, val_acc=0.756]
Epoch 60:  22%|██▏       | 26/117 [00:01<00:06, 14.63it/s, loss=0.874, v_num=1, val_acc=0.756]
Epoch 60:  22%|██▏       | 26/117 [00:01<00:06, 14.43it/s, loss=0.872, v_num=1, val_acc=0.756]
Epoch 60:  23%|██▎       | 27/117 [00:01<00:06, 14.89it/s, loss=0.872, v_num=1, val_acc=0.756]
Epoch 60:  23%|██▎       | 27/117 [00:01<00:06, 14.69it/s, loss=0.879, v_num=1, val_acc=0.756]
Epoch 60:  24%|██▍       | 28/117 [00:01<00:05, 15.16it/s, loss=0.879, v_num=1, val_acc=0.756]
Epoch 60:  24%|██▍       | 28/117 [00:01<00:05, 14.96it/s, loss=0.881, v_num=1, val_acc=0.756]
Epoch 60:  25%|██▍       | 29/117 [00:01<00:05, 15.41it/s, loss=0.881, v_num=1, val_acc=0.756]
Epoch 60:  25%|██▍       | 29/117 [00:01<00:05, 15.21it/s, loss=0.879, v_num=1, val_acc=0.756]
Epoch 60:  26%|██▌       | 30/117 [00:01<00:05, 15.65it/s, loss=0.879, v_num=1, val_acc=0.756]
Epoch 60:  26%|██▌       | 30/117 [00:01<00:05, 15.45it/s, loss=0.864, v_num=1, val_acc=0.756]
Epoch 60:  26%|██▋       | 31/117 [00:01<00:05, 15.87it/s, loss=0.864, v_num=1, val_acc=0.756]
Epoch 60:  26%|██▋       | 31/117 [00:01<00:05, 15.67it/s, loss=0.855, v_num=1, val_acc=0.756]
Epoch 60:  27%|██▋       | 32/117 [00:01<00:05, 16.10it/s, loss=0.855, v_num=1, val_acc=0.756]
Epoch 60:  27%|██▋       | 32/117 [00:02<00:05, 15.90it/s, loss=0.85, v_num=1, val_acc=0.756]
Epoch 60:  28%|██▊       | 33/117 [00:02<00:05, 16.32it/s, loss=0.85, v_num=1, val_acc=0.756]
Epoch 60:  28%|██▊       | 33/117 [00:02<00:05, 16.12it/s, loss=0.846, v_num=1, val_acc=0.756]
Epoch 60:  29%|██▉       | 34/117 [00:02<00:05, 16.53it/s, loss=0.846, v_num=1, val_acc=0.756]
Epoch 60:  29%|██▉       | 34/117 [00:02<00:05, 16.33it/s, loss=0.836, v_num=1, val_acc=0.756]
Epoch 60:  30%|██▉       | 35/117 [00:02<00:04, 16.74it/s, loss=0.836, v_num=1, val_acc=0.756]
Epoch 60:  30%|██▉       | 35/117 [00:02<00:04, 16.54it/s, loss=0.821, v_num=1, val_acc=0.756]
Epoch 60:  31%|███       | 36/117 [00:02<00:04, 16.94it/s, loss=0.821, v_num=1, val_acc=0.756]
Epoch 60:  31%|███       | 36/117 [00:02<00:04, 16.74it/s, loss=0.806, v_num=1, val_acc=0.756]
Epoch 60:  32%|███▏      | 37/117 [00:02<00:04, 17.13it/s, loss=0.806, v_num=1, val_acc=0.756]
Epoch 60:  32%|███▏      | 37/117 [00:02<00:04, 16.93it/s, loss=0.79, v_num=1, val_acc=0.756]
Epoch 60:  32%|███▏      | 38/117 [00:02<00:04, 17.31it/s, loss=0.79, v_num=1, val_acc=0.756]
Epoch 60:  32%|███▏      | 38/117 [00:02<00:04, 17.12it/s, loss=0.791, v_num=1, val_acc=0.756]
Epoch 60:  33%|███▎      | 39/117 [00:02<00:04, 17.50it/s, loss=0.791, v_num=1, val_acc=0.756]
Epoch 60:  33%|███▎      | 39/117 [00:02<00:04, 17.30it/s, loss=0.788, v_num=1, val_acc=0.756]
Epoch 60:  34%|███▍      | 40/117 [00:02<00:04, 17.67it/s, loss=0.788, v_num=1, val_acc=0.756]
Epoch 60:  34%|███▍      | 40/117 [00:02<00:04, 17.47it/s, loss=0.787, v_num=1, val_acc=0.756]
Epoch 60:  35%|███▌      | 41/117 [00:02<00:04, 17.84it/s, loss=0.787, v_num=1, val_acc=0.756]
Epoch 60:  35%|███▌      | 41/117 [00:02<00:04, 17.64it/s, loss=0.784, v_num=1, val_acc=0.756]
Epoch 60:  36%|███▌      | 42/117 [00:02<00:04, 18.00it/s, loss=0.784, v_num=1, val_acc=0.756]
Epoch 60:  36%|███▌      | 42/117 [00:02<00:04, 17.81it/s, loss=0.781, v_num=1, val_acc=0.756]
Epoch 60:  37%|███▋      | 43/117 [00:02<00:04, 18.16it/s, loss=0.781, v_num=1, val_acc=0.756]
Epoch 60:  37%|███▋      | 43/117 [00:02<00:04, 17.97it/s, loss=0.782, v_num=1, val_acc=0.756]
Epoch 60:  38%|███▊      | 44/117 [00:02<00:03, 18.32it/s, loss=0.782, v_num=1, val_acc=0.756]
Epoch 60:  38%|███▊      | 44/117 [00:02<00:04, 18.13it/s, loss=0.779, v_num=1, val_acc=0.756]
Epoch 60:  38%|███▊      | 45/117 [00:02<00:03, 18.47it/s, loss=0.779, v_num=1, val_acc=0.756]
Epoch 60:  38%|███▊      | 45/117 [00:02<00:03, 18.28it/s, loss=0.779, v_num=1, val_acc=0.756]
Epoch 60:  39%|███▉      | 46/117 [00:02<00:03, 18.57it/s, loss=0.779, v_num=1, val_acc=0.756]
Epoch 60:  39%|███▉      | 46/117 [00:02<00:03, 18.40it/s, loss=0.778, v_num=1, val_acc=0.756]
Epoch 60:  40%|████      | 47/117 [00:02<00:03, 18.73it/s, loss=0.778, v_num=1, val_acc=0.756]
Epoch 60:  40%|████      | 47/117 [00:02<00:03, 18.55it/s, loss=0.767, v_num=1, val_acc=0.756]
Epoch 60:  41%|████      | 48/117 [00:02<00:03, 18.87it/s, loss=0.767, v_num=1, val_acc=0.756]
Epoch 60:  41%|████      | 48/117 [00:02<00:03, 18.69it/s, loss=0.764, v_num=1, val_acc=0.756]
Epoch 60:  42%|████▏     | 49/117 [00:02<00:03, 19.01it/s, loss=0.764, v_num=1, val_acc=0.756]
Epoch 60:  42%|████▏     | 49/117 [00:02<00:03, 18.83it/s, loss=0.761, v_num=1, val_acc=0.756]
Epoch 60:  43%|████▎     | 50/117 [00:02<00:03, 19.14it/s, loss=0.761, v_num=1, val_acc=0.756]
Epoch 60:  43%|████▎     | 50/117 [00:02<00:03, 18.96it/s, loss=0.767, v_num=1, val_acc=0.756]
Epoch 60:  44%|████▎     | 51/117 [00:02<00:03, 19.27it/s, loss=0.767, v_num=1, val_acc=0.756]
Epoch 60:  44%|████▎     | 51/117 [00:02<00:03, 19.09it/s, loss=0.767, v_num=1, val_acc=0.756]
Epoch 60:  44%|████▍     | 52/117 [00:02<00:03, 19.40it/s, loss=0.767, v_num=1, val_acc=0.756]
Epoch 60:  44%|████▍     | 52/117 [00:02<00:03, 19.22it/s, loss=0.766, v_num=1, val_acc=0.756]
Epoch 60:  45%|████▌     | 53/117 [00:02<00:03, 19.52it/s, loss=0.766, v_num=1, val_acc=0.756]
Epoch 60:  45%|████▌     | 53/117 [00:02<00:03, 19.34it/s, loss=0.763, v_num=1, val_acc=0.756]
Epoch 60:  46%|████▌     | 54/117 [00:02<00:03, 19.64it/s, loss=0.763, v_num=1, val_acc=0.756]
Epoch 60:  46%|████▌     | 54/117 [00:02<00:03, 19.46it/s, loss=0.766, v_num=1, val_acc=0.756]
Epoch 60:  47%|████▋     | 55/117 [00:02<00:03, 19.76it/s, loss=0.766, v_num=1, val_acc=0.756]
Epoch 60:  47%|████▋     | 55/117 [00:02<00:03, 19.58it/s, loss=0.77, v_num=1, val_acc=0.756]
Epoch 60:  48%|████▊     | 56/117 [00:02<00:03, 19.87it/s, loss=0.77, v_num=1, val_acc=0.756]
Epoch 60:  48%|████▊     | 56/117 [00:02<00:03, 19.69it/s, loss=0.772, v_num=1, val_acc=0.756]
Epoch 60:  49%|████▊     | 57/117 [00:02<00:03, 19.98it/s, loss=0.772, v_num=1, val_acc=0.756]
Epoch 60:  49%|████▊     | 57/117 [00:02<00:03, 19.81it/s, loss=0.775, v_num=1, val_acc=0.756]
Epoch 60:  50%|████▉     | 58/117 [00:02<00:02, 20.09it/s, loss=0.775, v_num=1, val_acc=0.756]
Epoch 60:  50%|████▉     | 58/117 [00:02<00:02, 19.92it/s, loss=0.765, v_num=1, val_acc=0.756]
Epoch 60:  50%|█████     | 59/117 [00:02<00:02, 20.20it/s, loss=0.765, v_num=1, val_acc=0.756]
Epoch 60:  50%|█████     | 59/117 [00:02<00:02, 20.02it/s, loss=0.766, v_num=1, val_acc=0.756]
Epoch 60:  51%|█████▏    | 60/117 [00:02<00:02, 20.30it/s, loss=0.766, v_num=1, val_acc=0.756]
Epoch 60:  51%|█████▏    | 60/117 [00:02<00:02, 20.13it/s, loss=0.773, v_num=1, val_acc=0.756]
Epoch 60:  52%|█████▏    | 61/117 [00:02<00:02, 20.40it/s, loss=0.773, v_num=1, val_acc=0.756]
Epoch 60:  52%|█████▏    | 61/117 [00:03<00:02, 20.23it/s, loss=0.771, v_num=1, val_acc=0.756]
Epoch 60:  53%|█████▎    | 62/117 [00:03<00:02, 20.50it/s, loss=0.771, v_num=1, val_acc=0.756]
Epoch 60:  53%|█████▎    | 62/117 [00:03<00:02, 20.33it/s, loss=0.78, v_num=1, val_acc=0.756]
Epoch 60:  54%|█████▍    | 63/117 [00:03<00:02, 20.60it/s, loss=0.78, v_num=1, val_acc=0.756]
Epoch 60:  54%|█████▍    | 63/117 [00:03<00:02, 20.43it/s, loss=0.788, v_num=1, val_acc=0.756]
Epoch 60:  55%|█████▍    | 64/117 [00:03<00:02, 20.68it/s, loss=0.788, v_num=1, val_acc=0.756]
Epoch 60:  55%|█████▍    | 64/117 [00:03<00:02, 20.51it/s, loss=0.803, v_num=1, val_acc=0.756]
Epoch 60:  56%|█████▌    | 65/117 [00:03<00:02, 20.77it/s, loss=0.803, v_num=1, val_acc=0.756]
Epoch 60:  56%|█████▌    | 65/117 [00:03<00:02, 20.61it/s, loss=0.819, v_num=1, val_acc=0.756]
Epoch 60:  56%|█████▋    | 66/117 [00:03<00:02, 20.86it/s, loss=0.819, v_num=1, val_acc=0.756]
Epoch 60:  56%|█████▋    | 66/117 [00:03<00:02, 20.70it/s, loss=0.83, v_num=1, val_acc=0.756]
Epoch 60:  57%|█████▋    | 67/117 [00:03<00:02, 20.95it/s, loss=0.83, v_num=1, val_acc=0.756]
Epoch 60:  57%|█████▋    | 67/117 [00:03<00:02, 20.78it/s, loss=0.834, v_num=1, val_acc=0.756]
Epoch 60:  58%|█████▊    | 68/117 [00:03<00:02, 21.03it/s, loss=0.834, v_num=1, val_acc=0.756]
Epoch 60:  58%|█████▊    | 68/117 [00:03<00:02, 20.87it/s, loss=0.834, v_num=1, val_acc=0.756]
Epoch 60:  59%|█████▉    | 69/117 [00:03<00:02, 21.12it/s, loss=0.834, v_num=1, val_acc=0.756]
Epoch 60:  59%|█████▉    | 69/117 [00:03<00:02, 20.96it/s, loss=0.837, v_num=1, val_acc=0.756]
Epoch 60:  60%|█████▉    | 70/117 [00:03<00:02, 21.20it/s, loss=0.837, v_num=1, val_acc=0.756]
Epoch 60:  60%|█████▉    | 70/117 [00:03<00:02, 21.04it/s, loss=0.841, v_num=1, val_acc=0.756]
Epoch 60:  61%|██████    | 71/117 [00:03<00:02, 21.28it/s, loss=0.841, v_num=1, val_acc=0.756]
Epoch 60:  61%|██████    | 71/117 [00:03<00:02, 21.12it/s, loss=0.837, v_num=1, val_acc=0.756]
Epoch 60:  62%|██████▏   | 72/117 [00:03<00:02, 21.35it/s, loss=0.837, v_num=1, val_acc=0.756]
Epoch 60:  62%|██████▏   | 72/117 [00:03<00:02, 21.19it/s, loss=0.839, v_num=1, val_acc=0.756]
Epoch 60:  62%|██████▏   | 73/117 [00:03<00:02, 21.43it/s, loss=0.839, v_num=1, val_acc=0.756]
Epoch 60:  62%|██████▏   | 73/117 [00:03<00:02, 21.27it/s, loss=0.838, v_num=1, val_acc=0.756]
Epoch 60:  63%|██████▎   | 74/117 [00:03<00:01, 21.51it/s, loss=0.838, v_num=1, val_acc=0.756]
Epoch 60:  63%|██████▎   | 74/117 [00:03<00:02, 21.35it/s, loss=0.836, v_num=1, val_acc=0.756]
Epoch 60:  64%|██████▍   | 75/117 [00:03<00:01, 21.58it/s, loss=0.836, v_num=1, val_acc=0.756]
Epoch 60:  64%|██████▍   | 75/117 [00:03<00:01, 21.42it/s, loss=0.849, v_num=1, val_acc=0.756]
Epoch 60:  65%|██████▍   | 76/117 [00:03<00:01, 21.65it/s, loss=0.849, v_num=1, val_acc=0.756]
Epoch 60:  65%|██████▍   | 76/117 [00:03<00:01, 21.50it/s, loss=0.875, v_num=1, val_acc=0.756]
Epoch 60:  66%|██████▌   | 77/117 [00:03<00:01, 21.72it/s, loss=0.875, v_num=1, val_acc=0.756]
Epoch 60:  66%|██████▌   | 77/117 [00:03<00:01, 21.57it/s, loss=0.89, v_num=1, val_acc=0.756]
Epoch 60:  67%|██████▋   | 78/117 [00:03<00:01, 21.79it/s, loss=0.89, v_num=1, val_acc=0.756]
Epoch 60:  67%|██████▋   | 78/117 [00:03<00:01, 21.64it/s, loss=0.896, v_num=1, val_acc=0.756]
Epoch 60:  68%|██████▊   | 79/117 [00:03<00:01, 21.86it/s, loss=0.896, v_num=1, val_acc=0.756]
Epoch 60:  68%|██████▊   | 79/117 [00:03<00:01, 21.71it/s, loss=0.897, v_num=1, val_acc=0.756]
Epoch 60:  68%|██████▊   | 80/117 [00:03<00:01, 21.93it/s, loss=0.897, v_num=1, val_acc=0.756]
Epoch 60:  68%|██████▊   | 80/117 [00:03<00:01, 21.78it/s, loss=0.902, v_num=1, val_acc=0.756]
Epoch 60:  69%|██████▉   | 81/117 [00:03<00:01, 21.99it/s, loss=0.902, v_num=1, val_acc=0.756]
Epoch 60:  69%|██████▉   | 81/117 [00:03<00:01, 21.84it/s, loss=0.905, v_num=1, val_acc=0.756]
Epoch 60:  70%|███████   | 82/117 [00:03<00:01, 22.04it/s, loss=0.905, v_num=1, val_acc=0.756]
Epoch 60:  70%|███████   | 82/117 [00:03<00:01, 21.90it/s, loss=0.905, v_num=1, val_acc=0.756]
Epoch 60:  71%|███████   | 83/117 [00:03<00:01, 22.11it/s, loss=0.905, v_num=1, val_acc=0.756]
Epoch 60:  71%|███████   | 83/117 [00:03<00:01, 21.96it/s, loss=0.903, v_num=1, val_acc=0.756]
Epoch 60:  72%|███████▏  | 84/117 [00:03<00:01, 22.17it/s, loss=0.903, v_num=1, val_acc=0.756]
Epoch 60:  72%|███████▏  | 84/117 [00:03<00:01, 22.02it/s, loss=0.897, v_num=1, val_acc=0.756]
Epoch 60:  73%|███████▎  | 85/117 [00:03<00:01, 22.21it/s, loss=0.897, v_num=1, val_acc=0.756]
Epoch 60:  73%|███████▎  | 85/117 [00:03<00:01, 22.07it/s, loss=0.893, v_num=1, val_acc=0.756]
Epoch 60:  74%|███████▎  | 86/117 [00:03<00:01, 22.28it/s, loss=0.893, v_num=1, val_acc=0.756]
Epoch 60:  74%|███████▎  | 86/117 [00:03<00:01, 22.13it/s, loss=0.905, v_num=1, val_acc=0.756]
Epoch 60:  74%|███████▍  | 87/117 [00:03<00:01, 22.34it/s, loss=0.905, v_num=1, val_acc=0.756]
Epoch 60:  74%|███████▍  | 87/117 [00:03<00:01, 22.19it/s, loss=0.907, v_num=1, val_acc=0.756]
Epoch 60:  75%|███████▌  | 88/117 [00:03<00:01, 22.40it/s, loss=0.907, v_num=1, val_acc=0.756]
Epoch 60:  75%|███████▌  | 88/117 [00:03<00:01, 22.26it/s, loss=0.902, v_num=1, val_acc=0.756]
Epoch 60:  76%|███████▌  | 89/117 [00:03<00:01, 22.46it/s, loss=0.902, v_num=1, val_acc=0.756]
Epoch 60:  76%|███████▌  | 89/117 [00:03<00:01, 22.32it/s, loss=0.899, v_num=1, val_acc=0.756]
Epoch 60:  77%|███████▋  | 90/117 [00:03<00:01, 22.52it/s, loss=0.899, v_num=1, val_acc=0.756]
Epoch 60:  77%|███████▋  | 90/117 [00:04<00:01, 22.37it/s, loss=0.888, v_num=1, val_acc=0.756]
Epoch 60:  78%|███████▊  | 91/117 [00:04<00:01, 22.57it/s, loss=0.888, v_num=1, val_acc=0.756]
Epoch 60:  78%|███████▊  | 91/117 [00:04<00:01, 22.43it/s, loss=0.897, v_num=1, val_acc=0.756]
Epoch 60:  79%|███████▊  | 92/117 [00:04<00:01, 22.63it/s, loss=0.897, v_num=1, val_acc=0.756]
Epoch 60:  79%|███████▊  | 92/117 [00:04<00:01, 22.49it/s, loss=0.896, v_num=1, val_acc=0.756]
Epoch 60:  79%|███████▉  | 93/117 [00:04<00:01, 22.68it/s, loss=0.896, v_num=1, val_acc=0.756]
Epoch 60:  79%|███████▉  | 93/117 [00:04<00:01, 22.54it/s, loss=0.896, v_num=1, val_acc=0.756]
Epoch 60:  80%|████████  | 94/117 [00:04<00:01, 22.74it/s, loss=0.896, v_num=1, val_acc=0.756]
Epoch 60:  80%|████████  | 94/117 [00:04<00:01, 22.60it/s, loss=0.896, v_num=1, val_acc=0.756]
Epoch 60:  81%|████████  | 95/117 [00:04<00:00, 22.79it/s, loss=0.896, v_num=1, val_acc=0.756]
Epoch 60:  81%|████████  | 95/117 [00:04<00:00, 22.65it/s, loss=0.882, v_num=1, val_acc=0.756]
Epoch 60:  82%|████████▏ | 96/117 [00:04<00:00, 22.84it/s, loss=0.882, v_num=1, val_acc=0.756]
Epoch 60:  82%|████████▏ | 96/117 [00:04<00:00, 22.70it/s, loss=0.861, v_num=1, val_acc=0.756]
Epoch 60:  83%|████████▎ | 97/117 [00:04<00:00, 22.89it/s, loss=0.861, v_num=1, val_acc=0.756]
Epoch 60:  83%|████████▎ | 97/117 [00:04<00:00, 22.75it/s, loss=0.856, v_num=1, val_acc=0.756]

Validation: 0it [00:00, ?it/s]

Validation:   0%|          | 0/20 [00:00<?, ?it/s]

Validation DataLoader 0:   0%|          | 0/20 [00:00<?, ?it/s]

Validation DataLoader 0:   5%|▌         | 1/20 [00:00<00:00, 173.12it/s]
Epoch 60:  84%|████████▍ | 98/117 [00:05<00:00, 19.18it/s, loss=0.856, v_num=1, val_acc=0.756]

Validation DataLoader 0:  10%|█         | 2/20 [00:00<00:00, 55.29it/s]
Epoch 60:  85%|████████▍ | 99/117 [00:05<00:00, 19.26it/s, loss=0.856, v_num=1, val_acc=0.756]

Validation DataLoader 0:  15%|█▌        | 3/20 [00:00<00:00, 44.21it/s]
Epoch 60:  85%|████████▌ | 100/117 [00:05<00:00, 19.34it/s, loss=0.856, v_num=1, val_acc=0.756]

Validation DataLoader 0:  20%|██        | 4/20 [00:00<00:00, 40.28it/s]
Epoch 60:  86%|████████▋ | 101/117 [00:05<00:00, 19.41it/s, loss=0.856, v_num=1, val_acc=0.756]

Validation DataLoader 0:  25%|██▌       | 5/20 [00:00<00:00, 38.12it/s]
Epoch 60:  87%|████████▋ | 102/117 [00:05<00:00, 19.49it/s, loss=0.856, v_num=1, val_acc=0.756]

Validation DataLoader 0:  30%|███       | 6/20 [00:00<00:00, 36.84it/s]
Epoch 60:  88%|████████▊ | 103/117 [00:05<00:00, 19.56it/s, loss=0.856, v_num=1, val_acc=0.756]

Validation DataLoader 0:  35%|███▌      | 7/20 [00:00<00:00, 36.01it/s]
Epoch 60:  89%|████████▉ | 104/117 [00:05<00:00, 19.63it/s, loss=0.856, v_num=1, val_acc=0.756]

Validation DataLoader 0:  40%|████      | 8/20 [00:00<00:00, 35.38it/s]
Epoch 60:  90%|████████▉ | 105/117 [00:05<00:00, 19.70it/s, loss=0.856, v_num=1, val_acc=0.756]

Validation DataLoader 0:  45%|████▌     | 9/20 [00:00<00:00, 34.93it/s]
Epoch 60:  91%|█████████ | 106/117 [00:05<00:00, 19.77it/s, loss=0.856, v_num=1, val_acc=0.756]

Validation DataLoader 0:  50%|█████     | 10/20 [00:00<00:00, 34.53it/s]
Epoch 60:  91%|█████████▏| 107/117 [00:05<00:00, 19.84it/s, loss=0.856, v_num=1, val_acc=0.756]

Validation DataLoader 0:  55%|█████▌    | 11/20 [00:00<00:00, 34.25it/s]
Epoch 60:  92%|█████████▏| 108/117 [00:05<00:00, 19.91it/s, loss=0.856, v_num=1, val_acc=0.756]

Validation DataLoader 0:  60%|██████    | 12/20 [00:00<00:00, 34.03it/s]
Epoch 60:  93%|█████████▎| 109/117 [00:05<00:00, 19.98it/s, loss=0.856, v_num=1, val_acc=0.756]

Validation DataLoader 0:  65%|██████▌   | 13/20 [00:00<00:00, 33.82it/s]
Epoch 60:  94%|█████████▍| 110/117 [00:05<00:00, 20.04it/s, loss=0.856, v_num=1, val_acc=0.756]

Validation DataLoader 0:  70%|███████   | 14/20 [00:00<00:00, 33.64it/s]
Epoch 60:  95%|█████████▍| 111/117 [00:05<00:00, 20.11it/s, loss=0.856, v_num=1, val_acc=0.756]

Validation DataLoader 0:  75%|███████▌  | 15/20 [00:00<00:00, 33.49it/s]
Epoch 60:  96%|█████████▌| 112/117 [00:05<00:00, 20.18it/s, loss=0.856, v_num=1, val_acc=0.756]

Validation DataLoader 0:  80%|████████  | 16/20 [00:00<00:00, 33.35it/s]
Epoch 60:  97%|█████████▋| 113/117 [00:05<00:00, 20.24it/s, loss=0.856, v_num=1, val_acc=0.756]

Validation DataLoader 0:  85%|████████▌ | 17/20 [00:00<00:00, 33.22it/s]
Epoch 60:  97%|█████████▋| 114/117 [00:05<00:00, 20.30it/s, loss=0.856, v_num=1, val_acc=0.756]

Validation DataLoader 0:  90%|█████████ | 18/20 [00:00<00:00, 33.13it/s]
Epoch 60:  98%|█████████▊| 115/117 [00:05<00:00, 20.37it/s, loss=0.856, v_num=1, val_acc=0.756]

Validation DataLoader 0:  95%|█████████▌| 19/20 [00:00<00:00, 33.04it/s]
Epoch 60:  99%|█████████▉| 116/117 [00:05<00:00, 20.43it/s, loss=0.856, v_num=1, val_acc=0.756]

Validation DataLoader 0: 100%|██████████| 20/20 [00:00<00:00, 33.04it/s]
Epoch 60: 100%|██████████| 117/117 [00:05<00:00, 20.50it/s, loss=0.856, v_num=1, val_acc=0.756]
Epoch 60: 100%|██████████| 117/117 [00:05<00:00, 20.42it/s, loss=0.856, v_num=1, val_acc=0.748]


Epoch 60: 100%|██████████| 117/117 [00:05<00:00, 20.42it/s, loss=0.856, v_num=1, val_acc=0.748]
Epoch 60:   0%|          | 0/117 [00:00<?, ?it/s, loss=0.856, v_num=1, val_acc=0.748]
Epoch 61:   0%|          | 0/117 [00:00<?, ?it/s, loss=0.856, v_num=1, val_acc=0.748]
Epoch 61:   1%|          | 1/117 [00:00<01:45,  1.10it/s, loss=0.856, v_num=1, val_acc=0.748]
Epoch 61:   1%|          | 1/117 [00:00<01:48,  1.07it/s, loss=0.856, v_num=1, val_acc=0.748]
Epoch 61:   2%|▏         | 2/117 [00:00<00:54,  2.11it/s, loss=0.856, v_num=1, val_acc=0.748]
Epoch 61:   2%|▏         | 2/117 [00:00<00:55,  2.05it/s, loss=0.858, v_num=1, val_acc=0.748]
Epoch 61:   3%|▎         | 3/117 [00:00<00:37,  3.06it/s, loss=0.858, v_num=1, val_acc=0.748]
Epoch 61:   3%|▎         | 3/117 [00:01<00:38,  2.98it/s, loss=0.853, v_num=1, val_acc=0.748]
Epoch 61:   3%|▎         | 4/117 [00:01<00:28,  3.94it/s, loss=0.853, v_num=1, val_acc=0.748]
Epoch 61:   3%|▎         | 4/117 [00:01<00:29,  3.84it/s, loss=0.85, v_num=1, val_acc=0.748]
Epoch 61:   4%|▍         | 5/117 [00:01<00:23,  4.76it/s, loss=0.85, v_num=1, val_acc=0.748]
Epoch 61:   4%|▍         | 5/117 [00:01<00:24,  4.65it/s, loss=0.854, v_num=1, val_acc=0.748]
Epoch 61:   5%|▌         | 6/117 [00:01<00:20,  5.52it/s, loss=0.854, v_num=1, val_acc=0.748]
Epoch 61:   5%|▌         | 6/117 [00:01<00:20,  5.40it/s, loss=0.852, v_num=1, val_acc=0.748]
Epoch 61:   6%|▌         | 7/117 [00:01<00:17,  6.25it/s, loss=0.852, v_num=1, val_acc=0.748]
Epoch 61:   6%|▌         | 7/117 [00:01<00:18,  6.11it/s, loss=0.852, v_num=1, val_acc=0.748]
Epoch 61:   7%|▋         | 8/117 [00:01<00:15,  6.93it/s, loss=0.852, v_num=1, val_acc=0.748]
Epoch 61:   7%|▋         | 8/117 [00:01<00:16,  6.78it/s, loss=0.849, v_num=1, val_acc=0.748]
Epoch 61:   8%|▊         | 9/117 [00:01<00:14,  7.55it/s, loss=0.849, v_num=1, val_acc=0.748]
Epoch 61:   8%|▊         | 9/117 [00:01<00:14,  7.39it/s, loss=0.829, v_num=1, val_acc=0.748]
Epoch 61:   9%|▊         | 10/117 [00:01<00:13,  8.14it/s, loss=0.829, v_num=1, val_acc=0.748]
Epoch 61:   9%|▊         | 10/117 [00:01<00:13,  7.98it/s, loss=0.831, v_num=1, val_acc=0.748]
Epoch 61:   9%|▉         | 11/117 [00:01<00:12,  8.72it/s, loss=0.831, v_num=1, val_acc=0.748]
Epoch 61:   9%|▉         | 11/117 [00:01<00:12,  8.54it/s, loss=0.841, v_num=1, val_acc=0.748]
Epoch 61:  10%|█         | 12/117 [00:01<00:11,  9.26it/s, loss=0.841, v_num=1, val_acc=0.748]
Epoch 61:  10%|█         | 12/117 [00:01<00:11,  9.08it/s, loss=0.838, v_num=1, val_acc=0.748]
Epoch 61:  11%|█         | 13/117 [00:01<00:10,  9.78it/s, loss=0.838, v_num=1, val_acc=0.748]
Epoch 61:  11%|█         | 13/117 [00:01<00:10,  9.60it/s, loss=0.836, v_num=1, val_acc=0.748]
Epoch 61:  12%|█▏        | 14/117 [00:01<00:10, 10.26it/s, loss=0.836, v_num=1, val_acc=0.748]
Epoch 61:  12%|█▏        | 14/117 [00:01<00:10, 10.08it/s, loss=0.829, v_num=1, val_acc=0.748]
Epoch 61:  13%|█▎        | 15/117 [00:01<00:09, 10.73it/s, loss=0.829, v_num=1, val_acc=0.748]
Epoch 61:  13%|█▎        | 15/117 [00:01<00:09, 10.54it/s, loss=0.825, v_num=1, val_acc=0.748]
Epoch 61:  14%|█▎        | 16/117 [00:01<00:09, 11.18it/s, loss=0.825, v_num=1, val_acc=0.748]
Epoch 61:  14%|█▎        | 16/117 [00:01<00:09, 10.98it/s, loss=0.826, v_num=1, val_acc=0.748]
Epoch 61:  15%|█▍        | 17/117 [00:01<00:08, 11.57it/s, loss=0.826, v_num=1, val_acc=0.748]
Epoch 61:  15%|█▍        | 17/117 [00:01<00:08, 11.37it/s, loss=0.819, v_num=1, val_acc=0.748]
Epoch 61:  15%|█▌        | 18/117 [00:01<00:08, 11.94it/s, loss=0.819, v_num=1, val_acc=0.748]
Epoch 61:  15%|█▌        | 18/117 [00:01<00:08, 11.75it/s, loss=0.816, v_num=1, val_acc=0.748]
Epoch 61:  16%|█▌        | 19/117 [00:01<00:07, 12.34it/s, loss=0.816, v_num=1, val_acc=0.748]
Epoch 61:  16%|█▌        | 19/117 [00:01<00:08, 12.14it/s, loss=0.815, v_num=1, val_acc=0.748]
Epoch 61:  17%|█▋        | 20/117 [00:01<00:07, 12.71it/s, loss=0.815, v_num=1, val_acc=0.748]
Epoch 61:  17%|█▋        | 20/117 [00:01<00:07, 12.51it/s, loss=0.809, v_num=1, val_acc=0.748]
Epoch 61:  18%|█▊        | 21/117 [00:01<00:07, 13.06it/s, loss=0.809, v_num=1, val_acc=0.748]
Epoch 61:  18%|█▊        | 21/117 [00:01<00:07, 12.86it/s, loss=0.801, v_num=1, val_acc=0.748]
Epoch 61:  19%|█▉        | 22/117 [00:01<00:07, 13.40it/s, loss=0.801, v_num=1, val_acc=0.748]
Epoch 61:  19%|█▉        | 22/117 [00:01<00:07, 13.20it/s, loss=0.797, v_num=1, val_acc=0.748]
Epoch 61:  20%|█▉        | 23/117 [00:01<00:06, 13.72it/s, loss=0.797, v_num=1, val_acc=0.748]
Epoch 61:  20%|█▉        | 23/117 [00:01<00:06, 13.52it/s, loss=0.794, v_num=1, val_acc=0.748]
Epoch 61:  21%|██        | 24/117 [00:01<00:06, 14.03it/s, loss=0.794, v_num=1, val_acc=0.748]
Epoch 61:  21%|██        | 24/117 [00:01<00:06, 13.82it/s, loss=0.79, v_num=1, val_acc=0.748]
Epoch 61:  21%|██▏       | 25/117 [00:01<00:06, 14.32it/s, loss=0.79, v_num=1, val_acc=0.748]
Epoch 61:  21%|██▏       | 25/117 [00:01<00:06, 14.12it/s, loss=0.774, v_num=1, val_acc=0.748]
Epoch 61:  22%|██▏       | 26/117 [00:01<00:06, 14.60it/s, loss=0.774, v_num=1, val_acc=0.748]
Epoch 61:  22%|██▏       | 26/117 [00:01<00:06, 14.39it/s, loss=0.77, v_num=1, val_acc=0.748]
Epoch 61:  23%|██▎       | 27/117 [00:01<00:06, 14.85it/s, loss=0.77, v_num=1, val_acc=0.748]
Epoch 61:  23%|██▎       | 27/117 [00:01<00:06, 14.67it/s, loss=0.762, v_num=1, val_acc=0.748]
Epoch 61:  24%|██▍       | 28/117 [00:01<00:05, 15.14it/s, loss=0.762, v_num=1, val_acc=0.748]
Epoch 61:  24%|██▍       | 28/117 [00:01<00:05, 14.94it/s, loss=0.757, v_num=1, val_acc=0.748]
Epoch 61:  25%|██▍       | 29/117 [00:01<00:05, 15.40it/s, loss=0.757, v_num=1, val_acc=0.748]
Epoch 61:  25%|██▍       | 29/117 [00:01<00:05, 15.19it/s, loss=0.75, v_num=1, val_acc=0.748]
Epoch 61:  26%|██▌       | 30/117 [00:01<00:05, 15.64it/s, loss=0.75, v_num=1, val_acc=0.748]
Epoch 61:  26%|██▌       | 30/117 [00:01<00:05, 15.44it/s, loss=0.745, v_num=1, val_acc=0.748]
Epoch 61:  26%|██▋       | 31/117 [00:01<00:05, 15.88it/s, loss=0.745, v_num=1, val_acc=0.748]
Epoch 61:  26%|██▋       | 31/117 [00:01<00:05, 15.67it/s, loss=0.733, v_num=1, val_acc=0.748]
Epoch 61:  27%|██▋       | 32/117 [00:01<00:05, 16.10it/s, loss=0.733, v_num=1, val_acc=0.748]
Epoch 61:  27%|██▋       | 32/117 [00:02<00:05, 15.90it/s, loss=0.728, v_num=1, val_acc=0.748]
Epoch 61:  28%|██▊       | 33/117 [00:02<00:05, 16.32it/s, loss=0.728, v_num=1, val_acc=0.748]
Epoch 61:  28%|██▊       | 33/117 [00:02<00:05, 16.12it/s, loss=0.736, v_num=1, val_acc=0.748]
Epoch 61:  29%|██▉       | 34/117 [00:02<00:05, 16.52it/s, loss=0.736, v_num=1, val_acc=0.748]
Epoch 61:  29%|██▉       | 34/117 [00:02<00:05, 16.32it/s, loss=0.738, v_num=1, val_acc=0.748]
Epoch 61:  30%|██▉       | 35/117 [00:02<00:04, 16.74it/s, loss=0.738, v_num=1, val_acc=0.748]
Epoch 61:  30%|██▉       | 35/117 [00:02<00:04, 16.53it/s, loss=0.736, v_num=1, val_acc=0.748]
Epoch 61:  31%|███       | 36/117 [00:02<00:04, 16.89it/s, loss=0.736, v_num=1, val_acc=0.748]
Epoch 61:  31%|███       | 36/117 [00:02<00:04, 16.71it/s, loss=0.73, v_num=1, val_acc=0.748]
Epoch 61:  32%|███▏      | 37/117 [00:02<00:04, 17.11it/s, loss=0.73, v_num=1, val_acc=0.748]
Epoch 61:  32%|███▏      | 37/117 [00:02<00:04, 16.91it/s, loss=0.734, v_num=1, val_acc=0.748]
Epoch 61:  32%|███▏      | 38/117 [00:02<00:04, 17.30it/s, loss=0.734, v_num=1, val_acc=0.748]
Epoch 61:  32%|███▏      | 38/117 [00:02<00:04, 17.10it/s, loss=0.735, v_num=1, val_acc=0.748]
Epoch 61:  33%|███▎      | 39/117 [00:02<00:04, 17.48it/s, loss=0.735, v_num=1, val_acc=0.748]
Epoch 61:  33%|███▎      | 39/117 [00:02<00:04, 17.28it/s, loss=0.73, v_num=1, val_acc=0.748]
Epoch 61:  34%|███▍      | 40/117 [00:02<00:04, 17.65it/s, loss=0.73, v_num=1, val_acc=0.748]
Epoch 61:  34%|███▍      | 40/117 [00:02<00:04, 17.46it/s, loss=0.733, v_num=1, val_acc=0.748]
Epoch 61:  35%|███▌      | 41/117 [00:02<00:04, 17.82it/s, loss=0.733, v_num=1, val_acc=0.748]
Epoch 61:  35%|███▌      | 41/117 [00:02<00:04, 17.63it/s, loss=0.743, v_num=1, val_acc=0.748]
Epoch 61:  36%|███▌      | 42/117 [00:02<00:04, 17.96it/s, loss=0.743, v_num=1, val_acc=0.748]
Epoch 61:  36%|███▌      | 42/117 [00:02<00:04, 17.78it/s, loss=0.751, v_num=1, val_acc=0.748]
Epoch 61:  37%|███▋      | 43/117 [00:02<00:04, 18.13it/s, loss=0.751, v_num=1, val_acc=0.748]
Epoch 61:  37%|███▋      | 43/117 [00:02<00:04, 17.94it/s, loss=0.763, v_num=1, val_acc=0.748]
Epoch 61:  38%|███▊      | 44/117 [00:02<00:03, 18.29it/s, loss=0.763, v_num=1, val_acc=0.748]
Epoch 61:  38%|███▊      | 44/117 [00:02<00:04, 18.10it/s, loss=0.782, v_num=1, val_acc=0.748]
Epoch 61:  38%|███▊      | 45/117 [00:02<00:03, 18.44it/s, loss=0.782, v_num=1, val_acc=0.748]
Epoch 61:  38%|███▊      | 45/117 [00:02<00:03, 18.25it/s, loss=0.799, v_num=1, val_acc=0.748]
Epoch 61:  39%|███▉      | 46/117 [00:02<00:03, 18.59it/s, loss=0.799, v_num=1, val_acc=0.748]
Epoch 61:  39%|███▉      | 46/117 [00:02<00:03, 18.40it/s, loss=0.804, v_num=1, val_acc=0.748]
Epoch 61:  40%|████      | 47/117 [00:02<00:03, 18.73it/s, loss=0.804, v_num=1, val_acc=0.748]
Epoch 61:  40%|████      | 47/117 [00:02<00:03, 18.54it/s, loss=0.805, v_num=1, val_acc=0.748]
Epoch 61:  41%|████      | 48/117 [00:02<00:03, 18.87it/s, loss=0.805, v_num=1, val_acc=0.748]
Epoch 61:  41%|████      | 48/117 [00:02<00:03, 18.68it/s, loss=0.795, v_num=1, val_acc=0.748]
Epoch 61:  42%|████▏     | 49/117 [00:02<00:03, 18.97it/s, loss=0.795, v_num=1, val_acc=0.748]
Epoch 61:  42%|████▏     | 49/117 [00:02<00:03, 18.80it/s, loss=0.799, v_num=1, val_acc=0.748]
Epoch 61:  43%|████▎     | 50/117 [00:02<00:03, 19.11it/s, loss=0.799, v_num=1, val_acc=0.748]
Epoch 61:  43%|████▎     | 50/117 [00:02<00:03, 18.93it/s, loss=0.799, v_num=1, val_acc=0.748]
Epoch 61:  44%|████▎     | 51/117 [00:02<00:03, 19.24it/s, loss=0.799, v_num=1, val_acc=0.748]
Epoch 61:  44%|████▎     | 51/117 [00:02<00:03, 19.06it/s, loss=0.802, v_num=1, val_acc=0.748]
Epoch 61:  44%|████▍     | 52/117 [00:02<00:03, 19.37it/s, loss=0.802, v_num=1, val_acc=0.748]
Epoch 61:  44%|████▍     | 52/117 [00:02<00:03, 19.19it/s, loss=0.81, v_num=1, val_acc=0.748]
Epoch 61:  45%|████▌     | 53/117 [00:02<00:03, 19.49it/s, loss=0.81, v_num=1, val_acc=0.748]
Epoch 61:  45%|████▌     | 53/117 [00:02<00:03, 19.31it/s, loss=0.812, v_num=1, val_acc=0.748]
Epoch 61:  46%|████▌     | 54/117 [00:02<00:03, 19.61it/s, loss=0.812, v_num=1, val_acc=0.748]
Epoch 61:  46%|████▌     | 54/117 [00:02<00:03, 19.43it/s, loss=0.809, v_num=1, val_acc=0.748]
Epoch 61:  47%|████▋     | 55/117 [00:02<00:03, 19.73it/s, loss=0.809, v_num=1, val_acc=0.748]
Epoch 61:  47%|████▋     | 55/117 [00:02<00:03, 19.55it/s, loss=0.813, v_num=1, val_acc=0.748]
Epoch 61:  48%|████▊     | 56/117 [00:02<00:03, 19.84it/s, loss=0.813, v_num=1, val_acc=0.748]
Epoch 61:  48%|████▊     | 56/117 [00:02<00:03, 19.66it/s, loss=0.816, v_num=1, val_acc=0.748]
Epoch 61:  49%|████▊     | 57/117 [00:02<00:03, 19.95it/s, loss=0.816, v_num=1, val_acc=0.748]
Epoch 61:  49%|████▊     | 57/117 [00:02<00:03, 19.77it/s, loss=0.816, v_num=1, val_acc=0.748]
Epoch 61:  50%|████▉     | 58/117 [00:02<00:02, 20.06it/s, loss=0.816, v_num=1, val_acc=0.748]
Epoch 61:  50%|████▉     | 58/117 [00:02<00:02, 19.88it/s, loss=0.816, v_num=1, val_acc=0.748]
Epoch 61:  50%|█████     | 59/117 [00:02<00:02, 20.16it/s, loss=0.816, v_num=1, val_acc=0.748]
Epoch 61:  50%|█████     | 59/117 [00:02<00:02, 19.99it/s, loss=0.818, v_num=1, val_acc=0.748]
Epoch 61:  51%|█████▏    | 60/117 [00:02<00:02, 20.27it/s, loss=0.818, v_num=1, val_acc=0.748]
Epoch 61:  51%|█████▏    | 60/117 [00:02<00:02, 20.09it/s, loss=0.814, v_num=1, val_acc=0.748]
Epoch 61:  52%|█████▏    | 61/117 [00:02<00:02, 20.37it/s, loss=0.814, v_num=1, val_acc=0.748]
Epoch 61:  52%|█████▏    | 61/117 [00:03<00:02, 20.20it/s, loss=0.807, v_num=1, val_acc=0.748]
Epoch 61:  53%|█████▎    | 62/117 [00:03<00:02, 20.47it/s, loss=0.807, v_num=1, val_acc=0.748]
Epoch 61:  53%|█████▎    | 62/117 [00:03<00:02, 20.30it/s, loss=0.8, v_num=1, val_acc=0.748]
Epoch 61:  54%|█████▍    | 63/117 [00:03<00:02, 20.56it/s, loss=0.8, v_num=1, val_acc=0.748]
Epoch 61:  54%|█████▍    | 63/117 [00:03<00:02, 20.39it/s, loss=0.79, v_num=1, val_acc=0.748]
Epoch 61:  55%|█████▍    | 64/117 [00:03<00:02, 20.66it/s, loss=0.79, v_num=1, val_acc=0.748]
Epoch 61:  55%|█████▍    | 64/117 [00:03<00:02, 20.49it/s, loss=0.775, v_num=1, val_acc=0.748]
Epoch 61:  56%|█████▌    | 65/117 [00:03<00:02, 20.75it/s, loss=0.775, v_num=1, val_acc=0.748]
Epoch 61:  56%|█████▌    | 65/117 [00:03<00:02, 20.58it/s, loss=0.768, v_num=1, val_acc=0.748]
Epoch 61:  56%|█████▋    | 66/117 [00:03<00:02, 20.84it/s, loss=0.768, v_num=1, val_acc=0.748]
Epoch 61:  56%|█████▋    | 66/117 [00:03<00:02, 20.67it/s, loss=0.765, v_num=1, val_acc=0.748]
Epoch 61:  57%|█████▋    | 67/117 [00:03<00:02, 20.93it/s, loss=0.765, v_num=1, val_acc=0.748]
Epoch 61:  57%|█████▋    | 67/117 [00:03<00:02, 20.76it/s, loss=0.765, v_num=1, val_acc=0.748]
Epoch 61:  58%|█████▊    | 68/117 [00:03<00:02, 21.01it/s, loss=0.765, v_num=1, val_acc=0.748]
Epoch 61:  58%|█████▊    | 68/117 [00:03<00:02, 20.85it/s, loss=0.782, v_num=1, val_acc=0.748]
Epoch 61:  59%|█████▉    | 69/117 [00:03<00:02, 21.10it/s, loss=0.782, v_num=1, val_acc=0.748]
Epoch 61:  59%|█████▉    | 69/117 [00:03<00:02, 20.93it/s, loss=0.788, v_num=1, val_acc=0.748]
Epoch 61:  60%|█████▉    | 70/117 [00:03<00:02, 21.18it/s, loss=0.788, v_num=1, val_acc=0.748]
Epoch 61:  60%|█████▉    | 70/117 [00:03<00:02, 21.02it/s, loss=0.792, v_num=1, val_acc=0.748]
Epoch 61:  61%|██████    | 71/117 [00:03<00:02, 21.26it/s, loss=0.792, v_num=1, val_acc=0.748]
Epoch 61:  61%|██████    | 71/117 [00:03<00:02, 21.10it/s, loss=0.794, v_num=1, val_acc=0.748]
Epoch 61:  62%|██████▏   | 72/117 [00:03<00:02, 21.34it/s, loss=0.794, v_num=1, val_acc=0.748]
Epoch 61:  62%|██████▏   | 72/117 [00:03<00:02, 21.18it/s, loss=0.797, v_num=1, val_acc=0.748]
Epoch 61:  62%|██████▏   | 73/117 [00:03<00:02, 21.42it/s, loss=0.797, v_num=1, val_acc=0.748]
Epoch 61:  62%|██████▏   | 73/117 [00:03<00:02, 21.26it/s, loss=0.802, v_num=1, val_acc=0.748]
Epoch 61:  63%|██████▎   | 74/117 [00:03<00:02, 21.49it/s, loss=0.802, v_num=1, val_acc=0.748]
Epoch 61:  63%|██████▎   | 74/117 [00:03<00:02, 21.34it/s, loss=0.813, v_num=1, val_acc=0.748]
Epoch 61:  64%|██████▍   | 75/117 [00:03<00:01, 21.57it/s, loss=0.813, v_num=1, val_acc=0.748]
Epoch 61:  64%|██████▍   | 75/117 [00:03<00:01, 21.41it/s, loss=0.825, v_num=1, val_acc=0.748]
Epoch 61:  65%|██████▍   | 76/117 [00:03<00:01, 21.64it/s, loss=0.825, v_num=1, val_acc=0.748]
Epoch 61:  65%|██████▍   | 76/117 [00:03<00:01, 21.49it/s, loss=0.829, v_num=1, val_acc=0.748]
Epoch 61:  66%|██████▌   | 77/117 [00:03<00:01, 21.71it/s, loss=0.829, v_num=1, val_acc=0.748]
Epoch 61:  66%|██████▌   | 77/117 [00:03<00:01, 21.56it/s, loss=0.832, v_num=1, val_acc=0.748]
Epoch 61:  67%|██████▋   | 78/117 [00:03<00:01, 21.78it/s, loss=0.832, v_num=1, val_acc=0.748]
Epoch 61:  67%|██████▋   | 78/117 [00:03<00:01, 21.63it/s, loss=0.837, v_num=1, val_acc=0.748]
Epoch 61:  68%|██████▊   | 79/117 [00:03<00:01, 21.85it/s, loss=0.837, v_num=1, val_acc=0.748]
Epoch 61:  68%|██████▊   | 79/117 [00:03<00:01, 21.70it/s, loss=0.84, v_num=1, val_acc=0.748]
Epoch 61:  68%|██████▊   | 80/117 [00:03<00:01, 21.92it/s, loss=0.84, v_num=1, val_acc=0.748]
Epoch 61:  68%|██████▊   | 80/117 [00:03<00:01, 21.77it/s, loss=0.842, v_num=1, val_acc=0.748]
Epoch 61:  69%|██████▉   | 81/117 [00:03<00:01, 21.98it/s, loss=0.842, v_num=1, val_acc=0.748]
Epoch 61:  69%|██████▉   | 81/117 [00:03<00:01, 21.83it/s, loss=0.852, v_num=1, val_acc=0.748]
Epoch 61:  70%|███████   | 82/117 [00:03<00:01, 22.03it/s, loss=0.852, v_num=1, val_acc=0.748]
Epoch 61:  70%|███████   | 82/117 [00:03<00:01, 21.88it/s, loss=0.861, v_num=1, val_acc=0.748]
Epoch 61:  71%|███████   | 83/117 [00:03<00:01, 22.09it/s, loss=0.861, v_num=1, val_acc=0.748]
Epoch 61:  71%|███████   | 83/117 [00:03<00:01, 21.95it/s, loss=0.865, v_num=1, val_acc=0.748]
Epoch 61:  72%|███████▏  | 84/117 [00:03<00:01, 22.15it/s, loss=0.865, v_num=1, val_acc=0.748]
Epoch 61:  72%|███████▏  | 84/117 [00:03<00:01, 22.01it/s, loss=0.868, v_num=1, val_acc=0.748]
Epoch 61:  73%|███████▎  | 85/117 [00:03<00:01, 22.22it/s, loss=0.868, v_num=1, val_acc=0.748]
Epoch 61:  73%|███████▎  | 85/117 [00:03<00:01, 22.07it/s, loss=0.866, v_num=1, val_acc=0.748]
Epoch 61:  74%|███████▎  | 86/117 [00:03<00:01, 22.28it/s, loss=0.866, v_num=1, val_acc=0.748]
Epoch 61:  74%|███████▎  | 86/117 [00:03<00:01, 22.13it/s, loss=0.868, v_num=1, val_acc=0.748]
Epoch 61:  74%|███████▍  | 87/117 [00:03<00:01, 22.34it/s, loss=0.868, v_num=1, val_acc=0.748]
Epoch 61:  74%|███████▍  | 87/117 [00:03<00:01, 22.20it/s, loss=0.877, v_num=1, val_acc=0.748]
Epoch 61:  75%|███████▌  | 88/117 [00:03<00:01, 22.40it/s, loss=0.877, v_num=1, val_acc=0.748]
Epoch 61:  75%|███████▌  | 88/117 [00:03<00:01, 22.26it/s, loss=0.873, v_num=1, val_acc=0.748]
Epoch 61:  76%|███████▌  | 89/117 [00:03<00:01, 22.46it/s, loss=0.873, v_num=1, val_acc=0.748]
Epoch 61:  76%|███████▌  | 89/117 [00:03<00:01, 22.32it/s, loss=0.873, v_num=1, val_acc=0.748]
Epoch 61:  77%|███████▋  | 90/117 [00:03<00:01, 22.52it/s, loss=0.873, v_num=1, val_acc=0.748]
Epoch 61:  77%|███████▋  | 90/117 [00:04<00:01, 22.38it/s, loss=0.877, v_num=1, val_acc=0.748]
Epoch 61:  78%|███████▊  | 91/117 [00:04<00:01, 22.57it/s, loss=0.877, v_num=1, val_acc=0.748]
Epoch 61:  78%|███████▊  | 91/117 [00:04<00:01, 22.43it/s, loss=0.879, v_num=1, val_acc=0.748]
Epoch 61:  79%|███████▊  | 92/117 [00:04<00:01, 22.63it/s, loss=0.879, v_num=1, val_acc=0.748]
Epoch 61:  79%|███████▊  | 92/117 [00:04<00:01, 22.49it/s, loss=0.875, v_num=1, val_acc=0.748]
Epoch 61:  79%|███████▉  | 93/117 [00:04<00:01, 22.68it/s, loss=0.875, v_num=1, val_acc=0.748]
Epoch 61:  79%|███████▉  | 93/117 [00:04<00:01, 22.54it/s, loss=0.864, v_num=1, val_acc=0.748]
Epoch 61:  80%|████████  | 94/117 [00:04<00:01, 22.74it/s, loss=0.864, v_num=1, val_acc=0.748]
Epoch 61:  80%|████████  | 94/117 [00:04<00:01, 22.60it/s, loss=0.858, v_num=1, val_acc=0.748]
Epoch 61:  81%|████████  | 95/117 [00:04<00:00, 22.79it/s, loss=0.858, v_num=1, val_acc=0.748]
Epoch 61:  81%|████████  | 95/117 [00:04<00:00, 22.65it/s, loss=0.846, v_num=1, val_acc=0.748]
Epoch 61:  82%|████████▏ | 96/117 [00:04<00:00, 22.84it/s, loss=0.846, v_num=1, val_acc=0.748]
Epoch 61:  82%|████████▏ | 96/117 [00:04<00:00, 22.70it/s, loss=0.838, v_num=1, val_acc=0.748]
Epoch 61:  83%|████████▎ | 97/117 [00:04<00:00, 22.89it/s, loss=0.838, v_num=1, val_acc=0.748]
Epoch 61:  83%|████████▎ | 97/117 [00:04<00:00, 22.75it/s, loss=0.835, v_num=1, val_acc=0.748]

Validation: 0it [00:00, ?it/s]

Validation:   0%|          | 0/20 [00:00<?, ?it/s]

Validation DataLoader 0:   0%|          | 0/20 [00:00<?, ?it/s]

Validation DataLoader 0:   5%|▌         | 1/20 [00:00<00:00, 122.74it/s]
Epoch 61:  84%|████████▍ | 98/117 [00:05<00:00, 19.16it/s, loss=0.835, v_num=1, val_acc=0.748]

Validation DataLoader 0:  10%|█         | 2/20 [00:00<00:00, 52.55it/s]
Epoch 61:  85%|████████▍ | 99/117 [00:05<00:00, 19.24it/s, loss=0.835, v_num=1, val_acc=0.748]

Validation DataLoader 0:  15%|█▌        | 3/20 [00:00<00:00, 42.90it/s]
Epoch 61:  85%|████████▌ | 100/117 [00:05<00:00, 19.32it/s, loss=0.835, v_num=1, val_acc=0.748]

Validation DataLoader 0:  20%|██        | 4/20 [00:00<00:00, 39.23it/s]
Epoch 61:  86%|████████▋ | 101/117 [00:05<00:00, 19.39it/s, loss=0.835, v_num=1, val_acc=0.748]

Validation DataLoader 0:  25%|██▌       | 5/20 [00:00<00:00, 37.25it/s]
Epoch 61:  87%|████████▋ | 102/117 [00:05<00:00, 19.46it/s, loss=0.835, v_num=1, val_acc=0.748]

Validation DataLoader 0:  30%|███       | 6/20 [00:00<00:00, 36.20it/s]
Epoch 61:  88%|████████▊ | 103/117 [00:05<00:00, 19.54it/s, loss=0.835, v_num=1, val_acc=0.748]

Validation DataLoader 0:  35%|███▌      | 7/20 [00:00<00:00, 35.41it/s]
Epoch 61:  89%|████████▉ | 104/117 [00:05<00:00, 19.61it/s, loss=0.835, v_num=1, val_acc=0.748]

Validation DataLoader 0:  40%|████      | 8/20 [00:00<00:00, 34.87it/s]
Epoch 61:  90%|████████▉ | 105/117 [00:05<00:00, 19.68it/s, loss=0.835, v_num=1, val_acc=0.748]

Validation DataLoader 0:  45%|████▌     | 9/20 [00:00<00:00, 34.39it/s]
Epoch 61:  91%|█████████ | 106/117 [00:05<00:00, 19.75it/s, loss=0.835, v_num=1, val_acc=0.748]

Validation DataLoader 0:  50%|█████     | 10/20 [00:00<00:00, 34.16it/s]
Epoch 61:  91%|█████████▏| 107/117 [00:05<00:00, 19.82it/s, loss=0.835, v_num=1, val_acc=0.748]

Validation DataLoader 0:  55%|█████▌    | 11/20 [00:00<00:00, 33.92it/s]
Epoch 61:  92%|█████████▏| 108/117 [00:05<00:00, 19.89it/s, loss=0.835, v_num=1, val_acc=0.748]

Validation DataLoader 0:  60%|██████    | 12/20 [00:00<00:00, 33.71it/s]
Epoch 61:  93%|█████████▎| 109/117 [00:05<00:00, 19.95it/s, loss=0.835, v_num=1, val_acc=0.748]

Validation DataLoader 0:  65%|██████▌   | 13/20 [00:00<00:00, 33.54it/s]
Epoch 61:  94%|█████████▍| 110/117 [00:05<00:00, 20.02it/s, loss=0.835, v_num=1, val_acc=0.748]

Validation DataLoader 0:  70%|███████   | 14/20 [00:00<00:00, 33.38it/s]
Epoch 61:  95%|█████████▍| 111/117 [00:05<00:00, 20.09it/s, loss=0.835, v_num=1, val_acc=0.748]

Validation DataLoader 0:  75%|███████▌  | 15/20 [00:00<00:00, 33.25it/s]
Epoch 61:  96%|█████████▌| 112/117 [00:05<00:00, 20.15it/s, loss=0.835, v_num=1, val_acc=0.748]

Validation DataLoader 0:  80%|████████  | 16/20 [00:00<00:00, 33.15it/s]
Epoch 61:  97%|█████████▋| 113/117 [00:05<00:00, 20.22it/s, loss=0.835, v_num=1, val_acc=0.748]

Validation DataLoader 0:  85%|████████▌ | 17/20 [00:00<00:00, 33.05it/s]
Epoch 61:  97%|█████████▋| 114/117 [00:05<00:00, 20.28it/s, loss=0.835, v_num=1, val_acc=0.748]

Validation DataLoader 0:  90%|█████████ | 18/20 [00:00<00:00, 32.97it/s]
Epoch 61:  98%|█████████▊| 115/117 [00:05<00:00, 20.34it/s, loss=0.835, v_num=1, val_acc=0.748]

Validation DataLoader 0:  95%|█████████▌| 19/20 [00:00<00:00, 32.89it/s]
Epoch 61:  99%|█████████▉| 116/117 [00:05<00:00, 20.41it/s, loss=0.835, v_num=1, val_acc=0.748]

Validation DataLoader 0: 100%|██████████| 20/20 [00:00<00:00, 32.89it/s]
Epoch 61: 100%|██████████| 117/117 [00:05<00:00, 20.47it/s, loss=0.835, v_num=1, val_acc=0.748]
Epoch 61: 100%|██████████| 117/117 [00:05<00:00, 20.40it/s, loss=0.835, v_num=1, val_acc=0.747]


Epoch 61: 100%|██████████| 117/117 [00:05<00:00, 20.40it/s, loss=0.835, v_num=1, val_acc=0.747]
Epoch 61:   0%|          | 0/117 [00:00<?, ?it/s, loss=0.835, v_num=1, val_acc=0.747]
Epoch 62:   0%|          | 0/117 [00:00<?, ?it/s, loss=0.835, v_num=1, val_acc=0.747]
Epoch 62:   1%|          | 1/117 [00:00<01:44,  1.11it/s, loss=0.835, v_num=1, val_acc=0.747]
Epoch 62:   1%|          | 1/117 [00:00<01:46,  1.08it/s, loss=0.831, v_num=1, val_acc=0.747]
Epoch 62:   2%|▏         | 2/117 [00:00<00:53,  2.15it/s, loss=0.831, v_num=1, val_acc=0.747]
Epoch 62:   2%|▏         | 2/117 [00:00<00:55,  2.09it/s, loss=0.826, v_num=1, val_acc=0.747]
Epoch 62:   3%|▎         | 3/117 [00:00<00:36,  3.10it/s, loss=0.826, v_num=1, val_acc=0.747]
Epoch 62:   3%|▎         | 3/117 [00:00<00:37,  3.03it/s, loss=0.82, v_num=1, val_acc=0.747]
Epoch 62:   3%|▎         | 4/117 [00:01<00:28,  4.00it/s, loss=0.82, v_num=1, val_acc=0.747]
Epoch 62:   3%|▎         | 4/117 [00:01<00:28,  3.90it/s, loss=0.812, v_num=1, val_acc=0.747]
Epoch 62:   4%|▍         | 5/117 [00:01<00:23,  4.83it/s, loss=0.812, v_num=1, val_acc=0.747]
Epoch 62:   4%|▍         | 5/117 [00:01<00:23,  4.71it/s, loss=0.801, v_num=1, val_acc=0.747]
Epoch 62:   5%|▌         | 6/117 [00:01<00:19,  5.60it/s, loss=0.801, v_num=1, val_acc=0.747]
Epoch 62:   5%|▌         | 6/117 [00:01<00:20,  5.47it/s, loss=0.801, v_num=1, val_acc=0.747]
Epoch 62:   6%|▌         | 7/117 [00:01<00:17,  6.33it/s, loss=0.801, v_num=1, val_acc=0.747]
Epoch 62:   6%|▌         | 7/117 [00:01<00:17,  6.19it/s, loss=0.796, v_num=1, val_acc=0.747]
Epoch 62:   7%|▋         | 8/117 [00:01<00:15,  7.02it/s, loss=0.796, v_num=1, val_acc=0.747]
Epoch 62:   7%|▋         | 8/117 [00:01<00:15,  6.87it/s, loss=0.793, v_num=1, val_acc=0.747]
Epoch 62:   8%|▊         | 9/117 [00:01<00:14,  7.66it/s, loss=0.793, v_num=1, val_acc=0.747]
Epoch 62:   8%|▊         | 9/117 [00:01<00:14,  7.50it/s, loss=0.787, v_num=1, val_acc=0.747]
Epoch 62:   9%|▊         | 10/117 [00:01<00:12,  8.25it/s, loss=0.787, v_num=1, val_acc=0.747]
Epoch 62:   9%|▊         | 10/117 [00:01<00:13,  8.09it/s, loss=0.779, v_num=1, val_acc=0.747]
Epoch 62:   9%|▉         | 11/117 [00:01<00:12,  8.80it/s, loss=0.779, v_num=1, val_acc=0.747]
Epoch 62:   9%|▉         | 11/117 [00:01<00:12,  8.63it/s, loss=0.779, v_num=1, val_acc=0.747]
Epoch 62:  10%|█         | 12/117 [00:01<00:11,  9.34it/s, loss=0.779, v_num=1, val_acc=0.747]
Epoch 62:  10%|█         | 12/117 [00:01<00:11,  9.17it/s, loss=0.776, v_num=1, val_acc=0.747]
Epoch 62:  11%|█         | 13/117 [00:01<00:10,  9.86it/s, loss=0.776, v_num=1, val_acc=0.747]
Epoch 62:  11%|█         | 13/117 [00:01<00:10,  9.68it/s, loss=0.786, v_num=1, val_acc=0.747]
Epoch 62:  12%|█▏        | 14/117 [00:01<00:09, 10.35it/s, loss=0.786, v_num=1, val_acc=0.747]
Epoch 62:  12%|█▏        | 14/117 [00:01<00:10, 10.16it/s, loss=0.786, v_num=1, val_acc=0.747]
Epoch 62:  13%|█▎        | 15/117 [00:01<00:09, 10.82it/s, loss=0.786, v_num=1, val_acc=0.747]
Epoch 62:  13%|█▎        | 15/117 [00:01<00:09, 10.62it/s, loss=0.783, v_num=1, val_acc=0.747]
Epoch 62:  14%|█▎        | 16/117 [00:01<00:08, 11.26it/s, loss=0.783, v_num=1, val_acc=0.747]
Epoch 62:  14%|█▎        | 16/117 [00:01<00:09, 11.07it/s, loss=0.787, v_num=1, val_acc=0.747]
Epoch 62:  15%|█▍        | 17/117 [00:01<00:08, 11.68it/s, loss=0.787, v_num=1, val_acc=0.747]
Epoch 62:  15%|█▍        | 17/117 [00:01<00:08, 11.48it/s, loss=0.779, v_num=1, val_acc=0.747]
Epoch 62:  15%|█▌        | 18/117 [00:01<00:08, 12.08it/s, loss=0.779, v_num=1, val_acc=0.747]
Epoch 62:  15%|█▌        | 18/117 [00:01<00:08, 11.88it/s, loss=0.779, v_num=1, val_acc=0.747]
Epoch 62:  16%|█▌        | 19/117 [00:01<00:07, 12.42it/s, loss=0.779, v_num=1, val_acc=0.747]
Epoch 62:  16%|█▌        | 19/117 [00:01<00:08, 12.24it/s, loss=0.782, v_num=1, val_acc=0.747]
Epoch 62:  17%|█▋        | 20/117 [00:01<00:07, 12.77it/s, loss=0.782, v_num=1, val_acc=0.747]
Epoch 62:  17%|█▋        | 20/117 [00:01<00:07, 12.57it/s, loss=0.779, v_num=1, val_acc=0.747]
Epoch 62:  18%|█▊        | 21/117 [00:01<00:07, 13.13it/s, loss=0.779, v_num=1, val_acc=0.747]
Epoch 62:  18%|█▊        | 21/117 [00:01<00:07, 12.92it/s, loss=0.78, v_num=1, val_acc=0.747]
Epoch 62:  19%|█▉        | 22/117 [00:01<00:07, 13.46it/s, loss=0.78, v_num=1, val_acc=0.747]
Epoch 62:  19%|█▉        | 22/117 [00:01<00:07, 13.26it/s, loss=0.785, v_num=1, val_acc=0.747]
Epoch 62:  20%|█▉        | 23/117 [00:01<00:06, 13.74it/s, loss=0.785, v_num=1, val_acc=0.747]
Epoch 62:  20%|█▉        | 23/117 [00:01<00:06, 13.55it/s, loss=0.788, v_num=1, val_acc=0.747]
Epoch 62:  21%|██        | 24/117 [00:01<00:06, 14.07it/s, loss=0.788, v_num=1, val_acc=0.747]
Epoch 62:  21%|██        | 24/117 [00:01<00:06, 13.86it/s, loss=0.792, v_num=1, val_acc=0.747]
Epoch 62:  21%|██▏       | 25/117 [00:01<00:06, 14.36it/s, loss=0.792, v_num=1, val_acc=0.747]
Epoch 62:  21%|██▏       | 25/117 [00:01<00:06, 14.16it/s, loss=0.793, v_num=1, val_acc=0.747]
Epoch 62:  22%|██▏       | 26/117 [00:01<00:06, 14.65it/s, loss=0.793, v_num=1, val_acc=0.747]
Epoch 62:  22%|██▏       | 26/117 [00:01<00:06, 14.44it/s, loss=0.791, v_num=1, val_acc=0.747]
Epoch 62:  23%|██▎       | 27/117 [00:01<00:06, 14.92it/s, loss=0.791, v_num=1, val_acc=0.747]
Epoch 62:  23%|██▎       | 27/117 [00:01<00:06, 14.72it/s, loss=0.796, v_num=1, val_acc=0.747]
Epoch 62:  24%|██▍       | 28/117 [00:01<00:05, 15.17it/s, loss=0.796, v_num=1, val_acc=0.747]
Epoch 62:  24%|██▍       | 28/117 [00:01<00:05, 14.97it/s, loss=0.802, v_num=1, val_acc=0.747]
Epoch 62:  25%|██▍       | 29/117 [00:01<00:05, 15.43it/s, loss=0.802, v_num=1, val_acc=0.747]
Epoch 62:  25%|██▍       | 29/117 [00:01<00:05, 15.23it/s, loss=0.806, v_num=1, val_acc=0.747]
Epoch 62:  26%|██▌       | 30/117 [00:01<00:05, 15.68it/s, loss=0.806, v_num=1, val_acc=0.747]
Epoch 62:  26%|██▌       | 30/117 [00:01<00:05, 15.47it/s, loss=0.807, v_num=1, val_acc=0.747]
Epoch 62:  26%|██▋       | 31/117 [00:01<00:05, 15.91it/s, loss=0.807, v_num=1, val_acc=0.747]
Epoch 62:  26%|██▋       | 31/117 [00:01<00:05, 15.71it/s, loss=0.805, v_num=1, val_acc=0.747]
Epoch 62:  27%|██▋       | 32/117 [00:01<00:05, 16.14it/s, loss=0.805, v_num=1, val_acc=0.747]
Epoch 62:  27%|██▋       | 32/117 [00:02<00:05, 15.94it/s, loss=0.797, v_num=1, val_acc=0.747]
Epoch 62:  28%|██▊       | 33/117 [00:02<00:05, 16.36it/s, loss=0.797, v_num=1, val_acc=0.747]
Epoch 62:  28%|██▊       | 33/117 [00:02<00:05, 16.16it/s, loss=0.782, v_num=1, val_acc=0.747]
Epoch 62:  29%|██▉       | 34/117 [00:02<00:05, 16.57it/s, loss=0.782, v_num=1, val_acc=0.747]
Epoch 62:  29%|██▉       | 34/117 [00:02<00:05, 16.37it/s, loss=0.773, v_num=1, val_acc=0.747]
Epoch 62:  30%|██▉       | 35/117 [00:02<00:04, 16.78it/s, loss=0.773, v_num=1, val_acc=0.747]
Epoch 62:  30%|██▉       | 35/117 [00:02<00:04, 16.58it/s, loss=0.779, v_num=1, val_acc=0.747]
Epoch 62:  31%|███       | 36/117 [00:02<00:04, 16.98it/s, loss=0.779, v_num=1, val_acc=0.747]
Epoch 62:  31%|███       | 36/117 [00:02<00:04, 16.78it/s, loss=0.787, v_num=1, val_acc=0.747]
Epoch 62:  32%|███▏      | 37/117 [00:02<00:04, 17.16it/s, loss=0.787, v_num=1, val_acc=0.747]
Epoch 62:  32%|███▏      | 37/117 [00:02<00:04, 16.96it/s, loss=0.802, v_num=1, val_acc=0.747]
Epoch 62:  32%|███▏      | 38/117 [00:02<00:04, 17.35it/s, loss=0.802, v_num=1, val_acc=0.747]
Epoch 62:  32%|███▏      | 38/117 [00:02<00:04, 17.15it/s, loss=0.807, v_num=1, val_acc=0.747]
Epoch 62:  33%|███▎      | 39/117 [00:02<00:04, 17.53it/s, loss=0.807, v_num=1, val_acc=0.747]
Epoch 62:  33%|███▎      | 39/117 [00:02<00:04, 17.33it/s, loss=0.81, v_num=1, val_acc=0.747]
Epoch 62:  34%|███▍      | 40/117 [00:02<00:04, 17.70it/s, loss=0.81, v_num=1, val_acc=0.747]
Epoch 62:  34%|███▍      | 40/117 [00:02<00:04, 17.51it/s, loss=0.809, v_num=1, val_acc=0.747]
Epoch 62:  35%|███▌      | 41/117 [00:02<00:04, 17.87it/s, loss=0.809, v_num=1, val_acc=0.747]
Epoch 62:  35%|███▌      | 41/117 [00:02<00:04, 17.68it/s, loss=0.806, v_num=1, val_acc=0.747]
Epoch 62:  36%|███▌      | 42/117 [00:02<00:04, 18.04it/s, loss=0.806, v_num=1, val_acc=0.747]
Epoch 62:  36%|███▌      | 42/117 [00:02<00:04, 17.84it/s, loss=0.807, v_num=1, val_acc=0.747]
Epoch 62:  37%|███▋      | 43/117 [00:02<00:04, 18.20it/s, loss=0.807, v_num=1, val_acc=0.747]
Epoch 62:  37%|███▋      | 43/117 [00:02<00:04, 18.00it/s, loss=0.807, v_num=1, val_acc=0.747]
Epoch 62:  38%|███▊      | 44/117 [00:02<00:03, 18.35it/s, loss=0.807, v_num=1, val_acc=0.747]
Epoch 62:  38%|███▊      | 44/117 [00:02<00:04, 18.16it/s, loss=0.806, v_num=1, val_acc=0.747]
Epoch 62:  38%|███▊      | 45/117 [00:02<00:03, 18.50it/s, loss=0.806, v_num=1, val_acc=0.747]
Epoch 62:  38%|███▊      | 45/117 [00:02<00:03, 18.31it/s, loss=0.803, v_num=1, val_acc=0.747]
Epoch 62:  39%|███▉      | 46/117 [00:02<00:03, 18.65it/s, loss=0.803, v_num=1, val_acc=0.747]
Epoch 62:  39%|███▉      | 46/117 [00:02<00:03, 18.46it/s, loss=0.796, v_num=1, val_acc=0.747]
Epoch 62:  40%|████      | 47/117 [00:02<00:03, 18.79it/s, loss=0.796, v_num=1, val_acc=0.747]
Epoch 62:  40%|████      | 47/117 [00:02<00:03, 18.60it/s, loss=0.796, v_num=1, val_acc=0.747]
Epoch 62:  41%|████      | 48/117 [00:02<00:03, 18.93it/s, loss=0.796, v_num=1, val_acc=0.747]
Epoch 62:  41%|████      | 48/117 [00:02<00:03, 18.74it/s, loss=0.793, v_num=1, val_acc=0.747]
Epoch 62:  42%|████▏     | 49/117 [00:02<00:03, 19.07it/s, loss=0.793, v_num=1, val_acc=0.747]
Epoch 62:  42%|████▏     | 49/117 [00:02<00:03, 18.88it/s, loss=0.788, v_num=1, val_acc=0.747]
Epoch 62:  43%|████▎     | 50/117 [00:02<00:03, 19.20it/s, loss=0.788, v_num=1, val_acc=0.747]
Epoch 62:  43%|████▎     | 50/117 [00:02<00:03, 19.01it/s, loss=0.787, v_num=1, val_acc=0.747]
Epoch 62:  44%|████▎     | 51/117 [00:02<00:03, 19.33it/s, loss=0.787, v_num=1, val_acc=0.747]
Epoch 62:  44%|████▎     | 51/117 [00:02<00:03, 19.14it/s, loss=0.782, v_num=1, val_acc=0.747]
Epoch 62:  44%|████▍     | 52/117 [00:02<00:03, 19.44it/s, loss=0.782, v_num=1, val_acc=0.747]
Epoch 62:  44%|████▍     | 52/117 [00:02<00:03, 19.26it/s, loss=0.792, v_num=1, val_acc=0.747]
Epoch 62:  45%|████▌     | 53/117 [00:02<00:03, 19.53it/s, loss=0.792, v_num=1, val_acc=0.747]
Epoch 62:  45%|████▌     | 53/117 [00:02<00:03, 19.36it/s, loss=0.794, v_num=1, val_acc=0.747]
Epoch 62:  46%|████▌     | 54/117 [00:02<00:03, 19.65it/s, loss=0.794, v_num=1, val_acc=0.747]
Epoch 62:  46%|████▌     | 54/117 [00:02<00:03, 19.47it/s, loss=0.799, v_num=1, val_acc=0.747]
Epoch 62:  47%|████▋     | 55/117 [00:02<00:03, 19.76it/s, loss=0.799, v_num=1, val_acc=0.747]
Epoch 62:  47%|████▋     | 55/117 [00:02<00:03, 19.58it/s, loss=0.793, v_num=1, val_acc=0.747]
Epoch 62:  48%|████▊     | 56/117 [00:02<00:03, 19.87it/s, loss=0.793, v_num=1, val_acc=0.747]
Epoch 62:  48%|████▊     | 56/117 [00:02<00:03, 19.70it/s, loss=0.784, v_num=1, val_acc=0.747]
Epoch 62:  49%|████▊     | 57/117 [00:02<00:03, 19.98it/s, loss=0.784, v_num=1, val_acc=0.747]
Epoch 62:  49%|████▊     | 57/117 [00:02<00:03, 19.81it/s, loss=0.771, v_num=1, val_acc=0.747]
Epoch 62:  50%|████▉     | 58/117 [00:02<00:02, 20.09it/s, loss=0.771, v_num=1, val_acc=0.747]
Epoch 62:  50%|████▉     | 58/117 [00:02<00:02, 19.91it/s, loss=0.765, v_num=1, val_acc=0.747]
Epoch 62:  50%|█████     | 59/117 [00:02<00:02, 20.19it/s, loss=0.765, v_num=1, val_acc=0.747]
Epoch 62:  50%|█████     | 59/117 [00:02<00:02, 20.02it/s, loss=0.761, v_num=1, val_acc=0.747]
Epoch 62:  51%|█████▏    | 60/117 [00:02<00:02, 20.29it/s, loss=0.761, v_num=1, val_acc=0.747]
Epoch 62:  51%|█████▏    | 60/117 [00:02<00:02, 20.12it/s, loss=0.761, v_num=1, val_acc=0.747]
Epoch 62:  52%|█████▏    | 61/117 [00:02<00:02, 20.39it/s, loss=0.761, v_num=1, val_acc=0.747]
Epoch 62:  52%|█████▏    | 61/117 [00:03<00:02, 20.22it/s, loss=0.762, v_num=1, val_acc=0.747]
Epoch 62:  53%|█████▎    | 62/117 [00:03<00:02, 20.48it/s, loss=0.762, v_num=1, val_acc=0.747]
Epoch 62:  53%|█████▎    | 62/117 [00:03<00:02, 20.31it/s, loss=0.758, v_num=1, val_acc=0.747]
Epoch 62:  54%|█████▍    | 63/117 [00:03<00:02, 20.58it/s, loss=0.758, v_num=1, val_acc=0.747]
Epoch 62:  54%|█████▍    | 63/117 [00:03<00:02, 20.41it/s, loss=0.758, v_num=1, val_acc=0.747]
Epoch 62:  55%|█████▍    | 64/117 [00:03<00:02, 20.67it/s, loss=0.758, v_num=1, val_acc=0.747]
Epoch 62:  55%|█████▍    | 64/117 [00:03<00:02, 20.51it/s, loss=0.76, v_num=1, val_acc=0.747]
Epoch 62:  56%|█████▌    | 65/117 [00:03<00:02, 20.76it/s, loss=0.76, v_num=1, val_acc=0.747]
Epoch 62:  56%|█████▌    | 65/117 [00:03<00:02, 20.60it/s, loss=0.772, v_num=1, val_acc=0.747]
Epoch 62:  56%|█████▋    | 66/117 [00:03<00:02, 20.85it/s, loss=0.772, v_num=1, val_acc=0.747]
Epoch 62:  56%|█████▋    | 66/117 [00:03<00:02, 20.69it/s, loss=0.777, v_num=1, val_acc=0.747]
Epoch 62:  57%|█████▋    | 67/117 [00:03<00:02, 20.94it/s, loss=0.777, v_num=1, val_acc=0.747]
Epoch 62:  57%|█████▋    | 67/117 [00:03<00:02, 20.77it/s, loss=0.779, v_num=1, val_acc=0.747]
Epoch 62:  58%|█████▊    | 68/117 [00:03<00:02, 21.02it/s, loss=0.779, v_num=1, val_acc=0.747]
Epoch 62:  58%|█████▊    | 68/117 [00:03<00:02, 20.86it/s, loss=0.778, v_num=1, val_acc=0.747]
Epoch 62:  59%|█████▉    | 69/117 [00:03<00:02, 21.11it/s, loss=0.778, v_num=1, val_acc=0.747]
Epoch 62:  59%|█████▉    | 69/117 [00:03<00:02, 20.95it/s, loss=0.776, v_num=1, val_acc=0.747]
Epoch 62:  60%|█████▉    | 70/117 [00:03<00:02, 21.19it/s, loss=0.776, v_num=1, val_acc=0.747]
Epoch 62:  60%|█████▉    | 70/117 [00:03<00:02, 21.03it/s, loss=0.774, v_num=1, val_acc=0.747]
Epoch 62:  61%|██████    | 71/117 [00:03<00:02, 21.27it/s, loss=0.774, v_num=1, val_acc=0.747]
Epoch 62:  61%|██████    | 71/117 [00:03<00:02, 21.11it/s, loss=0.775, v_num=1, val_acc=0.747]
Epoch 62:  62%|██████▏   | 72/117 [00:03<00:02, 21.35it/s, loss=0.775, v_num=1, val_acc=0.747]
Epoch 62:  62%|██████▏   | 72/117 [00:03<00:02, 21.19it/s, loss=0.768, v_num=1, val_acc=0.747]
Epoch 62:  62%|██████▏   | 73/117 [00:03<00:02, 21.43it/s, loss=0.768, v_num=1, val_acc=0.747]
Epoch 62:  62%|██████▏   | 73/117 [00:03<00:02, 21.27it/s, loss=0.762, v_num=1, val_acc=0.747]
Epoch 62:  63%|██████▎   | 74/117 [00:03<00:01, 21.50it/s, loss=0.762, v_num=1, val_acc=0.747]
Epoch 62:  63%|██████▎   | 74/117 [00:03<00:02, 21.35it/s, loss=0.758, v_num=1, val_acc=0.747]
Epoch 62:  64%|██████▍   | 75/117 [00:03<00:01, 21.58it/s, loss=0.758, v_num=1, val_acc=0.747]
Epoch 62:  64%|██████▍   | 75/117 [00:03<00:01, 21.42it/s, loss=0.761, v_num=1, val_acc=0.747]
Epoch 62:  65%|██████▍   | 76/117 [00:03<00:01, 21.65it/s, loss=0.761, v_num=1, val_acc=0.747]
Epoch 62:  65%|██████▍   | 76/117 [00:03<00:01, 21.49it/s, loss=0.761, v_num=1, val_acc=0.747]
Epoch 62:  66%|██████▌   | 77/117 [00:03<00:01, 21.72it/s, loss=0.761, v_num=1, val_acc=0.747]
Epoch 62:  66%|██████▌   | 77/117 [00:03<00:01, 21.57it/s, loss=0.761, v_num=1, val_acc=0.747]
Epoch 62:  67%|██████▋   | 78/117 [00:03<00:01, 21.79it/s, loss=0.761, v_num=1, val_acc=0.747]
Epoch 62:  67%|██████▋   | 78/117 [00:03<00:01, 21.64it/s, loss=0.758, v_num=1, val_acc=0.747]
Epoch 62:  68%|██████▊   | 79/117 [00:03<00:01, 21.86it/s, loss=0.758, v_num=1, val_acc=0.747]
Epoch 62:  68%|██████▊   | 79/117 [00:03<00:01, 21.71it/s, loss=0.754, v_num=1, val_acc=0.747]
Epoch 62:  68%|██████▊   | 80/117 [00:03<00:01, 21.93it/s, loss=0.754, v_num=1, val_acc=0.747]
Epoch 62:  68%|██████▊   | 80/117 [00:03<00:01, 21.78it/s, loss=0.758, v_num=1, val_acc=0.747]
Epoch 62:  69%|██████▉   | 81/117 [00:03<00:01, 21.99it/s, loss=0.758, v_num=1, val_acc=0.747]
Epoch 62:  69%|██████▉   | 81/117 [00:03<00:01, 21.84it/s, loss=0.759, v_num=1, val_acc=0.747]
Epoch 62:  70%|███████   | 82/117 [00:03<00:01, 22.04it/s, loss=0.759, v_num=1, val_acc=0.747]
Epoch 62:  70%|███████   | 82/117 [00:03<00:01, 21.89it/s, loss=0.759, v_num=1, val_acc=0.747]
Epoch 62:  71%|███████   | 83/117 [00:03<00:01, 22.11it/s, loss=0.759, v_num=1, val_acc=0.747]
Epoch 62:  71%|███████   | 83/117 [00:03<00:01, 21.96it/s, loss=0.762, v_num=1, val_acc=0.747]
Epoch 62:  72%|███████▏  | 84/117 [00:03<00:01, 22.17it/s, loss=0.762, v_num=1, val_acc=0.747]
Epoch 62:  72%|███████▏  | 84/117 [00:03<00:01, 22.02it/s, loss=0.759, v_num=1, val_acc=0.747]
Epoch 62:  73%|███████▎  | 85/117 [00:03<00:01, 22.21it/s, loss=0.759, v_num=1, val_acc=0.747]
Epoch 62:  73%|███████▎  | 85/117 [00:03<00:01, 22.08it/s, loss=0.754, v_num=1, val_acc=0.747]
Epoch 62:  74%|███████▎  | 86/117 [00:03<00:01, 22.28it/s, loss=0.754, v_num=1, val_acc=0.747]
Epoch 62:  74%|███████▎  | 86/117 [00:03<00:01, 22.14it/s, loss=0.761, v_num=1, val_acc=0.747]
Epoch 62:  74%|███████▍  | 87/117 [00:03<00:01, 22.34it/s, loss=0.761, v_num=1, val_acc=0.747]
Epoch 62:  74%|███████▍  | 87/117 [00:03<00:01, 22.20it/s, loss=0.764, v_num=1, val_acc=0.747]
Epoch 62:  75%|███████▌  | 88/117 [00:03<00:01, 22.40it/s, loss=0.764, v_num=1, val_acc=0.747]
Epoch 62:  75%|███████▌  | 88/117 [00:03<00:01, 22.26it/s, loss=0.779, v_num=1, val_acc=0.747]
Epoch 62:  76%|███████▌  | 89/117 [00:03<00:01, 22.46it/s, loss=0.779, v_num=1, val_acc=0.747]
Epoch 62:  76%|███████▌  | 89/117 [00:03<00:01, 22.32it/s, loss=0.783, v_num=1, val_acc=0.747]
Epoch 62:  77%|███████▋  | 90/117 [00:03<00:01, 22.52it/s, loss=0.783, v_num=1, val_acc=0.747]
Epoch 62:  77%|███████▋  | 90/117 [00:04<00:01, 22.37it/s, loss=0.786, v_num=1, val_acc=0.747]
Epoch 62:  78%|███████▊  | 91/117 [00:04<00:01, 22.57it/s, loss=0.786, v_num=1, val_acc=0.747]
Epoch 62:  78%|███████▊  | 91/117 [00:04<00:01, 22.43it/s, loss=0.791, v_num=1, val_acc=0.747]
Epoch 62:  79%|███████▊  | 92/117 [00:04<00:01, 22.62it/s, loss=0.791, v_num=1, val_acc=0.747]
Epoch 62:  79%|███████▊  | 92/117 [00:04<00:01, 22.48it/s, loss=0.797, v_num=1, val_acc=0.747]
Epoch 62:  79%|███████▉  | 93/117 [00:04<00:01, 22.68it/s, loss=0.797, v_num=1, val_acc=0.747]
Epoch 62:  79%|███████▉  | 93/117 [00:04<00:01, 22.54it/s, loss=0.806, v_num=1, val_acc=0.747]
Epoch 62:  80%|████████  | 94/117 [00:04<00:01, 22.73it/s, loss=0.806, v_num=1, val_acc=0.747]
Epoch 62:  80%|████████  | 94/117 [00:04<00:01, 22.59it/s, loss=0.809, v_num=1, val_acc=0.747]
Epoch 62:  81%|████████  | 95/117 [00:04<00:00, 22.78it/s, loss=0.809, v_num=1, val_acc=0.747]
Epoch 62:  81%|████████  | 95/117 [00:04<00:00, 22.65it/s, loss=0.807, v_num=1, val_acc=0.747]
Epoch 62:  82%|████████▏ | 96/117 [00:04<00:00, 22.84it/s, loss=0.807, v_num=1, val_acc=0.747]
Epoch 62:  82%|████████▏ | 96/117 [00:04<00:00, 22.70it/s, loss=0.807, v_num=1, val_acc=0.747]
Epoch 62:  83%|████████▎ | 97/117 [00:04<00:00, 22.89it/s, loss=0.807, v_num=1, val_acc=0.747]
Epoch 62:  83%|████████▎ | 97/117 [00:04<00:00, 22.75it/s, loss=0.808, v_num=1, val_acc=0.747]

Validation: 0it [00:00, ?it/s]

Validation:   0%|          | 0/20 [00:00<?, ?it/s]

Validation DataLoader 0:   0%|          | 0/20 [00:00<?, ?it/s]

Validation DataLoader 0:   5%|▌         | 1/20 [00:00<00:00, 127.24it/s]
Epoch 62:  84%|████████▍ | 98/117 [00:05<00:00, 19.15it/s, loss=0.808, v_num=1, val_acc=0.747]

Validation DataLoader 0:  10%|█         | 2/20 [00:00<00:00, 54.48it/s]
Epoch 62:  85%|████████▍ | 99/117 [00:05<00:00, 19.24it/s, loss=0.808, v_num=1, val_acc=0.747]

Validation DataLoader 0:  15%|█▌        | 3/20 [00:00<00:00, 43.93it/s]
Epoch 62:  85%|████████▌ | 100/117 [00:05<00:00, 19.31it/s, loss=0.808, v_num=1, val_acc=0.747]

Validation DataLoader 0:  20%|██        | 4/20 [00:00<00:00, 39.66it/s]
Epoch 62:  86%|████████▋ | 101/117 [00:05<00:00, 19.38it/s, loss=0.808, v_num=1, val_acc=0.747]

Validation DataLoader 0:  25%|██▌       | 5/20 [00:00<00:00, 37.87it/s]
Epoch 62:  87%|████████▋ | 102/117 [00:05<00:00, 19.46it/s, loss=0.808, v_num=1, val_acc=0.747]

Validation DataLoader 0:  30%|███       | 6/20 [00:00<00:00, 36.65it/s]
Epoch 62:  88%|████████▊ | 103/117 [00:05<00:00, 19.53it/s, loss=0.808, v_num=1, val_acc=0.747]

Validation DataLoader 0:  35%|███▌      | 7/20 [00:00<00:00, 35.89it/s]
Epoch 62:  89%|████████▉ | 104/117 [00:05<00:00, 19.60it/s, loss=0.808, v_num=1, val_acc=0.747]

Validation DataLoader 0:  40%|████      | 8/20 [00:00<00:00, 35.29it/s]
Epoch 62:  90%|████████▉ | 105/117 [00:05<00:00, 19.68it/s, loss=0.808, v_num=1, val_acc=0.747]

Validation DataLoader 0:  45%|████▌     | 9/20 [00:00<00:00, 34.83it/s]
Epoch 62:  91%|█████████ | 106/117 [00:05<00:00, 19.75it/s, loss=0.808, v_num=1, val_acc=0.747]

Validation DataLoader 0:  50%|█████     | 10/20 [00:00<00:00, 34.50it/s]
Epoch 62:  91%|█████████▏| 107/117 [00:05<00:00, 19.82it/s, loss=0.808, v_num=1, val_acc=0.747]

Validation DataLoader 0:  55%|█████▌    | 11/20 [00:00<00:00, 34.24it/s]
Epoch 62:  92%|█████████▏| 108/117 [00:05<00:00, 19.88it/s, loss=0.808, v_num=1, val_acc=0.747]

Validation DataLoader 0:  60%|██████    | 12/20 [00:00<00:00, 34.01it/s]
Epoch 62:  93%|█████████▎| 109/117 [00:05<00:00, 19.95it/s, loss=0.808, v_num=1, val_acc=0.747]

Validation DataLoader 0:  65%|██████▌   | 13/20 [00:00<00:00, 33.79it/s]
Epoch 62:  94%|█████████▍| 110/117 [00:05<00:00, 20.02it/s, loss=0.808, v_num=1, val_acc=0.747]

Validation DataLoader 0:  70%|███████   | 14/20 [00:00<00:00, 33.64it/s]
Epoch 62:  95%|█████████▍| 111/117 [00:05<00:00, 20.09it/s, loss=0.808, v_num=1, val_acc=0.747]

Validation DataLoader 0:  75%|███████▌  | 15/20 [00:00<00:00, 33.50it/s]
Epoch 62:  96%|█████████▌| 112/117 [00:05<00:00, 20.15it/s, loss=0.808, v_num=1, val_acc=0.747]

Validation DataLoader 0:  80%|████████  | 16/20 [00:00<00:00, 33.36it/s]
Epoch 62:  97%|█████████▋| 113/117 [00:05<00:00, 20.22it/s, loss=0.808, v_num=1, val_acc=0.747]

Validation DataLoader 0:  85%|████████▌ | 17/20 [00:00<00:00, 33.23it/s]
Epoch 62:  97%|█████████▋| 114/117 [00:05<00:00, 20.28it/s, loss=0.808, v_num=1, val_acc=0.747]

Validation DataLoader 0:  90%|█████████ | 18/20 [00:00<00:00, 33.15it/s]
Epoch 62:  98%|█████████▊| 115/117 [00:05<00:00, 20.34it/s, loss=0.808, v_num=1, val_acc=0.747]

Validation DataLoader 0:  95%|█████████▌| 19/20 [00:00<00:00, 33.06it/s]
Epoch 62:  99%|█████████▉| 116/117 [00:05<00:00, 20.41it/s, loss=0.808, v_num=1, val_acc=0.747]

Validation DataLoader 0: 100%|██████████| 20/20 [00:00<00:00, 33.06it/s]
Epoch 62: 100%|██████████| 117/117 [00:05<00:00, 20.47it/s, loss=0.808, v_num=1, val_acc=0.747]
Epoch 62: 100%|██████████| 117/117 [00:05<00:00, 20.40it/s, loss=0.808, v_num=1, val_acc=0.756]


Epoch 62: 100%|██████████| 117/117 [00:05<00:00, 20.40it/s, loss=0.808, v_num=1, val_acc=0.756]
Epoch 62:   0%|          | 0/117 [00:00<?, ?it/s, loss=0.808, v_num=1, val_acc=0.756]
Epoch 63:   0%|          | 0/117 [00:00<?, ?it/s, loss=0.808, v_num=1, val_acc=0.756]
Epoch 63:   1%|          | 1/117 [00:00<01:45,  1.10it/s, loss=0.808, v_num=1, val_acc=0.756]
Epoch 63:   1%|          | 1/117 [00:00<01:48,  1.07it/s, loss=0.81, v_num=1, val_acc=0.756]
Epoch 63:   2%|▏         | 2/117 [00:00<00:54,  2.12it/s, loss=0.81, v_num=1, val_acc=0.756]
Epoch 63:   2%|▏         | 2/117 [00:00<00:55,  2.06it/s, loss=0.812, v_num=1, val_acc=0.756]
Epoch 63:   3%|▎         | 3/117 [00:00<00:37,  3.05it/s, loss=0.812, v_num=1, val_acc=0.756]
Epoch 63:   3%|▎         | 3/117 [00:01<00:38,  2.98it/s, loss=0.813, v_num=1, val_acc=0.756]
Epoch 63:   3%|▎         | 4/117 [00:01<00:28,  3.92it/s, loss=0.813, v_num=1, val_acc=0.756]
Epoch 63:   3%|▎         | 4/117 [00:01<00:29,  3.83it/s, loss=0.814, v_num=1, val_acc=0.756]
Epoch 63:   4%|▍         | 5/117 [00:01<00:23,  4.75it/s, loss=0.814, v_num=1, val_acc=0.756]
Epoch 63:   4%|▍         | 5/117 [00:01<00:24,  4.64it/s, loss=0.811, v_num=1, val_acc=0.756]
Epoch 63:   5%|▌         | 6/117 [00:01<00:20,  5.52it/s, loss=0.811, v_num=1, val_acc=0.756]
Epoch 63:   5%|▌         | 6/117 [00:01<00:20,  5.40it/s, loss=0.806, v_num=1, val_acc=0.756]
Epoch 63:   6%|▌         | 7/117 [00:01<00:17,  6.25it/s, loss=0.806, v_num=1, val_acc=0.756]
Epoch 63:   6%|▌         | 7/117 [00:01<00:18,  6.11it/s, loss=0.805, v_num=1, val_acc=0.756]
Epoch 63:   7%|▋         | 8/117 [00:01<00:15,  6.93it/s, loss=0.805, v_num=1, val_acc=0.756]
Epoch 63:   7%|▋         | 8/117 [00:01<00:16,  6.78it/s, loss=0.802, v_num=1, val_acc=0.756]
Epoch 63:   8%|▊         | 9/117 [00:01<00:14,  7.55it/s, loss=0.802, v_num=1, val_acc=0.756]
Epoch 63:   8%|▊         | 9/117 [00:01<00:14,  7.39it/s, loss=0.794, v_num=1, val_acc=0.756]
Epoch 63:   9%|▊         | 10/117 [00:01<00:13,  8.15it/s, loss=0.794, v_num=1, val_acc=0.756]
Epoch 63:   9%|▊         | 10/117 [00:01<00:13,  7.99it/s, loss=0.786, v_num=1, val_acc=0.756]
Epoch 63:   9%|▉         | 11/117 [00:01<00:12,  8.73it/s, loss=0.786, v_num=1, val_acc=0.756]
Epoch 63:   9%|▉         | 11/117 [00:01<00:12,  8.56it/s, loss=0.764, v_num=1, val_acc=0.756]
Epoch 63:  10%|█         | 12/117 [00:01<00:11,  9.26it/s, loss=0.764, v_num=1, val_acc=0.756]
Epoch 63:  10%|█         | 12/117 [00:01<00:11,  9.08it/s, loss=0.769, v_num=1, val_acc=0.756]
Epoch 63:  11%|█         | 13/117 [00:01<00:10,  9.78it/s, loss=0.769, v_num=1, val_acc=0.756]
Epoch 63:  11%|█         | 13/117 [00:01<00:10,  9.59it/s, loss=0.762, v_num=1, val_acc=0.756]
Epoch 63:  12%|█▏        | 14/117 [00:01<00:10, 10.27it/s, loss=0.762, v_num=1, val_acc=0.756]
Epoch 63:  12%|█▏        | 14/117 [00:01<00:10, 10.08it/s, loss=0.76, v_num=1, val_acc=0.756]
Epoch 63:  13%|█▎        | 15/117 [00:01<00:09, 10.73it/s, loss=0.76, v_num=1, val_acc=0.756]
Epoch 63:  13%|█▎        | 15/117 [00:01<00:09, 10.54it/s, loss=0.753, v_num=1, val_acc=0.756]
Epoch 63:  14%|█▎        | 16/117 [00:01<00:09, 11.17it/s, loss=0.753, v_num=1, val_acc=0.756]
Epoch 63:  14%|█▎        | 16/117 [00:01<00:09, 10.98it/s, loss=0.744, v_num=1, val_acc=0.756]
Epoch 63:  15%|█▍        | 17/117 [00:01<00:08, 11.58it/s, loss=0.744, v_num=1, val_acc=0.756]
Epoch 63:  15%|█▍        | 17/117 [00:01<00:08, 11.38it/s, loss=0.741, v_num=1, val_acc=0.756]
Epoch 63:  15%|█▌        | 18/117 [00:01<00:08, 11.98it/s, loss=0.741, v_num=1, val_acc=0.756]
Epoch 63:  15%|█▌        | 18/117 [00:01<00:08, 11.79it/s, loss=0.744, v_num=1, val_acc=0.756]
Epoch 63:  16%|█▌        | 19/117 [00:01<00:07, 12.37it/s, loss=0.744, v_num=1, val_acc=0.756]
Epoch 63:  16%|█▌        | 19/117 [00:01<00:08, 12.17it/s, loss=0.742, v_num=1, val_acc=0.756]
Epoch 63:  17%|█▋        | 20/117 [00:01<00:07, 12.73it/s, loss=0.742, v_num=1, val_acc=0.756]
Epoch 63:  17%|█▋        | 20/117 [00:01<00:07, 12.53it/s, loss=0.751, v_num=1, val_acc=0.756]
Epoch 63:  18%|█▊        | 21/117 [00:01<00:07, 13.09it/s, loss=0.751, v_num=1, val_acc=0.756]
Epoch 63:  18%|█▊        | 21/117 [00:01<00:07, 12.88it/s, loss=0.749, v_num=1, val_acc=0.756]
Epoch 63:  19%|█▉        | 22/117 [00:01<00:07, 13.42it/s, loss=0.749, v_num=1, val_acc=0.756]
Epoch 63:  19%|█▉        | 22/117 [00:01<00:07, 13.21it/s, loss=0.752, v_num=1, val_acc=0.756]
Epoch 63:  20%|█▉        | 23/117 [00:01<00:06, 13.74it/s, loss=0.752, v_num=1, val_acc=0.756]
Epoch 63:  20%|█▉        | 23/117 [00:01<00:06, 13.53it/s, loss=0.749, v_num=1, val_acc=0.756]
Epoch 63:  21%|██        | 24/117 [00:01<00:06, 14.05it/s, loss=0.749, v_num=1, val_acc=0.756]
Epoch 63:  21%|██        | 24/117 [00:01<00:06, 13.84it/s, loss=0.75, v_num=1, val_acc=0.756]
Epoch 63:  21%|██▏       | 25/117 [00:01<00:06, 14.34it/s, loss=0.75, v_num=1, val_acc=0.756]
Epoch 63:  21%|██▏       | 25/117 [00:01<00:06, 14.14it/s, loss=0.754, v_num=1, val_acc=0.756]
Epoch 63:  22%|██▏       | 26/117 [00:01<00:06, 14.63it/s, loss=0.754, v_num=1, val_acc=0.756]
Epoch 63:  22%|██▏       | 26/117 [00:01<00:06, 14.42it/s, loss=0.76, v_num=1, val_acc=0.756]
Epoch 63:  23%|██▎       | 27/117 [00:01<00:06, 14.90it/s, loss=0.76, v_num=1, val_acc=0.756]
Epoch 63:  23%|██▎       | 27/117 [00:01<00:06, 14.69it/s, loss=0.762, v_num=1, val_acc=0.756]
Epoch 63:  24%|██▍       | 28/117 [00:01<00:05, 15.16it/s, loss=0.762, v_num=1, val_acc=0.756]
Epoch 63:  24%|██▍       | 28/117 [00:01<00:05, 14.96it/s, loss=0.759, v_num=1, val_acc=0.756]
Epoch 63:  25%|██▍       | 29/117 [00:01<00:05, 15.42it/s, loss=0.759, v_num=1, val_acc=0.756]
Epoch 63:  25%|██▍       | 29/117 [00:01<00:05, 15.21it/s, loss=0.756, v_num=1, val_acc=0.756]
Epoch 63:  26%|██▌       | 30/117 [00:01<00:05, 15.66it/s, loss=0.756, v_num=1, val_acc=0.756]
Epoch 63:  26%|██▌       | 30/117 [00:01<00:05, 15.46it/s, loss=0.76, v_num=1, val_acc=0.756]
Epoch 63:  26%|██▋       | 31/117 [00:01<00:05, 15.90it/s, loss=0.76, v_num=1, val_acc=0.756]
Epoch 63:  26%|██▋       | 31/117 [00:01<00:05, 15.69it/s, loss=0.769, v_num=1, val_acc=0.756]
Epoch 63:  27%|██▋       | 32/117 [00:01<00:05, 16.13it/s, loss=0.769, v_num=1, val_acc=0.756]
Epoch 63:  27%|██▋       | 32/117 [00:02<00:05, 15.92it/s, loss=0.768, v_num=1, val_acc=0.756]
Epoch 63:  28%|██▊       | 33/117 [00:02<00:05, 16.35it/s, loss=0.768, v_num=1, val_acc=0.756]
Epoch 63:  28%|██▊       | 33/117 [00:02<00:05, 16.14it/s, loss=0.767, v_num=1, val_acc=0.756]
Epoch 63:  29%|██▉       | 34/117 [00:02<00:05, 16.56it/s, loss=0.767, v_num=1, val_acc=0.756]
Epoch 63:  29%|██▉       | 34/117 [00:02<00:05, 16.36it/s, loss=0.766, v_num=1, val_acc=0.756]
Epoch 63:  30%|██▉       | 35/117 [00:02<00:04, 16.76it/s, loss=0.766, v_num=1, val_acc=0.756]
Epoch 63:  30%|██▉       | 35/117 [00:02<00:04, 16.56it/s, loss=0.77, v_num=1, val_acc=0.756]
Epoch 63:  31%|███       | 36/117 [00:02<00:04, 16.96it/s, loss=0.77, v_num=1, val_acc=0.756]
Epoch 63:  31%|███       | 36/117 [00:02<00:04, 16.76it/s, loss=0.777, v_num=1, val_acc=0.756]
Epoch 63:  32%|███▏      | 37/117 [00:02<00:04, 17.15it/s, loss=0.777, v_num=1, val_acc=0.756]
Epoch 63:  32%|███▏      | 37/117 [00:02<00:04, 16.96it/s, loss=0.784, v_num=1, val_acc=0.756]
Epoch 63:  32%|███▏      | 38/117 [00:02<00:04, 17.34it/s, loss=0.784, v_num=1, val_acc=0.756]
Epoch 63:  32%|███▏      | 38/117 [00:02<00:04, 17.14it/s, loss=0.787, v_num=1, val_acc=0.756]
Epoch 63:  33%|███▎      | 39/117 [00:02<00:04, 17.51it/s, loss=0.787, v_num=1, val_acc=0.756]
Epoch 63:  33%|███▎      | 39/117 [00:02<00:04, 17.32it/s, loss=0.799, v_num=1, val_acc=0.756]
Epoch 63:  34%|███▍      | 40/117 [00:02<00:04, 17.68it/s, loss=0.799, v_num=1, val_acc=0.756]
Epoch 63:  34%|███▍      | 40/117 [00:02<00:04, 17.49it/s, loss=0.788, v_num=1, val_acc=0.756]
Epoch 63:  35%|███▌      | 41/117 [00:02<00:04, 17.85it/s, loss=0.788, v_num=1, val_acc=0.756]
Epoch 63:  35%|███▌      | 41/117 [00:02<00:04, 17.66it/s, loss=0.792, v_num=1, val_acc=0.756]
Epoch 63:  36%|███▌      | 42/117 [00:02<00:04, 18.02it/s, loss=0.792, v_num=1, val_acc=0.756]
Epoch 63:  36%|███▌      | 42/117 [00:02<00:04, 17.82it/s, loss=0.79, v_num=1, val_acc=0.756]
Epoch 63:  37%|███▋      | 43/117 [00:02<00:04, 18.18it/s, loss=0.79, v_num=1, val_acc=0.756]
Epoch 63:  37%|███▋      | 43/117 [00:02<00:04, 17.98it/s, loss=0.792, v_num=1, val_acc=0.756]
Epoch 63:  38%|███▊      | 44/117 [00:02<00:03, 18.30it/s, loss=0.792, v_num=1, val_acc=0.756]
Epoch 63:  38%|███▊      | 44/117 [00:02<00:04, 18.12it/s, loss=0.788, v_num=1, val_acc=0.756]
Epoch 63:  38%|███▊      | 45/117 [00:02<00:03, 18.46it/s, loss=0.788, v_num=1, val_acc=0.756]
Epoch 63:  38%|███▊      | 45/117 [00:02<00:03, 18.27it/s, loss=0.788, v_num=1, val_acc=0.756]
Epoch 63:  39%|███▉      | 46/117 [00:02<00:03, 18.61it/s, loss=0.788, v_num=1, val_acc=0.756]
Epoch 63:  39%|███▉      | 46/117 [00:02<00:03, 18.42it/s, loss=0.783, v_num=1, val_acc=0.756]
Epoch 63:  40%|████      | 47/117 [00:02<00:03, 18.75it/s, loss=0.783, v_num=1, val_acc=0.756]
Epoch 63:  40%|████      | 47/117 [00:02<00:03, 18.57it/s, loss=0.785, v_num=1, val_acc=0.756]
Epoch 63:  41%|████      | 48/117 [00:02<00:03, 18.89it/s, loss=0.785, v_num=1, val_acc=0.756]
Epoch 63:  41%|████      | 48/117 [00:02<00:03, 18.70it/s, loss=0.787, v_num=1, val_acc=0.756]
Epoch 63:  42%|████▏     | 49/117 [00:02<00:03, 19.03it/s, loss=0.787, v_num=1, val_acc=0.756]
Epoch 63:  42%|████▏     | 49/117 [00:02<00:03, 18.84it/s, loss=0.788, v_num=1, val_acc=0.756]
Epoch 63:  43%|████▎     | 50/117 [00:02<00:03, 19.16it/s, loss=0.788, v_num=1, val_acc=0.756]
Epoch 63:  43%|████▎     | 50/117 [00:02<00:03, 18.97it/s, loss=0.792, v_num=1, val_acc=0.756]
Epoch 63:  44%|████▎     | 51/117 [00:02<00:03, 19.29it/s, loss=0.792, v_num=1, val_acc=0.756]
Epoch 63:  44%|████▎     | 51/117 [00:02<00:03, 19.10it/s, loss=0.795, v_num=1, val_acc=0.756]
Epoch 63:  44%|████▍     | 52/117 [00:02<00:03, 19.41it/s, loss=0.795, v_num=1, val_acc=0.756]
Epoch 63:  44%|████▍     | 52/117 [00:02<00:03, 19.23it/s, loss=0.789, v_num=1, val_acc=0.756]
Epoch 63:  45%|████▌     | 53/117 [00:02<00:03, 19.53it/s, loss=0.789, v_num=1, val_acc=0.756]
Epoch 63:  45%|████▌     | 53/117 [00:02<00:03, 19.35it/s, loss=0.793, v_num=1, val_acc=0.756]
Epoch 63:  46%|████▌     | 54/117 [00:02<00:03, 19.65it/s, loss=0.793, v_num=1, val_acc=0.756]
Epoch 63:  46%|████▌     | 54/117 [00:02<00:03, 19.47it/s, loss=0.787, v_num=1, val_acc=0.756]
Epoch 63:  47%|████▋     | 55/117 [00:02<00:03, 19.77it/s, loss=0.787, v_num=1, val_acc=0.756]
Epoch 63:  47%|████▋     | 55/117 [00:02<00:03, 19.59it/s, loss=0.783, v_num=1, val_acc=0.756]
Epoch 63:  48%|████▊     | 56/117 [00:02<00:03, 19.88it/s, loss=0.783, v_num=1, val_acc=0.756]
Epoch 63:  48%|████▊     | 56/117 [00:02<00:03, 19.70it/s, loss=0.782, v_num=1, val_acc=0.756]
Epoch 63:  49%|████▊     | 57/117 [00:02<00:03, 19.98it/s, loss=0.782, v_num=1, val_acc=0.756]
Epoch 63:  49%|████▊     | 57/117 [00:02<00:03, 19.81it/s, loss=0.784, v_num=1, val_acc=0.756]
Epoch 63:  50%|████▉     | 58/117 [00:02<00:02, 20.09it/s, loss=0.784, v_num=1, val_acc=0.756]
Epoch 63:  50%|████▉     | 58/117 [00:02<00:02, 19.91it/s, loss=0.775, v_num=1, val_acc=0.756]
Epoch 63:  50%|█████     | 59/117 [00:02<00:02, 20.19it/s, loss=0.775, v_num=1, val_acc=0.756]
Epoch 63:  50%|█████     | 59/117 [00:02<00:02, 20.02it/s, loss=0.768, v_num=1, val_acc=0.756]
Epoch 63:  51%|█████▏    | 60/117 [00:02<00:02, 20.25it/s, loss=0.768, v_num=1, val_acc=0.756]
Epoch 63:  51%|█████▏    | 60/117 [00:02<00:02, 20.10it/s, loss=0.767, v_num=1, val_acc=0.756]
Epoch 63:  52%|█████▏    | 61/117 [00:02<00:02, 20.37it/s, loss=0.767, v_num=1, val_acc=0.756]
Epoch 63:  52%|█████▏    | 61/117 [00:03<00:02, 20.20it/s, loss=0.769, v_num=1, val_acc=0.756]
Epoch 63:  53%|█████▎    | 62/117 [00:03<00:02, 20.46it/s, loss=0.769, v_num=1, val_acc=0.756]
Epoch 63:  53%|█████▎    | 62/117 [00:03<00:02, 20.30it/s, loss=0.772, v_num=1, val_acc=0.756]
Epoch 63:  54%|█████▍    | 63/117 [00:03<00:02, 20.56it/s, loss=0.772, v_num=1, val_acc=0.756]
Epoch 63:  54%|█████▍    | 63/117 [00:03<00:02, 20.39it/s, loss=0.776, v_num=1, val_acc=0.756]
Epoch 63:  55%|█████▍    | 64/117 [00:03<00:02, 20.66it/s, loss=0.776, v_num=1, val_acc=0.756]
Epoch 63:  55%|█████▍    | 64/117 [00:03<00:02, 20.49it/s, loss=0.778, v_num=1, val_acc=0.756]
Epoch 63:  56%|█████▌    | 65/117 [00:03<00:02, 20.75it/s, loss=0.778, v_num=1, val_acc=0.756]
Epoch 63:  56%|█████▌    | 65/117 [00:03<00:02, 20.58it/s, loss=0.783, v_num=1, val_acc=0.756]
Epoch 63:  56%|█████▋    | 66/117 [00:03<00:02, 20.84it/s, loss=0.783, v_num=1, val_acc=0.756]
Epoch 63:  56%|█████▋    | 66/117 [00:03<00:02, 20.67it/s, loss=0.783, v_num=1, val_acc=0.756]
Epoch 63:  57%|█████▋    | 67/117 [00:03<00:02, 20.92it/s, loss=0.783, v_num=1, val_acc=0.756]
Epoch 63:  57%|█████▋    | 67/117 [00:03<00:02, 20.76it/s, loss=0.778, v_num=1, val_acc=0.756]
Epoch 63:  58%|█████▊    | 68/117 [00:03<00:02, 21.00it/s, loss=0.778, v_num=1, val_acc=0.756]
Epoch 63:  58%|█████▊    | 68/117 [00:03<00:02, 20.84it/s, loss=0.78, v_num=1, val_acc=0.756]
Epoch 63:  59%|█████▉    | 69/117 [00:03<00:02, 21.06it/s, loss=0.78, v_num=1, val_acc=0.756]
Epoch 63:  59%|█████▉    | 69/117 [00:03<00:02, 20.93it/s, loss=0.793, v_num=1, val_acc=0.756]
Epoch 63:  60%|█████▉    | 70/117 [00:03<00:02, 21.17it/s, loss=0.793, v_num=1, val_acc=0.756]
Epoch 63:  60%|█████▉    | 70/117 [00:03<00:02, 21.01it/s, loss=0.793, v_num=1, val_acc=0.756]
Epoch 63:  61%|██████    | 71/117 [00:03<00:02, 21.25it/s, loss=0.793, v_num=1, val_acc=0.756]
Epoch 63:  61%|██████    | 71/117 [00:03<00:02, 21.09it/s, loss=0.79, v_num=1, val_acc=0.756]
Epoch 63:  62%|██████▏   | 72/117 [00:03<00:02, 21.33it/s, loss=0.79, v_num=1, val_acc=0.756]
Epoch 63:  62%|██████▏   | 72/117 [00:03<00:02, 21.17it/s, loss=0.798, v_num=1, val_acc=0.756]
Epoch 63:  62%|██████▏   | 73/117 [00:03<00:02, 21.41it/s, loss=0.798, v_num=1, val_acc=0.756]
Epoch 63:  62%|██████▏   | 73/117 [00:03<00:02, 21.25it/s, loss=0.8, v_num=1, val_acc=0.756]
Epoch 63:  63%|██████▎   | 74/117 [00:03<00:02, 21.48it/s, loss=0.8, v_num=1, val_acc=0.756]
Epoch 63:  63%|██████▎   | 74/117 [00:03<00:02, 21.33it/s, loss=0.811, v_num=1, val_acc=0.756]
Epoch 63:  64%|██████▍   | 75/117 [00:03<00:01, 21.56it/s, loss=0.811, v_num=1, val_acc=0.756]
Epoch 63:  64%|██████▍   | 75/117 [00:03<00:01, 21.40it/s, loss=0.815, v_num=1, val_acc=0.756]
Epoch 63:  65%|██████▍   | 76/117 [00:03<00:01, 21.63it/s, loss=0.815, v_num=1, val_acc=0.756]
Epoch 63:  65%|██████▍   | 76/117 [00:03<00:01, 21.48it/s, loss=0.81, v_num=1, val_acc=0.756]
Epoch 63:  66%|██████▌   | 77/117 [00:03<00:01, 21.71it/s, loss=0.81, v_num=1, val_acc=0.756]
Epoch 63:  66%|██████▌   | 77/117 [00:03<00:01, 21.55it/s, loss=0.804, v_num=1, val_acc=0.756]
Epoch 63:  67%|██████▋   | 78/117 [00:03<00:01, 21.77it/s, loss=0.804, v_num=1, val_acc=0.756]
Epoch 63:  67%|██████▋   | 78/117 [00:03<00:01, 21.62it/s, loss=0.806, v_num=1, val_acc=0.756]
Epoch 63:  68%|██████▊   | 79/117 [00:03<00:01, 21.84it/s, loss=0.806, v_num=1, val_acc=0.756]
Epoch 63:  68%|██████▊   | 79/117 [00:03<00:01, 21.69it/s, loss=0.807, v_num=1, val_acc=0.756]
Epoch 63:  68%|██████▊   | 80/117 [00:03<00:01, 21.91it/s, loss=0.807, v_num=1, val_acc=0.756]
Epoch 63:  68%|██████▊   | 80/117 [00:03<00:01, 21.76it/s, loss=0.813, v_num=1, val_acc=0.756]
Epoch 63:  69%|██████▉   | 81/117 [00:03<00:01, 21.98it/s, loss=0.813, v_num=1, val_acc=0.756]
Epoch 63:  69%|██████▉   | 81/117 [00:03<00:01, 21.83it/s, loss=0.814, v_num=1, val_acc=0.756]
Epoch 63:  70%|███████   | 82/117 [00:03<00:01, 22.03it/s, loss=0.814, v_num=1, val_acc=0.756]
Epoch 63:  70%|███████   | 82/117 [00:03<00:01, 21.88it/s, loss=0.81, v_num=1, val_acc=0.756]
Epoch 63:  71%|███████   | 83/117 [00:03<00:01, 22.10it/s, loss=0.81, v_num=1, val_acc=0.756]
Epoch 63:  71%|███████   | 83/117 [00:03<00:01, 21.95it/s, loss=0.808, v_num=1, val_acc=0.756]
Epoch 63:  72%|███████▏  | 84/117 [00:03<00:01, 22.16it/s, loss=0.808, v_num=1, val_acc=0.756]
Epoch 63:  72%|███████▏  | 84/117 [00:03<00:01, 22.01it/s, loss=0.81, v_num=1, val_acc=0.756]
Epoch 63:  73%|███████▎  | 85/117 [00:03<00:01, 22.23it/s, loss=0.81, v_num=1, val_acc=0.756]
Epoch 63:  73%|███████▎  | 85/117 [00:03<00:01, 22.08it/s, loss=0.816, v_num=1, val_acc=0.756]
Epoch 63:  74%|███████▎  | 86/117 [00:03<00:01, 22.29it/s, loss=0.816, v_num=1, val_acc=0.756]
Epoch 63:  74%|███████▎  | 86/117 [00:03<00:01, 22.14it/s, loss=0.825, v_num=1, val_acc=0.756]
Epoch 63:  74%|███████▍  | 87/117 [00:03<00:01, 22.35it/s, loss=0.825, v_num=1, val_acc=0.756]
Epoch 63:  74%|███████▍  | 87/117 [00:03<00:01, 22.20it/s, loss=0.838, v_num=1, val_acc=0.756]
Epoch 63:  75%|███████▌  | 88/117 [00:03<00:01, 22.41it/s, loss=0.838, v_num=1, val_acc=0.756]
Epoch 63:  75%|███████▌  | 88/117 [00:03<00:01, 22.26it/s, loss=0.834, v_num=1, val_acc=0.756]
Epoch 63:  76%|███████▌  | 89/117 [00:03<00:01, 22.47it/s, loss=0.834, v_num=1, val_acc=0.756]
Epoch 63:  76%|███████▌  | 89/117 [00:03<00:01, 22.32it/s, loss=0.822, v_num=1, val_acc=0.756]
Epoch 63:  77%|███████▋  | 90/117 [00:03<00:01, 22.52it/s, loss=0.822, v_num=1, val_acc=0.756]
Epoch 63:  77%|███████▋  | 90/117 [00:04<00:01, 22.38it/s, loss=0.816, v_num=1, val_acc=0.756]
Epoch 63:  78%|███████▊  | 91/117 [00:04<00:01, 22.58it/s, loss=0.816, v_num=1, val_acc=0.756]
Epoch 63:  78%|███████▊  | 91/117 [00:04<00:01, 22.44it/s, loss=0.819, v_num=1, val_acc=0.756]
Epoch 63:  79%|███████▊  | 92/117 [00:04<00:01, 22.63it/s, loss=0.819, v_num=1, val_acc=0.756]
Epoch 63:  79%|███████▊  | 92/117 [00:04<00:01, 22.49it/s, loss=0.809, v_num=1, val_acc=0.756]
Epoch 63:  79%|███████▉  | 93/117 [00:04<00:01, 22.69it/s, loss=0.809, v_num=1, val_acc=0.756]
Epoch 63:  79%|███████▉  | 93/117 [00:04<00:01, 22.55it/s, loss=0.81, v_num=1, val_acc=0.756]
Epoch 63:  80%|████████  | 94/117 [00:04<00:01, 22.74it/s, loss=0.81, v_num=1, val_acc=0.756]
Epoch 63:  80%|████████  | 94/117 [00:04<00:01, 22.60it/s, loss=0.8, v_num=1, val_acc=0.756]
Epoch 63:  81%|████████  | 95/117 [00:04<00:00, 22.77it/s, loss=0.8, v_num=1, val_acc=0.756]
Epoch 63:  81%|████████  | 95/117 [00:04<00:00, 22.64it/s, loss=0.796, v_num=1, val_acc=0.756]
Epoch 63:  82%|████████▏ | 96/117 [00:04<00:00, 22.83it/s, loss=0.796, v_num=1, val_acc=0.756]
Epoch 63:  82%|████████▏ | 96/117 [00:04<00:00, 22.69it/s, loss=0.798, v_num=1, val_acc=0.756]
Epoch 63:  83%|████████▎ | 97/117 [00:04<00:00, 22.88it/s, loss=0.798, v_num=1, val_acc=0.756]
Epoch 63:  83%|████████▎ | 97/117 [00:04<00:00, 22.74it/s, loss=0.804, v_num=1, val_acc=0.756]

Validation: 0it [00:00, ?it/s]

Validation:   0%|          | 0/20 [00:00<?, ?it/s]

Validation DataLoader 0:   0%|          | 0/20 [00:00<?, ?it/s]

Validation DataLoader 0:   5%|▌         | 1/20 [00:00<00:00, 125.97it/s]
Epoch 63:  84%|████████▍ | 98/117 [00:05<00:00, 19.12it/s, loss=0.804, v_num=1, val_acc=0.756]

Validation DataLoader 0:  10%|█         | 2/20 [00:00<00:00, 49.96it/s]
Epoch 63:  85%|████████▍ | 99/117 [00:05<00:00, 19.20it/s, loss=0.804, v_num=1, val_acc=0.756]

Validation DataLoader 0:  15%|█▌        | 3/20 [00:00<00:00, 42.55it/s]
Epoch 63:  85%|████████▌ | 100/117 [00:05<00:00, 19.28it/s, loss=0.804, v_num=1, val_acc=0.756]

Validation DataLoader 0:  20%|██        | 4/20 [00:00<00:00, 39.18it/s]
Epoch 63:  86%|████████▋ | 101/117 [00:05<00:00, 19.35it/s, loss=0.804, v_num=1, val_acc=0.756]

Validation DataLoader 0:  25%|██▌       | 5/20 [00:00<00:00, 37.19it/s]
Epoch 63:  87%|████████▋ | 102/117 [00:05<00:00, 19.42it/s, loss=0.804, v_num=1, val_acc=0.756]

Validation DataLoader 0:  30%|███       | 6/20 [00:00<00:00, 36.27it/s]
Epoch 63:  88%|████████▊ | 103/117 [00:05<00:00, 19.50it/s, loss=0.804, v_num=1, val_acc=0.756]

Validation DataLoader 0:  35%|███▌      | 7/20 [00:00<00:00, 35.52it/s]
Epoch 63:  89%|████████▉ | 104/117 [00:05<00:00, 19.57it/s, loss=0.804, v_num=1, val_acc=0.756]

Validation DataLoader 0:  40%|████      | 8/20 [00:00<00:00, 34.95it/s]
Epoch 63:  90%|████████▉ | 105/117 [00:05<00:00, 19.64it/s, loss=0.804, v_num=1, val_acc=0.756]

Validation DataLoader 0:  45%|████▌     | 9/20 [00:00<00:00, 34.58it/s]
Epoch 63:  91%|█████████ | 106/117 [00:05<00:00, 19.71it/s, loss=0.804, v_num=1, val_acc=0.756]

Validation DataLoader 0:  50%|█████     | 10/20 [00:00<00:00, 34.26it/s]
Epoch 63:  91%|█████████▏| 107/117 [00:05<00:00, 19.78it/s, loss=0.804, v_num=1, val_acc=0.756]

Validation DataLoader 0:  55%|█████▌    | 11/20 [00:00<00:00, 34.01it/s]
Epoch 63:  92%|█████████▏| 108/117 [00:05<00:00, 19.85it/s, loss=0.804, v_num=1, val_acc=0.756]

Validation DataLoader 0:  60%|██████    | 12/20 [00:00<00:00, 33.81it/s]
Epoch 63:  93%|█████████▎| 109/117 [00:05<00:00, 19.92it/s, loss=0.804, v_num=1, val_acc=0.756]

Validation DataLoader 0:  65%|██████▌   | 13/20 [00:00<00:00, 33.65it/s]
Epoch 63:  94%|█████████▍| 110/117 [00:05<00:00, 19.99it/s, loss=0.804, v_num=1, val_acc=0.756]

Validation DataLoader 0:  70%|███████   | 14/20 [00:00<00:00, 33.43it/s]
Epoch 63:  95%|█████████▍| 111/117 [00:05<00:00, 20.05it/s, loss=0.804, v_num=1, val_acc=0.756]

Validation DataLoader 0:  75%|███████▌  | 15/20 [00:00<00:00, 33.32it/s]
Epoch 63:  96%|█████████▌| 112/117 [00:05<00:00, 20.12it/s, loss=0.804, v_num=1, val_acc=0.756]

Validation DataLoader 0:  80%|████████  | 16/20 [00:00<00:00, 33.23it/s]
Epoch 63:  97%|█████████▋| 113/117 [00:05<00:00, 20.19it/s, loss=0.804, v_num=1, val_acc=0.756]

Validation DataLoader 0:  85%|████████▌ | 17/20 [00:00<00:00, 33.10it/s]
Epoch 63:  97%|█████████▋| 114/117 [00:05<00:00, 20.25it/s, loss=0.804, v_num=1, val_acc=0.756]

Validation DataLoader 0:  90%|█████████ | 18/20 [00:00<00:00, 33.02it/s]
Epoch 63:  98%|█████████▊| 115/117 [00:05<00:00, 20.31it/s, loss=0.804, v_num=1, val_acc=0.756]

Validation DataLoader 0:  95%|█████████▌| 19/20 [00:00<00:00, 32.94it/s]
Epoch 63:  99%|█████████▉| 116/117 [00:05<00:00, 20.37it/s, loss=0.804, v_num=1, val_acc=0.756]

Validation DataLoader 0: 100%|██████████| 20/20 [00:00<00:00, 32.94it/s]
Epoch 63: 100%|██████████| 117/117 [00:05<00:00, 20.44it/s, loss=0.804, v_num=1, val_acc=0.756]
Epoch 63: 100%|██████████| 117/117 [00:05<00:00, 20.37it/s, loss=0.804, v_num=1, val_acc=0.755]


Epoch 63: 100%|██████████| 117/117 [00:05<00:00, 20.37it/s, loss=0.804, v_num=1, val_acc=0.755]
Epoch 63:   0%|          | 0/117 [00:00<?, ?it/s, loss=0.804, v_num=1, val_acc=0.755]
Epoch 64:   0%|          | 0/117 [00:00<?, ?it/s, loss=0.804, v_num=1, val_acc=0.755]
Epoch 64:   1%|          | 1/117 [00:00<01:43,  1.12it/s, loss=0.804, v_num=1, val_acc=0.755]
Epoch 64:   1%|          | 1/117 [00:00<01:46,  1.09it/s, loss=0.801, v_num=1, val_acc=0.755]
Epoch 64:   2%|▏         | 2/117 [00:00<00:53,  2.15it/s, loss=0.801, v_num=1, val_acc=0.755]
Epoch 64:   2%|▏         | 2/117 [00:00<00:55,  2.09it/s, loss=0.796, v_num=1, val_acc=0.755]
Epoch 64:   3%|▎         | 3/117 [00:00<00:36,  3.11it/s, loss=0.796, v_num=1, val_acc=0.755]
Epoch 64:   3%|▎         | 3/117 [00:00<00:37,  3.03it/s, loss=0.796, v_num=1, val_acc=0.755]
Epoch 64:   3%|▎         | 4/117 [00:00<00:28,  4.01it/s, loss=0.796, v_num=1, val_acc=0.755]
Epoch 64:   3%|▎         | 4/117 [00:01<00:28,  3.91it/s, loss=0.792, v_num=1, val_acc=0.755]
Epoch 64:   4%|▍         | 5/117 [00:01<00:23,  4.84it/s, loss=0.792, v_num=1, val_acc=0.755]
Epoch 64:   4%|▍         | 5/117 [00:01<00:23,  4.72it/s, loss=0.793, v_num=1, val_acc=0.755]
Epoch 64:   5%|▌         | 6/117 [00:01<00:19,  5.60it/s, loss=0.793, v_num=1, val_acc=0.755]
Epoch 64:   5%|▌         | 6/117 [00:01<00:20,  5.47it/s, loss=0.787, v_num=1, val_acc=0.755]
Epoch 64:   6%|▌         | 7/117 [00:01<00:17,  6.34it/s, loss=0.787, v_num=1, val_acc=0.755]
Epoch 64:   6%|▌         | 7/117 [00:01<00:17,  6.19it/s, loss=0.774, v_num=1, val_acc=0.755]
Epoch 64:   7%|▋         | 8/117 [00:01<00:15,  7.02it/s, loss=0.774, v_num=1, val_acc=0.755]
Epoch 64:   7%|▋         | 8/117 [00:01<00:15,  6.87it/s, loss=0.758, v_num=1, val_acc=0.755]
Epoch 64:   8%|▊         | 9/117 [00:01<00:14,  7.61it/s, loss=0.758, v_num=1, val_acc=0.755]
Epoch 64:   8%|▊         | 9/117 [00:01<00:14,  7.46it/s, loss=0.752, v_num=1, val_acc=0.755]
Epoch 64:   9%|▊         | 10/117 [00:01<00:12,  8.23it/s, loss=0.752, v_num=1, val_acc=0.755]
Epoch 64:   9%|▊         | 10/117 [00:01<00:13,  8.07it/s, loss=0.738, v_num=1, val_acc=0.755]
Epoch 64:   9%|▉         | 11/117 [00:01<00:12,  8.81it/s, loss=0.738, v_num=1, val_acc=0.755]
Epoch 64:   9%|▉         | 11/117 [00:01<00:12,  8.64it/s, loss=0.739, v_num=1, val_acc=0.755]
Epoch 64:  10%|█         | 12/117 [00:01<00:11,  9.36it/s, loss=0.739, v_num=1, val_acc=0.755]
Epoch 64:  10%|█         | 12/117 [00:01<00:11,  9.17it/s, loss=0.734, v_num=1, val_acc=0.755]
Epoch 64:  11%|█         | 13/117 [00:01<00:10,  9.88it/s, loss=0.734, v_num=1, val_acc=0.755]
Epoch 64:  11%|█         | 13/117 [00:01<00:10,  9.69it/s, loss=0.731, v_num=1, val_acc=0.755]
Epoch 64:  12%|█▏        | 14/117 [00:01<00:09, 10.37it/s, loss=0.731, v_num=1, val_acc=0.755]
Epoch 64:  12%|█▏        | 14/117 [00:01<00:10, 10.18it/s, loss=0.723, v_num=1, val_acc=0.755]
Epoch 64:  13%|█▎        | 15/117 [00:01<00:09, 10.84it/s, loss=0.723, v_num=1, val_acc=0.755]
Epoch 64:  13%|█▎        | 15/117 [00:01<00:09, 10.64it/s, loss=0.729, v_num=1, val_acc=0.755]
Epoch 64:  14%|█▎        | 16/117 [00:01<00:08, 11.29it/s, loss=0.729, v_num=1, val_acc=0.755]
Epoch 64:  14%|█▎        | 16/117 [00:01<00:09, 11.09it/s, loss=0.726, v_num=1, val_acc=0.755]
Epoch 64:  15%|█▍        | 17/117 [00:01<00:08, 11.70it/s, loss=0.726, v_num=1, val_acc=0.755]
Epoch 64:  15%|█▍        | 17/117 [00:01<00:08, 11.50it/s, loss=0.734, v_num=1, val_acc=0.755]
Epoch 64:  15%|█▌        | 18/117 [00:01<00:08, 12.10it/s, loss=0.734, v_num=1, val_acc=0.755]
Epoch 64:  15%|█▌        | 18/117 [00:01<00:08, 11.90it/s, loss=0.742, v_num=1, val_acc=0.755]
Epoch 64:  16%|█▌        | 19/117 [00:01<00:07, 12.49it/s, loss=0.742, v_num=1, val_acc=0.755]
Epoch 64:  16%|█▌        | 19/117 [00:01<00:07, 12.29it/s, loss=0.74, v_num=1, val_acc=0.755]
Epoch 64:  17%|█▋        | 20/117 [00:01<00:07, 12.85it/s, loss=0.74, v_num=1, val_acc=0.755]
Epoch 64:  17%|█▋        | 20/117 [00:01<00:07, 12.65it/s, loss=0.737, v_num=1, val_acc=0.755]
Epoch 64:  18%|█▊        | 21/117 [00:01<00:07, 13.21it/s, loss=0.737, v_num=1, val_acc=0.755]
Epoch 64:  18%|█▊        | 21/117 [00:01<00:07, 13.00it/s, loss=0.742, v_num=1, val_acc=0.755]
Epoch 64:  19%|█▉        | 22/117 [00:01<00:07, 13.54it/s, loss=0.742, v_num=1, val_acc=0.755]
Epoch 64:  19%|█▉        | 22/117 [00:01<00:07, 13.34it/s, loss=0.75, v_num=1, val_acc=0.755]
Epoch 64:  20%|█▉        | 23/117 [00:01<00:06, 13.82it/s, loss=0.75, v_num=1, val_acc=0.755]
Epoch 64:  20%|█▉        | 23/117 [00:01<00:06, 13.63it/s, loss=0.751, v_num=1, val_acc=0.755]
Epoch 64:  21%|██        | 24/117 [00:01<00:06, 14.15it/s, loss=0.751, v_num=1, val_acc=0.755]
Epoch 64:  21%|██        | 24/117 [00:01<00:06, 13.94it/s, loss=0.758, v_num=1, val_acc=0.755]
Epoch 64:  21%|██▏       | 25/117 [00:01<00:06, 14.44it/s, loss=0.758, v_num=1, val_acc=0.755]
Epoch 64:  21%|██▏       | 25/117 [00:01<00:06, 14.23it/s, loss=0.758, v_num=1, val_acc=0.755]
Epoch 64:  22%|██▏       | 26/117 [00:01<00:06, 14.72it/s, loss=0.758, v_num=1, val_acc=0.755]
Epoch 64:  22%|██▏       | 26/117 [00:01<00:06, 14.52it/s, loss=0.765, v_num=1, val_acc=0.755]
Epoch 64:  23%|██▎       | 27/117 [00:01<00:06, 15.00it/s, loss=0.765, v_num=1, val_acc=0.755]
Epoch 64:  23%|██▎       | 27/117 [00:01<00:06, 14.79it/s, loss=0.779, v_num=1, val_acc=0.755]
Epoch 64:  24%|██▍       | 28/117 [00:01<00:05, 15.26it/s, loss=0.779, v_num=1, val_acc=0.755]
Epoch 64:  24%|██▍       | 28/117 [00:01<00:05, 15.05it/s, loss=0.777, v_num=1, val_acc=0.755]
Epoch 64:  25%|██▍       | 29/117 [00:01<00:05, 15.51it/s, loss=0.777, v_num=1, val_acc=0.755]
Epoch 64:  25%|██▍       | 29/117 [00:01<00:05, 15.31it/s, loss=0.774, v_num=1, val_acc=0.755]
Epoch 64:  26%|██▌       | 30/117 [00:01<00:05, 15.76it/s, loss=0.774, v_num=1, val_acc=0.755]
Epoch 64:  26%|██▌       | 30/117 [00:01<00:05, 15.55it/s, loss=0.773, v_num=1, val_acc=0.755]
Epoch 64:  26%|██▋       | 31/117 [00:01<00:05, 15.99it/s, loss=0.773, v_num=1, val_acc=0.755]
Epoch 64:  26%|██▋       | 31/117 [00:01<00:05, 15.79it/s, loss=0.772, v_num=1, val_acc=0.755]
Epoch 64:  27%|██▋       | 32/117 [00:01<00:05, 16.22it/s, loss=0.772, v_num=1, val_acc=0.755]
Epoch 64:  27%|██▋       | 32/117 [00:01<00:05, 16.02it/s, loss=0.774, v_num=1, val_acc=0.755]
Epoch 64:  28%|██▊       | 33/117 [00:02<00:05, 16.44it/s, loss=0.774, v_num=1, val_acc=0.755]
Epoch 64:  28%|██▊       | 33/117 [00:02<00:05, 16.24it/s, loss=0.775, v_num=1, val_acc=0.755]
Epoch 64:  29%|██▉       | 34/117 [00:02<00:04, 16.65it/s, loss=0.775, v_num=1, val_acc=0.755]
Epoch 64:  29%|██▉       | 34/117 [00:02<00:05, 16.45it/s, loss=0.778, v_num=1, val_acc=0.755]
Epoch 64:  30%|██▉       | 35/117 [00:02<00:04, 16.86it/s, loss=0.778, v_num=1, val_acc=0.755]
Epoch 64:  30%|██▉       | 35/117 [00:02<00:04, 16.66it/s, loss=0.778, v_num=1, val_acc=0.755]
Epoch 64:  31%|███       | 36/117 [00:02<00:04, 17.05it/s, loss=0.778, v_num=1, val_acc=0.755]
Epoch 64:  31%|███       | 36/117 [00:02<00:04, 16.85it/s, loss=0.774, v_num=1, val_acc=0.755]
Epoch 64:  32%|███▏      | 37/117 [00:02<00:04, 17.21it/s, loss=0.774, v_num=1, val_acc=0.755]
Epoch 64:  32%|███▏      | 37/117 [00:02<00:04, 17.03it/s, loss=0.771, v_num=1, val_acc=0.755]
Epoch 64:  32%|███▏      | 38/117 [00:02<00:04, 17.41it/s, loss=0.771, v_num=1, val_acc=0.755]
Epoch 64:  32%|███▏      | 38/117 [00:02<00:04, 17.22it/s, loss=0.769, v_num=1, val_acc=0.755]
Epoch 64:  33%|███▎      | 39/117 [00:02<00:04, 17.60it/s, loss=0.769, v_num=1, val_acc=0.755]
Epoch 64:  33%|███▎      | 39/117 [00:02<00:04, 17.40it/s, loss=0.77, v_num=1, val_acc=0.755]
Epoch 64:  34%|███▍      | 40/117 [00:02<00:04, 17.77it/s, loss=0.77, v_num=1, val_acc=0.755]
Epoch 64:  34%|███▍      | 40/117 [00:02<00:04, 17.57it/s, loss=0.772, v_num=1, val_acc=0.755]
Epoch 64:  35%|███▌      | 41/117 [00:02<00:04, 17.94it/s, loss=0.772, v_num=1, val_acc=0.755]
Epoch 64:  35%|███▌      | 41/117 [00:02<00:04, 17.74it/s, loss=0.769, v_num=1, val_acc=0.755]
Epoch 64:  36%|███▌      | 42/117 [00:02<00:04, 18.11it/s, loss=0.769, v_num=1, val_acc=0.755]
Epoch 64:  36%|███▌      | 42/117 [00:02<00:04, 17.91it/s, loss=0.767, v_num=1, val_acc=0.755]
Epoch 64:  37%|███▋      | 43/117 [00:02<00:04, 18.26it/s, loss=0.767, v_num=1, val_acc=0.755]
Epoch 64:  37%|███▋      | 43/117 [00:02<00:04, 18.06it/s, loss=0.764, v_num=1, val_acc=0.755]
Epoch 64:  38%|███▊      | 44/117 [00:02<00:03, 18.41it/s, loss=0.764, v_num=1, val_acc=0.755]
Epoch 64:  38%|███▊      | 44/117 [00:02<00:04, 18.22it/s, loss=0.761, v_num=1, val_acc=0.755]
Epoch 64:  38%|███▊      | 45/117 [00:02<00:03, 18.56it/s, loss=0.761, v_num=1, val_acc=0.755]
Epoch 64:  38%|███▊      | 45/117 [00:02<00:03, 18.37it/s, loss=0.762, v_num=1, val_acc=0.755]
Epoch 64:  39%|███▉      | 46/117 [00:02<00:03, 18.71it/s, loss=0.762, v_num=1, val_acc=0.755]
Epoch 64:  39%|███▉      | 46/117 [00:02<00:03, 18.52it/s, loss=0.759, v_num=1, val_acc=0.755]
Epoch 64:  40%|████      | 47/117 [00:02<00:03, 18.84it/s, loss=0.759, v_num=1, val_acc=0.755]
Epoch 64:  40%|████      | 47/117 [00:02<00:03, 18.65it/s, loss=0.755, v_num=1, val_acc=0.755]
Epoch 64:  41%|████      | 48/117 [00:02<00:03, 18.98it/s, loss=0.755, v_num=1, val_acc=0.755]
Epoch 64:  41%|████      | 48/117 [00:02<00:03, 18.79it/s, loss=0.766, v_num=1, val_acc=0.755]
Epoch 64:  42%|████▏     | 49/117 [00:02<00:03, 19.08it/s, loss=0.766, v_num=1, val_acc=0.755]
Epoch 64:  42%|████▏     | 49/117 [00:02<00:03, 18.91it/s, loss=0.757, v_num=1, val_acc=0.755]
Epoch 64:  43%|████▎     | 50/117 [00:02<00:03, 19.21it/s, loss=0.757, v_num=1, val_acc=0.755]
Epoch 64:  43%|████▎     | 50/117 [00:02<00:03, 19.02it/s, loss=0.759, v_num=1, val_acc=0.755]
Epoch 64:  44%|████▎     | 51/117 [00:02<00:03, 19.34it/s, loss=0.759, v_num=1, val_acc=0.755]
Epoch 64:  44%|████▎     | 51/117 [00:02<00:03, 19.15it/s, loss=0.758, v_num=1, val_acc=0.755]
Epoch 64:  44%|████▍     | 52/117 [00:02<00:03, 19.46it/s, loss=0.758, v_num=1, val_acc=0.755]
Epoch 64:  44%|████▍     | 52/117 [00:02<00:03, 19.28it/s, loss=0.761, v_num=1, val_acc=0.755]
Epoch 64:  45%|████▌     | 53/117 [00:02<00:03, 19.58it/s, loss=0.761, v_num=1, val_acc=0.755]
Epoch 64:  45%|████▌     | 53/117 [00:02<00:03, 19.40it/s, loss=0.759, v_num=1, val_acc=0.755]
Epoch 64:  46%|████▌     | 54/117 [00:02<00:03, 19.70it/s, loss=0.759, v_num=1, val_acc=0.755]
Epoch 64:  46%|████▌     | 54/117 [00:02<00:03, 19.52it/s, loss=0.763, v_num=1, val_acc=0.755]
Epoch 64:  47%|████▋     | 55/117 [00:02<00:03, 19.82it/s, loss=0.763, v_num=1, val_acc=0.755]
Epoch 64:  47%|████▋     | 55/117 [00:02<00:03, 19.64it/s, loss=0.76, v_num=1, val_acc=0.755]
Epoch 64:  48%|████▊     | 56/117 [00:02<00:03, 19.93it/s, loss=0.76, v_num=1, val_acc=0.755]
Epoch 64:  48%|████▊     | 56/117 [00:02<00:03, 19.75it/s, loss=0.769, v_num=1, val_acc=0.755]
Epoch 64:  49%|████▊     | 57/117 [00:02<00:02, 20.04it/s, loss=0.769, v_num=1, val_acc=0.755]
Epoch 64:  49%|████▊     | 57/117 [00:02<00:03, 19.86it/s, loss=0.769, v_num=1, val_acc=0.755]
Epoch 64:  50%|████▉     | 58/117 [00:02<00:02, 20.15it/s, loss=0.769, v_num=1, val_acc=0.755]
Epoch 64:  50%|████▉     | 58/117 [00:02<00:02, 19.97it/s, loss=0.772, v_num=1, val_acc=0.755]
Epoch 64:  50%|█████     | 59/117 [00:02<00:02, 20.25it/s, loss=0.772, v_num=1, val_acc=0.755]
Epoch 64:  50%|█████     | 59/117 [00:02<00:02, 20.08it/s, loss=0.77, v_num=1, val_acc=0.755]
Epoch 64:  51%|█████▏    | 60/117 [00:02<00:02, 20.36it/s, loss=0.77, v_num=1, val_acc=0.755]
Epoch 64:  51%|█████▏    | 60/117 [00:02<00:02, 20.18it/s, loss=0.764, v_num=1, val_acc=0.755]
Epoch 64:  52%|█████▏    | 61/117 [00:02<00:02, 20.46it/s, loss=0.764, v_num=1, val_acc=0.755]
Epoch 64:  52%|█████▏    | 61/117 [00:03<00:02, 20.28it/s, loss=0.763, v_num=1, val_acc=0.755]
Epoch 64:  53%|█████▎    | 62/117 [00:03<00:02, 20.56it/s, loss=0.763, v_num=1, val_acc=0.755]
Epoch 64:  53%|█████▎    | 62/117 [00:03<00:02, 20.38it/s, loss=0.759, v_num=1, val_acc=0.755]
Epoch 64:  54%|█████▍    | 63/117 [00:03<00:02, 20.65it/s, loss=0.759, v_num=1, val_acc=0.755]
Epoch 64:  54%|█████▍    | 63/117 [00:03<00:02, 20.48it/s, loss=0.757, v_num=1, val_acc=0.755]
Epoch 64:  55%|█████▍    | 64/117 [00:03<00:02, 20.74it/s, loss=0.757, v_num=1, val_acc=0.755]
Epoch 64:  55%|█████▍    | 64/117 [00:03<00:02, 20.58it/s, loss=0.758, v_num=1, val_acc=0.755]
Epoch 64:  56%|█████▌    | 65/117 [00:03<00:02, 20.84it/s, loss=0.758, v_num=1, val_acc=0.755]
Epoch 64:  56%|█████▌    | 65/117 [00:03<00:02, 20.67it/s, loss=0.763, v_num=1, val_acc=0.755]
Epoch 64:  56%|█████▋    | 66/117 [00:03<00:02, 20.93it/s, loss=0.763, v_num=1, val_acc=0.755]
Epoch 64:  56%|█████▋    | 66/117 [00:03<00:02, 20.76it/s, loss=0.774, v_num=1, val_acc=0.755]
Epoch 64:  57%|█████▋    | 67/117 [00:03<00:02, 21.01it/s, loss=0.774, v_num=1, val_acc=0.755]
Epoch 64:  57%|█████▋    | 67/117 [00:03<00:02, 20.85it/s, loss=0.782, v_num=1, val_acc=0.755]
Epoch 64:  58%|█████▊    | 68/117 [00:03<00:02, 21.10it/s, loss=0.782, v_num=1, val_acc=0.755]
Epoch 64:  58%|█████▊    | 68/117 [00:03<00:02, 20.94it/s, loss=0.784, v_num=1, val_acc=0.755]
Epoch 64:  59%|█████▉    | 69/117 [00:03<00:02, 21.18it/s, loss=0.784, v_num=1, val_acc=0.755]
Epoch 64:  59%|█████▉    | 69/117 [00:03<00:02, 21.02it/s, loss=0.797, v_num=1, val_acc=0.755]
Epoch 64:  60%|█████▉    | 70/117 [00:03<00:02, 21.27it/s, loss=0.797, v_num=1, val_acc=0.755]
Epoch 64:  60%|█████▉    | 70/117 [00:03<00:02, 21.10it/s, loss=0.805, v_num=1, val_acc=0.755]
Epoch 64:  61%|██████    | 71/117 [00:03<00:02, 21.35it/s, loss=0.805, v_num=1, val_acc=0.755]
Epoch 64:  61%|██████    | 71/117 [00:03<00:02, 21.19it/s, loss=0.81, v_num=1, val_acc=0.755]
Epoch 64:  62%|██████▏   | 72/117 [00:03<00:02, 21.42it/s, loss=0.81, v_num=1, val_acc=0.755]
Epoch 64:  62%|██████▏   | 72/117 [00:03<00:02, 21.27it/s, loss=0.812, v_num=1, val_acc=0.755]
Epoch 64:  62%|██████▏   | 73/117 [00:03<00:02, 21.50it/s, loss=0.812, v_num=1, val_acc=0.755]
Epoch 64:  62%|██████▏   | 73/117 [00:03<00:02, 21.34it/s, loss=0.815, v_num=1, val_acc=0.755]
Epoch 64:  63%|██████▎   | 74/117 [00:03<00:01, 21.58it/s, loss=0.815, v_num=1, val_acc=0.755]
Epoch 64:  63%|██████▎   | 74/117 [00:03<00:02, 21.42it/s, loss=0.807, v_num=1, val_acc=0.755]
Epoch 64:  64%|██████▍   | 75/117 [00:03<00:01, 21.65it/s, loss=0.807, v_num=1, val_acc=0.755]
Epoch 64:  64%|██████▍   | 75/117 [00:03<00:01, 21.49it/s, loss=0.807, v_num=1, val_acc=0.755]
Epoch 64:  65%|██████▍   | 76/117 [00:03<00:01, 21.73it/s, loss=0.807, v_num=1, val_acc=0.755]
Epoch 64:  65%|██████▍   | 76/117 [00:03<00:01, 21.57it/s, loss=0.798, v_num=1, val_acc=0.755]
Epoch 64:  66%|██████▌   | 77/117 [00:03<00:01, 21.80it/s, loss=0.798, v_num=1, val_acc=0.755]
Epoch 64:  66%|██████▌   | 77/117 [00:03<00:01, 21.64it/s, loss=0.797, v_num=1, val_acc=0.755]
Epoch 64:  67%|██████▋   | 78/117 [00:03<00:01, 21.84it/s, loss=0.797, v_num=1, val_acc=0.755]
Epoch 64:  67%|██████▋   | 78/117 [00:03<00:01, 21.70it/s, loss=0.792, v_num=1, val_acc=0.755]
Epoch 64:  68%|██████▊   | 79/117 [00:03<00:01, 21.92it/s, loss=0.792, v_num=1, val_acc=0.755]
Epoch 64:  68%|██████▊   | 79/117 [00:03<00:01, 21.77it/s, loss=0.797, v_num=1, val_acc=0.755]
Epoch 64:  68%|██████▊   | 80/117 [00:03<00:01, 21.99it/s, loss=0.797, v_num=1, val_acc=0.755]
Epoch 64:  68%|██████▊   | 80/117 [00:03<00:01, 21.84it/s, loss=0.803, v_num=1, val_acc=0.755]
Epoch 64:  69%|██████▉   | 81/117 [00:03<00:01, 22.06it/s, loss=0.803, v_num=1, val_acc=0.755]
Epoch 64:  69%|██████▉   | 81/117 [00:03<00:01, 21.90it/s, loss=0.806, v_num=1, val_acc=0.755]
Epoch 64:  70%|███████   | 82/117 [00:03<00:01, 22.09it/s, loss=0.806, v_num=1, val_acc=0.755]
Epoch 64:  70%|███████   | 82/117 [00:03<00:01, 21.94it/s, loss=0.802, v_num=1, val_acc=0.755]
Epoch 64:  71%|███████   | 83/117 [00:03<00:01, 22.16it/s, loss=0.802, v_num=1, val_acc=0.755]
Epoch 64:  71%|███████   | 83/117 [00:03<00:01, 22.01it/s, loss=0.801, v_num=1, val_acc=0.755]
Epoch 64:  72%|███████▏  | 84/117 [00:03<00:01, 22.22it/s, loss=0.801, v_num=1, val_acc=0.755]
Epoch 64:  72%|███████▏  | 84/117 [00:03<00:01, 22.07it/s, loss=0.797, v_num=1, val_acc=0.755]
Epoch 64:  73%|███████▎  | 85/117 [00:03<00:01, 22.29it/s, loss=0.797, v_num=1, val_acc=0.755]
Epoch 64:  73%|███████▎  | 85/117 [00:03<00:01, 22.14it/s, loss=0.786, v_num=1, val_acc=0.755]
Epoch 64:  74%|███████▎  | 86/117 [00:03<00:01, 22.35it/s, loss=0.786, v_num=1, val_acc=0.755]
Epoch 64:  74%|███████▎  | 86/117 [00:03<00:01, 22.20it/s, loss=0.77, v_num=1, val_acc=0.755]
Epoch 64:  74%|███████▍  | 87/117 [00:03<00:01, 22.41it/s, loss=0.77, v_num=1, val_acc=0.755]
Epoch 64:  74%|███████▍  | 87/117 [00:03<00:01, 22.26it/s, loss=0.759, v_num=1, val_acc=0.755]
Epoch 64:  75%|███████▌  | 88/117 [00:03<00:01, 22.47it/s, loss=0.759, v_num=1, val_acc=0.755]
Epoch 64:  75%|███████▌  | 88/117 [00:03<00:01, 22.32it/s, loss=0.75, v_num=1, val_acc=0.755]
Epoch 64:  76%|███████▌  | 89/117 [00:03<00:01, 22.53it/s, loss=0.75, v_num=1, val_acc=0.755]
Epoch 64:  76%|███████▌  | 89/117 [00:03<00:01, 22.38it/s, loss=0.749, v_num=1, val_acc=0.755]
Epoch 64:  77%|███████▋  | 90/117 [00:03<00:01, 22.58it/s, loss=0.749, v_num=1, val_acc=0.755]
Epoch 64:  77%|███████▋  | 90/117 [00:04<00:01, 22.44it/s, loss=0.742, v_num=1, val_acc=0.755]
Epoch 64:  78%|███████▊  | 91/117 [00:04<00:01, 22.64it/s, loss=0.742, v_num=1, val_acc=0.755]
Epoch 64:  78%|███████▊  | 91/117 [00:04<00:01, 22.50it/s, loss=0.745, v_num=1, val_acc=0.755]
Epoch 64:  79%|███████▊  | 92/117 [00:04<00:01, 22.70it/s, loss=0.745, v_num=1, val_acc=0.755]
Epoch 64:  79%|███████▊  | 92/117 [00:04<00:01, 22.55it/s, loss=0.744, v_num=1, val_acc=0.755]
Epoch 64:  79%|███████▉  | 93/117 [00:04<00:01, 22.75it/s, loss=0.744, v_num=1, val_acc=0.755]
Epoch 64:  79%|███████▉  | 93/117 [00:04<00:01, 22.61it/s, loss=0.75, v_num=1, val_acc=0.755]
Epoch 64:  80%|████████  | 94/117 [00:04<00:01, 22.80it/s, loss=0.75, v_num=1, val_acc=0.755]
Epoch 64:  80%|████████  | 94/117 [00:04<00:01, 22.66it/s, loss=0.765, v_num=1, val_acc=0.755]
Epoch 64:  81%|████████  | 95/117 [00:04<00:00, 22.85it/s, loss=0.765, v_num=1, val_acc=0.755]
Epoch 64:  81%|████████  | 95/117 [00:04<00:00, 22.71it/s, loss=0.769, v_num=1, val_acc=0.755]
Epoch 64:  82%|████████▏ | 96/117 [00:04<00:00, 22.90it/s, loss=0.769, v_num=1, val_acc=0.755]
Epoch 64:  82%|████████▏ | 96/117 [00:04<00:00, 22.77it/s, loss=0.779, v_num=1, val_acc=0.755]
Epoch 64:  83%|████████▎ | 97/117 [00:04<00:00, 22.95it/s, loss=0.779, v_num=1, val_acc=0.755]
Epoch 64:  83%|████████▎ | 97/117 [00:04<00:00, 22.82it/s, loss=0.778, v_num=1, val_acc=0.755]

Validation: 0it [00:00, ?it/s]

Validation:   0%|          | 0/20 [00:00<?, ?it/s]

Validation DataLoader 0:   0%|          | 0/20 [00:00<?, ?it/s]

Validation DataLoader 0:   5%|▌         | 1/20 [00:00<00:00, 168.84it/s]
Epoch 64:  84%|████████▍ | 98/117 [00:05<00:00, 19.22it/s, loss=0.778, v_num=1, val_acc=0.755]

Validation DataLoader 0:  10%|█         | 2/20 [00:00<00:00, 55.16it/s]
Epoch 64:  85%|████████▍ | 99/117 [00:05<00:00, 19.30it/s, loss=0.778, v_num=1, val_acc=0.755]

Validation DataLoader 0:  15%|█▌        | 3/20 [00:00<00:00, 44.25it/s]
Epoch 64:  85%|████████▌ | 100/117 [00:05<00:00, 19.38it/s, loss=0.778, v_num=1, val_acc=0.755]

Validation DataLoader 0:  20%|██        | 4/20 [00:00<00:00, 40.24it/s]
Epoch 64:  86%|████████▋ | 101/117 [00:05<00:00, 19.45it/s, loss=0.778, v_num=1, val_acc=0.755]

Validation DataLoader 0:  25%|██▌       | 5/20 [00:00<00:00, 38.09it/s]
Epoch 64:  87%|████████▋ | 102/117 [00:05<00:00, 19.52it/s, loss=0.778, v_num=1, val_acc=0.755]

Validation DataLoader 0:  30%|███       | 6/20 [00:00<00:00, 36.83it/s]
Epoch 64:  88%|████████▊ | 103/117 [00:05<00:00, 19.60it/s, loss=0.778, v_num=1, val_acc=0.755]

Validation DataLoader 0:  35%|███▌      | 7/20 [00:00<00:00, 36.02it/s]
Epoch 64:  89%|████████▉ | 104/117 [00:05<00:00, 19.67it/s, loss=0.778, v_num=1, val_acc=0.755]

Validation DataLoader 0:  40%|████      | 8/20 [00:00<00:00, 35.41it/s]
Epoch 64:  90%|████████▉ | 105/117 [00:05<00:00, 19.74it/s, loss=0.778, v_num=1, val_acc=0.755]

Validation DataLoader 0:  45%|████▌     | 9/20 [00:00<00:00, 34.92it/s]
Epoch 64:  91%|█████████ | 106/117 [00:05<00:00, 19.81it/s, loss=0.778, v_num=1, val_acc=0.755]

Validation DataLoader 0:  50%|█████     | 10/20 [00:00<00:00, 34.57it/s]
Epoch 64:  91%|█████████▏| 107/117 [00:05<00:00, 19.88it/s, loss=0.778, v_num=1, val_acc=0.755]

Validation DataLoader 0:  55%|█████▌    | 11/20 [00:00<00:00, 34.29it/s]
Epoch 64:  92%|█████████▏| 108/117 [00:05<00:00, 19.95it/s, loss=0.778, v_num=1, val_acc=0.755]

Validation DataLoader 0:  60%|██████    | 12/20 [00:00<00:00, 34.05it/s]
Epoch 64:  93%|█████████▎| 109/117 [00:05<00:00, 20.02it/s, loss=0.778, v_num=1, val_acc=0.755]

Validation DataLoader 0:  65%|██████▌   | 13/20 [00:00<00:00, 33.81it/s]
Epoch 64:  94%|█████████▍| 110/117 [00:05<00:00, 20.08it/s, loss=0.778, v_num=1, val_acc=0.755]

Validation DataLoader 0:  70%|███████   | 14/20 [00:00<00:00, 33.66it/s]
Epoch 64:  95%|█████████▍| 111/117 [00:05<00:00, 20.15it/s, loss=0.778, v_num=1, val_acc=0.755]

Validation DataLoader 0:  75%|███████▌  | 15/20 [00:00<00:00, 33.50it/s]
Epoch 64:  96%|█████████▌| 112/117 [00:05<00:00, 20.21it/s, loss=0.778, v_num=1, val_acc=0.755]

Validation DataLoader 0:  80%|████████  | 16/20 [00:00<00:00, 33.38it/s]
Epoch 64:  97%|█████████▋| 113/117 [00:05<00:00, 20.28it/s, loss=0.778, v_num=1, val_acc=0.755]

Validation DataLoader 0:  85%|████████▌ | 17/20 [00:00<00:00, 33.25it/s]
Epoch 64:  97%|█████████▋| 114/117 [00:05<00:00, 20.34it/s, loss=0.778, v_num=1, val_acc=0.755]

Validation DataLoader 0:  90%|█████████ | 18/20 [00:00<00:00, 33.16it/s]
Epoch 64:  98%|█████████▊| 115/117 [00:05<00:00, 20.40it/s, loss=0.778, v_num=1, val_acc=0.755]

Validation DataLoader 0:  95%|█████████▌| 19/20 [00:00<00:00, 33.07it/s]
Epoch 64:  99%|█████████▉| 116/117 [00:05<00:00, 20.47it/s, loss=0.778, v_num=1, val_acc=0.755]

Validation DataLoader 0: 100%|██████████| 20/20 [00:00<00:00, 33.07it/s]
Epoch 64: 100%|██████████| 117/117 [00:05<00:00, 20.53it/s, loss=0.778, v_num=1, val_acc=0.755]
Epoch 64: 100%|██████████| 117/117 [00:05<00:00, 20.46it/s, loss=0.778, v_num=1, val_acc=0.740]


Epoch 64: 100%|██████████| 117/117 [00:05<00:00, 20.46it/s, loss=0.778, v_num=1, val_acc=0.740]
Epoch 64:   0%|          | 0/117 [00:00<?, ?it/s, loss=0.778, v_num=1, val_acc=0.740]
Epoch 65:   0%|          | 0/117 [00:00<?, ?it/s, loss=0.778, v_num=1, val_acc=0.740]
Epoch 65:   1%|          | 1/117 [00:00<01:46,  1.09it/s, loss=0.778, v_num=1, val_acc=0.740]
Epoch 65:   1%|          | 1/117 [00:00<01:49,  1.06it/s, loss=0.778, v_num=1, val_acc=0.740]
Epoch 65:   2%|▏         | 2/117 [00:00<00:54,  2.10it/s, loss=0.778, v_num=1, val_acc=0.740]
Epoch 65:   2%|▏         | 2/117 [00:00<00:56,  2.05it/s, loss=0.775, v_num=1, val_acc=0.740]
Epoch 65:   3%|▎         | 3/117 [00:00<00:37,  3.04it/s, loss=0.775, v_num=1, val_acc=0.740]
Epoch 65:   3%|▎         | 3/117 [00:01<00:38,  2.97it/s, loss=0.766, v_num=1, val_acc=0.740]
Epoch 65:   3%|▎         | 4/117 [00:01<00:28,  3.90it/s, loss=0.766, v_num=1, val_acc=0.740]
Epoch 65:   3%|▎         | 4/117 [00:01<00:29,  3.81it/s, loss=0.765, v_num=1, val_acc=0.740]
Epoch 65:   4%|▍         | 5/117 [00:01<00:23,  4.72it/s, loss=0.765, v_num=1, val_acc=0.740]
Epoch 65:   4%|▍         | 5/117 [00:01<00:24,  4.61it/s, loss=0.769, v_num=1, val_acc=0.740]
Epoch 65:   5%|▌         | 6/117 [00:01<00:20,  5.48it/s, loss=0.769, v_num=1, val_acc=0.740]
Epoch 65:   5%|▌         | 6/117 [00:01<00:20,  5.36it/s, loss=0.772, v_num=1, val_acc=0.740]
Epoch 65:   6%|▌         | 7/117 [00:01<00:17,  6.21it/s, loss=0.772, v_num=1, val_acc=0.740]
Epoch 65:   6%|▌         | 7/117 [00:01<00:18,  6.07it/s, loss=0.779, v_num=1, val_acc=0.740]
Epoch 65:   7%|▋         | 8/117 [00:01<00:15,  6.89it/s, loss=0.779, v_num=1, val_acc=0.740]
Epoch 65:   7%|▋         | 8/117 [00:01<00:16,  6.74it/s, loss=0.779, v_num=1, val_acc=0.740]
Epoch 65:   8%|▊         | 9/117 [00:01<00:14,  7.51it/s, loss=0.779, v_num=1, val_acc=0.740]
Epoch 65:   8%|▊         | 9/117 [00:01<00:14,  7.35it/s, loss=0.782, v_num=1, val_acc=0.740]
Epoch 65:   9%|▊         | 10/117 [00:01<00:13,  8.09it/s, loss=0.782, v_num=1, val_acc=0.740]
Epoch 65:   9%|▊         | 10/117 [00:01<00:13,  7.93it/s, loss=0.786, v_num=1, val_acc=0.740]
Epoch 65:   9%|▉         | 11/117 [00:01<00:12,  8.67it/s, loss=0.786, v_num=1, val_acc=0.740]
Epoch 65:   9%|▉         | 11/117 [00:01<00:12,  8.50it/s, loss=0.794, v_num=1, val_acc=0.740]
Epoch 65:  10%|█         | 12/117 [00:01<00:11,  9.21it/s, loss=0.794, v_num=1, val_acc=0.740]
Epoch 65:  10%|█         | 12/117 [00:01<00:11,  9.03it/s, loss=0.789, v_num=1, val_acc=0.740]
Epoch 65:  11%|█         | 13/117 [00:01<00:10,  9.73it/s, loss=0.789, v_num=1, val_acc=0.740]
Epoch 65:  11%|█         | 13/117 [00:01<00:10,  9.55it/s, loss=0.792, v_num=1, val_acc=0.740]
Epoch 65:  12%|█▏        | 14/117 [00:01<00:10, 10.22it/s, loss=0.792, v_num=1, val_acc=0.740]
Epoch 65:  12%|█▏        | 14/117 [00:01<00:10, 10.03it/s, loss=0.784, v_num=1, val_acc=0.740]
Epoch 65:  13%|█▎        | 15/117 [00:01<00:09, 10.68it/s, loss=0.784, v_num=1, val_acc=0.740]
Epoch 65:  13%|█▎        | 15/117 [00:01<00:09, 10.49it/s, loss=0.78, v_num=1, val_acc=0.740]
Epoch 65:  14%|█▎        | 16/117 [00:01<00:09, 11.13it/s, loss=0.78, v_num=1, val_acc=0.740]
Epoch 65:  14%|█▎        | 16/117 [00:01<00:09, 10.93it/s, loss=0.776, v_num=1, val_acc=0.740]
Epoch 65:  15%|█▍        | 17/117 [00:01<00:08, 11.52it/s, loss=0.776, v_num=1, val_acc=0.740]
Epoch 65:  15%|█▍        | 17/117 [00:01<00:08, 11.33it/s, loss=0.767, v_num=1, val_acc=0.740]
Epoch 65:  15%|█▌        | 18/117 [00:01<00:08, 11.92it/s, loss=0.767, v_num=1, val_acc=0.740]
Epoch 65:  15%|█▌        | 18/117 [00:01<00:08, 11.73it/s, loss=0.756, v_num=1, val_acc=0.740]
Epoch 65:  16%|█▌        | 19/117 [00:01<00:07, 12.31it/s, loss=0.756, v_num=1, val_acc=0.740]
Epoch 65:  16%|█▌        | 19/117 [00:01<00:08, 12.11it/s, loss=0.749, v_num=1, val_acc=0.740]
Epoch 65:  17%|█▋        | 20/117 [00:01<00:07, 12.68it/s, loss=0.749, v_num=1, val_acc=0.740]
Epoch 65:  17%|█▋        | 20/117 [00:01<00:07, 12.48it/s, loss=0.745, v_num=1, val_acc=0.740]
Epoch 65:  18%|█▊        | 21/117 [00:01<00:07, 13.04it/s, loss=0.745, v_num=1, val_acc=0.740]
Epoch 65:  18%|█▊        | 21/117 [00:01<00:07, 12.83it/s, loss=0.737, v_num=1, val_acc=0.740]
Epoch 65:  19%|█▉        | 22/117 [00:01<00:07, 13.37it/s, loss=0.737, v_num=1, val_acc=0.740]
Epoch 65:  19%|█▉        | 22/117 [00:01<00:07, 13.17it/s, loss=0.735, v_num=1, val_acc=0.740]
Epoch 65:  20%|█▉        | 23/117 [00:01<00:06, 13.69it/s, loss=0.735, v_num=1, val_acc=0.740]
Epoch 65:  20%|█▉        | 23/117 [00:01<00:06, 13.49it/s, loss=0.739, v_num=1, val_acc=0.740]
Epoch 65:  21%|██        | 24/117 [00:01<00:06, 14.00it/s, loss=0.739, v_num=1, val_acc=0.740]
Epoch 65:  21%|██        | 24/117 [00:01<00:06, 13.79it/s, loss=0.736, v_num=1, val_acc=0.740]
Epoch 65:  21%|██▏       | 25/117 [00:01<00:06, 14.24it/s, loss=0.736, v_num=1, val_acc=0.740]
Epoch 65:  21%|██▏       | 25/117 [00:01<00:06, 14.06it/s, loss=0.732, v_num=1, val_acc=0.740]
Epoch 65:  22%|██▏       | 26/117 [00:01<00:06, 14.55it/s, loss=0.732, v_num=1, val_acc=0.740]
Epoch 65:  22%|██▏       | 26/117 [00:01<00:06, 14.35it/s, loss=0.736, v_num=1, val_acc=0.740]
Epoch 65:  23%|██▎       | 27/117 [00:01<00:06, 14.83it/s, loss=0.736, v_num=1, val_acc=0.740]
Epoch 65:  23%|██▎       | 27/117 [00:01<00:06, 14.63it/s, loss=0.731, v_num=1, val_acc=0.740]
Epoch 65:  24%|██▍       | 28/117 [00:01<00:05, 15.10it/s, loss=0.731, v_num=1, val_acc=0.740]
Epoch 65:  24%|██▍       | 28/117 [00:01<00:05, 14.89it/s, loss=0.734, v_num=1, val_acc=0.740]
Epoch 65:  25%|██▍       | 29/117 [00:01<00:05, 15.35it/s, loss=0.734, v_num=1, val_acc=0.740]
Epoch 65:  25%|██▍       | 29/117 [00:01<00:05, 15.15it/s, loss=0.734, v_num=1, val_acc=0.740]
Epoch 65:  26%|██▌       | 30/117 [00:01<00:05, 15.56it/s, loss=0.734, v_num=1, val_acc=0.740]
Epoch 65:  26%|██▌       | 30/117 [00:01<00:05, 15.37it/s, loss=0.731, v_num=1, val_acc=0.740]
Epoch 65:  26%|██▋       | 31/117 [00:01<00:05, 15.80it/s, loss=0.731, v_num=1, val_acc=0.740]
Epoch 65:  26%|██▋       | 31/117 [00:01<00:05, 15.60it/s, loss=0.72, v_num=1, val_acc=0.740]
Epoch 65:  27%|██▋       | 32/117 [00:01<00:05, 16.02it/s, loss=0.72, v_num=1, val_acc=0.740]
Epoch 65:  27%|██▋       | 32/117 [00:02<00:05, 15.82it/s, loss=0.723, v_num=1, val_acc=0.740]
Epoch 65:  28%|██▊       | 33/117 [00:02<00:05, 16.23it/s, loss=0.723, v_num=1, val_acc=0.740]
Epoch 65:  28%|██▊       | 33/117 [00:02<00:05, 16.03it/s, loss=0.721, v_num=1, val_acc=0.740]
Epoch 65:  29%|██▉       | 34/117 [00:02<00:05, 16.45it/s, loss=0.721, v_num=1, val_acc=0.740]
Epoch 65:  29%|██▉       | 34/117 [00:02<00:05, 16.25it/s, loss=0.724, v_num=1, val_acc=0.740]
Epoch 65:  30%|██▉       | 35/117 [00:02<00:04, 16.66it/s, loss=0.724, v_num=1, val_acc=0.740]
Epoch 65:  30%|██▉       | 35/117 [00:02<00:04, 16.46it/s, loss=0.728, v_num=1, val_acc=0.740]
Epoch 65:  31%|███       | 36/117 [00:02<00:04, 16.86it/s, loss=0.728, v_num=1, val_acc=0.740]
Epoch 65:  31%|███       | 36/117 [00:02<00:04, 16.66it/s, loss=0.725, v_num=1, val_acc=0.740]
Epoch 65:  32%|███▏      | 37/117 [00:02<00:04, 17.05it/s, loss=0.725, v_num=1, val_acc=0.740]
Epoch 65:  32%|███▏      | 37/117 [00:02<00:04, 16.86it/s, loss=0.723, v_num=1, val_acc=0.740]
Epoch 65:  32%|███▏      | 38/117 [00:02<00:04, 17.24it/s, loss=0.723, v_num=1, val_acc=0.740]
Epoch 65:  32%|███▏      | 38/117 [00:02<00:04, 17.04it/s, loss=0.734, v_num=1, val_acc=0.740]
Epoch 65:  33%|███▎      | 39/117 [00:02<00:04, 17.42it/s, loss=0.734, v_num=1, val_acc=0.740]
Epoch 65:  33%|███▎      | 39/117 [00:02<00:04, 17.23it/s, loss=0.737, v_num=1, val_acc=0.740]
Epoch 65:  34%|███▍      | 40/117 [00:02<00:04, 17.59it/s, loss=0.737, v_num=1, val_acc=0.740]
Epoch 65:  34%|███▍      | 40/117 [00:02<00:04, 17.40it/s, loss=0.74, v_num=1, val_acc=0.740]
Epoch 65:  35%|███▌      | 41/117 [00:02<00:04, 17.76it/s, loss=0.74, v_num=1, val_acc=0.740]
Epoch 65:  35%|███▌      | 41/117 [00:02<00:04, 17.57it/s, loss=0.743, v_num=1, val_acc=0.740]
Epoch 65:  36%|███▌      | 42/117 [00:02<00:04, 17.93it/s, loss=0.743, v_num=1, val_acc=0.740]
Epoch 65:  36%|███▌      | 42/117 [00:02<00:04, 17.74it/s, loss=0.742, v_num=1, val_acc=0.740]
Epoch 65:  37%|███▋      | 43/117 [00:02<00:04, 18.05it/s, loss=0.742, v_num=1, val_acc=0.740]
Epoch 65:  37%|███▋      | 43/117 [00:02<00:04, 17.88it/s, loss=0.74, v_num=1, val_acc=0.740]
Epoch 65:  38%|███▊      | 44/117 [00:02<00:04, 18.23it/s, loss=0.74, v_num=1, val_acc=0.740]
Epoch 65:  38%|███▊      | 44/117 [00:02<00:04, 18.04it/s, loss=0.741, v_num=1, val_acc=0.740]
Epoch 65:  38%|███▊      | 45/117 [00:02<00:03, 18.38it/s, loss=0.741, v_num=1, val_acc=0.740]
Epoch 65:  38%|███▊      | 45/117 [00:02<00:03, 18.19it/s, loss=0.747, v_num=1, val_acc=0.740]
Epoch 65:  39%|███▉      | 46/117 [00:02<00:03, 18.52it/s, loss=0.747, v_num=1, val_acc=0.740]
Epoch 65:  39%|███▉      | 46/117 [00:02<00:03, 18.33it/s, loss=0.744, v_num=1, val_acc=0.740]
Epoch 65:  40%|████      | 47/117 [00:02<00:03, 18.66it/s, loss=0.744, v_num=1, val_acc=0.740]
Epoch 65:  40%|████      | 47/117 [00:02<00:03, 18.48it/s, loss=0.745, v_num=1, val_acc=0.740]
Epoch 65:  41%|████      | 48/117 [00:02<00:03, 18.80it/s, loss=0.745, v_num=1, val_acc=0.740]
Epoch 65:  41%|████      | 48/117 [00:02<00:03, 18.61it/s, loss=0.743, v_num=1, val_acc=0.740]
Epoch 65:  42%|████▏     | 49/117 [00:02<00:03, 18.93it/s, loss=0.743, v_num=1, val_acc=0.740]
Epoch 65:  42%|████▏     | 49/117 [00:02<00:03, 18.75it/s, loss=0.746, v_num=1, val_acc=0.740]
Epoch 65:  43%|████▎     | 50/117 [00:02<00:03, 19.07it/s, loss=0.746, v_num=1, val_acc=0.740]
Epoch 65:  43%|████▎     | 50/117 [00:02<00:03, 18.88it/s, loss=0.753, v_num=1, val_acc=0.740]
Epoch 65:  44%|████▎     | 51/117 [00:02<00:03, 19.20it/s, loss=0.753, v_num=1, val_acc=0.740]
Epoch 65:  44%|████▎     | 51/117 [00:02<00:03, 19.02it/s, loss=0.757, v_num=1, val_acc=0.740]
Epoch 65:  44%|████▍     | 52/117 [00:02<00:03, 19.32it/s, loss=0.757, v_num=1, val_acc=0.740]
Epoch 65:  44%|████▍     | 52/117 [00:02<00:03, 19.14it/s, loss=0.757, v_num=1, val_acc=0.740]
Epoch 65:  45%|████▌     | 53/117 [00:02<00:03, 19.44it/s, loss=0.757, v_num=1, val_acc=0.740]
Epoch 65:  45%|████▌     | 53/117 [00:02<00:03, 19.27it/s, loss=0.752, v_num=1, val_acc=0.740]
Epoch 65:  46%|████▌     | 54/117 [00:02<00:03, 19.56it/s, loss=0.752, v_num=1, val_acc=0.740]
Epoch 65:  46%|████▌     | 54/117 [00:02<00:03, 19.39it/s, loss=0.748, v_num=1, val_acc=0.740]
Epoch 65:  47%|████▋     | 55/117 [00:02<00:03, 19.68it/s, loss=0.748, v_num=1, val_acc=0.740]
Epoch 65:  47%|████▋     | 55/117 [00:02<00:03, 19.50it/s, loss=0.752, v_num=1, val_acc=0.740]
Epoch 65:  48%|████▊     | 56/117 [00:02<00:03, 19.79it/s, loss=0.752, v_num=1, val_acc=0.740]
Epoch 65:  48%|████▊     | 56/117 [00:02<00:03, 19.62it/s, loss=0.76, v_num=1, val_acc=0.740]
Epoch 65:  49%|████▊     | 57/117 [00:02<00:03, 19.90it/s, loss=0.76, v_num=1, val_acc=0.740]
Epoch 65:  49%|████▊     | 57/117 [00:02<00:03, 19.72it/s, loss=0.759, v_num=1, val_acc=0.740]
Epoch 65:  50%|████▉     | 58/117 [00:02<00:02, 20.01it/s, loss=0.759, v_num=1, val_acc=0.740]
Epoch 65:  50%|████▉     | 58/117 [00:02<00:02, 19.83it/s, loss=0.753, v_num=1, val_acc=0.740]
Epoch 65:  50%|█████     | 59/117 [00:02<00:02, 20.11it/s, loss=0.753, v_num=1, val_acc=0.740]
Epoch 65:  50%|█████     | 59/117 [00:02<00:02, 19.94it/s, loss=0.755, v_num=1, val_acc=0.740]
Epoch 65:  51%|█████▏    | 60/117 [00:02<00:02, 20.22it/s, loss=0.755, v_num=1, val_acc=0.740]
Epoch 65:  51%|█████▏    | 60/117 [00:02<00:02, 20.04it/s, loss=0.758, v_num=1, val_acc=0.740]
Epoch 65:  52%|█████▏    | 61/117 [00:03<00:02, 20.32it/s, loss=0.758, v_num=1, val_acc=0.740]
Epoch 65:  52%|█████▏    | 61/117 [00:03<00:02, 20.15it/s, loss=0.763, v_num=1, val_acc=0.740]
Epoch 65:  53%|█████▎    | 62/117 [00:03<00:02, 20.42it/s, loss=0.763, v_num=1, val_acc=0.740]
Epoch 65:  53%|█████▎    | 62/117 [00:03<00:02, 20.25it/s, loss=0.767, v_num=1, val_acc=0.740]
Epoch 65:  54%|█████▍    | 63/117 [00:03<00:02, 20.51it/s, loss=0.767, v_num=1, val_acc=0.740]
Epoch 65:  54%|█████▍    | 63/117 [00:03<00:02, 20.35it/s, loss=0.773, v_num=1, val_acc=0.740]
Epoch 65:  55%|█████▍    | 64/117 [00:03<00:02, 20.61it/s, loss=0.773, v_num=1, val_acc=0.740]
Epoch 65:  55%|█████▍    | 64/117 [00:03<00:02, 20.44it/s, loss=0.771, v_num=1, val_acc=0.740]
Epoch 65:  56%|█████▌    | 65/117 [00:03<00:02, 20.70it/s, loss=0.771, v_num=1, val_acc=0.740]
Epoch 65:  56%|█████▌    | 65/117 [00:03<00:02, 20.54it/s, loss=0.765, v_num=1, val_acc=0.740]
Epoch 65:  56%|█████▋    | 66/117 [00:03<00:02, 20.79it/s, loss=0.765, v_num=1, val_acc=0.740]
Epoch 65:  56%|█████▋    | 66/117 [00:03<00:02, 20.63it/s, loss=0.774, v_num=1, val_acc=0.740]
Epoch 65:  57%|█████▋    | 67/117 [00:03<00:02, 20.88it/s, loss=0.774, v_num=1, val_acc=0.740]
Epoch 65:  57%|█████▋    | 67/117 [00:03<00:02, 20.72it/s, loss=0.776, v_num=1, val_acc=0.740]
Epoch 65:  58%|█████▊    | 68/117 [00:03<00:02, 20.97it/s, loss=0.776, v_num=1, val_acc=0.740]
Epoch 65:  58%|█████▊    | 68/117 [00:03<00:02, 20.80it/s, loss=0.772, v_num=1, val_acc=0.740]
Epoch 65:  59%|█████▉    | 69/117 [00:03<00:02, 21.05it/s, loss=0.772, v_num=1, val_acc=0.740]
Epoch 65:  59%|█████▉    | 69/117 [00:03<00:02, 20.89it/s, loss=0.772, v_num=1, val_acc=0.740]
Epoch 65:  60%|█████▉    | 70/117 [00:03<00:02, 21.13it/s, loss=0.772, v_num=1, val_acc=0.740]
Epoch 65:  60%|█████▉    | 70/117 [00:03<00:02, 20.97it/s, loss=0.759, v_num=1, val_acc=0.740]
Epoch 65:  61%|██████    | 71/117 [00:03<00:02, 21.21it/s, loss=0.759, v_num=1, val_acc=0.740]
Epoch 65:  61%|██████    | 71/117 [00:03<00:02, 21.06it/s, loss=0.756, v_num=1, val_acc=0.740]
Epoch 65:  62%|██████▏   | 72/117 [00:03<00:02, 21.30it/s, loss=0.756, v_num=1, val_acc=0.740]
Epoch 65:  62%|██████▏   | 72/117 [00:03<00:02, 21.14it/s, loss=0.753, v_num=1, val_acc=0.740]
Epoch 65:  62%|██████▏   | 73/117 [00:03<00:02, 21.37it/s, loss=0.753, v_num=1, val_acc=0.740]
Epoch 65:  62%|██████▏   | 73/117 [00:03<00:02, 21.22it/s, loss=0.752, v_num=1, val_acc=0.740]
Epoch 65:  63%|██████▎   | 74/117 [00:03<00:02, 21.45it/s, loss=0.752, v_num=1, val_acc=0.740]
Epoch 65:  63%|██████▎   | 74/117 [00:03<00:02, 21.29it/s, loss=0.76, v_num=1, val_acc=0.740]
Epoch 65:  64%|██████▍   | 75/117 [00:03<00:01, 21.52it/s, loss=0.76, v_num=1, val_acc=0.740]
Epoch 65:  64%|██████▍   | 75/117 [00:03<00:01, 21.37it/s, loss=0.756, v_num=1, val_acc=0.740]
Epoch 65:  65%|██████▍   | 76/117 [00:03<00:01, 21.58it/s, loss=0.756, v_num=1, val_acc=0.740]
Epoch 65:  65%|██████▍   | 76/117 [00:03<00:01, 21.44it/s, loss=0.75, v_num=1, val_acc=0.740]
Epoch 65:  66%|██████▌   | 77/117 [00:03<00:01, 21.67it/s, loss=0.75, v_num=1, val_acc=0.740]
Epoch 65:  66%|██████▌   | 77/117 [00:03<00:01, 21.51it/s, loss=0.744, v_num=1, val_acc=0.740]
Epoch 65:  67%|██████▋   | 78/117 [00:03<00:01, 21.74it/s, loss=0.744, v_num=1, val_acc=0.740]
Epoch 65:  67%|██████▋   | 78/117 [00:03<00:01, 21.58it/s, loss=0.748, v_num=1, val_acc=0.740]
Epoch 65:  68%|██████▊   | 79/117 [00:03<00:01, 21.81it/s, loss=0.748, v_num=1, val_acc=0.740]
Epoch 65:  68%|██████▊   | 79/117 [00:03<00:01, 21.65it/s, loss=0.745, v_num=1, val_acc=0.740]
Epoch 65:  68%|██████▊   | 80/117 [00:03<00:01, 21.87it/s, loss=0.745, v_num=1, val_acc=0.740]
Epoch 65:  68%|██████▊   | 80/117 [00:03<00:01, 21.72it/s, loss=0.739, v_num=1, val_acc=0.740]
Epoch 65:  69%|██████▉   | 81/117 [00:03<00:01, 21.94it/s, loss=0.739, v_num=1, val_acc=0.740]
Epoch 65:  69%|██████▉   | 81/117 [00:03<00:01, 21.79it/s, loss=0.736, v_num=1, val_acc=0.740]
Epoch 65:  70%|███████   | 82/117 [00:03<00:01, 21.98it/s, loss=0.736, v_num=1, val_acc=0.740]
Epoch 65:  70%|███████   | 82/117 [00:03<00:01, 21.84it/s, loss=0.735, v_num=1, val_acc=0.740]
Epoch 65:  71%|███████   | 83/117 [00:03<00:01, 22.05it/s, loss=0.735, v_num=1, val_acc=0.740]
Epoch 65:  71%|███████   | 83/117 [00:03<00:01, 21.90it/s, loss=0.742, v_num=1, val_acc=0.740]
Epoch 65:  72%|███████▏  | 84/117 [00:03<00:01, 22.12it/s, loss=0.742, v_num=1, val_acc=0.740]
Epoch 65:  72%|███████▏  | 84/117 [00:03<00:01, 21.97it/s, loss=0.749, v_num=1, val_acc=0.740]
Epoch 65:  73%|███████▎  | 85/117 [00:03<00:01, 22.18it/s, loss=0.749, v_num=1, val_acc=0.740]
Epoch 65:  73%|███████▎  | 85/117 [00:03<00:01, 22.03it/s, loss=0.758, v_num=1, val_acc=0.740]
Epoch 65:  74%|███████▎  | 86/117 [00:03<00:01, 22.24it/s, loss=0.758, v_num=1, val_acc=0.740]
Epoch 65:  74%|███████▎  | 86/117 [00:03<00:01, 22.09it/s, loss=0.751, v_num=1, val_acc=0.740]
Epoch 65:  74%|███████▍  | 87/117 [00:03<00:01, 22.30it/s, loss=0.751, v_num=1, val_acc=0.740]
Epoch 65:  74%|███████▍  | 87/117 [00:03<00:01, 22.16it/s, loss=0.754, v_num=1, val_acc=0.740]
Epoch 65:  75%|███████▌  | 88/117 [00:03<00:01, 22.36it/s, loss=0.754, v_num=1, val_acc=0.740]
Epoch 65:  75%|███████▌  | 88/117 [00:03<00:01, 22.22it/s, loss=0.759, v_num=1, val_acc=0.740]
Epoch 65:  76%|███████▌  | 89/117 [00:03<00:01, 22.42it/s, loss=0.759, v_num=1, val_acc=0.740]
Epoch 65:  76%|███████▌  | 89/117 [00:03<00:01, 22.28it/s, loss=0.763, v_num=1, val_acc=0.740]
Epoch 65:  77%|███████▋  | 90/117 [00:04<00:01, 22.48it/s, loss=0.763, v_num=1, val_acc=0.740]
Epoch 65:  77%|███████▋  | 90/117 [00:04<00:01, 22.34it/s, loss=0.772, v_num=1, val_acc=0.740]
Epoch 65:  78%|███████▊  | 91/117 [00:04<00:01, 22.54it/s, loss=0.772, v_num=1, val_acc=0.740]
Epoch 65:  78%|███████▊  | 91/117 [00:04<00:01, 22.39it/s, loss=0.774, v_num=1, val_acc=0.740]
Epoch 65:  79%|███████▊  | 92/117 [00:04<00:01, 22.59it/s, loss=0.774, v_num=1, val_acc=0.740]
Epoch 65:  79%|███████▊  | 92/117 [00:04<00:01, 22.45it/s, loss=0.781, v_num=1, val_acc=0.740]
Epoch 65:  79%|███████▉  | 93/117 [00:04<00:01, 22.64it/s, loss=0.781, v_num=1, val_acc=0.740]
Epoch 65:  79%|███████▉  | 93/117 [00:04<00:01, 22.51it/s, loss=0.785, v_num=1, val_acc=0.740]
Epoch 65:  80%|████████  | 94/117 [00:04<00:01, 22.70it/s, loss=0.785, v_num=1, val_acc=0.740]
Epoch 65:  80%|████████  | 94/117 [00:04<00:01, 22.56it/s, loss=0.78, v_num=1, val_acc=0.740]
Epoch 65:  81%|████████  | 95/117 [00:04<00:00, 22.75it/s, loss=0.78, v_num=1, val_acc=0.740]
Epoch 65:  81%|████████  | 95/117 [00:04<00:00, 22.61it/s, loss=0.783, v_num=1, val_acc=0.740]
Epoch 65:  82%|████████▏ | 96/117 [00:04<00:00, 22.80it/s, loss=0.783, v_num=1, val_acc=0.740]
Epoch 65:  82%|████████▏ | 96/117 [00:04<00:00, 22.66it/s, loss=0.782, v_num=1, val_acc=0.740]
Epoch 65:  83%|████████▎ | 97/117 [00:04<00:00, 22.85it/s, loss=0.782, v_num=1, val_acc=0.740]
Epoch 65:  83%|████████▎ | 97/117 [00:04<00:00, 22.71it/s, loss=0.792, v_num=1, val_acc=0.740]

Validation: 0it [00:00, ?it/s]

Validation:   0%|          | 0/20 [00:00<?, ?it/s]

Validation DataLoader 0:   0%|          | 0/20 [00:00<?, ?it/s]

Validation DataLoader 0:   5%|▌         | 1/20 [00:00<00:00, 175.55it/s]
Epoch 65:  84%|████████▍ | 98/117 [00:05<00:00, 19.18it/s, loss=0.792, v_num=1, val_acc=0.740]

Validation DataLoader 0:  10%|█         | 2/20 [00:00<00:00, 55.62it/s]
Epoch 65:  85%|████████▍ | 99/117 [00:05<00:00, 19.26it/s, loss=0.792, v_num=1, val_acc=0.740]

Validation DataLoader 0:  15%|█▌        | 3/20 [00:00<00:00, 44.42it/s]
Epoch 65:  85%|████████▌ | 100/117 [00:05<00:00, 19.34it/s, loss=0.792, v_num=1, val_acc=0.740]

Validation DataLoader 0:  20%|██        | 4/20 [00:00<00:00, 40.43it/s]
Epoch 65:  86%|████████▋ | 101/117 [00:05<00:00, 19.41it/s, loss=0.792, v_num=1, val_acc=0.740]

Validation DataLoader 0:  25%|██▌       | 5/20 [00:00<00:00, 38.26it/s]
Epoch 65:  87%|████████▋ | 102/117 [00:05<00:00, 19.49it/s, loss=0.792, v_num=1, val_acc=0.740]

Validation DataLoader 0:  30%|███       | 6/20 [00:00<00:00, 36.89it/s]
Epoch 65:  88%|████████▊ | 103/117 [00:05<00:00, 19.56it/s, loss=0.792, v_num=1, val_acc=0.740]

Validation DataLoader 0:  35%|███▌      | 7/20 [00:00<00:00, 36.06it/s]
Epoch 65:  89%|████████▉ | 104/117 [00:05<00:00, 19.63it/s, loss=0.792, v_num=1, val_acc=0.740]

Validation DataLoader 0:  40%|████      | 8/20 [00:00<00:00, 35.47it/s]
Epoch 65:  90%|████████▉ | 105/117 [00:05<00:00, 19.70it/s, loss=0.792, v_num=1, val_acc=0.740]

Validation DataLoader 0:  45%|████▌     | 9/20 [00:00<00:00, 34.97it/s]
Epoch 65:  91%|█████████ | 106/117 [00:05<00:00, 19.77it/s, loss=0.792, v_num=1, val_acc=0.740]

Validation DataLoader 0:  50%|█████     | 10/20 [00:00<00:00, 34.60it/s]
Epoch 65:  91%|█████████▏| 107/117 [00:05<00:00, 19.84it/s, loss=0.792, v_num=1, val_acc=0.740]

Validation DataLoader 0:  55%|█████▌    | 11/20 [00:00<00:00, 34.32it/s]
Epoch 65:  92%|█████████▏| 108/117 [00:05<00:00, 19.91it/s, loss=0.792, v_num=1, val_acc=0.740]

Validation DataLoader 0:  60%|██████    | 12/20 [00:00<00:00, 34.08it/s]
Epoch 65:  93%|█████████▎| 109/117 [00:05<00:00, 19.98it/s, loss=0.792, v_num=1, val_acc=0.740]

Validation DataLoader 0:  65%|██████▌   | 13/20 [00:00<00:00, 33.89it/s]
Epoch 65:  94%|█████████▍| 110/117 [00:05<00:00, 20.05it/s, loss=0.792, v_num=1, val_acc=0.740]

Validation DataLoader 0:  70%|███████   | 14/20 [00:00<00:00, 33.70it/s]
Epoch 65:  95%|█████████▍| 111/117 [00:05<00:00, 20.11it/s, loss=0.792, v_num=1, val_acc=0.740]

Validation DataLoader 0:  75%|███████▌  | 15/20 [00:00<00:00, 33.56it/s]
Epoch 65:  96%|█████████▌| 112/117 [00:05<00:00, 20.18it/s, loss=0.792, v_num=1, val_acc=0.740]

Validation DataLoader 0:  80%|████████  | 16/20 [00:00<00:00, 33.42it/s]
Epoch 65:  97%|█████████▋| 113/117 [00:05<00:00, 20.24it/s, loss=0.792, v_num=1, val_acc=0.740]

Validation DataLoader 0:  85%|████████▌ | 17/20 [00:00<00:00, 33.29it/s]
Epoch 65:  97%|█████████▋| 114/117 [00:05<00:00, 20.30it/s, loss=0.792, v_num=1, val_acc=0.740]

Validation DataLoader 0:  90%|█████████ | 18/20 [00:00<00:00, 33.19it/s]
Epoch 65:  98%|█████████▊| 115/117 [00:05<00:00, 20.37it/s, loss=0.792, v_num=1, val_acc=0.740]

Validation DataLoader 0:  95%|█████████▌| 19/20 [00:00<00:00, 33.11it/s]
Epoch 65:  99%|█████████▉| 116/117 [00:05<00:00, 20.43it/s, loss=0.792, v_num=1, val_acc=0.740]

Validation DataLoader 0: 100%|██████████| 20/20 [00:00<00:00, 33.10it/s]
Epoch 65: 100%|██████████| 117/117 [00:05<00:00, 20.50it/s, loss=0.792, v_num=1, val_acc=0.740]
Epoch 65: 100%|██████████| 117/117 [00:05<00:00, 20.43it/s, loss=0.792, v_num=1, val_acc=0.750]


Epoch 65: 100%|██████████| 117/117 [00:05<00:00, 20.42it/s, loss=0.792, v_num=1, val_acc=0.750]
Epoch 65:   0%|          | 0/117 [00:00<?, ?it/s, loss=0.792, v_num=1, val_acc=0.750]
Epoch 66:   0%|          | 0/117 [00:00<?, ?it/s, loss=0.792, v_num=1, val_acc=0.750]
Epoch 66:   1%|          | 1/117 [00:00<01:47,  1.08it/s, loss=0.792, v_num=1, val_acc=0.750]
Epoch 66:   1%|          | 1/117 [00:00<01:49,  1.06it/s, loss=0.795, v_num=1, val_acc=0.750]
Epoch 66:   2%|▏         | 2/117 [00:00<00:55,  2.09it/s, loss=0.795, v_num=1, val_acc=0.750]
Epoch 66:   2%|▏         | 2/117 [00:00<00:56,  2.04it/s, loss=0.803, v_num=1, val_acc=0.750]
Epoch 66:   3%|▎         | 3/117 [00:00<00:37,  3.01it/s, loss=0.803, v_num=1, val_acc=0.750]
Epoch 66:   3%|▎         | 3/117 [00:01<00:38,  2.94it/s, loss=0.808, v_num=1, val_acc=0.750]
Epoch 66:   3%|▎         | 4/117 [00:01<00:29,  3.89it/s, loss=0.808, v_num=1, val_acc=0.750]
Epoch 66:   3%|▎         | 4/117 [00:01<00:29,  3.79it/s, loss=0.815, v_num=1, val_acc=0.750]
Epoch 66:   4%|▍         | 5/117 [00:01<00:23,  4.69it/s, loss=0.815, v_num=1, val_acc=0.750]
Epoch 66:   4%|▍         | 5/117 [00:01<00:24,  4.58it/s, loss=0.819, v_num=1, val_acc=0.750]
Epoch 66:   5%|▌         | 6/117 [00:01<00:20,  5.45it/s, loss=0.819, v_num=1, val_acc=0.750]
Epoch 66:   5%|▌         | 6/117 [00:01<00:20,  5.33it/s, loss=0.809, v_num=1, val_acc=0.750]
Epoch 66:   6%|▌         | 7/117 [00:01<00:17,  6.16it/s, loss=0.809, v_num=1, val_acc=0.750]
Epoch 66:   6%|▌         | 7/117 [00:01<00:18,  6.03it/s, loss=0.809, v_num=1, val_acc=0.750]
Epoch 66:   7%|▋         | 8/117 [00:01<00:15,  6.84it/s, loss=0.809, v_num=1, val_acc=0.750]
Epoch 66:   7%|▋         | 8/117 [00:01<00:16,  6.70it/s, loss=0.804, v_num=1, val_acc=0.750]
Epoch 66:   8%|▊         | 9/117 [00:01<00:14,  7.47it/s, loss=0.804, v_num=1, val_acc=0.750]
Epoch 66:   8%|▊         | 9/117 [00:01<00:14,  7.32it/s, loss=0.801, v_num=1, val_acc=0.750]
Epoch 66:   9%|▊         | 10/117 [00:01<00:13,  8.01it/s, loss=0.801, v_num=1, val_acc=0.750]
Epoch 66:   9%|▊         | 10/117 [00:01<00:13,  7.85it/s, loss=0.798, v_num=1, val_acc=0.750]
Epoch 66:   9%|▉         | 11/117 [00:01<00:12,  8.58it/s, loss=0.798, v_num=1, val_acc=0.750]
Epoch 66:   9%|▉         | 11/117 [00:01<00:12,  8.41it/s, loss=0.801, v_num=1, val_acc=0.750]
Epoch 66:  10%|█         | 12/117 [00:01<00:11,  9.12it/s, loss=0.801, v_num=1, val_acc=0.750]
Epoch 66:  10%|█         | 12/117 [00:01<00:11,  8.94it/s, loss=0.791, v_num=1, val_acc=0.750]
Epoch 66:  11%|█         | 13/117 [00:01<00:10,  9.63it/s, loss=0.791, v_num=1, val_acc=0.750]
Epoch 66:  11%|█         | 13/117 [00:01<00:11,  9.45it/s, loss=0.784, v_num=1, val_acc=0.750]
Epoch 66:  12%|█▏        | 14/117 [00:01<00:10, 10.12it/s, loss=0.784, v_num=1, val_acc=0.750]
Epoch 66:  12%|█▏        | 14/117 [00:01<00:10,  9.94it/s, loss=0.787, v_num=1, val_acc=0.750]
Epoch 66:  13%|█▎        | 15/117 [00:01<00:09, 10.58it/s, loss=0.787, v_num=1, val_acc=0.750]
Epoch 66:  13%|█▎        | 15/117 [00:01<00:09, 10.39it/s, loss=0.78, v_num=1, val_acc=0.750]
Epoch 66:  14%|█▎        | 16/117 [00:01<00:09, 11.02it/s, loss=0.78, v_num=1, val_acc=0.750]
Epoch 66:  14%|█▎        | 16/117 [00:01<00:09, 10.83it/s, loss=0.779, v_num=1, val_acc=0.750]
Epoch 66:  15%|█▍        | 17/117 [00:01<00:08, 11.43it/s, loss=0.779, v_num=1, val_acc=0.750]
Epoch 66:  15%|█▍        | 17/117 [00:01<00:08, 11.24it/s, loss=0.778, v_num=1, val_acc=0.750]
Epoch 66:  15%|█▌        | 18/117 [00:01<00:08, 11.77it/s, loss=0.778, v_num=1, val_acc=0.750]
Epoch 66:  15%|█▌        | 18/117 [00:01<00:08, 11.58it/s, loss=0.78, v_num=1, val_acc=0.750]
Epoch 66:  16%|█▌        | 19/117 [00:01<00:08, 12.16it/s, loss=0.78, v_num=1, val_acc=0.750]
Epoch 66:  16%|█▌        | 19/117 [00:01<00:08, 11.96it/s, loss=0.78, v_num=1, val_acc=0.750]
Epoch 66:  17%|█▋        | 20/117 [00:01<00:07, 12.53it/s, loss=0.78, v_num=1, val_acc=0.750]
Epoch 66:  17%|█▋        | 20/117 [00:01<00:07, 12.33it/s, loss=0.777, v_num=1, val_acc=0.750]
Epoch 66:  18%|█▊        | 21/117 [00:01<00:07, 12.88it/s, loss=0.777, v_num=1, val_acc=0.750]
Epoch 66:  18%|█▊        | 21/117 [00:01<00:07, 12.68it/s, loss=0.769, v_num=1, val_acc=0.750]
Epoch 66:  19%|█▉        | 22/117 [00:01<00:07, 13.21it/s, loss=0.769, v_num=1, val_acc=0.750]
Epoch 66:  19%|█▉        | 22/117 [00:01<00:07, 13.02it/s, loss=0.757, v_num=1, val_acc=0.750]
Epoch 66:  20%|█▉        | 23/117 [00:01<00:06, 13.54it/s, loss=0.757, v_num=1, val_acc=0.750]
Epoch 66:  20%|█▉        | 23/117 [00:01<00:07, 13.34it/s, loss=0.759, v_num=1, val_acc=0.750]
Epoch 66:  21%|██        | 24/117 [00:01<00:06, 13.79it/s, loss=0.759, v_num=1, val_acc=0.750]
Epoch 66:  21%|██        | 24/117 [00:01<00:06, 13.62it/s, loss=0.758, v_num=1, val_acc=0.750]
Epoch 66:  21%|██▏       | 25/117 [00:01<00:06, 14.11it/s, loss=0.758, v_num=1, val_acc=0.750]
Epoch 66:  21%|██▏       | 25/117 [00:01<00:06, 13.91it/s, loss=0.755, v_num=1, val_acc=0.750]
Epoch 66:  22%|██▏       | 26/117 [00:01<00:06, 14.39it/s, loss=0.755, v_num=1, val_acc=0.750]
Epoch 66:  22%|██▏       | 26/117 [00:01<00:06, 14.19it/s, loss=0.767, v_num=1, val_acc=0.750]
Epoch 66:  23%|██▎       | 27/117 [00:01<00:06, 14.67it/s, loss=0.767, v_num=1, val_acc=0.750]
Epoch 66:  23%|██▎       | 27/117 [00:01<00:06, 14.47it/s, loss=0.765, v_num=1, val_acc=0.750]
Epoch 66:  24%|██▍       | 28/117 [00:01<00:05, 14.94it/s, loss=0.765, v_num=1, val_acc=0.750]
Epoch 66:  24%|██▍       | 28/117 [00:01<00:06, 14.74it/s, loss=0.763, v_num=1, val_acc=0.750]
Epoch 66:  25%|██▍       | 29/117 [00:01<00:05, 15.19it/s, loss=0.763, v_num=1, val_acc=0.750]
Epoch 66:  25%|██▍       | 29/117 [00:01<00:05, 14.99it/s, loss=0.773, v_num=1, val_acc=0.750]
Epoch 66:  26%|██▌       | 30/117 [00:01<00:05, 15.43it/s, loss=0.773, v_num=1, val_acc=0.750]
Epoch 66:  26%|██▌       | 30/117 [00:01<00:05, 15.24it/s, loss=0.77, v_num=1, val_acc=0.750]
Epoch 66:  26%|██▋       | 31/117 [00:01<00:05, 15.67it/s, loss=0.77, v_num=1, val_acc=0.750]
Epoch 66:  26%|██▋       | 31/117 [00:02<00:05, 15.47it/s, loss=0.77, v_num=1, val_acc=0.750]
Epoch 66:  27%|██▋       | 32/117 [00:02<00:05, 15.90it/s, loss=0.77, v_num=1, val_acc=0.750]
Epoch 66:  27%|██▋       | 32/117 [00:02<00:05, 15.70it/s, loss=0.77, v_num=1, val_acc=0.750]
Epoch 66:  28%|██▊       | 33/117 [00:02<00:05, 16.12it/s, loss=0.77, v_num=1, val_acc=0.750]
Epoch 66:  28%|██▊       | 33/117 [00:02<00:05, 15.92it/s, loss=0.769, v_num=1, val_acc=0.750]
Epoch 66:  29%|██▉       | 34/117 [00:02<00:05, 16.33it/s, loss=0.769, v_num=1, val_acc=0.750]
Epoch 66:  29%|██▉       | 34/117 [00:02<00:05, 16.13it/s, loss=0.767, v_num=1, val_acc=0.750]
Epoch 66:  30%|██▉       | 35/117 [00:02<00:04, 16.54it/s, loss=0.767, v_num=1, val_acc=0.750]
Epoch 66:  30%|██▉       | 35/117 [00:02<00:05, 16.35it/s, loss=0.768, v_num=1, val_acc=0.750]
Epoch 66:  31%|███       | 36/117 [00:02<00:04, 16.74it/s, loss=0.768, v_num=1, val_acc=0.750]
Epoch 66:  31%|███       | 36/117 [00:02<00:04, 16.55it/s, loss=0.77, v_num=1, val_acc=0.750]
Epoch 66:  32%|███▏      | 37/117 [00:02<00:04, 16.94it/s, loss=0.77, v_num=1, val_acc=0.750]
Epoch 66:  32%|███▏      | 37/117 [00:02<00:04, 16.74it/s, loss=0.775, v_num=1, val_acc=0.750]
Epoch 66:  32%|███▏      | 38/117 [00:02<00:04, 17.12it/s, loss=0.775, v_num=1, val_acc=0.750]
Epoch 66:  32%|███▏      | 38/117 [00:02<00:04, 16.93it/s, loss=0.771, v_num=1, val_acc=0.750]
Epoch 66:  33%|███▎      | 39/117 [00:02<00:04, 17.31it/s, loss=0.771, v_num=1, val_acc=0.750]
Epoch 66:  33%|███▎      | 39/117 [00:02<00:04, 17.11it/s, loss=0.768, v_num=1, val_acc=0.750]
Epoch 66:  34%|███▍      | 40/117 [00:02<00:04, 17.48it/s, loss=0.768, v_num=1, val_acc=0.750]
Epoch 66:  34%|███▍      | 40/117 [00:02<00:04, 17.29it/s, loss=0.763, v_num=1, val_acc=0.750]
Epoch 66:  35%|███▌      | 41/117 [00:02<00:04, 17.65it/s, loss=0.763, v_num=1, val_acc=0.750]
Epoch 66:  35%|███▌      | 41/117 [00:02<00:04, 17.46it/s, loss=0.763, v_num=1, val_acc=0.750]
Epoch 66:  36%|███▌      | 42/117 [00:02<00:04, 17.81it/s, loss=0.763, v_num=1, val_acc=0.750]
Epoch 66:  36%|███▌      | 42/117 [00:02<00:04, 17.62it/s, loss=0.767, v_num=1, val_acc=0.750]
Epoch 66:  37%|███▋      | 43/117 [00:02<00:04, 17.97it/s, loss=0.767, v_num=1, val_acc=0.750]
Epoch 66:  37%|███▋      | 43/117 [00:02<00:04, 17.79it/s, loss=0.76, v_num=1, val_acc=0.750]
Epoch 66:  38%|███▊      | 44/117 [00:02<00:04, 18.13it/s, loss=0.76, v_num=1, val_acc=0.750]
Epoch 66:  38%|███▊      | 44/117 [00:02<00:04, 17.94it/s, loss=0.758, v_num=1, val_acc=0.750]
Epoch 66:  38%|███▊      | 45/117 [00:02<00:03, 18.29it/s, loss=0.758, v_num=1, val_acc=0.750]
Epoch 66:  38%|███▊      | 45/117 [00:02<00:03, 18.10it/s, loss=0.759, v_num=1, val_acc=0.750]
Epoch 66:  39%|███▉      | 46/117 [00:02<00:03, 18.43it/s, loss=0.759, v_num=1, val_acc=0.750]
Epoch 66:  39%|███▉      | 46/117 [00:02<00:03, 18.25it/s, loss=0.75, v_num=1, val_acc=0.750]
Epoch 66:  40%|████      | 47/117 [00:02<00:03, 18.58it/s, loss=0.75, v_num=1, val_acc=0.750]
Epoch 66:  40%|████      | 47/117 [00:02<00:03, 18.39it/s, loss=0.748, v_num=1, val_acc=0.750]
Epoch 66:  41%|████      | 48/117 [00:02<00:03, 18.72it/s, loss=0.748, v_num=1, val_acc=0.750]
Epoch 66:  41%|████      | 48/117 [00:02<00:03, 18.53it/s, loss=0.747, v_num=1, val_acc=0.750]
Epoch 66:  42%|████▏     | 49/117 [00:02<00:03, 18.84it/s, loss=0.747, v_num=1, val_acc=0.750]
Epoch 66:  42%|████▏     | 49/117 [00:02<00:03, 18.66it/s, loss=0.745, v_num=1, val_acc=0.750]
Epoch 66:  43%|████▎     | 50/117 [00:02<00:03, 18.98it/s, loss=0.745, v_num=1, val_acc=0.750]
Epoch 66:  43%|████▎     | 50/117 [00:02<00:03, 18.80it/s, loss=0.744, v_num=1, val_acc=0.750]
Epoch 66:  44%|████▎     | 51/117 [00:02<00:03, 19.11it/s, loss=0.744, v_num=1, val_acc=0.750]
Epoch 66:  44%|████▎     | 51/117 [00:02<00:03, 18.93it/s, loss=0.75, v_num=1, val_acc=0.750]
Epoch 66:  44%|████▍     | 52/117 [00:02<00:03, 19.23it/s, loss=0.75, v_num=1, val_acc=0.750]
Epoch 66:  44%|████▍     | 52/117 [00:02<00:03, 19.06it/s, loss=0.753, v_num=1, val_acc=0.750]
Epoch 66:  45%|████▌     | 53/117 [00:02<00:03, 19.36it/s, loss=0.753, v_num=1, val_acc=0.750]
Epoch 66:  45%|████▌     | 53/117 [00:02<00:03, 19.18it/s, loss=0.755, v_num=1, val_acc=0.750]
Epoch 66:  46%|████▌     | 54/117 [00:02<00:03, 19.48it/s, loss=0.755, v_num=1, val_acc=0.750]
Epoch 66:  46%|████▌     | 54/117 [00:02<00:03, 19.30it/s, loss=0.763, v_num=1, val_acc=0.750]
Epoch 66:  47%|████▋     | 55/117 [00:02<00:03, 19.59it/s, loss=0.763, v_num=1, val_acc=0.750]
Epoch 66:  47%|████▋     | 55/117 [00:02<00:03, 19.42it/s, loss=0.762, v_num=1, val_acc=0.750]
Epoch 66:  48%|████▊     | 56/117 [00:02<00:03, 19.70it/s, loss=0.762, v_num=1, val_acc=0.750]
Epoch 66:  48%|████▊     | 56/117 [00:02<00:03, 19.53it/s, loss=0.759, v_num=1, val_acc=0.750]
Epoch 66:  49%|████▊     | 57/117 [00:02<00:03, 19.81it/s, loss=0.759, v_num=1, val_acc=0.750]
Epoch 66:  49%|████▊     | 57/117 [00:02<00:03, 19.64it/s, loss=0.751, v_num=1, val_acc=0.750]
Epoch 66:  50%|████▉     | 58/117 [00:02<00:02, 19.91it/s, loss=0.751, v_num=1, val_acc=0.750]
Epoch 66:  50%|████▉     | 58/117 [00:02<00:02, 19.74it/s, loss=0.746, v_num=1, val_acc=0.750]
Epoch 66:  50%|█████     | 59/117 [00:02<00:02, 20.02it/s, loss=0.746, v_num=1, val_acc=0.750]
Epoch 66:  50%|█████     | 59/117 [00:02<00:02, 19.85it/s, loss=0.75, v_num=1, val_acc=0.750]
Epoch 66:  51%|█████▏    | 60/117 [00:02<00:02, 20.12it/s, loss=0.75, v_num=1, val_acc=0.750]
Epoch 66:  51%|█████▏    | 60/117 [00:03<00:02, 19.95it/s, loss=0.753, v_num=1, val_acc=0.750]
Epoch 66:  52%|█████▏    | 61/117 [00:03<00:02, 20.22it/s, loss=0.753, v_num=1, val_acc=0.750]
Epoch 66:  52%|█████▏    | 61/117 [00:03<00:02, 20.05it/s, loss=0.76, v_num=1, val_acc=0.750]
Epoch 66:  53%|█████▎    | 62/117 [00:03<00:02, 20.32it/s, loss=0.76, v_num=1, val_acc=0.750]
Epoch 66:  53%|█████▎    | 62/117 [00:03<00:02, 20.15it/s, loss=0.756, v_num=1, val_acc=0.750]
Epoch 66:  54%|█████▍    | 63/117 [00:03<00:02, 20.42it/s, loss=0.756, v_num=1, val_acc=0.750]
Epoch 66:  54%|█████▍    | 63/117 [00:03<00:02, 20.25it/s, loss=0.759, v_num=1, val_acc=0.750]
Epoch 66:  55%|█████▍    | 64/117 [00:03<00:02, 20.51it/s, loss=0.759, v_num=1, val_acc=0.750]
Epoch 66:  55%|█████▍    | 64/117 [00:03<00:02, 20.35it/s, loss=0.758, v_num=1, val_acc=0.750]
Epoch 66:  56%|█████▌    | 65/117 [00:03<00:02, 20.60it/s, loss=0.758, v_num=1, val_acc=0.750]
Epoch 66:  56%|█████▌    | 65/117 [00:03<00:02, 20.44it/s, loss=0.756, v_num=1, val_acc=0.750]
Epoch 66:  56%|█████▋    | 66/117 [00:03<00:02, 20.65it/s, loss=0.756, v_num=1, val_acc=0.750]
Epoch 66:  56%|█████▋    | 66/117 [00:03<00:02, 20.50it/s, loss=0.75, v_num=1, val_acc=0.750]
Epoch 66:  57%|█████▋    | 67/117 [00:03<00:02, 20.75it/s, loss=0.75, v_num=1, val_acc=0.750]
Epoch 66:  57%|█████▋    | 67/117 [00:03<00:02, 20.59it/s, loss=0.748, v_num=1, val_acc=0.750]
Epoch 66:  58%|█████▊    | 68/117 [00:03<00:02, 20.84it/s, loss=0.748, v_num=1, val_acc=0.750]
Epoch 66:  58%|█████▊    | 68/117 [00:03<00:02, 20.68it/s, loss=0.748, v_num=1, val_acc=0.750]
Epoch 66:  59%|█████▉    | 69/117 [00:03<00:02, 20.92it/s, loss=0.748, v_num=1, val_acc=0.750]
Epoch 66:  59%|█████▉    | 69/117 [00:03<00:02, 20.76it/s, loss=0.738, v_num=1, val_acc=0.750]
Epoch 66:  60%|█████▉    | 70/117 [00:03<00:02, 21.00it/s, loss=0.738, v_num=1, val_acc=0.750]
Epoch 66:  60%|█████▉    | 70/117 [00:03<00:02, 20.85it/s, loss=0.741, v_num=1, val_acc=0.750]
Epoch 66:  61%|██████    | 71/117 [00:03<00:02, 21.08it/s, loss=0.741, v_num=1, val_acc=0.750]
Epoch 66:  61%|██████    | 71/117 [00:03<00:02, 20.93it/s, loss=0.734, v_num=1, val_acc=0.750]
Epoch 66:  62%|██████▏   | 72/117 [00:03<00:02, 21.17it/s, loss=0.734, v_num=1, val_acc=0.750]
Epoch 66:  62%|██████▏   | 72/117 [00:03<00:02, 21.01it/s, loss=0.734, v_num=1, val_acc=0.750]
Epoch 66:  62%|██████▏   | 73/117 [00:03<00:02, 21.24it/s, loss=0.734, v_num=1, val_acc=0.750]
Epoch 66:  62%|██████▏   | 73/117 [00:03<00:02, 21.09it/s, loss=0.737, v_num=1, val_acc=0.750]
Epoch 66:  63%|██████▎   | 74/117 [00:03<00:02, 21.32it/s, loss=0.737, v_num=1, val_acc=0.750]
Epoch 66:  63%|██████▎   | 74/117 [00:03<00:02, 21.17it/s, loss=0.728, v_num=1, val_acc=0.750]
Epoch 66:  64%|██████▍   | 75/117 [00:03<00:01, 21.40it/s, loss=0.728, v_num=1, val_acc=0.750]
Epoch 66:  64%|██████▍   | 75/117 [00:03<00:01, 21.24it/s, loss=0.725, v_num=1, val_acc=0.750]
Epoch 66:  65%|██████▍   | 76/117 [00:03<00:01, 21.47it/s, loss=0.725, v_num=1, val_acc=0.750]
Epoch 66:  65%|██████▍   | 76/117 [00:03<00:01, 21.32it/s, loss=0.725, v_num=1, val_acc=0.750]
Epoch 66:  66%|██████▌   | 77/117 [00:03<00:01, 21.54it/s, loss=0.725, v_num=1, val_acc=0.750]
Epoch 66:  66%|██████▌   | 77/117 [00:03<00:01, 21.39it/s, loss=0.728, v_num=1, val_acc=0.750]
Epoch 66:  67%|██████▋   | 78/117 [00:03<00:01, 21.61it/s, loss=0.728, v_num=1, val_acc=0.750]
Epoch 66:  67%|██████▋   | 78/117 [00:03<00:01, 21.46it/s, loss=0.732, v_num=1, val_acc=0.750]
Epoch 66:  68%|██████▊   | 79/117 [00:03<00:01, 21.68it/s, loss=0.732, v_num=1, val_acc=0.750]
Epoch 66:  68%|██████▊   | 79/117 [00:03<00:01, 21.53it/s, loss=0.731, v_num=1, val_acc=0.750]
Epoch 66:  68%|██████▊   | 80/117 [00:03<00:01, 21.75it/s, loss=0.731, v_num=1, val_acc=0.750]
Epoch 66:  68%|██████▊   | 80/117 [00:03<00:01, 21.60it/s, loss=0.726, v_num=1, val_acc=0.750]
Epoch 66:  69%|██████▉   | 81/117 [00:03<00:01, 21.82it/s, loss=0.726, v_num=1, val_acc=0.750]
Epoch 66:  69%|██████▉   | 81/117 [00:03<00:01, 21.67it/s, loss=0.719, v_num=1, val_acc=0.750]
Epoch 66:  70%|███████   | 82/117 [00:03<00:01, 21.87it/s, loss=0.719, v_num=1, val_acc=0.750]
Epoch 66:  70%|███████   | 82/117 [00:03<00:01, 21.73it/s, loss=0.727, v_num=1, val_acc=0.750]
Epoch 66:  71%|███████   | 83/117 [00:03<00:01, 21.94it/s, loss=0.727, v_num=1, val_acc=0.750]
Epoch 66:  71%|███████   | 83/117 [00:03<00:01, 21.79it/s, loss=0.719, v_num=1, val_acc=0.750]
Epoch 66:  72%|███████▏  | 84/117 [00:03<00:01, 22.01it/s, loss=0.719, v_num=1, val_acc=0.750]
Epoch 66:  72%|███████▏  | 84/117 [00:03<00:01, 21.86it/s, loss=0.715, v_num=1, val_acc=0.750]
Epoch 66:  73%|███████▎  | 85/117 [00:03<00:01, 22.07it/s, loss=0.715, v_num=1, val_acc=0.750]
Epoch 66:  73%|███████▎  | 85/117 [00:03<00:01, 21.92it/s, loss=0.709, v_num=1, val_acc=0.750]
Epoch 66:  74%|███████▎  | 86/117 [00:03<00:01, 22.13it/s, loss=0.709, v_num=1, val_acc=0.750]
Epoch 66:  74%|███████▎  | 86/117 [00:03<00:01, 21.99it/s, loss=0.712, v_num=1, val_acc=0.750]
Epoch 66:  74%|███████▍  | 87/117 [00:03<00:01, 22.20it/s, loss=0.712, v_num=1, val_acc=0.750]
Epoch 66:  74%|███████▍  | 87/117 [00:03<00:01, 22.05it/s, loss=0.715, v_num=1, val_acc=0.750]
Epoch 66:  75%|███████▌  | 88/117 [00:03<00:01, 22.26it/s, loss=0.715, v_num=1, val_acc=0.750]
Epoch 66:  75%|███████▌  | 88/117 [00:03<00:01, 22.11it/s, loss=0.71, v_num=1, val_acc=0.750]
Epoch 66:  76%|███████▌  | 89/117 [00:03<00:01, 22.32it/s, loss=0.71, v_num=1, val_acc=0.750]
Epoch 66:  76%|███████▌  | 89/117 [00:04<00:01, 22.18it/s, loss=0.718, v_num=1, val_acc=0.750]
Epoch 66:  77%|███████▋  | 90/117 [00:04<00:01, 22.38it/s, loss=0.718, v_num=1, val_acc=0.750]
Epoch 66:  77%|███████▋  | 90/117 [00:04<00:01, 22.23it/s, loss=0.712, v_num=1, val_acc=0.750]
Epoch 66:  78%|███████▊  | 91/117 [00:04<00:01, 22.43it/s, loss=0.712, v_num=1, val_acc=0.750]
Epoch 66:  78%|███████▊  | 91/117 [00:04<00:01, 22.29it/s, loss=0.708, v_num=1, val_acc=0.750]
Epoch 66:  79%|███████▊  | 92/117 [00:04<00:01, 22.49it/s, loss=0.708, v_num=1, val_acc=0.750]
Epoch 66:  79%|███████▊  | 92/117 [00:04<00:01, 22.35it/s, loss=0.707, v_num=1, val_acc=0.750]
Epoch 66:  79%|███████▉  | 93/117 [00:04<00:01, 22.54it/s, loss=0.707, v_num=1, val_acc=0.750]
Epoch 66:  79%|███████▉  | 93/117 [00:04<00:01, 22.41it/s, loss=0.706, v_num=1, val_acc=0.750]
Epoch 66:  80%|████████  | 94/117 [00:04<00:01, 22.60it/s, loss=0.706, v_num=1, val_acc=0.750]
Epoch 66:  80%|████████  | 94/117 [00:04<00:01, 22.46it/s, loss=0.7, v_num=1, val_acc=0.750]
Epoch 66:  81%|████████  | 95/117 [00:04<00:00, 22.65it/s, loss=0.7, v_num=1, val_acc=0.750]
Epoch 66:  81%|████████  | 95/117 [00:04<00:00, 22.52it/s, loss=0.705, v_num=1, val_acc=0.750]
Epoch 66:  82%|████████▏ | 96/117 [00:04<00:00, 22.71it/s, loss=0.705, v_num=1, val_acc=0.750]
Epoch 66:  82%|████████▏ | 96/117 [00:04<00:00, 22.57it/s, loss=0.706, v_num=1, val_acc=0.750]
Epoch 66:  83%|████████▎ | 97/117 [00:04<00:00, 22.76it/s, loss=0.706, v_num=1, val_acc=0.750]
Epoch 66:  83%|████████▎ | 97/117 [00:04<00:00, 22.62it/s, loss=0.706, v_num=1, val_acc=0.750]

Validation: 0it [00:00, ?it/s]

Validation:   0%|          | 0/20 [00:00<?, ?it/s]

Validation DataLoader 0:   0%|          | 0/20 [00:00<?, ?it/s]

Validation DataLoader 0:   5%|▌         | 1/20 [00:00<00:00, 184.93it/s]
Epoch 66:  84%|████████▍ | 98/117 [00:05<00:00, 19.13it/s, loss=0.706, v_num=1, val_acc=0.750]

Validation DataLoader 0:  10%|█         | 2/20 [00:00<00:00, 55.82it/s]
Epoch 66:  85%|████████▍ | 99/117 [00:05<00:00, 19.21it/s, loss=0.706, v_num=1, val_acc=0.750]

Validation DataLoader 0:  15%|█▌        | 3/20 [00:00<00:00, 44.56it/s]
Epoch 66:  85%|████████▌ | 100/117 [00:05<00:00, 19.29it/s, loss=0.706, v_num=1, val_acc=0.750]

Validation DataLoader 0:  20%|██        | 4/20 [00:00<00:00, 40.33it/s]
Epoch 66:  86%|████████▋ | 101/117 [00:05<00:00, 19.36it/s, loss=0.706, v_num=1, val_acc=0.750]

Validation DataLoader 0:  25%|██▌       | 5/20 [00:00<00:00, 38.19it/s]
Epoch 66:  87%|████████▋ | 102/117 [00:05<00:00, 19.43it/s, loss=0.706, v_num=1, val_acc=0.750]

Validation DataLoader 0:  30%|███       | 6/20 [00:00<00:00, 36.93it/s]
Epoch 66:  88%|████████▊ | 103/117 [00:05<00:00, 19.51it/s, loss=0.706, v_num=1, val_acc=0.750]

Validation DataLoader 0:  35%|███▌      | 7/20 [00:00<00:00, 36.10it/s]
Epoch 66:  89%|████████▉ | 104/117 [00:05<00:00, 19.58it/s, loss=0.706, v_num=1, val_acc=0.750]

Validation DataLoader 0:  40%|████      | 8/20 [00:00<00:00, 35.44it/s]
Epoch 66:  90%|████████▉ | 105/117 [00:05<00:00, 19.65it/s, loss=0.706, v_num=1, val_acc=0.750]

Validation DataLoader 0:  45%|████▌     | 9/20 [00:00<00:00, 34.97it/s]
Epoch 66:  91%|█████████ | 106/117 [00:05<00:00, 19.72it/s, loss=0.706, v_num=1, val_acc=0.750]

Validation DataLoader 0:  50%|█████     | 10/20 [00:00<00:00, 34.59it/s]
Epoch 66:  91%|█████████▏| 107/117 [00:05<00:00, 19.79it/s, loss=0.706, v_num=1, val_acc=0.750]

Validation DataLoader 0:  55%|█████▌    | 11/20 [00:00<00:00, 34.30it/s]
Epoch 66:  92%|█████████▏| 108/117 [00:05<00:00, 19.86it/s, loss=0.706, v_num=1, val_acc=0.750]

Validation DataLoader 0:  60%|██████    | 12/20 [00:00<00:00, 34.06it/s]
Epoch 66:  93%|█████████▎| 109/117 [00:05<00:00, 19.93it/s, loss=0.706, v_num=1, val_acc=0.750]

Validation DataLoader 0:  65%|██████▌   | 13/20 [00:00<00:00, 33.88it/s]
Epoch 66:  94%|█████████▍| 110/117 [00:05<00:00, 19.99it/s, loss=0.706, v_num=1, val_acc=0.750]

Validation DataLoader 0:  70%|███████   | 14/20 [00:00<00:00, 33.71it/s]
Epoch 66:  95%|█████████▍| 111/117 [00:05<00:00, 20.06it/s, loss=0.706, v_num=1, val_acc=0.750]

Validation DataLoader 0:  75%|███████▌  | 15/20 [00:00<00:00, 33.56it/s]
Epoch 66:  96%|█████████▌| 112/117 [00:05<00:00, 20.13it/s, loss=0.706, v_num=1, val_acc=0.750]

Validation DataLoader 0:  80%|████████  | 16/20 [00:00<00:00, 33.41it/s]
Epoch 66:  97%|█████████▋| 113/117 [00:05<00:00, 20.19it/s, loss=0.706, v_num=1, val_acc=0.750]

Validation DataLoader 0:  85%|████████▌ | 17/20 [00:00<00:00, 33.29it/s]
Epoch 66:  97%|█████████▋| 114/117 [00:05<00:00, 20.25it/s, loss=0.706, v_num=1, val_acc=0.750]

Validation DataLoader 0:  90%|█████████ | 18/20 [00:00<00:00, 33.19it/s]
Epoch 66:  98%|█████████▊| 115/117 [00:05<00:00, 20.32it/s, loss=0.706, v_num=1, val_acc=0.750]

Validation DataLoader 0:  95%|█████████▌| 19/20 [00:00<00:00, 33.09it/s]
Epoch 66:  99%|█████████▉| 116/117 [00:05<00:00, 20.38it/s, loss=0.706, v_num=1, val_acc=0.750]

Validation DataLoader 0: 100%|██████████| 20/20 [00:00<00:00, 33.09it/s]
Epoch 66: 100%|██████████| 117/117 [00:05<00:00, 20.45it/s, loss=0.706, v_num=1, val_acc=0.750]
Epoch 66: 100%|██████████| 117/117 [00:05<00:00, 20.37it/s, loss=0.706, v_num=1, val_acc=0.756]


Epoch 66: 100%|██████████| 117/117 [00:05<00:00, 20.37it/s, loss=0.706, v_num=1, val_acc=0.756]
Epoch 66:   0%|          | 0/117 [00:00<?, ?it/s, loss=0.706, v_num=1, val_acc=0.756]
Epoch 67:   0%|          | 0/117 [00:00<?, ?it/s, loss=0.706, v_num=1, val_acc=0.756]
Epoch 67:   1%|          | 1/117 [00:00<01:49,  1.06it/s, loss=0.706, v_num=1, val_acc=0.756]
Epoch 67:   1%|          | 1/117 [00:00<01:52,  1.03it/s, loss=0.707, v_num=1, val_acc=0.756]
Epoch 67:   2%|▏         | 2/117 [00:00<00:56,  2.04it/s, loss=0.707, v_num=1, val_acc=0.756]
Epoch 67:   2%|▏         | 2/117 [00:01<00:57,  1.99it/s, loss=0.703, v_num=1, val_acc=0.756]
Epoch 67:   3%|▎         | 3/117 [00:01<00:38,  2.96it/s, loss=0.703, v_num=1, val_acc=0.756]
Epoch 67:   3%|▎         | 3/117 [00:01<00:39,  2.89it/s, loss=0.709, v_num=1, val_acc=0.756]
Epoch 67:   3%|▎         | 4/117 [00:01<00:29,  3.82it/s, loss=0.709, v_num=1, val_acc=0.756]
Epoch 67:   3%|▎         | 4/117 [00:01<00:30,  3.73it/s, loss=0.71, v_num=1, val_acc=0.756]
Epoch 67:   4%|▍         | 5/117 [00:01<00:24,  4.62it/s, loss=0.71, v_num=1, val_acc=0.756]
Epoch 67:   4%|▍         | 5/117 [00:01<00:24,  4.52it/s, loss=0.705, v_num=1, val_acc=0.756]
Epoch 67:   5%|▌         | 6/117 [00:01<00:20,  5.37it/s, loss=0.705, v_num=1, val_acc=0.756]
Epoch 67:   5%|▌         | 6/117 [00:01<00:21,  5.25it/s, loss=0.711, v_num=1, val_acc=0.756]
Epoch 67:   6%|▌         | 7/117 [00:01<00:18,  6.08it/s, loss=0.711, v_num=1, val_acc=0.756]
Epoch 67:   6%|▌         | 7/117 [00:01<00:18,  5.95it/s, loss=0.713, v_num=1, val_acc=0.756]
Epoch 67:   7%|▋         | 8/117 [00:01<00:16,  6.76it/s, loss=0.713, v_num=1, val_acc=0.756]
Epoch 67:   7%|▋         | 8/117 [00:01<00:16,  6.61it/s, loss=0.727, v_num=1, val_acc=0.756]
Epoch 67:   8%|▊         | 9/117 [00:01<00:14,  7.33it/s, loss=0.727, v_num=1, val_acc=0.756]
Epoch 67:   8%|▊         | 9/117 [00:01<00:15,  7.19it/s, loss=0.725, v_num=1, val_acc=0.756]
Epoch 67:   9%|▊         | 10/117 [00:01<00:13,  7.92it/s, loss=0.725, v_num=1, val_acc=0.756]
Epoch 67:   9%|▊         | 10/117 [00:01<00:13,  7.77it/s, loss=0.719, v_num=1, val_acc=0.756]
Epoch 67:   9%|▉         | 11/117 [00:01<00:12,  8.49it/s, loss=0.719, v_num=1, val_acc=0.756]
Epoch 67:   9%|▉         | 11/117 [00:01<00:12,  8.33it/s, loss=0.723, v_num=1, val_acc=0.756]
Epoch 67:  10%|█         | 12/117 [00:01<00:11,  9.03it/s, loss=0.723, v_num=1, val_acc=0.756]
Epoch 67:  10%|█         | 12/117 [00:01<00:11,  8.86it/s, loss=0.715, v_num=1, val_acc=0.756]
Epoch 67:  11%|█         | 13/117 [00:01<00:10,  9.54it/s, loss=0.715, v_num=1, val_acc=0.756]
Epoch 67:  11%|█         | 13/117 [00:01<00:11,  9.36it/s, loss=0.719, v_num=1, val_acc=0.756]
Epoch 67:  12%|█▏        | 14/117 [00:01<00:10, 10.03it/s, loss=0.719, v_num=1, val_acc=0.756]
Epoch 67:  12%|█▏        | 14/117 [00:01<00:10,  9.85it/s, loss=0.721, v_num=1, val_acc=0.756]
Epoch 67:  13%|█▎        | 15/117 [00:01<00:09, 10.49it/s, loss=0.721, v_num=1, val_acc=0.756]
Epoch 67:  13%|█▎        | 15/117 [00:01<00:09, 10.30it/s, loss=0.723, v_num=1, val_acc=0.756]
Epoch 67:  14%|█▎        | 16/117 [00:01<00:09, 10.93it/s, loss=0.723, v_num=1, val_acc=0.756]
Epoch 67:  14%|█▎        | 16/117 [00:01<00:09, 10.74it/s, loss=0.72, v_num=1, val_acc=0.756]
Epoch 67:  15%|█▍        | 17/117 [00:01<00:08, 11.33it/s, loss=0.72, v_num=1, val_acc=0.756]
Epoch 67:  15%|█▍        | 17/117 [00:01<00:08, 11.14it/s, loss=0.728, v_num=1, val_acc=0.756]
Epoch 67:  15%|█▌        | 18/117 [00:01<00:08, 11.72it/s, loss=0.728, v_num=1, val_acc=0.756]
Epoch 67:  15%|█▌        | 18/117 [00:01<00:08, 11.53it/s, loss=0.725, v_num=1, val_acc=0.756]
Epoch 67:  16%|█▌        | 19/117 [00:01<00:08, 12.11it/s, loss=0.725, v_num=1, val_acc=0.756]
Epoch 67:  16%|█▌        | 19/117 [00:01<00:08, 11.92it/s, loss=0.727, v_num=1, val_acc=0.756]
Epoch 67:  17%|█▋        | 20/117 [00:01<00:07, 12.48it/s, loss=0.727, v_num=1, val_acc=0.756]
Epoch 67:  17%|█▋        | 20/117 [00:01<00:07, 12.29it/s, loss=0.726, v_num=1, val_acc=0.756]
Epoch 67:  18%|█▊        | 21/117 [00:01<00:07, 12.84it/s, loss=0.726, v_num=1, val_acc=0.756]
Epoch 67:  18%|█▊        | 21/117 [00:01<00:07, 12.64it/s, loss=0.721, v_num=1, val_acc=0.756]
Epoch 67:  19%|█▉        | 22/117 [00:01<00:07, 13.17it/s, loss=0.721, v_num=1, val_acc=0.756]
Epoch 67:  19%|█▉        | 22/117 [00:01<00:07, 12.97it/s, loss=0.726, v_num=1, val_acc=0.756]
Epoch 67:  20%|█▉        | 23/117 [00:01<00:06, 13.49it/s, loss=0.726, v_num=1, val_acc=0.756]
Epoch 67:  20%|█▉        | 23/117 [00:01<00:07, 13.29it/s, loss=0.726, v_num=1, val_acc=0.756]
Epoch 67:  21%|██        | 24/117 [00:01<00:06, 13.80it/s, loss=0.726, v_num=1, val_acc=0.756]
Epoch 67:  21%|██        | 24/117 [00:01<00:06, 13.60it/s, loss=0.724, v_num=1, val_acc=0.756]
Epoch 67:  21%|██▏       | 25/117 [00:01<00:06, 14.09it/s, loss=0.724, v_num=1, val_acc=0.756]
Epoch 67:  21%|██▏       | 25/117 [00:01<00:06, 13.89it/s, loss=0.719, v_num=1, val_acc=0.756]
Epoch 67:  22%|██▏       | 26/117 [00:01<00:06, 14.28it/s, loss=0.719, v_num=1, val_acc=0.756]
Epoch 67:  22%|██▏       | 26/117 [00:01<00:06, 14.11it/s, loss=0.719, v_num=1, val_acc=0.756]
Epoch 67:  23%|██▎       | 27/117 [00:01<00:06, 14.55it/s, loss=0.719, v_num=1, val_acc=0.756]
Epoch 67:  23%|██▎       | 27/117 [00:01<00:06, 14.37it/s, loss=0.72, v_num=1, val_acc=0.756]
Epoch 67:  24%|██▍       | 28/117 [00:01<00:06, 14.82it/s, loss=0.72, v_num=1, val_acc=0.756]
Epoch 67:  24%|██▍       | 28/117 [00:01<00:06, 14.63it/s, loss=0.711, v_num=1, val_acc=0.756]
Epoch 67:  25%|██▍       | 29/117 [00:01<00:05, 15.08it/s, loss=0.711, v_num=1, val_acc=0.756]
Epoch 67:  25%|██▍       | 29/117 [00:01<00:05, 14.88it/s, loss=0.717, v_num=1, val_acc=0.756]
Epoch 67:  26%|██▌       | 30/117 [00:01<00:05, 15.32it/s, loss=0.717, v_num=1, val_acc=0.756]
Epoch 67:  26%|██▌       | 30/117 [00:01<00:05, 15.12it/s, loss=0.721, v_num=1, val_acc=0.756]
Epoch 67:  26%|██▋       | 31/117 [00:01<00:05, 15.56it/s, loss=0.721, v_num=1, val_acc=0.756]
Epoch 67:  26%|██▋       | 31/117 [00:02<00:05, 15.36it/s, loss=0.724, v_num=1, val_acc=0.756]
Epoch 67:  27%|██▋       | 32/117 [00:02<00:05, 15.78it/s, loss=0.724, v_num=1, val_acc=0.756]
Epoch 67:  27%|██▋       | 32/117 [00:02<00:05, 15.59it/s, loss=0.732, v_num=1, val_acc=0.756]
Epoch 67:  28%|██▊       | 33/117 [00:02<00:05, 16.00it/s, loss=0.732, v_num=1, val_acc=0.756]
Epoch 67:  28%|██▊       | 33/117 [00:02<00:05, 15.81it/s, loss=0.73, v_num=1, val_acc=0.756]
Epoch 67:  29%|██▉       | 34/117 [00:02<00:05, 16.20it/s, loss=0.73, v_num=1, val_acc=0.756]
Epoch 67:  29%|██▉       | 34/117 [00:02<00:05, 16.01it/s, loss=0.732, v_num=1, val_acc=0.756]
Epoch 67:  30%|██▉       | 35/117 [00:02<00:04, 16.41it/s, loss=0.732, v_num=1, val_acc=0.756]
Epoch 67:  30%|██▉       | 35/117 [00:02<00:05, 16.22it/s, loss=0.734, v_num=1, val_acc=0.756]
Epoch 67:  31%|███       | 36/117 [00:02<00:04, 16.61it/s, loss=0.734, v_num=1, val_acc=0.756]
Epoch 67:  31%|███       | 36/117 [00:02<00:04, 16.42it/s, loss=0.744, v_num=1, val_acc=0.756]
Epoch 67:  32%|███▏      | 37/117 [00:02<00:04, 16.80it/s, loss=0.744, v_num=1, val_acc=0.756]
Epoch 67:  32%|███▏      | 37/117 [00:02<00:04, 16.61it/s, loss=0.743, v_num=1, val_acc=0.756]
Epoch 67:  32%|███▏      | 38/117 [00:02<00:04, 16.99it/s, loss=0.743, v_num=1, val_acc=0.756]
Epoch 67:  32%|███▏      | 38/117 [00:02<00:04, 16.80it/s, loss=0.748, v_num=1, val_acc=0.756]
Epoch 67:  33%|███▎      | 39/117 [00:02<00:04, 17.17it/s, loss=0.748, v_num=1, val_acc=0.756]
Epoch 67:  33%|███▎      | 39/117 [00:02<00:04, 16.98it/s, loss=0.748, v_num=1, val_acc=0.756]
Epoch 67:  34%|███▍      | 40/117 [00:02<00:04, 17.34it/s, loss=0.748, v_num=1, val_acc=0.756]
Epoch 67:  34%|███▍      | 40/117 [00:02<00:04, 17.16it/s, loss=0.75, v_num=1, val_acc=0.756]
Epoch 67:  35%|███▌      | 41/117 [00:02<00:04, 17.51it/s, loss=0.75, v_num=1, val_acc=0.756]
Epoch 67:  35%|███▌      | 41/117 [00:02<00:04, 17.33it/s, loss=0.749, v_num=1, val_acc=0.756]
Epoch 67:  36%|███▌      | 42/117 [00:02<00:04, 17.68it/s, loss=0.749, v_num=1, val_acc=0.756]
Epoch 67:  36%|███▌      | 42/117 [00:02<00:04, 17.49it/s, loss=0.742, v_num=1, val_acc=0.756]
Epoch 67:  37%|███▋      | 43/117 [00:02<00:04, 17.84it/s, loss=0.742, v_num=1, val_acc=0.756]
Epoch 67:  37%|███▋      | 43/117 [00:02<00:04, 17.65it/s, loss=0.737, v_num=1, val_acc=0.756]
Epoch 67:  38%|███▊      | 44/117 [00:02<00:04, 17.99it/s, loss=0.737, v_num=1, val_acc=0.756]
Epoch 67:  38%|███▊      | 44/117 [00:02<00:04, 17.81it/s, loss=0.74, v_num=1, val_acc=0.756]
Epoch 67:  38%|███▊      | 45/117 [00:02<00:03, 18.15it/s, loss=0.74, v_num=1, val_acc=0.756]
Epoch 67:  38%|███▊      | 45/117 [00:02<00:04, 17.96it/s, loss=0.745, v_num=1, val_acc=0.756]
Epoch 67:  39%|███▉      | 46/117 [00:02<00:03, 18.25it/s, loss=0.745, v_num=1, val_acc=0.756]
Epoch 67:  39%|███▉      | 46/117 [00:02<00:03, 18.09it/s, loss=0.741, v_num=1, val_acc=0.756]
Epoch 67:  40%|████      | 47/117 [00:02<00:03, 18.41it/s, loss=0.741, v_num=1, val_acc=0.756]
Epoch 67:  40%|████      | 47/117 [00:02<00:03, 18.23it/s, loss=0.741, v_num=1, val_acc=0.756]
Epoch 67:  41%|████      | 48/117 [00:02<00:03, 18.55it/s, loss=0.741, v_num=1, val_acc=0.756]
Epoch 67:  41%|████      | 48/117 [00:02<00:03, 18.37it/s, loss=0.743, v_num=1, val_acc=0.756]
Epoch 67:  42%|████▏     | 49/117 [00:02<00:03, 18.69it/s, loss=0.743, v_num=1, val_acc=0.756]
Epoch 67:  42%|████▏     | 49/117 [00:02<00:03, 18.51it/s, loss=0.739, v_num=1, val_acc=0.756]
Epoch 67:  43%|████▎     | 50/117 [00:02<00:03, 18.81it/s, loss=0.739, v_num=1, val_acc=0.756]
Epoch 67:  43%|████▎     | 50/117 [00:02<00:03, 18.63it/s, loss=0.737, v_num=1, val_acc=0.756]
Epoch 67:  44%|████▎     | 51/117 [00:02<00:03, 18.94it/s, loss=0.737, v_num=1, val_acc=0.756]
Epoch 67:  44%|████▎     | 51/117 [00:02<00:03, 18.77it/s, loss=0.736, v_num=1, val_acc=0.756]
Epoch 67:  44%|████▍     | 52/117 [00:02<00:03, 19.06it/s, loss=0.736, v_num=1, val_acc=0.756]
Epoch 67:  44%|████▍     | 52/117 [00:02<00:03, 18.89it/s, loss=0.734, v_num=1, val_acc=0.756]
Epoch 67:  45%|████▌     | 53/117 [00:02<00:03, 19.16it/s, loss=0.734, v_num=1, val_acc=0.756]
Epoch 67:  45%|████▌     | 53/117 [00:02<00:03, 19.00it/s, loss=0.734, v_num=1, val_acc=0.756]
Epoch 67:  46%|████▌     | 54/117 [00:02<00:03, 19.26it/s, loss=0.734, v_num=1, val_acc=0.756]
Epoch 67:  46%|████▌     | 54/117 [00:02<00:03, 19.10it/s, loss=0.731, v_num=1, val_acc=0.756]
Epoch 67:  47%|████▋     | 55/117 [00:02<00:03, 19.35it/s, loss=0.731, v_num=1, val_acc=0.756]
Epoch 67:  47%|████▋     | 55/117 [00:02<00:03, 19.20it/s, loss=0.727, v_num=1, val_acc=0.756]
Epoch 67:  48%|████▊     | 56/117 [00:02<00:03, 19.48it/s, loss=0.727, v_num=1, val_acc=0.756]
Epoch 67:  48%|████▊     | 56/117 [00:02<00:03, 19.31it/s, loss=0.719, v_num=1, val_acc=0.756]
Epoch 67:  49%|████▊     | 57/117 [00:02<00:03, 19.59it/s, loss=0.719, v_num=1, val_acc=0.756]
Epoch 67:  49%|████▊     | 57/117 [00:02<00:03, 19.42it/s, loss=0.721, v_num=1, val_acc=0.756]
Epoch 67:  50%|████▉     | 58/117 [00:02<00:02, 19.70it/s, loss=0.721, v_num=1, val_acc=0.756]
Epoch 67:  50%|████▉     | 58/117 [00:02<00:03, 19.54it/s, loss=0.719, v_num=1, val_acc=0.756]
Epoch 67:  50%|█████     | 59/117 [00:02<00:02, 19.81it/s, loss=0.719, v_num=1, val_acc=0.756]
Epoch 67:  50%|█████     | 59/117 [00:03<00:02, 19.64it/s, loss=0.722, v_num=1, val_acc=0.756]
Epoch 67:  51%|█████▏    | 60/117 [00:03<00:02, 19.91it/s, loss=0.722, v_num=1, val_acc=0.756]
Epoch 67:  51%|█████▏    | 60/117 [00:03<00:02, 19.75it/s, loss=0.725, v_num=1, val_acc=0.756]
Epoch 67:  52%|█████▏    | 61/117 [00:03<00:02, 20.02it/s, loss=0.725, v_num=1, val_acc=0.756]
Epoch 67:  52%|█████▏    | 61/117 [00:03<00:02, 19.85it/s, loss=0.731, v_num=1, val_acc=0.756]
Epoch 67:  53%|█████▎    | 62/117 [00:03<00:02, 20.12it/s, loss=0.731, v_num=1, val_acc=0.756]
Epoch 67:  53%|█████▎    | 62/117 [00:03<00:02, 19.96it/s, loss=0.74, v_num=1, val_acc=0.756]
Epoch 67:  54%|█████▍    | 63/117 [00:03<00:02, 20.22it/s, loss=0.74, v_num=1, val_acc=0.756]
Epoch 67:  54%|█████▍    | 63/117 [00:03<00:02, 20.05it/s, loss=0.746, v_num=1, val_acc=0.756]
Epoch 67:  55%|█████▍    | 64/117 [00:03<00:02, 20.31it/s, loss=0.746, v_num=1, val_acc=0.756]
Epoch 67:  55%|█████▍    | 64/117 [00:03<00:02, 20.15it/s, loss=0.746, v_num=1, val_acc=0.756]
Epoch 67:  56%|█████▌    | 65/117 [00:03<00:02, 20.41it/s, loss=0.746, v_num=1, val_acc=0.756]
Epoch 67:  56%|█████▌    | 65/117 [00:03<00:02, 20.25it/s, loss=0.74, v_num=1, val_acc=0.756]
Epoch 67:  56%|█████▋    | 66/117 [00:03<00:02, 20.50it/s, loss=0.74, v_num=1, val_acc=0.756]
Epoch 67:  56%|█████▋    | 66/117 [00:03<00:02, 20.34it/s, loss=0.747, v_num=1, val_acc=0.756]
Epoch 67:  57%|█████▋    | 67/117 [00:03<00:02, 20.59it/s, loss=0.747, v_num=1, val_acc=0.756]
Epoch 67:  57%|█████▋    | 67/117 [00:03<00:02, 20.43it/s, loss=0.751, v_num=1, val_acc=0.756]
Epoch 67:  58%|█████▊    | 68/117 [00:03<00:02, 20.68it/s, loss=0.751, v_num=1, val_acc=0.756]
Epoch 67:  58%|█████▊    | 68/117 [00:03<00:02, 20.52it/s, loss=0.754, v_num=1, val_acc=0.756]
Epoch 67:  59%|█████▉    | 69/117 [00:03<00:02, 20.76it/s, loss=0.754, v_num=1, val_acc=0.756]
Epoch 67:  59%|█████▉    | 69/117 [00:03<00:02, 20.61it/s, loss=0.753, v_num=1, val_acc=0.756]
Epoch 67:  60%|█████▉    | 70/117 [00:03<00:02, 20.85it/s, loss=0.753, v_num=1, val_acc=0.756]
Epoch 67:  60%|█████▉    | 70/117 [00:03<00:02, 20.69it/s, loss=0.752, v_num=1, val_acc=0.756]
Epoch 67:  61%|██████    | 71/117 [00:03<00:02, 20.93it/s, loss=0.752, v_num=1, val_acc=0.756]
Epoch 67:  61%|██████    | 71/117 [00:03<00:02, 20.77it/s, loss=0.749, v_num=1, val_acc=0.756]
Epoch 67:  62%|██████▏   | 72/117 [00:03<00:02, 21.01it/s, loss=0.749, v_num=1, val_acc=0.756]
Epoch 67:  62%|██████▏   | 72/117 [00:03<00:02, 20.86it/s, loss=0.747, v_num=1, val_acc=0.756]
Epoch 67:  62%|██████▏   | 73/117 [00:03<00:02, 21.09it/s, loss=0.747, v_num=1, val_acc=0.756]
Epoch 67:  62%|██████▏   | 73/117 [00:03<00:02, 20.93it/s, loss=0.754, v_num=1, val_acc=0.756]
Epoch 67:  63%|██████▎   | 74/117 [00:03<00:02, 21.16it/s, loss=0.754, v_num=1, val_acc=0.756]
Epoch 67:  63%|██████▎   | 74/117 [00:03<00:02, 21.01it/s, loss=0.758, v_num=1, val_acc=0.756]
Epoch 67:  64%|██████▍   | 75/117 [00:03<00:01, 21.24it/s, loss=0.758, v_num=1, val_acc=0.756]
Epoch 67:  64%|██████▍   | 75/117 [00:03<00:01, 21.09it/s, loss=0.756, v_num=1, val_acc=0.756]
Epoch 67:  65%|██████▍   | 76/117 [00:03<00:01, 21.31it/s, loss=0.756, v_num=1, val_acc=0.756]
Epoch 67:  65%|██████▍   | 76/117 [00:03<00:01, 21.16it/s, loss=0.759, v_num=1, val_acc=0.756]
Epoch 67:  66%|██████▌   | 77/117 [00:03<00:01, 21.39it/s, loss=0.759, v_num=1, val_acc=0.756]
Epoch 67:  66%|██████▌   | 77/117 [00:03<00:01, 21.24it/s, loss=0.76, v_num=1, val_acc=0.756]
Epoch 67:  67%|██████▋   | 78/117 [00:03<00:01, 21.46it/s, loss=0.76, v_num=1, val_acc=0.756]
Epoch 67:  67%|██████▋   | 78/117 [00:03<00:01, 21.31it/s, loss=0.762, v_num=1, val_acc=0.756]
Epoch 67:  68%|██████▊   | 79/117 [00:03<00:01, 21.53it/s, loss=0.762, v_num=1, val_acc=0.756]
Epoch 67:  68%|██████▊   | 79/117 [00:03<00:01, 21.38it/s, loss=0.761, v_num=1, val_acc=0.756]
Epoch 67:  68%|██████▊   | 80/117 [00:03<00:01, 21.60it/s, loss=0.761, v_num=1, val_acc=0.756]
Epoch 67:  68%|██████▊   | 80/117 [00:03<00:01, 21.46it/s, loss=0.757, v_num=1, val_acc=0.756]
Epoch 67:  69%|██████▉   | 81/117 [00:03<00:01, 21.67it/s, loss=0.757, v_num=1, val_acc=0.756]
Epoch 67:  69%|██████▉   | 81/117 [00:03<00:01, 21.52it/s, loss=0.754, v_num=1, val_acc=0.756]
Epoch 67:  70%|███████   | 82/117 [00:03<00:01, 21.72it/s, loss=0.754, v_num=1, val_acc=0.756]
Epoch 67:  70%|███████   | 82/117 [00:03<00:01, 21.58it/s, loss=0.747, v_num=1, val_acc=0.756]
Epoch 67:  71%|███████   | 83/117 [00:03<00:01, 21.79it/s, loss=0.747, v_num=1, val_acc=0.756]
Epoch 67:  71%|███████   | 83/117 [00:03<00:01, 21.65it/s, loss=0.74, v_num=1, val_acc=0.756]
Epoch 67:  72%|███████▏  | 84/117 [00:03<00:01, 21.85it/s, loss=0.74, v_num=1, val_acc=0.756]
Epoch 67:  72%|███████▏  | 84/117 [00:03<00:01, 21.71it/s, loss=0.742, v_num=1, val_acc=0.756]
Epoch 67:  73%|███████▎  | 85/117 [00:03<00:01, 21.92it/s, loss=0.742, v_num=1, val_acc=0.756]
Epoch 67:  73%|███████▎  | 85/117 [00:03<00:01, 21.78it/s, loss=0.761, v_num=1, val_acc=0.756]
Epoch 67:  74%|███████▎  | 86/117 [00:03<00:01, 21.98it/s, loss=0.761, v_num=1, val_acc=0.756]
Epoch 67:  74%|███████▎  | 86/117 [00:03<00:01, 21.84it/s, loss=0.758, v_num=1, val_acc=0.756]
Epoch 67:  74%|███████▍  | 87/117 [00:03<00:01, 22.04it/s, loss=0.758, v_num=1, val_acc=0.756]
Epoch 67:  74%|███████▍  | 87/117 [00:03<00:01, 21.90it/s, loss=0.752, v_num=1, val_acc=0.756]
Epoch 67:  75%|███████▌  | 88/117 [00:03<00:01, 22.11it/s, loss=0.752, v_num=1, val_acc=0.756]
Epoch 67:  75%|███████▌  | 88/117 [00:04<00:01, 21.97it/s, loss=0.748, v_num=1, val_acc=0.756]
Epoch 67:  76%|███████▌  | 89/117 [00:04<00:01, 22.13it/s, loss=0.748, v_num=1, val_acc=0.756]
Epoch 67:  76%|███████▌  | 89/117 [00:04<00:01, 22.01it/s, loss=0.746, v_num=1, val_acc=0.756]
Epoch 67:  77%|███████▋  | 90/117 [00:04<00:01, 22.21it/s, loss=0.746, v_num=1, val_acc=0.756]
Epoch 67:  77%|███████▋  | 90/117 [00:04<00:01, 22.07it/s, loss=0.748, v_num=1, val_acc=0.756]
Epoch 67:  78%|███████▊  | 91/117 [00:04<00:01, 22.26it/s, loss=0.748, v_num=1, val_acc=0.756]
Epoch 67:  78%|███████▊  | 91/117 [00:04<00:01, 22.12it/s, loss=0.748, v_num=1, val_acc=0.756]
Epoch 67:  79%|███████▊  | 92/117 [00:04<00:01, 22.32it/s, loss=0.748, v_num=1, val_acc=0.756]
Epoch 67:  79%|███████▊  | 92/117 [00:04<00:01, 22.18it/s, loss=0.744, v_num=1, val_acc=0.756]
Epoch 67:  79%|███████▉  | 93/117 [00:04<00:01, 22.37it/s, loss=0.744, v_num=1, val_acc=0.756]
Epoch 67:  79%|███████▉  | 93/117 [00:04<00:01, 22.24it/s, loss=0.739, v_num=1, val_acc=0.756]
Epoch 67:  80%|████████  | 94/117 [00:04<00:01, 22.43it/s, loss=0.739, v_num=1, val_acc=0.756]
Epoch 67:  80%|████████  | 94/117 [00:04<00:01, 22.29it/s, loss=0.735, v_num=1, val_acc=0.756]
Epoch 67:  81%|████████  | 95/117 [00:04<00:00, 22.48it/s, loss=0.735, v_num=1, val_acc=0.756]
Epoch 67:  81%|████████  | 95/117 [00:04<00:00, 22.35it/s, loss=0.739, v_num=1, val_acc=0.756]
Epoch 67:  82%|████████▏ | 96/117 [00:04<00:00, 22.54it/s, loss=0.739, v_num=1, val_acc=0.756]
Epoch 67:  82%|████████▏ | 96/117 [00:04<00:00, 22.40it/s, loss=0.736, v_num=1, val_acc=0.756]
Epoch 67:  83%|████████▎ | 97/117 [00:04<00:00, 22.59it/s, loss=0.736, v_num=1, val_acc=0.756]
Epoch 67:  83%|████████▎ | 97/117 [00:04<00:00, 22.45it/s, loss=0.733, v_num=1, val_acc=0.756]

Validation: 0it [00:00, ?it/s]

Validation:   0%|          | 0/20 [00:00<?, ?it/s]

Validation DataLoader 0:   0%|          | 0/20 [00:00<?, ?it/s]

Validation DataLoader 0:   5%|▌         | 1/20 [00:00<00:00, 160.54it/s]
Epoch 67:  84%|████████▍ | 98/117 [00:05<00:01, 18.96it/s, loss=0.733, v_num=1, val_acc=0.756]

Validation DataLoader 0:  10%|█         | 2/20 [00:00<00:00, 54.38it/s]
Epoch 67:  85%|████████▍ | 99/117 [00:05<00:00, 19.04it/s, loss=0.733, v_num=1, val_acc=0.756]

Validation DataLoader 0:  15%|█▌        | 3/20 [00:00<00:00, 44.01it/s]
Epoch 67:  85%|████████▌ | 100/117 [00:05<00:00, 19.12it/s, loss=0.733, v_num=1, val_acc=0.756]

Validation DataLoader 0:  20%|██        | 4/20 [00:00<00:00, 40.05it/s]
Epoch 67:  86%|████████▋ | 101/117 [00:05<00:00, 19.20it/s, loss=0.733, v_num=1, val_acc=0.756]

Validation DataLoader 0:  25%|██▌       | 5/20 [00:00<00:00, 37.98it/s]
Epoch 67:  87%|████████▋ | 102/117 [00:05<00:00, 19.27it/s, loss=0.733, v_num=1, val_acc=0.756]

Validation DataLoader 0:  30%|███       | 6/20 [00:00<00:00, 36.75it/s]
Epoch 67:  88%|████████▊ | 103/117 [00:05<00:00, 19.34it/s, loss=0.733, v_num=1, val_acc=0.756]

Validation DataLoader 0:  35%|███▌      | 7/20 [00:00<00:00, 35.96it/s]
Epoch 67:  89%|████████▉ | 104/117 [00:05<00:00, 19.42it/s, loss=0.733, v_num=1, val_acc=0.756]

Validation DataLoader 0:  40%|████      | 8/20 [00:00<00:00, 35.35it/s]
Epoch 67:  90%|████████▉ | 105/117 [00:05<00:00, 19.49it/s, loss=0.733, v_num=1, val_acc=0.756]

Validation DataLoader 0:  45%|████▌     | 9/20 [00:00<00:00, 34.87it/s]
Epoch 67:  91%|█████████ | 106/117 [00:05<00:00, 19.56it/s, loss=0.733, v_num=1, val_acc=0.756]

Validation DataLoader 0:  50%|█████     | 10/20 [00:00<00:00, 34.52it/s]
Epoch 67:  91%|█████████▏| 107/117 [00:05<00:00, 19.63it/s, loss=0.733, v_num=1, val_acc=0.756]

Validation DataLoader 0:  55%|█████▌    | 11/20 [00:00<00:00, 34.24it/s]
Epoch 67:  92%|█████████▏| 108/117 [00:05<00:00, 19.70it/s, loss=0.733, v_num=1, val_acc=0.756]

Validation DataLoader 0:  60%|██████    | 12/20 [00:00<00:00, 34.01it/s]
Epoch 67:  93%|█████████▎| 109/117 [00:05<00:00, 19.77it/s, loss=0.733, v_num=1, val_acc=0.756]

Validation DataLoader 0:  65%|██████▌   | 13/20 [00:00<00:00, 33.78it/s]
Epoch 67:  94%|█████████▍| 110/117 [00:05<00:00, 19.83it/s, loss=0.733, v_num=1, val_acc=0.756]

Validation DataLoader 0:  70%|███████   | 14/20 [00:00<00:00, 33.56it/s]
Epoch 67:  95%|█████████▍| 111/117 [00:05<00:00, 19.90it/s, loss=0.733, v_num=1, val_acc=0.756]

Validation DataLoader 0:  75%|███████▌  | 15/20 [00:00<00:00, 33.47it/s]
Epoch 67:  96%|█████████▌| 112/117 [00:05<00:00, 19.96it/s, loss=0.733, v_num=1, val_acc=0.756]

Validation DataLoader 0:  80%|████████  | 16/20 [00:00<00:00, 33.34it/s]
Epoch 67:  97%|█████████▋| 113/117 [00:05<00:00, 20.03it/s, loss=0.733, v_num=1, val_acc=0.756]

Validation DataLoader 0:  85%|████████▌ | 17/20 [00:00<00:00, 33.21it/s]
Epoch 67:  97%|█████████▋| 114/117 [00:05<00:00, 20.09it/s, loss=0.733, v_num=1, val_acc=0.756]

Validation DataLoader 0:  90%|█████████ | 18/20 [00:00<00:00, 33.12it/s]
Epoch 67:  98%|█████████▊| 115/117 [00:05<00:00, 20.16it/s, loss=0.733, v_num=1, val_acc=0.756]

Validation DataLoader 0:  95%|█████████▌| 19/20 [00:00<00:00, 33.04it/s]
Epoch 67:  99%|█████████▉| 116/117 [00:05<00:00, 20.22it/s, loss=0.733, v_num=1, val_acc=0.756]

Validation DataLoader 0: 100%|██████████| 20/20 [00:00<00:00, 33.03it/s]
Epoch 67: 100%|██████████| 117/117 [00:05<00:00, 20.29it/s, loss=0.733, v_num=1, val_acc=0.756]
Epoch 67: 100%|██████████| 117/117 [00:05<00:00, 20.22it/s, loss=0.733, v_num=1, val_acc=0.754]


Epoch 67: 100%|██████████| 117/117 [00:05<00:00, 20.21it/s, loss=0.733, v_num=1, val_acc=0.754]
Epoch 67:   0%|          | 0/117 [00:00<?, ?it/s, loss=0.733, v_num=1, val_acc=0.754]
Epoch 68:   0%|          | 0/117 [00:00<?, ?it/s, loss=0.733, v_num=1, val_acc=0.754]
Epoch 68:   1%|          | 1/117 [00:00<01:45,  1.10it/s, loss=0.733, v_num=1, val_acc=0.754]
Epoch 68:   1%|          | 1/117 [00:00<01:48,  1.07it/s, loss=0.732, v_num=1, val_acc=0.754]
Epoch 68:   2%|▏         | 2/117 [00:00<00:54,  2.10it/s, loss=0.732, v_num=1, val_acc=0.754]
Epoch 68:   2%|▏         | 2/117 [00:00<00:56,  2.05it/s, loss=0.724, v_num=1, val_acc=0.754]
Epoch 68:   3%|▎         | 3/117 [00:00<00:37,  3.05it/s, loss=0.724, v_num=1, val_acc=0.754]
Epoch 68:   3%|▎         | 3/117 [00:01<00:38,  2.97it/s, loss=0.724, v_num=1, val_acc=0.754]
Epoch 68:   3%|▎         | 4/117 [00:01<00:28,  3.93it/s, loss=0.724, v_num=1, val_acc=0.754]
Epoch 68:   3%|▎         | 4/117 [00:01<00:29,  3.84it/s, loss=0.727, v_num=1, val_acc=0.754]
Epoch 68:   4%|▍         | 5/117 [00:01<00:23,  4.75it/s, loss=0.727, v_num=1, val_acc=0.754]
Epoch 68:   4%|▍         | 5/117 [00:01<00:24,  4.64it/s, loss=0.725, v_num=1, val_acc=0.754]
Epoch 68:   5%|▌         | 6/117 [00:01<00:20,  5.52it/s, loss=0.725, v_num=1, val_acc=0.754]
Epoch 68:   5%|▌         | 6/117 [00:01<00:20,  5.40it/s, loss=0.726, v_num=1, val_acc=0.754]
Epoch 68:   6%|▌         | 7/117 [00:01<00:17,  6.25it/s, loss=0.726, v_num=1, val_acc=0.754]
Epoch 68:   6%|▌         | 7/117 [00:01<00:18,  6.11it/s, loss=0.717, v_num=1, val_acc=0.754]
Epoch 68:   7%|▋         | 8/117 [00:01<00:15,  6.93it/s, loss=0.717, v_num=1, val_acc=0.754]
Epoch 68:   7%|▋         | 8/117 [00:01<00:16,  6.78it/s, loss=0.705, v_num=1, val_acc=0.754]
Epoch 68:   8%|▊         | 9/117 [00:01<00:14,  7.57it/s, loss=0.705, v_num=1, val_acc=0.754]
Epoch 68:   8%|▊         | 9/117 [00:01<00:14,  7.41it/s, loss=0.702, v_num=1, val_acc=0.754]
Epoch 68:   9%|▊         | 10/117 [00:01<00:13,  8.15it/s, loss=0.702, v_num=1, val_acc=0.754]
Epoch 68:   9%|▊         | 10/117 [00:01<00:13,  7.99it/s, loss=0.705, v_num=1, val_acc=0.754]
Epoch 68:   9%|▉         | 11/117 [00:01<00:12,  8.72it/s, loss=0.705, v_num=1, val_acc=0.754]
Epoch 68:   9%|▉         | 11/117 [00:01<00:12,  8.55it/s, loss=0.706, v_num=1, val_acc=0.754]
Epoch 68:  10%|█         | 12/117 [00:01<00:11,  9.26it/s, loss=0.706, v_num=1, val_acc=0.754]
Epoch 68:  10%|█         | 12/117 [00:01<00:11,  9.08it/s, loss=0.711, v_num=1, val_acc=0.754]
Epoch 68:  11%|█         | 13/117 [00:01<00:10,  9.78it/s, loss=0.711, v_num=1, val_acc=0.754]
Epoch 68:  11%|█         | 13/117 [00:01<00:10,  9.60it/s, loss=0.711, v_num=1, val_acc=0.754]
Epoch 68:  12%|█▏        | 14/117 [00:01<00:10, 10.27it/s, loss=0.711, v_num=1, val_acc=0.754]
Epoch 68:  12%|█▏        | 14/117 [00:01<00:10, 10.08it/s, loss=0.717, v_num=1, val_acc=0.754]
Epoch 68:  13%|█▎        | 15/117 [00:01<00:09, 10.74it/s, loss=0.717, v_num=1, val_acc=0.754]
Epoch 68:  13%|█▎        | 15/117 [00:01<00:09, 10.55it/s, loss=0.719, v_num=1, val_acc=0.754]
Epoch 68:  14%|█▎        | 16/117 [00:01<00:09, 11.18it/s, loss=0.719, v_num=1, val_acc=0.754]
Epoch 68:  14%|█▎        | 16/117 [00:01<00:09, 10.99it/s, loss=0.725, v_num=1, val_acc=0.754]
Epoch 68:  15%|█▍        | 17/117 [00:01<00:08, 11.60it/s, loss=0.725, v_num=1, val_acc=0.754]
Epoch 68:  15%|█▍        | 17/117 [00:01<00:08, 11.40it/s, loss=0.727, v_num=1, val_acc=0.754]
Epoch 68:  15%|█▌        | 18/117 [00:01<00:08, 12.00it/s, loss=0.727, v_num=1, val_acc=0.754]
Epoch 68:  15%|█▌        | 18/117 [00:01<00:08, 11.80it/s, loss=0.728, v_num=1, val_acc=0.754]
Epoch 68:  16%|█▌        | 19/117 [00:01<00:07, 12.38it/s, loss=0.728, v_num=1, val_acc=0.754]
Epoch 68:  16%|█▌        | 19/117 [00:01<00:08, 12.18it/s, loss=0.73, v_num=1, val_acc=0.754]
Epoch 68:  17%|█▋        | 20/117 [00:01<00:07, 12.70it/s, loss=0.73, v_num=1, val_acc=0.754]
Epoch 68:  17%|█▋        | 20/117 [00:01<00:07, 12.51it/s, loss=0.729, v_num=1, val_acc=0.754]
Epoch 68:  18%|█▊        | 21/117 [00:01<00:07, 13.06it/s, loss=0.729, v_num=1, val_acc=0.754]
Epoch 68:  18%|█▊        | 21/117 [00:01<00:07, 12.85it/s, loss=0.733, v_num=1, val_acc=0.754]
Epoch 68:  19%|█▉        | 22/117 [00:01<00:07, 13.37it/s, loss=0.733, v_num=1, val_acc=0.754]
Epoch 68:  19%|█▉        | 22/117 [00:01<00:07, 13.18it/s, loss=0.736, v_num=1, val_acc=0.754]
Epoch 68:  20%|█▉        | 23/117 [00:01<00:06, 13.70it/s, loss=0.736, v_num=1, val_acc=0.754]
Epoch 68:  20%|█▉        | 23/117 [00:01<00:06, 13.50it/s, loss=0.736, v_num=1, val_acc=0.754]
Epoch 68:  21%|██        | 24/117 [00:01<00:06, 14.01it/s, loss=0.736, v_num=1, val_acc=0.754]
Epoch 68:  21%|██        | 24/117 [00:01<00:06, 13.81it/s, loss=0.735, v_num=1, val_acc=0.754]
Epoch 68:  21%|██▏       | 25/117 [00:01<00:06, 14.31it/s, loss=0.735, v_num=1, val_acc=0.754]
Epoch 68:  21%|██▏       | 25/117 [00:01<00:06, 14.10it/s, loss=0.735, v_num=1, val_acc=0.754]
Epoch 68:  22%|██▏       | 26/117 [00:01<00:06, 14.59it/s, loss=0.735, v_num=1, val_acc=0.754]
Epoch 68:  22%|██▏       | 26/117 [00:01<00:06, 14.39it/s, loss=0.737, v_num=1, val_acc=0.754]
Epoch 68:  23%|██▎       | 27/117 [00:01<00:06, 14.86it/s, loss=0.737, v_num=1, val_acc=0.754]
Epoch 68:  23%|██▎       | 27/117 [00:01<00:06, 14.66it/s, loss=0.744, v_num=1, val_acc=0.754]
Epoch 68:  24%|██▍       | 28/117 [00:01<00:05, 15.12it/s, loss=0.744, v_num=1, val_acc=0.754]
Epoch 68:  24%|██▍       | 28/117 [00:01<00:05, 14.92it/s, loss=0.745, v_num=1, val_acc=0.754]
Epoch 68:  25%|██▍       | 29/117 [00:01<00:05, 15.38it/s, loss=0.745, v_num=1, val_acc=0.754]
Epoch 68:  25%|██▍       | 29/117 [00:01<00:05, 15.17it/s, loss=0.748, v_num=1, val_acc=0.754]
Epoch 68:  26%|██▌       | 30/117 [00:01<00:05, 15.62it/s, loss=0.748, v_num=1, val_acc=0.754]
Epoch 68:  26%|██▌       | 30/117 [00:01<00:05, 15.42it/s, loss=0.745, v_num=1, val_acc=0.754]
Epoch 68:  26%|██▋       | 31/117 [00:01<00:05, 15.86it/s, loss=0.745, v_num=1, val_acc=0.754]
Epoch 68:  26%|██▋       | 31/117 [00:01<00:05, 15.66it/s, loss=0.745, v_num=1, val_acc=0.754]
Epoch 68:  27%|██▋       | 32/117 [00:01<00:05, 16.09it/s, loss=0.745, v_num=1, val_acc=0.754]
Epoch 68:  27%|██▋       | 32/117 [00:02<00:05, 15.88it/s, loss=0.744, v_num=1, val_acc=0.754]
Epoch 68:  28%|██▊       | 33/117 [00:02<00:05, 16.31it/s, loss=0.744, v_num=1, val_acc=0.754]
Epoch 68:  28%|██▊       | 33/117 [00:02<00:05, 16.10it/s, loss=0.741, v_num=1, val_acc=0.754]
Epoch 68:  29%|██▉       | 34/117 [00:02<00:05, 16.52it/s, loss=0.741, v_num=1, val_acc=0.754]
Epoch 68:  29%|██▉       | 34/117 [00:02<00:05, 16.32it/s, loss=0.738, v_num=1, val_acc=0.754]
Epoch 68:  30%|██▉       | 35/117 [00:02<00:04, 16.72it/s, loss=0.738, v_num=1, val_acc=0.754]
Epoch 68:  30%|██▉       | 35/117 [00:02<00:04, 16.52it/s, loss=0.737, v_num=1, val_acc=0.754]
Epoch 68:  31%|███       | 36/117 [00:02<00:04, 16.92it/s, loss=0.737, v_num=1, val_acc=0.754]
Epoch 68:  31%|███       | 36/117 [00:02<00:04, 16.72it/s, loss=0.735, v_num=1, val_acc=0.754]
Epoch 68:  32%|███▏      | 37/117 [00:02<00:04, 17.11it/s, loss=0.735, v_num=1, val_acc=0.754]
Epoch 68:  32%|███▏      | 37/117 [00:02<00:04, 16.92it/s, loss=0.725, v_num=1, val_acc=0.754]
Epoch 68:  32%|███▏      | 38/117 [00:02<00:04, 17.30it/s, loss=0.725, v_num=1, val_acc=0.754]
Epoch 68:  32%|███▏      | 38/117 [00:02<00:04, 17.10it/s, loss=0.722, v_num=1, val_acc=0.754]
Epoch 68:  33%|███▎      | 39/117 [00:02<00:04, 17.48it/s, loss=0.722, v_num=1, val_acc=0.754]
Epoch 68:  33%|███▎      | 39/117 [00:02<00:04, 17.29it/s, loss=0.722, v_num=1, val_acc=0.754]
Epoch 68:  34%|███▍      | 40/117 [00:02<00:04, 17.66it/s, loss=0.722, v_num=1, val_acc=0.754]
Epoch 68:  34%|███▍      | 40/117 [00:02<00:04, 17.46it/s, loss=0.721, v_num=1, val_acc=0.754]
Epoch 68:  35%|███▌      | 41/117 [00:02<00:04, 17.83it/s, loss=0.721, v_num=1, val_acc=0.754]
Epoch 68:  35%|███▌      | 41/117 [00:02<00:04, 17.63it/s, loss=0.716, v_num=1, val_acc=0.754]
Epoch 68:  36%|███▌      | 42/117 [00:02<00:04, 17.99it/s, loss=0.716, v_num=1, val_acc=0.754]
Epoch 68:  36%|███▌      | 42/117 [00:02<00:04, 17.80it/s, loss=0.717, v_num=1, val_acc=0.754]
Epoch 68:  37%|███▋      | 43/117 [00:02<00:04, 18.15it/s, loss=0.717, v_num=1, val_acc=0.754]
Epoch 68:  37%|███▋      | 43/117 [00:02<00:04, 17.96it/s, loss=0.711, v_num=1, val_acc=0.754]
Epoch 68:  38%|███▊      | 44/117 [00:02<00:03, 18.31it/s, loss=0.711, v_num=1, val_acc=0.754]
Epoch 68:  38%|███▊      | 44/117 [00:02<00:04, 18.12it/s, loss=0.708, v_num=1, val_acc=0.754]
Epoch 68:  38%|███▊      | 45/117 [00:02<00:03, 18.46it/s, loss=0.708, v_num=1, val_acc=0.754]
Epoch 68:  38%|███▊      | 45/117 [00:02<00:03, 18.27it/s, loss=0.712, v_num=1, val_acc=0.754]
Epoch 68:  39%|███▉      | 46/117 [00:02<00:03, 18.61it/s, loss=0.712, v_num=1, val_acc=0.754]
Epoch 68:  39%|███▉      | 46/117 [00:02<00:03, 18.42it/s, loss=0.713, v_num=1, val_acc=0.754]
Epoch 68:  40%|████      | 47/117 [00:02<00:03, 18.75it/s, loss=0.713, v_num=1, val_acc=0.754]
Epoch 68:  40%|████      | 47/117 [00:02<00:03, 18.56it/s, loss=0.717, v_num=1, val_acc=0.754]
Epoch 68:  41%|████      | 48/117 [00:02<00:03, 18.89it/s, loss=0.717, v_num=1, val_acc=0.754]
Epoch 68:  41%|████      | 48/117 [00:02<00:03, 18.70it/s, loss=0.718, v_num=1, val_acc=0.754]
Epoch 68:  42%|████▏     | 49/117 [00:02<00:03, 19.02it/s, loss=0.718, v_num=1, val_acc=0.754]
Epoch 68:  42%|████▏     | 49/117 [00:02<00:03, 18.84it/s, loss=0.721, v_num=1, val_acc=0.754]
Epoch 68:  43%|████▎     | 50/117 [00:02<00:03, 19.16it/s, loss=0.721, v_num=1, val_acc=0.754]
Epoch 68:  43%|████▎     | 50/117 [00:02<00:03, 18.97it/s, loss=0.721, v_num=1, val_acc=0.754]
Epoch 68:  44%|████▎     | 51/117 [00:02<00:03, 19.28it/s, loss=0.721, v_num=1, val_acc=0.754]
Epoch 68:  44%|████▎     | 51/117 [00:02<00:03, 19.10it/s, loss=0.724, v_num=1, val_acc=0.754]
Epoch 68:  44%|████▍     | 52/117 [00:02<00:03, 19.41it/s, loss=0.724, v_num=1, val_acc=0.754]
Epoch 68:  44%|████▍     | 52/117 [00:02<00:03, 19.23it/s, loss=0.716, v_num=1, val_acc=0.754]
Epoch 68:  45%|████▌     | 53/117 [00:02<00:03, 19.53it/s, loss=0.716, v_num=1, val_acc=0.754]
Epoch 68:  45%|████▌     | 53/117 [00:02<00:03, 19.35it/s, loss=0.719, v_num=1, val_acc=0.754]
Epoch 68:  46%|████▌     | 54/117 [00:02<00:03, 19.65it/s, loss=0.719, v_num=1, val_acc=0.754]
Epoch 68:  46%|████▌     | 54/117 [00:02<00:03, 19.47it/s, loss=0.717, v_num=1, val_acc=0.754]
Epoch 68:  47%|████▋     | 55/117 [00:02<00:03, 19.76it/s, loss=0.717, v_num=1, val_acc=0.754]
Epoch 68:  47%|████▋     | 55/117 [00:02<00:03, 19.58it/s, loss=0.719, v_num=1, val_acc=0.754]
Epoch 68:  48%|████▊     | 56/117 [00:02<00:03, 19.87it/s, loss=0.719, v_num=1, val_acc=0.754]
Epoch 68:  48%|████▊     | 56/117 [00:02<00:03, 19.70it/s, loss=0.719, v_num=1, val_acc=0.754]
Epoch 68:  49%|████▊     | 57/117 [00:02<00:03, 19.98it/s, loss=0.719, v_num=1, val_acc=0.754]
Epoch 68:  49%|████▊     | 57/117 [00:02<00:03, 19.81it/s, loss=0.728, v_num=1, val_acc=0.754]
Epoch 68:  50%|████▉     | 58/117 [00:02<00:02, 20.09it/s, loss=0.728, v_num=1, val_acc=0.754]
Epoch 68:  50%|████▉     | 58/117 [00:02<00:02, 19.92it/s, loss=0.726, v_num=1, val_acc=0.754]
Epoch 68:  50%|█████     | 59/117 [00:02<00:02, 20.20it/s, loss=0.726, v_num=1, val_acc=0.754]
Epoch 68:  50%|█████     | 59/117 [00:02<00:02, 20.02it/s, loss=0.73, v_num=1, val_acc=0.754]
Epoch 68:  51%|█████▏    | 60/117 [00:02<00:02, 20.30it/s, loss=0.73, v_num=1, val_acc=0.754]
Epoch 68:  51%|█████▏    | 60/117 [00:02<00:02, 20.13it/s, loss=0.728, v_num=1, val_acc=0.754]
Epoch 68:  52%|█████▏    | 61/117 [00:02<00:02, 20.40it/s, loss=0.728, v_num=1, val_acc=0.754]
Epoch 68:  52%|█████▏    | 61/117 [00:03<00:02, 20.23it/s, loss=0.727, v_num=1, val_acc=0.754]
Epoch 68:  53%|█████▎    | 62/117 [00:03<00:02, 20.50it/s, loss=0.727, v_num=1, val_acc=0.754]
Epoch 68:  53%|█████▎    | 62/117 [00:03<00:02, 20.33it/s, loss=0.728, v_num=1, val_acc=0.754]
Epoch 68:  54%|█████▍    | 63/117 [00:03<00:02, 20.59it/s, loss=0.728, v_num=1, val_acc=0.754]
Epoch 68:  54%|█████▍    | 63/117 [00:03<00:02, 20.42it/s, loss=0.736, v_num=1, val_acc=0.754]
Epoch 68:  55%|█████▍    | 64/117 [00:03<00:02, 20.69it/s, loss=0.736, v_num=1, val_acc=0.754]
Epoch 68:  55%|█████▍    | 64/117 [00:03<00:02, 20.52it/s, loss=0.743, v_num=1, val_acc=0.754]
Epoch 68:  56%|█████▌    | 65/117 [00:03<00:02, 20.78it/s, loss=0.743, v_num=1, val_acc=0.754]
Epoch 68:  56%|█████▌    | 65/117 [00:03<00:02, 20.61it/s, loss=0.742, v_num=1, val_acc=0.754]
Epoch 68:  56%|█████▋    | 66/117 [00:03<00:02, 20.87it/s, loss=0.742, v_num=1, val_acc=0.754]
Epoch 68:  56%|█████▋    | 66/117 [00:03<00:02, 20.70it/s, loss=0.744, v_num=1, val_acc=0.754]
Epoch 68:  57%|█████▋    | 67/117 [00:03<00:02, 20.96it/s, loss=0.744, v_num=1, val_acc=0.754]
Epoch 68:  57%|█████▋    | 67/117 [00:03<00:02, 20.79it/s, loss=0.745, v_num=1, val_acc=0.754]
Epoch 68:  58%|█████▊    | 68/117 [00:03<00:02, 21.04it/s, loss=0.745, v_num=1, val_acc=0.754]
Epoch 68:  58%|█████▊    | 68/117 [00:03<00:02, 20.88it/s, loss=0.744, v_num=1, val_acc=0.754]
Epoch 68:  59%|█████▉    | 69/117 [00:03<00:02, 21.12it/s, loss=0.744, v_num=1, val_acc=0.754]
Epoch 68:  59%|█████▉    | 69/117 [00:03<00:02, 20.96it/s, loss=0.735, v_num=1, val_acc=0.754]
Epoch 68:  60%|█████▉    | 70/117 [00:03<00:02, 21.21it/s, loss=0.735, v_num=1, val_acc=0.754]
Epoch 68:  60%|█████▉    | 70/117 [00:03<00:02, 21.05it/s, loss=0.738, v_num=1, val_acc=0.754]
Epoch 68:  61%|██████    | 71/117 [00:03<00:02, 21.29it/s, loss=0.738, v_num=1, val_acc=0.754]
Epoch 68:  61%|██████    | 71/117 [00:03<00:02, 21.13it/s, loss=0.735, v_num=1, val_acc=0.754]
Epoch 68:  62%|██████▏   | 72/117 [00:03<00:02, 21.34it/s, loss=0.735, v_num=1, val_acc=0.754]
Epoch 68:  62%|██████▏   | 72/117 [00:03<00:02, 21.20it/s, loss=0.742, v_num=1, val_acc=0.754]
Epoch 68:  62%|██████▏   | 73/117 [00:03<00:02, 21.43it/s, loss=0.742, v_num=1, val_acc=0.754]
Epoch 68:  62%|██████▏   | 73/117 [00:03<00:02, 21.28it/s, loss=0.736, v_num=1, val_acc=0.754]
Epoch 68:  63%|██████▎   | 74/117 [00:03<00:01, 21.51it/s, loss=0.736, v_num=1, val_acc=0.754]
Epoch 68:  63%|██████▎   | 74/117 [00:03<00:02, 21.35it/s, loss=0.739, v_num=1, val_acc=0.754]
Epoch 68:  64%|██████▍   | 75/117 [00:03<00:01, 21.58it/s, loss=0.739, v_num=1, val_acc=0.754]
Epoch 68:  64%|██████▍   | 75/117 [00:03<00:01, 21.43it/s, loss=0.74, v_num=1, val_acc=0.754]
Epoch 68:  65%|██████▍   | 76/117 [00:03<00:01, 21.66it/s, loss=0.74, v_num=1, val_acc=0.754]
Epoch 68:  65%|██████▍   | 76/117 [00:03<00:01, 21.50it/s, loss=0.742, v_num=1, val_acc=0.754]
Epoch 68:  66%|██████▌   | 77/117 [00:03<00:01, 21.73it/s, loss=0.742, v_num=1, val_acc=0.754]
Epoch 68:  66%|██████▌   | 77/117 [00:03<00:01, 21.57it/s, loss=0.739, v_num=1, val_acc=0.754]
Epoch 68:  67%|██████▋   | 78/117 [00:03<00:01, 21.80it/s, loss=0.739, v_num=1, val_acc=0.754]
Epoch 68:  67%|██████▋   | 78/117 [00:03<00:01, 21.64it/s, loss=0.743, v_num=1, val_acc=0.754]
Epoch 68:  68%|██████▊   | 79/117 [00:03<00:01, 21.87it/s, loss=0.743, v_num=1, val_acc=0.754]
Epoch 68:  68%|██████▊   | 79/117 [00:03<00:01, 21.71it/s, loss=0.743, v_num=1, val_acc=0.754]
Epoch 68:  68%|██████▊   | 80/117 [00:03<00:01, 21.93it/s, loss=0.743, v_num=1, val_acc=0.754]
Epoch 68:  68%|██████▊   | 80/117 [00:03<00:01, 21.78it/s, loss=0.75, v_num=1, val_acc=0.754]
Epoch 68:  69%|██████▉   | 81/117 [00:03<00:01, 22.00it/s, loss=0.75, v_num=1, val_acc=0.754]
Epoch 68:  69%|██████▉   | 81/117 [00:03<00:01, 21.85it/s, loss=0.751, v_num=1, val_acc=0.754]
Epoch 68:  70%|███████   | 82/117 [00:03<00:01, 22.04it/s, loss=0.751, v_num=1, val_acc=0.754]
Epoch 68:  70%|███████   | 82/117 [00:03<00:01, 21.89it/s, loss=0.751, v_num=1, val_acc=0.754]
Epoch 68:  71%|███████   | 83/117 [00:03<00:01, 22.10it/s, loss=0.751, v_num=1, val_acc=0.754]
Epoch 68:  71%|███████   | 83/117 [00:03<00:01, 21.96it/s, loss=0.75, v_num=1, val_acc=0.754]
Epoch 68:  72%|███████▏  | 84/117 [00:03<00:01, 22.16it/s, loss=0.75, v_num=1, val_acc=0.754]
Epoch 68:  72%|███████▏  | 84/117 [00:03<00:01, 22.02it/s, loss=0.745, v_num=1, val_acc=0.754]
Epoch 68:  73%|███████▎  | 85/117 [00:03<00:01, 22.22it/s, loss=0.745, v_num=1, val_acc=0.754]
Epoch 68:  73%|███████▎  | 85/117 [00:03<00:01, 22.08it/s, loss=0.745, v_num=1, val_acc=0.754]
Epoch 68:  74%|███████▎  | 86/117 [00:03<00:01, 22.29it/s, loss=0.745, v_num=1, val_acc=0.754]
Epoch 68:  74%|███████▎  | 86/117 [00:03<00:01, 22.14it/s, loss=0.745, v_num=1, val_acc=0.754]
Epoch 68:  74%|███████▍  | 87/117 [00:03<00:01, 22.35it/s, loss=0.745, v_num=1, val_acc=0.754]
Epoch 68:  74%|███████▍  | 87/117 [00:03<00:01, 22.20it/s, loss=0.74, v_num=1, val_acc=0.754]
Epoch 68:  75%|███████▌  | 88/117 [00:03<00:01, 22.41it/s, loss=0.74, v_num=1, val_acc=0.754]
Epoch 68:  75%|███████▌  | 88/117 [00:03<00:01, 22.26it/s, loss=0.736, v_num=1, val_acc=0.754]
Epoch 68:  76%|███████▌  | 89/117 [00:03<00:01, 22.46it/s, loss=0.736, v_num=1, val_acc=0.754]
Epoch 68:  76%|███████▌  | 89/117 [00:03<00:01, 22.32it/s, loss=0.745, v_num=1, val_acc=0.754]
Epoch 68:  77%|███████▋  | 90/117 [00:03<00:01, 22.52it/s, loss=0.745, v_num=1, val_acc=0.754]
Epoch 68:  77%|███████▋  | 90/117 [00:04<00:01, 22.38it/s, loss=0.745, v_num=1, val_acc=0.754]
Epoch 68:  78%|███████▊  | 91/117 [00:04<00:01, 22.58it/s, loss=0.745, v_num=1, val_acc=0.754]
Epoch 68:  78%|███████▊  | 91/117 [00:04<00:01, 22.44it/s, loss=0.745, v_num=1, val_acc=0.754]
Epoch 68:  79%|███████▊  | 92/117 [00:04<00:01, 22.63it/s, loss=0.745, v_num=1, val_acc=0.754]
Epoch 68:  79%|███████▊  | 92/117 [00:04<00:01, 22.49it/s, loss=0.739, v_num=1, val_acc=0.754]
Epoch 68:  79%|███████▉  | 93/117 [00:04<00:01, 22.68it/s, loss=0.739, v_num=1, val_acc=0.754]
Epoch 68:  79%|███████▉  | 93/117 [00:04<00:01, 22.55it/s, loss=0.746, v_num=1, val_acc=0.754]
Epoch 68:  80%|████████  | 94/117 [00:04<00:01, 22.74it/s, loss=0.746, v_num=1, val_acc=0.754]
Epoch 68:  80%|████████  | 94/117 [00:04<00:01, 22.60it/s, loss=0.741, v_num=1, val_acc=0.754]
Epoch 68:  81%|████████  | 95/117 [00:04<00:00, 22.79it/s, loss=0.741, v_num=1, val_acc=0.754]
Epoch 68:  81%|████████  | 95/117 [00:04<00:00, 22.65it/s, loss=0.739, v_num=1, val_acc=0.754]
Epoch 68:  82%|████████▏ | 96/117 [00:04<00:00, 22.84it/s, loss=0.739, v_num=1, val_acc=0.754]
Epoch 68:  82%|████████▏ | 96/117 [00:04<00:00, 22.70it/s, loss=0.735, v_num=1, val_acc=0.754]
Epoch 68:  83%|████████▎ | 97/117 [00:04<00:00, 22.89it/s, loss=0.735, v_num=1, val_acc=0.754]
Epoch 68:  83%|████████▎ | 97/117 [00:04<00:00, 22.76it/s, loss=0.738, v_num=1, val_acc=0.754]

Validation: 0it [00:00, ?it/s]

Validation:   0%|          | 0/20 [00:00<?, ?it/s]

Validation DataLoader 0:   0%|          | 0/20 [00:00<?, ?it/s]

Validation DataLoader 0:   5%|▌         | 1/20 [00:00<00:00, 191.57it/s]
Epoch 68:  84%|████████▍ | 98/117 [00:05<00:00, 19.32it/s, loss=0.738, v_num=1, val_acc=0.754]

Validation DataLoader 0:  10%|█         | 2/20 [00:00<00:00, 55.86it/s]
Epoch 68:  85%|████████▍ | 99/117 [00:05<00:00, 19.40it/s, loss=0.738, v_num=1, val_acc=0.754]

Validation DataLoader 0:  15%|█▌        | 3/20 [00:00<00:00, 44.36it/s]
Epoch 68:  85%|████████▌ | 100/117 [00:05<00:00, 19.48it/s, loss=0.738, v_num=1, val_acc=0.754]

Validation DataLoader 0:  20%|██        | 4/20 [00:00<00:00, 40.26it/s]
Epoch 68:  86%|████████▋ | 101/117 [00:05<00:00, 19.55it/s, loss=0.738, v_num=1, val_acc=0.754]

Validation DataLoader 0:  25%|██▌       | 5/20 [00:00<00:00, 37.87it/s]
Epoch 68:  87%|████████▋ | 102/117 [00:05<00:00, 19.62it/s, loss=0.738, v_num=1, val_acc=0.754]

Validation DataLoader 0:  30%|███       | 6/20 [00:00<00:00, 36.65it/s]
Epoch 68:  88%|████████▊ | 103/117 [00:05<00:00, 19.69it/s, loss=0.738, v_num=1, val_acc=0.754]

Validation DataLoader 0:  35%|███▌      | 7/20 [00:00<00:00, 35.85it/s]
Epoch 68:  89%|████████▉ | 104/117 [00:05<00:00, 19.77it/s, loss=0.738, v_num=1, val_acc=0.754]

Validation DataLoader 0:  40%|████      | 8/20 [00:00<00:00, 35.17it/s]
Epoch 68:  90%|████████▉ | 105/117 [00:05<00:00, 19.83it/s, loss=0.738, v_num=1, val_acc=0.754]

Validation DataLoader 0:  45%|████▌     | 9/20 [00:00<00:00, 34.64it/s]
Epoch 68:  91%|█████████ | 106/117 [00:05<00:00, 19.90it/s, loss=0.738, v_num=1, val_acc=0.754]

Validation DataLoader 0:  50%|█████     | 10/20 [00:00<00:00, 34.38it/s]
Epoch 68:  91%|█████████▏| 107/117 [00:05<00:00, 19.97it/s, loss=0.738, v_num=1, val_acc=0.754]

Validation DataLoader 0:  55%|█████▌    | 11/20 [00:00<00:00, 34.08it/s]
Epoch 68:  92%|█████████▏| 108/117 [00:05<00:00, 20.04it/s, loss=0.738, v_num=1, val_acc=0.754]

Validation DataLoader 0:  60%|██████    | 12/20 [00:00<00:00, 33.88it/s]
Epoch 68:  93%|█████████▎| 109/117 [00:05<00:00, 20.11it/s, loss=0.738, v_num=1, val_acc=0.754]

Validation DataLoader 0:  65%|██████▌   | 13/20 [00:00<00:00, 33.69it/s]
Epoch 68:  94%|█████████▍| 110/117 [00:05<00:00, 20.18it/s, loss=0.738, v_num=1, val_acc=0.754]

Validation DataLoader 0:  70%|███████   | 14/20 [00:00<00:00, 33.55it/s]
Epoch 68:  95%|█████████▍| 111/117 [00:05<00:00, 20.24it/s, loss=0.738, v_num=1, val_acc=0.754]

Validation DataLoader 0:  75%|███████▌  | 15/20 [00:00<00:00, 33.40it/s]
Epoch 68:  96%|█████████▌| 112/117 [00:05<00:00, 20.31it/s, loss=0.738, v_num=1, val_acc=0.754]

Validation DataLoader 0:  80%|████████  | 16/20 [00:00<00:00, 33.29it/s]
Epoch 68:  97%|█████████▋| 113/117 [00:05<00:00, 20.37it/s, loss=0.738, v_num=1, val_acc=0.754]

Validation DataLoader 0:  85%|████████▌ | 17/20 [00:00<00:00, 33.16it/s]
Epoch 68:  97%|█████████▋| 114/117 [00:05<00:00, 20.43it/s, loss=0.738, v_num=1, val_acc=0.754]

Validation DataLoader 0:  90%|█████████ | 18/20 [00:00<00:00, 33.07it/s]
Epoch 68:  98%|█████████▊| 115/117 [00:05<00:00, 20.50it/s, loss=0.738, v_num=1, val_acc=0.754]

Validation DataLoader 0:  95%|█████████▌| 19/20 [00:00<00:00, 33.00it/s]
Epoch 68:  99%|█████████▉| 116/117 [00:05<00:00, 20.56it/s, loss=0.738, v_num=1, val_acc=0.754]

Validation DataLoader 0: 100%|██████████| 20/20 [00:00<00:00, 32.99it/s]
Epoch 68: 100%|██████████| 117/117 [00:05<00:00, 20.63it/s, loss=0.738, v_num=1, val_acc=0.754]
Epoch 68: 100%|██████████| 117/117 [00:05<00:00, 20.55it/s, loss=0.738, v_num=1, val_acc=0.758]


Epoch 68: 100%|██████████| 117/117 [00:05<00:00, 20.55it/s, loss=0.738, v_num=1, val_acc=0.758]
Epoch 68:   0%|          | 0/117 [00:00<?, ?it/s, loss=0.738, v_num=1, val_acc=0.758]
Epoch 69:   0%|          | 0/117 [00:00<?, ?it/s, loss=0.738, v_num=1, val_acc=0.758]
Epoch 69:   1%|          | 1/117 [00:00<01:43,  1.12it/s, loss=0.738, v_num=1, val_acc=0.758]
Epoch 69:   1%|          | 1/117 [00:00<01:46,  1.09it/s, loss=0.734, v_num=1, val_acc=0.758]
Epoch 69:   2%|▏         | 2/117 [00:00<00:53,  2.14it/s, loss=0.734, v_num=1, val_acc=0.758]
Epoch 69:   2%|▏         | 2/117 [00:00<00:54,  2.09it/s, loss=0.728, v_num=1, val_acc=0.758]
Epoch 69:   3%|▎         | 3/117 [00:00<00:36,  3.09it/s, loss=0.728, v_num=1, val_acc=0.758]
Epoch 69:   3%|▎         | 3/117 [00:00<00:37,  3.01it/s, loss=0.722, v_num=1, val_acc=0.758]
Epoch 69:   3%|▎         | 4/117 [00:01<00:28,  3.98it/s, loss=0.722, v_num=1, val_acc=0.758]
Epoch 69:   3%|▎         | 4/117 [00:01<00:29,  3.89it/s, loss=0.721, v_num=1, val_acc=0.758]
Epoch 69:   4%|▍         | 5/117 [00:01<00:23,  4.82it/s, loss=0.721, v_num=1, val_acc=0.758]
Epoch 69:   4%|▍         | 5/117 [00:01<00:23,  4.70it/s, loss=0.72, v_num=1, val_acc=0.758]
Epoch 69:   5%|▌         | 6/117 [00:01<00:19,  5.59it/s, loss=0.72, v_num=1, val_acc=0.758]
Epoch 69:   5%|▌         | 6/117 [00:01<00:20,  5.46it/s, loss=0.715, v_num=1, val_acc=0.758]
Epoch 69:   6%|▌         | 7/117 [00:01<00:17,  6.32it/s, loss=0.715, v_num=1, val_acc=0.758]
Epoch 69:   6%|▌         | 7/117 [00:01<00:17,  6.18it/s, loss=0.716, v_num=1, val_acc=0.758]
Epoch 69:   7%|▋         | 8/117 [00:01<00:15,  7.00it/s, loss=0.716, v_num=1, val_acc=0.758]
Epoch 69:   7%|▋         | 8/117 [00:01<00:15,  6.85it/s, loss=0.716, v_num=1, val_acc=0.758]
Epoch 69:   8%|▊         | 9/117 [00:01<00:14,  7.63it/s, loss=0.716, v_num=1, val_acc=0.758]
Epoch 69:   8%|▊         | 9/117 [00:01<00:14,  7.47it/s, loss=0.715, v_num=1, val_acc=0.758]
Epoch 69:   9%|▊         | 10/117 [00:01<00:12,  8.24it/s, loss=0.715, v_num=1, val_acc=0.758]
Epoch 69:   9%|▊         | 10/117 [00:01<00:13,  8.07it/s, loss=0.713, v_num=1, val_acc=0.758]
Epoch 69:   9%|▉         | 11/117 [00:01<00:12,  8.75it/s, loss=0.713, v_num=1, val_acc=0.758]
Epoch 69:   9%|▉         | 11/117 [00:01<00:12,  8.60it/s, loss=0.714, v_num=1, val_acc=0.758]
Epoch 69:  10%|█         | 12/117 [00:01<00:11,  9.32it/s, loss=0.714, v_num=1, val_acc=0.758]
Epoch 69:  10%|█         | 12/117 [00:01<00:11,  9.14it/s, loss=0.709, v_num=1, val_acc=0.758]
Epoch 69:  11%|█         | 13/117 [00:01<00:10,  9.84it/s, loss=0.709, v_num=1, val_acc=0.758]
Epoch 69:  11%|█         | 13/117 [00:01<00:10,  9.65it/s, loss=0.71, v_num=1, val_acc=0.758]
Epoch 69:  12%|█▏        | 14/117 [00:01<00:09, 10.33it/s, loss=0.71, v_num=1, val_acc=0.758]
Epoch 69:  12%|█▏        | 14/117 [00:01<00:10, 10.14it/s, loss=0.715, v_num=1, val_acc=0.758]
Epoch 69:  13%|█▎        | 15/117 [00:01<00:09, 10.80it/s, loss=0.715, v_num=1, val_acc=0.758]
Epoch 69:  13%|█▎        | 15/117 [00:01<00:09, 10.60it/s, loss=0.72, v_num=1, val_acc=0.758]
Epoch 69:  14%|█▎        | 16/117 [00:01<00:08, 11.25it/s, loss=0.72, v_num=1, val_acc=0.758]
Epoch 69:  14%|█▎        | 16/117 [00:01<00:09, 11.05it/s, loss=0.717, v_num=1, val_acc=0.758]
Epoch 69:  15%|█▍        | 17/117 [00:01<00:08, 11.63it/s, loss=0.717, v_num=1, val_acc=0.758]
Epoch 69:  15%|█▍        | 17/117 [00:01<00:08, 11.45it/s, loss=0.718, v_num=1, val_acc=0.758]
Epoch 69:  15%|█▌        | 18/117 [00:01<00:08, 12.04it/s, loss=0.718, v_num=1, val_acc=0.758]
Epoch 69:  15%|█▌        | 18/117 [00:01<00:08, 11.84it/s, loss=0.715, v_num=1, val_acc=0.758]
Epoch 69:  16%|█▌        | 19/117 [00:01<00:07, 12.41it/s, loss=0.715, v_num=1, val_acc=0.758]
Epoch 69:  16%|█▌        | 19/117 [00:01<00:08, 12.21it/s, loss=0.713, v_num=1, val_acc=0.758]
Epoch 69:  17%|█▋        | 20/117 [00:01<00:07, 12.73it/s, loss=0.713, v_num=1, val_acc=0.758]
Epoch 69:  17%|█▋        | 20/117 [00:01<00:07, 12.55it/s, loss=0.708, v_num=1, val_acc=0.758]
Epoch 69:  18%|█▊        | 21/117 [00:01<00:07, 13.11it/s, loss=0.708, v_num=1, val_acc=0.758]
Epoch 69:  18%|█▊        | 21/117 [00:01<00:07, 12.91it/s, loss=0.708, v_num=1, val_acc=0.758]
Epoch 69:  19%|█▉        | 22/117 [00:01<00:07, 13.45it/s, loss=0.708, v_num=1, val_acc=0.758]
Epoch 69:  19%|█▉        | 22/117 [00:01<00:07, 13.24it/s, loss=0.708, v_num=1, val_acc=0.758]
Epoch 69:  20%|█▉        | 23/117 [00:01<00:06, 13.77it/s, loss=0.708, v_num=1, val_acc=0.758]
Epoch 69:  20%|█▉        | 23/117 [00:01<00:06, 13.56it/s, loss=0.709, v_num=1, val_acc=0.758]
Epoch 69:  21%|██        | 24/117 [00:01<00:06, 14.08it/s, loss=0.709, v_num=1, val_acc=0.758]
Epoch 69:  21%|██        | 24/117 [00:01<00:06, 13.87it/s, loss=0.703, v_num=1, val_acc=0.758]
Epoch 69:  21%|██▏       | 25/117 [00:01<00:06, 14.37it/s, loss=0.703, v_num=1, val_acc=0.758]
Epoch 69:  21%|██▏       | 25/117 [00:01<00:06, 14.17it/s, loss=0.701, v_num=1, val_acc=0.758]
Epoch 69:  22%|██▏       | 26/117 [00:01<00:06, 14.66it/s, loss=0.701, v_num=1, val_acc=0.758]
Epoch 69:  22%|██▏       | 26/117 [00:01<00:06, 14.45it/s, loss=0.705, v_num=1, val_acc=0.758]
Epoch 69:  23%|██▎       | 27/117 [00:01<00:06, 14.92it/s, loss=0.705, v_num=1, val_acc=0.758]
Epoch 69:  23%|██▎       | 27/117 [00:01<00:06, 14.71it/s, loss=0.711, v_num=1, val_acc=0.758]
Epoch 69:  24%|██▍       | 28/117 [00:01<00:05, 15.14it/s, loss=0.711, v_num=1, val_acc=0.758]
Epoch 69:  24%|██▍       | 28/117 [00:01<00:05, 14.96it/s, loss=0.709, v_num=1, val_acc=0.758]
Epoch 69:  25%|██▍       | 29/117 [00:01<00:05, 15.42it/s, loss=0.709, v_num=1, val_acc=0.758]
Epoch 69:  25%|██▍       | 29/117 [00:01<00:05, 15.22it/s, loss=0.705, v_num=1, val_acc=0.758]
Epoch 69:  26%|██▌       | 30/117 [00:01<00:05, 15.67it/s, loss=0.705, v_num=1, val_acc=0.758]
Epoch 69:  26%|██▌       | 30/117 [00:01<00:05, 15.46it/s, loss=0.708, v_num=1, val_acc=0.758]
Epoch 69:  26%|██▋       | 31/117 [00:01<00:05, 15.89it/s, loss=0.708, v_num=1, val_acc=0.758]
Epoch 69:  26%|██▋       | 31/117 [00:01<00:05, 15.69it/s, loss=0.705, v_num=1, val_acc=0.758]
Epoch 69:  27%|██▋       | 32/117 [00:01<00:05, 16.12it/s, loss=0.705, v_num=1, val_acc=0.758]
Epoch 69:  27%|██▋       | 32/117 [00:02<00:05, 15.92it/s, loss=0.71, v_num=1, val_acc=0.758]
Epoch 69:  28%|██▊       | 33/117 [00:02<00:05, 16.34it/s, loss=0.71, v_num=1, val_acc=0.758]
Epoch 69:  28%|██▊       | 33/117 [00:02<00:05, 16.14it/s, loss=0.708, v_num=1, val_acc=0.758]
Epoch 69:  29%|██▉       | 34/117 [00:02<00:05, 16.56it/s, loss=0.708, v_num=1, val_acc=0.758]
Epoch 69:  29%|██▉       | 34/117 [00:02<00:05, 16.36it/s, loss=0.702, v_num=1, val_acc=0.758]
Epoch 69:  30%|██▉       | 35/117 [00:02<00:04, 16.76it/s, loss=0.702, v_num=1, val_acc=0.758]
Epoch 69:  30%|██▉       | 35/117 [00:02<00:04, 16.56it/s, loss=0.699, v_num=1, val_acc=0.758]
Epoch 69:  31%|███       | 36/117 [00:02<00:04, 16.96it/s, loss=0.699, v_num=1, val_acc=0.758]
Epoch 69:  31%|███       | 36/117 [00:02<00:04, 16.76it/s, loss=0.699, v_num=1, val_acc=0.758]
Epoch 69:  32%|███▏      | 37/117 [00:02<00:04, 17.12it/s, loss=0.699, v_num=1, val_acc=0.758]
Epoch 69:  32%|███▏      | 37/117 [00:02<00:04, 16.93it/s, loss=0.697, v_num=1, val_acc=0.758]
Epoch 69:  32%|███▏      | 38/117 [00:02<00:04, 17.31it/s, loss=0.697, v_num=1, val_acc=0.758]
Epoch 69:  32%|███▏      | 38/117 [00:02<00:04, 17.12it/s, loss=0.699, v_num=1, val_acc=0.758]
Epoch 69:  33%|███▎      | 39/117 [00:02<00:04, 17.49it/s, loss=0.699, v_num=1, val_acc=0.758]
Epoch 69:  33%|███▎      | 39/117 [00:02<00:04, 17.29it/s, loss=0.703, v_num=1, val_acc=0.758]
Epoch 69:  34%|███▍      | 40/117 [00:02<00:04, 17.65it/s, loss=0.703, v_num=1, val_acc=0.758]
Epoch 69:  34%|███▍      | 40/117 [00:02<00:04, 17.46it/s, loss=0.708, v_num=1, val_acc=0.758]
Epoch 69:  35%|███▌      | 41/117 [00:02<00:04, 17.82it/s, loss=0.708, v_num=1, val_acc=0.758]
Epoch 69:  35%|███▌      | 41/117 [00:02<00:04, 17.63it/s, loss=0.71, v_num=1, val_acc=0.758]
Epoch 69:  36%|███▌      | 42/117 [00:02<00:04, 17.99it/s, loss=0.71, v_num=1, val_acc=0.758]
Epoch 69:  36%|███▌      | 42/117 [00:02<00:04, 17.80it/s, loss=0.711, v_num=1, val_acc=0.758]
Epoch 69:  37%|███▋      | 43/117 [00:02<00:04, 18.15it/s, loss=0.711, v_num=1, val_acc=0.758]
Epoch 69:  37%|███▋      | 43/117 [00:02<00:04, 17.96it/s, loss=0.708, v_num=1, val_acc=0.758]
Epoch 69:  38%|███▊      | 44/117 [00:02<00:03, 18.30it/s, loss=0.708, v_num=1, val_acc=0.758]
Epoch 69:  38%|███▊      | 44/117 [00:02<00:04, 18.11it/s, loss=0.714, v_num=1, val_acc=0.758]
Epoch 69:  38%|███▊      | 45/117 [00:02<00:03, 18.44it/s, loss=0.714, v_num=1, val_acc=0.758]
Epoch 69:  38%|███▊      | 45/117 [00:02<00:03, 18.26it/s, loss=0.716, v_num=1, val_acc=0.758]
Epoch 69:  39%|███▉      | 46/117 [00:02<00:03, 18.59it/s, loss=0.716, v_num=1, val_acc=0.758]
Epoch 69:  39%|███▉      | 46/117 [00:02<00:03, 18.40it/s, loss=0.711, v_num=1, val_acc=0.758]
Epoch 69:  40%|████      | 47/117 [00:02<00:03, 18.73it/s, loss=0.711, v_num=1, val_acc=0.758]
Epoch 69:  40%|████      | 47/117 [00:02<00:03, 18.54it/s, loss=0.709, v_num=1, val_acc=0.758]
Epoch 69:  41%|████      | 48/117 [00:02<00:03, 18.86it/s, loss=0.709, v_num=1, val_acc=0.758]
Epoch 69:  41%|████      | 48/117 [00:02<00:03, 18.68it/s, loss=0.709, v_num=1, val_acc=0.758]
Epoch 69:  42%|████▏     | 49/117 [00:02<00:03, 18.96it/s, loss=0.709, v_num=1, val_acc=0.758]
Epoch 69:  42%|████▏     | 49/117 [00:02<00:03, 18.79it/s, loss=0.712, v_num=1, val_acc=0.758]
Epoch 69:  43%|████▎     | 50/117 [00:02<00:03, 19.11it/s, loss=0.712, v_num=1, val_acc=0.758]
Epoch 69:  43%|████▎     | 50/117 [00:02<00:03, 18.93it/s, loss=0.705, v_num=1, val_acc=0.758]
Epoch 69:  44%|████▎     | 51/117 [00:02<00:03, 19.23it/s, loss=0.705, v_num=1, val_acc=0.758]
Epoch 69:  44%|████▎     | 51/117 [00:02<00:03, 19.05it/s, loss=0.709, v_num=1, val_acc=0.758]
Epoch 69:  44%|████▍     | 52/117 [00:02<00:03, 19.36it/s, loss=0.709, v_num=1, val_acc=0.758]
Epoch 69:  44%|████▍     | 52/117 [00:02<00:03, 19.18it/s, loss=0.704, v_num=1, val_acc=0.758]
Epoch 69:  45%|████▌     | 53/117 [00:02<00:03, 19.48it/s, loss=0.704, v_num=1, val_acc=0.758]
Epoch 69:  45%|████▌     | 53/117 [00:02<00:03, 19.30it/s, loss=0.702, v_num=1, val_acc=0.758]
Epoch 69:  46%|████▌     | 54/117 [00:02<00:03, 19.60it/s, loss=0.702, v_num=1, val_acc=0.758]
Epoch 69:  46%|████▌     | 54/117 [00:02<00:03, 19.42it/s, loss=0.702, v_num=1, val_acc=0.758]
Epoch 69:  47%|████▋     | 55/117 [00:02<00:03, 19.72it/s, loss=0.702, v_num=1, val_acc=0.758]
Epoch 69:  47%|████▋     | 55/117 [00:02<00:03, 19.54it/s, loss=0.707, v_num=1, val_acc=0.758]
Epoch 69:  48%|████▊     | 56/117 [00:02<00:03, 19.83it/s, loss=0.707, v_num=1, val_acc=0.758]
Epoch 69:  48%|████▊     | 56/117 [00:02<00:03, 19.66it/s, loss=0.713, v_num=1, val_acc=0.758]
Epoch 69:  49%|████▊     | 57/117 [00:02<00:03, 19.94it/s, loss=0.713, v_num=1, val_acc=0.758]
Epoch 69:  49%|████▊     | 57/117 [00:02<00:03, 19.77it/s, loss=0.72, v_num=1, val_acc=0.758]
Epoch 69:  50%|████▉     | 58/117 [00:02<00:02, 20.05it/s, loss=0.72, v_num=1, val_acc=0.758]
Epoch 69:  50%|████▉     | 58/117 [00:02<00:02, 19.87it/s, loss=0.718, v_num=1, val_acc=0.758]
Epoch 69:  50%|█████     | 59/117 [00:02<00:02, 20.15it/s, loss=0.718, v_num=1, val_acc=0.758]
Epoch 69:  50%|█████     | 59/117 [00:02<00:02, 19.98it/s, loss=0.712, v_num=1, val_acc=0.758]
Epoch 69:  51%|█████▏    | 60/117 [00:02<00:02, 20.26it/s, loss=0.712, v_num=1, val_acc=0.758]
Epoch 69:  51%|█████▏    | 60/117 [00:02<00:02, 20.09it/s, loss=0.711, v_num=1, val_acc=0.758]
Epoch 69:  52%|█████▏    | 61/117 [00:02<00:02, 20.36it/s, loss=0.711, v_num=1, val_acc=0.758]
Epoch 69:  52%|█████▏    | 61/117 [00:03<00:02, 20.19it/s, loss=0.715, v_num=1, val_acc=0.758]
Epoch 69:  53%|█████▎    | 62/117 [00:03<00:02, 20.46it/s, loss=0.715, v_num=1, val_acc=0.758]
Epoch 69:  53%|█████▎    | 62/117 [00:03<00:02, 20.29it/s, loss=0.716, v_num=1, val_acc=0.758]
Epoch 69:  54%|█████▍    | 63/117 [00:03<00:02, 20.55it/s, loss=0.716, v_num=1, val_acc=0.758]
Epoch 69:  54%|█████▍    | 63/117 [00:03<00:02, 20.39it/s, loss=0.72, v_num=1, val_acc=0.758]
Epoch 69:  55%|█████▍    | 64/117 [00:03<00:02, 20.65it/s, loss=0.72, v_num=1, val_acc=0.758]
Epoch 69:  55%|█████▍    | 64/117 [00:03<00:02, 20.48it/s, loss=0.719, v_num=1, val_acc=0.758]
Epoch 69:  56%|█████▌    | 65/117 [00:03<00:02, 20.74it/s, loss=0.719, v_num=1, val_acc=0.758]
Epoch 69:  56%|█████▌    | 65/117 [00:03<00:02, 20.57it/s, loss=0.718, v_num=1, val_acc=0.758]
Epoch 69:  56%|█████▋    | 66/117 [00:03<00:02, 20.83it/s, loss=0.718, v_num=1, val_acc=0.758]
Epoch 69:  56%|█████▋    | 66/117 [00:03<00:02, 20.67it/s, loss=0.726, v_num=1, val_acc=0.758]
Epoch 69:  57%|█████▋    | 67/117 [00:03<00:02, 20.92it/s, loss=0.726, v_num=1, val_acc=0.758]
Epoch 69:  57%|█████▋    | 67/117 [00:03<00:02, 20.75it/s, loss=0.724, v_num=1, val_acc=0.758]
Epoch 69:  58%|█████▊    | 68/117 [00:03<00:02, 21.01it/s, loss=0.724, v_num=1, val_acc=0.758]
Epoch 69:  58%|█████▊    | 68/117 [00:03<00:02, 20.84it/s, loss=0.727, v_num=1, val_acc=0.758]
Epoch 69:  59%|█████▉    | 69/117 [00:03<00:02, 21.09it/s, loss=0.727, v_num=1, val_acc=0.758]
Epoch 69:  59%|█████▉    | 69/117 [00:03<00:02, 20.93it/s, loss=0.73, v_num=1, val_acc=0.758]
Epoch 69:  60%|█████▉    | 70/117 [00:03<00:02, 21.17it/s, loss=0.73, v_num=1, val_acc=0.758]
Epoch 69:  60%|█████▉    | 70/117 [00:03<00:02, 21.01it/s, loss=0.735, v_num=1, val_acc=0.758]
Epoch 69:  61%|██████    | 71/117 [00:03<00:02, 21.26it/s, loss=0.735, v_num=1, val_acc=0.758]
Epoch 69:  61%|██████    | 71/117 [00:03<00:02, 21.10it/s, loss=0.731, v_num=1, val_acc=0.758]
Epoch 69:  62%|██████▏   | 72/117 [00:03<00:02, 21.34it/s, loss=0.731, v_num=1, val_acc=0.758]
Epoch 69:  62%|██████▏   | 72/117 [00:03<00:02, 21.18it/s, loss=0.728, v_num=1, val_acc=0.758]
Epoch 69:  62%|██████▏   | 73/117 [00:03<00:02, 21.42it/s, loss=0.728, v_num=1, val_acc=0.758]
Epoch 69:  62%|██████▏   | 73/117 [00:03<00:02, 21.26it/s, loss=0.729, v_num=1, val_acc=0.758]
Epoch 69:  63%|██████▎   | 74/117 [00:03<00:02, 21.49it/s, loss=0.729, v_num=1, val_acc=0.758]
Epoch 69:  63%|██████▎   | 74/117 [00:03<00:02, 21.34it/s, loss=0.729, v_num=1, val_acc=0.758]
Epoch 69:  64%|██████▍   | 75/117 [00:03<00:01, 21.57it/s, loss=0.729, v_num=1, val_acc=0.758]
Epoch 69:  64%|██████▍   | 75/117 [00:03<00:01, 21.41it/s, loss=0.723, v_num=1, val_acc=0.758]
Epoch 69:  65%|██████▍   | 76/117 [00:03<00:01, 21.64it/s, loss=0.723, v_num=1, val_acc=0.758]
Epoch 69:  65%|██████▍   | 76/117 [00:03<00:01, 21.49it/s, loss=0.721, v_num=1, val_acc=0.758]
Epoch 69:  66%|██████▌   | 77/117 [00:03<00:01, 21.71it/s, loss=0.721, v_num=1, val_acc=0.758]
Epoch 69:  66%|██████▌   | 77/117 [00:03<00:01, 21.56it/s, loss=0.718, v_num=1, val_acc=0.758]
Epoch 69:  67%|██████▋   | 78/117 [00:03<00:01, 21.79it/s, loss=0.718, v_num=1, val_acc=0.758]
Epoch 69:  67%|██████▋   | 78/117 [00:03<00:01, 21.63it/s, loss=0.719, v_num=1, val_acc=0.758]
Epoch 69:  68%|██████▊   | 79/117 [00:03<00:01, 21.86it/s, loss=0.719, v_num=1, val_acc=0.758]
Epoch 69:  68%|██████▊   | 79/117 [00:03<00:01, 21.70it/s, loss=0.724, v_num=1, val_acc=0.758]
Epoch 69:  68%|██████▊   | 80/117 [00:03<00:01, 21.92it/s, loss=0.724, v_num=1, val_acc=0.758]
Epoch 69:  68%|██████▊   | 80/117 [00:03<00:01, 21.77it/s, loss=0.726, v_num=1, val_acc=0.758]
Epoch 69:  69%|██████▉   | 81/117 [00:03<00:01, 21.99it/s, loss=0.726, v_num=1, val_acc=0.758]
Epoch 69:  69%|██████▉   | 81/117 [00:03<00:01, 21.84it/s, loss=0.732, v_num=1, val_acc=0.758]
Epoch 69:  70%|███████   | 82/117 [00:03<00:01, 22.04it/s, loss=0.732, v_num=1, val_acc=0.758]
Epoch 69:  70%|███████   | 82/117 [00:03<00:01, 21.90it/s, loss=0.734, v_num=1, val_acc=0.758]
Epoch 69:  71%|███████   | 83/117 [00:03<00:01, 22.11it/s, loss=0.734, v_num=1, val_acc=0.758]
Epoch 69:  71%|███████   | 83/117 [00:03<00:01, 21.96it/s, loss=0.738, v_num=1, val_acc=0.758]
Epoch 69:  72%|███████▏  | 84/117 [00:03<00:01, 22.17it/s, loss=0.738, v_num=1, val_acc=0.758]
Epoch 69:  72%|███████▏  | 84/117 [00:03<00:01, 22.03it/s, loss=0.74, v_num=1, val_acc=0.758]
Epoch 69:  73%|███████▎  | 85/117 [00:03<00:01, 22.24it/s, loss=0.74, v_num=1, val_acc=0.758]
Epoch 69:  73%|███████▎  | 85/117 [00:03<00:01, 22.09it/s, loss=0.738, v_num=1, val_acc=0.758]
Epoch 69:  74%|███████▎  | 86/117 [00:03<00:01, 22.30it/s, loss=0.738, v_num=1, val_acc=0.758]
Epoch 69:  74%|███████▎  | 86/117 [00:03<00:01, 22.15it/s, loss=0.731, v_num=1, val_acc=0.758]
Epoch 69:  74%|███████▍  | 87/117 [00:03<00:01, 22.36it/s, loss=0.731, v_num=1, val_acc=0.758]
Epoch 69:  74%|███████▍  | 87/117 [00:03<00:01, 22.21it/s, loss=0.73, v_num=1, val_acc=0.758]
Epoch 69:  75%|███████▌  | 88/117 [00:03<00:01, 22.42it/s, loss=0.73, v_num=1, val_acc=0.758]
Epoch 69:  75%|███████▌  | 88/117 [00:03<00:01, 22.28it/s, loss=0.731, v_num=1, val_acc=0.758]
Epoch 69:  76%|███████▌  | 89/117 [00:03<00:01, 22.48it/s, loss=0.731, v_num=1, val_acc=0.758]
Epoch 69:  76%|███████▌  | 89/117 [00:03<00:01, 22.34it/s, loss=0.727, v_num=1, val_acc=0.758]
Epoch 69:  77%|███████▋  | 90/117 [00:03<00:01, 22.54it/s, loss=0.727, v_num=1, val_acc=0.758]
Epoch 69:  77%|███████▋  | 90/117 [00:04<00:01, 22.39it/s, loss=0.724, v_num=1, val_acc=0.758]
Epoch 69:  78%|███████▊  | 91/117 [00:04<00:01, 22.59it/s, loss=0.724, v_num=1, val_acc=0.758]
Epoch 69:  78%|███████▊  | 91/117 [00:04<00:01, 22.45it/s, loss=0.731, v_num=1, val_acc=0.758]
Epoch 69:  79%|███████▊  | 92/117 [00:04<00:01, 22.61it/s, loss=0.731, v_num=1, val_acc=0.758]
Epoch 69:  79%|███████▊  | 92/117 [00:04<00:01, 22.49it/s, loss=0.732, v_num=1, val_acc=0.758]
Epoch 69:  79%|███████▉  | 93/117 [00:04<00:01, 22.68it/s, loss=0.732, v_num=1, val_acc=0.758]
Epoch 69:  79%|███████▉  | 93/117 [00:04<00:01, 22.54it/s, loss=0.734, v_num=1, val_acc=0.758]
Epoch 69:  80%|████████  | 94/117 [00:04<00:01, 22.74it/s, loss=0.734, v_num=1, val_acc=0.758]
Epoch 69:  80%|████████  | 94/117 [00:04<00:01, 22.60it/s, loss=0.735, v_num=1, val_acc=0.758]
Epoch 69:  81%|████████  | 95/117 [00:04<00:00, 22.79it/s, loss=0.735, v_num=1, val_acc=0.758]
Epoch 69:  81%|████████  | 95/117 [00:04<00:00, 22.65it/s, loss=0.737, v_num=1, val_acc=0.758]
Epoch 69:  82%|████████▏ | 96/117 [00:04<00:00, 22.84it/s, loss=0.737, v_num=1, val_acc=0.758]
Epoch 69:  82%|████████▏ | 96/117 [00:04<00:00, 22.70it/s, loss=0.739, v_num=1, val_acc=0.758]
Epoch 69:  83%|████████▎ | 97/117 [00:04<00:00, 22.89it/s, loss=0.739, v_num=1, val_acc=0.758]
Epoch 69:  83%|████████▎ | 97/117 [00:04<00:00, 22.75it/s, loss=0.746, v_num=1, val_acc=0.758]

Validation: 0it [00:00, ?it/s]

Validation:   0%|          | 0/20 [00:00<?, ?it/s]

Validation DataLoader 0:   0%|          | 0/20 [00:00<?, ?it/s]

Validation DataLoader 0:   5%|▌         | 1/20 [00:00<00:00, 184.28it/s]
Epoch 69:  84%|████████▍ | 98/117 [00:05<00:00, 19.20it/s, loss=0.746, v_num=1, val_acc=0.758]

Validation DataLoader 0:  10%|█         | 2/20 [00:00<00:00, 55.69it/s]
Epoch 69:  85%|████████▍ | 99/117 [00:05<00:00, 19.28it/s, loss=0.746, v_num=1, val_acc=0.758]

Validation DataLoader 0:  15%|█▌        | 3/20 [00:00<00:00, 44.49it/s]
Epoch 69:  85%|████████▌ | 100/117 [00:05<00:00, 19.36it/s, loss=0.746, v_num=1, val_acc=0.758]

Validation DataLoader 0:  20%|██        | 4/20 [00:00<00:00, 40.40it/s]
Epoch 69:  86%|████████▋ | 101/117 [00:05<00:00, 19.43it/s, loss=0.746, v_num=1, val_acc=0.758]

Validation DataLoader 0:  25%|██▌       | 5/20 [00:00<00:00, 38.22it/s]
Epoch 69:  87%|████████▋ | 102/117 [00:05<00:00, 19.51it/s, loss=0.746, v_num=1, val_acc=0.758]

Validation DataLoader 0:  30%|███       | 6/20 [00:00<00:00, 36.96it/s]
Epoch 69:  88%|████████▊ | 103/117 [00:05<00:00, 19.58it/s, loss=0.746, v_num=1, val_acc=0.758]

Validation DataLoader 0:  35%|███▌      | 7/20 [00:00<00:00, 36.09it/s]
Epoch 69:  89%|████████▉ | 104/117 [00:05<00:00, 19.65it/s, loss=0.746, v_num=1, val_acc=0.758]

Validation DataLoader 0:  40%|████      | 8/20 [00:00<00:00, 35.45it/s]
Epoch 69:  90%|████████▉ | 105/117 [00:05<00:00, 19.72it/s, loss=0.746, v_num=1, val_acc=0.758]

Validation DataLoader 0:  45%|████▌     | 9/20 [00:00<00:00, 34.94it/s]
Epoch 69:  91%|█████████ | 106/117 [00:05<00:00, 19.79it/s, loss=0.746, v_num=1, val_acc=0.758]

Validation DataLoader 0:  50%|█████     | 10/20 [00:00<00:00, 34.59it/s]
Epoch 69:  91%|█████████▏| 107/117 [00:05<00:00, 19.86it/s, loss=0.746, v_num=1, val_acc=0.758]

Validation DataLoader 0:  55%|█████▌    | 11/20 [00:00<00:00, 34.31it/s]
Epoch 69:  92%|█████████▏| 108/117 [00:05<00:00, 19.93it/s, loss=0.746, v_num=1, val_acc=0.758]

Validation DataLoader 0:  60%|██████    | 12/20 [00:00<00:00, 34.07it/s]
Epoch 69:  93%|█████████▎| 109/117 [00:05<00:00, 20.00it/s, loss=0.746, v_num=1, val_acc=0.758]

Validation DataLoader 0:  65%|██████▌   | 13/20 [00:00<00:00, 33.87it/s]
Epoch 69:  94%|█████████▍| 110/117 [00:05<00:00, 20.06it/s, loss=0.746, v_num=1, val_acc=0.758]

Validation DataLoader 0:  70%|███████   | 14/20 [00:00<00:00, 33.68it/s]
Epoch 69:  95%|█████████▍| 111/117 [00:05<00:00, 20.13it/s, loss=0.746, v_num=1, val_acc=0.758]

Validation DataLoader 0:  75%|███████▌  | 15/20 [00:00<00:00, 33.53it/s]
Epoch 69:  96%|█████████▌| 112/117 [00:05<00:00, 20.19it/s, loss=0.746, v_num=1, val_acc=0.758]

Validation DataLoader 0:  80%|████████  | 16/20 [00:00<00:00, 33.40it/s]
Epoch 69:  97%|█████████▋| 113/117 [00:05<00:00, 20.26it/s, loss=0.746, v_num=1, val_acc=0.758]

Validation DataLoader 0:  85%|████████▌ | 17/20 [00:00<00:00, 33.28it/s]
Epoch 69:  97%|█████████▋| 114/117 [00:05<00:00, 20.32it/s, loss=0.746, v_num=1, val_acc=0.758]

Validation DataLoader 0:  90%|█████████ | 18/20 [00:00<00:00, 33.18it/s]
Epoch 69:  98%|█████████▊| 115/117 [00:05<00:00, 20.39it/s, loss=0.746, v_num=1, val_acc=0.758]

Validation DataLoader 0:  95%|█████████▌| 19/20 [00:00<00:00, 33.09it/s]
Epoch 69:  99%|█████████▉| 116/117 [00:05<00:00, 20.45it/s, loss=0.746, v_num=1, val_acc=0.758]

Validation DataLoader 0: 100%|██████████| 20/20 [00:00<00:00, 33.08it/s]
Epoch 69: 100%|██████████| 117/117 [00:05<00:00, 20.52it/s, loss=0.746, v_num=1, val_acc=0.758]
Epoch 69: 100%|██████████| 117/117 [00:05<00:00, 20.44it/s, loss=0.746, v_num=1, val_acc=0.752]


Epoch 69: 100%|██████████| 117/117 [00:05<00:00, 20.44it/s, loss=0.746, v_num=1, val_acc=0.752]
Epoch 69:   0%|          | 0/117 [00:00<?, ?it/s, loss=0.746, v_num=1, val_acc=0.752]
Epoch 70:   0%|          | 0/117 [00:00<?, ?it/s, loss=0.746, v_num=1, val_acc=0.752]
Epoch 70:   1%|          | 1/117 [00:00<01:44,  1.11it/s, loss=0.746, v_num=1, val_acc=0.752]
Epoch 70:   1%|          | 1/117 [00:00<01:47,  1.08it/s, loss=0.748, v_num=1, val_acc=0.752]
Epoch 70:   2%|▏         | 2/117 [00:00<00:53,  2.13it/s, loss=0.748, v_num=1, val_acc=0.752]
Epoch 70:   2%|▏         | 2/117 [00:00<00:55,  2.08it/s, loss=0.748, v_num=1, val_acc=0.752]
Epoch 70:   3%|▎         | 3/117 [00:00<00:36,  3.08it/s, loss=0.748, v_num=1, val_acc=0.752]
Epoch 70:   3%|▎         | 3/117 [00:00<00:37,  3.01it/s, loss=0.741, v_num=1, val_acc=0.752]
Epoch 70:   3%|▎         | 4/117 [00:01<00:28,  3.97it/s, loss=0.741, v_num=1, val_acc=0.752]
Epoch 70:   3%|▎         | 4/117 [00:01<00:29,  3.88it/s, loss=0.729, v_num=1, val_acc=0.752]
Epoch 70:   4%|▍         | 5/117 [00:01<00:23,  4.80it/s, loss=0.729, v_num=1, val_acc=0.752]
Epoch 70:   4%|▍         | 5/117 [00:01<00:23,  4.69it/s, loss=0.726, v_num=1, val_acc=0.752]
Epoch 70:   5%|▌         | 6/117 [00:01<00:19,  5.58it/s, loss=0.726, v_num=1, val_acc=0.752]
Epoch 70:   5%|▌         | 6/117 [00:01<00:20,  5.45it/s, loss=0.726, v_num=1, val_acc=0.752]
Epoch 70:   6%|▌         | 7/117 [00:01<00:17,  6.30it/s, loss=0.726, v_num=1, val_acc=0.752]
Epoch 70:   6%|▌         | 7/117 [00:01<00:17,  6.16it/s, loss=0.722, v_num=1, val_acc=0.752]
Epoch 70:   7%|▋         | 8/117 [00:01<00:15,  6.99it/s, loss=0.722, v_num=1, val_acc=0.752]
Epoch 70:   7%|▋         | 8/117 [00:01<00:15,  6.84it/s, loss=0.725, v_num=1, val_acc=0.752]
Epoch 70:   8%|▊         | 9/117 [00:01<00:14,  7.62it/s, loss=0.725, v_num=1, val_acc=0.752]
Epoch 70:   8%|▊         | 9/117 [00:01<00:14,  7.46it/s, loss=0.724, v_num=1, val_acc=0.752]
Epoch 70:   9%|▊         | 10/117 [00:01<00:13,  8.22it/s, loss=0.724, v_num=1, val_acc=0.752]
Epoch 70:   9%|▊         | 10/117 [00:01<00:13,  8.05it/s, loss=0.725, v_num=1, val_acc=0.752]
Epoch 70:   9%|▉         | 11/117 [00:01<00:12,  8.78it/s, loss=0.725, v_num=1, val_acc=0.752]
Epoch 70:   9%|▉         | 11/117 [00:01<00:12,  8.61it/s, loss=0.721, v_num=1, val_acc=0.752]
Epoch 70:  10%|█         | 12/117 [00:01<00:11,  9.33it/s, loss=0.721, v_num=1, val_acc=0.752]
Epoch 70:  10%|█         | 12/117 [00:01<00:11,  9.15it/s, loss=0.726, v_num=1, val_acc=0.752]
Epoch 70:  11%|█         | 13/117 [00:01<00:10,  9.85it/s, loss=0.726, v_num=1, val_acc=0.752]
Epoch 70:  11%|█         | 13/117 [00:01<00:10,  9.66it/s, loss=0.73, v_num=1, val_acc=0.752]
Epoch 70:  12%|█▏        | 14/117 [00:01<00:09, 10.33it/s, loss=0.73, v_num=1, val_acc=0.752]
Epoch 70:  12%|█▏        | 14/117 [00:01<00:10, 10.14it/s, loss=0.726, v_num=1, val_acc=0.752]
Epoch 70:  13%|█▎        | 15/117 [00:01<00:09, 10.79it/s, loss=0.726, v_num=1, val_acc=0.752]
Epoch 70:  13%|█▎        | 15/117 [00:01<00:09, 10.60it/s, loss=0.729, v_num=1, val_acc=0.752]
Epoch 70:  14%|█▎        | 16/117 [00:01<00:08, 11.24it/s, loss=0.729, v_num=1, val_acc=0.752]
Epoch 70:  14%|█▎        | 16/117 [00:01<00:09, 11.04it/s, loss=0.727, v_num=1, val_acc=0.752]
Epoch 70:  15%|█▍        | 17/117 [00:01<00:08, 11.64it/s, loss=0.727, v_num=1, val_acc=0.752]
Epoch 70:  15%|█▍        | 17/117 [00:01<00:08, 11.44it/s, loss=0.725, v_num=1, val_acc=0.752]
Epoch 70:  15%|█▌        | 18/117 [00:01<00:08, 12.04it/s, loss=0.725, v_num=1, val_acc=0.752]
Epoch 70:  15%|█▌        | 18/117 [00:01<00:08, 11.84it/s, loss=0.73, v_num=1, val_acc=0.752]
Epoch 70:  16%|█▌        | 19/117 [00:01<00:07, 12.37it/s, loss=0.73, v_num=1, val_acc=0.752]
Epoch 70:  16%|█▌        | 19/117 [00:01<00:08, 12.19it/s, loss=0.719, v_num=1, val_acc=0.752]
Epoch 70:  17%|█▋        | 20/117 [00:01<00:07, 12.76it/s, loss=0.719, v_num=1, val_acc=0.752]
Epoch 70:  17%|█▋        | 20/117 [00:01<00:07, 12.56it/s, loss=0.711, v_num=1, val_acc=0.752]
Epoch 70:  18%|█▊        | 21/117 [00:01<00:07, 13.07it/s, loss=0.711, v_num=1, val_acc=0.752]
Epoch 70:  18%|█▊        | 21/117 [00:01<00:07, 12.89it/s, loss=0.709, v_num=1, val_acc=0.752]
Epoch 70:  19%|█▉        | 22/117 [00:01<00:07, 13.42it/s, loss=0.709, v_num=1, val_acc=0.752]
Epoch 70:  19%|█▉        | 22/117 [00:01<00:07, 13.22it/s, loss=0.705, v_num=1, val_acc=0.752]
Epoch 70:  20%|█▉        | 23/117 [00:01<00:06, 13.75it/s, loss=0.705, v_num=1, val_acc=0.752]
Epoch 70:  20%|█▉        | 23/117 [00:01<00:06, 13.54it/s, loss=0.713, v_num=1, val_acc=0.752]
Epoch 70:  21%|██        | 24/117 [00:01<00:06, 14.06it/s, loss=0.713, v_num=1, val_acc=0.752]
Epoch 70:  21%|██        | 24/117 [00:01<00:06, 13.85it/s, loss=0.719, v_num=1, val_acc=0.752]
Epoch 70:  21%|██▏       | 25/117 [00:01<00:06, 14.34it/s, loss=0.719, v_num=1, val_acc=0.752]
Epoch 70:  21%|██▏       | 25/117 [00:01<00:06, 14.14it/s, loss=0.716, v_num=1, val_acc=0.752]
Epoch 70:  22%|██▏       | 26/117 [00:01<00:06, 14.64it/s, loss=0.716, v_num=1, val_acc=0.752]
Epoch 70:  22%|██▏       | 26/117 [00:01<00:06, 14.43it/s, loss=0.717, v_num=1, val_acc=0.752]
Epoch 70:  23%|██▎       | 27/117 [00:01<00:06, 14.90it/s, loss=0.717, v_num=1, val_acc=0.752]
Epoch 70:  23%|██▎       | 27/117 [00:01<00:06, 14.70it/s, loss=0.72, v_num=1, val_acc=0.752]
Epoch 70:  24%|██▍       | 28/117 [00:01<00:05, 15.17it/s, loss=0.72, v_num=1, val_acc=0.752]
Epoch 70:  24%|██▍       | 28/117 [00:01<00:05, 14.97it/s, loss=0.726, v_num=1, val_acc=0.752]
Epoch 70:  25%|██▍       | 29/117 [00:01<00:05, 15.43it/s, loss=0.726, v_num=1, val_acc=0.752]
Epoch 70:  25%|██▍       | 29/117 [00:01<00:05, 15.22it/s, loss=0.731, v_num=1, val_acc=0.752]
Epoch 70:  26%|██▌       | 30/117 [00:01<00:05, 15.67it/s, loss=0.731, v_num=1, val_acc=0.752]
Epoch 70:  26%|██▌       | 30/117 [00:01<00:05, 15.47it/s, loss=0.728, v_num=1, val_acc=0.752]
Epoch 70:  26%|██▋       | 31/117 [00:01<00:05, 15.90it/s, loss=0.728, v_num=1, val_acc=0.752]
Epoch 70:  26%|██▋       | 31/117 [00:01<00:05, 15.70it/s, loss=0.731, v_num=1, val_acc=0.752]
Epoch 70:  27%|██▋       | 32/117 [00:01<00:05, 16.13it/s, loss=0.731, v_num=1, val_acc=0.752]
Epoch 70:  27%|██▋       | 32/117 [00:02<00:05, 15.93it/s, loss=0.729, v_num=1, val_acc=0.752]
Epoch 70:  28%|██▊       | 33/117 [00:02<00:05, 16.35it/s, loss=0.729, v_num=1, val_acc=0.752]
Epoch 70:  28%|██▊       | 33/117 [00:02<00:05, 16.15it/s, loss=0.727, v_num=1, val_acc=0.752]
Epoch 70:  29%|██▉       | 34/117 [00:02<00:05, 16.57it/s, loss=0.727, v_num=1, val_acc=0.752]
Epoch 70:  29%|██▉       | 34/117 [00:02<00:05, 16.36it/s, loss=0.728, v_num=1, val_acc=0.752]
Epoch 70:  30%|██▉       | 35/117 [00:02<00:04, 16.77it/s, loss=0.728, v_num=1, val_acc=0.752]
Epoch 70:  30%|██▉       | 35/117 [00:02<00:04, 16.57it/s, loss=0.727, v_num=1, val_acc=0.752]
Epoch 70:  31%|███       | 36/117 [00:02<00:04, 16.97it/s, loss=0.727, v_num=1, val_acc=0.752]
Epoch 70:  31%|███       | 36/117 [00:02<00:04, 16.77it/s, loss=0.726, v_num=1, val_acc=0.752]
Epoch 70:  32%|███▏      | 37/117 [00:02<00:04, 17.16it/s, loss=0.726, v_num=1, val_acc=0.752]
Epoch 70:  32%|███▏      | 37/117 [00:02<00:04, 16.96it/s, loss=0.73, v_num=1, val_acc=0.752]
Epoch 70:  32%|███▏      | 38/117 [00:02<00:04, 17.34it/s, loss=0.73, v_num=1, val_acc=0.752]
Epoch 70:  32%|███▏      | 38/117 [00:02<00:04, 17.15it/s, loss=0.731, v_num=1, val_acc=0.752]
Epoch 70:  33%|███▎      | 39/117 [00:02<00:04, 17.53it/s, loss=0.731, v_num=1, val_acc=0.752]
Epoch 70:  33%|███▎      | 39/117 [00:02<00:04, 17.33it/s, loss=0.732, v_num=1, val_acc=0.752]
Epoch 70:  34%|███▍      | 40/117 [00:02<00:04, 17.70it/s, loss=0.732, v_num=1, val_acc=0.752]
Epoch 70:  34%|███▍      | 40/117 [00:02<00:04, 17.51it/s, loss=0.726, v_num=1, val_acc=0.752]
Epoch 70:  35%|███▌      | 41/117 [00:02<00:04, 17.87it/s, loss=0.726, v_num=1, val_acc=0.752]
Epoch 70:  35%|███▌      | 41/117 [00:02<00:04, 17.68it/s, loss=0.729, v_num=1, val_acc=0.752]
Epoch 70:  36%|███▌      | 42/117 [00:02<00:04, 18.03it/s, loss=0.729, v_num=1, val_acc=0.752]
Epoch 70:  36%|███▌      | 42/117 [00:02<00:04, 17.84it/s, loss=0.735, v_num=1, val_acc=0.752]
Epoch 70:  37%|███▋      | 43/117 [00:02<00:04, 18.19it/s, loss=0.735, v_num=1, val_acc=0.752]
Epoch 70:  37%|███▋      | 43/117 [00:02<00:04, 18.00it/s, loss=0.727, v_num=1, val_acc=0.752]
Epoch 70:  38%|███▊      | 44/117 [00:02<00:03, 18.35it/s, loss=0.727, v_num=1, val_acc=0.752]
Epoch 70:  38%|███▊      | 44/117 [00:02<00:04, 18.15it/s, loss=0.72, v_num=1, val_acc=0.752]
Epoch 70:  38%|███▊      | 45/117 [00:02<00:03, 18.50it/s, loss=0.72, v_num=1, val_acc=0.752]
Epoch 70:  38%|███▊      | 45/117 [00:02<00:03, 18.31it/s, loss=0.722, v_num=1, val_acc=0.752]
Epoch 70:  39%|███▉      | 46/117 [00:02<00:03, 18.64it/s, loss=0.722, v_num=1, val_acc=0.752]
Epoch 70:  39%|███▉      | 46/117 [00:02<00:03, 18.45it/s, loss=0.716, v_num=1, val_acc=0.752]
Epoch 70:  40%|████      | 47/117 [00:02<00:03, 18.79it/s, loss=0.716, v_num=1, val_acc=0.752]
Epoch 70:  40%|████      | 47/117 [00:02<00:03, 18.60it/s, loss=0.715, v_num=1, val_acc=0.752]
Epoch 70:  41%|████      | 48/117 [00:02<00:03, 18.92it/s, loss=0.715, v_num=1, val_acc=0.752]
Epoch 70:  41%|████      | 48/117 [00:02<00:03, 18.74it/s, loss=0.711, v_num=1, val_acc=0.752]
Epoch 70:  42%|████▏     | 49/117 [00:02<00:03, 19.06it/s, loss=0.711, v_num=1, val_acc=0.752]
Epoch 70:  42%|████▏     | 49/117 [00:02<00:03, 18.87it/s, loss=0.709, v_num=1, val_acc=0.752]
Epoch 70:  43%|████▎     | 50/117 [00:02<00:03, 19.19it/s, loss=0.709, v_num=1, val_acc=0.752]
Epoch 70:  43%|████▎     | 50/117 [00:02<00:03, 19.01it/s, loss=0.712, v_num=1, val_acc=0.752]
Epoch 70:  44%|████▎     | 51/117 [00:02<00:03, 19.32it/s, loss=0.712, v_num=1, val_acc=0.752]
Epoch 70:  44%|████▎     | 51/117 [00:02<00:03, 19.14it/s, loss=0.709, v_num=1, val_acc=0.752]
Epoch 70:  44%|████▍     | 52/117 [00:02<00:03, 19.44it/s, loss=0.709, v_num=1, val_acc=0.752]
Epoch 70:  44%|████▍     | 52/117 [00:02<00:03, 19.26it/s, loss=0.714, v_num=1, val_acc=0.752]
Epoch 70:  45%|████▌     | 53/117 [00:02<00:03, 19.57it/s, loss=0.714, v_num=1, val_acc=0.752]
Epoch 70:  45%|████▌     | 53/117 [00:02<00:03, 19.39it/s, loss=0.711, v_num=1, val_acc=0.752]
Epoch 70:  46%|████▌     | 54/117 [00:02<00:03, 19.68it/s, loss=0.711, v_num=1, val_acc=0.752]
Epoch 70:  46%|████▌     | 54/117 [00:02<00:03, 19.50it/s, loss=0.71, v_num=1, val_acc=0.752]
Epoch 70:  47%|████▋     | 55/117 [00:02<00:03, 19.80it/s, loss=0.71, v_num=1, val_acc=0.752]
Epoch 70:  47%|████▋     | 55/117 [00:02<00:03, 19.62it/s, loss=0.706, v_num=1, val_acc=0.752]
Epoch 70:  48%|████▊     | 56/117 [00:02<00:03, 19.91it/s, loss=0.706, v_num=1, val_acc=0.752]
Epoch 70:  48%|████▊     | 56/117 [00:02<00:03, 19.74it/s, loss=0.708, v_num=1, val_acc=0.752]
Epoch 70:  49%|████▊     | 57/117 [00:02<00:02, 20.02it/s, loss=0.708, v_num=1, val_acc=0.752]
Epoch 70:  49%|████▊     | 57/117 [00:02<00:03, 19.85it/s, loss=0.705, v_num=1, val_acc=0.752]
Epoch 70:  50%|████▉     | 58/117 [00:02<00:02, 20.13it/s, loss=0.705, v_num=1, val_acc=0.752]
Epoch 70:  50%|████▉     | 58/117 [00:02<00:02, 19.96it/s, loss=0.704, v_num=1, val_acc=0.752]
Epoch 70:  50%|█████     | 59/117 [00:02<00:02, 20.23it/s, loss=0.704, v_num=1, val_acc=0.752]
Epoch 70:  50%|█████     | 59/117 [00:02<00:02, 20.06it/s, loss=0.708, v_num=1, val_acc=0.752]
Epoch 70:  51%|█████▏    | 60/117 [00:02<00:02, 20.34it/s, loss=0.708, v_num=1, val_acc=0.752]
Epoch 70:  51%|█████▏    | 60/117 [00:02<00:02, 20.16it/s, loss=0.714, v_num=1, val_acc=0.752]
Epoch 70:  52%|█████▏    | 61/117 [00:02<00:02, 20.43it/s, loss=0.714, v_num=1, val_acc=0.752]
Epoch 70:  52%|█████▏    | 61/117 [00:03<00:02, 20.26it/s, loss=0.708, v_num=1, val_acc=0.752]
Epoch 70:  53%|█████▎    | 62/117 [00:03<00:02, 20.53it/s, loss=0.708, v_num=1, val_acc=0.752]
Epoch 70:  53%|█████▎    | 62/117 [00:03<00:02, 20.36it/s, loss=0.706, v_num=1, val_acc=0.752]
Epoch 70:  54%|█████▍    | 63/117 [00:03<00:02, 20.62it/s, loss=0.706, v_num=1, val_acc=0.752]
Epoch 70:  54%|█████▍    | 63/117 [00:03<00:02, 20.46it/s, loss=0.712, v_num=1, val_acc=0.752]
Epoch 70:  55%|█████▍    | 64/117 [00:03<00:02, 20.72it/s, loss=0.712, v_num=1, val_acc=0.752]
Epoch 70:  55%|█████▍    | 64/117 [00:03<00:02, 20.55it/s, loss=0.718, v_num=1, val_acc=0.752]
Epoch 70:  56%|█████▌    | 65/117 [00:03<00:02, 20.81it/s, loss=0.718, v_num=1, val_acc=0.752]
Epoch 70:  56%|█████▌    | 65/117 [00:03<00:02, 20.64it/s, loss=0.72, v_num=1, val_acc=0.752]
Epoch 70:  56%|█████▋    | 66/117 [00:03<00:02, 20.90it/s, loss=0.72, v_num=1, val_acc=0.752]
Epoch 70:  56%|█████▋    | 66/117 [00:03<00:02, 20.73it/s, loss=0.724, v_num=1, val_acc=0.752]
Epoch 70:  57%|█████▋    | 67/117 [00:03<00:02, 20.98it/s, loss=0.724, v_num=1, val_acc=0.752]
Epoch 70:  57%|█████▋    | 67/117 [00:03<00:02, 20.82it/s, loss=0.726, v_num=1, val_acc=0.752]
Epoch 70:  58%|█████▊    | 68/117 [00:03<00:02, 21.07it/s, loss=0.726, v_num=1, val_acc=0.752]
Epoch 70:  58%|█████▊    | 68/117 [00:03<00:02, 20.91it/s, loss=0.728, v_num=1, val_acc=0.752]
Epoch 70:  59%|█████▉    | 69/117 [00:03<00:02, 21.16it/s, loss=0.728, v_num=1, val_acc=0.752]
Epoch 70:  59%|█████▉    | 69/117 [00:03<00:02, 20.99it/s, loss=0.723, v_num=1, val_acc=0.752]
Epoch 70:  60%|█████▉    | 70/117 [00:03<00:02, 21.24it/s, loss=0.723, v_num=1, val_acc=0.752]
Epoch 70:  60%|█████▉    | 70/117 [00:03<00:02, 21.08it/s, loss=0.722, v_num=1, val_acc=0.752]
Epoch 70:  61%|██████    | 71/117 [00:03<00:02, 21.32it/s, loss=0.722, v_num=1, val_acc=0.752]
Epoch 70:  61%|██████    | 71/117 [00:03<00:02, 21.16it/s, loss=0.727, v_num=1, val_acc=0.752]
Epoch 70:  62%|██████▏   | 72/117 [00:03<00:02, 21.40it/s, loss=0.727, v_num=1, val_acc=0.752]
Epoch 70:  62%|██████▏   | 72/117 [00:03<00:02, 21.24it/s, loss=0.721, v_num=1, val_acc=0.752]
Epoch 70:  62%|██████▏   | 73/117 [00:03<00:02, 21.47it/s, loss=0.721, v_num=1, val_acc=0.752]
Epoch 70:  62%|██████▏   | 73/117 [00:03<00:02, 21.31it/s, loss=0.724, v_num=1, val_acc=0.752]
Epoch 70:  63%|██████▎   | 74/117 [00:03<00:01, 21.55it/s, loss=0.724, v_num=1, val_acc=0.752]
Epoch 70:  63%|██████▎   | 74/117 [00:03<00:02, 21.39it/s, loss=0.725, v_num=1, val_acc=0.752]
Epoch 70:  64%|██████▍   | 75/117 [00:03<00:01, 21.62it/s, loss=0.725, v_num=1, val_acc=0.752]
Epoch 70:  64%|██████▍   | 75/117 [00:03<00:01, 21.47it/s, loss=0.728, v_num=1, val_acc=0.752]
Epoch 70:  65%|██████▍   | 76/117 [00:03<00:01, 21.70it/s, loss=0.728, v_num=1, val_acc=0.752]
Epoch 70:  65%|██████▍   | 76/117 [00:03<00:01, 21.54it/s, loss=0.723, v_num=1, val_acc=0.752]
Epoch 70:  66%|██████▌   | 77/117 [00:03<00:01, 21.77it/s, loss=0.723, v_num=1, val_acc=0.752]
Epoch 70:  66%|██████▌   | 77/117 [00:03<00:01, 21.61it/s, loss=0.723, v_num=1, val_acc=0.752]
Epoch 70:  67%|██████▋   | 78/117 [00:03<00:01, 21.84it/s, loss=0.723, v_num=1, val_acc=0.752]
Epoch 70:  67%|██████▋   | 78/117 [00:03<00:01, 21.68it/s, loss=0.72, v_num=1, val_acc=0.752]
Epoch 70:  68%|██████▊   | 79/117 [00:03<00:01, 21.90it/s, loss=0.72, v_num=1, val_acc=0.752]
Epoch 70:  68%|██████▊   | 79/117 [00:03<00:01, 21.75it/s, loss=0.721, v_num=1, val_acc=0.752]
Epoch 70:  68%|██████▊   | 80/117 [00:03<00:01, 21.97it/s, loss=0.721, v_num=1, val_acc=0.752]
Epoch 70:  68%|██████▊   | 80/117 [00:03<00:01, 21.82it/s, loss=0.718, v_num=1, val_acc=0.752]
Epoch 70:  69%|██████▉   | 81/117 [00:03<00:01, 22.04it/s, loss=0.718, v_num=1, val_acc=0.752]
Epoch 70:  69%|██████▉   | 81/117 [00:03<00:01, 21.89it/s, loss=0.719, v_num=1, val_acc=0.752]
Epoch 70:  70%|███████   | 82/117 [00:03<00:01, 22.09it/s, loss=0.719, v_num=1, val_acc=0.752]
Epoch 70:  70%|███████   | 82/117 [00:03<00:01, 21.94it/s, loss=0.726, v_num=1, val_acc=0.752]
Epoch 70:  71%|███████   | 83/117 [00:03<00:01, 22.15it/s, loss=0.726, v_num=1, val_acc=0.752]
Epoch 70:  71%|███████   | 83/117 [00:03<00:01, 22.00it/s, loss=0.725, v_num=1, val_acc=0.752]
Epoch 70:  72%|███████▏  | 84/117 [00:03<00:01, 22.21it/s, loss=0.725, v_num=1, val_acc=0.752]
Epoch 70:  72%|███████▏  | 84/117 [00:03<00:01, 22.06it/s, loss=0.728, v_num=1, val_acc=0.752]
Epoch 70:  73%|███████▎  | 85/117 [00:03<00:01, 22.27it/s, loss=0.728, v_num=1, val_acc=0.752]
Epoch 70:  73%|███████▎  | 85/117 [00:03<00:01, 22.13it/s, loss=0.726, v_num=1, val_acc=0.752]
Epoch 70:  74%|███████▎  | 86/117 [00:03<00:01, 22.34it/s, loss=0.726, v_num=1, val_acc=0.752]
Epoch 70:  74%|███████▎  | 86/117 [00:03<00:01, 22.19it/s, loss=0.729, v_num=1, val_acc=0.752]
Epoch 70:  74%|███████▍  | 87/117 [00:03<00:01, 22.40it/s, loss=0.729, v_num=1, val_acc=0.752]
Epoch 70:  74%|███████▍  | 87/117 [00:03<00:01, 22.25it/s, loss=0.725, v_num=1, val_acc=0.752]
Epoch 70:  75%|███████▌  | 88/117 [00:03<00:01, 22.46it/s, loss=0.725, v_num=1, val_acc=0.752]
Epoch 70:  75%|███████▌  | 88/117 [00:03<00:01, 22.31it/s, loss=0.721, v_num=1, val_acc=0.752]
Epoch 70:  76%|███████▌  | 89/117 [00:03<00:01, 22.52it/s, loss=0.721, v_num=1, val_acc=0.752]
Epoch 70:  76%|███████▌  | 89/117 [00:03<00:01, 22.37it/s, loss=0.722, v_num=1, val_acc=0.752]
Epoch 70:  77%|███████▋  | 90/117 [00:03<00:01, 22.57it/s, loss=0.722, v_num=1, val_acc=0.752]
Epoch 70:  77%|███████▋  | 90/117 [00:04<00:01, 22.43it/s, loss=0.716, v_num=1, val_acc=0.752]
Epoch 70:  78%|███████▊  | 91/117 [00:04<00:01, 22.63it/s, loss=0.716, v_num=1, val_acc=0.752]
Epoch 70:  78%|███████▊  | 91/117 [00:04<00:01, 22.48it/s, loss=0.713, v_num=1, val_acc=0.752]
Epoch 70:  79%|███████▊  | 92/117 [00:04<00:01, 22.68it/s, loss=0.713, v_num=1, val_acc=0.752]
Epoch 70:  79%|███████▊  | 92/117 [00:04<00:01, 22.54it/s, loss=0.706, v_num=1, val_acc=0.752]
Epoch 70:  79%|███████▉  | 93/117 [00:04<00:01, 22.74it/s, loss=0.706, v_num=1, val_acc=0.752]
Epoch 70:  79%|███████▉  | 93/117 [00:04<00:01, 22.60it/s, loss=0.709, v_num=1, val_acc=0.752]
Epoch 70:  80%|████████  | 94/117 [00:04<00:01, 22.79it/s, loss=0.709, v_num=1, val_acc=0.752]
Epoch 70:  80%|████████  | 94/117 [00:04<00:01, 22.65it/s, loss=0.708, v_num=1, val_acc=0.752]
Epoch 70:  81%|████████  | 95/117 [00:04<00:00, 22.84it/s, loss=0.708, v_num=1, val_acc=0.752]
Epoch 70:  81%|████████  | 95/117 [00:04<00:00, 22.70it/s, loss=0.711, v_num=1, val_acc=0.752]
Epoch 70:  82%|████████▏ | 96/117 [00:04<00:00, 22.89it/s, loss=0.711, v_num=1, val_acc=0.752]
Epoch 70:  82%|████████▏ | 96/117 [00:04<00:00, 22.75it/s, loss=0.708, v_num=1, val_acc=0.752]
Epoch 70:  83%|████████▎ | 97/117 [00:04<00:00, 22.94it/s, loss=0.708, v_num=1, val_acc=0.752]
Epoch 70:  83%|████████▎ | 97/117 [00:04<00:00, 22.80it/s, loss=0.714, v_num=1, val_acc=0.752]

Validation: 0it [00:00, ?it/s]

Validation:   0%|          | 0/20 [00:00<?, ?it/s]

Validation DataLoader 0:   0%|          | 0/20 [00:00<?, ?it/s]

Validation DataLoader 0:   5%|▌         | 1/20 [00:00<00:00, 167.83it/s]
Epoch 70:  84%|████████▍ | 98/117 [00:05<00:00, 19.25it/s, loss=0.714, v_num=1, val_acc=0.752]

Validation DataLoader 0:  10%|█         | 2/20 [00:00<00:00, 54.76it/s]
Epoch 70:  85%|████████▍ | 99/117 [00:05<00:00, 19.33it/s, loss=0.714, v_num=1, val_acc=0.752]

Validation DataLoader 0:  15%|█▌        | 3/20 [00:00<00:00, 43.93it/s]
Epoch 70:  85%|████████▌ | 100/117 [00:05<00:00, 19.41it/s, loss=0.714, v_num=1, val_acc=0.752]

Validation DataLoader 0:  20%|██        | 4/20 [00:00<00:00, 39.84it/s]
Epoch 70:  86%|████████▋ | 101/117 [00:05<00:00, 19.48it/s, loss=0.714, v_num=1, val_acc=0.752]

Validation DataLoader 0:  25%|██▌       | 5/20 [00:00<00:00, 37.71it/s]
Epoch 70:  87%|████████▋ | 102/117 [00:05<00:00, 19.55it/s, loss=0.714, v_num=1, val_acc=0.752]

Validation DataLoader 0:  30%|███       | 6/20 [00:00<00:00, 36.61it/s]
Epoch 70:  88%|████████▊ | 103/117 [00:05<00:00, 19.62it/s, loss=0.714, v_num=1, val_acc=0.752]

Validation DataLoader 0:  35%|███▌      | 7/20 [00:00<00:00, 35.82it/s]
Epoch 70:  89%|████████▉ | 104/117 [00:05<00:00, 19.70it/s, loss=0.714, v_num=1, val_acc=0.752]

Validation DataLoader 0:  40%|████      | 8/20 [00:00<00:00, 35.24it/s]
Epoch 70:  90%|████████▉ | 105/117 [00:05<00:00, 19.77it/s, loss=0.714, v_num=1, val_acc=0.752]

Validation DataLoader 0:  45%|████▌     | 9/20 [00:00<00:00, 34.75it/s]
Epoch 70:  91%|█████████ | 106/117 [00:05<00:00, 19.84it/s, loss=0.714, v_num=1, val_acc=0.752]

Validation DataLoader 0:  50%|█████     | 10/20 [00:00<00:00, 34.45it/s]
Epoch 70:  91%|█████████▏| 107/117 [00:05<00:00, 19.91it/s, loss=0.714, v_num=1, val_acc=0.752]

Validation DataLoader 0:  55%|█████▌    | 11/20 [00:00<00:00, 34.17it/s]
Epoch 70:  92%|█████████▏| 108/117 [00:05<00:00, 19.98it/s, loss=0.714, v_num=1, val_acc=0.752]

Validation DataLoader 0:  60%|██████    | 12/20 [00:00<00:00, 33.93it/s]
Epoch 70:  93%|█████████▎| 109/117 [00:05<00:00, 20.04it/s, loss=0.714, v_num=1, val_acc=0.752]

Validation DataLoader 0:  65%|██████▌   | 13/20 [00:00<00:00, 33.74it/s]
Epoch 70:  94%|█████████▍| 110/117 [00:05<00:00, 20.11it/s, loss=0.714, v_num=1, val_acc=0.752]

Validation DataLoader 0:  70%|███████   | 14/20 [00:00<00:00, 33.59it/s]
Epoch 70:  95%|█████████▍| 111/117 [00:05<00:00, 20.18it/s, loss=0.714, v_num=1, val_acc=0.752]

Validation DataLoader 0:  75%|███████▌  | 15/20 [00:00<00:00, 33.44it/s]
Epoch 70:  96%|█████████▌| 112/117 [00:05<00:00, 20.24it/s, loss=0.714, v_num=1, val_acc=0.752]

Validation DataLoader 0:  80%|████████  | 16/20 [00:00<00:00, 33.33it/s]
Epoch 70:  97%|█████████▋| 113/117 [00:05<00:00, 20.31it/s, loss=0.714, v_num=1, val_acc=0.752]

Validation DataLoader 0:  85%|████████▌ | 17/20 [00:00<00:00, 33.20it/s]
Epoch 70:  97%|█████████▋| 114/117 [00:05<00:00, 20.37it/s, loss=0.714, v_num=1, val_acc=0.752]

Validation DataLoader 0:  90%|█████████ | 18/20 [00:00<00:00, 33.10it/s]
Epoch 70:  98%|█████████▊| 115/117 [00:05<00:00, 20.43it/s, loss=0.714, v_num=1, val_acc=0.752]

Validation DataLoader 0:  95%|█████████▌| 19/20 [00:00<00:00, 33.02it/s]
Epoch 70:  99%|█████████▉| 116/117 [00:05<00:00, 20.49it/s, loss=0.714, v_num=1, val_acc=0.752]

Validation DataLoader 0: 100%|██████████| 20/20 [00:00<00:00, 33.02it/s]
Epoch 70: 100%|██████████| 117/117 [00:05<00:00, 20.56it/s, loss=0.714, v_num=1, val_acc=0.752]
Epoch 70: 100%|██████████| 117/117 [00:05<00:00, 20.49it/s, loss=0.714, v_num=1, val_acc=0.750]


Epoch 70: 100%|██████████| 117/117 [00:05<00:00, 20.48it/s, loss=0.714, v_num=1, val_acc=0.750]
Epoch 70:   0%|          | 0/117 [00:00<?, ?it/s, loss=0.714, v_num=1, val_acc=0.750]
Epoch 71:   0%|          | 0/117 [00:00<?, ?it/s, loss=0.714, v_num=1, val_acc=0.750]
Epoch 71:   1%|          | 1/117 [00:00<01:43,  1.12it/s, loss=0.714, v_num=1, val_acc=0.750]
Epoch 71:   1%|          | 1/117 [00:00<01:46,  1.09it/s, loss=0.711, v_num=1, val_acc=0.750]
Epoch 71:   2%|▏         | 2/117 [00:00<00:53,  2.16it/s, loss=0.711, v_num=1, val_acc=0.750]
Epoch 71:   2%|▏         | 2/117 [00:00<00:54,  2.10it/s, loss=0.708, v_num=1, val_acc=0.750]
Epoch 71:   3%|▎         | 3/117 [00:00<00:36,  3.10it/s, loss=0.708, v_num=1, val_acc=0.750]
Epoch 71:   3%|▎         | 3/117 [00:00<00:37,  3.02it/s, loss=0.713, v_num=1, val_acc=0.750]
Epoch 71:   3%|▎         | 4/117 [00:01<00:28,  3.99it/s, loss=0.713, v_num=1, val_acc=0.750]
Epoch 71:   3%|▎         | 4/117 [00:01<00:29,  3.89it/s, loss=0.714, v_num=1, val_acc=0.750]
Epoch 71:   4%|▍         | 5/117 [00:01<00:23,  4.83it/s, loss=0.714, v_num=1, val_acc=0.750]
Epoch 71:   4%|▍         | 5/117 [00:01<00:23,  4.71it/s, loss=0.708, v_num=1, val_acc=0.750]
Epoch 71:   5%|▌         | 6/117 [00:01<00:19,  5.61it/s, loss=0.708, v_num=1, val_acc=0.750]
Epoch 71:   5%|▌         | 6/117 [00:01<00:20,  5.48it/s, loss=0.703, v_num=1, val_acc=0.750]
Epoch 71:   6%|▌         | 7/117 [00:01<00:17,  6.35it/s, loss=0.703, v_num=1, val_acc=0.750]
Epoch 71:   6%|▌         | 7/117 [00:01<00:17,  6.20it/s, loss=0.697, v_num=1, val_acc=0.750]
Epoch 71:   7%|▋         | 8/117 [00:01<00:15,  7.04it/s, loss=0.697, v_num=1, val_acc=0.750]
Epoch 71:   7%|▋         | 8/117 [00:01<00:15,  6.88it/s, loss=0.696, v_num=1, val_acc=0.750]
Epoch 71:   8%|▊         | 9/117 [00:01<00:14,  7.67it/s, loss=0.696, v_num=1, val_acc=0.750]
Epoch 71:   8%|▊         | 9/117 [00:01<00:14,  7.51it/s, loss=0.689, v_num=1, val_acc=0.750]
Epoch 71:   9%|▊         | 10/117 [00:01<00:12,  8.28it/s, loss=0.689, v_num=1, val_acc=0.750]
Epoch 71:   9%|▊         | 10/117 [00:01<00:13,  8.11it/s, loss=0.694, v_num=1, val_acc=0.750]
Epoch 71:   9%|▉         | 11/117 [00:01<00:12,  8.82it/s, loss=0.694, v_num=1, val_acc=0.750]
Epoch 71:   9%|▉         | 11/117 [00:01<00:12,  8.65it/s, loss=0.692, v_num=1, val_acc=0.750]
Epoch 71:  10%|█         | 12/117 [00:01<00:11,  9.37it/s, loss=0.692, v_num=1, val_acc=0.750]
Epoch 71:  10%|█         | 12/117 [00:01<00:11,  9.19it/s, loss=0.693, v_num=1, val_acc=0.750]
Epoch 71:  11%|█         | 13/117 [00:01<00:10,  9.89it/s, loss=0.693, v_num=1, val_acc=0.750]
Epoch 71:  11%|█         | 13/117 [00:01<00:10,  9.71it/s, loss=0.697, v_num=1, val_acc=0.750]
Epoch 71:  12%|█▏        | 14/117 [00:01<00:09, 10.37it/s, loss=0.697, v_num=1, val_acc=0.750]
Epoch 71:  12%|█▏        | 14/117 [00:01<00:10, 10.18it/s, loss=0.694, v_num=1, val_acc=0.750]
Epoch 71:  13%|█▎        | 15/117 [00:01<00:09, 10.84it/s, loss=0.694, v_num=1, val_acc=0.750]
Epoch 71:  13%|█▎        | 15/117 [00:01<00:09, 10.65it/s, loss=0.703, v_num=1, val_acc=0.750]
Epoch 71:  14%|█▎        | 16/117 [00:01<00:08, 11.28it/s, loss=0.703, v_num=1, val_acc=0.750]
Epoch 71:  14%|█▎        | 16/117 [00:01<00:09, 11.09it/s, loss=0.707, v_num=1, val_acc=0.750]
Epoch 71:  15%|█▍        | 17/117 [00:01<00:08, 11.69it/s, loss=0.707, v_num=1, val_acc=0.750]
Epoch 71:  15%|█▍        | 17/117 [00:01<00:08, 11.49it/s, loss=0.708, v_num=1, val_acc=0.750]
Epoch 71:  15%|█▌        | 18/117 [00:01<00:08, 12.10it/s, loss=0.708, v_num=1, val_acc=0.750]
Epoch 71:  15%|█▌        | 18/117 [00:01<00:08, 11.89it/s, loss=0.706, v_num=1, val_acc=0.750]
Epoch 71:  16%|█▌        | 19/117 [00:01<00:07, 12.46it/s, loss=0.706, v_num=1, val_acc=0.750]
Epoch 71:  16%|█▌        | 19/117 [00:01<00:07, 12.26it/s, loss=0.709, v_num=1, val_acc=0.750]
Epoch 71:  17%|█▋        | 20/117 [00:01<00:07, 12.83it/s, loss=0.709, v_num=1, val_acc=0.750]
Epoch 71:  17%|█▋        | 20/117 [00:01<00:07, 12.63it/s, loss=0.699, v_num=1, val_acc=0.750]
Epoch 71:  18%|█▊        | 21/117 [00:01<00:07, 13.18it/s, loss=0.699, v_num=1, val_acc=0.750]
Epoch 71:  18%|█▊        | 21/117 [00:01<00:07, 12.98it/s, loss=0.702, v_num=1, val_acc=0.750]
Epoch 71:  19%|█▉        | 22/117 [00:01<00:07, 13.52it/s, loss=0.702, v_num=1, val_acc=0.750]
Epoch 71:  19%|█▉        | 22/117 [00:01<00:07, 13.32it/s, loss=0.704, v_num=1, val_acc=0.750]
Epoch 71:  20%|█▉        | 23/117 [00:01<00:06, 13.84it/s, loss=0.704, v_num=1, val_acc=0.750]
Epoch 71:  20%|█▉        | 23/117 [00:01<00:06, 13.63it/s, loss=0.707, v_num=1, val_acc=0.750]
Epoch 71:  21%|██        | 24/117 [00:01<00:06, 14.14it/s, loss=0.707, v_num=1, val_acc=0.750]
Epoch 71:  21%|██        | 24/117 [00:01<00:06, 13.94it/s, loss=0.707, v_num=1, val_acc=0.750]
Epoch 71:  21%|██▏       | 25/117 [00:01<00:06, 14.44it/s, loss=0.707, v_num=1, val_acc=0.750]
Epoch 71:  21%|██▏       | 25/117 [00:01<00:06, 14.23it/s, loss=0.709, v_num=1, val_acc=0.750]
Epoch 71:  22%|██▏       | 26/117 [00:01<00:06, 14.72it/s, loss=0.709, v_num=1, val_acc=0.750]
Epoch 71:  22%|██▏       | 26/117 [00:01<00:06, 14.51it/s, loss=0.706, v_num=1, val_acc=0.750]
Epoch 71:  23%|██▎       | 27/117 [00:01<00:06, 14.99it/s, loss=0.706, v_num=1, val_acc=0.750]
Epoch 71:  23%|██▎       | 27/117 [00:01<00:06, 14.78it/s, loss=0.708, v_num=1, val_acc=0.750]
Epoch 71:  24%|██▍       | 28/117 [00:01<00:05, 15.25it/s, loss=0.708, v_num=1, val_acc=0.750]
Epoch 71:  24%|██▍       | 28/117 [00:01<00:05, 15.05it/s, loss=0.712, v_num=1, val_acc=0.750]
Epoch 71:  25%|██▍       | 29/117 [00:01<00:05, 15.51it/s, loss=0.712, v_num=1, val_acc=0.750]
Epoch 71:  25%|██▍       | 29/117 [00:01<00:05, 15.30it/s, loss=0.718, v_num=1, val_acc=0.750]
Epoch 71:  26%|██▌       | 30/117 [00:01<00:05, 15.75it/s, loss=0.718, v_num=1, val_acc=0.750]
Epoch 71:  26%|██▌       | 30/117 [00:01<00:05, 15.54it/s, loss=0.714, v_num=1, val_acc=0.750]
Epoch 71:  26%|██▋       | 31/117 [00:01<00:05, 15.95it/s, loss=0.714, v_num=1, val_acc=0.750]
Epoch 71:  26%|██▋       | 31/117 [00:01<00:05, 15.78it/s, loss=0.724, v_num=1, val_acc=0.750]
Epoch 71:  27%|██▋       | 32/117 [00:01<00:05, 16.21it/s, loss=0.724, v_num=1, val_acc=0.750]
Epoch 71:  27%|██▋       | 32/117 [00:01<00:05, 16.00it/s, loss=0.724, v_num=1, val_acc=0.750]
Epoch 71:  28%|██▊       | 33/117 [00:02<00:05, 16.43it/s, loss=0.724, v_num=1, val_acc=0.750]
Epoch 71:  28%|██▊       | 33/117 [00:02<00:05, 16.22it/s, loss=0.725, v_num=1, val_acc=0.750]
Epoch 71:  29%|██▉       | 34/117 [00:02<00:04, 16.64it/s, loss=0.725, v_num=1, val_acc=0.750]
Epoch 71:  29%|██▉       | 34/117 [00:02<00:05, 16.44it/s, loss=0.729, v_num=1, val_acc=0.750]
Epoch 71:  30%|██▉       | 35/117 [00:02<00:04, 16.85it/s, loss=0.729, v_num=1, val_acc=0.750]
Epoch 71:  30%|██▉       | 35/117 [00:02<00:04, 16.64it/s, loss=0.727, v_num=1, val_acc=0.750]
Epoch 71:  31%|███       | 36/117 [00:02<00:04, 17.04it/s, loss=0.727, v_num=1, val_acc=0.750]
Epoch 71:  31%|███       | 36/117 [00:02<00:04, 16.84it/s, loss=0.719, v_num=1, val_acc=0.750]
Epoch 71:  32%|███▏      | 37/117 [00:02<00:04, 17.24it/s, loss=0.719, v_num=1, val_acc=0.750]
Epoch 71:  32%|███▏      | 37/117 [00:02<00:04, 17.03it/s, loss=0.725, v_num=1, val_acc=0.750]
Epoch 71:  32%|███▏      | 38/117 [00:02<00:04, 17.42it/s, loss=0.725, v_num=1, val_acc=0.750]
Epoch 71:  32%|███▏      | 38/117 [00:02<00:04, 17.22it/s, loss=0.726, v_num=1, val_acc=0.750]
Epoch 71:  33%|███▎      | 39/117 [00:02<00:04, 17.60it/s, loss=0.726, v_num=1, val_acc=0.750]
Epoch 71:  33%|███▎      | 39/117 [00:02<00:04, 17.41it/s, loss=0.728, v_num=1, val_acc=0.750]
Epoch 71:  34%|███▍      | 40/117 [00:02<00:04, 17.78it/s, loss=0.728, v_num=1, val_acc=0.750]
Epoch 71:  34%|███▍      | 40/117 [00:02<00:04, 17.58it/s, loss=0.732, v_num=1, val_acc=0.750]
Epoch 71:  35%|███▌      | 41/117 [00:02<00:04, 17.95it/s, loss=0.732, v_num=1, val_acc=0.750]
Epoch 71:  35%|███▌      | 41/117 [00:02<00:04, 17.75it/s, loss=0.731, v_num=1, val_acc=0.750]
Epoch 71:  36%|███▌      | 42/117 [00:02<00:04, 18.11it/s, loss=0.731, v_num=1, val_acc=0.750]
Epoch 71:  36%|███▌      | 42/117 [00:02<00:04, 17.92it/s, loss=0.731, v_num=1, val_acc=0.750]
Epoch 71:  37%|███▋      | 43/117 [00:02<00:04, 18.27it/s, loss=0.731, v_num=1, val_acc=0.750]
Epoch 71:  37%|███▋      | 43/117 [00:02<00:04, 18.08it/s, loss=0.729, v_num=1, val_acc=0.750]
Epoch 71:  38%|███▊      | 44/117 [00:02<00:03, 18.43it/s, loss=0.729, v_num=1, val_acc=0.750]
Epoch 71:  38%|███▊      | 44/117 [00:02<00:04, 18.23it/s, loss=0.731, v_num=1, val_acc=0.750]
Epoch 71:  38%|███▊      | 45/117 [00:02<00:03, 18.58it/s, loss=0.731, v_num=1, val_acc=0.750]
Epoch 71:  38%|███▊      | 45/117 [00:02<00:03, 18.39it/s, loss=0.728, v_num=1, val_acc=0.750]
Epoch 71:  39%|███▉      | 46/117 [00:02<00:03, 18.72it/s, loss=0.728, v_num=1, val_acc=0.750]
Epoch 71:  39%|███▉      | 46/117 [00:02<00:03, 18.53it/s, loss=0.73, v_num=1, val_acc=0.750]
Epoch 71:  40%|████      | 47/117 [00:02<00:03, 18.87it/s, loss=0.73, v_num=1, val_acc=0.750]
Epoch 71:  40%|████      | 47/117 [00:02<00:03, 18.68it/s, loss=0.731, v_num=1, val_acc=0.750]
Epoch 71:  41%|████      | 48/117 [00:02<00:03, 19.00it/s, loss=0.731, v_num=1, val_acc=0.750]
Epoch 71:  41%|████      | 48/117 [00:02<00:03, 18.82it/s, loss=0.729, v_num=1, val_acc=0.750]
Epoch 71:  42%|████▏     | 49/117 [00:02<00:03, 19.14it/s, loss=0.729, v_num=1, val_acc=0.750]
Epoch 71:  42%|████▏     | 49/117 [00:02<00:03, 18.95it/s, loss=0.727, v_num=1, val_acc=0.750]
Epoch 71:  43%|████▎     | 50/117 [00:02<00:03, 19.27it/s, loss=0.727, v_num=1, val_acc=0.750]
Epoch 71:  43%|████▎     | 50/117 [00:02<00:03, 19.08it/s, loss=0.727, v_num=1, val_acc=0.750]
Epoch 71:  44%|████▎     | 51/117 [00:02<00:03, 19.40it/s, loss=0.727, v_num=1, val_acc=0.750]
Epoch 71:  44%|████▎     | 51/117 [00:02<00:03, 19.21it/s, loss=0.722, v_num=1, val_acc=0.750]
Epoch 71:  44%|████▍     | 52/117 [00:02<00:03, 19.52it/s, loss=0.722, v_num=1, val_acc=0.750]
Epoch 71:  44%|████▍     | 52/117 [00:02<00:03, 19.34it/s, loss=0.721, v_num=1, val_acc=0.750]
Epoch 71:  45%|████▌     | 53/117 [00:02<00:03, 19.63it/s, loss=0.721, v_num=1, val_acc=0.750]
Epoch 71:  45%|████▌     | 53/117 [00:02<00:03, 19.45it/s, loss=0.719, v_num=1, val_acc=0.750]
Epoch 71:  46%|████▌     | 54/117 [00:02<00:03, 19.75it/s, loss=0.719, v_num=1, val_acc=0.750]
Epoch 71:  46%|████▌     | 54/117 [00:02<00:03, 19.57it/s, loss=0.709, v_num=1, val_acc=0.750]
Epoch 71:  47%|████▋     | 55/117 [00:02<00:03, 19.87it/s, loss=0.709, v_num=1, val_acc=0.750]
Epoch 71:  47%|████▋     | 55/117 [00:02<00:03, 19.69it/s, loss=0.707, v_num=1, val_acc=0.750]
Epoch 71:  48%|████▊     | 56/117 [00:02<00:03, 19.98it/s, loss=0.707, v_num=1, val_acc=0.750]
Epoch 71:  48%|████▊     | 56/117 [00:02<00:03, 19.80it/s, loss=0.704, v_num=1, val_acc=0.750]
Epoch 71:  49%|████▊     | 57/117 [00:02<00:02, 20.09it/s, loss=0.704, v_num=1, val_acc=0.750]
Epoch 71:  49%|████▊     | 57/117 [00:02<00:03, 19.91it/s, loss=0.694, v_num=1, val_acc=0.750]
Epoch 71:  50%|████▉     | 58/117 [00:02<00:02, 20.20it/s, loss=0.694, v_num=1, val_acc=0.750]
Epoch 71:  50%|████▉     | 58/117 [00:02<00:02, 20.02it/s, loss=0.699, v_num=1, val_acc=0.750]
Epoch 71:  50%|█████     | 59/117 [00:02<00:02, 20.30it/s, loss=0.699, v_num=1, val_acc=0.750]
Epoch 71:  50%|█████     | 59/117 [00:02<00:02, 20.12it/s, loss=0.696, v_num=1, val_acc=0.750]
Epoch 71:  51%|█████▏    | 60/117 [00:02<00:02, 20.40it/s, loss=0.696, v_num=1, val_acc=0.750]
Epoch 71:  51%|█████▏    | 60/117 [00:02<00:02, 20.23it/s, loss=0.695, v_num=1, val_acc=0.750]
Epoch 71:  52%|█████▏    | 61/117 [00:02<00:02, 20.50it/s, loss=0.695, v_num=1, val_acc=0.750]
Epoch 71:  52%|█████▏    | 61/117 [00:03<00:02, 20.33it/s, loss=0.698, v_num=1, val_acc=0.750]
Epoch 71:  53%|█████▎    | 62/117 [00:03<00:02, 20.60it/s, loss=0.698, v_num=1, val_acc=0.750]
Epoch 71:  53%|█████▎    | 62/117 [00:03<00:02, 20.43it/s, loss=0.698, v_num=1, val_acc=0.750]
Epoch 71:  54%|█████▍    | 63/117 [00:03<00:02, 20.69it/s, loss=0.698, v_num=1, val_acc=0.750]
Epoch 71:  54%|█████▍    | 63/117 [00:03<00:02, 20.52it/s, loss=0.702, v_num=1, val_acc=0.750]
Epoch 71:  55%|█████▍    | 64/117 [00:03<00:02, 20.78it/s, loss=0.702, v_num=1, val_acc=0.750]
Epoch 71:  55%|█████▍    | 64/117 [00:03<00:02, 20.61it/s, loss=0.696, v_num=1, val_acc=0.750]
Epoch 71:  56%|█████▌    | 65/117 [00:03<00:02, 20.87it/s, loss=0.696, v_num=1, val_acc=0.750]
Epoch 71:  56%|█████▌    | 65/117 [00:03<00:02, 20.70it/s, loss=0.696, v_num=1, val_acc=0.750]
Epoch 71:  56%|█████▋    | 66/117 [00:03<00:02, 20.96it/s, loss=0.696, v_num=1, val_acc=0.750]
Epoch 71:  56%|█████▋    | 66/117 [00:03<00:02, 20.79it/s, loss=0.699, v_num=1, val_acc=0.750]
Epoch 71:  57%|█████▋    | 67/117 [00:03<00:02, 21.05it/s, loss=0.699, v_num=1, val_acc=0.750]
Epoch 71:  57%|█████▋    | 67/117 [00:03<00:02, 20.88it/s, loss=0.699, v_num=1, val_acc=0.750]
Epoch 71:  58%|█████▊    | 68/117 [00:03<00:02, 21.13it/s, loss=0.699, v_num=1, val_acc=0.750]
Epoch 71:  58%|█████▊    | 68/117 [00:03<00:02, 20.97it/s, loss=0.697, v_num=1, val_acc=0.750]
Epoch 71:  59%|█████▉    | 69/117 [00:03<00:02, 21.22it/s, loss=0.697, v_num=1, val_acc=0.750]
Epoch 71:  59%|█████▉    | 69/117 [00:03<00:02, 21.05it/s, loss=0.694, v_num=1, val_acc=0.750]
Epoch 71:  60%|█████▉    | 70/117 [00:03<00:02, 21.30it/s, loss=0.694, v_num=1, val_acc=0.750]
Epoch 71:  60%|█████▉    | 70/117 [00:03<00:02, 21.14it/s, loss=0.692, v_num=1, val_acc=0.750]
Epoch 71:  61%|██████    | 71/117 [00:03<00:02, 21.38it/s, loss=0.692, v_num=1, val_acc=0.750]
Epoch 71:  61%|██████    | 71/117 [00:03<00:02, 21.22it/s, loss=0.692, v_num=1, val_acc=0.750]
Epoch 71:  62%|██████▏   | 72/117 [00:03<00:02, 21.46it/s, loss=0.692, v_num=1, val_acc=0.750]
Epoch 71:  62%|██████▏   | 72/117 [00:03<00:02, 21.30it/s, loss=0.698, v_num=1, val_acc=0.750]
Epoch 71:  62%|██████▏   | 73/117 [00:03<00:02, 21.53it/s, loss=0.698, v_num=1, val_acc=0.750]
Epoch 71:  62%|██████▏   | 73/117 [00:03<00:02, 21.37it/s, loss=0.699, v_num=1, val_acc=0.750]
Epoch 71:  63%|██████▎   | 74/117 [00:03<00:01, 21.61it/s, loss=0.699, v_num=1, val_acc=0.750]
Epoch 71:  63%|██████▎   | 74/117 [00:03<00:02, 21.45it/s, loss=0.709, v_num=1, val_acc=0.750]
Epoch 71:  64%|██████▍   | 75/117 [00:03<00:01, 21.68it/s, loss=0.709, v_num=1, val_acc=0.750]
Epoch 71:  64%|██████▍   | 75/117 [00:03<00:01, 21.52it/s, loss=0.713, v_num=1, val_acc=0.750]
Epoch 71:  65%|██████▍   | 76/117 [00:03<00:01, 21.75it/s, loss=0.713, v_num=1, val_acc=0.750]
Epoch 71:  65%|██████▍   | 76/117 [00:03<00:01, 21.60it/s, loss=0.714, v_num=1, val_acc=0.750]
Epoch 71:  66%|██████▌   | 77/117 [00:03<00:01, 21.82it/s, loss=0.714, v_num=1, val_acc=0.750]
Epoch 71:  66%|██████▌   | 77/117 [00:03<00:01, 21.67it/s, loss=0.716, v_num=1, val_acc=0.750]
Epoch 71:  67%|██████▋   | 78/117 [00:03<00:01, 21.89it/s, loss=0.716, v_num=1, val_acc=0.750]
Epoch 71:  67%|██████▋   | 78/117 [00:03<00:01, 21.74it/s, loss=0.708, v_num=1, val_acc=0.750]
Epoch 71:  68%|██████▊   | 79/117 [00:03<00:01, 21.96it/s, loss=0.708, v_num=1, val_acc=0.750]
Epoch 71:  68%|██████▊   | 79/117 [00:03<00:01, 21.81it/s, loss=0.711, v_num=1, val_acc=0.750]
Epoch 71:  68%|██████▊   | 80/117 [00:03<00:01, 22.03it/s, loss=0.711, v_num=1, val_acc=0.750]
Epoch 71:  68%|██████▊   | 80/117 [00:03<00:01, 21.87it/s, loss=0.713, v_num=1, val_acc=0.750]
Epoch 71:  69%|██████▉   | 81/117 [00:03<00:01, 22.09it/s, loss=0.713, v_num=1, val_acc=0.750]
Epoch 71:  69%|██████▉   | 81/117 [00:03<00:01, 21.94it/s, loss=0.713, v_num=1, val_acc=0.750]
Epoch 71:  70%|███████   | 82/117 [00:03<00:01, 22.14it/s, loss=0.713, v_num=1, val_acc=0.750]
Epoch 71:  70%|███████   | 82/117 [00:03<00:01, 21.99it/s, loss=0.709, v_num=1, val_acc=0.750]
Epoch 71:  71%|███████   | 83/117 [00:03<00:01, 22.21it/s, loss=0.709, v_num=1, val_acc=0.750]
Epoch 71:  71%|███████   | 83/117 [00:03<00:01, 22.06it/s, loss=0.702, v_num=1, val_acc=0.750]
Epoch 71:  72%|███████▏  | 84/117 [00:03<00:01, 22.27it/s, loss=0.702, v_num=1, val_acc=0.750]
Epoch 71:  72%|███████▏  | 84/117 [00:03<00:01, 22.12it/s, loss=0.704, v_num=1, val_acc=0.750]
Epoch 71:  73%|███████▎  | 85/117 [00:03<00:01, 22.34it/s, loss=0.704, v_num=1, val_acc=0.750]
Epoch 71:  73%|███████▎  | 85/117 [00:03<00:01, 22.19it/s, loss=0.706, v_num=1, val_acc=0.750]
Epoch 71:  74%|███████▎  | 86/117 [00:03<00:01, 22.40it/s, loss=0.706, v_num=1, val_acc=0.750]
Epoch 71:  74%|███████▎  | 86/117 [00:03<00:01, 22.25it/s, loss=0.702, v_num=1, val_acc=0.750]
Epoch 71:  74%|███████▍  | 87/117 [00:03<00:01, 22.46it/s, loss=0.702, v_num=1, val_acc=0.750]
Epoch 71:  74%|███████▍  | 87/117 [00:03<00:01, 22.31it/s, loss=0.705, v_num=1, val_acc=0.750]
Epoch 71:  75%|███████▌  | 88/117 [00:03<00:01, 22.52it/s, loss=0.705, v_num=1, val_acc=0.750]
Epoch 71:  75%|███████▌  | 88/117 [00:03<00:01, 22.37it/s, loss=0.708, v_num=1, val_acc=0.750]
Epoch 71:  76%|███████▌  | 89/117 [00:03<00:01, 22.57it/s, loss=0.708, v_num=1, val_acc=0.750]
Epoch 71:  76%|███████▌  | 89/117 [00:03<00:01, 22.43it/s, loss=0.706, v_num=1, val_acc=0.750]
Epoch 71:  77%|███████▋  | 90/117 [00:03<00:01, 22.63it/s, loss=0.706, v_num=1, val_acc=0.750]
Epoch 71:  77%|███████▋  | 90/117 [00:04<00:01, 22.49it/s, loss=0.709, v_num=1, val_acc=0.750]
Epoch 71:  78%|███████▊  | 91/117 [00:04<00:01, 22.69it/s, loss=0.709, v_num=1, val_acc=0.750]
Epoch 71:  78%|███████▊  | 91/117 [00:04<00:01, 22.54it/s, loss=0.711, v_num=1, val_acc=0.750]
Epoch 71:  79%|███████▊  | 92/117 [00:04<00:01, 22.74it/s, loss=0.711, v_num=1, val_acc=0.750]
Epoch 71:  79%|███████▊  | 92/117 [00:04<00:01, 22.60it/s, loss=0.706, v_num=1, val_acc=0.750]
Epoch 71:  79%|███████▉  | 93/117 [00:04<00:01, 22.80it/s, loss=0.706, v_num=1, val_acc=0.750]
Epoch 71:  79%|███████▉  | 93/117 [00:04<00:01, 22.66it/s, loss=0.708, v_num=1, val_acc=0.750]
Epoch 71:  80%|████████  | 94/117 [00:04<00:01, 22.85it/s, loss=0.708, v_num=1, val_acc=0.750]
Epoch 71:  80%|████████  | 94/117 [00:04<00:01, 22.71it/s, loss=0.702, v_num=1, val_acc=0.750]
Epoch 71:  81%|████████  | 95/117 [00:04<00:00, 22.90it/s, loss=0.702, v_num=1, val_acc=0.750]
Epoch 71:  81%|████████  | 95/117 [00:04<00:00, 22.76it/s, loss=0.701, v_num=1, val_acc=0.750]
Epoch 71:  82%|████████▏ | 96/117 [00:04<00:00, 22.95it/s, loss=0.701, v_num=1, val_acc=0.750]
Epoch 71:  82%|████████▏ | 96/117 [00:04<00:00, 22.81it/s, loss=0.699, v_num=1, val_acc=0.750]
Epoch 71:  83%|████████▎ | 97/117 [00:04<00:00, 23.00it/s, loss=0.699, v_num=1, val_acc=0.750]
Epoch 71:  83%|████████▎ | 97/117 [00:04<00:00, 22.87it/s, loss=0.694, v_num=1, val_acc=0.750]

Validation: 0it [00:00, ?it/s]

Validation:   0%|          | 0/20 [00:00<?, ?it/s]

Validation DataLoader 0:   0%|          | 0/20 [00:00<?, ?it/s]

Validation DataLoader 0:   5%|▌         | 1/20 [00:00<00:00, 187.84it/s]
Epoch 71:  84%|████████▍ | 98/117 [00:05<00:00, 19.24it/s, loss=0.694, v_num=1, val_acc=0.750]

Validation DataLoader 0:  10%|█         | 2/20 [00:00<00:00, 55.84it/s]
Epoch 71:  85%|████████▍ | 99/117 [00:05<00:00, 19.32it/s, loss=0.694, v_num=1, val_acc=0.750]

Validation DataLoader 0:  15%|█▌        | 3/20 [00:00<00:00, 44.23it/s]
Epoch 71:  85%|████████▌ | 100/117 [00:05<00:00, 19.39it/s, loss=0.694, v_num=1, val_acc=0.750]

Validation DataLoader 0:  20%|██        | 4/20 [00:00<00:00, 40.18it/s]
Epoch 71:  86%|████████▋ | 101/117 [00:05<00:00, 19.47it/s, loss=0.694, v_num=1, val_acc=0.750]

Validation DataLoader 0:  25%|██▌       | 5/20 [00:00<00:00, 37.69it/s]
Epoch 71:  87%|████████▋ | 102/117 [00:05<00:00, 19.53it/s, loss=0.694, v_num=1, val_acc=0.750]

Validation DataLoader 0:  30%|███       | 6/20 [00:00<00:00, 36.49it/s]
Epoch 71:  88%|████████▊ | 103/117 [00:05<00:00, 19.61it/s, loss=0.694, v_num=1, val_acc=0.750]

Validation DataLoader 0:  35%|███▌      | 7/20 [00:00<00:00, 35.69it/s]
Epoch 71:  89%|████████▉ | 104/117 [00:05<00:00, 19.68it/s, loss=0.694, v_num=1, val_acc=0.750]

Validation DataLoader 0:  40%|████      | 8/20 [00:00<00:00, 35.08it/s]
Epoch 71:  90%|████████▉ | 105/117 [00:05<00:00, 19.75it/s, loss=0.694, v_num=1, val_acc=0.750]

Validation DataLoader 0:  45%|████▌     | 9/20 [00:00<00:00, 34.55it/s]
Epoch 71:  91%|█████████ | 106/117 [00:05<00:00, 19.82it/s, loss=0.694, v_num=1, val_acc=0.750]

Validation DataLoader 0:  50%|█████     | 10/20 [00:00<00:00, 34.29it/s]
Epoch 71:  91%|█████████▏| 107/117 [00:05<00:00, 19.89it/s, loss=0.694, v_num=1, val_acc=0.750]

Validation DataLoader 0:  55%|█████▌    | 11/20 [00:00<00:00, 34.04it/s]
Epoch 71:  92%|█████████▏| 108/117 [00:05<00:00, 19.96it/s, loss=0.694, v_num=1, val_acc=0.750]

Validation DataLoader 0:  60%|██████    | 12/20 [00:00<00:00, 33.82it/s]
Epoch 71:  93%|█████████▎| 109/117 [00:05<00:00, 20.02it/s, loss=0.694, v_num=1, val_acc=0.750]

Validation DataLoader 0:  65%|██████▌   | 13/20 [00:00<00:00, 33.63it/s]
Epoch 71:  94%|█████████▍| 110/117 [00:05<00:00, 20.09it/s, loss=0.694, v_num=1, val_acc=0.750]

Validation DataLoader 0:  70%|███████   | 14/20 [00:00<00:00, 33.48it/s]
Epoch 71:  95%|█████████▍| 111/117 [00:05<00:00, 20.16it/s, loss=0.694, v_num=1, val_acc=0.750]

Validation DataLoader 0:  75%|███████▌  | 15/20 [00:00<00:00, 33.35it/s]
Epoch 71:  96%|█████████▌| 112/117 [00:05<00:00, 20.22it/s, loss=0.694, v_num=1, val_acc=0.750]

Validation DataLoader 0:  80%|████████  | 16/20 [00:00<00:00, 33.23it/s]
Epoch 71:  97%|█████████▋| 113/117 [00:05<00:00, 20.29it/s, loss=0.694, v_num=1, val_acc=0.750]

Validation DataLoader 0:  85%|████████▌ | 17/20 [00:00<00:00, 33.12it/s]
Epoch 71:  97%|█████████▋| 114/117 [00:05<00:00, 20.35it/s, loss=0.694, v_num=1, val_acc=0.750]

Validation DataLoader 0:  90%|█████████ | 18/20 [00:00<00:00, 33.03it/s]
Epoch 71:  98%|█████████▊| 115/117 [00:05<00:00, 20.41it/s, loss=0.694, v_num=1, val_acc=0.750]

Validation DataLoader 0:  95%|█████████▌| 19/20 [00:00<00:00, 32.95it/s]
Epoch 71:  99%|█████████▉| 116/117 [00:05<00:00, 20.47it/s, loss=0.694, v_num=1, val_acc=0.750]

Validation DataLoader 0: 100%|██████████| 20/20 [00:00<00:00, 32.95it/s]
Epoch 71: 100%|██████████| 117/117 [00:05<00:00, 20.54it/s, loss=0.694, v_num=1, val_acc=0.750]
Epoch 71: 100%|██████████| 117/117 [00:05<00:00, 20.47it/s, loss=0.694, v_num=1, val_acc=0.751]


Epoch 71: 100%|██████████| 117/117 [00:05<00:00, 20.46it/s, loss=0.694, v_num=1, val_acc=0.751]
Epoch 71:   0%|          | 0/117 [00:00<?, ?it/s, loss=0.694, v_num=1, val_acc=0.751]
Epoch 72:   0%|          | 0/117 [00:00<?, ?it/s, loss=0.694, v_num=1, val_acc=0.751]
Epoch 72:   1%|          | 1/117 [00:00<01:46,  1.09it/s, loss=0.694, v_num=1, val_acc=0.751]
Epoch 72:   1%|          | 1/117 [00:00<01:48,  1.07it/s, loss=0.699, v_num=1, val_acc=0.751]
Epoch 72:   2%|▏         | 2/117 [00:00<00:55,  2.09it/s, loss=0.699, v_num=1, val_acc=0.751]
Epoch 72:   2%|▏         | 2/117 [00:00<00:56,  2.04it/s, loss=0.697, v_num=1, val_acc=0.751]
Epoch 72:   3%|▎         | 3/117 [00:00<00:37,  3.03it/s, loss=0.697, v_num=1, val_acc=0.751]
Epoch 72:   3%|▎         | 3/117 [00:01<00:38,  2.95it/s, loss=0.697, v_num=1, val_acc=0.751]
Epoch 72:   3%|▎         | 4/117 [00:01<00:28,  3.91it/s, loss=0.697, v_num=1, val_acc=0.751]
Epoch 72:   3%|▎         | 4/117 [00:01<00:29,  3.81it/s, loss=0.695, v_num=1, val_acc=0.751]
Epoch 72:   4%|▍         | 5/117 [00:01<00:23,  4.72it/s, loss=0.695, v_num=1, val_acc=0.751]
Epoch 72:   4%|▍         | 5/117 [00:01<00:24,  4.61it/s, loss=0.699, v_num=1, val_acc=0.751]
Epoch 72:   5%|▌         | 6/117 [00:01<00:20,  5.49it/s, loss=0.699, v_num=1, val_acc=0.751]
Epoch 72:   5%|▌         | 6/117 [00:01<00:20,  5.36it/s, loss=0.699, v_num=1, val_acc=0.751]
Epoch 72:   6%|▌         | 7/117 [00:01<00:17,  6.21it/s, loss=0.699, v_num=1, val_acc=0.751]
Epoch 72:   6%|▌         | 7/117 [00:01<00:18,  6.08it/s, loss=0.701, v_num=1, val_acc=0.751]
Epoch 72:   7%|▋         | 8/117 [00:01<00:15,  6.89it/s, loss=0.701, v_num=1, val_acc=0.751]
Epoch 72:   7%|▋         | 8/117 [00:01<00:16,  6.74it/s, loss=0.701, v_num=1, val_acc=0.751]
Epoch 72:   8%|▊         | 9/117 [00:01<00:14,  7.53it/s, loss=0.701, v_num=1, val_acc=0.751]
Epoch 72:   8%|▊         | 9/117 [00:01<00:14,  7.37it/s, loss=0.706, v_num=1, val_acc=0.751]
Epoch 72:   9%|▊         | 10/117 [00:01<00:13,  8.10it/s, loss=0.706, v_num=1, val_acc=0.751]
Epoch 72:   9%|▊         | 10/117 [00:01<00:13,  7.94it/s, loss=0.705, v_num=1, val_acc=0.751]
Epoch 72:   9%|▉         | 11/117 [00:01<00:12,  8.67it/s, loss=0.705, v_num=1, val_acc=0.751]
Epoch 72:   9%|▉         | 11/117 [00:01<00:12,  8.50it/s, loss=0.699, v_num=1, val_acc=0.751]
Epoch 72:  10%|█         | 12/117 [00:01<00:11,  9.22it/s, loss=0.699, v_num=1, val_acc=0.751]
Epoch 72:  10%|█         | 12/117 [00:01<00:11,  9.04it/s, loss=0.702, v_num=1, val_acc=0.751]
Epoch 72:  11%|█         | 13/117 [00:01<00:10,  9.73it/s, loss=0.702, v_num=1, val_acc=0.751]
Epoch 72:  11%|█         | 13/117 [00:01<00:10,  9.55it/s, loss=0.698, v_num=1, val_acc=0.751]
Epoch 72:  12%|█▏        | 14/117 [00:01<00:10, 10.22it/s, loss=0.698, v_num=1, val_acc=0.751]
Epoch 72:  12%|█▏        | 14/117 [00:01<00:10, 10.04it/s, loss=0.695, v_num=1, val_acc=0.751]
Epoch 72:  13%|█▎        | 15/117 [00:01<00:09, 10.69it/s, loss=0.695, v_num=1, val_acc=0.751]
Epoch 72:  13%|█▎        | 15/117 [00:01<00:09, 10.50it/s, loss=0.697, v_num=1, val_acc=0.751]
Epoch 72:  14%|█▎        | 16/117 [00:01<00:09, 11.13it/s, loss=0.697, v_num=1, val_acc=0.751]
Epoch 72:  14%|█▎        | 16/117 [00:01<00:09, 10.94it/s, loss=0.7, v_num=1, val_acc=0.751]
Epoch 72:  15%|█▍        | 17/117 [00:01<00:08, 11.52it/s, loss=0.7, v_num=1, val_acc=0.751]
Epoch 72:  15%|█▍        | 17/117 [00:01<00:08, 11.33it/s, loss=0.705, v_num=1, val_acc=0.751]
Epoch 72:  15%|█▌        | 18/117 [00:01<00:08, 11.93it/s, loss=0.705, v_num=1, val_acc=0.751]
Epoch 72:  15%|█▌        | 18/117 [00:01<00:08, 11.73it/s, loss=0.703, v_num=1, val_acc=0.751]
Epoch 72:  16%|█▌        | 19/117 [00:01<00:07, 12.32it/s, loss=0.703, v_num=1, val_acc=0.751]
Epoch 72:  16%|█▌        | 19/117 [00:01<00:08, 12.12it/s, loss=0.709, v_num=1, val_acc=0.751]
Epoch 72:  17%|█▋        | 20/117 [00:01<00:07, 12.68it/s, loss=0.709, v_num=1, val_acc=0.751]
Epoch 72:  17%|█▋        | 20/117 [00:01<00:07, 12.48it/s, loss=0.716, v_num=1, val_acc=0.751]
Epoch 72:  18%|█▊        | 21/117 [00:01<00:07, 13.03it/s, loss=0.716, v_num=1, val_acc=0.751]
Epoch 72:  18%|█▊        | 21/117 [00:01<00:07, 12.83it/s, loss=0.717, v_num=1, val_acc=0.751]
Epoch 72:  19%|█▉        | 22/117 [00:01<00:07, 13.37it/s, loss=0.717, v_num=1, val_acc=0.751]
Epoch 72:  19%|█▉        | 22/117 [00:01<00:07, 13.16it/s, loss=0.716, v_num=1, val_acc=0.751]
Epoch 72:  20%|█▉        | 23/117 [00:01<00:06, 13.69it/s, loss=0.716, v_num=1, val_acc=0.751]
Epoch 72:  20%|█▉        | 23/117 [00:01<00:06, 13.49it/s, loss=0.718, v_num=1, val_acc=0.751]
Epoch 72:  21%|██        | 24/117 [00:01<00:06, 14.00it/s, loss=0.718, v_num=1, val_acc=0.751]
Epoch 72:  21%|██        | 24/117 [00:01<00:06, 13.79it/s, loss=0.719, v_num=1, val_acc=0.751]
Epoch 72:  21%|██▏       | 25/117 [00:01<00:06, 14.29it/s, loss=0.719, v_num=1, val_acc=0.751]
Epoch 72:  21%|██▏       | 25/117 [00:01<00:06, 14.09it/s, loss=0.723, v_num=1, val_acc=0.751]
Epoch 72:  22%|██▏       | 26/117 [00:01<00:06, 14.58it/s, loss=0.723, v_num=1, val_acc=0.751]
Epoch 72:  22%|██▏       | 26/117 [00:01<00:06, 14.37it/s, loss=0.724, v_num=1, val_acc=0.751]
Epoch 72:  23%|██▎       | 27/117 [00:01<00:06, 14.85it/s, loss=0.724, v_num=1, val_acc=0.751]
Epoch 72:  23%|██▎       | 27/117 [00:01<00:06, 14.65it/s, loss=0.723, v_num=1, val_acc=0.751]
Epoch 72:  24%|██▍       | 28/117 [00:01<00:05, 15.11it/s, loss=0.723, v_num=1, val_acc=0.751]
Epoch 72:  24%|██▍       | 28/117 [00:01<00:05, 14.91it/s, loss=0.723, v_num=1, val_acc=0.751]
Epoch 72:  25%|██▍       | 29/117 [00:01<00:05, 15.37it/s, loss=0.723, v_num=1, val_acc=0.751]
Epoch 72:  25%|██▍       | 29/117 [00:01<00:05, 15.17it/s, loss=0.717, v_num=1, val_acc=0.751]
Epoch 72:  26%|██▌       | 30/117 [00:01<00:05, 15.62it/s, loss=0.717, v_num=1, val_acc=0.751]
Epoch 72:  26%|██▌       | 30/117 [00:01<00:05, 15.41it/s, loss=0.71, v_num=1, val_acc=0.751]
Epoch 72:  26%|██▋       | 31/117 [00:01<00:05, 15.85it/s, loss=0.71, v_num=1, val_acc=0.751]
Epoch 72:  26%|██▋       | 31/117 [00:01<00:05, 15.65it/s, loss=0.714, v_num=1, val_acc=0.751]
Epoch 72:  27%|██▋       | 32/117 [00:01<00:05, 16.08it/s, loss=0.714, v_num=1, val_acc=0.751]
Epoch 72:  27%|██▋       | 32/117 [00:02<00:05, 15.88it/s, loss=0.719, v_num=1, val_acc=0.751]
Epoch 72:  28%|██▊       | 33/117 [00:02<00:05, 16.30it/s, loss=0.719, v_num=1, val_acc=0.751]
Epoch 72:  28%|██▊       | 33/117 [00:02<00:05, 16.10it/s, loss=0.721, v_num=1, val_acc=0.751]
Epoch 72:  29%|██▉       | 34/117 [00:02<00:05, 16.51it/s, loss=0.721, v_num=1, val_acc=0.751]
Epoch 72:  29%|██▉       | 34/117 [00:02<00:05, 16.31it/s, loss=0.723, v_num=1, val_acc=0.751]
Epoch 72:  30%|██▉       | 35/117 [00:02<00:04, 16.72it/s, loss=0.723, v_num=1, val_acc=0.751]
Epoch 72:  30%|██▉       | 35/117 [00:02<00:04, 16.52it/s, loss=0.717, v_num=1, val_acc=0.751]
Epoch 72:  31%|███       | 36/117 [00:02<00:04, 16.92it/s, loss=0.717, v_num=1, val_acc=0.751]
Epoch 72:  31%|███       | 36/117 [00:02<00:04, 16.72it/s, loss=0.715, v_num=1, val_acc=0.751]
Epoch 72:  32%|███▏      | 37/117 [00:02<00:04, 17.11it/s, loss=0.715, v_num=1, val_acc=0.751]
Epoch 72:  32%|███▏      | 37/117 [00:02<00:04, 16.91it/s, loss=0.716, v_num=1, val_acc=0.751]
Epoch 72:  32%|███▏      | 38/117 [00:02<00:04, 17.30it/s, loss=0.716, v_num=1, val_acc=0.751]
Epoch 72:  32%|███▏      | 38/117 [00:02<00:04, 17.10it/s, loss=0.712, v_num=1, val_acc=0.751]
Epoch 72:  33%|███▎      | 39/117 [00:02<00:04, 17.48it/s, loss=0.712, v_num=1, val_acc=0.751]
Epoch 72:  33%|███▎      | 39/117 [00:02<00:04, 17.28it/s, loss=0.713, v_num=1, val_acc=0.751]
Epoch 72:  34%|███▍      | 40/117 [00:02<00:04, 17.65it/s, loss=0.713, v_num=1, val_acc=0.751]
Epoch 72:  34%|███▍      | 40/117 [00:02<00:04, 17.46it/s, loss=0.711, v_num=1, val_acc=0.751]
Epoch 72:  35%|███▌      | 41/117 [00:02<00:04, 17.82it/s, loss=0.711, v_num=1, val_acc=0.751]
Epoch 72:  35%|███▌      | 41/117 [00:02<00:04, 17.63it/s, loss=0.707, v_num=1, val_acc=0.751]
Epoch 72:  36%|███▌      | 42/117 [00:02<00:04, 17.99it/s, loss=0.707, v_num=1, val_acc=0.751]
Epoch 72:  36%|███▌      | 42/117 [00:02<00:04, 17.80it/s, loss=0.707, v_num=1, val_acc=0.751]
Epoch 72:  37%|███▋      | 43/117 [00:02<00:04, 18.15it/s, loss=0.707, v_num=1, val_acc=0.751]
Epoch 72:  37%|███▋      | 43/117 [00:02<00:04, 17.96it/s, loss=0.702, v_num=1, val_acc=0.751]
Epoch 72:  38%|███▊      | 44/117 [00:02<00:03, 18.31it/s, loss=0.702, v_num=1, val_acc=0.751]
Epoch 72:  38%|███▊      | 44/117 [00:02<00:04, 18.11it/s, loss=0.707, v_num=1, val_acc=0.751]
Epoch 72:  38%|███▊      | 45/117 [00:02<00:03, 18.46it/s, loss=0.707, v_num=1, val_acc=0.751]
Epoch 72:  38%|███▊      | 45/117 [00:02<00:03, 18.27it/s, loss=0.702, v_num=1, val_acc=0.751]
Epoch 72:  39%|███▉      | 46/117 [00:02<00:03, 18.60it/s, loss=0.702, v_num=1, val_acc=0.751]
Epoch 72:  39%|███▉      | 46/117 [00:02<00:03, 18.42it/s, loss=0.701, v_num=1, val_acc=0.751]
Epoch 72:  40%|████      | 47/117 [00:02<00:03, 18.75it/s, loss=0.701, v_num=1, val_acc=0.751]
Epoch 72:  40%|████      | 47/117 [00:02<00:03, 18.56it/s, loss=0.698, v_num=1, val_acc=0.751]
Epoch 72:  41%|████      | 48/117 [00:02<00:03, 18.89it/s, loss=0.698, v_num=1, val_acc=0.751]
Epoch 72:  41%|████      | 48/117 [00:02<00:03, 18.70it/s, loss=0.696, v_num=1, val_acc=0.751]
Epoch 72:  42%|████▏     | 49/117 [00:02<00:03, 19.02it/s, loss=0.696, v_num=1, val_acc=0.751]
Epoch 72:  42%|████▏     | 49/117 [00:02<00:03, 18.84it/s, loss=0.696, v_num=1, val_acc=0.751]
Epoch 72:  43%|████▎     | 50/117 [00:02<00:03, 19.15it/s, loss=0.696, v_num=1, val_acc=0.751]
Epoch 72:  43%|████▎     | 50/117 [00:02<00:03, 18.97it/s, loss=0.704, v_num=1, val_acc=0.751]
Epoch 72:  44%|████▎     | 51/117 [00:02<00:03, 19.28it/s, loss=0.704, v_num=1, val_acc=0.751]
Epoch 72:  44%|████▎     | 51/117 [00:02<00:03, 19.10it/s, loss=0.705, v_num=1, val_acc=0.751]
Epoch 72:  44%|████▍     | 52/117 [00:02<00:03, 19.41it/s, loss=0.705, v_num=1, val_acc=0.751]
Epoch 72:  44%|████▍     | 52/117 [00:02<00:03, 19.22it/s, loss=0.698, v_num=1, val_acc=0.751]
Epoch 72:  45%|████▌     | 53/117 [00:02<00:03, 19.53it/s, loss=0.698, v_num=1, val_acc=0.751]
Epoch 72:  45%|████▌     | 53/117 [00:02<00:03, 19.35it/s, loss=0.695, v_num=1, val_acc=0.751]
Epoch 72:  46%|████▌     | 54/117 [00:02<00:03, 19.65it/s, loss=0.695, v_num=1, val_acc=0.751]
Epoch 72:  46%|████▌     | 54/117 [00:02<00:03, 19.47it/s, loss=0.694, v_num=1, val_acc=0.751]
Epoch 72:  47%|████▋     | 55/117 [00:02<00:03, 19.76it/s, loss=0.694, v_num=1, val_acc=0.751]
Epoch 72:  47%|████▋     | 55/117 [00:02<00:03, 19.59it/s, loss=0.698, v_num=1, val_acc=0.751]
Epoch 72:  48%|████▊     | 56/117 [00:02<00:03, 19.88it/s, loss=0.698, v_num=1, val_acc=0.751]
Epoch 72:  48%|████▊     | 56/117 [00:02<00:03, 19.70it/s, loss=0.701, v_num=1, val_acc=0.751]
Epoch 72:  49%|████▊     | 57/117 [00:02<00:03, 19.99it/s, loss=0.701, v_num=1, val_acc=0.751]
Epoch 72:  49%|████▊     | 57/117 [00:02<00:03, 19.81it/s, loss=0.699, v_num=1, val_acc=0.751]
Epoch 72:  50%|████▉     | 58/117 [00:02<00:02, 20.10it/s, loss=0.699, v_num=1, val_acc=0.751]
Epoch 72:  50%|████▉     | 58/117 [00:02<00:02, 19.92it/s, loss=0.705, v_num=1, val_acc=0.751]
Epoch 72:  50%|█████     | 59/117 [00:02<00:02, 20.20it/s, loss=0.705, v_num=1, val_acc=0.751]
Epoch 72:  50%|█████     | 59/117 [00:02<00:02, 20.03it/s, loss=0.701, v_num=1, val_acc=0.751]
Epoch 72:  51%|█████▏    | 60/117 [00:02<00:02, 20.31it/s, loss=0.701, v_num=1, val_acc=0.751]
Epoch 72:  51%|█████▏    | 60/117 [00:02<00:02, 20.13it/s, loss=0.709, v_num=1, val_acc=0.751]
Epoch 72:  52%|█████▏    | 61/117 [00:02<00:02, 20.40it/s, loss=0.709, v_num=1, val_acc=0.751]
Epoch 72:  52%|█████▏    | 61/117 [00:03<00:02, 20.23it/s, loss=0.705, v_num=1, val_acc=0.751]
Epoch 72:  53%|█████▎    | 62/117 [00:03<00:02, 20.50it/s, loss=0.705, v_num=1, val_acc=0.751]
Epoch 72:  53%|█████▎    | 62/117 [00:03<00:02, 20.33it/s, loss=0.706, v_num=1, val_acc=0.751]
Epoch 72:  54%|█████▍    | 63/117 [00:03<00:02, 20.59it/s, loss=0.706, v_num=1, val_acc=0.751]
Epoch 72:  54%|█████▍    | 63/117 [00:03<00:02, 20.42it/s, loss=0.706, v_num=1, val_acc=0.751]
Epoch 72:  55%|█████▍    | 64/117 [00:03<00:02, 20.69it/s, loss=0.706, v_num=1, val_acc=0.751]
Epoch 72:  55%|█████▍    | 64/117 [00:03<00:02, 20.52it/s, loss=0.708, v_num=1, val_acc=0.751]
Epoch 72:  56%|█████▌    | 65/117 [00:03<00:02, 20.78it/s, loss=0.708, v_num=1, val_acc=0.751]
Epoch 72:  56%|█████▌    | 65/117 [00:03<00:02, 20.61it/s, loss=0.714, v_num=1, val_acc=0.751]
Epoch 72:  56%|█████▋    | 66/117 [00:03<00:02, 20.87it/s, loss=0.714, v_num=1, val_acc=0.751]
Epoch 72:  56%|█████▋    | 66/117 [00:03<00:02, 20.70it/s, loss=0.717, v_num=1, val_acc=0.751]
Epoch 72:  57%|█████▋    | 67/117 [00:03<00:02, 20.95it/s, loss=0.717, v_num=1, val_acc=0.751]
Epoch 72:  57%|█████▋    | 67/117 [00:03<00:02, 20.79it/s, loss=0.718, v_num=1, val_acc=0.751]
Epoch 72:  58%|█████▊    | 68/117 [00:03<00:02, 21.04it/s, loss=0.718, v_num=1, val_acc=0.751]
Epoch 72:  58%|█████▊    | 68/117 [00:03<00:02, 20.88it/s, loss=0.721, v_num=1, val_acc=0.751]
Epoch 72:  59%|█████▉    | 69/117 [00:03<00:02, 21.12it/s, loss=0.721, v_num=1, val_acc=0.751]
Epoch 72:  59%|█████▉    | 69/117 [00:03<00:02, 20.96it/s, loss=0.725, v_num=1, val_acc=0.751]
Epoch 72:  60%|█████▉    | 70/117 [00:03<00:02, 21.21it/s, loss=0.725, v_num=1, val_acc=0.751]
Epoch 72:  60%|█████▉    | 70/117 [00:03<00:02, 21.04it/s, loss=0.719, v_num=1, val_acc=0.751]
Epoch 72:  61%|██████    | 71/117 [00:03<00:02, 21.29it/s, loss=0.719, v_num=1, val_acc=0.751]
Epoch 72:  61%|██████    | 71/117 [00:03<00:02, 21.13it/s, loss=0.721, v_num=1, val_acc=0.751]
Epoch 72:  62%|██████▏   | 72/117 [00:03<00:02, 21.37it/s, loss=0.721, v_num=1, val_acc=0.751]
Epoch 72:  62%|██████▏   | 72/117 [00:03<00:02, 21.21it/s, loss=0.726, v_num=1, val_acc=0.751]
Epoch 72:  62%|██████▏   | 73/117 [00:03<00:02, 21.44it/s, loss=0.726, v_num=1, val_acc=0.751]
Epoch 72:  62%|██████▏   | 73/117 [00:03<00:02, 21.28it/s, loss=0.725, v_num=1, val_acc=0.751]
Epoch 72:  63%|██████▎   | 74/117 [00:03<00:01, 21.52it/s, loss=0.725, v_num=1, val_acc=0.751]
Epoch 72:  63%|██████▎   | 74/117 [00:03<00:02, 21.36it/s, loss=0.729, v_num=1, val_acc=0.751]
Epoch 72:  64%|██████▍   | 75/117 [00:03<00:01, 21.59it/s, loss=0.729, v_num=1, val_acc=0.751]
Epoch 72:  64%|██████▍   | 75/117 [00:03<00:01, 21.43it/s, loss=0.727, v_num=1, val_acc=0.751]
Epoch 72:  65%|██████▍   | 76/117 [00:03<00:01, 21.66it/s, loss=0.727, v_num=1, val_acc=0.751]
Epoch 72:  65%|██████▍   | 76/117 [00:03<00:01, 21.51it/s, loss=0.724, v_num=1, val_acc=0.751]
Epoch 72:  66%|██████▌   | 77/117 [00:03<00:01, 21.74it/s, loss=0.724, v_num=1, val_acc=0.751]
Epoch 72:  66%|██████▌   | 77/117 [00:03<00:01, 21.58it/s, loss=0.725, v_num=1, val_acc=0.751]
Epoch 72:  67%|██████▋   | 78/117 [00:03<00:01, 21.77it/s, loss=0.725, v_num=1, val_acc=0.751]
Epoch 72:  67%|██████▋   | 78/117 [00:03<00:01, 21.63it/s, loss=0.728, v_num=1, val_acc=0.751]
Epoch 72:  68%|██████▊   | 79/117 [00:03<00:01, 21.85it/s, loss=0.728, v_num=1, val_acc=0.751]
Epoch 72:  68%|██████▊   | 79/117 [00:03<00:01, 21.70it/s, loss=0.728, v_num=1, val_acc=0.751]
Epoch 72:  68%|██████▊   | 80/117 [00:03<00:01, 21.91it/s, loss=0.728, v_num=1, val_acc=0.751]
Epoch 72:  68%|██████▊   | 80/117 [00:03<00:01, 21.76it/s, loss=0.716, v_num=1, val_acc=0.751]
Epoch 72:  69%|██████▉   | 81/117 [00:03<00:01, 21.98it/s, loss=0.716, v_num=1, val_acc=0.751]
Epoch 72:  69%|██████▉   | 81/117 [00:03<00:01, 21.83it/s, loss=0.722, v_num=1, val_acc=0.751]
Epoch 72:  70%|███████   | 82/117 [00:03<00:01, 22.03it/s, loss=0.722, v_num=1, val_acc=0.751]
Epoch 72:  70%|███████   | 82/117 [00:03<00:01, 21.88it/s, loss=0.726, v_num=1, val_acc=0.751]
Epoch 72:  71%|███████   | 83/117 [00:03<00:01, 22.10it/s, loss=0.726, v_num=1, val_acc=0.751]
Epoch 72:  71%|███████   | 83/117 [00:03<00:01, 21.95it/s, loss=0.723, v_num=1, val_acc=0.751]
Epoch 72:  72%|███████▏  | 84/117 [00:03<00:01, 22.16it/s, loss=0.723, v_num=1, val_acc=0.751]
Epoch 72:  72%|███████▏  | 84/117 [00:03<00:01, 22.01it/s, loss=0.716, v_num=1, val_acc=0.751]
Epoch 72:  73%|███████▎  | 85/117 [00:03<00:01, 22.22it/s, loss=0.716, v_num=1, val_acc=0.751]
Epoch 72:  73%|███████▎  | 85/117 [00:03<00:01, 22.08it/s, loss=0.712, v_num=1, val_acc=0.751]
Epoch 72:  74%|███████▎  | 86/117 [00:03<00:01, 22.29it/s, loss=0.712, v_num=1, val_acc=0.751]
Epoch 72:  74%|███████▎  | 86/117 [00:03<00:01, 22.14it/s, loss=0.711, v_num=1, val_acc=0.751]
Epoch 72:  74%|███████▍  | 87/117 [00:03<00:01, 22.35it/s, loss=0.711, v_num=1, val_acc=0.751]
Epoch 72:  74%|███████▍  | 87/117 [00:03<00:01, 22.20it/s, loss=0.71, v_num=1, val_acc=0.751]
Epoch 72:  75%|███████▌  | 88/117 [00:03<00:01, 22.41it/s, loss=0.71, v_num=1, val_acc=0.751]
Epoch 72:  75%|███████▌  | 88/117 [00:03<00:01, 22.26it/s, loss=0.709, v_num=1, val_acc=0.751]
Epoch 72:  76%|███████▌  | 89/117 [00:03<00:01, 22.47it/s, loss=0.709, v_num=1, val_acc=0.751]
Epoch 72:  76%|███████▌  | 89/117 [00:03<00:01, 22.32it/s, loss=0.706, v_num=1, val_acc=0.751]
Epoch 72:  77%|███████▋  | 90/117 [00:03<00:01, 22.52it/s, loss=0.706, v_num=1, val_acc=0.751]
Epoch 72:  77%|███████▋  | 90/117 [00:04<00:01, 22.38it/s, loss=0.708, v_num=1, val_acc=0.751]
Epoch 72:  78%|███████▊  | 91/117 [00:04<00:01, 22.58it/s, loss=0.708, v_num=1, val_acc=0.751]
Epoch 72:  78%|███████▊  | 91/117 [00:04<00:01, 22.44it/s, loss=0.71, v_num=1, val_acc=0.751]
Epoch 72:  79%|███████▊  | 92/117 [00:04<00:01, 22.63it/s, loss=0.71, v_num=1, val_acc=0.751]
Epoch 72:  79%|███████▊  | 92/117 [00:04<00:01, 22.49it/s, loss=0.709, v_num=1, val_acc=0.751]
Epoch 72:  79%|███████▉  | 93/117 [00:04<00:01, 22.69it/s, loss=0.709, v_num=1, val_acc=0.751]
Epoch 72:  79%|███████▉  | 93/117 [00:04<00:01, 22.55it/s, loss=0.714, v_num=1, val_acc=0.751]
Epoch 72:  80%|████████  | 94/117 [00:04<00:01, 22.74it/s, loss=0.714, v_num=1, val_acc=0.751]
Epoch 72:  80%|████████  | 94/117 [00:04<00:01, 22.60it/s, loss=0.709, v_num=1, val_acc=0.751]
Epoch 72:  81%|████████  | 95/117 [00:04<00:00, 22.79it/s, loss=0.709, v_num=1, val_acc=0.751]
Epoch 72:  81%|████████  | 95/117 [00:04<00:00, 22.65it/s, loss=0.712, v_num=1, val_acc=0.751]
Epoch 72:  82%|████████▏ | 96/117 [00:04<00:00, 22.84it/s, loss=0.712, v_num=1, val_acc=0.751]
Epoch 72:  82%|████████▏ | 96/117 [00:04<00:00, 22.71it/s, loss=0.711, v_num=1, val_acc=0.751]
Epoch 72:  83%|████████▎ | 97/117 [00:04<00:00, 22.89it/s, loss=0.711, v_num=1, val_acc=0.751]
Epoch 72:  83%|████████▎ | 97/117 [00:04<00:00, 22.76it/s, loss=0.704, v_num=1, val_acc=0.751]

Validation: 0it [00:00, ?it/s]

Validation:   0%|          | 0/20 [00:00<?, ?it/s]

Validation DataLoader 0:   0%|          | 0/20 [00:00<?, ?it/s]

Validation DataLoader 0:   5%|▌         | 1/20 [00:00<00:00, 158.11it/s]
Epoch 72:  84%|████████▍ | 98/117 [00:05<00:00, 19.14it/s, loss=0.704, v_num=1, val_acc=0.751]

Validation DataLoader 0:  10%|█         | 2/20 [00:00<00:00, 54.24it/s]
Epoch 72:  85%|████████▍ | 99/117 [00:05<00:00, 19.22it/s, loss=0.704, v_num=1, val_acc=0.751]

Validation DataLoader 0:  15%|█▌        | 3/20 [00:00<00:00, 43.53it/s]
Epoch 72:  85%|████████▌ | 100/117 [00:05<00:00, 19.29it/s, loss=0.704, v_num=1, val_acc=0.751]

Validation DataLoader 0:  20%|██        | 4/20 [00:00<00:00, 39.70it/s]
Epoch 72:  86%|████████▋ | 101/117 [00:05<00:00, 19.37it/s, loss=0.704, v_num=1, val_acc=0.751]

Validation DataLoader 0:  25%|██▌       | 5/20 [00:00<00:00, 37.49it/s]
Epoch 72:  87%|████████▋ | 102/117 [00:05<00:00, 19.44it/s, loss=0.704, v_num=1, val_acc=0.751]

Validation DataLoader 0:  30%|███       | 6/20 [00:00<00:00, 36.45it/s]
Epoch 72:  88%|████████▊ | 103/117 [00:05<00:00, 19.51it/s, loss=0.704, v_num=1, val_acc=0.751]

Validation DataLoader 0:  35%|███▌      | 7/20 [00:00<00:00, 35.67it/s]
Epoch 72:  89%|████████▉ | 104/117 [00:05<00:00, 19.58it/s, loss=0.704, v_num=1, val_acc=0.751]

Validation DataLoader 0:  40%|████      | 8/20 [00:00<00:00, 35.08it/s]
Epoch 72:  90%|████████▉ | 105/117 [00:05<00:00, 19.66it/s, loss=0.704, v_num=1, val_acc=0.751]

Validation DataLoader 0:  45%|████▌     | 9/20 [00:00<00:00, 34.64it/s]
Epoch 72:  91%|█████████ | 106/117 [00:05<00:00, 19.73it/s, loss=0.704, v_num=1, val_acc=0.751]

Validation DataLoader 0:  50%|█████     | 10/20 [00:00<00:00, 34.34it/s]
Epoch 72:  91%|█████████▏| 107/117 [00:05<00:00, 19.80it/s, loss=0.704, v_num=1, val_acc=0.751]

Validation DataLoader 0:  55%|█████▌    | 11/20 [00:00<00:00, 34.08it/s]
Epoch 72:  92%|█████████▏| 108/117 [00:05<00:00, 19.86it/s, loss=0.704, v_num=1, val_acc=0.751]

Validation DataLoader 0:  60%|██████    | 12/20 [00:00<00:00, 33.86it/s]
Epoch 72:  93%|█████████▎| 109/117 [00:05<00:00, 19.93it/s, loss=0.704, v_num=1, val_acc=0.751]

Validation DataLoader 0:  65%|██████▌   | 13/20 [00:00<00:00, 33.67it/s]
Epoch 72:  94%|█████████▍| 110/117 [00:05<00:00, 20.00it/s, loss=0.704, v_num=1, val_acc=0.751]

Validation DataLoader 0:  70%|███████   | 14/20 [00:00<00:00, 33.52it/s]
Epoch 72:  95%|█████████▍| 111/117 [00:05<00:00, 20.07it/s, loss=0.704, v_num=1, val_acc=0.751]

Validation DataLoader 0:  75%|███████▌  | 15/20 [00:00<00:00, 33.38it/s]
Epoch 72:  96%|█████████▌| 112/117 [00:05<00:00, 20.13it/s, loss=0.704, v_num=1, val_acc=0.751]

Validation DataLoader 0:  80%|████████  | 16/20 [00:00<00:00, 33.27it/s]
Epoch 72:  97%|█████████▋| 113/117 [00:05<00:00, 20.20it/s, loss=0.704, v_num=1, val_acc=0.751]

Validation DataLoader 0:  85%|████████▌ | 17/20 [00:00<00:00, 33.04it/s]
Epoch 72:  97%|█████████▋| 114/117 [00:05<00:00, 20.25it/s, loss=0.704, v_num=1, val_acc=0.751]

Validation DataLoader 0:  90%|█████████ | 18/20 [00:00<00:00, 32.96it/s]
Epoch 72:  98%|█████████▊| 115/117 [00:05<00:00, 20.32it/s, loss=0.704, v_num=1, val_acc=0.751]

Validation DataLoader 0:  95%|█████████▌| 19/20 [00:00<00:00, 32.88it/s]
Epoch 72:  99%|█████████▉| 116/117 [00:05<00:00, 20.38it/s, loss=0.704, v_num=1, val_acc=0.751]

Validation DataLoader 0: 100%|██████████| 20/20 [00:00<00:00, 32.88it/s]
Epoch 72: 100%|██████████| 117/117 [00:05<00:00, 20.45it/s, loss=0.704, v_num=1, val_acc=0.751]
Epoch 72: 100%|██████████| 117/117 [00:05<00:00, 20.38it/s, loss=0.704, v_num=1, val_acc=0.756]


Epoch 72: 100%|██████████| 117/117 [00:05<00:00, 20.37it/s, loss=0.704, v_num=1, val_acc=0.756]
Epoch 72:   0%|          | 0/117 [00:00<?, ?it/s, loss=0.704, v_num=1, val_acc=0.756]
Epoch 73:   0%|          | 0/117 [00:00<?, ?it/s, loss=0.704, v_num=1, val_acc=0.756]
Epoch 73:   1%|          | 1/117 [00:00<01:44,  1.11it/s, loss=0.704, v_num=1, val_acc=0.756]
Epoch 73:   1%|          | 1/117 [00:00<01:47,  1.08it/s, loss=0.697, v_num=1, val_acc=0.756]
Epoch 73:   2%|▏         | 2/117 [00:00<00:53,  2.14it/s, loss=0.697, v_num=1, val_acc=0.756]
Epoch 73:   2%|▏         | 2/117 [00:00<00:55,  2.08it/s, loss=0.696, v_num=1, val_acc=0.756]
Epoch 73:   3%|▎         | 3/117 [00:00<00:36,  3.10it/s, loss=0.696, v_num=1, val_acc=0.756]
Epoch 73:   3%|▎         | 3/117 [00:00<00:37,  3.02it/s, loss=0.702, v_num=1, val_acc=0.756]
Epoch 73:   3%|▎         | 4/117 [00:01<00:28,  3.99it/s, loss=0.702, v_num=1, val_acc=0.756]
Epoch 73:   3%|▎         | 4/117 [00:01<00:29,  3.89it/s, loss=0.699, v_num=1, val_acc=0.756]
Epoch 73:   4%|▍         | 5/117 [00:01<00:23,  4.83it/s, loss=0.699, v_num=1, val_acc=0.756]
Epoch 73:   4%|▍         | 5/117 [00:01<00:23,  4.71it/s, loss=0.695, v_num=1, val_acc=0.756]
Epoch 73:   5%|▌         | 6/117 [00:01<00:19,  5.61it/s, loss=0.695, v_num=1, val_acc=0.756]
Epoch 73:   5%|▌         | 6/117 [00:01<00:20,  5.48it/s, loss=0.699, v_num=1, val_acc=0.756]
Epoch 73:   6%|▌         | 7/117 [00:01<00:17,  6.33it/s, loss=0.699, v_num=1, val_acc=0.756]
Epoch 73:   6%|▌         | 7/117 [00:01<00:17,  6.19it/s, loss=0.697, v_num=1, val_acc=0.756]
Epoch 73:   7%|▋         | 8/117 [00:01<00:15,  7.02it/s, loss=0.697, v_num=1, val_acc=0.756]
Epoch 73:   7%|▋         | 8/117 [00:01<00:15,  6.87it/s, loss=0.691, v_num=1, val_acc=0.756]
Epoch 73:   8%|▊         | 9/117 [00:01<00:14,  7.66it/s, loss=0.691, v_num=1, val_acc=0.756]
Epoch 73:   8%|▊         | 9/117 [00:01<00:14,  7.49it/s, loss=0.689, v_num=1, val_acc=0.756]
Epoch 73:   9%|▊         | 10/117 [00:01<00:12,  8.26it/s, loss=0.689, v_num=1, val_acc=0.756]
Epoch 73:   9%|▊         | 10/117 [00:01<00:13,  8.09it/s, loss=0.691, v_num=1, val_acc=0.756]
Epoch 73:   9%|▉         | 11/117 [00:01<00:11,  8.84it/s, loss=0.691, v_num=1, val_acc=0.756]
Epoch 73:   9%|▉         | 11/117 [00:01<00:12,  8.66it/s, loss=0.696, v_num=1, val_acc=0.756]
Epoch 73:  10%|█         | 12/117 [00:01<00:11,  9.39it/s, loss=0.696, v_num=1, val_acc=0.756]
Epoch 73:  10%|█         | 12/117 [00:01<00:11,  9.21it/s, loss=0.699, v_num=1, val_acc=0.756]
Epoch 73:  11%|█         | 13/117 [00:01<00:10,  9.91it/s, loss=0.699, v_num=1, val_acc=0.756]
Epoch 73:  11%|█         | 13/117 [00:01<00:10,  9.72it/s, loss=0.702, v_num=1, val_acc=0.756]
Epoch 73:  12%|█▏        | 14/117 [00:01<00:09, 10.39it/s, loss=0.702, v_num=1, val_acc=0.756]
Epoch 73:  12%|█▏        | 14/117 [00:01<00:10, 10.20it/s, loss=0.697, v_num=1, val_acc=0.756]
Epoch 73:  13%|█▎        | 15/117 [00:01<00:09, 10.85it/s, loss=0.697, v_num=1, val_acc=0.756]
Epoch 73:  13%|█▎        | 15/117 [00:01<00:09, 10.66it/s, loss=0.695, v_num=1, val_acc=0.756]
Epoch 73:  14%|█▎        | 16/117 [00:01<00:08, 11.30it/s, loss=0.695, v_num=1, val_acc=0.756]
Epoch 73:  14%|█▎        | 16/117 [00:01<00:09, 11.10it/s, loss=0.693, v_num=1, val_acc=0.756]
Epoch 73:  15%|█▍        | 17/117 [00:01<00:08, 11.71it/s, loss=0.693, v_num=1, val_acc=0.756]
Epoch 73:  15%|█▍        | 17/117 [00:01<00:08, 11.51it/s, loss=0.697, v_num=1, val_acc=0.756]
Epoch 73:  15%|█▌        | 18/117 [00:01<00:08, 12.11it/s, loss=0.697, v_num=1, val_acc=0.756]
Epoch 73:  15%|█▌        | 18/117 [00:01<00:08, 11.91it/s, loss=0.692, v_num=1, val_acc=0.756]
Epoch 73:  16%|█▌        | 19/117 [00:01<00:07, 12.50it/s, loss=0.692, v_num=1, val_acc=0.756]
Epoch 73:  16%|█▌        | 19/117 [00:01<00:07, 12.30it/s, loss=0.693, v_num=1, val_acc=0.756]
Epoch 73:  17%|█▋        | 20/117 [00:01<00:07, 12.87it/s, loss=0.693, v_num=1, val_acc=0.756]
Epoch 73:  17%|█▋        | 20/117 [00:01<00:07, 12.66it/s, loss=0.702, v_num=1, val_acc=0.756]
Epoch 73:  18%|█▊        | 21/117 [00:01<00:07, 13.22it/s, loss=0.702, v_num=1, val_acc=0.756]
Epoch 73:  18%|█▊        | 21/117 [00:01<00:07, 13.01it/s, loss=0.703, v_num=1, val_acc=0.756]
Epoch 73:  19%|█▉        | 22/117 [00:01<00:07, 13.55it/s, loss=0.703, v_num=1, val_acc=0.756]
Epoch 73:  19%|█▉        | 22/117 [00:01<00:07, 13.34it/s, loss=0.704, v_num=1, val_acc=0.756]
Epoch 73:  20%|█▉        | 23/117 [00:01<00:06, 13.88it/s, loss=0.704, v_num=1, val_acc=0.756]
Epoch 73:  20%|█▉        | 23/117 [00:01<00:06, 13.67it/s, loss=0.699, v_num=1, val_acc=0.756]
Epoch 73:  21%|██        | 24/117 [00:01<00:06, 14.18it/s, loss=0.699, v_num=1, val_acc=0.756]
Epoch 73:  21%|██        | 24/117 [00:01<00:06, 13.97it/s, loss=0.701, v_num=1, val_acc=0.756]
Epoch 73:  21%|██▏       | 25/117 [00:01<00:06, 14.47it/s, loss=0.701, v_num=1, val_acc=0.756]
Epoch 73:  21%|██▏       | 25/117 [00:01<00:06, 14.26it/s, loss=0.703, v_num=1, val_acc=0.756]
Epoch 73:  22%|██▏       | 26/117 [00:01<00:06, 14.75it/s, loss=0.703, v_num=1, val_acc=0.756]
Epoch 73:  22%|██▏       | 26/117 [00:01<00:06, 14.55it/s, loss=0.704, v_num=1, val_acc=0.756]
Epoch 73:  23%|██▎       | 27/117 [00:01<00:06, 14.99it/s, loss=0.704, v_num=1, val_acc=0.756]
Epoch 73:  23%|██▎       | 27/117 [00:01<00:06, 14.80it/s, loss=0.702, v_num=1, val_acc=0.756]
Epoch 73:  24%|██▍       | 28/117 [00:01<00:05, 15.26it/s, loss=0.702, v_num=1, val_acc=0.756]
Epoch 73:  24%|██▍       | 28/117 [00:01<00:05, 15.06it/s, loss=0.708, v_num=1, val_acc=0.756]
Epoch 73:  25%|██▍       | 29/117 [00:01<00:05, 15.52it/s, loss=0.708, v_num=1, val_acc=0.756]
Epoch 73:  25%|██▍       | 29/117 [00:01<00:05, 15.31it/s, loss=0.709, v_num=1, val_acc=0.756]
Epoch 73:  26%|██▌       | 30/117 [00:01<00:05, 15.76it/s, loss=0.709, v_num=1, val_acc=0.756]
Epoch 73:  26%|██▌       | 30/117 [00:01<00:05, 15.56it/s, loss=0.705, v_num=1, val_acc=0.756]
Epoch 73:  26%|██▋       | 31/117 [00:01<00:05, 15.96it/s, loss=0.705, v_num=1, val_acc=0.756]
Epoch 73:  26%|██▋       | 31/117 [00:01<00:05, 15.79it/s, loss=0.701, v_num=1, val_acc=0.756]
Epoch 73:  27%|██▋       | 32/117 [00:01<00:05, 16.22it/s, loss=0.701, v_num=1, val_acc=0.756]
Epoch 73:  27%|██▋       | 32/117 [00:01<00:05, 16.01it/s, loss=0.701, v_num=1, val_acc=0.756]
Epoch 73:  28%|██▊       | 33/117 [00:02<00:05, 16.44it/s, loss=0.701, v_num=1, val_acc=0.756]
Epoch 73:  28%|██▊       | 33/117 [00:02<00:05, 16.23it/s, loss=0.694, v_num=1, val_acc=0.756]
Epoch 73:  29%|██▉       | 34/117 [00:02<00:04, 16.65it/s, loss=0.694, v_num=1, val_acc=0.756]
Epoch 73:  29%|██▉       | 34/117 [00:02<00:05, 16.44it/s, loss=0.692, v_num=1, val_acc=0.756]
Epoch 73:  30%|██▉       | 35/117 [00:02<00:04, 16.85it/s, loss=0.692, v_num=1, val_acc=0.756]
Epoch 73:  30%|██▉       | 35/117 [00:02<00:04, 16.65it/s, loss=0.695, v_num=1, val_acc=0.756]
Epoch 73:  31%|███       | 36/117 [00:02<00:04, 17.05it/s, loss=0.695, v_num=1, val_acc=0.756]
Epoch 73:  31%|███       | 36/117 [00:02<00:04, 16.85it/s, loss=0.697, v_num=1, val_acc=0.756]
Epoch 73:  32%|███▏      | 37/117 [00:02<00:04, 17.25it/s, loss=0.697, v_num=1, val_acc=0.756]
Epoch 73:  32%|███▏      | 37/117 [00:02<00:04, 17.05it/s, loss=0.693, v_num=1, val_acc=0.756]
Epoch 73:  32%|███▏      | 38/117 [00:02<00:04, 17.43it/s, loss=0.693, v_num=1, val_acc=0.756]
Epoch 73:  32%|███▏      | 38/117 [00:02<00:04, 17.23it/s, loss=0.699, v_num=1, val_acc=0.756]
Epoch 73:  33%|███▎      | 39/117 [00:02<00:04, 17.61it/s, loss=0.699, v_num=1, val_acc=0.756]
Epoch 73:  33%|███▎      | 39/117 [00:02<00:04, 17.41it/s, loss=0.696, v_num=1, val_acc=0.756]
Epoch 73:  34%|███▍      | 40/117 [00:02<00:04, 17.79it/s, loss=0.696, v_num=1, val_acc=0.756]
Epoch 73:  34%|███▍      | 40/117 [00:02<00:04, 17.59it/s, loss=0.692, v_num=1, val_acc=0.756]
Epoch 73:  35%|███▌      | 41/117 [00:02<00:04, 17.92it/s, loss=0.692, v_num=1, val_acc=0.756]
Epoch 73:  35%|███▌      | 41/117 [00:02<00:04, 17.74it/s, loss=0.701, v_num=1, val_acc=0.756]
Epoch 73:  36%|███▌      | 42/117 [00:02<00:04, 18.10it/s, loss=0.701, v_num=1, val_acc=0.756]
Epoch 73:  36%|███▌      | 42/117 [00:02<00:04, 17.90it/s, loss=0.701, v_num=1, val_acc=0.756]
Epoch 73:  37%|███▋      | 43/117 [00:02<00:04, 18.26it/s, loss=0.701, v_num=1, val_acc=0.756]
Epoch 73:  37%|███▋      | 43/117 [00:02<00:04, 18.06it/s, loss=0.705, v_num=1, val_acc=0.756]
Epoch 73:  38%|███▊      | 44/117 [00:02<00:03, 18.42it/s, loss=0.705, v_num=1, val_acc=0.756]
Epoch 73:  38%|███▊      | 44/117 [00:02<00:04, 18.22it/s, loss=0.708, v_num=1, val_acc=0.756]
Epoch 73:  38%|███▊      | 45/117 [00:02<00:03, 18.57it/s, loss=0.708, v_num=1, val_acc=0.756]
Epoch 73:  38%|███▊      | 45/117 [00:02<00:03, 18.37it/s, loss=0.712, v_num=1, val_acc=0.756]
Epoch 73:  39%|███▉      | 46/117 [00:02<00:03, 18.71it/s, loss=0.712, v_num=1, val_acc=0.756]
Epoch 73:  39%|███▉      | 46/117 [00:02<00:03, 18.52it/s, loss=0.718, v_num=1, val_acc=0.756]
Epoch 73:  40%|████      | 47/117 [00:02<00:03, 18.85it/s, loss=0.718, v_num=1, val_acc=0.756]
Epoch 73:  40%|████      | 47/117 [00:02<00:03, 18.66it/s, loss=0.719, v_num=1, val_acc=0.756]
Epoch 73:  41%|████      | 48/117 [00:02<00:03, 18.99it/s, loss=0.719, v_num=1, val_acc=0.756]
Epoch 73:  41%|████      | 48/117 [00:02<00:03, 18.80it/s, loss=0.72, v_num=1, val_acc=0.756]
Epoch 73:  42%|████▏     | 49/117 [00:02<00:03, 19.13it/s, loss=0.72, v_num=1, val_acc=0.756]
Epoch 73:  42%|████▏     | 49/117 [00:02<00:03, 18.94it/s, loss=0.723, v_num=1, val_acc=0.756]
Epoch 73:  43%|████▎     | 50/117 [00:02<00:03, 19.26it/s, loss=0.723, v_num=1, val_acc=0.756]
Epoch 73:  43%|████▎     | 50/117 [00:02<00:03, 19.07it/s, loss=0.729, v_num=1, val_acc=0.756]
Epoch 73:  44%|████▎     | 51/117 [00:02<00:03, 19.39it/s, loss=0.729, v_num=1, val_acc=0.756]
Epoch 73:  44%|████▎     | 51/117 [00:02<00:03, 19.20it/s, loss=0.734, v_num=1, val_acc=0.756]
Epoch 73:  44%|████▍     | 52/117 [00:02<00:03, 19.51it/s, loss=0.734, v_num=1, val_acc=0.756]
Epoch 73:  44%|████▍     | 52/117 [00:02<00:03, 19.33it/s, loss=0.734, v_num=1, val_acc=0.756]
Epoch 73:  45%|████▌     | 53/117 [00:02<00:03, 19.63it/s, loss=0.734, v_num=1, val_acc=0.756]
Epoch 73:  45%|████▌     | 53/117 [00:02<00:03, 19.45it/s, loss=0.742, v_num=1, val_acc=0.756]
Epoch 73:  46%|████▌     | 54/117 [00:02<00:03, 19.75it/s, loss=0.742, v_num=1, val_acc=0.756]
Epoch 73:  46%|████▌     | 54/117 [00:02<00:03, 19.57it/s, loss=0.741, v_num=1, val_acc=0.756]
Epoch 73:  47%|████▋     | 55/117 [00:02<00:03, 19.86it/s, loss=0.741, v_num=1, val_acc=0.756]
Epoch 73:  47%|████▋     | 55/117 [00:02<00:03, 19.68it/s, loss=0.743, v_num=1, val_acc=0.756]
Epoch 73:  48%|████▊     | 56/117 [00:02<00:03, 19.98it/s, loss=0.743, v_num=1, val_acc=0.756]
Epoch 73:  48%|████▊     | 56/117 [00:02<00:03, 19.80it/s, loss=0.742, v_num=1, val_acc=0.756]
Epoch 73:  49%|████▊     | 57/117 [00:02<00:02, 20.09it/s, loss=0.742, v_num=1, val_acc=0.756]
Epoch 73:  49%|████▊     | 57/117 [00:02<00:03, 19.91it/s, loss=0.742, v_num=1, val_acc=0.756]
Epoch 73:  50%|████▉     | 58/117 [00:02<00:02, 20.20it/s, loss=0.742, v_num=1, val_acc=0.756]
Epoch 73:  50%|████▉     | 58/117 [00:02<00:02, 20.02it/s, loss=0.742, v_num=1, val_acc=0.756]
Epoch 73:  50%|█████     | 59/117 [00:02<00:02, 20.30it/s, loss=0.742, v_num=1, val_acc=0.756]
Epoch 73:  50%|█████     | 59/117 [00:02<00:02, 20.12it/s, loss=0.748, v_num=1, val_acc=0.756]
Epoch 73:  51%|█████▏    | 60/117 [00:02<00:02, 20.40it/s, loss=0.748, v_num=1, val_acc=0.756]
Epoch 73:  51%|█████▏    | 60/117 [00:02<00:02, 20.23it/s, loss=0.745, v_num=1, val_acc=0.756]
Epoch 73:  52%|█████▏    | 61/117 [00:02<00:02, 20.50it/s, loss=0.745, v_num=1, val_acc=0.756]
Epoch 73:  52%|█████▏    | 61/117 [00:03<00:02, 20.33it/s, loss=0.736, v_num=1, val_acc=0.756]
Epoch 73:  53%|█████▎    | 62/117 [00:03<00:02, 20.60it/s, loss=0.736, v_num=1, val_acc=0.756]
Epoch 73:  53%|█████▎    | 62/117 [00:03<00:02, 20.43it/s, loss=0.736, v_num=1, val_acc=0.756]
Epoch 73:  54%|█████▍    | 63/117 [00:03<00:02, 20.69it/s, loss=0.736, v_num=1, val_acc=0.756]
Epoch 73:  54%|█████▍    | 63/117 [00:03<00:02, 20.52it/s, loss=0.737, v_num=1, val_acc=0.756]
Epoch 73:  55%|█████▍    | 64/117 [00:03<00:02, 20.79it/s, loss=0.737, v_num=1, val_acc=0.756]
Epoch 73:  55%|█████▍    | 64/117 [00:03<00:02, 20.62it/s, loss=0.735, v_num=1, val_acc=0.756]
Epoch 73:  56%|█████▌    | 65/117 [00:03<00:02, 20.88it/s, loss=0.735, v_num=1, val_acc=0.756]
Epoch 73:  56%|█████▌    | 65/117 [00:03<00:02, 20.71it/s, loss=0.733, v_num=1, val_acc=0.756]
Epoch 73:  56%|█████▋    | 66/117 [00:03<00:02, 20.97it/s, loss=0.733, v_num=1, val_acc=0.756]
Epoch 73:  56%|█████▋    | 66/117 [00:03<00:02, 20.80it/s, loss=0.722, v_num=1, val_acc=0.756]
Epoch 73:  57%|█████▋    | 67/117 [00:03<00:02, 21.05it/s, loss=0.722, v_num=1, val_acc=0.756]
Epoch 73:  57%|█████▋    | 67/117 [00:03<00:02, 20.89it/s, loss=0.725, v_num=1, val_acc=0.756]
Epoch 73:  58%|█████▊    | 68/117 [00:03<00:02, 21.14it/s, loss=0.725, v_num=1, val_acc=0.756]
Epoch 73:  58%|█████▊    | 68/117 [00:03<00:02, 20.97it/s, loss=0.722, v_num=1, val_acc=0.756]
Epoch 73:  59%|█████▉    | 69/117 [00:03<00:02, 21.22it/s, loss=0.722, v_num=1, val_acc=0.756]
Epoch 73:  59%|█████▉    | 69/117 [00:03<00:02, 21.06it/s, loss=0.717, v_num=1, val_acc=0.756]
Epoch 73:  60%|█████▉    | 70/117 [00:03<00:02, 21.30it/s, loss=0.717, v_num=1, val_acc=0.756]
Epoch 73:  60%|█████▉    | 70/117 [00:03<00:02, 21.14it/s, loss=0.716, v_num=1, val_acc=0.756]
Epoch 73:  61%|██████    | 71/117 [00:03<00:02, 21.38it/s, loss=0.716, v_num=1, val_acc=0.756]
Epoch 73:  61%|██████    | 71/117 [00:03<00:02, 21.22it/s, loss=0.714, v_num=1, val_acc=0.756]
Epoch 73:  62%|██████▏   | 72/117 [00:03<00:02, 21.46it/s, loss=0.714, v_num=1, val_acc=0.756]
Epoch 73:  62%|██████▏   | 72/117 [00:03<00:02, 21.29it/s, loss=0.71, v_num=1, val_acc=0.756]
Epoch 73:  62%|██████▏   | 73/117 [00:03<00:02, 21.53it/s, loss=0.71, v_num=1, val_acc=0.756]
Epoch 73:  62%|██████▏   | 73/117 [00:03<00:02, 21.37it/s, loss=0.71, v_num=1, val_acc=0.756]
Epoch 73:  63%|██████▎   | 74/117 [00:03<00:01, 21.61it/s, loss=0.71, v_num=1, val_acc=0.756]
Epoch 73:  63%|██████▎   | 74/117 [00:03<00:02, 21.45it/s, loss=0.712, v_num=1, val_acc=0.756]
Epoch 73:  64%|██████▍   | 75/117 [00:03<00:01, 21.68it/s, loss=0.712, v_num=1, val_acc=0.756]
Epoch 73:  64%|██████▍   | 75/117 [00:03<00:01, 21.52it/s, loss=0.708, v_num=1, val_acc=0.756]
Epoch 73:  65%|██████▍   | 76/117 [00:03<00:01, 21.75it/s, loss=0.708, v_num=1, val_acc=0.756]
Epoch 73:  65%|██████▍   | 76/117 [00:03<00:01, 21.60it/s, loss=0.71, v_num=1, val_acc=0.756]
Epoch 73:  66%|██████▌   | 77/117 [00:03<00:01, 21.83it/s, loss=0.71, v_num=1, val_acc=0.756]
Epoch 73:  66%|██████▌   | 77/117 [00:03<00:01, 21.67it/s, loss=0.713, v_num=1, val_acc=0.756]
Epoch 73:  67%|██████▋   | 78/117 [00:03<00:01, 21.89it/s, loss=0.713, v_num=1, val_acc=0.756]
Epoch 73:  67%|██████▋   | 78/117 [00:03<00:01, 21.74it/s, loss=0.71, v_num=1, val_acc=0.756]
Epoch 73:  68%|██████▊   | 79/117 [00:03<00:01, 21.96it/s, loss=0.71, v_num=1, val_acc=0.756]
Epoch 73:  68%|██████▊   | 79/117 [00:03<00:01, 21.81it/s, loss=0.714, v_num=1, val_acc=0.756]
Epoch 73:  68%|██████▊   | 80/117 [00:03<00:01, 22.03it/s, loss=0.714, v_num=1, val_acc=0.756]
Epoch 73:  68%|██████▊   | 80/117 [00:03<00:01, 21.88it/s, loss=0.715, v_num=1, val_acc=0.756]
Epoch 73:  69%|██████▉   | 81/117 [00:03<00:01, 22.10it/s, loss=0.715, v_num=1, val_acc=0.756]
Epoch 73:  69%|██████▉   | 81/117 [00:03<00:01, 21.94it/s, loss=0.715, v_num=1, val_acc=0.756]
Epoch 73:  70%|███████   | 82/117 [00:03<00:01, 22.14it/s, loss=0.715, v_num=1, val_acc=0.756]
Epoch 73:  70%|███████   | 82/117 [00:03<00:01, 21.99it/s, loss=0.711, v_num=1, val_acc=0.756]
Epoch 73:  71%|███████   | 83/117 [00:03<00:01, 22.21it/s, loss=0.711, v_num=1, val_acc=0.756]
Epoch 73:  71%|███████   | 83/117 [00:03<00:01, 22.06it/s, loss=0.709, v_num=1, val_acc=0.756]
Epoch 73:  72%|███████▏  | 84/117 [00:03<00:01, 22.27it/s, loss=0.709, v_num=1, val_acc=0.756]
Epoch 73:  72%|███████▏  | 84/117 [00:03<00:01, 22.12it/s, loss=0.703, v_num=1, val_acc=0.756]
Epoch 73:  73%|███████▎  | 85/117 [00:03<00:01, 22.33it/s, loss=0.703, v_num=1, val_acc=0.756]
Epoch 73:  73%|███████▎  | 85/117 [00:03<00:01, 22.19it/s, loss=0.706, v_num=1, val_acc=0.756]
Epoch 73:  74%|███████▎  | 86/117 [00:03<00:01, 22.39it/s, loss=0.706, v_num=1, val_acc=0.756]
Epoch 73:  74%|███████▎  | 86/117 [00:03<00:01, 22.25it/s, loss=0.713, v_num=1, val_acc=0.756]
Epoch 73:  74%|███████▍  | 87/117 [00:03<00:01, 22.46it/s, loss=0.713, v_num=1, val_acc=0.756]
Epoch 73:  74%|███████▍  | 87/117 [00:03<00:01, 22.31it/s, loss=0.711, v_num=1, val_acc=0.756]
Epoch 73:  75%|███████▌  | 88/117 [00:03<00:01, 22.51it/s, loss=0.711, v_num=1, val_acc=0.756]
Epoch 73:  75%|███████▌  | 88/117 [00:03<00:01, 22.37it/s, loss=0.706, v_num=1, val_acc=0.756]
Epoch 73:  76%|███████▌  | 89/117 [00:03<00:01, 22.57it/s, loss=0.706, v_num=1, val_acc=0.756]
Epoch 73:  76%|███████▌  | 89/117 [00:03<00:01, 22.43it/s, loss=0.708, v_num=1, val_acc=0.756]
Epoch 73:  77%|███████▋  | 90/117 [00:03<00:01, 22.63it/s, loss=0.708, v_num=1, val_acc=0.756]
Epoch 73:  77%|███████▋  | 90/117 [00:04<00:01, 22.48it/s, loss=0.702, v_num=1, val_acc=0.756]
Epoch 73:  78%|███████▊  | 91/117 [00:04<00:01, 22.68it/s, loss=0.702, v_num=1, val_acc=0.756]
Epoch 73:  78%|███████▊  | 91/117 [00:04<00:01, 22.54it/s, loss=0.697, v_num=1, val_acc=0.756]
Epoch 73:  79%|███████▊  | 92/117 [00:04<00:01, 22.74it/s, loss=0.697, v_num=1, val_acc=0.756]
Epoch 73:  79%|███████▊  | 92/117 [00:04<00:01, 22.60it/s, loss=0.702, v_num=1, val_acc=0.756]
Epoch 73:  79%|███████▉  | 93/117 [00:04<00:01, 22.79it/s, loss=0.702, v_num=1, val_acc=0.756]
Epoch 73:  79%|███████▉  | 93/117 [00:04<00:01, 22.65it/s, loss=0.7, v_num=1, val_acc=0.756]
Epoch 73:  80%|████████  | 94/117 [00:04<00:01, 22.84it/s, loss=0.7, v_num=1, val_acc=0.756]
Epoch 73:  80%|████████  | 94/117 [00:04<00:01, 22.70it/s, loss=0.702, v_num=1, val_acc=0.756]
Epoch 73:  81%|████████  | 95/117 [00:04<00:00, 22.90it/s, loss=0.702, v_num=1, val_acc=0.756]
Epoch 73:  81%|████████  | 95/117 [00:04<00:00, 22.76it/s, loss=0.701, v_num=1, val_acc=0.756]
Epoch 73:  82%|████████▏ | 96/117 [00:04<00:00, 22.95it/s, loss=0.701, v_num=1, val_acc=0.756]
Epoch 73:  82%|████████▏ | 96/117 [00:04<00:00, 22.81it/s, loss=0.697, v_num=1, val_acc=0.756]
Epoch 73:  83%|████████▎ | 97/117 [00:04<00:00, 23.00it/s, loss=0.697, v_num=1, val_acc=0.756]
Epoch 73:  83%|████████▎ | 97/117 [00:04<00:00, 22.86it/s, loss=0.693, v_num=1, val_acc=0.756]

Validation: 0it [00:00, ?it/s]

Validation:   0%|          | 0/20 [00:00<?, ?it/s]

Validation DataLoader 0:   0%|          | 0/20 [00:00<?, ?it/s]

Validation DataLoader 0:   5%|▌         | 1/20 [00:00<00:00, 183.96it/s]
Epoch 73:  84%|████████▍ | 98/117 [00:05<00:00, 19.27it/s, loss=0.693, v_num=1, val_acc=0.756]

Validation DataLoader 0:  10%|█         | 2/20 [00:00<00:00, 56.11it/s]
Epoch 73:  85%|████████▍ | 99/117 [00:05<00:00, 19.35it/s, loss=0.693, v_num=1, val_acc=0.756]

Validation DataLoader 0:  15%|█▌        | 3/20 [00:00<00:00, 44.74it/s]
Epoch 73:  85%|████████▌ | 100/117 [00:05<00:00, 19.43it/s, loss=0.693, v_num=1, val_acc=0.756]

Validation DataLoader 0:  20%|██        | 4/20 [00:00<00:00, 40.48it/s]
Epoch 73:  86%|████████▋ | 101/117 [00:05<00:00, 19.50it/s, loss=0.693, v_num=1, val_acc=0.756]

Validation DataLoader 0:  25%|██▌       | 5/20 [00:00<00:00, 38.27it/s]
Epoch 73:  87%|████████▋ | 102/117 [00:05<00:00, 19.57it/s, loss=0.693, v_num=1, val_acc=0.756]

Validation DataLoader 0:  30%|███       | 6/20 [00:00<00:00, 36.99it/s]
Epoch 73:  88%|████████▊ | 103/117 [00:05<00:00, 19.65it/s, loss=0.693, v_num=1, val_acc=0.756]

Validation DataLoader 0:  35%|███▌      | 7/20 [00:00<00:00, 36.12it/s]
Epoch 73:  89%|████████▉ | 104/117 [00:05<00:00, 19.72it/s, loss=0.693, v_num=1, val_acc=0.756]

Validation DataLoader 0:  40%|████      | 8/20 [00:00<00:00, 35.49it/s]
Epoch 73:  90%|████████▉ | 105/117 [00:05<00:00, 19.79it/s, loss=0.693, v_num=1, val_acc=0.756]

Validation DataLoader 0:  45%|████▌     | 9/20 [00:00<00:00, 34.98it/s]
Epoch 73:  91%|█████████ | 106/117 [00:05<00:00, 19.86it/s, loss=0.693, v_num=1, val_acc=0.756]

Validation DataLoader 0:  50%|█████     | 10/20 [00:00<00:00, 34.64it/s]
Epoch 73:  91%|█████████▏| 107/117 [00:05<00:00, 19.93it/s, loss=0.693, v_num=1, val_acc=0.756]

Validation DataLoader 0:  55%|█████▌    | 11/20 [00:00<00:00, 34.35it/s]
Epoch 73:  92%|█████████▏| 108/117 [00:05<00:00, 20.00it/s, loss=0.693, v_num=1, val_acc=0.756]

Validation DataLoader 0:  60%|██████    | 12/20 [00:00<00:00, 34.08it/s]
Epoch 73:  93%|█████████▎| 109/117 [00:05<00:00, 20.06it/s, loss=0.693, v_num=1, val_acc=0.756]

Validation DataLoader 0:  65%|██████▌   | 13/20 [00:00<00:00, 33.89it/s]
Epoch 73:  94%|█████████▍| 110/117 [00:05<00:00, 20.13it/s, loss=0.693, v_num=1, val_acc=0.756]

Validation DataLoader 0:  70%|███████   | 14/20 [00:00<00:00, 33.72it/s]
Epoch 73:  95%|█████████▍| 111/117 [00:05<00:00, 20.20it/s, loss=0.693, v_num=1, val_acc=0.756]

Validation DataLoader 0:  75%|███████▌  | 15/20 [00:00<00:00, 33.57it/s]
Epoch 73:  96%|█████████▌| 112/117 [00:05<00:00, 20.26it/s, loss=0.693, v_num=1, val_acc=0.756]

Validation DataLoader 0:  80%|████████  | 16/20 [00:00<00:00, 33.44it/s]
Epoch 73:  97%|█████████▋| 113/117 [00:05<00:00, 20.33it/s, loss=0.693, v_num=1, val_acc=0.756]

Validation DataLoader 0:  85%|████████▌ | 17/20 [00:00<00:00, 33.31it/s]
Epoch 73:  97%|█████████▋| 114/117 [00:05<00:00, 20.39it/s, loss=0.693, v_num=1, val_acc=0.756]

Validation DataLoader 0:  90%|█████████ | 18/20 [00:00<00:00, 33.20it/s]
Epoch 73:  98%|█████████▊| 115/117 [00:05<00:00, 20.45it/s, loss=0.693, v_num=1, val_acc=0.756]

Validation DataLoader 0:  95%|█████████▌| 19/20 [00:00<00:00, 33.10it/s]
Epoch 73:  99%|█████████▉| 116/117 [00:05<00:00, 20.51it/s, loss=0.693, v_num=1, val_acc=0.756]

Validation DataLoader 0: 100%|██████████| 20/20 [00:00<00:00, 33.10it/s]
Epoch 73: 100%|██████████| 117/117 [00:05<00:00, 20.58it/s, loss=0.693, v_num=1, val_acc=0.756]
Epoch 73: 100%|██████████| 117/117 [00:05<00:00, 20.51it/s, loss=0.693, v_num=1, val_acc=0.754]


Epoch 73: 100%|██████████| 117/117 [00:05<00:00, 20.50it/s, loss=0.693, v_num=1, val_acc=0.754]
Epoch 73:   0%|          | 0/117 [00:00<?, ?it/s, loss=0.693, v_num=1, val_acc=0.754]
Epoch 74:   0%|          | 0/117 [00:00<?, ?it/s, loss=0.693, v_num=1, val_acc=0.754]
Epoch 74:   1%|          | 1/117 [00:00<01:45,  1.10it/s, loss=0.693, v_num=1, val_acc=0.754]
Epoch 74:   1%|          | 1/117 [00:00<01:48,  1.07it/s, loss=0.691, v_num=1, val_acc=0.754]
Epoch 74:   2%|▏         | 2/117 [00:00<00:54,  2.12it/s, loss=0.691, v_num=1, val_acc=0.754]
Epoch 74:   2%|▏         | 2/117 [00:00<00:55,  2.06it/s, loss=0.681, v_num=1, val_acc=0.754]
Epoch 74:   3%|▎         | 3/117 [00:00<00:37,  3.07it/s, loss=0.681, v_num=1, val_acc=0.754]
Epoch 74:   3%|▎         | 3/117 [00:01<00:38,  2.99it/s, loss=0.678, v_num=1, val_acc=0.754]
Epoch 74:   3%|▎         | 4/117 [00:01<00:28,  3.95it/s, loss=0.678, v_num=1, val_acc=0.754]
Epoch 74:   3%|▎         | 4/117 [00:01<00:29,  3.86it/s, loss=0.683, v_num=1, val_acc=0.754]
Epoch 74:   4%|▍         | 5/117 [00:01<00:23,  4.78it/s, loss=0.683, v_num=1, val_acc=0.754]
Epoch 74:   4%|▍         | 5/117 [00:01<00:23,  4.67it/s, loss=0.683, v_num=1, val_acc=0.754]
Epoch 74:   5%|▌         | 6/117 [00:01<00:19,  5.56it/s, loss=0.683, v_num=1, val_acc=0.754]
Epoch 74:   5%|▌         | 6/117 [00:01<00:20,  5.43it/s, loss=0.687, v_num=1, val_acc=0.754]
Epoch 74:   6%|▌         | 7/117 [00:01<00:17,  6.29it/s, loss=0.687, v_num=1, val_acc=0.754]
Epoch 74:   6%|▌         | 7/117 [00:01<00:17,  6.15it/s, loss=0.688, v_num=1, val_acc=0.754]
Epoch 74:   7%|▋         | 8/117 [00:01<00:15,  6.98it/s, loss=0.688, v_num=1, val_acc=0.754]
Epoch 74:   7%|▋         | 8/117 [00:01<00:15,  6.83it/s, loss=0.682, v_num=1, val_acc=0.754]
Epoch 74:   8%|▊         | 9/117 [00:01<00:14,  7.58it/s, loss=0.682, v_num=1, val_acc=0.754]
Epoch 74:   8%|▊         | 9/117 [00:01<00:14,  7.43it/s, loss=0.681, v_num=1, val_acc=0.754]
Epoch 74:   9%|▊         | 10/117 [00:01<00:13,  8.20it/s, loss=0.681, v_num=1, val_acc=0.754]
Epoch 74:   9%|▊         | 10/117 [00:01<00:13,  8.04it/s, loss=0.682, v_num=1, val_acc=0.754]
Epoch 74:   9%|▉         | 11/117 [00:01<00:12,  8.78it/s, loss=0.682, v_num=1, val_acc=0.754]
Epoch 74:   9%|▉         | 11/117 [00:01<00:12,  8.61it/s, loss=0.687, v_num=1, val_acc=0.754]
Epoch 74:  10%|█         | 12/117 [00:01<00:11,  9.30it/s, loss=0.687, v_num=1, val_acc=0.754]
Epoch 74:  10%|█         | 12/117 [00:01<00:11,  9.12it/s, loss=0.687, v_num=1, val_acc=0.754]
Epoch 74:  11%|█         | 13/117 [00:01<00:10,  9.82it/s, loss=0.687, v_num=1, val_acc=0.754]
Epoch 74:  11%|█         | 13/117 [00:01<00:10,  9.63it/s, loss=0.691, v_num=1, val_acc=0.754]
Epoch 74:  12%|█▏        | 14/117 [00:01<00:09, 10.31it/s, loss=0.691, v_num=1, val_acc=0.754]
Epoch 74:  12%|█▏        | 14/117 [00:01<00:10, 10.12it/s, loss=0.694, v_num=1, val_acc=0.754]
Epoch 74:  13%|█▎        | 15/117 [00:01<00:09, 10.78it/s, loss=0.694, v_num=1, val_acc=0.754]
Epoch 74:  13%|█▎        | 15/117 [00:01<00:09, 10.59it/s, loss=0.695, v_num=1, val_acc=0.754]
Epoch 74:  14%|█▎        | 16/117 [00:01<00:08, 11.23it/s, loss=0.695, v_num=1, val_acc=0.754]
Epoch 74:  14%|█▎        | 16/117 [00:01<00:09, 11.03it/s, loss=0.696, v_num=1, val_acc=0.754]
Epoch 74:  15%|█▍        | 17/117 [00:01<00:08, 11.61it/s, loss=0.696, v_num=1, val_acc=0.754]
Epoch 74:  15%|█▍        | 17/117 [00:01<00:08, 11.42it/s, loss=0.695, v_num=1, val_acc=0.754]
Epoch 74:  15%|█▌        | 18/117 [00:01<00:08, 12.02it/s, loss=0.695, v_num=1, val_acc=0.754]
Epoch 74:  15%|█▌        | 18/117 [00:01<00:08, 11.82it/s, loss=0.696, v_num=1, val_acc=0.754]
Epoch 74:  16%|█▌        | 19/117 [00:01<00:07, 12.41it/s, loss=0.696, v_num=1, val_acc=0.754]
Epoch 74:  16%|█▌        | 19/117 [00:01<00:08, 12.21it/s, loss=0.696, v_num=1, val_acc=0.754]
Epoch 74:  17%|█▋        | 20/117 [00:01<00:07, 12.78it/s, loss=0.696, v_num=1, val_acc=0.754]
Epoch 74:  17%|█▋        | 20/117 [00:01<00:07, 12.57it/s, loss=0.697, v_num=1, val_acc=0.754]
Epoch 74:  18%|█▊        | 21/117 [00:01<00:07, 13.13it/s, loss=0.697, v_num=1, val_acc=0.754]
Epoch 74:  18%|█▊        | 21/117 [00:01<00:07, 12.93it/s, loss=0.696, v_num=1, val_acc=0.754]
Epoch 74:  19%|█▉        | 22/117 [00:01<00:07, 13.47it/s, loss=0.696, v_num=1, val_acc=0.754]
Epoch 74:  19%|█▉        | 22/117 [00:01<00:07, 13.26it/s, loss=0.703, v_num=1, val_acc=0.754]
Epoch 74:  20%|█▉        | 23/117 [00:01<00:06, 13.78it/s, loss=0.703, v_num=1, val_acc=0.754]
Epoch 74:  20%|█▉        | 23/117 [00:01<00:06, 13.57it/s, loss=0.703, v_num=1, val_acc=0.754]
Epoch 74:  21%|██        | 24/117 [00:01<00:06, 14.09it/s, loss=0.703, v_num=1, val_acc=0.754]
Epoch 74:  21%|██        | 24/117 [00:01<00:06, 13.88it/s, loss=0.695, v_num=1, val_acc=0.754]
Epoch 74:  21%|██▏       | 25/117 [00:01<00:06, 14.37it/s, loss=0.695, v_num=1, val_acc=0.754]
Epoch 74:  21%|██▏       | 25/117 [00:01<00:06, 14.16it/s, loss=0.699, v_num=1, val_acc=0.754]
Epoch 74:  22%|██▏       | 26/117 [00:01<00:06, 14.66it/s, loss=0.699, v_num=1, val_acc=0.754]
Epoch 74:  22%|██▏       | 26/117 [00:01<00:06, 14.45it/s, loss=0.7, v_num=1, val_acc=0.754]
Epoch 74:  23%|██▎       | 27/117 [00:01<00:06, 14.94it/s, loss=0.7, v_num=1, val_acc=0.754]
Epoch 74:  23%|██▎       | 27/117 [00:01<00:06, 14.73it/s, loss=0.709, v_num=1, val_acc=0.754]
Epoch 74:  24%|██▍       | 28/117 [00:01<00:05, 15.21it/s, loss=0.709, v_num=1, val_acc=0.754]
Epoch 74:  24%|██▍       | 28/117 [00:01<00:05, 15.00it/s, loss=0.706, v_num=1, val_acc=0.754]
Epoch 74:  25%|██▍       | 29/117 [00:01<00:05, 15.46it/s, loss=0.706, v_num=1, val_acc=0.754]
Epoch 74:  25%|██▍       | 29/117 [00:01<00:05, 15.25it/s, loss=0.701, v_num=1, val_acc=0.754]
Epoch 74:  26%|██▌       | 30/117 [00:01<00:05, 15.71it/s, loss=0.701, v_num=1, val_acc=0.754]
Epoch 74:  26%|██▌       | 30/117 [00:01<00:05, 15.50it/s, loss=0.707, v_num=1, val_acc=0.754]
Epoch 74:  26%|██▋       | 31/117 [00:01<00:05, 15.94it/s, loss=0.707, v_num=1, val_acc=0.754]
Epoch 74:  26%|██▋       | 31/117 [00:01<00:05, 15.74it/s, loss=0.706, v_num=1, val_acc=0.754]
Epoch 74:  27%|██▋       | 32/117 [00:01<00:05, 16.17it/s, loss=0.706, v_num=1, val_acc=0.754]
Epoch 74:  27%|██▋       | 32/117 [00:02<00:05, 15.96it/s, loss=0.703, v_num=1, val_acc=0.754]
Epoch 74:  28%|██▊       | 33/117 [00:02<00:05, 16.38it/s, loss=0.703, v_num=1, val_acc=0.754]
Epoch 74:  28%|██▊       | 33/117 [00:02<00:05, 16.18it/s, loss=0.703, v_num=1, val_acc=0.754]
Epoch 74:  29%|██▉       | 34/117 [00:02<00:05, 16.60it/s, loss=0.703, v_num=1, val_acc=0.754]
Epoch 74:  29%|██▉       | 34/117 [00:02<00:05, 16.39it/s, loss=0.703, v_num=1, val_acc=0.754]
Epoch 74:  30%|██▉       | 35/117 [00:02<00:04, 16.81it/s, loss=0.703, v_num=1, val_acc=0.754]
Epoch 74:  30%|██▉       | 35/117 [00:02<00:04, 16.60it/s, loss=0.696, v_num=1, val_acc=0.754]
Epoch 74:  31%|███       | 36/117 [00:02<00:04, 17.01it/s, loss=0.696, v_num=1, val_acc=0.754]
Epoch 74:  31%|███       | 36/117 [00:02<00:04, 16.80it/s, loss=0.697, v_num=1, val_acc=0.754]
Epoch 74:  32%|███▏      | 37/117 [00:02<00:04, 17.20it/s, loss=0.697, v_num=1, val_acc=0.754]
Epoch 74:  32%|███▏      | 37/117 [00:02<00:04, 17.00it/s, loss=0.696, v_num=1, val_acc=0.754]
Epoch 74:  32%|███▏      | 38/117 [00:02<00:04, 17.39it/s, loss=0.696, v_num=1, val_acc=0.754]
Epoch 74:  32%|███▏      | 38/117 [00:02<00:04, 17.19it/s, loss=0.692, v_num=1, val_acc=0.754]
Epoch 74:  33%|███▎      | 39/117 [00:02<00:04, 17.57it/s, loss=0.692, v_num=1, val_acc=0.754]
Epoch 74:  33%|███▎      | 39/117 [00:02<00:04, 17.37it/s, loss=0.692, v_num=1, val_acc=0.754]
Epoch 74:  34%|███▍      | 40/117 [00:02<00:04, 17.74it/s, loss=0.692, v_num=1, val_acc=0.754]
Epoch 74:  34%|███▍      | 40/117 [00:02<00:04, 17.54it/s, loss=0.695, v_num=1, val_acc=0.754]
Epoch 74:  35%|███▌      | 41/117 [00:02<00:04, 17.91it/s, loss=0.695, v_num=1, val_acc=0.754]
Epoch 74:  35%|███▌      | 41/117 [00:02<00:04, 17.71it/s, loss=0.695, v_num=1, val_acc=0.754]
Epoch 74:  36%|███▌      | 42/117 [00:02<00:04, 18.08it/s, loss=0.695, v_num=1, val_acc=0.754]
Epoch 74:  36%|███▌      | 42/117 [00:02<00:04, 17.88it/s, loss=0.696, v_num=1, val_acc=0.754]
Epoch 74:  37%|███▋      | 43/117 [00:02<00:04, 18.23it/s, loss=0.696, v_num=1, val_acc=0.754]
Epoch 74:  37%|███▋      | 43/117 [00:02<00:04, 18.04it/s, loss=0.699, v_num=1, val_acc=0.754]
Epoch 74:  38%|███▊      | 44/117 [00:02<00:03, 18.38it/s, loss=0.699, v_num=1, val_acc=0.754]
Epoch 74:  38%|███▊      | 44/117 [00:02<00:04, 18.19it/s, loss=0.702, v_num=1, val_acc=0.754]
Epoch 74:  38%|███▊      | 45/117 [00:02<00:03, 18.53it/s, loss=0.702, v_num=1, val_acc=0.754]
Epoch 74:  38%|███▊      | 45/117 [00:02<00:03, 18.34it/s, loss=0.702, v_num=1, val_acc=0.754]
Epoch 74:  39%|███▉      | 46/117 [00:02<00:03, 18.68it/s, loss=0.702, v_num=1, val_acc=0.754]
Epoch 74:  39%|███▉      | 46/117 [00:02<00:03, 18.49it/s, loss=0.698, v_num=1, val_acc=0.754]
Epoch 74:  40%|████      | 47/117 [00:02<00:03, 18.82it/s, loss=0.698, v_num=1, val_acc=0.754]
Epoch 74:  40%|████      | 47/117 [00:02<00:03, 18.63it/s, loss=0.693, v_num=1, val_acc=0.754]
Epoch 74:  41%|████      | 48/117 [00:02<00:03, 18.96it/s, loss=0.693, v_num=1, val_acc=0.754]
Epoch 74:  41%|████      | 48/117 [00:02<00:03, 18.77it/s, loss=0.694, v_num=1, val_acc=0.754]
Epoch 74:  42%|████▏     | 49/117 [00:02<00:03, 19.10it/s, loss=0.694, v_num=1, val_acc=0.754]
Epoch 74:  42%|████▏     | 49/117 [00:02<00:03, 18.91it/s, loss=0.69, v_num=1, val_acc=0.754]
Epoch 74:  43%|████▎     | 50/117 [00:02<00:03, 19.23it/s, loss=0.69, v_num=1, val_acc=0.754]
Epoch 74:  43%|████▎     | 50/117 [00:02<00:03, 19.04it/s, loss=0.689, v_num=1, val_acc=0.754]
Epoch 74:  44%|████▎     | 51/117 [00:02<00:03, 19.36it/s, loss=0.689, v_num=1, val_acc=0.754]
Epoch 74:  44%|████▎     | 51/117 [00:02<00:03, 19.17it/s, loss=0.696, v_num=1, val_acc=0.754]
Epoch 74:  44%|████▍     | 52/117 [00:02<00:03, 19.48it/s, loss=0.696, v_num=1, val_acc=0.754]
Epoch 74:  44%|████▍     | 52/117 [00:02<00:03, 19.30it/s, loss=0.694, v_num=1, val_acc=0.754]
Epoch 74:  45%|████▌     | 53/117 [00:02<00:03, 19.60it/s, loss=0.694, v_num=1, val_acc=0.754]
Epoch 74:  45%|████▌     | 53/117 [00:02<00:03, 19.42it/s, loss=0.691, v_num=1, val_acc=0.754]
Epoch 74:  46%|████▌     | 54/117 [00:02<00:03, 19.68it/s, loss=0.691, v_num=1, val_acc=0.754]
Epoch 74:  46%|████▌     | 54/117 [00:02<00:03, 19.52it/s, loss=0.688, v_num=1, val_acc=0.754]
Epoch 74:  47%|████▋     | 55/117 [00:02<00:03, 19.81it/s, loss=0.688, v_num=1, val_acc=0.754]
Epoch 74:  47%|████▋     | 55/117 [00:02<00:03, 19.63it/s, loss=0.691, v_num=1, val_acc=0.754]
Epoch 74:  48%|████▊     | 56/117 [00:02<00:03, 19.92it/s, loss=0.691, v_num=1, val_acc=0.754]
Epoch 74:  48%|████▊     | 56/117 [00:02<00:03, 19.75it/s, loss=0.686, v_num=1, val_acc=0.754]
Epoch 74:  49%|████▊     | 57/117 [00:02<00:02, 20.03it/s, loss=0.686, v_num=1, val_acc=0.754]
Epoch 74:  49%|████▊     | 57/117 [00:02<00:03, 19.86it/s, loss=0.684, v_num=1, val_acc=0.754]
Epoch 74:  50%|████▉     | 58/117 [00:02<00:02, 20.14it/s, loss=0.684, v_num=1, val_acc=0.754]
Epoch 74:  50%|████▉     | 58/117 [00:02<00:02, 19.97it/s, loss=0.685, v_num=1, val_acc=0.754]
Epoch 74:  50%|█████     | 59/117 [00:02<00:02, 20.25it/s, loss=0.685, v_num=1, val_acc=0.754]
Epoch 74:  50%|█████     | 59/117 [00:02<00:02, 20.07it/s, loss=0.69, v_num=1, val_acc=0.754]
Epoch 74:  51%|█████▏    | 60/117 [00:02<00:02, 20.35it/s, loss=0.69, v_num=1, val_acc=0.754]
Epoch 74:  51%|█████▏    | 60/117 [00:02<00:02, 20.18it/s, loss=0.686, v_num=1, val_acc=0.754]
Epoch 74:  52%|█████▏    | 61/117 [00:02<00:02, 20.45it/s, loss=0.686, v_num=1, val_acc=0.754]
Epoch 74:  52%|█████▏    | 61/117 [00:03<00:02, 20.28it/s, loss=0.689, v_num=1, val_acc=0.754]
Epoch 74:  53%|█████▎    | 62/117 [00:03<00:02, 20.55it/s, loss=0.689, v_num=1, val_acc=0.754]
Epoch 74:  53%|█████▎    | 62/117 [00:03<00:02, 20.37it/s, loss=0.688, v_num=1, val_acc=0.754]
Epoch 74:  54%|█████▍    | 63/117 [00:03<00:02, 20.64it/s, loss=0.688, v_num=1, val_acc=0.754]
Epoch 74:  54%|█████▍    | 63/117 [00:03<00:02, 20.47it/s, loss=0.691, v_num=1, val_acc=0.754]
Epoch 74:  55%|█████▍    | 64/117 [00:03<00:02, 20.74it/s, loss=0.691, v_num=1, val_acc=0.754]
Epoch 74:  55%|█████▍    | 64/117 [00:03<00:02, 20.57it/s, loss=0.689, v_num=1, val_acc=0.754]
Epoch 74:  56%|█████▌    | 65/117 [00:03<00:02, 20.83it/s, loss=0.689, v_num=1, val_acc=0.754]
Epoch 74:  56%|█████▌    | 65/117 [00:03<00:02, 20.66it/s, loss=0.691, v_num=1, val_acc=0.754]
Epoch 74:  56%|█████▋    | 66/117 [00:03<00:02, 20.91it/s, loss=0.691, v_num=1, val_acc=0.754]
Epoch 74:  56%|█████▋    | 66/117 [00:03<00:02, 20.75it/s, loss=0.699, v_num=1, val_acc=0.754]
Epoch 74:  57%|█████▋    | 67/117 [00:03<00:02, 21.00it/s, loss=0.699, v_num=1, val_acc=0.754]
Epoch 74:  57%|█████▋    | 67/117 [00:03<00:02, 20.84it/s, loss=0.701, v_num=1, val_acc=0.754]
Epoch 74:  58%|█████▊    | 68/117 [00:03<00:02, 21.09it/s, loss=0.701, v_num=1, val_acc=0.754]
Epoch 74:  58%|█████▊    | 68/117 [00:03<00:02, 20.92it/s, loss=0.702, v_num=1, val_acc=0.754]
Epoch 74:  59%|█████▉    | 69/117 [00:03<00:02, 21.17it/s, loss=0.702, v_num=1, val_acc=0.754]
Epoch 74:  59%|█████▉    | 69/117 [00:03<00:02, 21.01it/s, loss=0.71, v_num=1, val_acc=0.754]
Epoch 74:  60%|█████▉    | 70/117 [00:03<00:02, 21.25it/s, loss=0.71, v_num=1, val_acc=0.754]
Epoch 74:  60%|█████▉    | 70/117 [00:03<00:02, 21.09it/s, loss=0.706, v_num=1, val_acc=0.754]
Epoch 74:  61%|██████    | 71/117 [00:03<00:02, 21.33it/s, loss=0.706, v_num=1, val_acc=0.754]
Epoch 74:  61%|██████    | 71/117 [00:03<00:02, 21.17it/s, loss=0.706, v_num=1, val_acc=0.754]
Epoch 74:  62%|██████▏   | 72/117 [00:03<00:02, 21.41it/s, loss=0.706, v_num=1, val_acc=0.754]
Epoch 74:  62%|██████▏   | 72/117 [00:03<00:02, 21.25it/s, loss=0.712, v_num=1, val_acc=0.754]
Epoch 74:  62%|██████▏   | 73/117 [00:03<00:02, 21.49it/s, loss=0.712, v_num=1, val_acc=0.754]
Epoch 74:  62%|██████▏   | 73/117 [00:03<00:02, 21.33it/s, loss=0.713, v_num=1, val_acc=0.754]
Epoch 74:  63%|██████▎   | 74/117 [00:03<00:01, 21.56it/s, loss=0.713, v_num=1, val_acc=0.754]
Epoch 74:  63%|██████▎   | 74/117 [00:03<00:02, 21.40it/s, loss=0.718, v_num=1, val_acc=0.754]
Epoch 74:  64%|██████▍   | 75/117 [00:03<00:01, 21.63it/s, loss=0.718, v_num=1, val_acc=0.754]
Epoch 74:  64%|██████▍   | 75/117 [00:03<00:01, 21.48it/s, loss=0.718, v_num=1, val_acc=0.754]
Epoch 74:  65%|██████▍   | 76/117 [00:03<00:01, 21.71it/s, loss=0.718, v_num=1, val_acc=0.754]
Epoch 74:  65%|██████▍   | 76/117 [00:03<00:01, 21.55it/s, loss=0.723, v_num=1, val_acc=0.754]
Epoch 74:  66%|██████▌   | 77/117 [00:03<00:01, 21.78it/s, loss=0.723, v_num=1, val_acc=0.754]
Epoch 74:  66%|██████▌   | 77/117 [00:03<00:01, 21.62it/s, loss=0.723, v_num=1, val_acc=0.754]
Epoch 74:  67%|██████▋   | 78/117 [00:03<00:01, 21.85it/s, loss=0.723, v_num=1, val_acc=0.754]
Epoch 74:  67%|██████▋   | 78/117 [00:03<00:01, 21.69it/s, loss=0.719, v_num=1, val_acc=0.754]
Epoch 74:  68%|██████▊   | 79/117 [00:03<00:01, 21.91it/s, loss=0.719, v_num=1, val_acc=0.754]
Epoch 74:  68%|██████▊   | 79/117 [00:03<00:01, 21.76it/s, loss=0.721, v_num=1, val_acc=0.754]
Epoch 74:  68%|██████▊   | 80/117 [00:03<00:01, 21.98it/s, loss=0.721, v_num=1, val_acc=0.754]
Epoch 74:  68%|██████▊   | 80/117 [00:03<00:01, 21.83it/s, loss=0.722, v_num=1, val_acc=0.754]
Epoch 74:  69%|██████▉   | 81/117 [00:03<00:01, 22.04it/s, loss=0.722, v_num=1, val_acc=0.754]
Epoch 74:  69%|██████▉   | 81/117 [00:03<00:01, 21.89it/s, loss=0.719, v_num=1, val_acc=0.754]
Epoch 74:  70%|███████   | 82/117 [00:03<00:01, 22.09it/s, loss=0.719, v_num=1, val_acc=0.754]
Epoch 74:  70%|███████   | 82/117 [00:03<00:01, 21.94it/s, loss=0.718, v_num=1, val_acc=0.754]
Epoch 74:  71%|███████   | 83/117 [00:03<00:01, 22.15it/s, loss=0.718, v_num=1, val_acc=0.754]
Epoch 74:  71%|███████   | 83/117 [00:03<00:01, 22.00it/s, loss=0.718, v_num=1, val_acc=0.754]
Epoch 74:  72%|███████▏  | 84/117 [00:03<00:01, 22.22it/s, loss=0.718, v_num=1, val_acc=0.754]
Epoch 74:  72%|███████▏  | 84/117 [00:03<00:01, 22.07it/s, loss=0.721, v_num=1, val_acc=0.754]
Epoch 74:  73%|███████▎  | 85/117 [00:03<00:01, 22.28it/s, loss=0.721, v_num=1, val_acc=0.754]
Epoch 74:  73%|███████▎  | 85/117 [00:03<00:01, 22.13it/s, loss=0.722, v_num=1, val_acc=0.754]
Epoch 74:  74%|███████▎  | 86/117 [00:03<00:01, 22.34it/s, loss=0.722, v_num=1, val_acc=0.754]
Epoch 74:  74%|███████▎  | 86/117 [00:03<00:01, 22.19it/s, loss=0.714, v_num=1, val_acc=0.754]
Epoch 74:  74%|███████▍  | 87/117 [00:03<00:01, 22.40it/s, loss=0.714, v_num=1, val_acc=0.754]
Epoch 74:  74%|███████▍  | 87/117 [00:03<00:01, 22.25it/s, loss=0.71, v_num=1, val_acc=0.754]
Epoch 74:  75%|███████▌  | 88/117 [00:03<00:01, 22.46it/s, loss=0.71, v_num=1, val_acc=0.754]
Epoch 74:  75%|███████▌  | 88/117 [00:03<00:01, 22.31it/s, loss=0.714, v_num=1, val_acc=0.754]
Epoch 74:  76%|███████▌  | 89/117 [00:03<00:01, 22.52it/s, loss=0.714, v_num=1, val_acc=0.754]
Epoch 74:  76%|███████▌  | 89/117 [00:03<00:01, 22.37it/s, loss=0.712, v_num=1, val_acc=0.754]
Epoch 74:  77%|███████▋  | 90/117 [00:03<00:01, 22.57it/s, loss=0.712, v_num=1, val_acc=0.754]
Epoch 74:  77%|███████▋  | 90/117 [00:04<00:01, 22.43it/s, loss=0.708, v_num=1, val_acc=0.754]
Epoch 74:  78%|███████▊  | 91/117 [00:04<00:01, 22.63it/s, loss=0.708, v_num=1, val_acc=0.754]
Epoch 74:  78%|███████▊  | 91/117 [00:04<00:01, 22.49it/s, loss=0.703, v_num=1, val_acc=0.754]
Epoch 74:  79%|███████▊  | 92/117 [00:04<00:01, 22.68it/s, loss=0.703, v_num=1, val_acc=0.754]
Epoch 74:  79%|███████▊  | 92/117 [00:04<00:01, 22.54it/s, loss=0.699, v_num=1, val_acc=0.754]
Epoch 74:  79%|███████▉  | 93/117 [00:04<00:01, 22.74it/s, loss=0.699, v_num=1, val_acc=0.754]
Epoch 74:  79%|███████▉  | 93/117 [00:04<00:01, 22.59it/s, loss=0.699, v_num=1, val_acc=0.754]
Epoch 74:  80%|████████  | 94/117 [00:04<00:01, 22.79it/s, loss=0.699, v_num=1, val_acc=0.754]
Epoch 74:  80%|████████  | 94/117 [00:04<00:01, 22.65it/s, loss=0.695, v_num=1, val_acc=0.754]
Epoch 74:  81%|████████  | 95/117 [00:04<00:00, 22.83it/s, loss=0.695, v_num=1, val_acc=0.754]
Epoch 74:  81%|████████  | 95/117 [00:04<00:00, 22.70it/s, loss=0.698, v_num=1, val_acc=0.754]
Epoch 74:  82%|████████▏ | 96/117 [00:04<00:00, 22.89it/s, loss=0.698, v_num=1, val_acc=0.754]
Epoch 74:  82%|████████▏ | 96/117 [00:04<00:00, 22.75it/s, loss=0.695, v_num=1, val_acc=0.754]
Epoch 74:  83%|████████▎ | 97/117 [00:04<00:00, 22.94it/s, loss=0.695, v_num=1, val_acc=0.754]
Epoch 74:  83%|████████▎ | 97/117 [00:04<00:00, 22.80it/s, loss=0.697, v_num=1, val_acc=0.754]

Validation: 0it [00:00, ?it/s]

Validation:   0%|          | 0/20 [00:00<?, ?it/s]

Validation DataLoader 0:   0%|          | 0/20 [00:00<?, ?it/s]

Validation DataLoader 0:   5%|▌         | 1/20 [00:00<00:00, 186.80it/s]
Epoch 74:  84%|████████▍ | 98/117 [00:05<00:00, 19.25it/s, loss=0.697, v_num=1, val_acc=0.754]

Validation DataLoader 0:  10%|█         | 2/20 [00:00<00:00, 56.47it/s]
Epoch 74:  85%|████████▍ | 99/117 [00:05<00:00, 19.33it/s, loss=0.697, v_num=1, val_acc=0.754]

Validation DataLoader 0:  15%|█▌        | 3/20 [00:00<00:00, 44.53it/s]
Epoch 74:  85%|████████▌ | 100/117 [00:05<00:00, 19.40it/s, loss=0.697, v_num=1, val_acc=0.754]

Validation DataLoader 0:  20%|██        | 4/20 [00:00<00:00, 40.50it/s]
Epoch 74:  86%|████████▋ | 101/117 [00:05<00:00, 19.48it/s, loss=0.697, v_num=1, val_acc=0.754]

Validation DataLoader 0:  25%|██▌       | 5/20 [00:00<00:00, 38.29it/s]
Epoch 74:  87%|████████▋ | 102/117 [00:05<00:00, 19.55it/s, loss=0.697, v_num=1, val_acc=0.754]

Validation DataLoader 0:  30%|███       | 6/20 [00:00<00:00, 36.99it/s]
Epoch 74:  88%|████████▊ | 103/117 [00:05<00:00, 19.62it/s, loss=0.697, v_num=1, val_acc=0.754]

Validation DataLoader 0:  35%|███▌      | 7/20 [00:00<00:00, 36.14it/s]
Epoch 74:  89%|████████▉ | 104/117 [00:05<00:00, 19.70it/s, loss=0.697, v_num=1, val_acc=0.754]

Validation DataLoader 0:  40%|████      | 8/20 [00:00<00:00, 35.49it/s]
Epoch 74:  90%|████████▉ | 105/117 [00:05<00:00, 19.77it/s, loss=0.697, v_num=1, val_acc=0.754]

Validation DataLoader 0:  45%|████▌     | 9/20 [00:00<00:00, 34.98it/s]
Epoch 74:  91%|█████████ | 106/117 [00:05<00:00, 19.84it/s, loss=0.697, v_num=1, val_acc=0.754]

Validation DataLoader 0:  50%|█████     | 10/20 [00:00<00:00, 34.65it/s]
Epoch 74:  91%|█████████▏| 107/117 [00:05<00:00, 19.91it/s, loss=0.697, v_num=1, val_acc=0.754]

Validation DataLoader 0:  55%|█████▌    | 11/20 [00:00<00:00, 34.36it/s]
Epoch 74:  92%|█████████▏| 108/117 [00:05<00:00, 19.98it/s, loss=0.697, v_num=1, val_acc=0.754]

Validation DataLoader 0:  60%|██████    | 12/20 [00:00<00:00, 34.11it/s]
Epoch 74:  93%|█████████▎| 109/117 [00:05<00:00, 20.04it/s, loss=0.697, v_num=1, val_acc=0.754]

Validation DataLoader 0:  65%|██████▌   | 13/20 [00:00<00:00, 33.92it/s]
Epoch 74:  94%|█████████▍| 110/117 [00:05<00:00, 20.11it/s, loss=0.697, v_num=1, val_acc=0.754]

Validation DataLoader 0:  70%|███████   | 14/20 [00:00<00:00, 33.74it/s]
Epoch 74:  95%|█████████▍| 111/117 [00:05<00:00, 20.18it/s, loss=0.697, v_num=1, val_acc=0.754]

Validation DataLoader 0:  75%|███████▌  | 15/20 [00:00<00:00, 33.59it/s]
Epoch 74:  96%|█████████▌| 112/117 [00:05<00:00, 20.24it/s, loss=0.697, v_num=1, val_acc=0.754]

Validation DataLoader 0:  80%|████████  | 16/20 [00:00<00:00, 33.46it/s]
Epoch 74:  97%|█████████▋| 113/117 [00:05<00:00, 20.31it/s, loss=0.697, v_num=1, val_acc=0.754]

Validation DataLoader 0:  85%|████████▌ | 17/20 [00:00<00:00, 33.32it/s]
Epoch 74:  97%|█████████▋| 114/117 [00:05<00:00, 20.37it/s, loss=0.697, v_num=1, val_acc=0.754]

Validation DataLoader 0:  90%|█████████ | 18/20 [00:00<00:00, 33.23it/s]
Epoch 74:  98%|█████████▊| 115/117 [00:05<00:00, 20.43it/s, loss=0.697, v_num=1, val_acc=0.754]

Validation DataLoader 0:  95%|█████████▌| 19/20 [00:00<00:00, 33.14it/s]
Epoch 74:  99%|█████████▉| 116/117 [00:05<00:00, 20.49it/s, loss=0.697, v_num=1, val_acc=0.754]

Validation DataLoader 0: 100%|██████████| 20/20 [00:00<00:00, 33.13it/s]
Epoch 74: 100%|██████████| 117/117 [00:05<00:00, 20.56it/s, loss=0.697, v_num=1, val_acc=0.754]
Epoch 74: 100%|██████████| 117/117 [00:05<00:00, 20.49it/s, loss=0.697, v_num=1, val_acc=0.757]


Epoch 74: 100%|██████████| 117/117 [00:05<00:00, 20.48it/s, loss=0.697, v_num=1, val_acc=0.757]
Epoch 74:   0%|          | 0/117 [00:00<?, ?it/s, loss=0.697, v_num=1, val_acc=0.757]
Epoch 75:   0%|          | 0/117 [00:00<?, ?it/s, loss=0.697, v_num=1, val_acc=0.757]
Epoch 75:   1%|          | 1/117 [00:00<01:49,  1.06it/s, loss=0.697, v_num=1, val_acc=0.757]
Epoch 75:   1%|          | 1/117 [00:00<01:51,  1.04it/s, loss=0.702, v_num=1, val_acc=0.757]
Epoch 75:   2%|▏         | 2/117 [00:00<00:55,  2.05it/s, loss=0.702, v_num=1, val_acc=0.757]
Epoch 75:   2%|▏         | 2/117 [00:00<00:57,  2.00it/s, loss=0.696, v_num=1, val_acc=0.757]
Epoch 75:   3%|▎         | 3/117 [00:01<00:38,  2.98it/s, loss=0.696, v_num=1, val_acc=0.757]
Epoch 75:   3%|▎         | 3/117 [00:01<00:39,  2.91it/s, loss=0.693, v_num=1, val_acc=0.757]
Epoch 75:   3%|▎         | 4/117 [00:01<00:29,  3.84it/s, loss=0.693, v_num=1, val_acc=0.757]
Epoch 75:   3%|▎         | 4/117 [00:01<00:30,  3.75it/s, loss=0.694, v_num=1, val_acc=0.757]
Epoch 75:   4%|▍         | 5/117 [00:01<00:24,  4.65it/s, loss=0.694, v_num=1, val_acc=0.757]
Epoch 75:   4%|▍         | 5/117 [00:01<00:24,  4.54it/s, loss=0.694, v_num=1, val_acc=0.757]
Epoch 75:   5%|▌         | 6/117 [00:01<00:20,  5.41it/s, loss=0.694, v_num=1, val_acc=0.757]
Epoch 75:   5%|▌         | 6/117 [00:01<00:20,  5.29it/s, loss=0.692, v_num=1, val_acc=0.757]
Epoch 75:   6%|▌         | 7/117 [00:01<00:17,  6.12it/s, loss=0.692, v_num=1, val_acc=0.757]
Epoch 75:   6%|▌         | 7/117 [00:01<00:18,  5.99it/s, loss=0.689, v_num=1, val_acc=0.757]
Epoch 75:   7%|▋         | 8/117 [00:01<00:16,  6.80it/s, loss=0.689, v_num=1, val_acc=0.757]
Epoch 75:   7%|▋         | 8/117 [00:01<00:16,  6.65it/s, loss=0.689, v_num=1, val_acc=0.757]
Epoch 75:   8%|▊         | 9/117 [00:01<00:14,  7.36it/s, loss=0.689, v_num=1, val_acc=0.757]
Epoch 75:   8%|▊         | 9/117 [00:01<00:14,  7.22it/s, loss=0.69, v_num=1, val_acc=0.757]
Epoch 75:   9%|▊         | 10/117 [00:01<00:13,  7.97it/s, loss=0.69, v_num=1, val_acc=0.757]
Epoch 75:   9%|▊         | 10/117 [00:01<00:13,  7.82it/s, loss=0.694, v_num=1, val_acc=0.757]
Epoch 75:   9%|▉         | 11/117 [00:01<00:12,  8.54it/s, loss=0.694, v_num=1, val_acc=0.757]
Epoch 75:   9%|▉         | 11/117 [00:01<00:12,  8.38it/s, loss=0.696, v_num=1, val_acc=0.757]
Epoch 75:  10%|█         | 12/117 [00:01<00:11,  9.07it/s, loss=0.696, v_num=1, val_acc=0.757]
Epoch 75:  10%|█         | 12/117 [00:01<00:11,  8.90it/s, loss=0.695, v_num=1, val_acc=0.757]
Epoch 75:  11%|█         | 13/117 [00:01<00:10,  9.59it/s, loss=0.695, v_num=1, val_acc=0.757]
Epoch 75:  11%|█         | 13/117 [00:01<00:11,  9.41it/s, loss=0.696, v_num=1, val_acc=0.757]
Epoch 75:  12%|█▏        | 14/117 [00:01<00:10, 10.07it/s, loss=0.696, v_num=1, val_acc=0.757]
Epoch 75:  12%|█▏        | 14/117 [00:01<00:10,  9.89it/s, loss=0.698, v_num=1, val_acc=0.757]
Epoch 75:  13%|█▎        | 15/117 [00:01<00:09, 10.54it/s, loss=0.698, v_num=1, val_acc=0.757]
Epoch 75:  13%|█▎        | 15/117 [00:01<00:09, 10.35it/s, loss=0.706, v_num=1, val_acc=0.757]
Epoch 75:  14%|█▎        | 16/117 [00:01<00:09, 10.98it/s, loss=0.706, v_num=1, val_acc=0.757]
Epoch 75:  14%|█▎        | 16/117 [00:01<00:09, 10.79it/s, loss=0.713, v_num=1, val_acc=0.757]
Epoch 75:  15%|█▍        | 17/117 [00:01<00:08, 11.38it/s, loss=0.713, v_num=1, val_acc=0.757]
Epoch 75:  15%|█▍        | 17/117 [00:01<00:08, 11.19it/s, loss=0.712, v_num=1, val_acc=0.757]
Epoch 75:  15%|█▌        | 18/117 [00:01<00:08, 11.78it/s, loss=0.712, v_num=1, val_acc=0.757]
Epoch 75:  15%|█▌        | 18/117 [00:01<00:08, 11.59it/s, loss=0.704, v_num=1, val_acc=0.757]
Epoch 75:  16%|█▌        | 19/117 [00:01<00:08, 12.17it/s, loss=0.704, v_num=1, val_acc=0.757]
Epoch 75:  16%|█▌        | 19/117 [00:01<00:08, 11.97it/s, loss=0.705, v_num=1, val_acc=0.757]
Epoch 75:  17%|█▋        | 20/117 [00:01<00:07, 12.53it/s, loss=0.705, v_num=1, val_acc=0.757]
Epoch 75:  17%|█▋        | 20/117 [00:01<00:07, 12.34it/s, loss=0.698, v_num=1, val_acc=0.757]
Epoch 75:  18%|█▊        | 21/117 [00:01<00:07, 12.89it/s, loss=0.698, v_num=1, val_acc=0.757]
Epoch 75:  18%|█▊        | 21/117 [00:01<00:07, 12.69it/s, loss=0.699, v_num=1, val_acc=0.757]
Epoch 75:  19%|█▉        | 22/117 [00:01<00:07, 13.22it/s, loss=0.699, v_num=1, val_acc=0.757]
Epoch 75:  19%|█▉        | 22/117 [00:01<00:07, 13.02it/s, loss=0.705, v_num=1, val_acc=0.757]
Epoch 75:  20%|█▉        | 23/117 [00:01<00:06, 13.54it/s, loss=0.705, v_num=1, val_acc=0.757]
Epoch 75:  20%|█▉        | 23/117 [00:01<00:07, 13.34it/s, loss=0.704, v_num=1, val_acc=0.757]
Epoch 75:  21%|██        | 24/117 [00:01<00:06, 13.85it/s, loss=0.704, v_num=1, val_acc=0.757]
Epoch 75:  21%|██        | 24/117 [00:01<00:06, 13.65it/s, loss=0.703, v_num=1, val_acc=0.757]
Epoch 75:  21%|██▏       | 25/117 [00:01<00:06, 14.14it/s, loss=0.703, v_num=1, val_acc=0.757]
Epoch 75:  21%|██▏       | 25/117 [00:01<00:06, 13.94it/s, loss=0.706, v_num=1, val_acc=0.757]
Epoch 75:  22%|██▏       | 26/117 [00:01<00:06, 14.42it/s, loss=0.706, v_num=1, val_acc=0.757]
Epoch 75:  22%|██▏       | 26/117 [00:01<00:06, 14.22it/s, loss=0.71, v_num=1, val_acc=0.757]
Epoch 75:  23%|██▎       | 27/117 [00:01<00:06, 14.69it/s, loss=0.71, v_num=1, val_acc=0.757]
Epoch 75:  23%|██▎       | 27/117 [00:01<00:06, 14.49it/s, loss=0.706, v_num=1, val_acc=0.757]
Epoch 75:  24%|██▍       | 28/117 [00:01<00:05, 14.95it/s, loss=0.706, v_num=1, val_acc=0.757]
Epoch 75:  24%|██▍       | 28/117 [00:01<00:06, 14.75it/s, loss=0.703, v_num=1, val_acc=0.757]
Epoch 75:  25%|██▍       | 29/117 [00:01<00:05, 15.20it/s, loss=0.703, v_num=1, val_acc=0.757]
Epoch 75:  25%|██▍       | 29/117 [00:01<00:05, 15.00it/s, loss=0.707, v_num=1, val_acc=0.757]
Epoch 75:  26%|██▌       | 30/117 [00:01<00:05, 15.45it/s, loss=0.707, v_num=1, val_acc=0.757]
Epoch 75:  26%|██▌       | 30/117 [00:01<00:05, 15.25it/s, loss=0.71, v_num=1, val_acc=0.757]
Epoch 75:  26%|██▋       | 31/117 [00:01<00:05, 15.68it/s, loss=0.71, v_num=1, val_acc=0.757]
Epoch 75:  26%|██▋       | 31/117 [00:02<00:05, 15.48it/s, loss=0.707, v_num=1, val_acc=0.757]
Epoch 75:  27%|██▋       | 32/117 [00:02<00:05, 15.91it/s, loss=0.707, v_num=1, val_acc=0.757]
Epoch 75:  27%|██▋       | 32/117 [00:02<00:05, 15.71it/s, loss=0.71, v_num=1, val_acc=0.757]
Epoch 75:  28%|██▊       | 33/117 [00:02<00:05, 16.13it/s, loss=0.71, v_num=1, val_acc=0.757]
Epoch 75:  28%|██▊       | 33/117 [00:02<00:05, 15.93it/s, loss=0.718, v_num=1, val_acc=0.757]
Epoch 75:  29%|██▉       | 34/117 [00:02<00:05, 16.35it/s, loss=0.718, v_num=1, val_acc=0.757]
Epoch 75:  29%|██▉       | 34/117 [00:02<00:05, 16.15it/s, loss=0.718, v_num=1, val_acc=0.757]
Epoch 75:  30%|██▉       | 35/117 [00:02<00:04, 16.55it/s, loss=0.718, v_num=1, val_acc=0.757]
Epoch 75:  30%|██▉       | 35/117 [00:02<00:05, 16.36it/s, loss=0.714, v_num=1, val_acc=0.757]
Epoch 75:  31%|███       | 36/117 [00:02<00:04, 16.75it/s, loss=0.714, v_num=1, val_acc=0.757]
Epoch 75:  31%|███       | 36/117 [00:02<00:04, 16.56it/s, loss=0.708, v_num=1, val_acc=0.757]
Epoch 75:  32%|███▏      | 37/117 [00:02<00:04, 16.94it/s, loss=0.708, v_num=1, val_acc=0.757]
Epoch 75:  32%|███▏      | 37/117 [00:02<00:04, 16.75it/s, loss=0.708, v_num=1, val_acc=0.757]
Epoch 75:  32%|███▏      | 38/117 [00:02<00:04, 17.08it/s, loss=0.708, v_num=1, val_acc=0.757]
Epoch 75:  32%|███▏      | 38/117 [00:02<00:04, 16.91it/s, loss=0.712, v_num=1, val_acc=0.757]
Epoch 75:  33%|███▎      | 39/117 [00:02<00:04, 17.28it/s, loss=0.712, v_num=1, val_acc=0.757]
Epoch 75:  33%|███▎      | 39/117 [00:02<00:04, 17.09it/s, loss=0.713, v_num=1, val_acc=0.757]
Epoch 75:  34%|███▍      | 40/117 [00:02<00:04, 17.46it/s, loss=0.713, v_num=1, val_acc=0.757]
Epoch 75:  34%|███▍      | 40/117 [00:02<00:04, 17.27it/s, loss=0.726, v_num=1, val_acc=0.757]
Epoch 75:  35%|███▌      | 41/117 [00:02<00:04, 17.63it/s, loss=0.726, v_num=1, val_acc=0.757]
Epoch 75:  35%|███▌      | 41/117 [00:02<00:04, 17.44it/s, loss=0.728, v_num=1, val_acc=0.757]
Epoch 75:  36%|███▌      | 42/117 [00:02<00:04, 17.80it/s, loss=0.728, v_num=1, val_acc=0.757]
Epoch 75:  36%|███▌      | 42/117 [00:02<00:04, 17.61it/s, loss=0.728, v_num=1, val_acc=0.757]
Epoch 75:  37%|███▋      | 43/117 [00:02<00:04, 17.96it/s, loss=0.728, v_num=1, val_acc=0.757]
Epoch 75:  37%|███▋      | 43/117 [00:02<00:04, 17.77it/s, loss=0.729, v_num=1, val_acc=0.757]
Epoch 75:  38%|███▊      | 44/117 [00:02<00:04, 18.08it/s, loss=0.729, v_num=1, val_acc=0.757]
Epoch 75:  38%|███▊      | 44/117 [00:02<00:04, 17.90it/s, loss=0.73, v_num=1, val_acc=0.757]
Epoch 75:  38%|███▊      | 45/117 [00:02<00:03, 18.23it/s, loss=0.73, v_num=1, val_acc=0.757]
Epoch 75:  38%|███▊      | 45/117 [00:02<00:03, 18.04it/s, loss=0.727, v_num=1, val_acc=0.757]
Epoch 75:  39%|███▉      | 46/117 [00:02<00:03, 18.38it/s, loss=0.727, v_num=1, val_acc=0.757]
Epoch 75:  39%|███▉      | 46/117 [00:02<00:03, 18.20it/s, loss=0.723, v_num=1, val_acc=0.757]
Epoch 75:  40%|████      | 47/117 [00:02<00:03, 18.52it/s, loss=0.723, v_num=1, val_acc=0.757]
Epoch 75:  40%|████      | 47/117 [00:02<00:03, 18.34it/s, loss=0.728, v_num=1, val_acc=0.757]
Epoch 75:  41%|████      | 48/117 [00:02<00:03, 18.66it/s, loss=0.728, v_num=1, val_acc=0.757]
Epoch 75:  41%|████      | 48/117 [00:02<00:03, 18.48it/s, loss=0.727, v_num=1, val_acc=0.757]
Epoch 75:  42%|████▏     | 49/117 [00:02<00:03, 18.80it/s, loss=0.727, v_num=1, val_acc=0.757]
Epoch 75:  42%|████▏     | 49/117 [00:02<00:03, 18.62it/s, loss=0.724, v_num=1, val_acc=0.757]
Epoch 75:  43%|████▎     | 50/117 [00:02<00:03, 18.93it/s, loss=0.724, v_num=1, val_acc=0.757]
Epoch 75:  43%|████▎     | 50/117 [00:02<00:03, 18.75it/s, loss=0.717, v_num=1, val_acc=0.757]
Epoch 75:  44%|████▎     | 51/117 [00:02<00:03, 19.02it/s, loss=0.717, v_num=1, val_acc=0.757]
Epoch 75:  44%|████▎     | 51/117 [00:02<00:03, 18.85it/s, loss=0.715, v_num=1, val_acc=0.757]
Epoch 75:  44%|████▍     | 52/117 [00:02<00:03, 19.16it/s, loss=0.715, v_num=1, val_acc=0.757]
Epoch 75:  44%|████▍     | 52/117 [00:02<00:03, 18.98it/s, loss=0.711, v_num=1, val_acc=0.757]
Epoch 75:  45%|████▌     | 53/117 [00:02<00:03, 19.28it/s, loss=0.711, v_num=1, val_acc=0.757]
Epoch 75:  45%|████▌     | 53/117 [00:02<00:03, 19.11it/s, loss=0.708, v_num=1, val_acc=0.757]
Epoch 75:  46%|████▌     | 54/117 [00:02<00:03, 19.40it/s, loss=0.708, v_num=1, val_acc=0.757]
Epoch 75:  46%|████▌     | 54/117 [00:02<00:03, 19.23it/s, loss=0.706, v_num=1, val_acc=0.757]
Epoch 75:  47%|████▋     | 55/117 [00:02<00:03, 19.52it/s, loss=0.706, v_num=1, val_acc=0.757]
Epoch 75:  47%|████▋     | 55/117 [00:02<00:03, 19.35it/s, loss=0.71, v_num=1, val_acc=0.757]
Epoch 75:  48%|████▊     | 56/117 [00:02<00:03, 19.64it/s, loss=0.71, v_num=1, val_acc=0.757]
Epoch 75:  48%|████▊     | 56/117 [00:02<00:03, 19.46it/s, loss=0.711, v_num=1, val_acc=0.757]
Epoch 75:  49%|████▊     | 57/117 [00:02<00:03, 19.71it/s, loss=0.711, v_num=1, val_acc=0.757]
Epoch 75:  49%|████▊     | 57/117 [00:02<00:03, 19.55it/s, loss=0.714, v_num=1, val_acc=0.757]
Epoch 75:  50%|████▉     | 58/117 [00:02<00:02, 19.80it/s, loss=0.714, v_num=1, val_acc=0.757]
Epoch 75:  50%|████▉     | 58/117 [00:02<00:03, 19.65it/s, loss=0.716, v_num=1, val_acc=0.757]
Epoch 75:  50%|█████     | 59/117 [00:02<00:02, 19.92it/s, loss=0.716, v_num=1, val_acc=0.757]
Epoch 75:  50%|█████     | 59/117 [00:02<00:02, 19.76it/s, loss=0.714, v_num=1, val_acc=0.757]
Epoch 75:  51%|█████▏    | 60/117 [00:02<00:02, 20.03it/s, loss=0.714, v_num=1, val_acc=0.757]
Epoch 75:  51%|█████▏    | 60/117 [00:03<00:02, 19.86it/s, loss=0.709, v_num=1, val_acc=0.757]
Epoch 75:  52%|█████▏    | 61/117 [00:03<00:02, 20.13it/s, loss=0.709, v_num=1, val_acc=0.757]
Epoch 75:  52%|█████▏    | 61/117 [00:03<00:02, 19.96it/s, loss=0.704, v_num=1, val_acc=0.757]
Epoch 75:  53%|█████▎    | 62/117 [00:03<00:02, 20.23it/s, loss=0.704, v_num=1, val_acc=0.757]
Epoch 75:  53%|█████▎    | 62/117 [00:03<00:02, 20.07it/s, loss=0.7, v_num=1, val_acc=0.757]
Epoch 75:  54%|█████▍    | 63/117 [00:03<00:02, 20.33it/s, loss=0.7, v_num=1, val_acc=0.757]
Epoch 75:  54%|█████▍    | 63/117 [00:03<00:02, 20.16it/s, loss=0.701, v_num=1, val_acc=0.757]
Epoch 75:  55%|█████▍    | 64/117 [00:03<00:02, 20.42it/s, loss=0.701, v_num=1, val_acc=0.757]
Epoch 75:  55%|█████▍    | 64/117 [00:03<00:02, 20.26it/s, loss=0.702, v_num=1, val_acc=0.757]
Epoch 75:  56%|█████▌    | 65/117 [00:03<00:02, 20.52it/s, loss=0.702, v_num=1, val_acc=0.757]
Epoch 75:  56%|█████▌    | 65/117 [00:03<00:02, 20.35it/s, loss=0.703, v_num=1, val_acc=0.757]
Epoch 75:  56%|█████▋    | 66/117 [00:03<00:02, 20.61it/s, loss=0.703, v_num=1, val_acc=0.757]
Epoch 75:  56%|█████▋    | 66/117 [00:03<00:02, 20.45it/s, loss=0.702, v_num=1, val_acc=0.757]
Epoch 75:  57%|█████▋    | 67/117 [00:03<00:02, 20.70it/s, loss=0.702, v_num=1, val_acc=0.757]
Epoch 75:  57%|█████▋    | 67/117 [00:03<00:02, 20.54it/s, loss=0.703, v_num=1, val_acc=0.757]
Epoch 75:  58%|█████▊    | 68/117 [00:03<00:02, 20.79it/s, loss=0.703, v_num=1, val_acc=0.757]
Epoch 75:  58%|█████▊    | 68/117 [00:03<00:02, 20.63it/s, loss=0.708, v_num=1, val_acc=0.757]
Epoch 75:  59%|█████▉    | 69/117 [00:03<00:02, 20.87it/s, loss=0.708, v_num=1, val_acc=0.757]
Epoch 75:  59%|█████▉    | 69/117 [00:03<00:02, 20.71it/s, loss=0.705, v_num=1, val_acc=0.757]
Epoch 75:  60%|█████▉    | 70/117 [00:03<00:02, 20.96it/s, loss=0.705, v_num=1, val_acc=0.757]
Epoch 75:  60%|█████▉    | 70/117 [00:03<00:02, 20.80it/s, loss=0.706, v_num=1, val_acc=0.757]
Epoch 75:  61%|██████    | 71/117 [00:03<00:02, 21.04it/s, loss=0.706, v_num=1, val_acc=0.757]
Epoch 75:  61%|██████    | 71/117 [00:03<00:02, 20.88it/s, loss=0.705, v_num=1, val_acc=0.757]
Epoch 75:  62%|██████▏   | 72/117 [00:03<00:02, 21.09it/s, loss=0.705, v_num=1, val_acc=0.757]
Epoch 75:  62%|██████▏   | 72/117 [00:03<00:02, 20.95it/s, loss=0.709, v_num=1, val_acc=0.757]
Epoch 75:  62%|██████▏   | 73/117 [00:03<00:02, 21.18it/s, loss=0.709, v_num=1, val_acc=0.757]
Epoch 75:  62%|██████▏   | 73/117 [00:03<00:02, 21.03it/s, loss=0.707, v_num=1, val_acc=0.757]
Epoch 75:  63%|██████▎   | 74/117 [00:03<00:02, 21.26it/s, loss=0.707, v_num=1, val_acc=0.757]
Epoch 75:  63%|██████▎   | 74/117 [00:03<00:02, 21.10it/s, loss=0.706, v_num=1, val_acc=0.757]
Epoch 75:  64%|██████▍   | 75/117 [00:03<00:01, 21.33it/s, loss=0.706, v_num=1, val_acc=0.757]
Epoch 75:  64%|██████▍   | 75/117 [00:03<00:01, 21.18it/s, loss=0.698, v_num=1, val_acc=0.757]
Epoch 75:  65%|██████▍   | 76/117 [00:03<00:01, 21.40it/s, loss=0.698, v_num=1, val_acc=0.757]
Epoch 75:  65%|██████▍   | 76/117 [00:03<00:01, 21.25it/s, loss=0.698, v_num=1, val_acc=0.757]
Epoch 75:  66%|██████▌   | 77/117 [00:03<00:01, 21.48it/s, loss=0.698, v_num=1, val_acc=0.757]
Epoch 75:  66%|██████▌   | 77/117 [00:03<00:01, 21.33it/s, loss=0.692, v_num=1, val_acc=0.757]
Epoch 75:  67%|██████▋   | 78/117 [00:03<00:01, 21.55it/s, loss=0.692, v_num=1, val_acc=0.757]
Epoch 75:  67%|██████▋   | 78/117 [00:03<00:01, 21.40it/s, loss=0.694, v_num=1, val_acc=0.757]
Epoch 75:  68%|██████▊   | 79/117 [00:03<00:01, 21.62it/s, loss=0.694, v_num=1, val_acc=0.757]
Epoch 75:  68%|██████▊   | 79/117 [00:03<00:01, 21.47it/s, loss=0.697, v_num=1, val_acc=0.757]
Epoch 75:  68%|██████▊   | 80/117 [00:03<00:01, 21.66it/s, loss=0.697, v_num=1, val_acc=0.757]
Epoch 75:  68%|██████▊   | 80/117 [00:03<00:01, 21.52it/s, loss=0.695, v_num=1, val_acc=0.757]
Epoch 75:  69%|██████▉   | 81/117 [00:03<00:01, 21.74it/s, loss=0.695, v_num=1, val_acc=0.757]
Epoch 75:  69%|██████▉   | 81/117 [00:03<00:01, 21.59it/s, loss=0.694, v_num=1, val_acc=0.757]
Epoch 75:  70%|███████   | 82/117 [00:03<00:01, 21.79it/s, loss=0.694, v_num=1, val_acc=0.757]
Epoch 75:  70%|███████   | 82/117 [00:03<00:01, 21.65it/s, loss=0.698, v_num=1, val_acc=0.757]
Epoch 75:  71%|███████   | 83/117 [00:03<00:01, 21.86it/s, loss=0.698, v_num=1, val_acc=0.757]
Epoch 75:  71%|███████   | 83/117 [00:03<00:01, 21.71it/s, loss=0.7, v_num=1, val_acc=0.757]
Epoch 75:  72%|███████▏  | 84/117 [00:03<00:01, 21.92it/s, loss=0.7, v_num=1, val_acc=0.757]
Epoch 75:  72%|███████▏  | 84/117 [00:03<00:01, 21.78it/s, loss=0.695, v_num=1, val_acc=0.757]
Epoch 75:  73%|███████▎  | 85/117 [00:03<00:01, 21.99it/s, loss=0.695, v_num=1, val_acc=0.757]
Epoch 75:  73%|███████▎  | 85/117 [00:03<00:01, 21.84it/s, loss=0.692, v_num=1, val_acc=0.757]
Epoch 75:  74%|███████▎  | 86/117 [00:03<00:01, 22.05it/s, loss=0.692, v_num=1, val_acc=0.757]
Epoch 75:  74%|███████▎  | 86/117 [00:03<00:01, 21.91it/s, loss=0.695, v_num=1, val_acc=0.757]
Epoch 75:  74%|███████▍  | 87/117 [00:03<00:01, 22.11it/s, loss=0.695, v_num=1, val_acc=0.757]
Epoch 75:  74%|███████▍  | 87/117 [00:03<00:01, 21.97it/s, loss=0.689, v_num=1, val_acc=0.757]
Epoch 75:  75%|███████▌  | 88/117 [00:03<00:01, 22.18it/s, loss=0.689, v_num=1, val_acc=0.757]
Epoch 75:  75%|███████▌  | 88/117 [00:03<00:01, 22.04it/s, loss=0.69, v_num=1, val_acc=0.757]
Epoch 75:  76%|███████▌  | 89/117 [00:04<00:01, 22.24it/s, loss=0.69, v_num=1, val_acc=0.757]
Epoch 75:  76%|███████▌  | 89/117 [00:04<00:01, 22.10it/s, loss=0.691, v_num=1, val_acc=0.757]
Epoch 75:  77%|███████▋  | 90/117 [00:04<00:01, 22.30it/s, loss=0.691, v_num=1, val_acc=0.757]
Epoch 75:  77%|███████▋  | 90/117 [00:04<00:01, 22.16it/s, loss=0.691, v_num=1, val_acc=0.757]
Epoch 75:  78%|███████▊  | 91/117 [00:04<00:01, 22.35it/s, loss=0.691, v_num=1, val_acc=0.757]
Epoch 75:  78%|███████▊  | 91/117 [00:04<00:01, 22.21it/s, loss=0.693, v_num=1, val_acc=0.757]
Epoch 75:  79%|███████▊  | 92/117 [00:04<00:01, 22.40it/s, loss=0.693, v_num=1, val_acc=0.757]
Epoch 75:  79%|███████▊  | 92/117 [00:04<00:01, 22.27it/s, loss=0.69, v_num=1, val_acc=0.757]
Epoch 75:  79%|███████▉  | 93/117 [00:04<00:01, 22.46it/s, loss=0.69, v_num=1, val_acc=0.757]
Epoch 75:  79%|███████▉  | 93/117 [00:04<00:01, 22.32it/s, loss=0.686, v_num=1, val_acc=0.757]
Epoch 75:  80%|████████  | 94/117 [00:04<00:01, 22.51it/s, loss=0.686, v_num=1, val_acc=0.757]
Epoch 75:  80%|████████  | 94/117 [00:04<00:01, 22.38it/s, loss=0.686, v_num=1, val_acc=0.757]
Epoch 75:  81%|████████  | 95/117 [00:04<00:00, 22.57it/s, loss=0.686, v_num=1, val_acc=0.757]
Epoch 75:  81%|████████  | 95/117 [00:04<00:00, 22.43it/s, loss=0.691, v_num=1, val_acc=0.757]
Epoch 75:  82%|████████▏ | 96/117 [00:04<00:00, 22.62it/s, loss=0.691, v_num=1, val_acc=0.757]
Epoch 75:  82%|████████▏ | 96/117 [00:04<00:00, 22.48it/s, loss=0.692, v_num=1, val_acc=0.757]
Epoch 75:  83%|████████▎ | 97/117 [00:04<00:00, 22.67it/s, loss=0.692, v_num=1, val_acc=0.757]
Epoch 75:  83%|████████▎ | 97/117 [00:04<00:00, 22.54it/s, loss=0.694, v_num=1, val_acc=0.757]

Validation: 0it [00:00, ?it/s]

Validation:   0%|          | 0/20 [00:00<?, ?it/s]

Validation DataLoader 0:   0%|          | 0/20 [00:00<?, ?it/s]

Validation DataLoader 0:   5%|▌         | 1/20 [00:00<00:00, 190.11it/s]
Epoch 75:  84%|████████▍ | 98/117 [00:05<00:01, 18.93it/s, loss=0.694, v_num=1, val_acc=0.757]

Validation DataLoader 0:  10%|█         | 2/20 [00:00<00:00, 56.26it/s]
Epoch 75:  85%|████████▍ | 99/117 [00:05<00:00, 19.02it/s, loss=0.694, v_num=1, val_acc=0.757]

Validation DataLoader 0:  15%|█▌        | 3/20 [00:00<00:00, 44.39it/s]
Epoch 75:  85%|████████▌ | 100/117 [00:05<00:00, 19.09it/s, loss=0.694, v_num=1, val_acc=0.757]

Validation DataLoader 0:  20%|██        | 4/20 [00:00<00:00, 40.47it/s]
Epoch 75:  86%|████████▋ | 101/117 [00:05<00:00, 19.17it/s, loss=0.694, v_num=1, val_acc=0.757]

Validation DataLoader 0:  25%|██▌       | 5/20 [00:00<00:00, 38.17it/s]
Epoch 75:  87%|████████▋ | 102/117 [00:05<00:00, 19.24it/s, loss=0.694, v_num=1, val_acc=0.757]

Validation DataLoader 0:  30%|███       | 6/20 [00:00<00:00, 36.96it/s]
Epoch 75:  88%|████████▊ | 103/117 [00:05<00:00, 19.31it/s, loss=0.694, v_num=1, val_acc=0.757]

Validation DataLoader 0:  35%|███▌      | 7/20 [00:00<00:00, 35.84it/s]
Epoch 75:  89%|████████▉ | 104/117 [00:05<00:00, 19.38it/s, loss=0.694, v_num=1, val_acc=0.757]

Validation DataLoader 0:  40%|████      | 8/20 [00:00<00:00, 35.27it/s]
Epoch 75:  90%|████████▉ | 105/117 [00:05<00:00, 19.45it/s, loss=0.694, v_num=1, val_acc=0.757]

Validation DataLoader 0:  45%|████▌     | 9/20 [00:00<00:00, 34.81it/s]
Epoch 75:  91%|█████████ | 106/117 [00:05<00:00, 19.52it/s, loss=0.694, v_num=1, val_acc=0.757]

Validation DataLoader 0:  50%|█████     | 10/20 [00:00<00:00, 34.48it/s]
Epoch 75:  91%|█████████▏| 107/117 [00:05<00:00, 19.59it/s, loss=0.694, v_num=1, val_acc=0.757]

Validation DataLoader 0:  55%|█████▌    | 11/20 [00:00<00:00, 34.20it/s]
Epoch 75:  92%|█████████▏| 108/117 [00:05<00:00, 19.66it/s, loss=0.694, v_num=1, val_acc=0.757]

Validation DataLoader 0:  60%|██████    | 12/20 [00:00<00:00, 33.97it/s]
Epoch 75:  93%|█████████▎| 109/117 [00:05<00:00, 19.73it/s, loss=0.694, v_num=1, val_acc=0.757]

Validation DataLoader 0:  65%|██████▌   | 13/20 [00:00<00:00, 33.75it/s]
Epoch 75:  94%|█████████▍| 110/117 [00:05<00:00, 19.80it/s, loss=0.694, v_num=1, val_acc=0.757]

Validation DataLoader 0:  70%|███████   | 14/20 [00:00<00:00, 33.60it/s]
Epoch 75:  95%|█████████▍| 111/117 [00:05<00:00, 19.87it/s, loss=0.694, v_num=1, val_acc=0.757]

Validation DataLoader 0:  75%|███████▌  | 15/20 [00:00<00:00, 33.45it/s]
Epoch 75:  96%|█████████▌| 112/117 [00:05<00:00, 19.93it/s, loss=0.694, v_num=1, val_acc=0.757]

Validation DataLoader 0:  80%|████████  | 16/20 [00:00<00:00, 33.34it/s]
Epoch 75:  97%|█████████▋| 113/117 [00:05<00:00, 20.00it/s, loss=0.694, v_num=1, val_acc=0.757]

Validation DataLoader 0:  85%|████████▌ | 17/20 [00:00<00:00, 33.21it/s]
Epoch 75:  97%|█████████▋| 114/117 [00:05<00:00, 20.06it/s, loss=0.694, v_num=1, val_acc=0.757]

Validation DataLoader 0:  90%|█████████ | 18/20 [00:00<00:00, 33.12it/s]
Epoch 75:  98%|█████████▊| 115/117 [00:05<00:00, 20.12it/s, loss=0.694, v_num=1, val_acc=0.757]

Validation DataLoader 0:  95%|█████████▌| 19/20 [00:00<00:00, 33.03it/s]
Epoch 75:  99%|█████████▉| 116/117 [00:05<00:00, 20.19it/s, loss=0.694, v_num=1, val_acc=0.757]

Validation DataLoader 0: 100%|██████████| 20/20 [00:00<00:00, 33.02it/s]
Epoch 75: 100%|██████████| 117/117 [00:05<00:00, 20.25it/s, loss=0.694, v_num=1, val_acc=0.757]
Epoch 75: 100%|██████████| 117/117 [00:05<00:00, 20.18it/s, loss=0.694, v_num=1, val_acc=0.755]


Epoch 75: 100%|██████████| 117/117 [00:05<00:00, 20.18it/s, loss=0.694, v_num=1, val_acc=0.755]
Epoch 75:   0%|          | 0/117 [00:00<?, ?it/s, loss=0.694, v_num=1, val_acc=0.755]
Epoch 76:   0%|          | 0/117 [00:00<?, ?it/s, loss=0.694, v_num=1, val_acc=0.755]
Epoch 76:   1%|          | 1/117 [00:00<01:44,  1.11it/s, loss=0.694, v_num=1, val_acc=0.755]
Epoch 76:   1%|          | 1/117 [00:00<01:47,  1.08it/s, loss=0.691, v_num=1, val_acc=0.755]
Epoch 76:   2%|▏         | 2/117 [00:00<00:55,  2.07it/s, loss=0.691, v_num=1, val_acc=0.755]
Epoch 76:   2%|▏         | 2/117 [00:00<00:56,  2.02it/s, loss=0.689, v_num=1, val_acc=0.755]
Epoch 76:   3%|▎         | 3/117 [00:01<00:38,  2.99it/s, loss=0.689, v_num=1, val_acc=0.755]
Epoch 76:   3%|▎         | 3/117 [00:01<00:39,  2.92it/s, loss=0.692, v_num=1, val_acc=0.755]
Epoch 76:   3%|▎         | 4/117 [00:01<00:29,  3.85it/s, loss=0.692, v_num=1, val_acc=0.755]
Epoch 76:   3%|▎         | 4/117 [00:01<00:30,  3.76it/s, loss=0.698, v_num=1, val_acc=0.755]
Epoch 76:   4%|▍         | 5/117 [00:01<00:24,  4.67it/s, loss=0.698, v_num=1, val_acc=0.755]
Epoch 76:   4%|▍         | 5/117 [00:01<00:24,  4.56it/s, loss=0.696, v_num=1, val_acc=0.755]
Epoch 76:   5%|▌         | 6/117 [00:01<00:20,  5.43it/s, loss=0.696, v_num=1, val_acc=0.755]
Epoch 76:   5%|▌         | 6/117 [00:01<00:20,  5.31it/s, loss=0.695, v_num=1, val_acc=0.755]
Epoch 76:   6%|▌         | 7/117 [00:01<00:17,  6.14it/s, loss=0.695, v_num=1, val_acc=0.755]
Epoch 76:   6%|▌         | 7/117 [00:01<00:18,  6.01it/s, loss=0.699, v_num=1, val_acc=0.755]
Epoch 76:   7%|▋         | 8/117 [00:01<00:16,  6.81it/s, loss=0.699, v_num=1, val_acc=0.755]
Epoch 76:   7%|▋         | 8/117 [00:01<00:16,  6.67it/s, loss=0.695, v_num=1, val_acc=0.755]
Epoch 76:   8%|▊         | 9/117 [00:01<00:14,  7.44it/s, loss=0.695, v_num=1, val_acc=0.755]
Epoch 76:   8%|▊         | 9/117 [00:01<00:14,  7.29it/s, loss=0.693, v_num=1, val_acc=0.755]
Epoch 76:   9%|▊         | 10/117 [00:01<00:13,  8.01it/s, loss=0.693, v_num=1, val_acc=0.755]
Epoch 76:   9%|▊         | 10/117 [00:01<00:13,  7.85it/s, loss=0.696, v_num=1, val_acc=0.755]
Epoch 76:   9%|▉         | 11/117 [00:01<00:12,  8.56it/s, loss=0.696, v_num=1, val_acc=0.755]
Epoch 76:   9%|▉         | 11/117 [00:01<00:12,  8.40it/s, loss=0.697, v_num=1, val_acc=0.755]
Epoch 76:  10%|█         | 12/117 [00:01<00:11,  9.10it/s, loss=0.697, v_num=1, val_acc=0.755]
Epoch 76:  10%|█         | 12/117 [00:01<00:11,  8.93it/s, loss=0.699, v_num=1, val_acc=0.755]
Epoch 76:  11%|█         | 13/117 [00:01<00:10,  9.60it/s, loss=0.699, v_num=1, val_acc=0.755]
Epoch 76:  11%|█         | 13/117 [00:01<00:11,  9.43it/s, loss=0.704, v_num=1, val_acc=0.755]
Epoch 76:  12%|█▏        | 14/117 [00:01<00:10, 10.08it/s, loss=0.704, v_num=1, val_acc=0.755]
Epoch 76:  12%|█▏        | 14/117 [00:01<00:10,  9.91it/s, loss=0.701, v_num=1, val_acc=0.755]
Epoch 76:  13%|█▎        | 15/117 [00:01<00:09, 10.54it/s, loss=0.701, v_num=1, val_acc=0.755]
Epoch 76:  13%|█▎        | 15/117 [00:01<00:09, 10.36it/s, loss=0.703, v_num=1, val_acc=0.755]
Epoch 76:  14%|█▎        | 16/117 [00:01<00:09, 10.98it/s, loss=0.703, v_num=1, val_acc=0.755]
Epoch 76:  14%|█▎        | 16/117 [00:01<00:09, 10.80it/s, loss=0.709, v_num=1, val_acc=0.755]
Epoch 76:  15%|█▍        | 17/117 [00:01<00:08, 11.40it/s, loss=0.709, v_num=1, val_acc=0.755]
Epoch 76:  15%|█▍        | 17/117 [00:01<00:08, 11.21it/s, loss=0.714, v_num=1, val_acc=0.755]
Epoch 76:  15%|█▌        | 18/117 [00:01<00:08, 11.76it/s, loss=0.714, v_num=1, val_acc=0.755]
Epoch 76:  15%|█▌        | 18/117 [00:01<00:08, 11.58it/s, loss=0.712, v_num=1, val_acc=0.755]
Epoch 76:  16%|█▌        | 19/117 [00:01<00:08, 12.15it/s, loss=0.712, v_num=1, val_acc=0.755]
Epoch 76:  16%|█▌        | 19/117 [00:01<00:08, 11.96it/s, loss=0.711, v_num=1, val_acc=0.755]
Epoch 76:  17%|█▋        | 20/117 [00:01<00:07, 12.52it/s, loss=0.711, v_num=1, val_acc=0.755]
Epoch 76:  17%|█▋        | 20/117 [00:01<00:07, 12.33it/s, loss=0.71, v_num=1, val_acc=0.755]
Epoch 76:  18%|█▊        | 21/117 [00:01<00:07, 12.87it/s, loss=0.71, v_num=1, val_acc=0.755]
Epoch 76:  18%|█▊        | 21/117 [00:01<00:07, 12.68it/s, loss=0.706, v_num=1, val_acc=0.755]
Epoch 76:  19%|█▉        | 22/117 [00:01<00:07, 13.21it/s, loss=0.706, v_num=1, val_acc=0.755]
Epoch 76:  19%|█▉        | 22/117 [00:01<00:07, 13.01it/s, loss=0.703, v_num=1, val_acc=0.755]
Epoch 76:  20%|█▉        | 23/117 [00:01<00:06, 13.53it/s, loss=0.703, v_num=1, val_acc=0.755]
Epoch 76:  20%|█▉        | 23/117 [00:01<00:07, 13.33it/s, loss=0.7, v_num=1, val_acc=0.755]
Epoch 76:  21%|██        | 24/117 [00:01<00:06, 13.83it/s, loss=0.7, v_num=1, val_acc=0.755]
Epoch 76:  21%|██        | 24/117 [00:01<00:06, 13.63it/s, loss=0.697, v_num=1, val_acc=0.755]
Epoch 76:  21%|██▏       | 25/117 [00:01<00:06, 14.12it/s, loss=0.697, v_num=1, val_acc=0.755]
Epoch 76:  21%|██▏       | 25/117 [00:01<00:06, 13.92it/s, loss=0.696, v_num=1, val_acc=0.755]
Epoch 76:  22%|██▏       | 26/117 [00:01<00:06, 14.38it/s, loss=0.696, v_num=1, val_acc=0.755]
Epoch 76:  22%|██▏       | 26/117 [00:01<00:06, 14.19it/s, loss=0.696, v_num=1, val_acc=0.755]
Epoch 76:  23%|██▎       | 27/117 [00:01<00:06, 14.65it/s, loss=0.696, v_num=1, val_acc=0.755]
Epoch 76:  23%|██▎       | 27/117 [00:01<00:06, 14.47it/s, loss=0.697, v_num=1, val_acc=0.755]
Epoch 76:  24%|██▍       | 28/117 [00:01<00:05, 14.93it/s, loss=0.697, v_num=1, val_acc=0.755]
Epoch 76:  24%|██▍       | 28/117 [00:01<00:06, 14.73it/s, loss=0.698, v_num=1, val_acc=0.755]
Epoch 76:  25%|██▍       | 29/117 [00:01<00:05, 15.18it/s, loss=0.698, v_num=1, val_acc=0.755]
Epoch 76:  25%|██▍       | 29/117 [00:01<00:05, 14.99it/s, loss=0.702, v_num=1, val_acc=0.755]
Epoch 76:  26%|██▌       | 30/117 [00:01<00:05, 15.43it/s, loss=0.702, v_num=1, val_acc=0.755]
Epoch 76:  26%|██▌       | 30/117 [00:01<00:05, 15.23it/s, loss=0.701, v_num=1, val_acc=0.755]
Epoch 76:  26%|██▋       | 31/117 [00:01<00:05, 15.67it/s, loss=0.701, v_num=1, val_acc=0.755]
Epoch 76:  26%|██▋       | 31/117 [00:02<00:05, 15.47it/s, loss=0.703, v_num=1, val_acc=0.755]
Epoch 76:  27%|██▋       | 32/117 [00:02<00:05, 15.89it/s, loss=0.703, v_num=1, val_acc=0.755]
Epoch 76:  27%|██▋       | 32/117 [00:02<00:05, 15.70it/s, loss=0.699, v_num=1, val_acc=0.755]
Epoch 76:  28%|██▊       | 33/117 [00:02<00:05, 16.11it/s, loss=0.699, v_num=1, val_acc=0.755]
Epoch 76:  28%|██▊       | 33/117 [00:02<00:05, 15.92it/s, loss=0.693, v_num=1, val_acc=0.755]
Epoch 76:  29%|██▉       | 34/117 [00:02<00:05, 16.31it/s, loss=0.693, v_num=1, val_acc=0.755]
Epoch 76:  29%|██▉       | 34/117 [00:02<00:05, 16.12it/s, loss=0.695, v_num=1, val_acc=0.755]
Epoch 76:  30%|██▉       | 35/117 [00:02<00:04, 16.53it/s, loss=0.695, v_num=1, val_acc=0.755]
Epoch 76:  30%|██▉       | 35/117 [00:02<00:05, 16.33it/s, loss=0.694, v_num=1, val_acc=0.755]
Epoch 76:  31%|███       | 36/117 [00:02<00:04, 16.73it/s, loss=0.694, v_num=1, val_acc=0.755]
Epoch 76:  31%|███       | 36/117 [00:02<00:04, 16.54it/s, loss=0.687, v_num=1, val_acc=0.755]
Epoch 76:  32%|███▏      | 37/117 [00:02<00:04, 16.92it/s, loss=0.687, v_num=1, val_acc=0.755]
Epoch 76:  32%|███▏      | 37/117 [00:02<00:04, 16.73it/s, loss=0.683, v_num=1, val_acc=0.755]
Epoch 76:  32%|███▏      | 38/117 [00:02<00:04, 17.11it/s, loss=0.683, v_num=1, val_acc=0.755]
Epoch 76:  32%|███▏      | 38/117 [00:02<00:04, 16.92it/s, loss=0.683, v_num=1, val_acc=0.755]
Epoch 76:  33%|███▎      | 39/117 [00:02<00:04, 17.29it/s, loss=0.683, v_num=1, val_acc=0.755]
Epoch 76:  33%|███▎      | 39/117 [00:02<00:04, 17.09it/s, loss=0.686, v_num=1, val_acc=0.755]
Epoch 76:  34%|███▍      | 40/117 [00:02<00:04, 17.46it/s, loss=0.686, v_num=1, val_acc=0.755]
Epoch 76:  34%|███▍      | 40/117 [00:02<00:04, 17.27it/s, loss=0.684, v_num=1, val_acc=0.755]
Epoch 76:  35%|███▌      | 41/117 [00:02<00:04, 17.63it/s, loss=0.684, v_num=1, val_acc=0.755]
Epoch 76:  35%|███▌      | 41/117 [00:02<00:04, 17.44it/s, loss=0.69, v_num=1, val_acc=0.755]
Epoch 76:  36%|███▌      | 42/117 [00:02<00:04, 17.79it/s, loss=0.69, v_num=1, val_acc=0.755]
Epoch 76:  36%|███▌      | 42/117 [00:02<00:04, 17.60it/s, loss=0.688, v_num=1, val_acc=0.755]
Epoch 76:  37%|███▋      | 43/117 [00:02<00:04, 17.96it/s, loss=0.688, v_num=1, val_acc=0.755]
Epoch 76:  37%|███▋      | 43/117 [00:02<00:04, 17.77it/s, loss=0.689, v_num=1, val_acc=0.755]
Epoch 76:  38%|███▊      | 44/117 [00:02<00:04, 18.12it/s, loss=0.689, v_num=1, val_acc=0.755]
Epoch 76:  38%|███▊      | 44/117 [00:02<00:04, 17.93it/s, loss=0.692, v_num=1, val_acc=0.755]
Epoch 76:  38%|███▊      | 45/117 [00:02<00:03, 18.26it/s, loss=0.692, v_num=1, val_acc=0.755]
Epoch 76:  38%|███▊      | 45/117 [00:02<00:03, 18.08it/s, loss=0.691, v_num=1, val_acc=0.755]
Epoch 76:  39%|███▉      | 46/117 [00:02<00:03, 18.41it/s, loss=0.691, v_num=1, val_acc=0.755]
Epoch 76:  39%|███▉      | 46/117 [00:02<00:03, 18.23it/s, loss=0.695, v_num=1, val_acc=0.755]
Epoch 76:  40%|████      | 47/117 [00:02<00:03, 18.56it/s, loss=0.695, v_num=1, val_acc=0.755]
Epoch 76:  40%|████      | 47/117 [00:02<00:03, 18.37it/s, loss=0.695, v_num=1, val_acc=0.755]
Epoch 76:  41%|████      | 48/117 [00:02<00:03, 18.70it/s, loss=0.695, v_num=1, val_acc=0.755]
Epoch 76:  41%|████      | 48/117 [00:02<00:03, 18.52it/s, loss=0.697, v_num=1, val_acc=0.755]
Epoch 76:  42%|████▏     | 49/117 [00:02<00:03, 18.83it/s, loss=0.697, v_num=1, val_acc=0.755]
Epoch 76:  42%|████▏     | 49/117 [00:02<00:03, 18.65it/s, loss=0.695, v_num=1, val_acc=0.755]
Epoch 76:  43%|████▎     | 50/117 [00:02<00:03, 18.97it/s, loss=0.695, v_num=1, val_acc=0.755]
Epoch 76:  43%|████▎     | 50/117 [00:02<00:03, 18.79it/s, loss=0.695, v_num=1, val_acc=0.755]
Epoch 76:  44%|████▎     | 51/117 [00:02<00:03, 19.06it/s, loss=0.695, v_num=1, val_acc=0.755]
Epoch 76:  44%|████▎     | 51/117 [00:02<00:03, 18.90it/s, loss=0.688, v_num=1, val_acc=0.755]
Epoch 76:  44%|████▍     | 52/117 [00:02<00:03, 19.20it/s, loss=0.688, v_num=1, val_acc=0.755]
Epoch 76:  44%|████▍     | 52/117 [00:02<00:03, 19.03it/s, loss=0.685, v_num=1, val_acc=0.755]
Epoch 76:  45%|████▌     | 53/117 [00:02<00:03, 19.33it/s, loss=0.685, v_num=1, val_acc=0.755]
Epoch 76:  45%|████▌     | 53/117 [00:02<00:03, 19.15it/s, loss=0.69, v_num=1, val_acc=0.755]
Epoch 76:  46%|████▌     | 54/117 [00:02<00:03, 19.44it/s, loss=0.69, v_num=1, val_acc=0.755]
Epoch 76:  46%|████▌     | 54/117 [00:02<00:03, 19.27it/s, loss=0.689, v_num=1, val_acc=0.755]
Epoch 76:  47%|████▋     | 55/117 [00:02<00:03, 19.56it/s, loss=0.689, v_num=1, val_acc=0.755]
Epoch 76:  47%|████▋     | 55/117 [00:02<00:03, 19.39it/s, loss=0.686, v_num=1, val_acc=0.755]
Epoch 76:  48%|████▊     | 56/117 [00:02<00:03, 19.68it/s, loss=0.686, v_num=1, val_acc=0.755]
Epoch 76:  48%|████▊     | 56/117 [00:02<00:03, 19.50it/s, loss=0.687, v_num=1, val_acc=0.755]
Epoch 76:  49%|████▊     | 57/117 [00:02<00:03, 19.79it/s, loss=0.687, v_num=1, val_acc=0.755]
Epoch 76:  49%|████▊     | 57/117 [00:02<00:03, 19.62it/s, loss=0.688, v_num=1, val_acc=0.755]
Epoch 76:  50%|████▉     | 58/117 [00:02<00:02, 19.90it/s, loss=0.688, v_num=1, val_acc=0.755]
Epoch 76:  50%|████▉     | 58/117 [00:02<00:02, 19.73it/s, loss=0.684, v_num=1, val_acc=0.755]
Epoch 76:  50%|█████     | 59/117 [00:02<00:02, 20.00it/s, loss=0.684, v_num=1, val_acc=0.755]
Epoch 76:  50%|█████     | 59/117 [00:02<00:02, 19.83it/s, loss=0.684, v_num=1, val_acc=0.755]
Epoch 76:  51%|█████▏    | 60/117 [00:02<00:02, 20.11it/s, loss=0.684, v_num=1, val_acc=0.755]
Epoch 76:  51%|█████▏    | 60/117 [00:03<00:02, 19.94it/s, loss=0.688, v_num=1, val_acc=0.755]
Epoch 76:  52%|█████▏    | 61/117 [00:03<00:02, 20.21it/s, loss=0.688, v_num=1, val_acc=0.755]
Epoch 76:  52%|█████▏    | 61/117 [00:03<00:02, 20.04it/s, loss=0.688, v_num=1, val_acc=0.755]
Epoch 76:  53%|█████▎    | 62/117 [00:03<00:02, 20.31it/s, loss=0.688, v_num=1, val_acc=0.755]
Epoch 76:  53%|█████▎    | 62/117 [00:03<00:02, 20.14it/s, loss=0.694, v_num=1, val_acc=0.755]
Epoch 76:  54%|█████▍    | 63/117 [00:03<00:02, 20.41it/s, loss=0.694, v_num=1, val_acc=0.755]
Epoch 76:  54%|█████▍    | 63/117 [00:03<00:02, 20.24it/s, loss=0.693, v_num=1, val_acc=0.755]
Epoch 76:  55%|█████▍    | 64/117 [00:03<00:02, 20.50it/s, loss=0.693, v_num=1, val_acc=0.755]
Epoch 76:  55%|█████▍    | 64/117 [00:03<00:02, 20.34it/s, loss=0.698, v_num=1, val_acc=0.755]
Epoch 76:  56%|█████▌    | 65/117 [00:03<00:02, 20.60it/s, loss=0.698, v_num=1, val_acc=0.755]
Epoch 76:  56%|█████▌    | 65/117 [00:03<00:02, 20.43it/s, loss=0.699, v_num=1, val_acc=0.755]
Epoch 76:  56%|█████▋    | 66/117 [00:03<00:02, 20.69it/s, loss=0.699, v_num=1, val_acc=0.755]
Epoch 76:  56%|█████▋    | 66/117 [00:03<00:02, 20.52it/s, loss=0.694, v_num=1, val_acc=0.755]
Epoch 76:  57%|█████▋    | 67/117 [00:03<00:02, 20.75it/s, loss=0.694, v_num=1, val_acc=0.755]
Epoch 76:  57%|█████▋    | 67/117 [00:03<00:02, 20.60it/s, loss=0.693, v_num=1, val_acc=0.755]
Epoch 76:  58%|█████▊    | 68/117 [00:03<00:02, 20.84it/s, loss=0.693, v_num=1, val_acc=0.755]
Epoch 76:  58%|█████▊    | 68/117 [00:03<00:02, 20.68it/s, loss=0.695, v_num=1, val_acc=0.755]
Epoch 76:  59%|█████▉    | 69/117 [00:03<00:02, 20.93it/s, loss=0.695, v_num=1, val_acc=0.755]
Epoch 76:  59%|█████▉    | 69/117 [00:03<00:02, 20.77it/s, loss=0.694, v_num=1, val_acc=0.755]
Epoch 76:  60%|█████▉    | 70/117 [00:03<00:02, 21.01it/s, loss=0.694, v_num=1, val_acc=0.755]
Epoch 76:  60%|█████▉    | 70/117 [00:03<00:02, 20.86it/s, loss=0.696, v_num=1, val_acc=0.755]
Epoch 76:  61%|██████    | 71/117 [00:03<00:02, 21.09it/s, loss=0.696, v_num=1, val_acc=0.755]
Epoch 76:  61%|██████    | 71/117 [00:03<00:02, 20.94it/s, loss=0.7, v_num=1, val_acc=0.755]
Epoch 76:  62%|██████▏   | 72/117 [00:03<00:02, 21.18it/s, loss=0.7, v_num=1, val_acc=0.755]
Epoch 76:  62%|██████▏   | 72/117 [00:03<00:02, 21.02it/s, loss=0.704, v_num=1, val_acc=0.755]
Epoch 76:  62%|██████▏   | 73/117 [00:03<00:02, 21.26it/s, loss=0.704, v_num=1, val_acc=0.755]
Epoch 76:  62%|██████▏   | 73/117 [00:03<00:02, 21.10it/s, loss=0.698, v_num=1, val_acc=0.755]
Epoch 76:  63%|██████▎   | 74/117 [00:03<00:02, 21.33it/s, loss=0.698, v_num=1, val_acc=0.755]
Epoch 76:  63%|██████▎   | 74/117 [00:03<00:02, 21.18it/s, loss=0.699, v_num=1, val_acc=0.755]
Epoch 76:  64%|██████▍   | 75/117 [00:03<00:01, 21.41it/s, loss=0.699, v_num=1, val_acc=0.755]
Epoch 76:  64%|██████▍   | 75/117 [00:03<00:01, 21.25it/s, loss=0.701, v_num=1, val_acc=0.755]
Epoch 76:  65%|██████▍   | 76/117 [00:03<00:01, 21.48it/s, loss=0.701, v_num=1, val_acc=0.755]
Epoch 76:  65%|██████▍   | 76/117 [00:03<00:01, 21.33it/s, loss=0.704, v_num=1, val_acc=0.755]
Epoch 76:  66%|██████▌   | 77/117 [00:03<00:01, 21.55it/s, loss=0.704, v_num=1, val_acc=0.755]
Epoch 76:  66%|██████▌   | 77/117 [00:03<00:01, 21.40it/s, loss=0.705, v_num=1, val_acc=0.755]
Epoch 76:  67%|██████▋   | 78/117 [00:03<00:01, 21.62it/s, loss=0.705, v_num=1, val_acc=0.755]
Epoch 76:  67%|██████▋   | 78/117 [00:03<00:01, 21.47it/s, loss=0.709, v_num=1, val_acc=0.755]
Epoch 76:  68%|██████▊   | 79/117 [00:03<00:01, 21.69it/s, loss=0.709, v_num=1, val_acc=0.755]
Epoch 76:  68%|██████▊   | 79/117 [00:03<00:01, 21.54it/s, loss=0.709, v_num=1, val_acc=0.755]
Epoch 76:  68%|██████▊   | 80/117 [00:03<00:01, 21.76it/s, loss=0.709, v_num=1, val_acc=0.755]
Epoch 76:  68%|██████▊   | 80/117 [00:03<00:01, 21.61it/s, loss=0.708, v_num=1, val_acc=0.755]
Epoch 76:  69%|██████▉   | 81/117 [00:03<00:01, 21.82it/s, loss=0.708, v_num=1, val_acc=0.755]
Epoch 76:  69%|██████▉   | 81/117 [00:03<00:01, 21.68it/s, loss=0.709, v_num=1, val_acc=0.755]
Epoch 76:  70%|███████   | 82/117 [00:03<00:01, 21.88it/s, loss=0.709, v_num=1, val_acc=0.755]
Epoch 76:  70%|███████   | 82/117 [00:03<00:01, 21.73it/s, loss=0.702, v_num=1, val_acc=0.755]
Epoch 76:  71%|███████   | 83/117 [00:03<00:01, 21.95it/s, loss=0.702, v_num=1, val_acc=0.755]
Epoch 76:  71%|███████   | 83/117 [00:03<00:01, 21.80it/s, loss=0.705, v_num=1, val_acc=0.755]
Epoch 76:  72%|███████▏  | 84/117 [00:03<00:01, 22.01it/s, loss=0.705, v_num=1, val_acc=0.755]
Epoch 76:  72%|███████▏  | 84/117 [00:03<00:01, 21.86it/s, loss=0.696, v_num=1, val_acc=0.755]
Epoch 76:  73%|███████▎  | 85/117 [00:03<00:01, 22.07it/s, loss=0.696, v_num=1, val_acc=0.755]
Epoch 76:  73%|███████▎  | 85/117 [00:03<00:01, 21.93it/s, loss=0.693, v_num=1, val_acc=0.755]
Epoch 76:  74%|███████▎  | 86/117 [00:03<00:01, 22.14it/s, loss=0.693, v_num=1, val_acc=0.755]
Epoch 76:  74%|███████▎  | 86/117 [00:03<00:01, 21.99it/s, loss=0.689, v_num=1, val_acc=0.755]
Epoch 76:  74%|███████▍  | 87/117 [00:03<00:01, 22.20it/s, loss=0.689, v_num=1, val_acc=0.755]
Epoch 76:  74%|███████▍  | 87/117 [00:03<00:01, 22.06it/s, loss=0.694, v_num=1, val_acc=0.755]
Epoch 76:  75%|███████▌  | 88/117 [00:03<00:01, 22.26it/s, loss=0.694, v_num=1, val_acc=0.755]
Epoch 76:  75%|███████▌  | 88/117 [00:03<00:01, 22.12it/s, loss=0.693, v_num=1, val_acc=0.755]
Epoch 76:  76%|███████▌  | 89/117 [00:03<00:01, 22.32it/s, loss=0.693, v_num=1, val_acc=0.755]
Epoch 76:  76%|███████▌  | 89/117 [00:04<00:01, 22.18it/s, loss=0.699, v_num=1, val_acc=0.755]
Epoch 76:  77%|███████▋  | 90/117 [00:04<00:01, 22.38it/s, loss=0.699, v_num=1, val_acc=0.755]
Epoch 76:  77%|███████▋  | 90/117 [00:04<00:01, 22.24it/s, loss=0.699, v_num=1, val_acc=0.755]
Epoch 76:  78%|███████▊  | 91/117 [00:04<00:01, 22.44it/s, loss=0.699, v_num=1, val_acc=0.755]
Epoch 76:  78%|███████▊  | 91/117 [00:04<00:01, 22.30it/s, loss=0.699, v_num=1, val_acc=0.755]
Epoch 76:  79%|███████▊  | 92/117 [00:04<00:01, 22.49it/s, loss=0.699, v_num=1, val_acc=0.755]
Epoch 76:  79%|███████▊  | 92/117 [00:04<00:01, 22.35it/s, loss=0.695, v_num=1, val_acc=0.755]
Epoch 76:  79%|███████▉  | 93/117 [00:04<00:01, 22.55it/s, loss=0.695, v_num=1, val_acc=0.755]
Epoch 76:  79%|███████▉  | 93/117 [00:04<00:01, 22.41it/s, loss=0.698, v_num=1, val_acc=0.755]
Epoch 76:  80%|████████  | 94/117 [00:04<00:01, 22.60it/s, loss=0.698, v_num=1, val_acc=0.755]
Epoch 76:  80%|████████  | 94/117 [00:04<00:01, 22.46it/s, loss=0.703, v_num=1, val_acc=0.755]
Epoch 76:  81%|████████  | 95/117 [00:04<00:00, 22.65it/s, loss=0.703, v_num=1, val_acc=0.755]
Epoch 76:  81%|████████  | 95/117 [00:04<00:00, 22.52it/s, loss=0.704, v_num=1, val_acc=0.755]
Epoch 76:  82%|████████▏ | 96/117 [00:04<00:00, 22.71it/s, loss=0.704, v_num=1, val_acc=0.755]
Epoch 76:  82%|████████▏ | 96/117 [00:04<00:00, 22.57it/s, loss=0.703, v_num=1, val_acc=0.755]
Epoch 76:  83%|████████▎ | 97/117 [00:04<00:00, 22.76it/s, loss=0.703, v_num=1, val_acc=0.755]
Epoch 76:  83%|████████▎ | 97/117 [00:04<00:00, 22.62it/s, loss=0.701, v_num=1, val_acc=0.755]

Validation: 0it [00:00, ?it/s]

Validation:   0%|          | 0/20 [00:00<?, ?it/s]

Validation DataLoader 0:   0%|          | 0/20 [00:00<?, ?it/s]

Validation DataLoader 0:   5%|▌         | 1/20 [00:00<00:00, 112.58it/s]
Epoch 76:  84%|████████▍ | 98/117 [00:05<00:00, 19.11it/s, loss=0.701, v_num=1, val_acc=0.755]

Validation DataLoader 0:  10%|█         | 2/20 [00:00<00:00, 53.89it/s]
Epoch 76:  85%|████████▍ | 99/117 [00:05<00:00, 19.20it/s, loss=0.701, v_num=1, val_acc=0.755]

Validation DataLoader 0:  15%|█▌        | 3/20 [00:00<00:00, 43.78it/s]
Epoch 76:  85%|████████▌ | 100/117 [00:05<00:00, 19.28it/s, loss=0.701, v_num=1, val_acc=0.755]

Validation DataLoader 0:  20%|██        | 4/20 [00:00<00:00, 39.94it/s]
Epoch 76:  86%|████████▋ | 101/117 [00:05<00:00, 19.35it/s, loss=0.701, v_num=1, val_acc=0.755]

Validation DataLoader 0:  25%|██▌       | 5/20 [00:00<00:00, 37.97it/s]
Epoch 76:  87%|████████▋ | 102/117 [00:05<00:00, 19.42it/s, loss=0.701, v_num=1, val_acc=0.755]

Validation DataLoader 0:  30%|███       | 6/20 [00:00<00:00, 36.69it/s]
Epoch 76:  88%|████████▊ | 103/117 [00:05<00:00, 19.50it/s, loss=0.701, v_num=1, val_acc=0.755]

Validation DataLoader 0:  35%|███▌      | 7/20 [00:00<00:00, 35.92it/s]
Epoch 76:  89%|████████▉ | 104/117 [00:05<00:00, 19.57it/s, loss=0.701, v_num=1, val_acc=0.755]

Validation DataLoader 0:  40%|████      | 8/20 [00:00<00:00, 35.29it/s]
Epoch 76:  90%|████████▉ | 105/117 [00:05<00:00, 19.64it/s, loss=0.701, v_num=1, val_acc=0.755]

Validation DataLoader 0:  45%|████▌     | 9/20 [00:00<00:00, 34.84it/s]
Epoch 76:  91%|█████████ | 106/117 [00:05<00:00, 19.71it/s, loss=0.701, v_num=1, val_acc=0.755]

Validation DataLoader 0:  50%|█████     | 10/20 [00:00<00:00, 34.47it/s]
Epoch 76:  91%|█████████▏| 107/117 [00:05<00:00, 19.78it/s, loss=0.701, v_num=1, val_acc=0.755]

Validation DataLoader 0:  55%|█████▌    | 11/20 [00:00<00:00, 34.21it/s]
Epoch 76:  92%|█████████▏| 108/117 [00:05<00:00, 19.85it/s, loss=0.701, v_num=1, val_acc=0.755]

Validation DataLoader 0:  60%|██████    | 12/20 [00:00<00:00, 33.99it/s]
Epoch 76:  93%|█████████▎| 109/117 [00:05<00:00, 19.92it/s, loss=0.701, v_num=1, val_acc=0.755]

Validation DataLoader 0:  65%|██████▌   | 13/20 [00:00<00:00, 33.78it/s]
Epoch 76:  94%|█████████▍| 110/117 [00:05<00:00, 19.98it/s, loss=0.701, v_num=1, val_acc=0.755]

Validation DataLoader 0:  70%|███████   | 14/20 [00:00<00:00, 33.63it/s]
Epoch 76:  95%|█████████▍| 111/117 [00:05<00:00, 20.05it/s, loss=0.701, v_num=1, val_acc=0.755]

Validation DataLoader 0:  75%|███████▌  | 15/20 [00:00<00:00, 33.48it/s]
Epoch 76:  96%|█████████▌| 112/117 [00:05<00:00, 20.12it/s, loss=0.701, v_num=1, val_acc=0.755]

Validation DataLoader 0:  80%|████████  | 16/20 [00:00<00:00, 33.35it/s]
Epoch 76:  97%|█████████▋| 113/117 [00:05<00:00, 20.18it/s, loss=0.701, v_num=1, val_acc=0.755]

Validation DataLoader 0:  85%|████████▌ | 17/20 [00:00<00:00, 33.24it/s]
Epoch 76:  97%|█████████▋| 114/117 [00:05<00:00, 20.25it/s, loss=0.701, v_num=1, val_acc=0.755]

Validation DataLoader 0:  90%|█████████ | 18/20 [00:00<00:00, 33.13it/s]
Epoch 76:  98%|█████████▊| 115/117 [00:05<00:00, 20.31it/s, loss=0.701, v_num=1, val_acc=0.755]

Validation DataLoader 0:  95%|█████████▌| 19/20 [00:00<00:00, 33.06it/s]
Epoch 76:  99%|█████████▉| 116/117 [00:05<00:00, 20.37it/s, loss=0.701, v_num=1, val_acc=0.755]

Validation DataLoader 0: 100%|██████████| 20/20 [00:00<00:00, 33.05it/s]
Epoch 76: 100%|██████████| 117/117 [00:05<00:00, 20.44it/s, loss=0.701, v_num=1, val_acc=0.755]
Epoch 76: 100%|██████████| 117/117 [00:05<00:00, 20.37it/s, loss=0.701, v_num=1, val_acc=0.755]


Epoch 76: 100%|██████████| 117/117 [00:05<00:00, 20.36it/s, loss=0.701, v_num=1, val_acc=0.755]
Epoch 76:   0%|          | 0/117 [00:00<?, ?it/s, loss=0.701, v_num=1, val_acc=0.755]
Epoch 77:   0%|          | 0/117 [00:00<?, ?it/s, loss=0.701, v_num=1, val_acc=0.755]
Epoch 77:   1%|          | 1/117 [00:00<01:44,  1.11it/s, loss=0.701, v_num=1, val_acc=0.755]
Epoch 77:   1%|          | 1/117 [00:00<01:47,  1.08it/s, loss=0.698, v_num=1, val_acc=0.755]
Epoch 77:   2%|▏         | 2/117 [00:00<00:53,  2.14it/s, loss=0.698, v_num=1, val_acc=0.755]
Epoch 77:   2%|▏         | 2/117 [00:00<00:55,  2.08it/s, loss=0.699, v_num=1, val_acc=0.755]
Epoch 77:   3%|▎         | 3/117 [00:00<00:36,  3.10it/s, loss=0.699, v_num=1, val_acc=0.755]
Epoch 77:   3%|▎         | 3/117 [00:00<00:37,  3.02it/s, loss=0.699, v_num=1, val_acc=0.755]
Epoch 77:   3%|▎         | 4/117 [00:01<00:28,  3.99it/s, loss=0.699, v_num=1, val_acc=0.755]
Epoch 77:   3%|▎         | 4/117 [00:01<00:29,  3.89it/s, loss=0.698, v_num=1, val_acc=0.755]
Epoch 77:   4%|▍         | 5/117 [00:01<00:23,  4.81it/s, loss=0.698, v_num=1, val_acc=0.755]
Epoch 77:   4%|▍         | 5/117 [00:01<00:23,  4.69it/s, loss=0.703, v_num=1, val_acc=0.755]
Epoch 77:   5%|▌         | 6/117 [00:01<00:19,  5.59it/s, loss=0.703, v_num=1, val_acc=0.755]
Epoch 77:   5%|▌         | 6/117 [00:01<00:20,  5.46it/s, loss=0.703, v_num=1, val_acc=0.755]
Epoch 77:   6%|▌         | 7/117 [00:01<00:17,  6.32it/s, loss=0.703, v_num=1, val_acc=0.755]
Epoch 77:   6%|▌         | 7/117 [00:01<00:17,  6.18it/s, loss=0.71, v_num=1, val_acc=0.755]
Epoch 77:   7%|▋         | 8/117 [00:01<00:15,  7.01it/s, loss=0.71, v_num=1, val_acc=0.755]
Epoch 77:   7%|▋         | 8/117 [00:01<00:15,  6.85it/s, loss=0.711, v_num=1, val_acc=0.755]
Epoch 77:   8%|▊         | 9/117 [00:01<00:14,  7.62it/s, loss=0.711, v_num=1, val_acc=0.755]
Epoch 77:   8%|▊         | 9/117 [00:01<00:14,  7.46it/s, loss=0.713, v_num=1, val_acc=0.755]
Epoch 77:   9%|▊         | 10/117 [00:01<00:12,  8.23it/s, loss=0.713, v_num=1, val_acc=0.755]
Epoch 77:   9%|▊         | 10/117 [00:01<00:13,  8.06it/s, loss=0.71, v_num=1, val_acc=0.755]
Epoch 77:   9%|▉         | 11/117 [00:01<00:12,  8.81it/s, loss=0.71, v_num=1, val_acc=0.755]
Epoch 77:   9%|▉         | 11/117 [00:01<00:12,  8.64it/s, loss=0.709, v_num=1, val_acc=0.755]
Epoch 77:  10%|█         | 12/117 [00:01<00:11,  9.36it/s, loss=0.709, v_num=1, val_acc=0.755]
Epoch 77:  10%|█         | 12/117 [00:01<00:11,  9.18it/s, loss=0.705, v_num=1, val_acc=0.755]
Epoch 77:  11%|█         | 13/117 [00:01<00:10,  9.87it/s, loss=0.705, v_num=1, val_acc=0.755]
Epoch 77:  11%|█         | 13/117 [00:01<00:10,  9.68it/s, loss=0.709, v_num=1, val_acc=0.755]
Epoch 77:  12%|█▏        | 14/117 [00:01<00:09, 10.36it/s, loss=0.709, v_num=1, val_acc=0.755]
Epoch 77:  12%|█▏        | 14/117 [00:01<00:10, 10.17it/s, loss=0.709, v_num=1, val_acc=0.755]
Epoch 77:  13%|█▎        | 15/117 [00:01<00:09, 10.84it/s, loss=0.709, v_num=1, val_acc=0.755]
Epoch 77:  13%|█▎        | 15/117 [00:01<00:09, 10.64it/s, loss=0.716, v_num=1, val_acc=0.755]
Epoch 77:  14%|█▎        | 16/117 [00:01<00:08, 11.28it/s, loss=0.716, v_num=1, val_acc=0.755]
Epoch 77:  14%|█▎        | 16/117 [00:01<00:09, 11.09it/s, loss=0.718, v_num=1, val_acc=0.755]
Epoch 77:  15%|█▍        | 17/117 [00:01<00:08, 11.68it/s, loss=0.718, v_num=1, val_acc=0.755]
Epoch 77:  15%|█▍        | 17/117 [00:01<00:08, 11.48it/s, loss=0.71, v_num=1, val_acc=0.755]
Epoch 77:  15%|█▌        | 18/117 [00:01<00:08, 12.09it/s, loss=0.71, v_num=1, val_acc=0.755]
Epoch 77:  15%|█▌        | 18/117 [00:01<00:08, 11.89it/s, loss=0.71, v_num=1, val_acc=0.755]
Epoch 77:  16%|█▌        | 19/117 [00:01<00:07, 12.47it/s, loss=0.71, v_num=1, val_acc=0.755]
Epoch 77:  16%|█▌        | 19/117 [00:01<00:07, 12.27it/s, loss=0.71, v_num=1, val_acc=0.755]
Epoch 77:  17%|█▋        | 20/117 [00:01<00:07, 12.85it/s, loss=0.71, v_num=1, val_acc=0.755]
Epoch 77:  17%|█▋        | 20/117 [00:01<00:07, 12.64it/s, loss=0.712, v_num=1, val_acc=0.755]
Epoch 77:  18%|█▊        | 21/117 [00:01<00:07, 13.20it/s, loss=0.712, v_num=1, val_acc=0.755]
Epoch 77:  18%|█▊        | 21/117 [00:01<00:07, 12.99it/s, loss=0.715, v_num=1, val_acc=0.755]
Epoch 77:  19%|█▉        | 22/117 [00:01<00:07, 13.54it/s, loss=0.715, v_num=1, val_acc=0.755]
Epoch 77:  19%|█▉        | 22/117 [00:01<00:07, 13.33it/s, loss=0.715, v_num=1, val_acc=0.755]
Epoch 77:  20%|█▉        | 23/117 [00:01<00:06, 13.86it/s, loss=0.715, v_num=1, val_acc=0.755]
Epoch 77:  20%|█▉        | 23/117 [00:01<00:06, 13.65it/s, loss=0.717, v_num=1, val_acc=0.755]
Epoch 77:  21%|██        | 24/117 [00:01<00:06, 14.17it/s, loss=0.717, v_num=1, val_acc=0.755]
Epoch 77:  21%|██        | 24/117 [00:01<00:06, 13.96it/s, loss=0.715, v_num=1, val_acc=0.755]
Epoch 77:  21%|██▏       | 25/117 [00:01<00:06, 14.45it/s, loss=0.715, v_num=1, val_acc=0.755]
Epoch 77:  21%|██▏       | 25/117 [00:01<00:06, 14.24it/s, loss=0.717, v_num=1, val_acc=0.755]
Epoch 77:  22%|██▏       | 26/117 [00:01<00:06, 14.74it/s, loss=0.717, v_num=1, val_acc=0.755]
Epoch 77:  22%|██▏       | 26/117 [00:01<00:06, 14.53it/s, loss=0.711, v_num=1, val_acc=0.755]
Epoch 77:  23%|██▎       | 27/117 [00:01<00:05, 15.02it/s, loss=0.711, v_num=1, val_acc=0.755]
Epoch 77:  23%|██▎       | 27/117 [00:01<00:06, 14.81it/s, loss=0.708, v_num=1, val_acc=0.755]
Epoch 77:  24%|██▍       | 28/117 [00:01<00:05, 15.29it/s, loss=0.708, v_num=1, val_acc=0.755]
Epoch 77:  24%|██▍       | 28/117 [00:01<00:05, 15.08it/s, loss=0.71, v_num=1, val_acc=0.755]
Epoch 77:  25%|██▍       | 29/117 [00:01<00:05, 15.54it/s, loss=0.71, v_num=1, val_acc=0.755]
Epoch 77:  25%|██▍       | 29/117 [00:01<00:05, 15.33it/s, loss=0.716, v_num=1, val_acc=0.755]
Epoch 77:  26%|██▌       | 30/117 [00:01<00:05, 15.79it/s, loss=0.716, v_num=1, val_acc=0.755]
Epoch 77:  26%|██▌       | 30/117 [00:01<00:05, 15.58it/s, loss=0.715, v_num=1, val_acc=0.755]
Epoch 77:  26%|██▋       | 31/117 [00:01<00:05, 16.03it/s, loss=0.715, v_num=1, val_acc=0.755]
Epoch 77:  26%|██▋       | 31/117 [00:01<00:05, 15.82it/s, loss=0.714, v_num=1, val_acc=0.755]
Epoch 77:  27%|██▋       | 32/117 [00:01<00:05, 16.24it/s, loss=0.714, v_num=1, val_acc=0.755]
Epoch 77:  27%|██▋       | 32/117 [00:01<00:05, 16.04it/s, loss=0.713, v_num=1, val_acc=0.755]
Epoch 77:  28%|██▊       | 33/117 [00:02<00:05, 16.45it/s, loss=0.713, v_num=1, val_acc=0.755]
Epoch 77:  28%|██▊       | 33/117 [00:02<00:05, 16.25it/s, loss=0.708, v_num=1, val_acc=0.755]
Epoch 77:  29%|██▉       | 34/117 [00:02<00:04, 16.67it/s, loss=0.708, v_num=1, val_acc=0.755]
Epoch 77:  29%|██▉       | 34/117 [00:02<00:05, 16.47it/s, loss=0.707, v_num=1, val_acc=0.755]
Epoch 77:  30%|██▉       | 35/117 [00:02<00:04, 16.89it/s, loss=0.707, v_num=1, val_acc=0.755]
Epoch 77:  30%|██▉       | 35/117 [00:02<00:04, 16.68it/s, loss=0.703, v_num=1, val_acc=0.755]
Epoch 77:  31%|███       | 36/117 [00:02<00:04, 17.08it/s, loss=0.703, v_num=1, val_acc=0.755]
Epoch 77:  31%|███       | 36/117 [00:02<00:04, 16.88it/s, loss=0.705, v_num=1, val_acc=0.755]
Epoch 77:  32%|███▏      | 37/117 [00:02<00:04, 17.28it/s, loss=0.705, v_num=1, val_acc=0.755]
Epoch 77:  32%|███▏      | 37/117 [00:02<00:04, 17.07it/s, loss=0.709, v_num=1, val_acc=0.755]
Epoch 77:  32%|███▏      | 38/117 [00:02<00:04, 17.46it/s, loss=0.709, v_num=1, val_acc=0.755]
Epoch 77:  32%|███▏      | 38/117 [00:02<00:04, 17.26it/s, loss=0.709, v_num=1, val_acc=0.755]
Epoch 77:  33%|███▎      | 39/117 [00:02<00:04, 17.64it/s, loss=0.709, v_num=1, val_acc=0.755]
Epoch 77:  33%|███▎      | 39/117 [00:02<00:04, 17.44it/s, loss=0.711, v_num=1, val_acc=0.755]
Epoch 77:  34%|███▍      | 40/117 [00:02<00:04, 17.82it/s, loss=0.711, v_num=1, val_acc=0.755]
Epoch 77:  34%|███▍      | 40/117 [00:02<00:04, 17.62it/s, loss=0.709, v_num=1, val_acc=0.755]
Epoch 77:  35%|███▌      | 41/117 [00:02<00:04, 17.98it/s, loss=0.709, v_num=1, val_acc=0.755]
Epoch 77:  35%|███▌      | 41/117 [00:02<00:04, 17.78it/s, loss=0.707, v_num=1, val_acc=0.755]
Epoch 77:  36%|███▌      | 42/117 [00:02<00:04, 18.15it/s, loss=0.707, v_num=1, val_acc=0.755]
Epoch 77:  36%|███▌      | 42/117 [00:02<00:04, 17.96it/s, loss=0.705, v_num=1, val_acc=0.755]
Epoch 77:  37%|███▋      | 43/117 [00:02<00:04, 18.31it/s, loss=0.705, v_num=1, val_acc=0.755]
Epoch 77:  37%|███▋      | 43/117 [00:02<00:04, 18.12it/s, loss=0.703, v_num=1, val_acc=0.755]
Epoch 77:  38%|███▊      | 44/117 [00:02<00:03, 18.47it/s, loss=0.703, v_num=1, val_acc=0.755]
Epoch 77:  38%|███▊      | 44/117 [00:02<00:03, 18.27it/s, loss=0.705, v_num=1, val_acc=0.755]
Epoch 77:  38%|███▊      | 45/117 [00:02<00:03, 18.62it/s, loss=0.705, v_num=1, val_acc=0.755]
Epoch 77:  38%|███▊      | 45/117 [00:02<00:03, 18.42it/s, loss=0.704, v_num=1, val_acc=0.755]
Epoch 77:  39%|███▉      | 46/117 [00:02<00:03, 18.76it/s, loss=0.704, v_num=1, val_acc=0.755]
Epoch 77:  39%|███▉      | 46/117 [00:02<00:03, 18.56it/s, loss=0.71, v_num=1, val_acc=0.755]
Epoch 77:  40%|████      | 47/117 [00:02<00:03, 18.90it/s, loss=0.71, v_num=1, val_acc=0.755]
Epoch 77:  40%|████      | 47/117 [00:02<00:03, 18.71it/s, loss=0.701, v_num=1, val_acc=0.755]
Epoch 77:  41%|████      | 48/117 [00:02<00:03, 19.04it/s, loss=0.701, v_num=1, val_acc=0.755]
Epoch 77:  41%|████      | 48/117 [00:02<00:03, 18.85it/s, loss=0.699, v_num=1, val_acc=0.755]
Epoch 77:  42%|████▏     | 49/117 [00:02<00:03, 19.17it/s, loss=0.699, v_num=1, val_acc=0.755]
Epoch 77:  42%|████▏     | 49/117 [00:02<00:03, 18.99it/s, loss=0.696, v_num=1, val_acc=0.755]
Epoch 77:  43%|████▎     | 50/117 [00:02<00:03, 19.31it/s, loss=0.696, v_num=1, val_acc=0.755]
Epoch 77:  43%|████▎     | 50/117 [00:02<00:03, 19.12it/s, loss=0.692, v_num=1, val_acc=0.755]
Epoch 77:  44%|████▎     | 51/117 [00:02<00:03, 19.43it/s, loss=0.692, v_num=1, val_acc=0.755]
Epoch 77:  44%|████▎     | 51/117 [00:02<00:03, 19.25it/s, loss=0.696, v_num=1, val_acc=0.755]
Epoch 77:  44%|████▍     | 52/117 [00:02<00:03, 19.56it/s, loss=0.696, v_num=1, val_acc=0.755]
Epoch 77:  44%|████▍     | 52/117 [00:02<00:03, 19.37it/s, loss=0.695, v_num=1, val_acc=0.755]
Epoch 77:  45%|████▌     | 53/117 [00:02<00:03, 19.68it/s, loss=0.695, v_num=1, val_acc=0.755]
Epoch 77:  45%|████▌     | 53/117 [00:02<00:03, 19.50it/s, loss=0.697, v_num=1, val_acc=0.755]
Epoch 77:  46%|████▌     | 54/117 [00:02<00:03, 19.80it/s, loss=0.697, v_num=1, val_acc=0.755]
Epoch 77:  46%|████▌     | 54/117 [00:02<00:03, 19.62it/s, loss=0.696, v_num=1, val_acc=0.755]
Epoch 77:  47%|████▋     | 55/117 [00:02<00:03, 19.91it/s, loss=0.696, v_num=1, val_acc=0.755]
Epoch 77:  47%|████▋     | 55/117 [00:02<00:03, 19.73it/s, loss=0.695, v_num=1, val_acc=0.755]
Epoch 77:  48%|████▊     | 56/117 [00:02<00:03, 20.03it/s, loss=0.695, v_num=1, val_acc=0.755]
Epoch 77:  48%|████▊     | 56/117 [00:02<00:03, 19.85it/s, loss=0.698, v_num=1, val_acc=0.755]
Epoch 77:  49%|████▊     | 57/117 [00:02<00:02, 20.14it/s, loss=0.698, v_num=1, val_acc=0.755]
Epoch 77:  49%|████▊     | 57/117 [00:02<00:03, 19.96it/s, loss=0.697, v_num=1, val_acc=0.755]
Epoch 77:  50%|████▉     | 58/117 [00:02<00:02, 20.24it/s, loss=0.697, v_num=1, val_acc=0.755]
Epoch 77:  50%|████▉     | 58/117 [00:02<00:02, 20.07it/s, loss=0.692, v_num=1, val_acc=0.755]
Epoch 77:  50%|█████     | 59/117 [00:02<00:02, 20.35it/s, loss=0.692, v_num=1, val_acc=0.755]
Epoch 77:  50%|█████     | 59/117 [00:02<00:02, 20.17it/s, loss=0.692, v_num=1, val_acc=0.755]
Epoch 77:  51%|█████▏    | 60/117 [00:02<00:02, 20.45it/s, loss=0.692, v_num=1, val_acc=0.755]
Epoch 77:  51%|█████▏    | 60/117 [00:02<00:02, 20.28it/s, loss=0.696, v_num=1, val_acc=0.755]
Epoch 77:  52%|█████▏    | 61/117 [00:02<00:02, 20.55it/s, loss=0.696, v_num=1, val_acc=0.755]
Epoch 77:  52%|█████▏    | 61/117 [00:02<00:02, 20.38it/s, loss=0.69, v_num=1, val_acc=0.755]
Epoch 77:  53%|█████▎    | 62/117 [00:03<00:02, 20.65it/s, loss=0.69, v_num=1, val_acc=0.755]
Epoch 77:  53%|█████▎    | 62/117 [00:03<00:02, 20.48it/s, loss=0.691, v_num=1, val_acc=0.755]
Epoch 77:  54%|█████▍    | 63/117 [00:03<00:02, 20.74it/s, loss=0.691, v_num=1, val_acc=0.755]
Epoch 77:  54%|█████▍    | 63/117 [00:03<00:02, 20.57it/s, loss=0.69, v_num=1, val_acc=0.755]
Epoch 77:  55%|█████▍    | 64/117 [00:03<00:02, 20.84it/s, loss=0.69, v_num=1, val_acc=0.755]
Epoch 77:  55%|█████▍    | 64/117 [00:03<00:02, 20.67it/s, loss=0.685, v_num=1, val_acc=0.755]
Epoch 77:  56%|█████▌    | 65/117 [00:03<00:02, 20.93it/s, loss=0.685, v_num=1, val_acc=0.755]
Epoch 77:  56%|█████▌    | 65/117 [00:03<00:02, 20.76it/s, loss=0.689, v_num=1, val_acc=0.755]
Epoch 77:  56%|█████▋    | 66/117 [00:03<00:02, 21.01it/s, loss=0.689, v_num=1, val_acc=0.755]
Epoch 77:  56%|█████▋    | 66/117 [00:03<00:02, 20.84it/s, loss=0.685, v_num=1, val_acc=0.755]
Epoch 77:  57%|█████▋    | 67/117 [00:03<00:02, 21.10it/s, loss=0.685, v_num=1, val_acc=0.755]
Epoch 77:  57%|█████▋    | 67/117 [00:03<00:02, 20.93it/s, loss=0.693, v_num=1, val_acc=0.755]
Epoch 77:  58%|█████▊    | 68/117 [00:03<00:02, 21.18it/s, loss=0.693, v_num=1, val_acc=0.755]
Epoch 77:  58%|█████▊    | 68/117 [00:03<00:02, 21.02it/s, loss=0.694, v_num=1, val_acc=0.755]
Epoch 77:  59%|█████▉    | 69/117 [00:03<00:02, 21.27it/s, loss=0.694, v_num=1, val_acc=0.755]
Epoch 77:  59%|█████▉    | 69/117 [00:03<00:02, 21.10it/s, loss=0.692, v_num=1, val_acc=0.755]
Epoch 77:  60%|█████▉    | 70/117 [00:03<00:02, 21.35it/s, loss=0.692, v_num=1, val_acc=0.755]
Epoch 77:  60%|█████▉    | 70/117 [00:03<00:02, 21.18it/s, loss=0.693, v_num=1, val_acc=0.755]
Epoch 77:  61%|██████    | 71/117 [00:03<00:02, 21.43it/s, loss=0.693, v_num=1, val_acc=0.755]
Epoch 77:  61%|██████    | 71/117 [00:03<00:02, 21.26it/s, loss=0.69, v_num=1, val_acc=0.755]
Epoch 77:  62%|██████▏   | 72/117 [00:03<00:02, 21.50it/s, loss=0.69, v_num=1, val_acc=0.755]
Epoch 77:  62%|██████▏   | 72/117 [00:03<00:02, 21.34it/s, loss=0.695, v_num=1, val_acc=0.755]
Epoch 77:  62%|██████▏   | 73/117 [00:03<00:02, 21.58it/s, loss=0.695, v_num=1, val_acc=0.755]
Epoch 77:  62%|██████▏   | 73/117 [00:03<00:02, 21.42it/s, loss=0.693, v_num=1, val_acc=0.755]
Epoch 77:  63%|██████▎   | 74/117 [00:03<00:01, 21.66it/s, loss=0.693, v_num=1, val_acc=0.755]
Epoch 77:  63%|██████▎   | 74/117 [00:03<00:02, 21.50it/s, loss=0.692, v_num=1, val_acc=0.755]
Epoch 77:  64%|██████▍   | 75/117 [00:03<00:01, 21.73it/s, loss=0.692, v_num=1, val_acc=0.755]
Epoch 77:  64%|██████▍   | 75/117 [00:03<00:01, 21.57it/s, loss=0.697, v_num=1, val_acc=0.755]
Epoch 77:  65%|██████▍   | 76/117 [00:03<00:01, 21.80it/s, loss=0.697, v_num=1, val_acc=0.755]
Epoch 77:  65%|██████▍   | 76/117 [00:03<00:01, 21.64it/s, loss=0.69, v_num=1, val_acc=0.755]
Epoch 77:  66%|██████▌   | 77/117 [00:03<00:01, 21.87it/s, loss=0.69, v_num=1, val_acc=0.755]
Epoch 77:  66%|██████▌   | 77/117 [00:03<00:01, 21.72it/s, loss=0.691, v_num=1, val_acc=0.755]
Epoch 77:  67%|██████▋   | 78/117 [00:03<00:01, 21.94it/s, loss=0.691, v_num=1, val_acc=0.755]
Epoch 77:  67%|██████▋   | 78/117 [00:03<00:01, 21.78it/s, loss=0.695, v_num=1, val_acc=0.755]
Epoch 77:  68%|██████▊   | 79/117 [00:03<00:01, 22.01it/s, loss=0.695, v_num=1, val_acc=0.755]
Epoch 77:  68%|██████▊   | 79/117 [00:03<00:01, 21.85it/s, loss=0.7, v_num=1, val_acc=0.755]
Epoch 77:  68%|██████▊   | 80/117 [00:03<00:01, 22.07it/s, loss=0.7, v_num=1, val_acc=0.755]
Epoch 77:  68%|██████▊   | 80/117 [00:03<00:01, 21.92it/s, loss=0.695, v_num=1, val_acc=0.755]
Epoch 77:  69%|██████▉   | 81/117 [00:03<00:01, 22.14it/s, loss=0.695, v_num=1, val_acc=0.755]
Epoch 77:  69%|██████▉   | 81/117 [00:03<00:01, 21.99it/s, loss=0.702, v_num=1, val_acc=0.755]
Epoch 77:  70%|███████   | 82/117 [00:03<00:01, 22.19it/s, loss=0.702, v_num=1, val_acc=0.755]
Epoch 77:  70%|███████   | 82/117 [00:03<00:01, 22.04it/s, loss=0.706, v_num=1, val_acc=0.755]
Epoch 77:  71%|███████   | 83/117 [00:03<00:01, 22.25it/s, loss=0.706, v_num=1, val_acc=0.755]
Epoch 77:  71%|███████   | 83/117 [00:03<00:01, 22.10it/s, loss=0.702, v_num=1, val_acc=0.755]
Epoch 77:  72%|███████▏  | 84/117 [00:03<00:01, 22.32it/s, loss=0.702, v_num=1, val_acc=0.755]
Epoch 77:  72%|███████▏  | 84/117 [00:03<00:01, 22.17it/s, loss=0.706, v_num=1, val_acc=0.755]
Epoch 77:  73%|███████▎  | 85/117 [00:03<00:01, 22.38it/s, loss=0.706, v_num=1, val_acc=0.755]
Epoch 77:  73%|███████▎  | 85/117 [00:03<00:01, 22.23it/s, loss=0.704, v_num=1, val_acc=0.755]
Epoch 77:  74%|███████▎  | 86/117 [00:03<00:01, 22.43it/s, loss=0.704, v_num=1, val_acc=0.755]
Epoch 77:  74%|███████▎  | 86/117 [00:03<00:01, 22.29it/s, loss=0.707, v_num=1, val_acc=0.755]
Epoch 77:  74%|███████▍  | 87/117 [00:03<00:01, 22.49it/s, loss=0.707, v_num=1, val_acc=0.755]
Epoch 77:  74%|███████▍  | 87/117 [00:03<00:01, 22.35it/s, loss=0.704, v_num=1, val_acc=0.755]
Epoch 77:  75%|███████▌  | 88/117 [00:03<00:01, 22.55it/s, loss=0.704, v_num=1, val_acc=0.755]
Epoch 77:  75%|███████▌  | 88/117 [00:03<00:01, 22.41it/s, loss=0.702, v_num=1, val_acc=0.755]
Epoch 77:  76%|███████▌  | 89/117 [00:03<00:01, 22.61it/s, loss=0.702, v_num=1, val_acc=0.755]
Epoch 77:  76%|███████▌  | 89/117 [00:03<00:01, 22.46it/s, loss=0.703, v_num=1, val_acc=0.755]
Epoch 77:  77%|███████▋  | 90/117 [00:03<00:01, 22.66it/s, loss=0.703, v_num=1, val_acc=0.755]
Epoch 77:  77%|███████▋  | 90/117 [00:03<00:01, 22.52it/s, loss=0.701, v_num=1, val_acc=0.755]
Epoch 77:  78%|███████▊  | 91/117 [00:04<00:01, 22.72it/s, loss=0.701, v_num=1, val_acc=0.755]
Epoch 77:  78%|███████▊  | 91/117 [00:04<00:01, 22.58it/s, loss=0.704, v_num=1, val_acc=0.755]
Epoch 77:  79%|███████▊  | 92/117 [00:04<00:01, 22.77it/s, loss=0.704, v_num=1, val_acc=0.755]
Epoch 77:  79%|███████▊  | 92/117 [00:04<00:01, 22.63it/s, loss=0.696, v_num=1, val_acc=0.755]
Epoch 77:  79%|███████▉  | 93/117 [00:04<00:01, 22.83it/s, loss=0.696, v_num=1, val_acc=0.755]
Epoch 77:  79%|███████▉  | 93/117 [00:04<00:01, 22.69it/s, loss=0.697, v_num=1, val_acc=0.755]
Epoch 77:  80%|████████  | 94/117 [00:04<00:01, 22.88it/s, loss=0.697, v_num=1, val_acc=0.755]
Epoch 77:  80%|████████  | 94/117 [00:04<00:01, 22.74it/s, loss=0.696, v_num=1, val_acc=0.755]
Epoch 77:  81%|████████  | 95/117 [00:04<00:00, 22.93it/s, loss=0.696, v_num=1, val_acc=0.755]
Epoch 77:  81%|████████  | 95/117 [00:04<00:00, 22.79it/s, loss=0.7, v_num=1, val_acc=0.755]
Epoch 77:  82%|████████▏ | 96/117 [00:04<00:00, 22.98it/s, loss=0.7, v_num=1, val_acc=0.755]
Epoch 77:  82%|████████▏ | 96/117 [00:04<00:00, 22.84it/s, loss=0.701, v_num=1, val_acc=0.755]
Epoch 77:  83%|████████▎ | 97/117 [00:04<00:00, 23.03it/s, loss=0.701, v_num=1, val_acc=0.755]
Epoch 77:  83%|████████▎ | 97/117 [00:04<00:00, 22.90it/s, loss=0.697, v_num=1, val_acc=0.755]

Validation: 0it [00:00, ?it/s]

Validation:   0%|          | 0/20 [00:00<?, ?it/s]

Validation DataLoader 0:   0%|          | 0/20 [00:00<?, ?it/s]

Validation DataLoader 0:   5%|▌         | 1/20 [00:00<00:00, 148.77it/s]
Epoch 77:  84%|████████▍ | 98/117 [00:05<00:00, 19.24it/s, loss=0.697, v_num=1, val_acc=0.755]

Validation DataLoader 0:  10%|█         | 2/20 [00:00<00:00, 54.82it/s]
Epoch 77:  85%|████████▍ | 99/117 [00:05<00:00, 19.32it/s, loss=0.697, v_num=1, val_acc=0.755]

Validation DataLoader 0:  15%|█▌        | 3/20 [00:00<00:00, 43.94it/s]
Epoch 77:  85%|████████▌ | 100/117 [00:05<00:00, 19.39it/s, loss=0.697, v_num=1, val_acc=0.755]

Validation DataLoader 0:  20%|██        | 4/20 [00:00<00:00, 40.06it/s]
Epoch 77:  86%|████████▋ | 101/117 [00:05<00:00, 19.47it/s, loss=0.697, v_num=1, val_acc=0.755]

Validation DataLoader 0:  25%|██▌       | 5/20 [00:00<00:00, 38.02it/s]
Epoch 77:  87%|████████▋ | 102/117 [00:05<00:00, 19.54it/s, loss=0.697, v_num=1, val_acc=0.755]

Validation DataLoader 0:  30%|███       | 6/20 [00:00<00:00, 36.78it/s]
Epoch 77:  88%|████████▊ | 103/117 [00:05<00:00, 19.62it/s, loss=0.697, v_num=1, val_acc=0.755]

Validation DataLoader 0:  35%|███▌      | 7/20 [00:00<00:00, 35.97it/s]
Epoch 77:  89%|████████▉ | 104/117 [00:05<00:00, 19.69it/s, loss=0.697, v_num=1, val_acc=0.755]

Validation DataLoader 0:  40%|████      | 8/20 [00:00<00:00, 35.36it/s]
Epoch 77:  90%|████████▉ | 105/117 [00:05<00:00, 19.76it/s, loss=0.697, v_num=1, val_acc=0.755]

Validation DataLoader 0:  45%|████▌     | 9/20 [00:00<00:00, 34.88it/s]
Epoch 77:  91%|█████████ | 106/117 [00:05<00:00, 19.83it/s, loss=0.697, v_num=1, val_acc=0.755]

Validation DataLoader 0:  50%|█████     | 10/20 [00:00<00:00, 34.50it/s]
Epoch 77:  91%|█████████▏| 107/117 [00:05<00:00, 19.90it/s, loss=0.697, v_num=1, val_acc=0.755]

Validation DataLoader 0:  55%|█████▌    | 11/20 [00:00<00:00, 34.25it/s]
Epoch 77:  92%|█████████▏| 108/117 [00:05<00:00, 19.97it/s, loss=0.697, v_num=1, val_acc=0.755]

Validation DataLoader 0:  60%|██████    | 12/20 [00:00<00:00, 34.01it/s]
Epoch 77:  93%|█████████▎| 109/117 [00:05<00:00, 20.03it/s, loss=0.697, v_num=1, val_acc=0.755]

Validation DataLoader 0:  65%|██████▌   | 13/20 [00:00<00:00, 33.83it/s]
Epoch 77:  94%|█████████▍| 110/117 [00:05<00:00, 20.10it/s, loss=0.697, v_num=1, val_acc=0.755]

Validation DataLoader 0:  70%|███████   | 14/20 [00:00<00:00, 33.66it/s]
Epoch 77:  95%|█████████▍| 111/117 [00:05<00:00, 20.17it/s, loss=0.697, v_num=1, val_acc=0.755]

Validation DataLoader 0:  75%|███████▌  | 15/20 [00:00<00:00, 33.51it/s]
Epoch 77:  96%|█████████▌| 112/117 [00:05<00:00, 20.23it/s, loss=0.697, v_num=1, val_acc=0.755]

Validation DataLoader 0:  80%|████████  | 16/20 [00:00<00:00, 33.39it/s]
Epoch 77:  97%|█████████▋| 113/117 [00:05<00:00, 20.30it/s, loss=0.697, v_num=1, val_acc=0.755]

Validation DataLoader 0:  85%|████████▌ | 17/20 [00:00<00:00, 33.25it/s]
Epoch 77:  97%|█████████▋| 114/117 [00:05<00:00, 20.36it/s, loss=0.697, v_num=1, val_acc=0.755]

Validation DataLoader 0:  90%|█████████ | 18/20 [00:00<00:00, 33.16it/s]
Epoch 77:  98%|█████████▊| 115/117 [00:05<00:00, 20.42it/s, loss=0.697, v_num=1, val_acc=0.755]

Validation DataLoader 0:  95%|█████████▌| 19/20 [00:00<00:00, 33.08it/s]
Epoch 77:  99%|█████████▉| 116/117 [00:05<00:00, 20.49it/s, loss=0.697, v_num=1, val_acc=0.755]

Validation DataLoader 0: 100%|██████████| 20/20 [00:00<00:00, 33.07it/s]
Epoch 77: 100%|██████████| 117/117 [00:05<00:00, 20.55it/s, loss=0.697, v_num=1, val_acc=0.755]
Epoch 77: 100%|██████████| 117/117 [00:05<00:00, 20.48it/s, loss=0.697, v_num=1, val_acc=0.757]


Epoch 77: 100%|██████████| 117/117 [00:05<00:00, 20.48it/s, loss=0.697, v_num=1, val_acc=0.757]
Epoch 77:   0%|          | 0/117 [00:00<?, ?it/s, loss=0.697, v_num=1, val_acc=0.757]
Epoch 78:   0%|          | 0/117 [00:00<?, ?it/s, loss=0.697, v_num=1, val_acc=0.757]
Epoch 78:   1%|          | 1/117 [00:00<01:44,  1.11it/s, loss=0.697, v_num=1, val_acc=0.757]
Epoch 78:   1%|          | 1/117 [00:00<01:47,  1.08it/s, loss=0.697, v_num=1, val_acc=0.757]
Epoch 78:   2%|▏         | 2/117 [00:00<00:53,  2.14it/s, loss=0.697, v_num=1, val_acc=0.757]
Epoch 78:   2%|▏         | 2/117 [00:00<00:55,  2.08it/s, loss=0.694, v_num=1, val_acc=0.757]
Epoch 78:   3%|▎         | 3/117 [00:00<00:36,  3.09it/s, loss=0.694, v_num=1, val_acc=0.757]
Epoch 78:   3%|▎         | 3/117 [00:00<00:37,  3.01it/s, loss=0.695, v_num=1, val_acc=0.757]
Epoch 78:   3%|▎         | 4/117 [00:01<00:28,  3.97it/s, loss=0.695, v_num=1, val_acc=0.757]
Epoch 78:   3%|▎         | 4/117 [00:01<00:29,  3.87it/s, loss=0.691, v_num=1, val_acc=0.757]
Epoch 78:   4%|▍         | 5/117 [00:01<00:23,  4.80it/s, loss=0.691, v_num=1, val_acc=0.757]
Epoch 78:   4%|▍         | 5/117 [00:01<00:23,  4.69it/s, loss=0.691, v_num=1, val_acc=0.757]
Epoch 78:   5%|▌         | 6/117 [00:01<00:19,  5.58it/s, loss=0.691, v_num=1, val_acc=0.757]
Epoch 78:   5%|▌         | 6/117 [00:01<00:20,  5.45it/s, loss=0.692, v_num=1, val_acc=0.757]
Epoch 78:   6%|▌         | 7/117 [00:01<00:17,  6.30it/s, loss=0.692, v_num=1, val_acc=0.757]
Epoch 78:   6%|▌         | 7/117 [00:01<00:17,  6.16it/s, loss=0.693, v_num=1, val_acc=0.757]
Epoch 78:   7%|▋         | 8/117 [00:01<00:15,  6.98it/s, loss=0.693, v_num=1, val_acc=0.757]
Epoch 78:   7%|▋         | 8/117 [00:01<00:15,  6.83it/s, loss=0.688, v_num=1, val_acc=0.757]
Epoch 78:   8%|▊         | 9/117 [00:01<00:14,  7.63it/s, loss=0.688, v_num=1, val_acc=0.757]
Epoch 78:   8%|▊         | 9/117 [00:01<00:14,  7.47it/s, loss=0.684, v_num=1, val_acc=0.757]
Epoch 78:   9%|▊         | 10/117 [00:01<00:12,  8.23it/s, loss=0.684, v_num=1, val_acc=0.757]
Epoch 78:   9%|▊         | 10/117 [00:01<00:13,  8.06it/s, loss=0.693, v_num=1, val_acc=0.757]
Epoch 78:   9%|▉         | 11/117 [00:01<00:12,  8.81it/s, loss=0.693, v_num=1, val_acc=0.757]
Epoch 78:   9%|▉         | 11/117 [00:01<00:12,  8.63it/s, loss=0.692, v_num=1, val_acc=0.757]
Epoch 78:  10%|█         | 12/117 [00:01<00:11,  9.33it/s, loss=0.692, v_num=1, val_acc=0.757]
Epoch 78:  10%|█         | 12/117 [00:01<00:11,  9.15it/s, loss=0.698, v_num=1, val_acc=0.757]
Epoch 78:  11%|█         | 13/117 [00:01<00:10,  9.85it/s, loss=0.698, v_num=1, val_acc=0.757]
Epoch 78:  11%|█         | 13/117 [00:01<00:10,  9.67it/s, loss=0.702, v_num=1, val_acc=0.757]
Epoch 78:  12%|█▏        | 14/117 [00:01<00:09, 10.34it/s, loss=0.702, v_num=1, val_acc=0.757]
Epoch 78:  12%|█▏        | 14/117 [00:01<00:10, 10.14it/s, loss=0.699, v_num=1, val_acc=0.757]
Epoch 78:  13%|█▎        | 15/117 [00:01<00:09, 10.80it/s, loss=0.699, v_num=1, val_acc=0.757]
Epoch 78:  13%|█▎        | 15/117 [00:01<00:09, 10.61it/s, loss=0.701, v_num=1, val_acc=0.757]
Epoch 78:  14%|█▎        | 16/117 [00:01<00:08, 11.25it/s, loss=0.701, v_num=1, val_acc=0.757]
Epoch 78:  14%|█▎        | 16/117 [00:01<00:09, 11.05it/s, loss=0.697, v_num=1, val_acc=0.757]
Epoch 78:  15%|█▍        | 17/117 [00:01<00:08, 11.67it/s, loss=0.697, v_num=1, val_acc=0.757]
Epoch 78:  15%|█▍        | 17/117 [00:01<00:08, 11.47it/s, loss=0.701, v_num=1, val_acc=0.757]
Epoch 78:  15%|█▌        | 18/117 [00:01<00:08, 12.07it/s, loss=0.701, v_num=1, val_acc=0.757]
Epoch 78:  15%|█▌        | 18/117 [00:01<00:08, 11.87it/s, loss=0.695, v_num=1, val_acc=0.757]
Epoch 78:  16%|█▌        | 19/117 [00:01<00:07, 12.46it/s, loss=0.695, v_num=1, val_acc=0.757]
Epoch 78:  16%|█▌        | 19/117 [00:01<00:07, 12.25it/s, loss=0.695, v_num=1, val_acc=0.757]
Epoch 78:  17%|█▋        | 20/117 [00:01<00:07, 12.81it/s, loss=0.695, v_num=1, val_acc=0.757]
Epoch 78:  17%|█▋        | 20/117 [00:01<00:07, 12.61it/s, loss=0.698, v_num=1, val_acc=0.757]
Epoch 78:  18%|█▊        | 21/117 [00:01<00:07, 13.17it/s, loss=0.698, v_num=1, val_acc=0.757]
Epoch 78:  18%|█▊        | 21/117 [00:01<00:07, 12.97it/s, loss=0.697, v_num=1, val_acc=0.757]
Epoch 78:  19%|█▉        | 22/117 [00:01<00:07, 13.46it/s, loss=0.697, v_num=1, val_acc=0.757]
Epoch 78:  19%|█▉        | 22/117 [00:01<00:07, 13.27it/s, loss=0.696, v_num=1, val_acc=0.757]
Epoch 78:  20%|█▉        | 23/117 [00:01<00:06, 13.80it/s, loss=0.696, v_num=1, val_acc=0.757]
Epoch 78:  20%|█▉        | 23/117 [00:01<00:06, 13.59it/s, loss=0.691, v_num=1, val_acc=0.757]
Epoch 78:  21%|██        | 24/117 [00:01<00:06, 14.11it/s, loss=0.691, v_num=1, val_acc=0.757]
Epoch 78:  21%|██        | 24/117 [00:01<00:06, 13.90it/s, loss=0.694, v_num=1, val_acc=0.757]
Epoch 78:  21%|██▏       | 25/117 [00:01<00:06, 14.41it/s, loss=0.694, v_num=1, val_acc=0.757]
Epoch 78:  21%|██▏       | 25/117 [00:01<00:06, 14.20it/s, loss=0.692, v_num=1, val_acc=0.757]
Epoch 78:  22%|██▏       | 26/117 [00:01<00:06, 14.69it/s, loss=0.692, v_num=1, val_acc=0.757]
Epoch 78:  22%|██▏       | 26/117 [00:01<00:06, 14.48it/s, loss=0.692, v_num=1, val_acc=0.757]
Epoch 78:  23%|██▎       | 27/117 [00:01<00:06, 14.97it/s, loss=0.692, v_num=1, val_acc=0.757]
Epoch 78:  23%|██▎       | 27/117 [00:01<00:06, 14.76it/s, loss=0.692, v_num=1, val_acc=0.757]
Epoch 78:  24%|██▍       | 28/117 [00:01<00:05, 15.23it/s, loss=0.692, v_num=1, val_acc=0.757]
Epoch 78:  24%|██▍       | 28/117 [00:01<00:05, 15.02it/s, loss=0.692, v_num=1, val_acc=0.757]
Epoch 78:  25%|██▍       | 29/117 [00:01<00:05, 15.48it/s, loss=0.692, v_num=1, val_acc=0.757]
Epoch 78:  25%|██▍       | 29/117 [00:01<00:05, 15.28it/s, loss=0.688, v_num=1, val_acc=0.757]
Epoch 78:  26%|██▌       | 30/117 [00:01<00:05, 15.73it/s, loss=0.688, v_num=1, val_acc=0.757]
Epoch 78:  26%|██▌       | 30/117 [00:01<00:05, 15.52it/s, loss=0.683, v_num=1, val_acc=0.757]
Epoch 78:  26%|██▋       | 31/117 [00:01<00:05, 15.96it/s, loss=0.683, v_num=1, val_acc=0.757]
Epoch 78:  26%|██▋       | 31/117 [00:01<00:05, 15.76it/s, loss=0.683, v_num=1, val_acc=0.757]
Epoch 78:  27%|██▋       | 32/117 [00:01<00:05, 16.19it/s, loss=0.683, v_num=1, val_acc=0.757]
Epoch 78:  27%|██▋       | 32/117 [00:02<00:05, 15.99it/s, loss=0.678, v_num=1, val_acc=0.757]
Epoch 78:  28%|██▊       | 33/117 [00:02<00:05, 16.41it/s, loss=0.678, v_num=1, val_acc=0.757]
Epoch 78:  28%|██▊       | 33/117 [00:02<00:05, 16.21it/s, loss=0.682, v_num=1, val_acc=0.757]
Epoch 78:  29%|██▉       | 34/117 [00:02<00:04, 16.62it/s, loss=0.682, v_num=1, val_acc=0.757]
Epoch 78:  29%|██▉       | 34/117 [00:02<00:05, 16.42it/s, loss=0.686, v_num=1, val_acc=0.757]
Epoch 78:  30%|██▉       | 35/117 [00:02<00:04, 16.82it/s, loss=0.686, v_num=1, val_acc=0.757]
Epoch 78:  30%|██▉       | 35/117 [00:02<00:04, 16.62it/s, loss=0.688, v_num=1, val_acc=0.757]
Epoch 78:  31%|███       | 36/117 [00:02<00:04, 17.02it/s, loss=0.688, v_num=1, val_acc=0.757]
Epoch 78:  31%|███       | 36/117 [00:02<00:04, 16.82it/s, loss=0.688, v_num=1, val_acc=0.757]
Epoch 78:  32%|███▏      | 37/117 [00:02<00:04, 17.21it/s, loss=0.688, v_num=1, val_acc=0.757]
Epoch 78:  32%|███▏      | 37/117 [00:02<00:04, 17.01it/s, loss=0.685, v_num=1, val_acc=0.757]
Epoch 78:  32%|███▏      | 38/117 [00:02<00:04, 17.40it/s, loss=0.685, v_num=1, val_acc=0.757]
Epoch 78:  32%|███▏      | 38/117 [00:02<00:04, 17.20it/s, loss=0.685, v_num=1, val_acc=0.757]
Epoch 78:  33%|███▎      | 39/117 [00:02<00:04, 17.58it/s, loss=0.685, v_num=1, val_acc=0.757]
Epoch 78:  33%|███▎      | 39/117 [00:02<00:04, 17.38it/s, loss=0.688, v_num=1, val_acc=0.757]
Epoch 78:  34%|███▍      | 40/117 [00:02<00:04, 17.75it/s, loss=0.688, v_num=1, val_acc=0.757]
Epoch 78:  34%|███▍      | 40/117 [00:02<00:04, 17.56it/s, loss=0.692, v_num=1, val_acc=0.757]
Epoch 78:  35%|███▌      | 41/117 [00:02<00:04, 17.92it/s, loss=0.692, v_num=1, val_acc=0.757]
Epoch 78:  35%|███▌      | 41/117 [00:02<00:04, 17.73it/s, loss=0.693, v_num=1, val_acc=0.757]
Epoch 78:  36%|███▌      | 42/117 [00:02<00:04, 18.09it/s, loss=0.693, v_num=1, val_acc=0.757]
Epoch 78:  36%|███▌      | 42/117 [00:02<00:04, 17.89it/s, loss=0.692, v_num=1, val_acc=0.757]
Epoch 78:  37%|███▋      | 43/117 [00:02<00:04, 18.25it/s, loss=0.692, v_num=1, val_acc=0.757]
Epoch 78:  37%|███▋      | 43/117 [00:02<00:04, 18.05it/s, loss=0.696, v_num=1, val_acc=0.757]
Epoch 78:  38%|███▊      | 44/117 [00:02<00:03, 18.40it/s, loss=0.696, v_num=1, val_acc=0.757]
Epoch 78:  38%|███▊      | 44/117 [00:02<00:04, 18.21it/s, loss=0.693, v_num=1, val_acc=0.757]
Epoch 78:  38%|███▊      | 45/117 [00:02<00:03, 18.55it/s, loss=0.693, v_num=1, val_acc=0.757]
Epoch 78:  38%|███▊      | 45/117 [00:02<00:03, 18.36it/s, loss=0.688, v_num=1, val_acc=0.757]
Epoch 78:  39%|███▉      | 46/117 [00:02<00:03, 18.70it/s, loss=0.688, v_num=1, val_acc=0.757]
Epoch 78:  39%|███▉      | 46/117 [00:02<00:03, 18.51it/s, loss=0.688, v_num=1, val_acc=0.757]
Epoch 78:  40%|████      | 47/117 [00:02<00:03, 18.84it/s, loss=0.688, v_num=1, val_acc=0.757]
Epoch 78:  40%|████      | 47/117 [00:02<00:03, 18.65it/s, loss=0.687, v_num=1, val_acc=0.757]
Epoch 78:  41%|████      | 48/117 [00:02<00:03, 18.98it/s, loss=0.687, v_num=1, val_acc=0.757]
Epoch 78:  41%|████      | 48/117 [00:02<00:03, 18.79it/s, loss=0.691, v_num=1, val_acc=0.757]
Epoch 78:  42%|████▏     | 49/117 [00:02<00:03, 19.12it/s, loss=0.691, v_num=1, val_acc=0.757]
Epoch 78:  42%|████▏     | 49/117 [00:02<00:03, 18.93it/s, loss=0.691, v_num=1, val_acc=0.757]
Epoch 78:  43%|████▎     | 50/117 [00:02<00:03, 19.25it/s, loss=0.691, v_num=1, val_acc=0.757]
Epoch 78:  43%|████▎     | 50/117 [00:02<00:03, 19.06it/s, loss=0.688, v_num=1, val_acc=0.757]
Epoch 78:  44%|████▎     | 51/117 [00:02<00:03, 19.38it/s, loss=0.688, v_num=1, val_acc=0.757]
Epoch 78:  44%|████▎     | 51/117 [00:02<00:03, 19.19it/s, loss=0.688, v_num=1, val_acc=0.757]
Epoch 78:  44%|████▍     | 52/117 [00:02<00:03, 19.50it/s, loss=0.688, v_num=1, val_acc=0.757]
Epoch 78:  44%|████▍     | 52/117 [00:02<00:03, 19.32it/s, loss=0.682, v_num=1, val_acc=0.757]
Epoch 78:  45%|████▌     | 53/117 [00:02<00:03, 19.62it/s, loss=0.682, v_num=1, val_acc=0.757]
Epoch 78:  45%|████▌     | 53/117 [00:02<00:03, 19.44it/s, loss=0.68, v_num=1, val_acc=0.757]
Epoch 78:  46%|████▌     | 54/117 [00:02<00:03, 19.74it/s, loss=0.68, v_num=1, val_acc=0.757]
Epoch 78:  46%|████▌     | 54/117 [00:02<00:03, 19.56it/s, loss=0.676, v_num=1, val_acc=0.757]
Epoch 78:  47%|████▋     | 55/117 [00:02<00:03, 19.85it/s, loss=0.676, v_num=1, val_acc=0.757]
Epoch 78:  47%|████▋     | 55/117 [00:02<00:03, 19.67it/s, loss=0.675, v_num=1, val_acc=0.757]
Epoch 78:  48%|████▊     | 56/117 [00:02<00:03, 19.96it/s, loss=0.675, v_num=1, val_acc=0.757]
Epoch 78:  48%|████▊     | 56/117 [00:02<00:03, 19.79it/s, loss=0.681, v_num=1, val_acc=0.757]
Epoch 78:  49%|████▊     | 57/117 [00:02<00:02, 20.08it/s, loss=0.681, v_num=1, val_acc=0.757]
Epoch 78:  49%|████▊     | 57/117 [00:02<00:03, 19.90it/s, loss=0.679, v_num=1, val_acc=0.757]
Epoch 78:  50%|████▉     | 58/117 [00:02<00:02, 20.18it/s, loss=0.679, v_num=1, val_acc=0.757]
Epoch 78:  50%|████▉     | 58/117 [00:02<00:02, 20.01it/s, loss=0.675, v_num=1, val_acc=0.757]
Epoch 78:  50%|█████     | 59/117 [00:02<00:02, 20.29it/s, loss=0.675, v_num=1, val_acc=0.757]
Epoch 78:  50%|█████     | 59/117 [00:02<00:02, 20.11it/s, loss=0.674, v_num=1, val_acc=0.757]
Epoch 78:  51%|█████▏    | 60/117 [00:02<00:02, 20.39it/s, loss=0.674, v_num=1, val_acc=0.757]
Epoch 78:  51%|█████▏    | 60/117 [00:02<00:02, 20.22it/s, loss=0.667, v_num=1, val_acc=0.757]
Epoch 78:  52%|█████▏    | 61/117 [00:02<00:02, 20.49it/s, loss=0.667, v_num=1, val_acc=0.757]
Epoch 78:  52%|█████▏    | 61/117 [00:03<00:02, 20.32it/s, loss=0.663, v_num=1, val_acc=0.757]
Epoch 78:  53%|█████▎    | 62/117 [00:03<00:02, 20.59it/s, loss=0.663, v_num=1, val_acc=0.757]
Epoch 78:  53%|█████▎    | 62/117 [00:03<00:02, 20.42it/s, loss=0.663, v_num=1, val_acc=0.757]
Epoch 78:  54%|█████▍    | 63/117 [00:03<00:02, 20.68it/s, loss=0.663, v_num=1, val_acc=0.757]
Epoch 78:  54%|█████▍    | 63/117 [00:03<00:02, 20.51it/s, loss=0.665, v_num=1, val_acc=0.757]
Epoch 78:  55%|█████▍    | 64/117 [00:03<00:02, 20.77it/s, loss=0.665, v_num=1, val_acc=0.757]
Epoch 78:  55%|█████▍    | 64/117 [00:03<00:02, 20.61it/s, loss=0.668, v_num=1, val_acc=0.757]
Epoch 78:  56%|█████▌    | 65/117 [00:03<00:02, 20.87it/s, loss=0.668, v_num=1, val_acc=0.757]
Epoch 78:  56%|█████▌    | 65/117 [00:03<00:02, 20.70it/s, loss=0.671, v_num=1, val_acc=0.757]
Epoch 78:  56%|█████▋    | 66/117 [00:03<00:02, 20.96it/s, loss=0.671, v_num=1, val_acc=0.757]
Epoch 78:  56%|█████▋    | 66/117 [00:03<00:02, 20.79it/s, loss=0.674, v_num=1, val_acc=0.757]
Epoch 78:  57%|█████▋    | 67/117 [00:03<00:02, 21.04it/s, loss=0.674, v_num=1, val_acc=0.757]
Epoch 78:  57%|█████▋    | 67/117 [00:03<00:02, 20.88it/s, loss=0.675, v_num=1, val_acc=0.757]
Epoch 78:  58%|█████▊    | 68/117 [00:03<00:02, 21.13it/s, loss=0.675, v_num=1, val_acc=0.757]
Epoch 78:  58%|█████▊    | 68/117 [00:03<00:02, 20.96it/s, loss=0.673, v_num=1, val_acc=0.757]
Epoch 78:  59%|█████▉    | 69/117 [00:03<00:02, 21.21it/s, loss=0.673, v_num=1, val_acc=0.757]
Epoch 78:  59%|█████▉    | 69/117 [00:03<00:02, 21.05it/s, loss=0.677, v_num=1, val_acc=0.757]
Epoch 78:  60%|█████▉    | 70/117 [00:03<00:02, 21.29it/s, loss=0.677, v_num=1, val_acc=0.757]
Epoch 78:  60%|█████▉    | 70/117 [00:03<00:02, 21.13it/s, loss=0.677, v_num=1, val_acc=0.757]
Epoch 78:  61%|██████    | 71/117 [00:03<00:02, 21.37it/s, loss=0.677, v_num=1, val_acc=0.757]
Epoch 78:  61%|██████    | 71/117 [00:03<00:02, 21.21it/s, loss=0.681, v_num=1, val_acc=0.757]
Epoch 78:  62%|██████▏   | 72/117 [00:03<00:02, 21.45it/s, loss=0.681, v_num=1, val_acc=0.757]
Epoch 78:  62%|██████▏   | 72/117 [00:03<00:02, 21.29it/s, loss=0.688, v_num=1, val_acc=0.757]
Epoch 78:  62%|██████▏   | 73/117 [00:03<00:02, 21.53it/s, loss=0.688, v_num=1, val_acc=0.757]
Epoch 78:  62%|██████▏   | 73/117 [00:03<00:02, 21.37it/s, loss=0.684, v_num=1, val_acc=0.757]
Epoch 78:  63%|██████▎   | 74/117 [00:03<00:01, 21.61it/s, loss=0.684, v_num=1, val_acc=0.757]
Epoch 78:  63%|██████▎   | 74/117 [00:03<00:02, 21.45it/s, loss=0.684, v_num=1, val_acc=0.757]
Epoch 78:  64%|██████▍   | 75/117 [00:03<00:01, 21.68it/s, loss=0.684, v_num=1, val_acc=0.757]
Epoch 78:  64%|██████▍   | 75/117 [00:03<00:01, 21.52it/s, loss=0.683, v_num=1, val_acc=0.757]
Epoch 78:  65%|██████▍   | 76/117 [00:03<00:01, 21.75it/s, loss=0.683, v_num=1, val_acc=0.757]
Epoch 78:  65%|██████▍   | 76/117 [00:03<00:01, 21.59it/s, loss=0.68, v_num=1, val_acc=0.757]
Epoch 78:  66%|██████▌   | 77/117 [00:03<00:01, 21.82it/s, loss=0.68, v_num=1, val_acc=0.757]
Epoch 78:  66%|██████▌   | 77/117 [00:03<00:01, 21.67it/s, loss=0.686, v_num=1, val_acc=0.757]
Epoch 78:  67%|██████▋   | 78/117 [00:03<00:01, 21.89it/s, loss=0.686, v_num=1, val_acc=0.757]
Epoch 78:  67%|██████▋   | 78/117 [00:03<00:01, 21.74it/s, loss=0.691, v_num=1, val_acc=0.757]
Epoch 78:  68%|██████▊   | 79/117 [00:03<00:01, 21.96it/s, loss=0.691, v_num=1, val_acc=0.757]
Epoch 78:  68%|██████▊   | 79/117 [00:03<00:01, 21.81it/s, loss=0.695, v_num=1, val_acc=0.757]
Epoch 78:  68%|██████▊   | 80/117 [00:03<00:01, 22.03it/s, loss=0.695, v_num=1, val_acc=0.757]
Epoch 78:  68%|██████▊   | 80/117 [00:03<00:01, 21.88it/s, loss=0.702, v_num=1, val_acc=0.757]
Epoch 78:  69%|██████▉   | 81/117 [00:03<00:01, 22.09it/s, loss=0.702, v_num=1, val_acc=0.757]
Epoch 78:  69%|██████▉   | 81/117 [00:03<00:01, 21.94it/s, loss=0.703, v_num=1, val_acc=0.757]
Epoch 78:  70%|███████   | 82/117 [00:03<00:01, 22.13it/s, loss=0.703, v_num=1, val_acc=0.757]
Epoch 78:  70%|███████   | 82/117 [00:03<00:01, 21.98it/s, loss=0.705, v_num=1, val_acc=0.757]
Epoch 78:  71%|███████   | 83/117 [00:03<00:01, 22.20it/s, loss=0.705, v_num=1, val_acc=0.757]
Epoch 78:  71%|███████   | 83/117 [00:03<00:01, 22.05it/s, loss=0.708, v_num=1, val_acc=0.757]
Epoch 78:  72%|███████▏  | 84/117 [00:03<00:01, 22.26it/s, loss=0.708, v_num=1, val_acc=0.757]
Epoch 78:  72%|███████▏  | 84/117 [00:03<00:01, 22.11it/s, loss=0.709, v_num=1, val_acc=0.757]
Epoch 78:  73%|███████▎  | 85/117 [00:03<00:01, 22.32it/s, loss=0.709, v_num=1, val_acc=0.757]
Epoch 78:  73%|███████▎  | 85/117 [00:03<00:01, 22.17it/s, loss=0.708, v_num=1, val_acc=0.757]
Epoch 78:  74%|███████▎  | 86/117 [00:03<00:01, 22.38it/s, loss=0.708, v_num=1, val_acc=0.757]
Epoch 78:  74%|███████▎  | 86/117 [00:03<00:01, 22.23it/s, loss=0.713, v_num=1, val_acc=0.757]
Epoch 78:  74%|███████▍  | 87/117 [00:03<00:01, 22.44it/s, loss=0.713, v_num=1, val_acc=0.757]
Epoch 78:  74%|███████▍  | 87/117 [00:03<00:01, 22.30it/s, loss=0.715, v_num=1, val_acc=0.757]
Epoch 78:  75%|███████▌  | 88/117 [00:03<00:01, 22.50it/s, loss=0.715, v_num=1, val_acc=0.757]
Epoch 78:  75%|███████▌  | 88/117 [00:03<00:01, 22.36it/s, loss=0.714, v_num=1, val_acc=0.757]
Epoch 78:  76%|███████▌  | 89/117 [00:03<00:01, 22.56it/s, loss=0.714, v_num=1, val_acc=0.757]
Epoch 78:  76%|███████▌  | 89/117 [00:03<00:01, 22.41it/s, loss=0.715, v_num=1, val_acc=0.757]
Epoch 78:  77%|███████▋  | 90/117 [00:03<00:01, 22.62it/s, loss=0.715, v_num=1, val_acc=0.757]
Epoch 78:  77%|███████▋  | 90/117 [00:04<00:01, 22.47it/s, loss=0.716, v_num=1, val_acc=0.757]
Epoch 78:  78%|███████▊  | 91/117 [00:04<00:01, 22.67it/s, loss=0.716, v_num=1, val_acc=0.757]
Epoch 78:  78%|███████▊  | 91/117 [00:04<00:01, 22.53it/s, loss=0.715, v_num=1, val_acc=0.757]
Epoch 78:  79%|███████▊  | 92/117 [00:04<00:01, 22.73it/s, loss=0.715, v_num=1, val_acc=0.757]
Epoch 78:  79%|███████▊  | 92/117 [00:04<00:01, 22.58it/s, loss=0.718, v_num=1, val_acc=0.757]
Epoch 78:  79%|███████▉  | 93/117 [00:04<00:01, 22.78it/s, loss=0.718, v_num=1, val_acc=0.757]
Epoch 78:  79%|███████▉  | 93/117 [00:04<00:01, 22.64it/s, loss=0.718, v_num=1, val_acc=0.757]
Epoch 78:  80%|████████  | 94/117 [00:04<00:01, 22.83it/s, loss=0.718, v_num=1, val_acc=0.757]
Epoch 78:  80%|████████  | 94/117 [00:04<00:01, 22.69it/s, loss=0.72, v_num=1, val_acc=0.757]
Epoch 78:  81%|████████  | 95/117 [00:04<00:00, 22.88it/s, loss=0.72, v_num=1, val_acc=0.757]
Epoch 78:  81%|████████  | 95/117 [00:04<00:00, 22.74it/s, loss=0.724, v_num=1, val_acc=0.757]
Epoch 78:  82%|████████▏ | 96/117 [00:04<00:00, 22.93it/s, loss=0.724, v_num=1, val_acc=0.757]
Epoch 78:  82%|████████▏ | 96/117 [00:04<00:00, 22.79it/s, loss=0.724, v_num=1, val_acc=0.757]
Epoch 78:  83%|████████▎ | 97/117 [00:04<00:00, 22.98it/s, loss=0.724, v_num=1, val_acc=0.757]
Epoch 78:  83%|████████▎ | 97/117 [00:04<00:00, 22.84it/s, loss=0.716, v_num=1, val_acc=0.757]

Validation: 0it [00:00, ?it/s]

Validation:   0%|          | 0/20 [00:00<?, ?it/s]

Validation DataLoader 0:   0%|          | 0/20 [00:00<?, ?it/s]

Validation DataLoader 0:   5%|▌         | 1/20 [00:00<00:00, 176.82it/s]
Epoch 78:  84%|████████▍ | 98/117 [00:05<00:00, 19.24it/s, loss=0.716, v_num=1, val_acc=0.757]

Validation DataLoader 0:  10%|█         | 2/20 [00:00<00:00, 55.71it/s]
Epoch 78:  85%|████████▍ | 99/117 [00:05<00:00, 19.32it/s, loss=0.716, v_num=1, val_acc=0.757]

Validation DataLoader 0:  15%|█▌        | 3/20 [00:00<00:00, 44.28it/s]
Epoch 78:  85%|████████▌ | 100/117 [00:05<00:00, 19.40it/s, loss=0.716, v_num=1, val_acc=0.757]

Validation DataLoader 0:  20%|██        | 4/20 [00:00<00:00, 40.33it/s]
Epoch 78:  86%|████████▋ | 101/117 [00:05<00:00, 19.47it/s, loss=0.716, v_num=1, val_acc=0.757]

Validation DataLoader 0:  25%|██▌       | 5/20 [00:00<00:00, 38.19it/s]
Epoch 78:  87%|████████▋ | 102/117 [00:05<00:00, 19.55it/s, loss=0.716, v_num=1, val_acc=0.757]

Validation DataLoader 0:  30%|███       | 6/20 [00:00<00:00, 36.91it/s]
Epoch 78:  88%|████████▊ | 103/117 [00:05<00:00, 19.62it/s, loss=0.716, v_num=1, val_acc=0.757]

Validation DataLoader 0:  35%|███▌      | 7/20 [00:00<00:00, 36.06it/s]
Epoch 78:  89%|████████▉ | 104/117 [00:05<00:00, 19.69it/s, loss=0.716, v_num=1, val_acc=0.757]

Validation DataLoader 0:  40%|████      | 8/20 [00:00<00:00, 35.44it/s]
Epoch 78:  90%|████████▉ | 105/117 [00:05<00:00, 19.76it/s, loss=0.716, v_num=1, val_acc=0.757]

Validation DataLoader 0:  45%|████▌     | 9/20 [00:00<00:00, 34.96it/s]
Epoch 78:  91%|█████████ | 106/117 [00:05<00:00, 19.83it/s, loss=0.716, v_num=1, val_acc=0.757]

Validation DataLoader 0:  50%|█████     | 10/20 [00:00<00:00, 34.59it/s]
Epoch 78:  91%|█████████▏| 107/117 [00:05<00:00, 19.90it/s, loss=0.716, v_num=1, val_acc=0.757]

Validation DataLoader 0:  55%|█████▌    | 11/20 [00:00<00:00, 34.32it/s]
Epoch 78:  92%|█████████▏| 108/117 [00:05<00:00, 19.97it/s, loss=0.716, v_num=1, val_acc=0.757]

Validation DataLoader 0:  60%|██████    | 12/20 [00:00<00:00, 34.07it/s]
Epoch 78:  93%|█████████▎| 109/117 [00:05<00:00, 20.04it/s, loss=0.716, v_num=1, val_acc=0.757]

Validation DataLoader 0:  65%|██████▌   | 13/20 [00:00<00:00, 33.87it/s]
Epoch 78:  94%|█████████▍| 110/117 [00:05<00:00, 20.10it/s, loss=0.716, v_num=1, val_acc=0.757]

Validation DataLoader 0:  70%|███████   | 14/20 [00:00<00:00, 33.72it/s]
Epoch 78:  95%|█████████▍| 111/117 [00:05<00:00, 20.17it/s, loss=0.716, v_num=1, val_acc=0.757]

Validation DataLoader 0:  75%|███████▌  | 15/20 [00:00<00:00, 33.56it/s]
Epoch 78:  96%|█████████▌| 112/117 [00:05<00:00, 20.24it/s, loss=0.716, v_num=1, val_acc=0.757]

Validation DataLoader 0:  80%|████████  | 16/20 [00:00<00:00, 33.42it/s]
Epoch 78:  97%|█████████▋| 113/117 [00:05<00:00, 20.30it/s, loss=0.716, v_num=1, val_acc=0.757]

Validation DataLoader 0:  85%|████████▌ | 17/20 [00:00<00:00, 33.30it/s]
Epoch 78:  97%|█████████▋| 114/117 [00:05<00:00, 20.36it/s, loss=0.716, v_num=1, val_acc=0.757]

Validation DataLoader 0:  90%|█████████ | 18/20 [00:00<00:00, 33.20it/s]
Epoch 78:  98%|█████████▊| 115/117 [00:05<00:00, 20.43it/s, loss=0.716, v_num=1, val_acc=0.757]

Validation DataLoader 0:  95%|█████████▌| 19/20 [00:00<00:00, 33.10it/s]
Epoch 78:  99%|█████████▉| 116/117 [00:05<00:00, 20.49it/s, loss=0.716, v_num=1, val_acc=0.757]

Validation DataLoader 0: 100%|██████████| 20/20 [00:00<00:00, 33.09it/s]
Epoch 78: 100%|██████████| 117/117 [00:05<00:00, 20.56it/s, loss=0.716, v_num=1, val_acc=0.757]
Epoch 78: 100%|██████████| 117/117 [00:05<00:00, 20.48it/s, loss=0.716, v_num=1, val_acc=0.756]


Epoch 78: 100%|██████████| 117/117 [00:05<00:00, 20.48it/s, loss=0.716, v_num=1, val_acc=0.756]
Epoch 78:   0%|          | 0/117 [00:00<?, ?it/s, loss=0.716, v_num=1, val_acc=0.756]
Epoch 79:   0%|          | 0/117 [00:00<?, ?it/s, loss=0.716, v_num=1, val_acc=0.756]
Epoch 79:   1%|          | 1/117 [00:00<01:46,  1.09it/s, loss=0.716, v_num=1, val_acc=0.756]
Epoch 79:   1%|          | 1/117 [00:00<01:49,  1.06it/s, loss=0.721, v_num=1, val_acc=0.756]
Epoch 79:   2%|▏         | 2/117 [00:00<00:54,  2.10it/s, loss=0.721, v_num=1, val_acc=0.756]
Epoch 79:   2%|▏         | 2/117 [00:00<00:56,  2.05it/s, loss=0.713, v_num=1, val_acc=0.756]
Epoch 79:   3%|▎         | 3/117 [00:00<00:37,  3.04it/s, loss=0.713, v_num=1, val_acc=0.756]
Epoch 79:   3%|▎         | 3/117 [00:01<00:38,  2.96it/s, loss=0.712, v_num=1, val_acc=0.756]
Epoch 79:   3%|▎         | 4/117 [00:01<00:28,  3.92it/s, loss=0.712, v_num=1, val_acc=0.756]
Epoch 79:   3%|▎         | 4/117 [00:01<00:29,  3.82it/s, loss=0.711, v_num=1, val_acc=0.756]
Epoch 79:   4%|▍         | 5/117 [00:01<00:23,  4.74it/s, loss=0.711, v_num=1, val_acc=0.756]
Epoch 79:   4%|▍         | 5/117 [00:01<00:24,  4.63it/s, loss=0.706, v_num=1, val_acc=0.756]
Epoch 79:   5%|▌         | 6/117 [00:01<00:20,  5.51it/s, loss=0.706, v_num=1, val_acc=0.756]
Epoch 79:   5%|▌         | 6/117 [00:01<00:20,  5.39it/s, loss=0.708, v_num=1, val_acc=0.756]
Epoch 79:   6%|▌         | 7/117 [00:01<00:17,  6.23it/s, loss=0.708, v_num=1, val_acc=0.756]
Epoch 79:   6%|▌         | 7/117 [00:01<00:18,  6.09it/s, loss=0.708, v_num=1, val_acc=0.756]
Epoch 79:   7%|▋         | 8/117 [00:01<00:15,  6.91it/s, loss=0.708, v_num=1, val_acc=0.756]
Epoch 79:   7%|▋         | 8/117 [00:01<00:16,  6.76it/s, loss=0.705, v_num=1, val_acc=0.756]
Epoch 79:   8%|▊         | 9/117 [00:01<00:14,  7.54it/s, loss=0.705, v_num=1, val_acc=0.756]
Epoch 79:   8%|▊         | 9/117 [00:01<00:14,  7.39it/s, loss=0.696, v_num=1, val_acc=0.756]
Epoch 79:   9%|▊         | 10/117 [00:01<00:13,  8.14it/s, loss=0.696, v_num=1, val_acc=0.756]
Epoch 79:   9%|▊         | 10/117 [00:01<00:13,  7.98it/s, loss=0.7, v_num=1, val_acc=0.756]
Epoch 79:   9%|▉         | 11/117 [00:01<00:12,  8.70it/s, loss=0.7, v_num=1, val_acc=0.756]
Epoch 79:   9%|▉         | 11/117 [00:01<00:12,  8.53it/s, loss=0.698, v_num=1, val_acc=0.756]
Epoch 79:  10%|█         | 12/117 [00:01<00:11,  9.24it/s, loss=0.698, v_num=1, val_acc=0.756]
Epoch 79:  10%|█         | 12/117 [00:01<00:11,  9.07it/s, loss=0.697, v_num=1, val_acc=0.756]
Epoch 79:  11%|█         | 13/117 [00:01<00:10,  9.75it/s, loss=0.697, v_num=1, val_acc=0.756]
Epoch 79:  11%|█         | 13/117 [00:01<00:10,  9.57it/s, loss=0.695, v_num=1, val_acc=0.756]
Epoch 79:  12%|█▏        | 14/117 [00:01<00:10, 10.24it/s, loss=0.695, v_num=1, val_acc=0.756]
Epoch 79:  12%|█▏        | 14/117 [00:01<00:10, 10.05it/s, loss=0.699, v_num=1, val_acc=0.756]
Epoch 79:  13%|█▎        | 15/117 [00:01<00:09, 10.70it/s, loss=0.699, v_num=1, val_acc=0.756]
Epoch 79:  13%|█▎        | 15/117 [00:01<00:09, 10.51it/s, loss=0.693, v_num=1, val_acc=0.756]
Epoch 79:  14%|█▎        | 16/117 [00:01<00:09, 11.14it/s, loss=0.693, v_num=1, val_acc=0.756]
Epoch 79:  14%|█▎        | 16/117 [00:01<00:09, 10.95it/s, loss=0.697, v_num=1, val_acc=0.756]
Epoch 79:  15%|█▍        | 17/117 [00:01<00:08, 11.55it/s, loss=0.697, v_num=1, val_acc=0.756]
Epoch 79:  15%|█▍        | 17/117 [00:01<00:08, 11.36it/s, loss=0.696, v_num=1, val_acc=0.756]
Epoch 79:  15%|█▌        | 18/117 [00:01<00:08, 11.94it/s, loss=0.696, v_num=1, val_acc=0.756]
Epoch 79:  15%|█▌        | 18/117 [00:01<00:08, 11.75it/s, loss=0.696, v_num=1, val_acc=0.756]
Epoch 79:  16%|█▌        | 19/117 [00:01<00:07, 12.27it/s, loss=0.696, v_num=1, val_acc=0.756]
Epoch 79:  16%|█▌        | 19/117 [00:01<00:08, 12.09it/s, loss=0.697, v_num=1, val_acc=0.756]
Epoch 79:  17%|█▋        | 20/117 [00:01<00:07, 12.66it/s, loss=0.697, v_num=1, val_acc=0.756]
Epoch 79:  17%|█▋        | 20/117 [00:01<00:07, 12.46it/s, loss=0.697, v_num=1, val_acc=0.756]
Epoch 79:  18%|█▊        | 21/117 [00:01<00:07, 13.02it/s, loss=0.697, v_num=1, val_acc=0.756]
Epoch 79:  18%|█▊        | 21/117 [00:01<00:07, 12.81it/s, loss=0.692, v_num=1, val_acc=0.756]
Epoch 79:  19%|█▉        | 22/117 [00:01<00:07, 13.35it/s, loss=0.692, v_num=1, val_acc=0.756]
Epoch 79:  19%|█▉        | 22/117 [00:01<00:07, 13.15it/s, loss=0.697, v_num=1, val_acc=0.756]
Epoch 79:  20%|█▉        | 23/117 [00:01<00:06, 13.67it/s, loss=0.697, v_num=1, val_acc=0.756]
Epoch 79:  20%|█▉        | 23/117 [00:01<00:06, 13.47it/s, loss=0.697, v_num=1, val_acc=0.756]
Epoch 79:  21%|██        | 24/117 [00:01<00:06, 13.98it/s, loss=0.697, v_num=1, val_acc=0.756]
Epoch 79:  21%|██        | 24/117 [00:01<00:06, 13.77it/s, loss=0.699, v_num=1, val_acc=0.756]
Epoch 79:  21%|██▏       | 25/117 [00:01<00:06, 14.27it/s, loss=0.699, v_num=1, val_acc=0.756]
Epoch 79:  21%|██▏       | 25/117 [00:01<00:06, 14.07it/s, loss=0.704, v_num=1, val_acc=0.756]
Epoch 79:  22%|██▏       | 26/117 [00:01<00:06, 14.56it/s, loss=0.704, v_num=1, val_acc=0.756]
Epoch 79:  22%|██▏       | 26/117 [00:01<00:06, 14.35it/s, loss=0.7, v_num=1, val_acc=0.756]
Epoch 79:  23%|██▎       | 27/117 [00:01<00:06, 14.82it/s, loss=0.7, v_num=1, val_acc=0.756]
Epoch 79:  23%|██▎       | 27/117 [00:01<00:06, 14.62it/s, loss=0.698, v_num=1, val_acc=0.756]
Epoch 79:  24%|██▍       | 28/117 [00:01<00:05, 15.09it/s, loss=0.698, v_num=1, val_acc=0.756]
Epoch 79:  24%|██▍       | 28/117 [00:01<00:05, 14.89it/s, loss=0.699, v_num=1, val_acc=0.756]
Epoch 79:  25%|██▍       | 29/117 [00:01<00:05, 15.35it/s, loss=0.699, v_num=1, val_acc=0.756]
Epoch 79:  25%|██▍       | 29/117 [00:01<00:05, 15.14it/s, loss=0.701, v_num=1, val_acc=0.756]
Epoch 79:  26%|██▌       | 30/117 [00:01<00:05, 15.59it/s, loss=0.701, v_num=1, val_acc=0.756]
Epoch 79:  26%|██▌       | 30/117 [00:01<00:05, 15.39it/s, loss=0.69, v_num=1, val_acc=0.756]
Epoch 79:  26%|██▋       | 31/117 [00:01<00:05, 15.79it/s, loss=0.69, v_num=1, val_acc=0.756]
Epoch 79:  26%|██▋       | 31/117 [00:01<00:05, 15.60it/s, loss=0.7, v_num=1, val_acc=0.756]
Epoch 79:  27%|██▋       | 32/117 [00:01<00:05, 16.03it/s, loss=0.7, v_num=1, val_acc=0.756]
Epoch 79:  27%|██▋       | 32/117 [00:02<00:05, 15.83it/s, loss=0.698, v_num=1, val_acc=0.756]
Epoch 79:  28%|██▊       | 33/117 [00:02<00:05, 16.25it/s, loss=0.698, v_num=1, val_acc=0.756]
Epoch 79:  28%|██▊       | 33/117 [00:02<00:05, 16.05it/s, loss=0.698, v_num=1, val_acc=0.756]
Epoch 79:  29%|██▉       | 34/117 [00:02<00:05, 16.47it/s, loss=0.698, v_num=1, val_acc=0.756]
Epoch 79:  29%|██▉       | 34/117 [00:02<00:05, 16.27it/s, loss=0.693, v_num=1, val_acc=0.756]
Epoch 79:  30%|██▉       | 35/117 [00:02<00:04, 16.67it/s, loss=0.693, v_num=1, val_acc=0.756]
Epoch 79:  30%|██▉       | 35/117 [00:02<00:04, 16.47it/s, loss=0.693, v_num=1, val_acc=0.756]
Epoch 79:  31%|███       | 36/117 [00:02<00:04, 16.87it/s, loss=0.693, v_num=1, val_acc=0.756]
Epoch 79:  31%|███       | 36/117 [00:02<00:04, 16.67it/s, loss=0.688, v_num=1, val_acc=0.756]
Epoch 79:  32%|███▏      | 37/117 [00:02<00:04, 17.06it/s, loss=0.688, v_num=1, val_acc=0.756]
Epoch 79:  32%|███▏      | 37/117 [00:02<00:04, 16.87it/s, loss=0.692, v_num=1, val_acc=0.756]
Epoch 79:  32%|███▏      | 38/117 [00:02<00:04, 17.24it/s, loss=0.692, v_num=1, val_acc=0.756]
Epoch 79:  32%|███▏      | 38/117 [00:02<00:04, 17.04it/s, loss=0.694, v_num=1, val_acc=0.756]
Epoch 79:  33%|███▎      | 39/117 [00:02<00:04, 17.42it/s, loss=0.694, v_num=1, val_acc=0.756]
Epoch 79:  33%|███▎      | 39/117 [00:02<00:04, 17.23it/s, loss=0.695, v_num=1, val_acc=0.756]
Epoch 79:  34%|███▍      | 40/117 [00:02<00:04, 17.60it/s, loss=0.695, v_num=1, val_acc=0.756]
Epoch 79:  34%|███▍      | 40/117 [00:02<00:04, 17.41it/s, loss=0.7, v_num=1, val_acc=0.756]
Epoch 79:  35%|███▌      | 41/117 [00:02<00:04, 17.77it/s, loss=0.7, v_num=1, val_acc=0.756]
Epoch 79:  35%|███▌      | 41/117 [00:02<00:04, 17.58it/s, loss=0.7, v_num=1, val_acc=0.756]
Epoch 79:  36%|███▌      | 42/117 [00:02<00:04, 17.93it/s, loss=0.7, v_num=1, val_acc=0.756]
Epoch 79:  36%|███▌      | 42/117 [00:02<00:04, 17.74it/s, loss=0.701, v_num=1, val_acc=0.756]
Epoch 79:  37%|███▋      | 43/117 [00:02<00:04, 18.09it/s, loss=0.701, v_num=1, val_acc=0.756]
Epoch 79:  37%|███▋      | 43/117 [00:02<00:04, 17.90it/s, loss=0.697, v_num=1, val_acc=0.756]
Epoch 79:  38%|███▊      | 44/117 [00:02<00:04, 18.25it/s, loss=0.697, v_num=1, val_acc=0.756]
Epoch 79:  38%|███▊      | 44/117 [00:02<00:04, 18.06it/s, loss=0.695, v_num=1, val_acc=0.756]
Epoch 79:  38%|███▊      | 45/117 [00:02<00:03, 18.40it/s, loss=0.695, v_num=1, val_acc=0.756]
Epoch 79:  38%|███▊      | 45/117 [00:02<00:03, 18.21it/s, loss=0.687, v_num=1, val_acc=0.756]
Epoch 79:  39%|███▉      | 46/117 [00:02<00:03, 18.55it/s, loss=0.687, v_num=1, val_acc=0.756]
Epoch 79:  39%|███▉      | 46/117 [00:02<00:03, 18.36it/s, loss=0.687, v_num=1, val_acc=0.756]
Epoch 79:  40%|████      | 47/117 [00:02<00:03, 18.69it/s, loss=0.687, v_num=1, val_acc=0.756]
Epoch 79:  40%|████      | 47/117 [00:02<00:03, 18.51it/s, loss=0.69, v_num=1, val_acc=0.756]
Epoch 79:  41%|████      | 48/117 [00:02<00:03, 18.83it/s, loss=0.69, v_num=1, val_acc=0.756]
Epoch 79:  41%|████      | 48/117 [00:02<00:03, 18.65it/s, loss=0.692, v_num=1, val_acc=0.756]
Epoch 79:  42%|████▏     | 49/117 [00:02<00:03, 18.97it/s, loss=0.692, v_num=1, val_acc=0.756]
Epoch 79:  42%|████▏     | 49/117 [00:02<00:03, 18.79it/s, loss=0.696, v_num=1, val_acc=0.756]
Epoch 79:  43%|████▎     | 50/117 [00:02<00:03, 19.10it/s, loss=0.696, v_num=1, val_acc=0.756]
Epoch 79:  43%|████▎     | 50/117 [00:02<00:03, 18.92it/s, loss=0.706, v_num=1, val_acc=0.756]
Epoch 79:  44%|████▎     | 51/117 [00:02<00:03, 19.23it/s, loss=0.706, v_num=1, val_acc=0.756]
Epoch 79:  44%|████▎     | 51/117 [00:02<00:03, 19.05it/s, loss=0.7, v_num=1, val_acc=0.756]
Epoch 79:  44%|████▍     | 52/117 [00:02<00:03, 19.36it/s, loss=0.7, v_num=1, val_acc=0.756]
Epoch 79:  44%|████▍     | 52/117 [00:02<00:03, 19.18it/s, loss=0.705, v_num=1, val_acc=0.756]
Epoch 79:  45%|████▌     | 53/117 [00:02<00:03, 19.47it/s, loss=0.705, v_num=1, val_acc=0.756]
Epoch 79:  45%|████▌     | 53/117 [00:02<00:03, 19.30it/s, loss=0.708, v_num=1, val_acc=0.756]
Epoch 79:  46%|████▌     | 54/117 [00:02<00:03, 19.60it/s, loss=0.708, v_num=1, val_acc=0.756]
Epoch 79:  46%|████▌     | 54/117 [00:02<00:03, 19.42it/s, loss=0.708, v_num=1, val_acc=0.756]
Epoch 79:  47%|████▋     | 55/117 [00:02<00:03, 19.71it/s, loss=0.708, v_num=1, val_acc=0.756]
Epoch 79:  47%|████▋     | 55/117 [00:02<00:03, 19.54it/s, loss=0.709, v_num=1, val_acc=0.756]
Epoch 79:  48%|████▊     | 56/117 [00:02<00:03, 19.83it/s, loss=0.709, v_num=1, val_acc=0.756]
Epoch 79:  48%|████▊     | 56/117 [00:02<00:03, 19.65it/s, loss=0.712, v_num=1, val_acc=0.756]
Epoch 79:  49%|████▊     | 57/117 [00:02<00:03, 19.94it/s, loss=0.712, v_num=1, val_acc=0.756]
Epoch 79:  49%|████▊     | 57/117 [00:02<00:03, 19.76it/s, loss=0.707, v_num=1, val_acc=0.756]
Epoch 79:  50%|████▉     | 58/117 [00:02<00:02, 20.05it/s, loss=0.707, v_num=1, val_acc=0.756]
Epoch 79:  50%|████▉     | 58/117 [00:02<00:02, 19.87it/s, loss=0.701, v_num=1, val_acc=0.756]
Epoch 79:  50%|█████     | 59/117 [00:02<00:02, 20.15it/s, loss=0.701, v_num=1, val_acc=0.756]
Epoch 79:  50%|█████     | 59/117 [00:02<00:02, 19.98it/s, loss=0.698, v_num=1, val_acc=0.756]
Epoch 79:  51%|█████▏    | 60/117 [00:02<00:02, 20.26it/s, loss=0.698, v_num=1, val_acc=0.756]
Epoch 79:  51%|█████▏    | 60/117 [00:02<00:02, 20.08it/s, loss=0.694, v_num=1, val_acc=0.756]
Epoch 79:  52%|█████▏    | 61/117 [00:02<00:02, 20.36it/s, loss=0.694, v_num=1, val_acc=0.756]
Epoch 79:  52%|█████▏    | 61/117 [00:03<00:02, 20.19it/s, loss=0.693, v_num=1, val_acc=0.756]
Epoch 79:  53%|█████▎    | 62/117 [00:03<00:02, 20.46it/s, loss=0.693, v_num=1, val_acc=0.756]
Epoch 79:  53%|█████▎    | 62/117 [00:03<00:02, 20.29it/s, loss=0.692, v_num=1, val_acc=0.756]
Epoch 79:  54%|█████▍    | 63/117 [00:03<00:02, 20.55it/s, loss=0.692, v_num=1, val_acc=0.756]
Epoch 79:  54%|█████▍    | 63/117 [00:03<00:02, 20.38it/s, loss=0.692, v_num=1, val_acc=0.756]
Epoch 79:  55%|█████▍    | 64/117 [00:03<00:02, 20.65it/s, loss=0.692, v_num=1, val_acc=0.756]
Epoch 79:  55%|█████▍    | 64/117 [00:03<00:02, 20.48it/s, loss=0.692, v_num=1, val_acc=0.756]
Epoch 79:  56%|█████▌    | 65/117 [00:03<00:02, 20.73it/s, loss=0.692, v_num=1, val_acc=0.756]
Epoch 79:  56%|█████▌    | 65/117 [00:03<00:02, 20.57it/s, loss=0.693, v_num=1, val_acc=0.756]
Epoch 79:  56%|█████▋    | 66/117 [00:03<00:02, 20.82it/s, loss=0.693, v_num=1, val_acc=0.756]
Epoch 79:  56%|█████▋    | 66/117 [00:03<00:02, 20.66it/s, loss=0.686, v_num=1, val_acc=0.756]
Epoch 79:  57%|█████▋    | 67/117 [00:03<00:02, 20.91it/s, loss=0.686, v_num=1, val_acc=0.756]
Epoch 79:  57%|█████▋    | 67/117 [00:03<00:02, 20.75it/s, loss=0.685, v_num=1, val_acc=0.756]
Epoch 79:  58%|█████▊    | 68/117 [00:03<00:02, 21.00it/s, loss=0.685, v_num=1, val_acc=0.756]
Epoch 79:  58%|█████▊    | 68/117 [00:03<00:02, 20.84it/s, loss=0.681, v_num=1, val_acc=0.756]
Epoch 79:  59%|█████▉    | 69/117 [00:03<00:02, 21.08it/s, loss=0.681, v_num=1, val_acc=0.756]
Epoch 79:  59%|█████▉    | 69/117 [00:03<00:02, 20.92it/s, loss=0.68, v_num=1, val_acc=0.756]
Epoch 79:  60%|█████▉    | 70/117 [00:03<00:02, 21.16it/s, loss=0.68, v_num=1, val_acc=0.756]
Epoch 79:  60%|█████▉    | 70/117 [00:03<00:02, 21.00it/s, loss=0.678, v_num=1, val_acc=0.756]
Epoch 79:  61%|██████    | 71/117 [00:03<00:02, 21.25it/s, loss=0.678, v_num=1, val_acc=0.756]
Epoch 79:  61%|██████    | 71/117 [00:03<00:02, 21.09it/s, loss=0.676, v_num=1, val_acc=0.756]
Epoch 79:  62%|██████▏   | 72/117 [00:03<00:02, 21.32it/s, loss=0.676, v_num=1, val_acc=0.756]
Epoch 79:  62%|██████▏   | 72/117 [00:03<00:02, 21.17it/s, loss=0.677, v_num=1, val_acc=0.756]
Epoch 79:  62%|██████▏   | 73/117 [00:03<00:02, 21.37it/s, loss=0.677, v_num=1, val_acc=0.756]
Epoch 79:  62%|██████▏   | 73/117 [00:03<00:02, 21.23it/s, loss=0.673, v_num=1, val_acc=0.756]
Epoch 79:  63%|██████▎   | 74/117 [00:03<00:02, 21.46it/s, loss=0.673, v_num=1, val_acc=0.756]
Epoch 79:  63%|██████▎   | 74/117 [00:03<00:02, 21.30it/s, loss=0.673, v_num=1, val_acc=0.756]
Epoch 79:  64%|██████▍   | 75/117 [00:03<00:01, 21.54it/s, loss=0.673, v_num=1, val_acc=0.756]
Epoch 79:  64%|██████▍   | 75/117 [00:03<00:01, 21.38it/s, loss=0.678, v_num=1, val_acc=0.756]
Epoch 79:  65%|██████▍   | 76/117 [00:03<00:01, 21.58it/s, loss=0.678, v_num=1, val_acc=0.756]
Epoch 79:  65%|██████▍   | 76/117 [00:03<00:01, 21.43it/s, loss=0.678, v_num=1, val_acc=0.756]
Epoch 79:  66%|██████▌   | 77/117 [00:03<00:01, 21.66it/s, loss=0.678, v_num=1, val_acc=0.756]
Epoch 79:  66%|██████▌   | 77/117 [00:03<00:01, 21.51it/s, loss=0.682, v_num=1, val_acc=0.756]
Epoch 79:  67%|██████▋   | 78/117 [00:03<00:01, 21.72it/s, loss=0.682, v_num=1, val_acc=0.756]
Epoch 79:  67%|██████▋   | 78/117 [00:03<00:01, 21.57it/s, loss=0.692, v_num=1, val_acc=0.756]
Epoch 79:  68%|██████▊   | 79/117 [00:03<00:01, 21.79it/s, loss=0.692, v_num=1, val_acc=0.756]
Epoch 79:  68%|██████▊   | 79/117 [00:03<00:01, 21.64it/s, loss=0.696, v_num=1, val_acc=0.756]
Epoch 79:  68%|██████▊   | 80/117 [00:03<00:01, 21.86it/s, loss=0.696, v_num=1, val_acc=0.756]
Epoch 79:  68%|██████▊   | 80/117 [00:03<00:01, 21.71it/s, loss=0.698, v_num=1, val_acc=0.756]
Epoch 79:  69%|██████▉   | 81/117 [00:03<00:01, 21.93it/s, loss=0.698, v_num=1, val_acc=0.756]
Epoch 79:  69%|██████▉   | 81/117 [00:03<00:01, 21.78it/s, loss=0.695, v_num=1, val_acc=0.756]
Epoch 79:  70%|███████   | 82/117 [00:03<00:01, 21.98it/s, loss=0.695, v_num=1, val_acc=0.756]
Epoch 79:  70%|███████   | 82/117 [00:03<00:01, 21.83it/s, loss=0.694, v_num=1, val_acc=0.756]
Epoch 79:  71%|███████   | 83/117 [00:03<00:01, 22.02it/s, loss=0.694, v_num=1, val_acc=0.756]
Epoch 79:  71%|███████   | 83/117 [00:03<00:01, 21.88it/s, loss=0.694, v_num=1, val_acc=0.756]
Epoch 79:  72%|███████▏  | 84/117 [00:03<00:01, 22.09it/s, loss=0.694, v_num=1, val_acc=0.756]
Epoch 79:  72%|███████▏  | 84/117 [00:03<00:01, 21.94it/s, loss=0.693, v_num=1, val_acc=0.756]
Epoch 79:  73%|███████▎  | 85/117 [00:03<00:01, 22.16it/s, loss=0.693, v_num=1, val_acc=0.756]
Epoch 79:  73%|███████▎  | 85/117 [00:03<00:01, 22.01it/s, loss=0.696, v_num=1, val_acc=0.756]
Epoch 79:  74%|███████▎  | 86/117 [00:03<00:01, 22.22it/s, loss=0.696, v_num=1, val_acc=0.756]
Epoch 79:  74%|███████▎  | 86/117 [00:03<00:01, 22.07it/s, loss=0.699, v_num=1, val_acc=0.756]
Epoch 79:  74%|███████▍  | 87/117 [00:03<00:01, 22.28it/s, loss=0.699, v_num=1, val_acc=0.756]
Epoch 79:  74%|███████▍  | 87/117 [00:03<00:01, 22.13it/s, loss=0.701, v_num=1, val_acc=0.756]
Epoch 79:  75%|███████▌  | 88/117 [00:03<00:01, 22.33it/s, loss=0.701, v_num=1, val_acc=0.756]
Epoch 79:  75%|███████▌  | 88/117 [00:03<00:01, 22.19it/s, loss=0.7, v_num=1, val_acc=0.756]
Epoch 79:  76%|███████▌  | 89/117 [00:03<00:01, 22.39it/s, loss=0.7, v_num=1, val_acc=0.756]
Epoch 79:  76%|███████▌  | 89/117 [00:03<00:01, 22.25it/s, loss=0.701, v_num=1, val_acc=0.756]
Epoch 79:  77%|███████▋  | 90/117 [00:04<00:01, 22.45it/s, loss=0.701, v_num=1, val_acc=0.756]
Epoch 79:  77%|███████▋  | 90/117 [00:04<00:01, 22.31it/s, loss=0.701, v_num=1, val_acc=0.756]
Epoch 79:  78%|███████▊  | 91/117 [00:04<00:01, 22.51it/s, loss=0.701, v_num=1, val_acc=0.756]
Epoch 79:  78%|███████▊  | 91/117 [00:04<00:01, 22.37it/s, loss=0.699, v_num=1, val_acc=0.756]
Epoch 79:  79%|███████▊  | 92/117 [00:04<00:01, 22.57it/s, loss=0.699, v_num=1, val_acc=0.756]
Epoch 79:  79%|███████▊  | 92/117 [00:04<00:01, 22.43it/s, loss=0.695, v_num=1, val_acc=0.756]
Epoch 79:  79%|███████▉  | 93/117 [00:04<00:01, 22.62it/s, loss=0.695, v_num=1, val_acc=0.756]
Epoch 79:  79%|███████▉  | 93/117 [00:04<00:01, 22.48it/s, loss=0.696, v_num=1, val_acc=0.756]
Epoch 79:  80%|████████  | 94/117 [00:04<00:01, 22.67it/s, loss=0.696, v_num=1, val_acc=0.756]
Epoch 79:  80%|████████  | 94/117 [00:04<00:01, 22.53it/s, loss=0.698, v_num=1, val_acc=0.756]
Epoch 79:  81%|████████  | 95/117 [00:04<00:00, 22.73it/s, loss=0.698, v_num=1, val_acc=0.756]
Epoch 79:  81%|████████  | 95/117 [00:04<00:00, 22.59it/s, loss=0.696, v_num=1, val_acc=0.756]
Epoch 79:  82%|████████▏ | 96/117 [00:04<00:00, 22.78it/s, loss=0.696, v_num=1, val_acc=0.756]
Epoch 79:  82%|████████▏ | 96/117 [00:04<00:00, 22.64it/s, loss=0.692, v_num=1, val_acc=0.756]
Epoch 79:  83%|████████▎ | 97/117 [00:04<00:00, 22.83it/s, loss=0.692, v_num=1, val_acc=0.756]
Epoch 79:  83%|████████▎ | 97/117 [00:04<00:00, 22.69it/s, loss=0.687, v_num=1, val_acc=0.756]

Validation: 0it [00:00, ?it/s]

Validation:   0%|          | 0/20 [00:00<?, ?it/s]

Validation DataLoader 0:   0%|          | 0/20 [00:00<?, ?it/s]

Validation DataLoader 0:   5%|▌         | 1/20 [00:00<00:00, 162.85it/s]
Epoch 79:  84%|████████▍ | 98/117 [00:05<00:00, 19.22it/s, loss=0.687, v_num=1, val_acc=0.756]

Validation DataLoader 0:  10%|█         | 2/20 [00:00<00:00, 54.28it/s]
Epoch 79:  85%|████████▍ | 99/117 [00:05<00:00, 19.30it/s, loss=0.687, v_num=1, val_acc=0.756]

Validation DataLoader 0:  15%|█▌        | 3/20 [00:00<00:00, 44.34it/s]
Epoch 79:  85%|████████▌ | 100/117 [00:05<00:00, 19.38it/s, loss=0.687, v_num=1, val_acc=0.756]

Validation DataLoader 0:  20%|██        | 4/20 [00:00<00:00, 40.18it/s]
Epoch 79:  86%|████████▋ | 101/117 [00:05<00:00, 19.46it/s, loss=0.687, v_num=1, val_acc=0.756]

Validation DataLoader 0:  25%|██▌       | 5/20 [00:00<00:00, 38.13it/s]
Epoch 79:  87%|████████▋ | 102/117 [00:05<00:00, 19.53it/s, loss=0.687, v_num=1, val_acc=0.756]

Validation DataLoader 0:  30%|███       | 6/20 [00:00<00:00, 36.88it/s]
Epoch 79:  88%|████████▊ | 103/117 [00:05<00:00, 19.60it/s, loss=0.687, v_num=1, val_acc=0.756]

Validation DataLoader 0:  35%|███▌      | 7/20 [00:00<00:00, 35.97it/s]
Epoch 79:  89%|████████▉ | 104/117 [00:05<00:00, 19.67it/s, loss=0.687, v_num=1, val_acc=0.756]

Validation DataLoader 0:  40%|████      | 8/20 [00:00<00:00, 35.36it/s]
Epoch 79:  90%|████████▉ | 105/117 [00:05<00:00, 19.74it/s, loss=0.687, v_num=1, val_acc=0.756]

Validation DataLoader 0:  45%|████▌     | 9/20 [00:00<00:00, 34.86it/s]
Epoch 79:  91%|█████████ | 106/117 [00:05<00:00, 19.81it/s, loss=0.687, v_num=1, val_acc=0.756]

Validation DataLoader 0:  50%|█████     | 10/20 [00:00<00:00, 34.52it/s]
Epoch 79:  91%|█████████▏| 107/117 [00:05<00:00, 19.88it/s, loss=0.687, v_num=1, val_acc=0.756]

Validation DataLoader 0:  55%|█████▌    | 11/20 [00:00<00:00, 34.24it/s]
Epoch 79:  92%|█████████▏| 108/117 [00:05<00:00, 19.95it/s, loss=0.687, v_num=1, val_acc=0.756]

Validation DataLoader 0:  60%|██████    | 12/20 [00:00<00:00, 33.99it/s]
Epoch 79:  93%|█████████▎| 109/117 [00:05<00:00, 20.02it/s, loss=0.687, v_num=1, val_acc=0.756]

Validation DataLoader 0:  65%|██████▌   | 13/20 [00:00<00:00, 33.81it/s]
Epoch 79:  94%|█████████▍| 110/117 [00:05<00:00, 20.09it/s, loss=0.687, v_num=1, val_acc=0.756]

Validation DataLoader 0:  70%|███████   | 14/20 [00:00<00:00, 33.64it/s]
Epoch 79:  95%|█████████▍| 111/117 [00:05<00:00, 20.15it/s, loss=0.687, v_num=1, val_acc=0.756]

Validation DataLoader 0:  75%|███████▌  | 15/20 [00:00<00:00, 33.50it/s]
Epoch 79:  96%|█████████▌| 112/117 [00:05<00:00, 20.22it/s, loss=0.687, v_num=1, val_acc=0.756]

Validation DataLoader 0:  80%|████████  | 16/20 [00:00<00:00, 33.32it/s]
Epoch 79:  97%|█████████▋| 113/117 [00:05<00:00, 20.28it/s, loss=0.687, v_num=1, val_acc=0.756]

Validation DataLoader 0:  85%|████████▌ | 17/20 [00:00<00:00, 33.20it/s]
Epoch 79:  97%|█████████▋| 114/117 [00:05<00:00, 20.34it/s, loss=0.687, v_num=1, val_acc=0.756]

Validation DataLoader 0:  90%|█████████ | 18/20 [00:00<00:00, 33.10it/s]
Epoch 79:  98%|█████████▊| 115/117 [00:05<00:00, 20.41it/s, loss=0.687, v_num=1, val_acc=0.756]

Validation DataLoader 0:  95%|█████████▌| 19/20 [00:00<00:00, 33.02it/s]
Epoch 79:  99%|█████████▉| 116/117 [00:05<00:00, 20.47it/s, loss=0.687, v_num=1, val_acc=0.756]

Validation DataLoader 0: 100%|██████████| 20/20 [00:00<00:00, 33.01it/s]
Epoch 79: 100%|██████████| 117/117 [00:05<00:00, 20.54it/s, loss=0.687, v_num=1, val_acc=0.756]
Epoch 79: 100%|██████████| 117/117 [00:05<00:00, 20.46it/s, loss=0.687, v_num=1, val_acc=0.755]


Epoch 79: 100%|██████████| 117/117 [00:05<00:00, 20.46it/s, loss=0.687, v_num=1, val_acc=0.755]
Epoch 79:   0%|          | 0/117 [00:00<?, ?it/s, loss=0.687, v_num=1, val_acc=0.755]
Epoch 80:   0%|          | 0/117 [00:00<?, ?it/s, loss=0.687, v_num=1, val_acc=0.755]
Epoch 80:   1%|          | 1/117 [00:00<01:46,  1.09it/s, loss=0.687, v_num=1, val_acc=0.755]
Epoch 80:   1%|          | 1/117 [00:00<01:48,  1.07it/s, loss=0.682, v_num=1, val_acc=0.755]
Epoch 80:   2%|▏         | 2/117 [00:00<00:54,  2.11it/s, loss=0.682, v_num=1, val_acc=0.755]
Epoch 80:   2%|▏         | 2/117 [00:00<00:55,  2.06it/s, loss=0.679, v_num=1, val_acc=0.755]
Epoch 80:   3%|▎         | 3/117 [00:00<00:37,  3.05it/s, loss=0.679, v_num=1, val_acc=0.755]
Epoch 80:   3%|▎         | 3/117 [00:01<00:38,  2.97it/s, loss=0.675, v_num=1, val_acc=0.755]
Epoch 80:   3%|▎         | 4/117 [00:01<00:28,  3.93it/s, loss=0.675, v_num=1, val_acc=0.755]
Epoch 80:   3%|▎         | 4/117 [00:01<00:29,  3.83it/s, loss=0.682, v_num=1, val_acc=0.755]
Epoch 80:   4%|▍         | 5/117 [00:01<00:23,  4.75it/s, loss=0.682, v_num=1, val_acc=0.755]
Epoch 80:   4%|▍         | 5/117 [00:01<00:24,  4.64it/s, loss=0.682, v_num=1, val_acc=0.755]
Epoch 80:   5%|▌         | 6/117 [00:01<00:20,  5.51it/s, loss=0.682, v_num=1, val_acc=0.755]
Epoch 80:   5%|▌         | 6/117 [00:01<00:20,  5.39it/s, loss=0.68, v_num=1, val_acc=0.755]
Epoch 80:   6%|▌         | 7/117 [00:01<00:17,  6.24it/s, loss=0.68, v_num=1, val_acc=0.755]
Epoch 80:   6%|▌         | 7/117 [00:01<00:18,  6.10it/s, loss=0.683, v_num=1, val_acc=0.755]
Epoch 80:   7%|▋         | 8/117 [00:01<00:15,  6.92it/s, loss=0.683, v_num=1, val_acc=0.755]
Epoch 80:   7%|▋         | 8/117 [00:01<00:16,  6.77it/s, loss=0.682, v_num=1, val_acc=0.755]
Epoch 80:   8%|▊         | 9/117 [00:01<00:14,  7.55it/s, loss=0.682, v_num=1, val_acc=0.755]
Epoch 80:   8%|▊         | 9/117 [00:01<00:14,  7.39it/s, loss=0.686, v_num=1, val_acc=0.755]
Epoch 80:   9%|▊         | 10/117 [00:01<00:13,  8.15it/s, loss=0.686, v_num=1, val_acc=0.755]
Epoch 80:   9%|▊         | 10/117 [00:01<00:13,  7.99it/s, loss=0.684, v_num=1, val_acc=0.755]
Epoch 80:   9%|▉         | 11/117 [00:01<00:12,  8.73it/s, loss=0.684, v_num=1, val_acc=0.755]
Epoch 80:   9%|▉         | 11/117 [00:01<00:12,  8.56it/s, loss=0.689, v_num=1, val_acc=0.755]
Epoch 80:  10%|█         | 12/117 [00:01<00:11,  9.24it/s, loss=0.689, v_num=1, val_acc=0.755]
Epoch 80:  10%|█         | 12/117 [00:01<00:11,  9.07it/s, loss=0.689, v_num=1, val_acc=0.755]
Epoch 80:  11%|█         | 13/117 [00:01<00:10,  9.76it/s, loss=0.689, v_num=1, val_acc=0.755]
Epoch 80:  11%|█         | 13/117 [00:01<00:10,  9.58it/s, loss=0.684, v_num=1, val_acc=0.755]
Epoch 80:  12%|█▏        | 14/117 [00:01<00:10, 10.25it/s, loss=0.684, v_num=1, val_acc=0.755]
Epoch 80:  12%|█▏        | 14/117 [00:01<00:10, 10.06it/s, loss=0.688, v_num=1, val_acc=0.755]
Epoch 80:  13%|█▎        | 15/117 [00:01<00:09, 10.72it/s, loss=0.688, v_num=1, val_acc=0.755]
Epoch 80:  13%|█▎        | 15/117 [00:01<00:09, 10.53it/s, loss=0.691, v_num=1, val_acc=0.755]
Epoch 80:  14%|█▎        | 16/117 [00:01<00:09, 11.16it/s, loss=0.691, v_num=1, val_acc=0.755]
Epoch 80:  14%|█▎        | 16/117 [00:01<00:09, 10.97it/s, loss=0.689, v_num=1, val_acc=0.755]
Epoch 80:  15%|█▍        | 17/117 [00:01<00:08, 11.58it/s, loss=0.689, v_num=1, val_acc=0.755]
Epoch 80:  15%|█▍        | 17/117 [00:01<00:08, 11.38it/s, loss=0.691, v_num=1, val_acc=0.755]
Epoch 80:  15%|█▌        | 18/117 [00:01<00:08, 11.98it/s, loss=0.691, v_num=1, val_acc=0.755]
Epoch 80:  15%|█▌        | 18/117 [00:01<00:08, 11.79it/s, loss=0.689, v_num=1, val_acc=0.755]
Epoch 80:  16%|█▌        | 19/117 [00:01<00:07, 12.36it/s, loss=0.689, v_num=1, val_acc=0.755]
Epoch 80:  16%|█▌        | 19/117 [00:01<00:08, 12.16it/s, loss=0.696, v_num=1, val_acc=0.755]
Epoch 80:  17%|█▋        | 20/117 [00:01<00:07, 12.72it/s, loss=0.696, v_num=1, val_acc=0.755]
Epoch 80:  17%|█▋        | 20/117 [00:01<00:07, 12.52it/s, loss=0.696, v_num=1, val_acc=0.755]
Epoch 80:  18%|█▊        | 21/117 [00:01<00:07, 13.07it/s, loss=0.696, v_num=1, val_acc=0.755]
Epoch 80:  18%|█▊        | 21/117 [00:01<00:07, 12.87it/s, loss=0.693, v_num=1, val_acc=0.755]
Epoch 80:  19%|█▉        | 22/117 [00:01<00:07, 13.41it/s, loss=0.693, v_num=1, val_acc=0.755]
Epoch 80:  19%|█▉        | 22/117 [00:01<00:07, 13.21it/s, loss=0.692, v_num=1, val_acc=0.755]
Epoch 80:  20%|█▉        | 23/117 [00:01<00:06, 13.74it/s, loss=0.692, v_num=1, val_acc=0.755]
Epoch 80:  20%|█▉        | 23/117 [00:01<00:06, 13.53it/s, loss=0.695, v_num=1, val_acc=0.755]
Epoch 80:  21%|██        | 24/117 [00:01<00:06, 14.04it/s, loss=0.695, v_num=1, val_acc=0.755]
Epoch 80:  21%|██        | 24/117 [00:01<00:06, 13.84it/s, loss=0.691, v_num=1, val_acc=0.755]
Epoch 80:  21%|██▏       | 25/117 [00:01<00:06, 14.34it/s, loss=0.691, v_num=1, val_acc=0.755]
Epoch 80:  21%|██▏       | 25/117 [00:01<00:06, 14.13it/s, loss=0.688, v_num=1, val_acc=0.755]
Epoch 80:  22%|██▏       | 26/117 [00:01<00:06, 14.62it/s, loss=0.688, v_num=1, val_acc=0.755]
Epoch 80:  22%|██▏       | 26/117 [00:01<00:06, 14.42it/s, loss=0.69, v_num=1, val_acc=0.755]
Epoch 80:  23%|██▎       | 27/117 [00:01<00:06, 14.90it/s, loss=0.69, v_num=1, val_acc=0.755]
Epoch 80:  23%|██▎       | 27/117 [00:01<00:06, 14.69it/s, loss=0.69, v_num=1, val_acc=0.755]
Epoch 80:  24%|██▍       | 28/117 [00:01<00:05, 15.15it/s, loss=0.69, v_num=1, val_acc=0.755]
Epoch 80:  24%|██▍       | 28/117 [00:01<00:05, 14.95it/s, loss=0.69, v_num=1, val_acc=0.755]
Epoch 80:  25%|██▍       | 29/117 [00:01<00:05, 15.41it/s, loss=0.69, v_num=1, val_acc=0.755]
Epoch 80:  25%|██▍       | 29/117 [00:01<00:05, 15.21it/s, loss=0.688, v_num=1, val_acc=0.755]
Epoch 80:  26%|██▌       | 30/117 [00:01<00:05, 15.67it/s, loss=0.688, v_num=1, val_acc=0.755]
Epoch 80:  26%|██▌       | 30/117 [00:01<00:05, 15.46it/s, loss=0.686, v_num=1, val_acc=0.755]
Epoch 80:  26%|██▋       | 31/117 [00:01<00:05, 15.90it/s, loss=0.686, v_num=1, val_acc=0.755]
Epoch 80:  26%|██▋       | 31/117 [00:01<00:05, 15.70it/s, loss=0.685, v_num=1, val_acc=0.755]
Epoch 80:  27%|██▋       | 32/117 [00:01<00:05, 16.13it/s, loss=0.685, v_num=1, val_acc=0.755]
Epoch 80:  27%|██▋       | 32/117 [00:02<00:05, 15.92it/s, loss=0.677, v_num=1, val_acc=0.755]
Epoch 80:  28%|██▊       | 33/117 [00:02<00:05, 16.35it/s, loss=0.677, v_num=1, val_acc=0.755]
Epoch 80:  28%|██▊       | 33/117 [00:02<00:05, 16.15it/s, loss=0.68, v_num=1, val_acc=0.755]
Epoch 80:  29%|██▉       | 34/117 [00:02<00:05, 16.56it/s, loss=0.68, v_num=1, val_acc=0.755]
Epoch 80:  29%|██▉       | 34/117 [00:02<00:05, 16.36it/s, loss=0.675, v_num=1, val_acc=0.755]
Epoch 80:  30%|██▉       | 35/117 [00:02<00:04, 16.77it/s, loss=0.675, v_num=1, val_acc=0.755]
Epoch 80:  30%|██▉       | 35/117 [00:02<00:04, 16.57it/s, loss=0.669, v_num=1, val_acc=0.755]
Epoch 80:  31%|███       | 36/117 [00:02<00:04, 16.96it/s, loss=0.669, v_num=1, val_acc=0.755]
Epoch 80:  31%|███       | 36/117 [00:02<00:04, 16.76it/s, loss=0.674, v_num=1, val_acc=0.755]
Epoch 80:  32%|███▏      | 37/117 [00:02<00:04, 17.16it/s, loss=0.674, v_num=1, val_acc=0.755]
Epoch 80:  32%|███▏      | 37/117 [00:02<00:04, 16.96it/s, loss=0.672, v_num=1, val_acc=0.755]
Epoch 80:  32%|███▏      | 38/117 [00:02<00:04, 17.35it/s, loss=0.672, v_num=1, val_acc=0.755]
Epoch 80:  32%|███▏      | 38/117 [00:02<00:04, 17.15it/s, loss=0.672, v_num=1, val_acc=0.755]
Epoch 80:  33%|███▎      | 39/117 [00:02<00:04, 17.53it/s, loss=0.672, v_num=1, val_acc=0.755]
Epoch 80:  33%|███▎      | 39/117 [00:02<00:04, 17.33it/s, loss=0.667, v_num=1, val_acc=0.755]
Epoch 80:  34%|███▍      | 40/117 [00:02<00:04, 17.70it/s, loss=0.667, v_num=1, val_acc=0.755]
Epoch 80:  34%|███▍      | 40/117 [00:02<00:04, 17.50it/s, loss=0.671, v_num=1, val_acc=0.755]
Epoch 80:  35%|███▌      | 41/117 [00:02<00:04, 17.86it/s, loss=0.671, v_num=1, val_acc=0.755]
Epoch 80:  35%|███▌      | 41/117 [00:02<00:04, 17.67it/s, loss=0.672, v_num=1, val_acc=0.755]
Epoch 80:  36%|███▌      | 42/117 [00:02<00:04, 18.03it/s, loss=0.672, v_num=1, val_acc=0.755]
Epoch 80:  36%|███▌      | 42/117 [00:02<00:04, 17.83it/s, loss=0.676, v_num=1, val_acc=0.755]
Epoch 80:  37%|███▋      | 43/117 [00:02<00:04, 18.19it/s, loss=0.676, v_num=1, val_acc=0.755]
Epoch 80:  37%|███▋      | 43/117 [00:02<00:04, 18.00it/s, loss=0.679, v_num=1, val_acc=0.755]
Epoch 80:  38%|███▊      | 44/117 [00:02<00:03, 18.35it/s, loss=0.679, v_num=1, val_acc=0.755]
Epoch 80:  38%|███▊      | 44/117 [00:02<00:04, 18.15it/s, loss=0.679, v_num=1, val_acc=0.755]
Epoch 80:  38%|███▊      | 45/117 [00:02<00:03, 18.50it/s, loss=0.679, v_num=1, val_acc=0.755]
Epoch 80:  38%|███▊      | 45/117 [00:02<00:03, 18.31it/s, loss=0.684, v_num=1, val_acc=0.755]
Epoch 80:  39%|███▉      | 46/117 [00:02<00:03, 18.64it/s, loss=0.684, v_num=1, val_acc=0.755]
Epoch 80:  39%|███▉      | 46/117 [00:02<00:03, 18.46it/s, loss=0.687, v_num=1, val_acc=0.755]
Epoch 80:  40%|████      | 47/117 [00:02<00:03, 18.79it/s, loss=0.687, v_num=1, val_acc=0.755]
Epoch 80:  40%|████      | 47/117 [00:02<00:03, 18.60it/s, loss=0.689, v_num=1, val_acc=0.755]
Epoch 80:  41%|████      | 48/117 [00:02<00:03, 18.93it/s, loss=0.689, v_num=1, val_acc=0.755]
Epoch 80:  41%|████      | 48/117 [00:02<00:03, 18.74it/s, loss=0.688, v_num=1, val_acc=0.755]
Epoch 80:  42%|████▏     | 49/117 [00:02<00:03, 19.06it/s, loss=0.688, v_num=1, val_acc=0.755]
Epoch 80:  42%|████▏     | 49/117 [00:02<00:03, 18.88it/s, loss=0.691, v_num=1, val_acc=0.755]
Epoch 80:  43%|████▎     | 50/117 [00:02<00:03, 19.20it/s, loss=0.691, v_num=1, val_acc=0.755]
Epoch 80:  43%|████▎     | 50/117 [00:02<00:03, 19.01it/s, loss=0.694, v_num=1, val_acc=0.755]
Epoch 80:  44%|████▎     | 51/117 [00:02<00:03, 19.33it/s, loss=0.694, v_num=1, val_acc=0.755]
Epoch 80:  44%|████▎     | 51/117 [00:02<00:03, 19.14it/s, loss=0.696, v_num=1, val_acc=0.755]
Epoch 80:  44%|████▍     | 52/117 [00:02<00:03, 19.45it/s, loss=0.696, v_num=1, val_acc=0.755]
Epoch 80:  44%|████▍     | 52/117 [00:02<00:03, 19.27it/s, loss=0.702, v_num=1, val_acc=0.755]
Epoch 80:  45%|████▌     | 53/117 [00:02<00:03, 19.57it/s, loss=0.702, v_num=1, val_acc=0.755]
Epoch 80:  45%|████▌     | 53/117 [00:02<00:03, 19.39it/s, loss=0.699, v_num=1, val_acc=0.755]
Epoch 80:  46%|████▌     | 54/117 [00:02<00:03, 19.69it/s, loss=0.699, v_num=1, val_acc=0.755]
Epoch 80:  46%|████▌     | 54/117 [00:02<00:03, 19.51it/s, loss=0.705, v_num=1, val_acc=0.755]
Epoch 80:  47%|████▋     | 55/117 [00:02<00:03, 19.81it/s, loss=0.705, v_num=1, val_acc=0.755]
Epoch 80:  47%|████▋     | 55/117 [00:02<00:03, 19.63it/s, loss=0.709, v_num=1, val_acc=0.755]
Epoch 80:  48%|████▊     | 56/117 [00:02<00:03, 19.92it/s, loss=0.709, v_num=1, val_acc=0.755]
Epoch 80:  48%|████▊     | 56/117 [00:02<00:03, 19.74it/s, loss=0.708, v_num=1, val_acc=0.755]
Epoch 80:  49%|████▊     | 57/117 [00:02<00:02, 20.03it/s, loss=0.708, v_num=1, val_acc=0.755]
Epoch 80:  49%|████▊     | 57/117 [00:02<00:03, 19.86it/s, loss=0.71, v_num=1, val_acc=0.755]
Epoch 80:  50%|████▉     | 58/117 [00:02<00:02, 20.14it/s, loss=0.71, v_num=1, val_acc=0.755]
Epoch 80:  50%|████▉     | 58/117 [00:02<00:02, 19.96it/s, loss=0.715, v_num=1, val_acc=0.755]
Epoch 80:  50%|█████     | 59/117 [00:02<00:02, 20.25it/s, loss=0.715, v_num=1, val_acc=0.755]
Epoch 80:  50%|█████     | 59/117 [00:02<00:02, 20.07it/s, loss=0.72, v_num=1, val_acc=0.755]
Epoch 80:  51%|█████▏    | 60/117 [00:02<00:02, 20.35it/s, loss=0.72, v_num=1, val_acc=0.755]
Epoch 80:  51%|█████▏    | 60/117 [00:02<00:02, 20.17it/s, loss=0.719, v_num=1, val_acc=0.755]
Epoch 80:  52%|█████▏    | 61/117 [00:02<00:02, 20.45it/s, loss=0.719, v_num=1, val_acc=0.755]
Epoch 80:  52%|█████▏    | 61/117 [00:03<00:02, 20.27it/s, loss=0.718, v_num=1, val_acc=0.755]
Epoch 80:  53%|█████▎    | 62/117 [00:03<00:02, 20.51it/s, loss=0.718, v_num=1, val_acc=0.755]
Epoch 80:  53%|█████▎    | 62/117 [00:03<00:02, 20.35it/s, loss=0.71, v_num=1, val_acc=0.755]
Epoch 80:  54%|█████▍    | 63/117 [00:03<00:02, 20.62it/s, loss=0.71, v_num=1, val_acc=0.755]
Epoch 80:  54%|█████▍    | 63/117 [00:03<00:02, 20.45it/s, loss=0.712, v_num=1, val_acc=0.755]
Epoch 80:  55%|█████▍    | 64/117 [00:03<00:02, 20.72it/s, loss=0.712, v_num=1, val_acc=0.755]
Epoch 80:  55%|█████▍    | 64/117 [00:03<00:02, 20.55it/s, loss=0.708, v_num=1, val_acc=0.755]
Epoch 80:  56%|█████▌    | 65/117 [00:03<00:02, 20.81it/s, loss=0.708, v_num=1, val_acc=0.755]
Epoch 80:  56%|█████▌    | 65/117 [00:03<00:02, 20.64it/s, loss=0.709, v_num=1, val_acc=0.755]
Epoch 80:  56%|█████▋    | 66/117 [00:03<00:02, 20.90it/s, loss=0.709, v_num=1, val_acc=0.755]
Epoch 80:  56%|█████▋    | 66/117 [00:03<00:02, 20.73it/s, loss=0.709, v_num=1, val_acc=0.755]
Epoch 80:  57%|█████▋    | 67/117 [00:03<00:02, 20.99it/s, loss=0.709, v_num=1, val_acc=0.755]
Epoch 80:  57%|█████▋    | 67/117 [00:03<00:02, 20.82it/s, loss=0.706, v_num=1, val_acc=0.755]
Epoch 80:  58%|█████▊    | 68/117 [00:03<00:02, 21.07it/s, loss=0.706, v_num=1, val_acc=0.755]
Epoch 80:  58%|█████▊    | 68/117 [00:03<00:02, 20.91it/s, loss=0.711, v_num=1, val_acc=0.755]
Epoch 80:  59%|█████▉    | 69/117 [00:03<00:02, 21.16it/s, loss=0.711, v_num=1, val_acc=0.755]
Epoch 80:  59%|█████▉    | 69/117 [00:03<00:02, 20.99it/s, loss=0.708, v_num=1, val_acc=0.755]
Epoch 80:  60%|█████▉    | 70/117 [00:03<00:02, 21.24it/s, loss=0.708, v_num=1, val_acc=0.755]
Epoch 80:  60%|█████▉    | 70/117 [00:03<00:02, 21.08it/s, loss=0.704, v_num=1, val_acc=0.755]
Epoch 80:  61%|██████    | 71/117 [00:03<00:02, 21.32it/s, loss=0.704, v_num=1, val_acc=0.755]
Epoch 80:  61%|██████    | 71/117 [00:03<00:02, 21.16it/s, loss=0.7, v_num=1, val_acc=0.755]
Epoch 80:  62%|██████▏   | 72/117 [00:03<00:02, 21.40it/s, loss=0.7, v_num=1, val_acc=0.755]
Epoch 80:  62%|██████▏   | 72/117 [00:03<00:02, 21.24it/s, loss=0.704, v_num=1, val_acc=0.755]
Epoch 80:  62%|██████▏   | 73/117 [00:03<00:02, 21.48it/s, loss=0.704, v_num=1, val_acc=0.755]
Epoch 80:  62%|██████▏   | 73/117 [00:03<00:02, 21.32it/s, loss=0.705, v_num=1, val_acc=0.755]
Epoch 80:  63%|██████▎   | 74/117 [00:03<00:01, 21.55it/s, loss=0.705, v_num=1, val_acc=0.755]
Epoch 80:  63%|██████▎   | 74/117 [00:03<00:02, 21.39it/s, loss=0.705, v_num=1, val_acc=0.755]
Epoch 80:  64%|██████▍   | 75/117 [00:03<00:01, 21.63it/s, loss=0.705, v_num=1, val_acc=0.755]
Epoch 80:  64%|██████▍   | 75/117 [00:03<00:01, 21.47it/s, loss=0.702, v_num=1, val_acc=0.755]
Epoch 80:  65%|██████▍   | 76/117 [00:03<00:01, 21.69it/s, loss=0.702, v_num=1, val_acc=0.755]
Epoch 80:  65%|██████▍   | 76/117 [00:03<00:01, 21.54it/s, loss=0.702, v_num=1, val_acc=0.755]
Epoch 80:  66%|██████▌   | 77/117 [00:03<00:01, 21.77it/s, loss=0.702, v_num=1, val_acc=0.755]
Epoch 80:  66%|██████▌   | 77/117 [00:03<00:01, 21.61it/s, loss=0.703, v_num=1, val_acc=0.755]
Epoch 80:  67%|██████▋   | 78/117 [00:03<00:01, 21.84it/s, loss=0.703, v_num=1, val_acc=0.755]
Epoch 80:  67%|██████▋   | 78/117 [00:03<00:01, 21.68it/s, loss=0.697, v_num=1, val_acc=0.755]
Epoch 80:  68%|██████▊   | 79/117 [00:03<00:01, 21.90it/s, loss=0.697, v_num=1, val_acc=0.755]
Epoch 80:  68%|██████▊   | 79/117 [00:03<00:01, 21.75it/s, loss=0.691, v_num=1, val_acc=0.755]
Epoch 80:  68%|██████▊   | 80/117 [00:03<00:01, 21.97it/s, loss=0.691, v_num=1, val_acc=0.755]
Epoch 80:  68%|██████▊   | 80/117 [00:03<00:01, 21.82it/s, loss=0.687, v_num=1, val_acc=0.755]
Epoch 80:  69%|██████▉   | 81/117 [00:03<00:01, 22.04it/s, loss=0.687, v_num=1, val_acc=0.755]
Epoch 80:  69%|██████▉   | 81/117 [00:03<00:01, 21.89it/s, loss=0.69, v_num=1, val_acc=0.755]
Epoch 80:  70%|███████   | 82/117 [00:03<00:01, 22.09it/s, loss=0.69, v_num=1, val_acc=0.755]
Epoch 80:  70%|███████   | 82/117 [00:03<00:01, 21.94it/s, loss=0.697, v_num=1, val_acc=0.755]
Epoch 80:  71%|███████   | 83/117 [00:03<00:01, 22.15it/s, loss=0.697, v_num=1, val_acc=0.755]
Epoch 80:  71%|███████   | 83/117 [00:03<00:01, 22.00it/s, loss=0.694, v_num=1, val_acc=0.755]
Epoch 80:  72%|███████▏  | 84/117 [00:03<00:01, 22.21it/s, loss=0.694, v_num=1, val_acc=0.755]
Epoch 80:  72%|███████▏  | 84/117 [00:03<00:01, 22.07it/s, loss=0.701, v_num=1, val_acc=0.755]
Epoch 80:  73%|███████▎  | 85/117 [00:03<00:01, 22.28it/s, loss=0.701, v_num=1, val_acc=0.755]
Epoch 80:  73%|███████▎  | 85/117 [00:03<00:01, 22.13it/s, loss=0.699, v_num=1, val_acc=0.755]
Epoch 80:  74%|███████▎  | 86/117 [00:03<00:01, 22.34it/s, loss=0.699, v_num=1, val_acc=0.755]
Epoch 80:  74%|███████▎  | 86/117 [00:03<00:01, 22.19it/s, loss=0.693, v_num=1, val_acc=0.755]
Epoch 80:  74%|███████▍  | 87/117 [00:03<00:01, 22.40it/s, loss=0.693, v_num=1, val_acc=0.755]
Epoch 80:  74%|███████▍  | 87/117 [00:03<00:01, 22.25it/s, loss=0.692, v_num=1, val_acc=0.755]
Epoch 80:  75%|███████▌  | 88/117 [00:03<00:01, 22.46it/s, loss=0.692, v_num=1, val_acc=0.755]
Epoch 80:  75%|███████▌  | 88/117 [00:03<00:01, 22.31it/s, loss=0.691, v_num=1, val_acc=0.755]
Epoch 80:  76%|███████▌  | 89/117 [00:03<00:01, 22.52it/s, loss=0.691, v_num=1, val_acc=0.755]
Epoch 80:  76%|███████▌  | 89/117 [00:03<00:01, 22.37it/s, loss=0.69, v_num=1, val_acc=0.755]
Epoch 80:  77%|███████▋  | 90/117 [00:03<00:01, 22.57it/s, loss=0.69, v_num=1, val_acc=0.755]
Epoch 80:  77%|███████▋  | 90/117 [00:04<00:01, 22.43it/s, loss=0.69, v_num=1, val_acc=0.755]
Epoch 80:  78%|███████▊  | 91/117 [00:04<00:01, 22.63it/s, loss=0.69, v_num=1, val_acc=0.755]
Epoch 80:  78%|███████▊  | 91/117 [00:04<00:01, 22.49it/s, loss=0.694, v_num=1, val_acc=0.755]
Epoch 80:  79%|███████▊  | 92/117 [00:04<00:01, 22.68it/s, loss=0.694, v_num=1, val_acc=0.755]
Epoch 80:  79%|███████▊  | 92/117 [00:04<00:01, 22.54it/s, loss=0.692, v_num=1, val_acc=0.755]
Epoch 80:  79%|███████▉  | 93/117 [00:04<00:01, 22.73it/s, loss=0.692, v_num=1, val_acc=0.755]
Epoch 80:  79%|███████▉  | 93/117 [00:04<00:01, 22.59it/s, loss=0.693, v_num=1, val_acc=0.755]
Epoch 80:  80%|████████  | 94/117 [00:04<00:01, 22.79it/s, loss=0.693, v_num=1, val_acc=0.755]
Epoch 80:  80%|████████  | 94/117 [00:04<00:01, 22.64it/s, loss=0.688, v_num=1, val_acc=0.755]
Epoch 80:  81%|████████  | 95/117 [00:04<00:00, 22.84it/s, loss=0.688, v_num=1, val_acc=0.755]
Epoch 80:  81%|████████  | 95/117 [00:04<00:00, 22.70it/s, loss=0.694, v_num=1, val_acc=0.755]
Epoch 80:  82%|████████▏ | 96/117 [00:04<00:00, 22.89it/s, loss=0.694, v_num=1, val_acc=0.755]
Epoch 80:  82%|████████▏ | 96/117 [00:04<00:00, 22.75it/s, loss=0.691, v_num=1, val_acc=0.755]
Epoch 80:  83%|████████▎ | 97/117 [00:04<00:00, 22.91it/s, loss=0.691, v_num=1, val_acc=0.755]
Epoch 80:  83%|████████▎ | 97/117 [00:04<00:00, 22.78it/s, loss=0.692, v_num=1, val_acc=0.755]

Validation: 0it [00:00, ?it/s]

Validation:   0%|          | 0/20 [00:00<?, ?it/s]

Validation DataLoader 0:   0%|          | 0/20 [00:00<?, ?it/s]

Validation DataLoader 0:   5%|▌         | 1/20 [00:00<00:00, 190.86it/s]
Epoch 80:  84%|████████▍ | 98/117 [00:05<00:00, 19.18it/s, loss=0.692, v_num=1, val_acc=0.755]

Validation DataLoader 0:  10%|█         | 2/20 [00:00<00:00, 53.73it/s]
Epoch 80:  85%|████████▍ | 99/117 [00:05<00:00, 19.25it/s, loss=0.692, v_num=1, val_acc=0.755]

Validation DataLoader 0:  15%|█▌        | 3/20 [00:00<00:00, 43.52it/s]
Epoch 80:  85%|████████▌ | 100/117 [00:05<00:00, 19.33it/s, loss=0.692, v_num=1, val_acc=0.755]

Validation DataLoader 0:  20%|██        | 4/20 [00:00<00:00, 39.70it/s]
Epoch 80:  86%|████████▋ | 101/117 [00:05<00:00, 19.40it/s, loss=0.692, v_num=1, val_acc=0.755]

Validation DataLoader 0:  25%|██▌       | 5/20 [00:00<00:00, 37.59it/s]
Epoch 80:  87%|████████▋ | 102/117 [00:05<00:00, 19.48it/s, loss=0.692, v_num=1, val_acc=0.755]

Validation DataLoader 0:  30%|███       | 6/20 [00:00<00:00, 36.50it/s]
Epoch 80:  88%|████████▊ | 103/117 [00:05<00:00, 19.55it/s, loss=0.692, v_num=1, val_acc=0.755]

Validation DataLoader 0:  35%|███▌      | 7/20 [00:00<00:00, 35.56it/s]
Epoch 80:  89%|████████▉ | 104/117 [00:05<00:00, 19.62it/s, loss=0.692, v_num=1, val_acc=0.755]

Validation DataLoader 0:  40%|████      | 8/20 [00:00<00:00, 35.06it/s]
Epoch 80:  90%|████████▉ | 105/117 [00:05<00:00, 19.69it/s, loss=0.692, v_num=1, val_acc=0.755]

Validation DataLoader 0:  45%|████▌     | 9/20 [00:00<00:00, 34.64it/s]
Epoch 80:  91%|█████████ | 106/117 [00:05<00:00, 19.76it/s, loss=0.692, v_num=1, val_acc=0.755]

Validation DataLoader 0:  50%|█████     | 10/20 [00:00<00:00, 34.31it/s]
Epoch 80:  91%|█████████▏| 107/117 [00:05<00:00, 19.83it/s, loss=0.692, v_num=1, val_acc=0.755]

Validation DataLoader 0:  55%|█████▌    | 11/20 [00:00<00:00, 34.07it/s]
Epoch 80:  92%|█████████▏| 108/117 [00:05<00:00, 19.90it/s, loss=0.692, v_num=1, val_acc=0.755]

Validation DataLoader 0:  60%|██████    | 12/20 [00:00<00:00, 33.86it/s]
Epoch 80:  93%|█████████▎| 109/117 [00:05<00:00, 19.97it/s, loss=0.692, v_num=1, val_acc=0.755]

Validation DataLoader 0:  65%|██████▌   | 13/20 [00:00<00:00, 33.67it/s]
Epoch 80:  94%|█████████▍| 110/117 [00:05<00:00, 20.03it/s, loss=0.692, v_num=1, val_acc=0.755]

Validation DataLoader 0:  70%|███████   | 14/20 [00:00<00:00, 33.50it/s]
Epoch 80:  95%|█████████▍| 111/117 [00:05<00:00, 20.10it/s, loss=0.692, v_num=1, val_acc=0.755]

Validation DataLoader 0:  75%|███████▌  | 15/20 [00:00<00:00, 33.37it/s]
Epoch 80:  96%|█████████▌| 112/117 [00:05<00:00, 20.17it/s, loss=0.692, v_num=1, val_acc=0.755]

Validation DataLoader 0:  80%|████████  | 16/20 [00:00<00:00, 33.23it/s]
Epoch 80:  97%|█████████▋| 113/117 [00:05<00:00, 20.23it/s, loss=0.692, v_num=1, val_acc=0.755]

Validation DataLoader 0:  85%|████████▌ | 17/20 [00:00<00:00, 33.09it/s]
Epoch 80:  97%|█████████▋| 114/117 [00:05<00:00, 20.29it/s, loss=0.692, v_num=1, val_acc=0.755]

Validation DataLoader 0:  90%|█████████ | 18/20 [00:00<00:00, 33.01it/s]
Epoch 80:  98%|█████████▊| 115/117 [00:05<00:00, 20.36it/s, loss=0.692, v_num=1, val_acc=0.755]

Validation DataLoader 0:  95%|█████████▌| 19/20 [00:00<00:00, 32.93it/s]
Epoch 80:  99%|█████████▉| 116/117 [00:05<00:00, 20.42it/s, loss=0.692, v_num=1, val_acc=0.755]

Validation DataLoader 0: 100%|██████████| 20/20 [00:00<00:00, 32.94it/s]
Epoch 80: 100%|██████████| 117/117 [00:05<00:00, 20.48it/s, loss=0.692, v_num=1, val_acc=0.755]
Epoch 80: 100%|██████████| 117/117 [00:05<00:00, 20.41it/s, loss=0.692, v_num=1, val_acc=0.755]


Epoch 80: 100%|██████████| 117/117 [00:05<00:00, 20.41it/s, loss=0.692, v_num=1, val_acc=0.755]
Epoch 80:   0%|          | 0/117 [00:00<?, ?it/s, loss=0.692, v_num=1, val_acc=0.755]
Epoch 81:   0%|          | 0/117 [00:00<?, ?it/s, loss=0.692, v_num=1, val_acc=0.755]
Epoch 81:   1%|          | 1/117 [00:00<01:47,  1.08it/s, loss=0.692, v_num=1, val_acc=0.755]
Epoch 81:   1%|          | 1/117 [00:00<01:50,  1.05it/s, loss=0.692, v_num=1, val_acc=0.755]
Epoch 81:   2%|▏         | 2/117 [00:00<00:55,  2.08it/s, loss=0.692, v_num=1, val_acc=0.755]
Epoch 81:   2%|▏         | 2/117 [00:00<00:56,  2.03it/s, loss=0.696, v_num=1, val_acc=0.755]
Epoch 81:   3%|▎         | 3/117 [00:00<00:37,  3.02it/s, loss=0.696, v_num=1, val_acc=0.755]
Epoch 81:   3%|▎         | 3/117 [00:01<00:38,  2.94it/s, loss=0.696, v_num=1, val_acc=0.755]
Epoch 81:   3%|▎         | 4/117 [00:01<00:29,  3.87it/s, loss=0.696, v_num=1, val_acc=0.755]
Epoch 81:   3%|▎         | 4/117 [00:01<00:29,  3.78it/s, loss=0.695, v_num=1, val_acc=0.755]
Epoch 81:   4%|▍         | 5/117 [00:01<00:23,  4.69it/s, loss=0.695, v_num=1, val_acc=0.755]
Epoch 81:   4%|▍         | 5/117 [00:01<00:24,  4.58it/s, loss=0.692, v_num=1, val_acc=0.755]
Epoch 81:   5%|▌         | 6/117 [00:01<00:20,  5.46it/s, loss=0.692, v_num=1, val_acc=0.755]
Epoch 81:   5%|▌         | 6/117 [00:01<00:20,  5.33it/s, loss=0.691, v_num=1, val_acc=0.755]
Epoch 81:   6%|▌         | 7/117 [00:01<00:17,  6.17it/s, loss=0.691, v_num=1, val_acc=0.755]
Epoch 81:   6%|▌         | 7/117 [00:01<00:18,  6.04it/s, loss=0.689, v_num=1, val_acc=0.755]
Epoch 81:   7%|▋         | 8/117 [00:01<00:15,  6.85it/s, loss=0.689, v_num=1, val_acc=0.755]
Epoch 81:   7%|▋         | 8/117 [00:01<00:16,  6.70it/s, loss=0.689, v_num=1, val_acc=0.755]
Epoch 81:   8%|▊         | 9/117 [00:01<00:14,  7.43it/s, loss=0.689, v_num=1, val_acc=0.755]
Epoch 81:   8%|▊         | 9/117 [00:01<00:14,  7.28it/s, loss=0.697, v_num=1, val_acc=0.755]
Epoch 81:   9%|▊         | 10/117 [00:01<00:13,  8.04it/s, loss=0.697, v_num=1, val_acc=0.755]
Epoch 81:   9%|▊         | 10/117 [00:01<00:13,  7.88it/s, loss=0.705, v_num=1, val_acc=0.755]
Epoch 81:   9%|▉         | 11/117 [00:01<00:12,  8.61it/s, loss=0.705, v_num=1, val_acc=0.755]
Epoch 81:   9%|▉         | 11/117 [00:01<00:12,  8.44it/s, loss=0.694, v_num=1, val_acc=0.755]
Epoch 81:  10%|█         | 12/117 [00:01<00:11,  9.15it/s, loss=0.694, v_num=1, val_acc=0.755]
Epoch 81:  10%|█         | 12/117 [00:01<00:11,  8.98it/s, loss=0.698, v_num=1, val_acc=0.755]
Epoch 81:  11%|█         | 13/117 [00:01<00:10,  9.67it/s, loss=0.698, v_num=1, val_acc=0.755]
Epoch 81:  11%|█         | 13/117 [00:01<00:10,  9.49it/s, loss=0.705, v_num=1, val_acc=0.755]
Epoch 81:  12%|█▏        | 14/117 [00:01<00:10, 10.16it/s, loss=0.705, v_num=1, val_acc=0.755]
Epoch 81:  12%|█▏        | 14/117 [00:01<00:10,  9.97it/s, loss=0.702, v_num=1, val_acc=0.755]
Epoch 81:  13%|█▎        | 15/117 [00:01<00:09, 10.62it/s, loss=0.702, v_num=1, val_acc=0.755]
Epoch 81:  13%|█▎        | 15/117 [00:01<00:09, 10.43it/s, loss=0.698, v_num=1, val_acc=0.755]
Epoch 81:  14%|█▎        | 16/117 [00:01<00:09, 11.07it/s, loss=0.698, v_num=1, val_acc=0.755]
Epoch 81:  14%|█▎        | 16/117 [00:01<00:09, 10.88it/s, loss=0.702, v_num=1, val_acc=0.755]
Epoch 81:  15%|█▍        | 17/117 [00:01<00:08, 11.46it/s, loss=0.702, v_num=1, val_acc=0.755]
Epoch 81:  15%|█▍        | 17/117 [00:01<00:08, 11.27it/s, loss=0.7, v_num=1, val_acc=0.755]
Epoch 81:  15%|█▌        | 18/117 [00:01<00:08, 11.87it/s, loss=0.7, v_num=1, val_acc=0.755]
Epoch 81:  15%|█▌        | 18/117 [00:01<00:08, 11.67it/s, loss=0.698, v_num=1, val_acc=0.755]
Epoch 81:  16%|█▌        | 19/117 [00:01<00:07, 12.25it/s, loss=0.698, v_num=1, val_acc=0.755]
Epoch 81:  16%|█▌        | 19/117 [00:01<00:08, 12.06it/s, loss=0.702, v_num=1, val_acc=0.755]
Epoch 81:  17%|█▋        | 20/117 [00:01<00:07, 12.63it/s, loss=0.702, v_num=1, val_acc=0.755]
Epoch 81:  17%|█▋        | 20/117 [00:01<00:07, 12.42it/s, loss=0.698, v_num=1, val_acc=0.755]
Epoch 81:  18%|█▊        | 21/117 [00:01<00:07, 12.98it/s, loss=0.698, v_num=1, val_acc=0.755]
Epoch 81:  18%|█▊        | 21/117 [00:01<00:07, 12.78it/s, loss=0.698, v_num=1, val_acc=0.755]
Epoch 81:  19%|█▉        | 22/117 [00:01<00:07, 13.31it/s, loss=0.698, v_num=1, val_acc=0.755]
Epoch 81:  19%|█▉        | 22/117 [00:01<00:07, 13.11it/s, loss=0.699, v_num=1, val_acc=0.755]
Epoch 81:  20%|█▉        | 23/117 [00:01<00:06, 13.63it/s, loss=0.699, v_num=1, val_acc=0.755]
Epoch 81:  20%|█▉        | 23/117 [00:01<00:07, 13.43it/s, loss=0.701, v_num=1, val_acc=0.755]
Epoch 81:  21%|██        | 24/117 [00:01<00:06, 13.94it/s, loss=0.701, v_num=1, val_acc=0.755]
Epoch 81:  21%|██        | 24/117 [00:01<00:06, 13.73it/s, loss=0.695, v_num=1, val_acc=0.755]
Epoch 81:  21%|██▏       | 25/117 [00:01<00:06, 14.21it/s, loss=0.695, v_num=1, val_acc=0.755]
Epoch 81:  21%|██▏       | 25/117 [00:01<00:06, 14.01it/s, loss=0.698, v_num=1, val_acc=0.755]
Epoch 81:  22%|██▏       | 26/117 [00:01<00:06, 14.51it/s, loss=0.698, v_num=1, val_acc=0.755]
Epoch 81:  22%|██▏       | 26/117 [00:01<00:06, 14.30it/s, loss=0.699, v_num=1, val_acc=0.755]
Epoch 81:  23%|██▎       | 27/117 [00:01<00:06, 14.79it/s, loss=0.699, v_num=1, val_acc=0.755]
Epoch 81:  23%|██▎       | 27/117 [00:01<00:06, 14.58it/s, loss=0.699, v_num=1, val_acc=0.755]
Epoch 81:  24%|██▍       | 28/117 [00:01<00:05, 15.06it/s, loss=0.699, v_num=1, val_acc=0.755]
Epoch 81:  24%|██▍       | 28/117 [00:01<00:05, 14.85it/s, loss=0.697, v_num=1, val_acc=0.755]
Epoch 81:  25%|██▍       | 29/117 [00:01<00:05, 15.31it/s, loss=0.697, v_num=1, val_acc=0.755]
Epoch 81:  25%|██▍       | 29/117 [00:01<00:05, 15.11it/s, loss=0.696, v_num=1, val_acc=0.755]
Epoch 81:  26%|██▌       | 30/117 [00:01<00:05, 15.55it/s, loss=0.696, v_num=1, val_acc=0.755]
Epoch 81:  26%|██▌       | 30/117 [00:01<00:05, 15.35it/s, loss=0.69, v_num=1, val_acc=0.755]
Epoch 81:  26%|██▋       | 31/117 [00:01<00:05, 15.79it/s, loss=0.69, v_num=1, val_acc=0.755]
Epoch 81:  26%|██▋       | 31/117 [00:01<00:05, 15.59it/s, loss=0.699, v_num=1, val_acc=0.755]
Epoch 81:  27%|██▋       | 32/117 [00:01<00:05, 16.02it/s, loss=0.699, v_num=1, val_acc=0.755]
Epoch 81:  27%|██▋       | 32/117 [00:02<00:05, 15.82it/s, loss=0.694, v_num=1, val_acc=0.755]
Epoch 81:  28%|██▊       | 33/117 [00:02<00:05, 16.23it/s, loss=0.694, v_num=1, val_acc=0.755]
Epoch 81:  28%|██▊       | 33/117 [00:02<00:05, 16.03it/s, loss=0.683, v_num=1, val_acc=0.755]
Epoch 81:  29%|██▉       | 34/117 [00:02<00:05, 16.45it/s, loss=0.683, v_num=1, val_acc=0.755]
Epoch 81:  29%|██▉       | 34/117 [00:02<00:05, 16.25it/s, loss=0.687, v_num=1, val_acc=0.755]
Epoch 81:  30%|██▉       | 35/117 [00:02<00:04, 16.66it/s, loss=0.687, v_num=1, val_acc=0.755]
Epoch 81:  30%|██▉       | 35/117 [00:02<00:04, 16.46it/s, loss=0.69, v_num=1, val_acc=0.755]
Epoch 81:  31%|███       | 36/117 [00:02<00:04, 16.85it/s, loss=0.69, v_num=1, val_acc=0.755]
Epoch 81:  31%|███       | 36/117 [00:02<00:04, 16.66it/s, loss=0.679, v_num=1, val_acc=0.755]
Epoch 81:  32%|███▏      | 37/117 [00:02<00:04, 17.05it/s, loss=0.679, v_num=1, val_acc=0.755]
Epoch 81:  32%|███▏      | 37/117 [00:02<00:04, 16.85it/s, loss=0.683, v_num=1, val_acc=0.755]
Epoch 81:  32%|███▏      | 38/117 [00:02<00:04, 17.24it/s, loss=0.683, v_num=1, val_acc=0.755]
Epoch 81:  32%|███▏      | 38/117 [00:02<00:04, 17.04it/s, loss=0.682, v_num=1, val_acc=0.755]
Epoch 81:  33%|███▎      | 39/117 [00:02<00:04, 17.42it/s, loss=0.682, v_num=1, val_acc=0.755]
Epoch 81:  33%|███▎      | 39/117 [00:02<00:04, 17.22it/s, loss=0.681, v_num=1, val_acc=0.755]
Epoch 81:  34%|███▍      | 40/117 [00:02<00:04, 17.59it/s, loss=0.681, v_num=1, val_acc=0.755]
Epoch 81:  34%|███▍      | 40/117 [00:02<00:04, 17.40it/s, loss=0.683, v_num=1, val_acc=0.755]
Epoch 81:  35%|███▌      | 41/117 [00:02<00:04, 17.76it/s, loss=0.683, v_num=1, val_acc=0.755]
Epoch 81:  35%|███▌      | 41/117 [00:02<00:04, 17.57it/s, loss=0.682, v_num=1, val_acc=0.755]
Epoch 81:  36%|███▌      | 42/117 [00:02<00:04, 17.93it/s, loss=0.682, v_num=1, val_acc=0.755]
Epoch 81:  36%|███▌      | 42/117 [00:02<00:04, 17.74it/s, loss=0.682, v_num=1, val_acc=0.755]
Epoch 81:  37%|███▋      | 43/117 [00:02<00:04, 18.09it/s, loss=0.682, v_num=1, val_acc=0.755]
Epoch 81:  37%|███▋      | 43/117 [00:02<00:04, 17.90it/s, loss=0.684, v_num=1, val_acc=0.755]
Epoch 81:  38%|███▊      | 44/117 [00:02<00:04, 18.24it/s, loss=0.684, v_num=1, val_acc=0.755]
Epoch 81:  38%|███▊      | 44/117 [00:02<00:04, 18.05it/s, loss=0.69, v_num=1, val_acc=0.755]
Epoch 81:  38%|███▊      | 45/117 [00:02<00:03, 18.39it/s, loss=0.69, v_num=1, val_acc=0.755]
Epoch 81:  38%|███▊      | 45/117 [00:02<00:03, 18.20it/s, loss=0.689, v_num=1, val_acc=0.755]
Epoch 81:  39%|███▉      | 46/117 [00:02<00:03, 18.54it/s, loss=0.689, v_num=1, val_acc=0.755]
Epoch 81:  39%|███▉      | 46/117 [00:02<00:03, 18.35it/s, loss=0.684, v_num=1, val_acc=0.755]
Epoch 81:  40%|████      | 47/117 [00:02<00:03, 18.68it/s, loss=0.684, v_num=1, val_acc=0.755]
Epoch 81:  40%|████      | 47/117 [00:02<00:03, 18.50it/s, loss=0.684, v_num=1, val_acc=0.755]
Epoch 81:  41%|████      | 48/117 [00:02<00:03, 18.82it/s, loss=0.684, v_num=1, val_acc=0.755]
Epoch 81:  41%|████      | 48/117 [00:02<00:03, 18.64it/s, loss=0.686, v_num=1, val_acc=0.755]
Epoch 81:  42%|████▏     | 49/117 [00:02<00:03, 18.96it/s, loss=0.686, v_num=1, val_acc=0.755]
Epoch 81:  42%|████▏     | 49/117 [00:02<00:03, 18.77it/s, loss=0.685, v_num=1, val_acc=0.755]
Epoch 81:  43%|████▎     | 50/117 [00:02<00:03, 19.09it/s, loss=0.685, v_num=1, val_acc=0.755]
Epoch 81:  43%|████▎     | 50/117 [00:02<00:03, 18.91it/s, loss=0.687, v_num=1, val_acc=0.755]
Epoch 81:  44%|████▎     | 51/117 [00:02<00:03, 19.22it/s, loss=0.687, v_num=1, val_acc=0.755]
Epoch 81:  44%|████▎     | 51/117 [00:02<00:03, 19.04it/s, loss=0.692, v_num=1, val_acc=0.755]
Epoch 81:  44%|████▍     | 52/117 [00:02<00:03, 19.35it/s, loss=0.692, v_num=1, val_acc=0.755]
Epoch 81:  44%|████▍     | 52/117 [00:02<00:03, 19.17it/s, loss=0.699, v_num=1, val_acc=0.755]
Epoch 81:  45%|████▌     | 53/117 [00:02<00:03, 19.47it/s, loss=0.699, v_num=1, val_acc=0.755]
Epoch 81:  45%|████▌     | 53/117 [00:02<00:03, 19.29it/s, loss=0.703, v_num=1, val_acc=0.755]
Epoch 81:  46%|████▌     | 54/117 [00:02<00:03, 19.59it/s, loss=0.703, v_num=1, val_acc=0.755]
Epoch 81:  46%|████▌     | 54/117 [00:02<00:03, 19.41it/s, loss=0.701, v_num=1, val_acc=0.755]
Epoch 81:  47%|████▋     | 55/117 [00:02<00:03, 19.70it/s, loss=0.701, v_num=1, val_acc=0.755]
Epoch 81:  47%|████▋     | 55/117 [00:02<00:03, 19.53it/s, loss=0.702, v_num=1, val_acc=0.755]
Epoch 81:  48%|████▊     | 56/117 [00:02<00:03, 19.82it/s, loss=0.702, v_num=1, val_acc=0.755]
Epoch 81:  48%|████▊     | 56/117 [00:02<00:03, 19.64it/s, loss=0.713, v_num=1, val_acc=0.755]
Epoch 81:  49%|████▊     | 57/117 [00:02<00:03, 19.93it/s, loss=0.713, v_num=1, val_acc=0.755]
Epoch 81:  49%|████▊     | 57/117 [00:02<00:03, 19.75it/s, loss=0.713, v_num=1, val_acc=0.755]
Epoch 81:  50%|████▉     | 58/117 [00:02<00:02, 20.04it/s, loss=0.713, v_num=1, val_acc=0.755]
Epoch 81:  50%|████▉     | 58/117 [00:02<00:02, 19.86it/s, loss=0.715, v_num=1, val_acc=0.755]
Epoch 81:  50%|█████     | 59/117 [00:02<00:02, 20.14it/s, loss=0.715, v_num=1, val_acc=0.755]
Epoch 81:  50%|█████     | 59/117 [00:02<00:02, 19.97it/s, loss=0.711, v_num=1, val_acc=0.755]
Epoch 81:  51%|█████▏    | 60/117 [00:02<00:02, 20.25it/s, loss=0.711, v_num=1, val_acc=0.755]
Epoch 81:  51%|█████▏    | 60/117 [00:02<00:02, 20.07it/s, loss=0.706, v_num=1, val_acc=0.755]
Epoch 81:  52%|█████▏    | 61/117 [00:02<00:02, 20.35it/s, loss=0.706, v_num=1, val_acc=0.755]
Epoch 81:  52%|█████▏    | 61/117 [00:03<00:02, 20.18it/s, loss=0.707, v_num=1, val_acc=0.755]
Epoch 81:  53%|█████▎    | 62/117 [00:03<00:02, 20.45it/s, loss=0.707, v_num=1, val_acc=0.755]
Epoch 81:  53%|█████▎    | 62/117 [00:03<00:02, 20.28it/s, loss=0.701, v_num=1, val_acc=0.755]
Epoch 81:  54%|█████▍    | 63/117 [00:03<00:02, 20.54it/s, loss=0.701, v_num=1, val_acc=0.755]
Epoch 81:  54%|█████▍    | 63/117 [00:03<00:02, 20.37it/s, loss=0.702, v_num=1, val_acc=0.755]
Epoch 81:  55%|█████▍    | 64/117 [00:03<00:02, 20.64it/s, loss=0.702, v_num=1, val_acc=0.755]
Epoch 81:  55%|█████▍    | 64/117 [00:03<00:02, 20.47it/s, loss=0.7, v_num=1, val_acc=0.755]
Epoch 81:  56%|█████▌    | 65/117 [00:03<00:02, 20.73it/s, loss=0.7, v_num=1, val_acc=0.755]
Epoch 81:  56%|█████▌    | 65/117 [00:03<00:02, 20.56it/s, loss=0.698, v_num=1, val_acc=0.755]
Epoch 81:  56%|█████▋    | 66/117 [00:03<00:02, 20.82it/s, loss=0.698, v_num=1, val_acc=0.755]
Epoch 81:  56%|█████▋    | 66/117 [00:03<00:02, 20.65it/s, loss=0.698, v_num=1, val_acc=0.755]
Epoch 81:  57%|█████▋    | 67/117 [00:03<00:02, 20.91it/s, loss=0.698, v_num=1, val_acc=0.755]
Epoch 81:  57%|█████▋    | 67/117 [00:03<00:02, 20.74it/s, loss=0.696, v_num=1, val_acc=0.755]
Epoch 81:  58%|█████▊    | 68/117 [00:03<00:02, 20.99it/s, loss=0.696, v_num=1, val_acc=0.755]
Epoch 81:  58%|█████▊    | 68/117 [00:03<00:02, 20.83it/s, loss=0.694, v_num=1, val_acc=0.755]
Epoch 81:  59%|█████▉    | 69/117 [00:03<00:02, 21.08it/s, loss=0.694, v_num=1, val_acc=0.755]
Epoch 81:  59%|█████▉    | 69/117 [00:03<00:02, 20.92it/s, loss=0.694, v_num=1, val_acc=0.755]
Epoch 81:  60%|█████▉    | 70/117 [00:03<00:02, 21.16it/s, loss=0.694, v_num=1, val_acc=0.755]
Epoch 81:  60%|█████▉    | 70/117 [00:03<00:02, 21.00it/s, loss=0.693, v_num=1, val_acc=0.755]
Epoch 81:  61%|██████    | 71/117 [00:03<00:02, 21.24it/s, loss=0.693, v_num=1, val_acc=0.755]
Epoch 81:  61%|██████    | 71/117 [00:03<00:02, 21.08it/s, loss=0.688, v_num=1, val_acc=0.755]
Epoch 81:  62%|██████▏   | 72/117 [00:03<00:02, 21.32it/s, loss=0.688, v_num=1, val_acc=0.755]
Epoch 81:  62%|██████▏   | 72/117 [00:03<00:02, 21.16it/s, loss=0.681, v_num=1, val_acc=0.755]
Epoch 81:  62%|██████▏   | 73/117 [00:03<00:02, 21.40it/s, loss=0.681, v_num=1, val_acc=0.755]
Epoch 81:  62%|██████▏   | 73/117 [00:03<00:02, 21.24it/s, loss=0.683, v_num=1, val_acc=0.755]
Epoch 81:  63%|██████▎   | 74/117 [00:03<00:02, 21.48it/s, loss=0.683, v_num=1, val_acc=0.755]
Epoch 81:  63%|██████▎   | 74/117 [00:03<00:02, 21.32it/s, loss=0.683, v_num=1, val_acc=0.755]
Epoch 81:  64%|██████▍   | 75/117 [00:03<00:01, 21.55it/s, loss=0.683, v_num=1, val_acc=0.755]
Epoch 81:  64%|██████▍   | 75/117 [00:03<00:01, 21.40it/s, loss=0.68, v_num=1, val_acc=0.755]
Epoch 81:  65%|██████▍   | 76/117 [00:03<00:01, 21.63it/s, loss=0.68, v_num=1, val_acc=0.755]
Epoch 81:  65%|██████▍   | 76/117 [00:03<00:01, 21.47it/s, loss=0.677, v_num=1, val_acc=0.755]
Epoch 81:  66%|██████▌   | 77/117 [00:03<00:01, 21.70it/s, loss=0.677, v_num=1, val_acc=0.755]
Epoch 81:  66%|██████▌   | 77/117 [00:03<00:01, 21.54it/s, loss=0.674, v_num=1, val_acc=0.755]
Epoch 81:  67%|██████▋   | 78/117 [00:03<00:01, 21.77it/s, loss=0.674, v_num=1, val_acc=0.755]
Epoch 81:  67%|██████▋   | 78/117 [00:03<00:01, 21.61it/s, loss=0.675, v_num=1, val_acc=0.755]
Epoch 81:  68%|██████▊   | 79/117 [00:03<00:01, 21.84it/s, loss=0.675, v_num=1, val_acc=0.755]
Epoch 81:  68%|██████▊   | 79/117 [00:03<00:01, 21.68it/s, loss=0.675, v_num=1, val_acc=0.755]
Epoch 81:  68%|██████▊   | 80/117 [00:03<00:01, 21.91it/s, loss=0.675, v_num=1, val_acc=0.755]
Epoch 81:  68%|██████▊   | 80/117 [00:03<00:01, 21.75it/s, loss=0.681, v_num=1, val_acc=0.755]
Epoch 81:  69%|██████▉   | 81/117 [00:03<00:01, 21.97it/s, loss=0.681, v_num=1, val_acc=0.755]
Epoch 81:  69%|██████▉   | 81/117 [00:03<00:01, 21.82it/s, loss=0.68, v_num=1, val_acc=0.755]
Epoch 81:  70%|███████   | 82/117 [00:03<00:01, 22.02it/s, loss=0.68, v_num=1, val_acc=0.755]
Epoch 81:  70%|███████   | 82/117 [00:03<00:01, 21.87it/s, loss=0.684, v_num=1, val_acc=0.755]
Epoch 81:  71%|███████   | 83/117 [00:03<00:01, 22.09it/s, loss=0.684, v_num=1, val_acc=0.755]
Epoch 81:  71%|███████   | 83/117 [00:03<00:01, 21.94it/s, loss=0.684, v_num=1, val_acc=0.755]
Epoch 81:  72%|███████▏  | 84/117 [00:03<00:01, 22.15it/s, loss=0.684, v_num=1, val_acc=0.755]
Epoch 81:  72%|███████▏  | 84/117 [00:03<00:01, 22.01it/s, loss=0.684, v_num=1, val_acc=0.755]
Epoch 81:  73%|███████▎  | 85/117 [00:03<00:01, 22.22it/s, loss=0.684, v_num=1, val_acc=0.755]
Epoch 81:  73%|███████▎  | 85/117 [00:03<00:01, 22.07it/s, loss=0.688, v_num=1, val_acc=0.755]
Epoch 81:  74%|███████▎  | 86/117 [00:03<00:01, 22.28it/s, loss=0.688, v_num=1, val_acc=0.755]
Epoch 81:  74%|███████▎  | 86/117 [00:03<00:01, 22.13it/s, loss=0.69, v_num=1, val_acc=0.755]
Epoch 81:  74%|███████▍  | 87/117 [00:03<00:01, 22.33it/s, loss=0.69, v_num=1, val_acc=0.755]
Epoch 81:  74%|███████▍  | 87/117 [00:03<00:01, 22.19it/s, loss=0.692, v_num=1, val_acc=0.755]
Epoch 81:  75%|███████▌  | 88/117 [00:03<00:01, 22.39it/s, loss=0.692, v_num=1, val_acc=0.755]
Epoch 81:  75%|███████▌  | 88/117 [00:03<00:01, 22.25it/s, loss=0.688, v_num=1, val_acc=0.755]
Epoch 81:  76%|███████▌  | 89/117 [00:03<00:01, 22.45it/s, loss=0.688, v_num=1, val_acc=0.755]
Epoch 81:  76%|███████▌  | 89/117 [00:03<00:01, 22.31it/s, loss=0.688, v_num=1, val_acc=0.755]
Epoch 81:  77%|███████▋  | 90/117 [00:03<00:01, 22.51it/s, loss=0.688, v_num=1, val_acc=0.755]
Epoch 81:  77%|███████▋  | 90/117 [00:04<00:01, 22.37it/s, loss=0.693, v_num=1, val_acc=0.755]
Epoch 81:  78%|███████▊  | 91/117 [00:04<00:01, 22.56it/s, loss=0.693, v_num=1, val_acc=0.755]
Epoch 81:  78%|███████▊  | 91/117 [00:04<00:01, 22.42it/s, loss=0.687, v_num=1, val_acc=0.755]
Epoch 81:  79%|███████▊  | 92/117 [00:04<00:01, 22.62it/s, loss=0.687, v_num=1, val_acc=0.755]
Epoch 81:  79%|███████▊  | 92/117 [00:04<00:01, 22.48it/s, loss=0.694, v_num=1, val_acc=0.755]
Epoch 81:  79%|███████▉  | 93/117 [00:04<00:01, 22.67it/s, loss=0.694, v_num=1, val_acc=0.755]
Epoch 81:  79%|███████▉  | 93/117 [00:04<00:01, 22.53it/s, loss=0.693, v_num=1, val_acc=0.755]
Epoch 81:  80%|████████  | 94/117 [00:04<00:01, 22.72it/s, loss=0.693, v_num=1, val_acc=0.755]
Epoch 81:  80%|████████  | 94/117 [00:04<00:01, 22.58it/s, loss=0.694, v_num=1, val_acc=0.755]
Epoch 81:  81%|████████  | 95/117 [00:04<00:00, 22.77it/s, loss=0.694, v_num=1, val_acc=0.755]
Epoch 81:  81%|████████  | 95/117 [00:04<00:00, 22.64it/s, loss=0.69, v_num=1, val_acc=0.755]
Epoch 81:  82%|████████▏ | 96/117 [00:04<00:00, 22.83it/s, loss=0.69, v_num=1, val_acc=0.755]
Epoch 81:  82%|████████▏ | 96/117 [00:04<00:00, 22.69it/s, loss=0.689, v_num=1, val_acc=0.755]
Epoch 81:  83%|████████▎ | 97/117 [00:04<00:00, 22.88it/s, loss=0.689, v_num=1, val_acc=0.755]
Epoch 81:  83%|████████▎ | 97/117 [00:04<00:00, 22.74it/s, loss=0.69, v_num=1, val_acc=0.755]

Validation: 0it [00:00, ?it/s]

Validation:   0%|          | 0/20 [00:00<?, ?it/s]

Validation DataLoader 0:   0%|          | 0/20 [00:00<?, ?it/s]

Validation DataLoader 0:   5%|▌         | 1/20 [00:00<00:00, 189.34it/s]
Epoch 81:  84%|████████▍ | 98/117 [00:05<00:00, 19.17it/s, loss=0.69, v_num=1, val_acc=0.755]

Validation DataLoader 0:  10%|█         | 2/20 [00:00<00:00, 55.51it/s]
Epoch 81:  85%|████████▍ | 99/117 [00:05<00:00, 19.25it/s, loss=0.69, v_num=1, val_acc=0.755]

Validation DataLoader 0:  15%|█▌        | 3/20 [00:00<00:00, 44.01it/s]
Epoch 81:  85%|████████▌ | 100/117 [00:05<00:00, 19.32it/s, loss=0.69, v_num=1, val_acc=0.755]

Validation DataLoader 0:  20%|██        | 4/20 [00:00<00:00, 40.02it/s]
Epoch 81:  86%|████████▋ | 101/117 [00:05<00:00, 19.40it/s, loss=0.69, v_num=1, val_acc=0.755]

Validation DataLoader 0:  25%|██▌       | 5/20 [00:00<00:00, 37.81it/s]
Epoch 81:  87%|████████▋ | 102/117 [00:05<00:00, 19.47it/s, loss=0.69, v_num=1, val_acc=0.755]

Validation DataLoader 0:  30%|███       | 6/20 [00:00<00:00, 36.70it/s]
Epoch 81:  88%|████████▊ | 103/117 [00:05<00:00, 19.54it/s, loss=0.69, v_num=1, val_acc=0.755]

Validation DataLoader 0:  35%|███▌      | 7/20 [00:00<00:00, 35.90it/s]
Epoch 81:  89%|████████▉ | 104/117 [00:05<00:00, 19.61it/s, loss=0.69, v_num=1, val_acc=0.755]

Validation DataLoader 0:  40%|████      | 8/20 [00:00<00:00, 35.30it/s]
Epoch 81:  90%|████████▉ | 105/117 [00:05<00:00, 19.69it/s, loss=0.69, v_num=1, val_acc=0.755]

Validation DataLoader 0:  45%|████▌     | 9/20 [00:00<00:00, 34.85it/s]
Epoch 81:  91%|█████████ | 106/117 [00:05<00:00, 19.76it/s, loss=0.69, v_num=1, val_acc=0.755]

Validation DataLoader 0:  50%|█████     | 10/20 [00:00<00:00, 34.52it/s]
Epoch 81:  91%|█████████▏| 107/117 [00:05<00:00, 19.83it/s, loss=0.69, v_num=1, val_acc=0.755]

Validation DataLoader 0:  55%|█████▌    | 11/20 [00:00<00:00, 34.15it/s]
Epoch 81:  92%|█████████▏| 108/117 [00:05<00:00, 19.89it/s, loss=0.69, v_num=1, val_acc=0.755]

Validation DataLoader 0:  60%|██████    | 12/20 [00:00<00:00, 33.97it/s]
Epoch 81:  93%|█████████▎| 109/117 [00:05<00:00, 19.96it/s, loss=0.69, v_num=1, val_acc=0.755]

Validation DataLoader 0:  65%|██████▌   | 13/20 [00:00<00:00, 33.78it/s]
Epoch 81:  94%|█████████▍| 110/117 [00:05<00:00, 20.03it/s, loss=0.69, v_num=1, val_acc=0.755]

Validation DataLoader 0:  70%|███████   | 14/20 [00:00<00:00, 33.63it/s]
Epoch 81:  95%|█████████▍| 111/117 [00:05<00:00, 20.10it/s, loss=0.69, v_num=1, val_acc=0.755]

Validation DataLoader 0:  75%|███████▌  | 15/20 [00:00<00:00, 33.48it/s]
Epoch 81:  96%|█████████▌| 112/117 [00:05<00:00, 20.16it/s, loss=0.69, v_num=1, val_acc=0.755]

Validation DataLoader 0:  80%|████████  | 16/20 [00:00<00:00, 33.36it/s]
Epoch 81:  97%|█████████▋| 113/117 [00:05<00:00, 20.23it/s, loss=0.69, v_num=1, val_acc=0.755]

Validation DataLoader 0:  85%|████████▌ | 17/20 [00:00<00:00, 33.24it/s]
Epoch 81:  97%|█████████▋| 114/117 [00:05<00:00, 20.29it/s, loss=0.69, v_num=1, val_acc=0.755]

Validation DataLoader 0:  90%|█████████ | 18/20 [00:00<00:00, 33.14it/s]
Epoch 81:  98%|█████████▊| 115/117 [00:05<00:00, 20.35it/s, loss=0.69, v_num=1, val_acc=0.755]

Validation DataLoader 0:  95%|█████████▌| 19/20 [00:00<00:00, 33.06it/s]
Epoch 81:  99%|█████████▉| 116/117 [00:05<00:00, 20.42it/s, loss=0.69, v_num=1, val_acc=0.755]

Validation DataLoader 0: 100%|██████████| 20/20 [00:00<00:00, 33.05it/s]
Epoch 81: 100%|██████████| 117/117 [00:05<00:00, 20.48it/s, loss=0.69, v_num=1, val_acc=0.755]
Epoch 81: 100%|██████████| 117/117 [00:05<00:00, 20.41it/s, loss=0.69, v_num=1, val_acc=0.755]


Epoch 81: 100%|██████████| 117/117 [00:05<00:00, 20.41it/s, loss=0.69, v_num=1, val_acc=0.755]
Epoch 81:   0%|          | 0/117 [00:00<?, ?it/s, loss=0.69, v_num=1, val_acc=0.755]
Epoch 82:   0%|          | 0/117 [00:00<?, ?it/s, loss=0.69, v_num=1, val_acc=0.755]
Epoch 82:   1%|          | 1/117 [00:00<01:45,  1.10it/s, loss=0.69, v_num=1, val_acc=0.755]
Epoch 82:   1%|          | 1/117 [00:00<01:47,  1.07it/s, loss=0.691, v_num=1, val_acc=0.755]
Epoch 82:   2%|▏         | 2/117 [00:00<00:54,  2.13it/s, loss=0.691, v_num=1, val_acc=0.755]
Epoch 82:   2%|▏         | 2/117 [00:00<00:55,  2.07it/s, loss=0.691, v_num=1, val_acc=0.755]
Epoch 82:   3%|▎         | 3/117 [00:00<00:37,  3.07it/s, loss=0.691, v_num=1, val_acc=0.755]
Epoch 82:   3%|▎         | 3/117 [00:01<00:38,  2.99it/s, loss=0.69, v_num=1, val_acc=0.755]
Epoch 82:   3%|▎         | 4/117 [00:01<00:28,  3.95it/s, loss=0.69, v_num=1, val_acc=0.755]
Epoch 82:   3%|▎         | 4/117 [00:01<00:29,  3.85it/s, loss=0.69, v_num=1, val_acc=0.755]
Epoch 82:   4%|▍         | 5/117 [00:01<00:23,  4.77it/s, loss=0.69, v_num=1, val_acc=0.755]
Epoch 82:   4%|▍         | 5/117 [00:01<00:24,  4.66it/s, loss=0.689, v_num=1, val_acc=0.755]
Epoch 82:   5%|▌         | 6/117 [00:01<00:19,  5.55it/s, loss=0.689, v_num=1, val_acc=0.755]
Epoch 82:   5%|▌         | 6/117 [00:01<00:20,  5.42it/s, loss=0.691, v_num=1, val_acc=0.755]
Epoch 82:   6%|▌         | 7/117 [00:01<00:17,  6.28it/s, loss=0.691, v_num=1, val_acc=0.755]
Epoch 82:   6%|▌         | 7/117 [00:01<00:17,  6.14it/s, loss=0.689, v_num=1, val_acc=0.755]
Epoch 82:   7%|▋         | 8/117 [00:01<00:15,  6.97it/s, loss=0.689, v_num=1, val_acc=0.755]
Epoch 82:   7%|▋         | 8/117 [00:01<00:15,  6.82it/s, loss=0.689, v_num=1, val_acc=0.755]
Epoch 82:   8%|▊         | 9/117 [00:01<00:14,  7.60it/s, loss=0.689, v_num=1, val_acc=0.755]
Epoch 82:   8%|▊         | 9/117 [00:01<00:14,  7.44it/s, loss=0.691, v_num=1, val_acc=0.755]
Epoch 82:   9%|▊         | 10/117 [00:01<00:13,  8.21it/s, loss=0.691, v_num=1, val_acc=0.755]
Epoch 82:   9%|▊         | 10/117 [00:01<00:13,  8.04it/s, loss=0.693, v_num=1, val_acc=0.755]
Epoch 82:   9%|▉         | 11/117 [00:01<00:12,  8.76it/s, loss=0.693, v_num=1, val_acc=0.755]
Epoch 82:   9%|▉         | 11/117 [00:01<00:12,  8.59it/s, loss=0.699, v_num=1, val_acc=0.755]
Epoch 82:  10%|█         | 12/117 [00:01<00:11,  9.31it/s, loss=0.699, v_num=1, val_acc=0.755]
Epoch 82:  10%|█         | 12/117 [00:01<00:11,  9.13it/s, loss=0.694, v_num=1, val_acc=0.755]
Epoch 82:  11%|█         | 13/117 [00:01<00:10,  9.83it/s, loss=0.694, v_num=1, val_acc=0.755]
Epoch 82:  11%|█         | 13/117 [00:01<00:10,  9.64it/s, loss=0.687, v_num=1, val_acc=0.755]
Epoch 82:  12%|█▏        | 14/117 [00:01<00:09, 10.31it/s, loss=0.687, v_num=1, val_acc=0.755]
Epoch 82:  12%|█▏        | 14/117 [00:01<00:10, 10.13it/s, loss=0.689, v_num=1, val_acc=0.755]
Epoch 82:  13%|█▎        | 15/117 [00:01<00:09, 10.75it/s, loss=0.689, v_num=1, val_acc=0.755]
Epoch 82:  13%|█▎        | 15/117 [00:01<00:09, 10.57it/s, loss=0.684, v_num=1, val_acc=0.755]
Epoch 82:  14%|█▎        | 16/117 [00:01<00:09, 11.20it/s, loss=0.684, v_num=1, val_acc=0.755]
Epoch 82:  14%|█▎        | 16/117 [00:01<00:09, 11.01it/s, loss=0.684, v_num=1, val_acc=0.755]
Epoch 82:  15%|█▍        | 17/117 [00:01<00:08, 11.58it/s, loss=0.684, v_num=1, val_acc=0.755]
Epoch 82:  15%|█▍        | 17/117 [00:01<00:08, 11.39it/s, loss=0.682, v_num=1, val_acc=0.755]
Epoch 82:  15%|█▌        | 18/117 [00:01<00:08, 11.99it/s, loss=0.682, v_num=1, val_acc=0.755]
Epoch 82:  15%|█▌        | 18/117 [00:01<00:08, 11.79it/s, loss=0.688, v_num=1, val_acc=0.755]
Epoch 82:  16%|█▌        | 19/117 [00:01<00:07, 12.35it/s, loss=0.688, v_num=1, val_acc=0.755]
Epoch 82:  16%|█▌        | 19/117 [00:01<00:08, 12.16it/s, loss=0.689, v_num=1, val_acc=0.755]
Epoch 82:  17%|█▋        | 20/117 [00:01<00:07, 12.73it/s, loss=0.689, v_num=1, val_acc=0.755]
Epoch 82:  17%|█▋        | 20/117 [00:01<00:07, 12.53it/s, loss=0.691, v_num=1, val_acc=0.755]
Epoch 82:  18%|█▊        | 21/117 [00:01<00:07, 13.08it/s, loss=0.691, v_num=1, val_acc=0.755]
Epoch 82:  18%|█▊        | 21/117 [00:01<00:07, 12.88it/s, loss=0.69, v_num=1, val_acc=0.755]
Epoch 82:  19%|█▉        | 22/117 [00:01<00:07, 13.42it/s, loss=0.69, v_num=1, val_acc=0.755]
Epoch 82:  19%|█▉        | 22/117 [00:01<00:07, 13.22it/s, loss=0.691, v_num=1, val_acc=0.755]
Epoch 82:  20%|█▉        | 23/117 [00:01<00:06, 13.74it/s, loss=0.691, v_num=1, val_acc=0.755]
Epoch 82:  20%|█▉        | 23/117 [00:01<00:06, 13.54it/s, loss=0.687, v_num=1, val_acc=0.755]
Epoch 82:  21%|██        | 24/117 [00:01<00:06, 14.05it/s, loss=0.687, v_num=1, val_acc=0.755]
Epoch 82:  21%|██        | 24/117 [00:01<00:06, 13.84it/s, loss=0.691, v_num=1, val_acc=0.755]
Epoch 82:  21%|██▏       | 25/117 [00:01<00:06, 14.34it/s, loss=0.691, v_num=1, val_acc=0.755]
Epoch 82:  21%|██▏       | 25/117 [00:01<00:06, 14.14it/s, loss=0.689, v_num=1, val_acc=0.755]
Epoch 82:  22%|██▏       | 26/117 [00:01<00:06, 14.62it/s, loss=0.689, v_num=1, val_acc=0.755]
Epoch 82:  22%|██▏       | 26/117 [00:01<00:06, 14.42it/s, loss=0.685, v_num=1, val_acc=0.755]
Epoch 82:  23%|██▎       | 27/117 [00:01<00:06, 14.89it/s, loss=0.685, v_num=1, val_acc=0.755]
Epoch 82:  23%|██▎       | 27/117 [00:01<00:06, 14.68it/s, loss=0.689, v_num=1, val_acc=0.755]
Epoch 82:  24%|██▍       | 28/117 [00:01<00:05, 15.15it/s, loss=0.689, v_num=1, val_acc=0.755]
Epoch 82:  24%|██▍       | 28/117 [00:01<00:05, 14.95it/s, loss=0.686, v_num=1, val_acc=0.755]
Epoch 82:  25%|██▍       | 29/117 [00:01<00:05, 15.41it/s, loss=0.686, v_num=1, val_acc=0.755]
Epoch 82:  25%|██▍       | 29/117 [00:01<00:05, 15.20it/s, loss=0.679, v_num=1, val_acc=0.755]
Epoch 82:  26%|██▌       | 30/117 [00:01<00:05, 15.65it/s, loss=0.679, v_num=1, val_acc=0.755]
Epoch 82:  26%|██▌       | 30/117 [00:01<00:05, 15.45it/s, loss=0.677, v_num=1, val_acc=0.755]
Epoch 82:  26%|██▋       | 31/117 [00:01<00:05, 15.89it/s, loss=0.677, v_num=1, val_acc=0.755]
Epoch 82:  26%|██▋       | 31/117 [00:01<00:05, 15.68it/s, loss=0.676, v_num=1, val_acc=0.755]
Epoch 82:  27%|██▋       | 32/117 [00:01<00:05, 16.11it/s, loss=0.676, v_num=1, val_acc=0.755]
Epoch 82:  27%|██▋       | 32/117 [00:02<00:05, 15.91it/s, loss=0.676, v_num=1, val_acc=0.755]
Epoch 82:  28%|██▊       | 33/117 [00:02<00:05, 16.33it/s, loss=0.676, v_num=1, val_acc=0.755]
Epoch 82:  28%|██▊       | 33/117 [00:02<00:05, 16.13it/s, loss=0.678, v_num=1, val_acc=0.755]
Epoch 82:  29%|██▉       | 34/117 [00:02<00:05, 16.53it/s, loss=0.678, v_num=1, val_acc=0.755]
Epoch 82:  29%|██▉       | 34/117 [00:02<00:05, 16.33it/s, loss=0.68, v_num=1, val_acc=0.755]
Epoch 82:  30%|██▉       | 35/117 [00:02<00:04, 16.73it/s, loss=0.68, v_num=1, val_acc=0.755]
Epoch 82:  30%|██▉       | 35/117 [00:02<00:04, 16.53it/s, loss=0.683, v_num=1, val_acc=0.755]
Epoch 82:  31%|███       | 36/117 [00:02<00:04, 16.92it/s, loss=0.683, v_num=1, val_acc=0.755]
Epoch 82:  31%|███       | 36/117 [00:02<00:04, 16.73it/s, loss=0.685, v_num=1, val_acc=0.755]
Epoch 82:  32%|███▏      | 37/117 [00:02<00:04, 17.12it/s, loss=0.685, v_num=1, val_acc=0.755]
Epoch 82:  32%|███▏      | 37/117 [00:02<00:04, 16.92it/s, loss=0.682, v_num=1, val_acc=0.755]
Epoch 82:  32%|███▏      | 38/117 [00:02<00:04, 17.30it/s, loss=0.682, v_num=1, val_acc=0.755]
Epoch 82:  32%|███▏      | 38/117 [00:02<00:04, 17.11it/s, loss=0.684, v_num=1, val_acc=0.755]
Epoch 82:  33%|███▎      | 39/117 [00:02<00:04, 17.49it/s, loss=0.684, v_num=1, val_acc=0.755]
Epoch 82:  33%|███▎      | 39/117 [00:02<00:04, 17.29it/s, loss=0.686, v_num=1, val_acc=0.755]
Epoch 82:  34%|███▍      | 40/117 [00:02<00:04, 17.66it/s, loss=0.686, v_num=1, val_acc=0.755]
Epoch 82:  34%|███▍      | 40/117 [00:02<00:04, 17.46it/s, loss=0.683, v_num=1, val_acc=0.755]
Epoch 82:  35%|███▌      | 41/117 [00:02<00:04, 17.82it/s, loss=0.683, v_num=1, val_acc=0.755]
Epoch 82:  35%|███▌      | 41/117 [00:02<00:04, 17.63it/s, loss=0.685, v_num=1, val_acc=0.755]
Epoch 82:  36%|███▌      | 42/117 [00:02<00:04, 17.98it/s, loss=0.685, v_num=1, val_acc=0.755]
Epoch 82:  36%|███▌      | 42/117 [00:02<00:04, 17.79it/s, loss=0.688, v_num=1, val_acc=0.755]
Epoch 82:  37%|███▋      | 43/117 [00:02<00:04, 18.14it/s, loss=0.688, v_num=1, val_acc=0.755]
Epoch 82:  37%|███▋      | 43/117 [00:02<00:04, 17.95it/s, loss=0.69, v_num=1, val_acc=0.755]
Epoch 82:  38%|███▊      | 44/117 [00:02<00:03, 18.29it/s, loss=0.69, v_num=1, val_acc=0.755]
Epoch 82:  38%|███▊      | 44/117 [00:02<00:04, 18.10it/s, loss=0.689, v_num=1, val_acc=0.755]
Epoch 82:  38%|███▊      | 45/117 [00:02<00:03, 18.40it/s, loss=0.689, v_num=1, val_acc=0.755]
Epoch 82:  38%|███▊      | 45/117 [00:02<00:03, 18.23it/s, loss=0.692, v_num=1, val_acc=0.755]
Epoch 82:  39%|███▉      | 46/117 [00:02<00:03, 18.57it/s, loss=0.692, v_num=1, val_acc=0.755]
Epoch 82:  39%|███▉      | 46/117 [00:02<00:03, 18.38it/s, loss=0.689, v_num=1, val_acc=0.755]
Epoch 82:  40%|████      | 47/117 [00:02<00:03, 18.71it/s, loss=0.689, v_num=1, val_acc=0.755]
Epoch 82:  40%|████      | 47/117 [00:02<00:03, 18.52it/s, loss=0.688, v_num=1, val_acc=0.755]
Epoch 82:  41%|████      | 48/117 [00:02<00:03, 18.84it/s, loss=0.688, v_num=1, val_acc=0.755]
Epoch 82:  41%|████      | 48/117 [00:02<00:03, 18.66it/s, loss=0.686, v_num=1, val_acc=0.755]
Epoch 82:  42%|████▏     | 49/117 [00:02<00:03, 18.97it/s, loss=0.686, v_num=1, val_acc=0.755]
Epoch 82:  42%|████▏     | 49/117 [00:02<00:03, 18.79it/s, loss=0.69, v_num=1, val_acc=0.755]
Epoch 82:  43%|████▎     | 50/117 [00:02<00:03, 19.11it/s, loss=0.69, v_num=1, val_acc=0.755]
Epoch 82:  43%|████▎     | 50/117 [00:02<00:03, 18.93it/s, loss=0.69, v_num=1, val_acc=0.755]
Epoch 82:  44%|████▎     | 51/117 [00:02<00:03, 19.23it/s, loss=0.69, v_num=1, val_acc=0.755]
Epoch 82:  44%|████▎     | 51/117 [00:02<00:03, 19.05it/s, loss=0.688, v_num=1, val_acc=0.755]
Epoch 82:  44%|████▍     | 52/117 [00:02<00:03, 19.35it/s, loss=0.688, v_num=1, val_acc=0.755]
Epoch 82:  44%|████▍     | 52/117 [00:02<00:03, 19.17it/s, loss=0.692, v_num=1, val_acc=0.755]
Epoch 82:  45%|████▌     | 53/117 [00:02<00:03, 19.48it/s, loss=0.692, v_num=1, val_acc=0.755]
Epoch 82:  45%|████▌     | 53/117 [00:02<00:03, 19.30it/s, loss=0.697, v_num=1, val_acc=0.755]
Epoch 82:  46%|████▌     | 54/117 [00:02<00:03, 19.60it/s, loss=0.697, v_num=1, val_acc=0.755]
Epoch 82:  46%|████▌     | 54/117 [00:02<00:03, 19.42it/s, loss=0.695, v_num=1, val_acc=0.755]
Epoch 82:  47%|████▋     | 55/117 [00:02<00:03, 19.71it/s, loss=0.695, v_num=1, val_acc=0.755]
Epoch 82:  47%|████▋     | 55/117 [00:02<00:03, 19.53it/s, loss=0.693, v_num=1, val_acc=0.755]
Epoch 82:  48%|████▊     | 56/117 [00:02<00:03, 19.82it/s, loss=0.693, v_num=1, val_acc=0.755]
Epoch 82:  48%|████▊     | 56/117 [00:02<00:03, 19.64it/s, loss=0.699, v_num=1, val_acc=0.755]
Epoch 82:  49%|████▊     | 57/117 [00:02<00:03, 19.93it/s, loss=0.699, v_num=1, val_acc=0.755]
Epoch 82:  49%|████▊     | 57/117 [00:02<00:03, 19.75it/s, loss=0.702, v_num=1, val_acc=0.755]
Epoch 82:  50%|████▉     | 58/117 [00:02<00:02, 20.03it/s, loss=0.702, v_num=1, val_acc=0.755]
Epoch 82:  50%|████▉     | 58/117 [00:02<00:02, 19.86it/s, loss=0.702, v_num=1, val_acc=0.755]
Epoch 82:  50%|█████     | 59/117 [00:02<00:02, 20.13it/s, loss=0.702, v_num=1, val_acc=0.755]
Epoch 82:  50%|█████     | 59/117 [00:02<00:02, 19.96it/s, loss=0.705, v_num=1, val_acc=0.755]
Epoch 82:  51%|█████▏    | 60/117 [00:02<00:02, 20.23it/s, loss=0.705, v_num=1, val_acc=0.755]
Epoch 82:  51%|█████▏    | 60/117 [00:02<00:02, 20.06it/s, loss=0.709, v_num=1, val_acc=0.755]
Epoch 82:  52%|█████▏    | 61/117 [00:03<00:02, 20.33it/s, loss=0.709, v_num=1, val_acc=0.755]
Epoch 82:  52%|█████▏    | 61/117 [00:03<00:02, 20.16it/s, loss=0.705, v_num=1, val_acc=0.755]
Epoch 82:  53%|█████▎    | 62/117 [00:03<00:02, 20.43it/s, loss=0.705, v_num=1, val_acc=0.755]
Epoch 82:  53%|█████▎    | 62/117 [00:03<00:02, 20.26it/s, loss=0.705, v_num=1, val_acc=0.755]
Epoch 82:  54%|█████▍    | 63/117 [00:03<00:02, 20.53it/s, loss=0.705, v_num=1, val_acc=0.755]
Epoch 82:  54%|█████▍    | 63/117 [00:03<00:02, 20.36it/s, loss=0.71, v_num=1, val_acc=0.755]
Epoch 82:  55%|█████▍    | 64/117 [00:03<00:02, 20.62it/s, loss=0.71, v_num=1, val_acc=0.755]
Epoch 82:  55%|█████▍    | 64/117 [00:03<00:02, 20.45it/s, loss=0.706, v_num=1, val_acc=0.755]
Epoch 82:  56%|█████▌    | 65/117 [00:03<00:02, 20.71it/s, loss=0.706, v_num=1, val_acc=0.755]
Epoch 82:  56%|█████▌    | 65/117 [00:03<00:02, 20.54it/s, loss=0.71, v_num=1, val_acc=0.755]
Epoch 82:  56%|█████▋    | 66/117 [00:03<00:02, 20.79it/s, loss=0.71, v_num=1, val_acc=0.755]
Epoch 82:  56%|█████▋    | 66/117 [00:03<00:02, 20.63it/s, loss=0.71, v_num=1, val_acc=0.755]
Epoch 82:  57%|█████▋    | 67/117 [00:03<00:02, 20.88it/s, loss=0.71, v_num=1, val_acc=0.755]
Epoch 82:  57%|█████▋    | 67/117 [00:03<00:02, 20.72it/s, loss=0.711, v_num=1, val_acc=0.755]
Epoch 82:  58%|█████▊    | 68/117 [00:03<00:02, 20.96it/s, loss=0.711, v_num=1, val_acc=0.755]
Epoch 82:  58%|█████▊    | 68/117 [00:03<00:02, 20.80it/s, loss=0.717, v_num=1, val_acc=0.755]
Epoch 82:  59%|█████▉    | 69/117 [00:03<00:02, 21.04it/s, loss=0.717, v_num=1, val_acc=0.755]
Epoch 82:  59%|█████▉    | 69/117 [00:03<00:02, 20.88it/s, loss=0.717, v_num=1, val_acc=0.755]
Epoch 82:  60%|█████▉    | 70/117 [00:03<00:02, 21.13it/s, loss=0.717, v_num=1, val_acc=0.755]
Epoch 82:  60%|█████▉    | 70/117 [00:03<00:02, 20.97it/s, loss=0.715, v_num=1, val_acc=0.755]
Epoch 82:  61%|██████    | 71/117 [00:03<00:02, 21.21it/s, loss=0.715, v_num=1, val_acc=0.755]
Epoch 82:  61%|██████    | 71/117 [00:03<00:02, 21.05it/s, loss=0.715, v_num=1, val_acc=0.755]
Epoch 82:  62%|██████▏   | 72/117 [00:03<00:02, 21.28it/s, loss=0.715, v_num=1, val_acc=0.755]
Epoch 82:  62%|██████▏   | 72/117 [00:03<00:02, 21.12it/s, loss=0.71, v_num=1, val_acc=0.755]
Epoch 82:  62%|██████▏   | 73/117 [00:03<00:02, 21.35it/s, loss=0.71, v_num=1, val_acc=0.755]
Epoch 82:  62%|██████▏   | 73/117 [00:03<00:02, 21.20it/s, loss=0.704, v_num=1, val_acc=0.755]
Epoch 82:  63%|██████▎   | 74/117 [00:03<00:02, 21.43it/s, loss=0.704, v_num=1, val_acc=0.755]
Epoch 82:  63%|██████▎   | 74/117 [00:03<00:02, 21.27it/s, loss=0.707, v_num=1, val_acc=0.755]
Epoch 82:  64%|██████▍   | 75/117 [00:03<00:01, 21.50it/s, loss=0.707, v_num=1, val_acc=0.755]
Epoch 82:  64%|██████▍   | 75/117 [00:03<00:01, 21.35it/s, loss=0.706, v_num=1, val_acc=0.755]
Epoch 82:  65%|██████▍   | 76/117 [00:03<00:01, 21.54it/s, loss=0.706, v_num=1, val_acc=0.755]
Epoch 82:  65%|██████▍   | 76/117 [00:03<00:01, 21.40it/s, loss=0.699, v_num=1, val_acc=0.755]
Epoch 82:  66%|██████▌   | 77/117 [00:03<00:01, 21.62it/s, loss=0.699, v_num=1, val_acc=0.755]
Epoch 82:  66%|██████▌   | 77/117 [00:03<00:01, 21.47it/s, loss=0.702, v_num=1, val_acc=0.755]
Epoch 82:  67%|██████▋   | 78/117 [00:03<00:01, 21.70it/s, loss=0.702, v_num=1, val_acc=0.755]
Epoch 82:  67%|██████▋   | 78/117 [00:03<00:01, 21.54it/s, loss=0.696, v_num=1, val_acc=0.755]
Epoch 82:  68%|██████▊   | 79/117 [00:03<00:01, 21.77it/s, loss=0.696, v_num=1, val_acc=0.755]
Epoch 82:  68%|██████▊   | 79/117 [00:03<00:01, 21.61it/s, loss=0.697, v_num=1, val_acc=0.755]
Epoch 82:  68%|██████▊   | 80/117 [00:03<00:01, 21.83it/s, loss=0.697, v_num=1, val_acc=0.755]
Epoch 82:  68%|██████▊   | 80/117 [00:03<00:01, 21.68it/s, loss=0.699, v_num=1, val_acc=0.755]
Epoch 82:  69%|██████▉   | 81/117 [00:03<00:01, 21.90it/s, loss=0.699, v_num=1, val_acc=0.755]
Epoch 82:  69%|██████▉   | 81/117 [00:03<00:01, 21.75it/s, loss=0.694, v_num=1, val_acc=0.755]
Epoch 82:  70%|███████   | 82/117 [00:03<00:01, 21.95it/s, loss=0.694, v_num=1, val_acc=0.755]
Epoch 82:  70%|███████   | 82/117 [00:03<00:01, 21.81it/s, loss=0.686, v_num=1, val_acc=0.755]
Epoch 82:  71%|███████   | 83/117 [00:03<00:01, 22.02it/s, loss=0.686, v_num=1, val_acc=0.755]
Epoch 82:  71%|███████   | 83/117 [00:03<00:01, 21.87it/s, loss=0.684, v_num=1, val_acc=0.755]
Epoch 82:  72%|███████▏  | 84/117 [00:03<00:01, 22.09it/s, loss=0.684, v_num=1, val_acc=0.755]
Epoch 82:  72%|███████▏  | 84/117 [00:03<00:01, 21.94it/s, loss=0.684, v_num=1, val_acc=0.755]
Epoch 82:  73%|███████▎  | 85/117 [00:03<00:01, 22.15it/s, loss=0.684, v_num=1, val_acc=0.755]
Epoch 82:  73%|███████▎  | 85/117 [00:03<00:01, 22.00it/s, loss=0.682, v_num=1, val_acc=0.755]
Epoch 82:  74%|███████▎  | 86/117 [00:03<00:01, 22.21it/s, loss=0.682, v_num=1, val_acc=0.755]
Epoch 82:  74%|███████▎  | 86/117 [00:03<00:01, 22.07it/s, loss=0.685, v_num=1, val_acc=0.755]
Epoch 82:  74%|███████▍  | 87/117 [00:03<00:01, 22.28it/s, loss=0.685, v_num=1, val_acc=0.755]
Epoch 82:  74%|███████▍  | 87/117 [00:03<00:01, 22.13it/s, loss=0.677, v_num=1, val_acc=0.755]
Epoch 82:  75%|███████▌  | 88/117 [00:03<00:01, 22.33it/s, loss=0.677, v_num=1, val_acc=0.755]
Epoch 82:  75%|███████▌  | 88/117 [00:03<00:01, 22.19it/s, loss=0.676, v_num=1, val_acc=0.755]
Epoch 82:  76%|███████▌  | 89/117 [00:03<00:01, 22.40it/s, loss=0.676, v_num=1, val_acc=0.755]
Epoch 82:  76%|███████▌  | 89/117 [00:03<00:01, 22.25it/s, loss=0.677, v_num=1, val_acc=0.755]
Epoch 82:  77%|███████▋  | 90/117 [00:04<00:01, 22.45it/s, loss=0.677, v_num=1, val_acc=0.755]
Epoch 82:  77%|███████▋  | 90/117 [00:04<00:01, 22.31it/s, loss=0.678, v_num=1, val_acc=0.755]
Epoch 82:  78%|███████▊  | 91/117 [00:04<00:01, 22.51it/s, loss=0.678, v_num=1, val_acc=0.755]
Epoch 82:  78%|███████▊  | 91/117 [00:04<00:01, 22.37it/s, loss=0.681, v_num=1, val_acc=0.755]
Epoch 82:  79%|███████▊  | 92/117 [00:04<00:01, 22.56it/s, loss=0.681, v_num=1, val_acc=0.755]
Epoch 82:  79%|███████▊  | 92/117 [00:04<00:01, 22.42it/s, loss=0.685, v_num=1, val_acc=0.755]
Epoch 82:  79%|███████▉  | 93/117 [00:04<00:01, 22.62it/s, loss=0.685, v_num=1, val_acc=0.755]
Epoch 82:  79%|███████▉  | 93/117 [00:04<00:01, 22.48it/s, loss=0.687, v_num=1, val_acc=0.755]
Epoch 82:  80%|████████  | 94/117 [00:04<00:01, 22.67it/s, loss=0.687, v_num=1, val_acc=0.755]
Epoch 82:  80%|████████  | 94/117 [00:04<00:01, 22.53it/s, loss=0.682, v_num=1, val_acc=0.755]
Epoch 82:  81%|████████  | 95/117 [00:04<00:00, 22.73it/s, loss=0.682, v_num=1, val_acc=0.755]
Epoch 82:  81%|████████  | 95/117 [00:04<00:00, 22.59it/s, loss=0.683, v_num=1, val_acc=0.755]
Epoch 82:  82%|████████▏ | 96/117 [00:04<00:00, 22.78it/s, loss=0.683, v_num=1, val_acc=0.755]
Epoch 82:  82%|████████▏ | 96/117 [00:04<00:00, 22.64it/s, loss=0.684, v_num=1, val_acc=0.755]
Epoch 82:  83%|████████▎ | 97/117 [00:04<00:00, 22.83it/s, loss=0.684, v_num=1, val_acc=0.755]
Epoch 82:  83%|████████▎ | 97/117 [00:04<00:00, 22.69it/s, loss=0.679, v_num=1, val_acc=0.755]

Validation: 0it [00:00, ?it/s]

Validation:   0%|          | 0/20 [00:00<?, ?it/s]

Validation DataLoader 0:   0%|          | 0/20 [00:00<?, ?it/s]

Validation DataLoader 0:   5%|▌         | 1/20 [00:00<00:00, 192.40it/s]
Epoch 82:  84%|████████▍ | 98/117 [00:05<00:00, 19.05it/s, loss=0.679, v_num=1, val_acc=0.755]

Validation DataLoader 0:  10%|█         | 2/20 [00:00<00:00, 55.72it/s]
Epoch 82:  85%|████████▍ | 99/117 [00:05<00:00, 19.13it/s, loss=0.679, v_num=1, val_acc=0.755]

Validation DataLoader 0:  15%|█▌        | 3/20 [00:00<00:00, 44.74it/s]
Epoch 82:  85%|████████▌ | 100/117 [00:05<00:00, 19.21it/s, loss=0.679, v_num=1, val_acc=0.755]

Validation DataLoader 0:  20%|██        | 4/20 [00:00<00:00, 40.46it/s]
Epoch 82:  86%|████████▋ | 101/117 [00:05<00:00, 19.28it/s, loss=0.679, v_num=1, val_acc=0.755]

Validation DataLoader 0:  25%|██▌       | 5/20 [00:00<00:00, 38.27it/s]
Epoch 82:  87%|████████▋ | 102/117 [00:05<00:00, 19.35it/s, loss=0.679, v_num=1, val_acc=0.755]

Validation DataLoader 0:  30%|███       | 6/20 [00:00<00:00, 36.98it/s]
Epoch 82:  88%|████████▊ | 103/117 [00:05<00:00, 19.43it/s, loss=0.679, v_num=1, val_acc=0.755]

Validation DataLoader 0:  35%|███▌      | 7/20 [00:00<00:00, 36.10it/s]
Epoch 82:  89%|████████▉ | 104/117 [00:05<00:00, 19.50it/s, loss=0.679, v_num=1, val_acc=0.755]

Validation DataLoader 0:  40%|████      | 8/20 [00:00<00:00, 35.46it/s]
Epoch 82:  90%|████████▉ | 105/117 [00:05<00:00, 19.57it/s, loss=0.679, v_num=1, val_acc=0.755]

Validation DataLoader 0:  45%|████▌     | 9/20 [00:00<00:00, 34.95it/s]
Epoch 82:  91%|█████████ | 106/117 [00:05<00:00, 19.64it/s, loss=0.679, v_num=1, val_acc=0.755]

Validation DataLoader 0:  50%|█████     | 10/20 [00:00<00:00, 34.40it/s]
Epoch 82:  91%|█████████▏| 107/117 [00:05<00:00, 19.70it/s, loss=0.679, v_num=1, val_acc=0.755]

Validation DataLoader 0:  55%|█████▌    | 11/20 [00:00<00:00, 34.30it/s]
Epoch 82:  92%|█████████▏| 108/117 [00:05<00:00, 19.78it/s, loss=0.679, v_num=1, val_acc=0.755]

Validation DataLoader 0:  60%|██████    | 12/20 [00:00<00:00, 34.05it/s]
Epoch 82:  93%|█████████▎| 109/117 [00:05<00:00, 19.85it/s, loss=0.679, v_num=1, val_acc=0.755]

Validation DataLoader 0:  65%|██████▌   | 13/20 [00:00<00:00, 33.86it/s]
Epoch 82:  94%|█████████▍| 110/117 [00:05<00:00, 19.91it/s, loss=0.679, v_num=1, val_acc=0.755]

Validation DataLoader 0:  70%|███████   | 14/20 [00:00<00:00, 33.68it/s]
Epoch 82:  95%|█████████▍| 111/117 [00:05<00:00, 19.98it/s, loss=0.679, v_num=1, val_acc=0.755]

Validation DataLoader 0:  75%|███████▌  | 15/20 [00:00<00:00, 33.54it/s]
Epoch 82:  96%|█████████▌| 112/117 [00:05<00:00, 20.05it/s, loss=0.679, v_num=1, val_acc=0.755]

Validation DataLoader 0:  80%|████████  | 16/20 [00:00<00:00, 33.40it/s]
Epoch 82:  97%|█████████▋| 113/117 [00:05<00:00, 20.11it/s, loss=0.679, v_num=1, val_acc=0.755]

Validation DataLoader 0:  85%|████████▌ | 17/20 [00:00<00:00, 33.26it/s]
Epoch 82:  97%|█████████▋| 114/117 [00:05<00:00, 20.17it/s, loss=0.679, v_num=1, val_acc=0.755]

Validation DataLoader 0:  90%|█████████ | 18/20 [00:00<00:00, 33.18it/s]
Epoch 82:  98%|█████████▊| 115/117 [00:05<00:00, 20.24it/s, loss=0.679, v_num=1, val_acc=0.755]

Validation DataLoader 0:  95%|█████████▌| 19/20 [00:00<00:00, 33.09it/s]
Epoch 82:  99%|█████████▉| 116/117 [00:05<00:00, 20.30it/s, loss=0.679, v_num=1, val_acc=0.755]

Validation DataLoader 0: 100%|██████████| 20/20 [00:00<00:00, 33.08it/s]
Epoch 82: 100%|██████████| 117/117 [00:05<00:00, 20.37it/s, loss=0.679, v_num=1, val_acc=0.755]
Epoch 82: 100%|██████████| 117/117 [00:05<00:00, 20.30it/s, loss=0.679, v_num=1, val_acc=0.757]


Epoch 82: 100%|██████████| 117/117 [00:05<00:00, 20.29it/s, loss=0.679, v_num=1, val_acc=0.757]
Epoch 82:   0%|          | 0/117 [00:00<?, ?it/s, loss=0.679, v_num=1, val_acc=0.757]
Epoch 83:   0%|          | 0/117 [00:00<?, ?it/s, loss=0.679, v_num=1, val_acc=0.757]
Epoch 83:   1%|          | 1/117 [00:00<01:47,  1.08it/s, loss=0.679, v_num=1, val_acc=0.757]
Epoch 83:   1%|          | 1/117 [00:00<01:49,  1.06it/s, loss=0.683, v_num=1, val_acc=0.757]
Epoch 83:   2%|▏         | 2/117 [00:00<00:55,  2.09it/s, loss=0.683, v_num=1, val_acc=0.757]
Epoch 83:   2%|▏         | 2/117 [00:00<00:56,  2.04it/s, loss=0.678, v_num=1, val_acc=0.757]
Epoch 83:   3%|▎         | 3/117 [00:00<00:37,  3.03it/s, loss=0.678, v_num=1, val_acc=0.757]
Epoch 83:   3%|▎         | 3/117 [00:01<00:38,  2.95it/s, loss=0.678, v_num=1, val_acc=0.757]
Epoch 83:   3%|▎         | 4/117 [00:01<00:29,  3.87it/s, loss=0.678, v_num=1, val_acc=0.757]
Epoch 83:   3%|▎         | 4/117 [00:01<00:29,  3.78it/s, loss=0.685, v_num=1, val_acc=0.757]
Epoch 83:   4%|▍         | 5/117 [00:01<00:23,  4.69it/s, loss=0.685, v_num=1, val_acc=0.757]
Epoch 83:   4%|▍         | 5/117 [00:01<00:24,  4.58it/s, loss=0.692, v_num=1, val_acc=0.757]
Epoch 83:   5%|▌         | 6/117 [00:01<00:20,  5.45it/s, loss=0.692, v_num=1, val_acc=0.757]
Epoch 83:   5%|▌         | 6/117 [00:01<00:20,  5.33it/s, loss=0.691, v_num=1, val_acc=0.757]
Epoch 83:   6%|▌         | 7/117 [00:01<00:17,  6.18it/s, loss=0.691, v_num=1, val_acc=0.757]
Epoch 83:   6%|▌         | 7/117 [00:01<00:18,  6.04it/s, loss=0.695, v_num=1, val_acc=0.757]
Epoch 83:   7%|▋         | 8/117 [00:01<00:15,  6.85it/s, loss=0.695, v_num=1, val_acc=0.757]
Epoch 83:   7%|▋         | 8/117 [00:01<00:16,  6.71it/s, loss=0.688, v_num=1, val_acc=0.757]
Epoch 83:   8%|▊         | 9/117 [00:01<00:14,  7.46it/s, loss=0.688, v_num=1, val_acc=0.757]
Epoch 83:   8%|▊         | 9/117 [00:01<00:14,  7.31it/s, loss=0.689, v_num=1, val_acc=0.757]
Epoch 83:   9%|▊         | 10/117 [00:01<00:13,  8.06it/s, loss=0.689, v_num=1, val_acc=0.757]
Epoch 83:   9%|▊         | 10/117 [00:01<00:13,  7.90it/s, loss=0.694, v_num=1, val_acc=0.757]
Epoch 83:   9%|▉         | 11/117 [00:01<00:12,  8.63it/s, loss=0.694, v_num=1, val_acc=0.757]
Epoch 83:   9%|▉         | 11/117 [00:01<00:12,  8.46it/s, loss=0.691, v_num=1, val_acc=0.757]
Epoch 83:  10%|█         | 12/117 [00:01<00:11,  9.16it/s, loss=0.691, v_num=1, val_acc=0.757]
Epoch 83:  10%|█         | 12/117 [00:01<00:11,  8.99it/s, loss=0.694, v_num=1, val_acc=0.757]
Epoch 83:  11%|█         | 13/117 [00:01<00:10,  9.68it/s, loss=0.694, v_num=1, val_acc=0.757]
Epoch 83:  11%|█         | 13/117 [00:01<00:10,  9.50it/s, loss=0.694, v_num=1, val_acc=0.757]
Epoch 83:  12%|█▏        | 14/117 [00:01<00:10, 10.17it/s, loss=0.694, v_num=1, val_acc=0.757]
Epoch 83:  12%|█▏        | 14/117 [00:01<00:10,  9.98it/s, loss=0.69, v_num=1, val_acc=0.757]
Epoch 83:  13%|█▎        | 15/117 [00:01<00:09, 10.63it/s, loss=0.69, v_num=1, val_acc=0.757]
Epoch 83:  13%|█▎        | 15/117 [00:01<00:09, 10.44it/s, loss=0.69, v_num=1, val_acc=0.757]
Epoch 83:  14%|█▎        | 16/117 [00:01<00:09, 11.08it/s, loss=0.69, v_num=1, val_acc=0.757]
Epoch 83:  14%|█▎        | 16/117 [00:01<00:09, 10.89it/s, loss=0.69, v_num=1, val_acc=0.757]
Epoch 83:  15%|█▍        | 17/117 [00:01<00:08, 11.47it/s, loss=0.69, v_num=1, val_acc=0.757]
Epoch 83:  15%|█▍        | 17/117 [00:01<00:08, 11.28it/s, loss=0.69, v_num=1, val_acc=0.757]
Epoch 83:  15%|█▌        | 18/117 [00:01<00:08, 11.88it/s, loss=0.69, v_num=1, val_acc=0.757]
Epoch 83:  15%|█▌        | 18/117 [00:01<00:08, 11.68it/s, loss=0.691, v_num=1, val_acc=0.757]
Epoch 83:  16%|█▌        | 19/117 [00:01<00:07, 12.27it/s, loss=0.691, v_num=1, val_acc=0.757]
Epoch 83:  16%|█▌        | 19/117 [00:01<00:08, 12.07it/s, loss=0.686, v_num=1, val_acc=0.757]
Epoch 83:  17%|█▋        | 20/117 [00:01<00:07, 12.63it/s, loss=0.686, v_num=1, val_acc=0.757]
Epoch 83:  17%|█▋        | 20/117 [00:01<00:07, 12.43it/s, loss=0.689, v_num=1, val_acc=0.757]
Epoch 83:  18%|█▊        | 21/117 [00:01<00:07, 12.98it/s, loss=0.689, v_num=1, val_acc=0.757]
Epoch 83:  18%|█▊        | 21/117 [00:01<00:07, 12.78it/s, loss=0.694, v_num=1, val_acc=0.757]
Epoch 83:  19%|█▉        | 22/117 [00:01<00:07, 13.31it/s, loss=0.694, v_num=1, val_acc=0.757]
Epoch 83:  19%|█▉        | 22/117 [00:01<00:07, 13.11it/s, loss=0.693, v_num=1, val_acc=0.757]
Epoch 83:  20%|█▉        | 23/117 [00:01<00:06, 13.63it/s, loss=0.693, v_num=1, val_acc=0.757]
Epoch 83:  20%|█▉        | 23/117 [00:01<00:07, 13.43it/s, loss=0.695, v_num=1, val_acc=0.757]
Epoch 83:  21%|██        | 24/117 [00:01<00:06, 13.93it/s, loss=0.695, v_num=1, val_acc=0.757]
Epoch 83:  21%|██        | 24/117 [00:01<00:06, 13.73it/s, loss=0.688, v_num=1, val_acc=0.757]
Epoch 83:  21%|██▏       | 25/117 [00:01<00:06, 14.22it/s, loss=0.688, v_num=1, val_acc=0.757]
Epoch 83:  21%|██▏       | 25/117 [00:01<00:06, 14.02it/s, loss=0.689, v_num=1, val_acc=0.757]
Epoch 83:  22%|██▏       | 26/117 [00:01<00:06, 14.50it/s, loss=0.689, v_num=1, val_acc=0.757]
Epoch 83:  22%|██▏       | 26/117 [00:01<00:06, 14.30it/s, loss=0.687, v_num=1, val_acc=0.757]
Epoch 83:  23%|██▎       | 27/117 [00:01<00:06, 14.78it/s, loss=0.687, v_num=1, val_acc=0.757]
Epoch 83:  23%|██▎       | 27/117 [00:01<00:06, 14.57it/s, loss=0.684, v_num=1, val_acc=0.757]
Epoch 83:  24%|██▍       | 28/117 [00:01<00:05, 15.04it/s, loss=0.684, v_num=1, val_acc=0.757]
Epoch 83:  24%|██▍       | 28/117 [00:01<00:05, 14.84it/s, loss=0.692, v_num=1, val_acc=0.757]
Epoch 83:  25%|██▍       | 29/117 [00:01<00:05, 15.29it/s, loss=0.692, v_num=1, val_acc=0.757]
Epoch 83:  25%|██▍       | 29/117 [00:01<00:05, 15.09it/s, loss=0.689, v_num=1, val_acc=0.757]
Epoch 83:  26%|██▌       | 30/117 [00:01<00:05, 15.53it/s, loss=0.689, v_num=1, val_acc=0.757]
Epoch 83:  26%|██▌       | 30/117 [00:01<00:05, 15.33it/s, loss=0.69, v_num=1, val_acc=0.757]
Epoch 83:  26%|██▋       | 31/117 [00:01<00:05, 15.72it/s, loss=0.69, v_num=1, val_acc=0.757]
Epoch 83:  26%|██▋       | 31/117 [00:01<00:05, 15.54it/s, loss=0.696, v_num=1, val_acc=0.757]
Epoch 83:  27%|██▋       | 32/117 [00:02<00:05, 15.97it/s, loss=0.696, v_num=1, val_acc=0.757]
Epoch 83:  27%|██▋       | 32/117 [00:02<00:05, 15.77it/s, loss=0.697, v_num=1, val_acc=0.757]
Epoch 83:  28%|██▊       | 33/117 [00:02<00:05, 16.19it/s, loss=0.697, v_num=1, val_acc=0.757]
Epoch 83:  28%|██▊       | 33/117 [00:02<00:05, 15.99it/s, loss=0.699, v_num=1, val_acc=0.757]
Epoch 83:  29%|██▉       | 34/117 [00:02<00:05, 16.40it/s, loss=0.699, v_num=1, val_acc=0.757]
Epoch 83:  29%|██▉       | 34/117 [00:02<00:05, 16.20it/s, loss=0.696, v_num=1, val_acc=0.757]
Epoch 83:  30%|██▉       | 35/117 [00:02<00:04, 16.61it/s, loss=0.696, v_num=1, val_acc=0.757]
Epoch 83:  30%|██▉       | 35/117 [00:02<00:04, 16.41it/s, loss=0.698, v_num=1, val_acc=0.757]
Epoch 83:  31%|███       | 36/117 [00:02<00:04, 16.80it/s, loss=0.698, v_num=1, val_acc=0.757]
Epoch 83:  31%|███       | 36/117 [00:02<00:04, 16.61it/s, loss=0.698, v_num=1, val_acc=0.757]
Epoch 83:  32%|███▏      | 37/117 [00:02<00:04, 17.00it/s, loss=0.698, v_num=1, val_acc=0.757]
Epoch 83:  32%|███▏      | 37/117 [00:02<00:04, 16.80it/s, loss=0.698, v_num=1, val_acc=0.757]
Epoch 83:  32%|███▏      | 38/117 [00:02<00:04, 17.19it/s, loss=0.698, v_num=1, val_acc=0.757]
Epoch 83:  32%|███▏      | 38/117 [00:02<00:04, 16.99it/s, loss=0.698, v_num=1, val_acc=0.757]
Epoch 83:  33%|███▎      | 39/117 [00:02<00:04, 17.37it/s, loss=0.698, v_num=1, val_acc=0.757]
Epoch 83:  33%|███▎      | 39/117 [00:02<00:04, 17.17it/s, loss=0.698, v_num=1, val_acc=0.757]
Epoch 83:  34%|███▍      | 40/117 [00:02<00:04, 17.54it/s, loss=0.698, v_num=1, val_acc=0.757]
Epoch 83:  34%|███▍      | 40/117 [00:02<00:04, 17.35it/s, loss=0.694, v_num=1, val_acc=0.757]
Epoch 83:  35%|███▌      | 41/117 [00:02<00:04, 17.71it/s, loss=0.694, v_num=1, val_acc=0.757]
Epoch 83:  35%|███▌      | 41/117 [00:02<00:04, 17.52it/s, loss=0.689, v_num=1, val_acc=0.757]
Epoch 83:  36%|███▌      | 42/117 [00:02<00:04, 17.87it/s, loss=0.689, v_num=1, val_acc=0.757]
Epoch 83:  36%|███▌      | 42/117 [00:02<00:04, 17.68it/s, loss=0.689, v_num=1, val_acc=0.757]
Epoch 83:  37%|███▋      | 43/117 [00:02<00:04, 18.03it/s, loss=0.689, v_num=1, val_acc=0.757]
Epoch 83:  37%|███▋      | 43/117 [00:02<00:04, 17.84it/s, loss=0.684, v_num=1, val_acc=0.757]
Epoch 83:  38%|███▊      | 44/117 [00:02<00:04, 18.19it/s, loss=0.684, v_num=1, val_acc=0.757]
Epoch 83:  38%|███▊      | 44/117 [00:02<00:04, 18.00it/s, loss=0.686, v_num=1, val_acc=0.757]
Epoch 83:  38%|███▊      | 45/117 [00:02<00:03, 18.29it/s, loss=0.686, v_num=1, val_acc=0.757]
Epoch 83:  38%|███▊      | 45/117 [00:02<00:03, 18.11it/s, loss=0.678, v_num=1, val_acc=0.757]
Epoch 83:  39%|███▉      | 46/117 [00:02<00:03, 18.45it/s, loss=0.678, v_num=1, val_acc=0.757]
Epoch 83:  39%|███▉      | 46/117 [00:02<00:03, 18.26it/s, loss=0.682, v_num=1, val_acc=0.757]
Epoch 83:  40%|████      | 47/117 [00:02<00:03, 18.59it/s, loss=0.682, v_num=1, val_acc=0.757]
Epoch 83:  40%|████      | 47/117 [00:02<00:03, 18.41it/s, loss=0.682, v_num=1, val_acc=0.757]
Epoch 83:  41%|████      | 48/117 [00:02<00:03, 18.73it/s, loss=0.682, v_num=1, val_acc=0.757]
Epoch 83:  41%|████      | 48/117 [00:02<00:03, 18.55it/s, loss=0.679, v_num=1, val_acc=0.757]
Epoch 83:  42%|████▏     | 49/117 [00:02<00:03, 18.87it/s, loss=0.679, v_num=1, val_acc=0.757]
Epoch 83:  42%|████▏     | 49/117 [00:02<00:03, 18.69it/s, loss=0.682, v_num=1, val_acc=0.757]
Epoch 83:  43%|████▎     | 50/117 [00:02<00:03, 18.99it/s, loss=0.682, v_num=1, val_acc=0.757]
Epoch 83:  43%|████▎     | 50/117 [00:02<00:03, 18.81it/s, loss=0.68, v_num=1, val_acc=0.757]
Epoch 83:  44%|████▎     | 51/117 [00:02<00:03, 19.12it/s, loss=0.68, v_num=1, val_acc=0.757]
Epoch 83:  44%|████▎     | 51/117 [00:02<00:03, 18.94it/s, loss=0.677, v_num=1, val_acc=0.757]
Epoch 83:  44%|████▍     | 52/117 [00:02<00:03, 19.25it/s, loss=0.677, v_num=1, val_acc=0.757]
Epoch 83:  44%|████▍     | 52/117 [00:02<00:03, 19.07it/s, loss=0.671, v_num=1, val_acc=0.757]
Epoch 83:  45%|████▌     | 53/117 [00:02<00:03, 19.37it/s, loss=0.671, v_num=1, val_acc=0.757]
Epoch 83:  45%|████▌     | 53/117 [00:02<00:03, 19.19it/s, loss=0.669, v_num=1, val_acc=0.757]
Epoch 83:  46%|████▌     | 54/117 [00:02<00:03, 19.49it/s, loss=0.669, v_num=1, val_acc=0.757]
Epoch 83:  46%|████▌     | 54/117 [00:02<00:03, 19.31it/s, loss=0.674, v_num=1, val_acc=0.757]
Epoch 83:  47%|████▋     | 55/117 [00:02<00:03, 19.60it/s, loss=0.674, v_num=1, val_acc=0.757]
Epoch 83:  47%|████▋     | 55/117 [00:02<00:03, 19.43it/s, loss=0.674, v_num=1, val_acc=0.757]
Epoch 83:  48%|████▊     | 56/117 [00:02<00:03, 19.72it/s, loss=0.674, v_num=1, val_acc=0.757]
Epoch 83:  48%|████▊     | 56/117 [00:02<00:03, 19.54it/s, loss=0.674, v_num=1, val_acc=0.757]
Epoch 83:  49%|████▊     | 57/117 [00:02<00:03, 19.83it/s, loss=0.674, v_num=1, val_acc=0.757]
Epoch 83:  49%|████▊     | 57/117 [00:02<00:03, 19.66it/s, loss=0.681, v_num=1, val_acc=0.757]
Epoch 83:  50%|████▉     | 58/117 [00:02<00:02, 19.94it/s, loss=0.681, v_num=1, val_acc=0.757]
Epoch 83:  50%|████▉     | 58/117 [00:02<00:02, 19.76it/s, loss=0.688, v_num=1, val_acc=0.757]
Epoch 83:  50%|█████     | 59/117 [00:02<00:02, 20.04it/s, loss=0.688, v_num=1, val_acc=0.757]
Epoch 83:  50%|█████     | 59/117 [00:02<00:02, 19.87it/s, loss=0.692, v_num=1, val_acc=0.757]
Epoch 83:  51%|█████▏    | 60/117 [00:02<00:02, 20.14it/s, loss=0.692, v_num=1, val_acc=0.757]
Epoch 83:  51%|█████▏    | 60/117 [00:03<00:02, 19.98it/s, loss=0.69, v_num=1, val_acc=0.757]
Epoch 83:  52%|█████▏    | 61/117 [00:03<00:02, 20.25it/s, loss=0.69, v_num=1, val_acc=0.757]
Epoch 83:  52%|█████▏    | 61/117 [00:03<00:02, 20.08it/s, loss=0.686, v_num=1, val_acc=0.757]
Epoch 83:  53%|█████▎    | 62/117 [00:03<00:02, 20.34it/s, loss=0.686, v_num=1, val_acc=0.757]
Epoch 83:  53%|█████▎    | 62/117 [00:03<00:02, 20.17it/s, loss=0.685, v_num=1, val_acc=0.757]
Epoch 83:  54%|█████▍    | 63/117 [00:03<00:02, 20.44it/s, loss=0.685, v_num=1, val_acc=0.757]
Epoch 83:  54%|█████▍    | 63/117 [00:03<00:02, 20.27it/s, loss=0.685, v_num=1, val_acc=0.757]
Epoch 83:  55%|█████▍    | 64/117 [00:03<00:02, 20.53it/s, loss=0.685, v_num=1, val_acc=0.757]
Epoch 83:  55%|█████▍    | 64/117 [00:03<00:02, 20.36it/s, loss=0.684, v_num=1, val_acc=0.757]
Epoch 83:  56%|█████▌    | 65/117 [00:03<00:02, 20.62it/s, loss=0.684, v_num=1, val_acc=0.757]
Epoch 83:  56%|█████▌    | 65/117 [00:03<00:02, 20.45it/s, loss=0.688, v_num=1, val_acc=0.757]
Epoch 83:  56%|█████▋    | 66/117 [00:03<00:02, 20.70it/s, loss=0.688, v_num=1, val_acc=0.757]
Epoch 83:  56%|█████▋    | 66/117 [00:03<00:02, 20.54it/s, loss=0.685, v_num=1, val_acc=0.757]
Epoch 83:  57%|█████▋    | 67/117 [00:03<00:02, 20.79it/s, loss=0.685, v_num=1, val_acc=0.757]
Epoch 83:  57%|█████▋    | 67/117 [00:03<00:02, 20.63it/s, loss=0.688, v_num=1, val_acc=0.757]
Epoch 83:  58%|█████▊    | 68/117 [00:03<00:02, 20.87it/s, loss=0.688, v_num=1, val_acc=0.757]
Epoch 83:  58%|█████▊    | 68/117 [00:03<00:02, 20.71it/s, loss=0.687, v_num=1, val_acc=0.757]
Epoch 83:  59%|█████▉    | 69/117 [00:03<00:02, 20.96it/s, loss=0.687, v_num=1, val_acc=0.757]
Epoch 83:  59%|█████▉    | 69/117 [00:03<00:02, 20.80it/s, loss=0.684, v_num=1, val_acc=0.757]
Epoch 83:  60%|█████▉    | 70/117 [00:03<00:02, 21.04it/s, loss=0.684, v_num=1, val_acc=0.757]
Epoch 83:  60%|█████▉    | 70/117 [00:03<00:02, 20.88it/s, loss=0.683, v_num=1, val_acc=0.757]
Epoch 83:  61%|██████    | 71/117 [00:03<00:02, 21.12it/s, loss=0.683, v_num=1, val_acc=0.757]
Epoch 83:  61%|██████    | 71/117 [00:03<00:02, 20.96it/s, loss=0.681, v_num=1, val_acc=0.757]
Epoch 83:  62%|██████▏   | 72/117 [00:03<00:02, 21.17it/s, loss=0.681, v_num=1, val_acc=0.757]
Epoch 83:  62%|██████▏   | 72/117 [00:03<00:02, 21.03it/s, loss=0.687, v_num=1, val_acc=0.757]
Epoch 83:  62%|██████▏   | 73/117 [00:03<00:02, 21.26it/s, loss=0.687, v_num=1, val_acc=0.757]
Epoch 83:  62%|██████▏   | 73/117 [00:03<00:02, 21.10it/s, loss=0.687, v_num=1, val_acc=0.757]
Epoch 83:  63%|██████▎   | 74/117 [00:03<00:02, 21.34it/s, loss=0.687, v_num=1, val_acc=0.757]
Epoch 83:  63%|██████▎   | 74/117 [00:03<00:02, 21.18it/s, loss=0.684, v_num=1, val_acc=0.757]
Epoch 83:  64%|██████▍   | 75/117 [00:03<00:01, 21.41it/s, loss=0.684, v_num=1, val_acc=0.757]
Epoch 83:  64%|██████▍   | 75/117 [00:03<00:01, 21.26it/s, loss=0.683, v_num=1, val_acc=0.757]
Epoch 83:  65%|██████▍   | 76/117 [00:03<00:01, 21.48it/s, loss=0.683, v_num=1, val_acc=0.757]
Epoch 83:  65%|██████▍   | 76/117 [00:03<00:01, 21.33it/s, loss=0.685, v_num=1, val_acc=0.757]
Epoch 83:  66%|██████▌   | 77/117 [00:03<00:01, 21.56it/s, loss=0.685, v_num=1, val_acc=0.757]
Epoch 83:  66%|██████▌   | 77/117 [00:03<00:01, 21.40it/s, loss=0.679, v_num=1, val_acc=0.757]
Epoch 83:  67%|██████▋   | 78/117 [00:03<00:01, 21.62it/s, loss=0.679, v_num=1, val_acc=0.757]
Epoch 83:  67%|██████▋   | 78/117 [00:03<00:01, 21.47it/s, loss=0.678, v_num=1, val_acc=0.757]
Epoch 83:  68%|██████▊   | 79/117 [00:03<00:01, 21.70it/s, loss=0.678, v_num=1, val_acc=0.757]
Epoch 83:  68%|██████▊   | 79/117 [00:03<00:01, 21.55it/s, loss=0.678, v_num=1, val_acc=0.757]
Epoch 83:  68%|██████▊   | 80/117 [00:03<00:01, 21.76it/s, loss=0.678, v_num=1, val_acc=0.757]
Epoch 83:  68%|██████▊   | 80/117 [00:03<00:01, 21.62it/s, loss=0.68, v_num=1, val_acc=0.757]
Epoch 83:  69%|██████▉   | 81/117 [00:03<00:01, 21.83it/s, loss=0.68, v_num=1, val_acc=0.757]
Epoch 83:  69%|██████▉   | 81/117 [00:03<00:01, 21.68it/s, loss=0.684, v_num=1, val_acc=0.757]
Epoch 83:  70%|███████   | 82/117 [00:03<00:01, 21.86it/s, loss=0.684, v_num=1, val_acc=0.757]
Epoch 83:  70%|███████   | 82/117 [00:03<00:01, 21.72it/s, loss=0.686, v_num=1, val_acc=0.757]
Epoch 83:  71%|███████   | 83/117 [00:03<00:01, 21.93it/s, loss=0.686, v_num=1, val_acc=0.757]
Epoch 83:  71%|███████   | 83/117 [00:03<00:01, 21.78it/s, loss=0.686, v_num=1, val_acc=0.757]
Epoch 83:  72%|███████▏  | 84/117 [00:03<00:01, 21.99it/s, loss=0.686, v_num=1, val_acc=0.757]
Epoch 83:  72%|███████▏  | 84/117 [00:03<00:01, 21.85it/s, loss=0.691, v_num=1, val_acc=0.757]
Epoch 83:  73%|███████▎  | 85/117 [00:03<00:01, 22.06it/s, loss=0.691, v_num=1, val_acc=0.757]
Epoch 83:  73%|███████▎  | 85/117 [00:03<00:01, 21.91it/s, loss=0.691, v_num=1, val_acc=0.757]
Epoch 83:  74%|███████▎  | 86/117 [00:03<00:01, 22.12it/s, loss=0.691, v_num=1, val_acc=0.757]
Epoch 83:  74%|███████▎  | 86/117 [00:03<00:01, 21.98it/s, loss=0.695, v_num=1, val_acc=0.757]
Epoch 83:  74%|███████▍  | 87/117 [00:03<00:01, 22.18it/s, loss=0.695, v_num=1, val_acc=0.757]
Epoch 83:  74%|███████▍  | 87/117 [00:03<00:01, 22.04it/s, loss=0.692, v_num=1, val_acc=0.757]
Epoch 83:  75%|███████▌  | 88/117 [00:03<00:01, 22.24it/s, loss=0.692, v_num=1, val_acc=0.757]
Epoch 83:  75%|███████▌  | 88/117 [00:03<00:01, 22.10it/s, loss=0.692, v_num=1, val_acc=0.757]
Epoch 83:  76%|███████▌  | 89/117 [00:03<00:01, 22.30it/s, loss=0.692, v_num=1, val_acc=0.757]
Epoch 83:  76%|███████▌  | 89/117 [00:04<00:01, 22.16it/s, loss=0.698, v_num=1, val_acc=0.757]
Epoch 83:  77%|███████▋  | 90/117 [00:04<00:01, 22.36it/s, loss=0.698, v_num=1, val_acc=0.757]
Epoch 83:  77%|███████▋  | 90/117 [00:04<00:01, 22.22it/s, loss=0.698, v_num=1, val_acc=0.757]
Epoch 83:  78%|███████▊  | 91/117 [00:04<00:01, 22.42it/s, loss=0.698, v_num=1, val_acc=0.757]
Epoch 83:  78%|███████▊  | 91/117 [00:04<00:01, 22.28it/s, loss=0.701, v_num=1, val_acc=0.757]
Epoch 83:  79%|███████▊  | 92/117 [00:04<00:01, 22.48it/s, loss=0.701, v_num=1, val_acc=0.757]
Epoch 83:  79%|███████▊  | 92/117 [00:04<00:01, 22.34it/s, loss=0.697, v_num=1, val_acc=0.757]
Epoch 83:  79%|███████▉  | 93/117 [00:04<00:01, 22.53it/s, loss=0.697, v_num=1, val_acc=0.757]
Epoch 83:  79%|███████▉  | 93/117 [00:04<00:01, 22.39it/s, loss=0.699, v_num=1, val_acc=0.757]
Epoch 83:  80%|████████  | 94/117 [00:04<00:01, 22.59it/s, loss=0.699, v_num=1, val_acc=0.757]
Epoch 83:  80%|████████  | 94/117 [00:04<00:01, 22.45it/s, loss=0.702, v_num=1, val_acc=0.757]
Epoch 83:  81%|████████  | 95/117 [00:04<00:00, 22.64it/s, loss=0.702, v_num=1, val_acc=0.757]
Epoch 83:  81%|████████  | 95/117 [00:04<00:00, 22.50it/s, loss=0.699, v_num=1, val_acc=0.757]
Epoch 83:  82%|████████▏ | 96/117 [00:04<00:00, 22.69it/s, loss=0.699, v_num=1, val_acc=0.757]
Epoch 83:  82%|████████▏ | 96/117 [00:04<00:00, 22.56it/s, loss=0.697, v_num=1, val_acc=0.757]
Epoch 83:  83%|████████▎ | 97/117 [00:04<00:00, 22.74it/s, loss=0.697, v_num=1, val_acc=0.757]
Epoch 83:  83%|████████▎ | 97/117 [00:04<00:00, 22.61it/s, loss=0.701, v_num=1, val_acc=0.757]

Validation: 0it [00:00, ?it/s]

Validation:   0%|          | 0/20 [00:00<?, ?it/s]

Validation DataLoader 0:   0%|          | 0/20 [00:00<?, ?it/s]

Validation DataLoader 0:   5%|▌         | 1/20 [00:00<00:00, 184.72it/s]
Epoch 83:  84%|████████▍ | 98/117 [00:05<00:00, 19.06it/s, loss=0.701, v_num=1, val_acc=0.757]

Validation DataLoader 0:  10%|█         | 2/20 [00:00<00:00, 55.24it/s]
Epoch 83:  85%|████████▍ | 99/117 [00:05<00:00, 19.14it/s, loss=0.701, v_num=1, val_acc=0.757]

Validation DataLoader 0:  15%|█▌        | 3/20 [00:00<00:00, 43.86it/s]
Epoch 83:  85%|████████▌ | 100/117 [00:05<00:00, 19.21it/s, loss=0.701, v_num=1, val_acc=0.757]

Validation DataLoader 0:  20%|██        | 4/20 [00:00<00:00, 39.85it/s]
Epoch 83:  86%|████████▋ | 101/117 [00:05<00:00, 19.29it/s, loss=0.701, v_num=1, val_acc=0.757]

Validation DataLoader 0:  25%|██▌       | 5/20 [00:00<00:00, 37.75it/s]
Epoch 83:  87%|████████▋ | 102/117 [00:05<00:00, 19.36it/s, loss=0.701, v_num=1, val_acc=0.757]

Validation DataLoader 0:  30%|███       | 6/20 [00:00<00:00, 36.68it/s]
Epoch 83:  88%|████████▊ | 103/117 [00:05<00:00, 19.44it/s, loss=0.701, v_num=1, val_acc=0.757]

Validation DataLoader 0:  35%|███▌      | 7/20 [00:00<00:00, 35.89it/s]
Epoch 83:  89%|████████▉ | 104/117 [00:05<00:00, 19.51it/s, loss=0.701, v_num=1, val_acc=0.757]

Validation DataLoader 0:  40%|████      | 8/20 [00:00<00:00, 35.31it/s]
Epoch 83:  90%|████████▉ | 105/117 [00:05<00:00, 19.58it/s, loss=0.701, v_num=1, val_acc=0.757]

Validation DataLoader 0:  45%|████▌     | 9/20 [00:00<00:00, 34.82it/s]
Epoch 83:  91%|█████████ | 106/117 [00:05<00:00, 19.65it/s, loss=0.701, v_num=1, val_acc=0.757]

Validation DataLoader 0:  50%|█████     | 10/20 [00:00<00:00, 34.50it/s]
Epoch 83:  91%|█████████▏| 107/117 [00:05<00:00, 19.72it/s, loss=0.701, v_num=1, val_acc=0.757]

Validation DataLoader 0:  55%|█████▌    | 11/20 [00:00<00:00, 34.21it/s]
Epoch 83:  92%|█████████▏| 108/117 [00:05<00:00, 19.79it/s, loss=0.701, v_num=1, val_acc=0.757]

Validation DataLoader 0:  60%|██████    | 12/20 [00:00<00:00, 33.96it/s]
Epoch 83:  93%|█████████▎| 109/117 [00:05<00:00, 19.86it/s, loss=0.701, v_num=1, val_acc=0.757]

Validation DataLoader 0:  65%|██████▌   | 13/20 [00:00<00:00, 33.77it/s]
Epoch 83:  94%|█████████▍| 110/117 [00:05<00:00, 19.92it/s, loss=0.701, v_num=1, val_acc=0.757]

Validation DataLoader 0:  70%|███████   | 14/20 [00:00<00:00, 33.60it/s]
Epoch 83:  95%|█████████▍| 111/117 [00:05<00:00, 19.99it/s, loss=0.701, v_num=1, val_acc=0.757]

Validation DataLoader 0:  75%|███████▌  | 15/20 [00:00<00:00, 33.47it/s]
Epoch 83:  96%|█████████▌| 112/117 [00:05<00:00, 20.06it/s, loss=0.701, v_num=1, val_acc=0.757]

Validation DataLoader 0:  80%|████████  | 16/20 [00:00<00:00, 33.34it/s]
Epoch 83:  97%|█████████▋| 113/117 [00:05<00:00, 20.12it/s, loss=0.701, v_num=1, val_acc=0.757]

Validation DataLoader 0:  85%|████████▌ | 17/20 [00:00<00:00, 33.22it/s]
Epoch 83:  97%|█████████▋| 114/117 [00:05<00:00, 20.19it/s, loss=0.701, v_num=1, val_acc=0.757]

Validation DataLoader 0:  90%|█████████ | 18/20 [00:00<00:00, 33.12it/s]
Epoch 83:  98%|█████████▊| 115/117 [00:05<00:00, 20.25it/s, loss=0.701, v_num=1, val_acc=0.757]

Validation DataLoader 0:  95%|█████████▌| 19/20 [00:00<00:00, 33.04it/s]
Epoch 83:  99%|█████████▉| 116/117 [00:05<00:00, 20.31it/s, loss=0.701, v_num=1, val_acc=0.757]

Validation DataLoader 0: 100%|██████████| 20/20 [00:00<00:00, 33.03it/s]
Epoch 83: 100%|██████████| 117/117 [00:05<00:00, 20.38it/s, loss=0.701, v_num=1, val_acc=0.757]
Epoch 83: 100%|██████████| 117/117 [00:05<00:00, 20.31it/s, loss=0.701, v_num=1, val_acc=0.757]


Epoch 83: 100%|██████████| 117/117 [00:05<00:00, 20.30it/s, loss=0.701, v_num=1, val_acc=0.757]
Epoch 83:   0%|          | 0/117 [00:00<?, ?it/s, loss=0.701, v_num=1, val_acc=0.757]
Epoch 84:   0%|          | 0/117 [00:00<?, ?it/s, loss=0.701, v_num=1, val_acc=0.757]
Epoch 84:   1%|          | 1/117 [00:00<01:45,  1.10it/s, loss=0.701, v_num=1, val_acc=0.757]
Epoch 84:   1%|          | 1/117 [00:00<01:48,  1.07it/s, loss=0.697, v_num=1, val_acc=0.757]
Epoch 84:   2%|▏         | 2/117 [00:00<00:54,  2.12it/s, loss=0.697, v_num=1, val_acc=0.757]
Epoch 84:   2%|▏         | 2/117 [00:00<00:55,  2.07it/s, loss=0.698, v_num=1, val_acc=0.757]
Epoch 84:   3%|▎         | 3/117 [00:00<00:37,  3.06it/s, loss=0.698, v_num=1, val_acc=0.757]
Epoch 84:   3%|▎         | 3/117 [00:01<00:38,  2.99it/s, loss=0.698, v_num=1, val_acc=0.757]
Epoch 84:   3%|▎         | 4/117 [00:01<00:28,  3.95it/s, loss=0.698, v_num=1, val_acc=0.757]
Epoch 84:   3%|▎         | 4/117 [00:01<00:29,  3.85it/s, loss=0.7, v_num=1, val_acc=0.757]
Epoch 84:   4%|▍         | 5/117 [00:01<00:23,  4.76it/s, loss=0.7, v_num=1, val_acc=0.757]
Epoch 84:   4%|▍         | 5/117 [00:01<00:24,  4.65it/s, loss=0.7, v_num=1, val_acc=0.757]
Epoch 84:   5%|▌         | 6/117 [00:01<00:20,  5.54it/s, loss=0.7, v_num=1, val_acc=0.757]
Epoch 84:   5%|▌         | 6/117 [00:01<00:20,  5.41it/s, loss=0.696, v_num=1, val_acc=0.757]
Epoch 84:   6%|▌         | 7/117 [00:01<00:17,  6.26it/s, loss=0.696, v_num=1, val_acc=0.757]
Epoch 84:   6%|▌         | 7/117 [00:01<00:17,  6.12it/s, loss=0.691, v_num=1, val_acc=0.757]
Epoch 84:   7%|▋         | 8/117 [00:01<00:15,  6.95it/s, loss=0.691, v_num=1, val_acc=0.757]
Epoch 84:   7%|▋         | 8/117 [00:01<00:16,  6.80it/s, loss=0.688, v_num=1, val_acc=0.757]
Epoch 84:   8%|▊         | 9/117 [00:01<00:14,  7.54it/s, loss=0.688, v_num=1, val_acc=0.757]
Epoch 84:   8%|▊         | 9/117 [00:01<00:14,  7.39it/s, loss=0.691, v_num=1, val_acc=0.757]
Epoch 84:   9%|▊         | 10/117 [00:01<00:13,  8.15it/s, loss=0.691, v_num=1, val_acc=0.757]
Epoch 84:   9%|▊         | 10/117 [00:01<00:13,  7.99it/s, loss=0.691, v_num=1, val_acc=0.757]
Epoch 84:   9%|▉         | 11/117 [00:01<00:12,  8.73it/s, loss=0.691, v_num=1, val_acc=0.757]
Epoch 84:   9%|▉         | 11/117 [00:01<00:12,  8.56it/s, loss=0.689, v_num=1, val_acc=0.757]
Epoch 84:  10%|█         | 12/117 [00:01<00:11,  9.27it/s, loss=0.689, v_num=1, val_acc=0.757]
Epoch 84:  10%|█         | 12/117 [00:01<00:11,  9.09it/s, loss=0.685, v_num=1, val_acc=0.757]
Epoch 84:  11%|█         | 13/117 [00:01<00:10,  9.79it/s, loss=0.685, v_num=1, val_acc=0.757]
Epoch 84:  11%|█         | 13/117 [00:01<00:10,  9.61it/s, loss=0.682, v_num=1, val_acc=0.757]
Epoch 84:  12%|█▏        | 14/117 [00:01<00:10, 10.28it/s, loss=0.682, v_num=1, val_acc=0.757]
Epoch 84:  12%|█▏        | 14/117 [00:01<00:10, 10.09it/s, loss=0.682, v_num=1, val_acc=0.757]
Epoch 84:  13%|█▎        | 15/117 [00:01<00:09, 10.74it/s, loss=0.682, v_num=1, val_acc=0.757]
Epoch 84:  13%|█▎        | 15/117 [00:01<00:09, 10.55it/s, loss=0.686, v_num=1, val_acc=0.757]
Epoch 84:  14%|█▎        | 16/117 [00:01<00:09, 11.19it/s, loss=0.686, v_num=1, val_acc=0.757]
Epoch 84:  14%|█▎        | 16/117 [00:01<00:09, 10.99it/s, loss=0.684, v_num=1, val_acc=0.757]
Epoch 84:  15%|█▍        | 17/117 [00:01<00:08, 11.59it/s, loss=0.684, v_num=1, val_acc=0.757]
Epoch 84:  15%|█▍        | 17/117 [00:01<00:08, 11.39it/s, loss=0.684, v_num=1, val_acc=0.757]
Epoch 84:  15%|█▌        | 18/117 [00:01<00:08, 11.99it/s, loss=0.684, v_num=1, val_acc=0.757]
Epoch 84:  15%|█▌        | 18/117 [00:01<00:08, 11.79it/s, loss=0.689, v_num=1, val_acc=0.757]
Epoch 84:  16%|█▌        | 19/117 [00:01<00:07, 12.38it/s, loss=0.689, v_num=1, val_acc=0.757]
Epoch 84:  16%|█▌        | 19/117 [00:01<00:08, 12.18it/s, loss=0.686, v_num=1, val_acc=0.757]
Epoch 84:  17%|█▋        | 20/117 [00:01<00:07, 12.74it/s, loss=0.686, v_num=1, val_acc=0.757]
Epoch 84:  17%|█▋        | 20/117 [00:01<00:07, 12.54it/s, loss=0.685, v_num=1, val_acc=0.757]
Epoch 84:  18%|█▊        | 21/117 [00:01<00:07, 13.09it/s, loss=0.685, v_num=1, val_acc=0.757]
Epoch 84:  18%|█▊        | 21/117 [00:01<00:07, 12.89it/s, loss=0.686, v_num=1, val_acc=0.757]
Epoch 84:  19%|█▉        | 22/117 [00:01<00:07, 13.42it/s, loss=0.686, v_num=1, val_acc=0.757]
Epoch 84:  19%|█▉        | 22/117 [00:01<00:07, 13.22it/s, loss=0.682, v_num=1, val_acc=0.757]
Epoch 84:  20%|█▉        | 23/117 [00:01<00:06, 13.73it/s, loss=0.682, v_num=1, val_acc=0.757]
Epoch 84:  20%|█▉        | 23/117 [00:01<00:06, 13.53it/s, loss=0.686, v_num=1, val_acc=0.757]
Epoch 84:  21%|██        | 24/117 [00:01<00:06, 14.04it/s, loss=0.686, v_num=1, val_acc=0.757]
Epoch 84:  21%|██        | 24/117 [00:01<00:06, 13.83it/s, loss=0.682, v_num=1, val_acc=0.757]
Epoch 84:  21%|██▏       | 25/117 [00:01<00:06, 14.33it/s, loss=0.682, v_num=1, val_acc=0.757]
Epoch 84:  21%|██▏       | 25/117 [00:01<00:06, 14.12it/s, loss=0.682, v_num=1, val_acc=0.757]
Epoch 84:  22%|██▏       | 26/117 [00:01<00:06, 14.61it/s, loss=0.682, v_num=1, val_acc=0.757]
Epoch 84:  22%|██▏       | 26/117 [00:01<00:06, 14.40it/s, loss=0.684, v_num=1, val_acc=0.757]
Epoch 84:  23%|██▎       | 27/117 [00:01<00:06, 14.88it/s, loss=0.684, v_num=1, val_acc=0.757]
Epoch 84:  23%|██▎       | 27/117 [00:01<00:06, 14.68it/s, loss=0.694, v_num=1, val_acc=0.757]
Epoch 84:  24%|██▍       | 28/117 [00:01<00:05, 15.15it/s, loss=0.694, v_num=1, val_acc=0.757]
Epoch 84:  24%|██▍       | 28/117 [00:01<00:05, 14.94it/s, loss=0.702, v_num=1, val_acc=0.757]
Epoch 84:  25%|██▍       | 29/117 [00:01<00:05, 15.40it/s, loss=0.702, v_num=1, val_acc=0.757]
Epoch 84:  25%|██▍       | 29/117 [00:01<00:05, 15.19it/s, loss=0.698, v_num=1, val_acc=0.757]
Epoch 84:  26%|██▌       | 30/117 [00:01<00:05, 15.64it/s, loss=0.698, v_num=1, val_acc=0.757]
Epoch 84:  26%|██▌       | 30/117 [00:01<00:05, 15.44it/s, loss=0.702, v_num=1, val_acc=0.757]
Epoch 84:  26%|██▋       | 31/117 [00:01<00:05, 15.87it/s, loss=0.702, v_num=1, val_acc=0.757]
Epoch 84:  26%|██▋       | 31/117 [00:01<00:05, 15.67it/s, loss=0.704, v_num=1, val_acc=0.757]
Epoch 84:  27%|██▋       | 32/117 [00:01<00:05, 16.10it/s, loss=0.704, v_num=1, val_acc=0.757]
Epoch 84:  27%|██▋       | 32/117 [00:02<00:05, 15.90it/s, loss=0.705, v_num=1, val_acc=0.757]
Epoch 84:  28%|██▊       | 33/117 [00:02<00:05, 16.31it/s, loss=0.705, v_num=1, val_acc=0.757]
Epoch 84:  28%|██▊       | 33/117 [00:02<00:05, 16.11it/s, loss=0.711, v_num=1, val_acc=0.757]
Epoch 84:  29%|██▉       | 34/117 [00:02<00:05, 16.52it/s, loss=0.711, v_num=1, val_acc=0.757]
Epoch 84:  29%|██▉       | 34/117 [00:02<00:05, 16.32it/s, loss=0.709, v_num=1, val_acc=0.757]
Epoch 84:  30%|██▉       | 35/117 [00:02<00:04, 16.73it/s, loss=0.709, v_num=1, val_acc=0.757]
Epoch 84:  30%|██▉       | 35/117 [00:02<00:04, 16.53it/s, loss=0.713, v_num=1, val_acc=0.757]
Epoch 84:  31%|███       | 36/117 [00:02<00:04, 16.92it/s, loss=0.713, v_num=1, val_acc=0.757]
Epoch 84:  31%|███       | 36/117 [00:02<00:04, 16.73it/s, loss=0.71, v_num=1, val_acc=0.757]
Epoch 84:  32%|███▏      | 37/117 [00:02<00:04, 17.12it/s, loss=0.71, v_num=1, val_acc=0.757]
Epoch 84:  32%|███▏      | 37/117 [00:02<00:04, 16.92it/s, loss=0.711, v_num=1, val_acc=0.757]
Epoch 84:  32%|███▏      | 38/117 [00:02<00:04, 17.30it/s, loss=0.711, v_num=1, val_acc=0.757]
Epoch 84:  32%|███▏      | 38/117 [00:02<00:04, 17.11it/s, loss=0.709, v_num=1, val_acc=0.757]
Epoch 84:  33%|███▎      | 39/117 [00:02<00:04, 17.48it/s, loss=0.709, v_num=1, val_acc=0.757]
Epoch 84:  33%|███▎      | 39/117 [00:02<00:04, 17.28it/s, loss=0.708, v_num=1, val_acc=0.757]
Epoch 84:  34%|███▍      | 40/117 [00:02<00:04, 17.65it/s, loss=0.708, v_num=1, val_acc=0.757]
Epoch 84:  34%|███▍      | 40/117 [00:02<00:04, 17.46it/s, loss=0.7, v_num=1, val_acc=0.757]
Epoch 84:  35%|███▌      | 41/117 [00:02<00:04, 17.82it/s, loss=0.7, v_num=1, val_acc=0.757]
Epoch 84:  35%|███▌      | 41/117 [00:02<00:04, 17.63it/s, loss=0.696, v_num=1, val_acc=0.757]
Epoch 84:  36%|███▌      | 42/117 [00:02<00:04, 17.98it/s, loss=0.696, v_num=1, val_acc=0.757]
Epoch 84:  36%|███▌      | 42/117 [00:02<00:04, 17.79it/s, loss=0.698, v_num=1, val_acc=0.757]
Epoch 84:  37%|███▋      | 43/117 [00:02<00:04, 18.14it/s, loss=0.698, v_num=1, val_acc=0.757]
Epoch 84:  37%|███▋      | 43/117 [00:02<00:04, 17.95it/s, loss=0.699, v_num=1, val_acc=0.757]
Epoch 84:  38%|███▊      | 44/117 [00:02<00:03, 18.30it/s, loss=0.699, v_num=1, val_acc=0.757]
Epoch 84:  38%|███▊      | 44/117 [00:02<00:04, 18.11it/s, loss=0.702, v_num=1, val_acc=0.757]
Epoch 84:  38%|███▊      | 45/117 [00:02<00:03, 18.45it/s, loss=0.702, v_num=1, val_acc=0.757]
Epoch 84:  38%|███▊      | 45/117 [00:02<00:03, 18.26it/s, loss=0.702, v_num=1, val_acc=0.757]
Epoch 84:  39%|███▉      | 46/117 [00:02<00:03, 18.59it/s, loss=0.702, v_num=1, val_acc=0.757]
Epoch 84:  39%|███▉      | 46/117 [00:02<00:03, 18.41it/s, loss=0.702, v_num=1, val_acc=0.757]
Epoch 84:  40%|████      | 47/117 [00:02<00:03, 18.73it/s, loss=0.702, v_num=1, val_acc=0.757]
Epoch 84:  40%|████      | 47/117 [00:02<00:03, 18.55it/s, loss=0.694, v_num=1, val_acc=0.757]
Epoch 84:  41%|████      | 48/117 [00:02<00:03, 18.87it/s, loss=0.694, v_num=1, val_acc=0.757]
Epoch 84:  41%|████      | 48/117 [00:02<00:03, 18.69it/s, loss=0.69, v_num=1, val_acc=0.757]
Epoch 84:  42%|████▏     | 49/117 [00:02<00:03, 19.01it/s, loss=0.69, v_num=1, val_acc=0.757]
Epoch 84:  42%|████▏     | 49/117 [00:02<00:03, 18.82it/s, loss=0.687, v_num=1, val_acc=0.757]
Epoch 84:  43%|████▎     | 50/117 [00:02<00:03, 19.14it/s, loss=0.687, v_num=1, val_acc=0.757]
Epoch 84:  43%|████▎     | 50/117 [00:02<00:03, 18.96it/s, loss=0.685, v_num=1, val_acc=0.757]
Epoch 84:  44%|████▎     | 51/117 [00:02<00:03, 19.27it/s, loss=0.685, v_num=1, val_acc=0.757]
Epoch 84:  44%|████▎     | 51/117 [00:02<00:03, 19.09it/s, loss=0.686, v_num=1, val_acc=0.757]
Epoch 84:  44%|████▍     | 52/117 [00:02<00:03, 19.39it/s, loss=0.686, v_num=1, val_acc=0.757]
Epoch 84:  44%|████▍     | 52/117 [00:02<00:03, 19.21it/s, loss=0.684, v_num=1, val_acc=0.757]
Epoch 84:  45%|████▌     | 53/117 [00:02<00:03, 19.50it/s, loss=0.684, v_num=1, val_acc=0.757]
Epoch 84:  45%|████▌     | 53/117 [00:02<00:03, 19.33it/s, loss=0.685, v_num=1, val_acc=0.757]
Epoch 84:  46%|████▌     | 54/117 [00:02<00:03, 19.62it/s, loss=0.685, v_num=1, val_acc=0.757]
Epoch 84:  46%|████▌     | 54/117 [00:02<00:03, 19.44it/s, loss=0.684, v_num=1, val_acc=0.757]
Epoch 84:  47%|████▋     | 55/117 [00:02<00:03, 19.73it/s, loss=0.684, v_num=1, val_acc=0.757]
Epoch 84:  47%|████▋     | 55/117 [00:02<00:03, 19.56it/s, loss=0.676, v_num=1, val_acc=0.757]
Epoch 84:  48%|████▊     | 56/117 [00:02<00:03, 19.84it/s, loss=0.676, v_num=1, val_acc=0.757]
Epoch 84:  48%|████▊     | 56/117 [00:02<00:03, 19.67it/s, loss=0.677, v_num=1, val_acc=0.757]
Epoch 84:  49%|████▊     | 57/117 [00:02<00:03, 19.95it/s, loss=0.677, v_num=1, val_acc=0.757]
Epoch 84:  49%|████▊     | 57/117 [00:02<00:03, 19.78it/s, loss=0.671, v_num=1, val_acc=0.757]
Epoch 84:  50%|████▉     | 58/117 [00:02<00:02, 20.06it/s, loss=0.671, v_num=1, val_acc=0.757]
Epoch 84:  50%|████▉     | 58/117 [00:02<00:02, 19.88it/s, loss=0.667, v_num=1, val_acc=0.757]
Epoch 84:  50%|█████     | 59/117 [00:02<00:02, 20.16it/s, loss=0.667, v_num=1, val_acc=0.757]
Epoch 84:  50%|█████     | 59/117 [00:02<00:02, 19.99it/s, loss=0.674, v_num=1, val_acc=0.757]
Epoch 84:  51%|█████▏    | 60/117 [00:02<00:02, 20.27it/s, loss=0.674, v_num=1, val_acc=0.757]
Epoch 84:  51%|█████▏    | 60/117 [00:02<00:02, 20.09it/s, loss=0.681, v_num=1, val_acc=0.757]
Epoch 84:  52%|█████▏    | 61/117 [00:02<00:02, 20.37it/s, loss=0.681, v_num=1, val_acc=0.757]
Epoch 84:  52%|█████▏    | 61/117 [00:03<00:02, 20.20it/s, loss=0.682, v_num=1, val_acc=0.757]
Epoch 84:  53%|█████▎    | 62/117 [00:03<00:02, 20.46it/s, loss=0.682, v_num=1, val_acc=0.757]
Epoch 84:  53%|█████▎    | 62/117 [00:03<00:02, 20.29it/s, loss=0.682, v_num=1, val_acc=0.757]
Epoch 84:  54%|█████▍    | 63/117 [00:03<00:02, 20.55it/s, loss=0.682, v_num=1, val_acc=0.757]
Epoch 84:  54%|█████▍    | 63/117 [00:03<00:02, 20.39it/s, loss=0.676, v_num=1, val_acc=0.757]
Epoch 84:  55%|█████▍    | 64/117 [00:03<00:02, 20.65it/s, loss=0.676, v_num=1, val_acc=0.757]
Epoch 84:  55%|█████▍    | 64/117 [00:03<00:02, 20.48it/s, loss=0.673, v_num=1, val_acc=0.757]
Epoch 84:  56%|█████▌    | 65/117 [00:03<00:02, 20.74it/s, loss=0.673, v_num=1, val_acc=0.757]
Epoch 84:  56%|█████▌    | 65/117 [00:03<00:02, 20.57it/s, loss=0.669, v_num=1, val_acc=0.757]
Epoch 84:  56%|█████▋    | 66/117 [00:03<00:02, 20.83it/s, loss=0.669, v_num=1, val_acc=0.757]
Epoch 84:  56%|█████▋    | 66/117 [00:03<00:02, 20.66it/s, loss=0.669, v_num=1, val_acc=0.757]
Epoch 84:  57%|█████▋    | 67/117 [00:03<00:02, 20.92it/s, loss=0.669, v_num=1, val_acc=0.757]
Epoch 84:  57%|█████▋    | 67/117 [00:03<00:02, 20.75it/s, loss=0.671, v_num=1, val_acc=0.757]
Epoch 84:  58%|█████▊    | 68/117 [00:03<00:02, 21.00it/s, loss=0.671, v_num=1, val_acc=0.757]
Epoch 84:  58%|█████▊    | 68/117 [00:03<00:02, 20.84it/s, loss=0.668, v_num=1, val_acc=0.757]
Epoch 84:  59%|█████▉    | 69/117 [00:03<00:02, 21.08it/s, loss=0.668, v_num=1, val_acc=0.757]
Epoch 84:  59%|█████▉    | 69/117 [00:03<00:02, 20.92it/s, loss=0.668, v_num=1, val_acc=0.757]
Epoch 84:  60%|█████▉    | 70/117 [00:03<00:02, 21.16it/s, loss=0.668, v_num=1, val_acc=0.757]
Epoch 84:  60%|█████▉    | 70/117 [00:03<00:02, 21.00it/s, loss=0.665, v_num=1, val_acc=0.757]
Epoch 84:  61%|██████    | 71/117 [00:03<00:02, 21.24it/s, loss=0.665, v_num=1, val_acc=0.757]
Epoch 84:  61%|██████    | 71/117 [00:03<00:02, 21.08it/s, loss=0.666, v_num=1, val_acc=0.757]
Epoch 84:  62%|██████▏   | 72/117 [00:03<00:02, 21.32it/s, loss=0.666, v_num=1, val_acc=0.757]
Epoch 84:  62%|██████▏   | 72/117 [00:03<00:02, 21.16it/s, loss=0.664, v_num=1, val_acc=0.757]
Epoch 84:  62%|██████▏   | 73/117 [00:03<00:02, 21.39it/s, loss=0.664, v_num=1, val_acc=0.757]
Epoch 84:  62%|██████▏   | 73/117 [00:03<00:02, 21.24it/s, loss=0.659, v_num=1, val_acc=0.757]
Epoch 84:  63%|██████▎   | 74/117 [00:03<00:02, 21.46it/s, loss=0.659, v_num=1, val_acc=0.757]
Epoch 84:  63%|██████▎   | 74/117 [00:03<00:02, 21.31it/s, loss=0.662, v_num=1, val_acc=0.757]
Epoch 84:  64%|██████▍   | 75/117 [00:03<00:01, 21.54it/s, loss=0.662, v_num=1, val_acc=0.757]
Epoch 84:  64%|██████▍   | 75/117 [00:03<00:01, 21.39it/s, loss=0.664, v_num=1, val_acc=0.757]
Epoch 84:  65%|██████▍   | 76/117 [00:03<00:01, 21.61it/s, loss=0.664, v_num=1, val_acc=0.757]
Epoch 84:  65%|██████▍   | 76/117 [00:03<00:01, 21.46it/s, loss=0.664, v_num=1, val_acc=0.757]
Epoch 84:  66%|██████▌   | 77/117 [00:03<00:01, 21.68it/s, loss=0.664, v_num=1, val_acc=0.757]
Epoch 84:  66%|██████▌   | 77/117 [00:03<00:01, 21.53it/s, loss=0.67, v_num=1, val_acc=0.757]
Epoch 84:  67%|██████▋   | 78/117 [00:03<00:01, 21.75it/s, loss=0.67, v_num=1, val_acc=0.757]
Epoch 84:  67%|██████▋   | 78/117 [00:03<00:01, 21.60it/s, loss=0.674, v_num=1, val_acc=0.757]
Epoch 84:  68%|██████▊   | 79/117 [00:03<00:01, 21.82it/s, loss=0.674, v_num=1, val_acc=0.757]
Epoch 84:  68%|██████▊   | 79/117 [00:03<00:01, 21.67it/s, loss=0.674, v_num=1, val_acc=0.757]
Epoch 84:  68%|██████▊   | 80/117 [00:03<00:01, 21.88it/s, loss=0.674, v_num=1, val_acc=0.757]
Epoch 84:  68%|██████▊   | 80/117 [00:03<00:01, 21.73it/s, loss=0.67, v_num=1, val_acc=0.757]
Epoch 84:  69%|██████▉   | 81/117 [00:03<00:01, 21.95it/s, loss=0.67, v_num=1, val_acc=0.757]
Epoch 84:  69%|██████▉   | 81/117 [00:03<00:01, 21.80it/s, loss=0.671, v_num=1, val_acc=0.757]
Epoch 84:  70%|███████   | 82/117 [00:03<00:01, 21.99it/s, loss=0.671, v_num=1, val_acc=0.757]
Epoch 84:  70%|███████   | 82/117 [00:03<00:01, 21.85it/s, loss=0.67, v_num=1, val_acc=0.757]
Epoch 84:  71%|███████   | 83/117 [00:03<00:01, 22.05it/s, loss=0.67, v_num=1, val_acc=0.757]
Epoch 84:  71%|███████   | 83/117 [00:03<00:01, 21.91it/s, loss=0.675, v_num=1, val_acc=0.757]
Epoch 84:  72%|███████▏  | 84/117 [00:03<00:01, 22.12it/s, loss=0.675, v_num=1, val_acc=0.757]
Epoch 84:  72%|███████▏  | 84/117 [00:03<00:01, 21.97it/s, loss=0.678, v_num=1, val_acc=0.757]
Epoch 84:  73%|███████▎  | 85/117 [00:03<00:01, 22.19it/s, loss=0.678, v_num=1, val_acc=0.757]
Epoch 84:  73%|███████▎  | 85/117 [00:03<00:01, 22.04it/s, loss=0.684, v_num=1, val_acc=0.757]
Epoch 84:  74%|███████▎  | 86/117 [00:03<00:01, 22.25it/s, loss=0.684, v_num=1, val_acc=0.757]
Epoch 84:  74%|███████▎  | 86/117 [00:03<00:01, 22.10it/s, loss=0.684, v_num=1, val_acc=0.757]
Epoch 84:  74%|███████▍  | 87/117 [00:03<00:01, 22.31it/s, loss=0.684, v_num=1, val_acc=0.757]
Epoch 84:  74%|███████▍  | 87/117 [00:03<00:01, 22.16it/s, loss=0.687, v_num=1, val_acc=0.757]
Epoch 84:  75%|███████▌  | 88/117 [00:03<00:01, 22.37it/s, loss=0.687, v_num=1, val_acc=0.757]
Epoch 84:  75%|███████▌  | 88/117 [00:03<00:01, 22.22it/s, loss=0.686, v_num=1, val_acc=0.757]
Epoch 84:  76%|███████▌  | 89/117 [00:03<00:01, 22.42it/s, loss=0.686, v_num=1, val_acc=0.757]
Epoch 84:  76%|███████▌  | 89/117 [00:03<00:01, 22.28it/s, loss=0.69, v_num=1, val_acc=0.757]
Epoch 84:  77%|███████▋  | 90/117 [00:04<00:01, 22.48it/s, loss=0.69, v_num=1, val_acc=0.757]
Epoch 84:  77%|███████▋  | 90/117 [00:04<00:01, 22.34it/s, loss=0.689, v_num=1, val_acc=0.757]
Epoch 84:  78%|███████▊  | 91/117 [00:04<00:01, 22.51it/s, loss=0.689, v_num=1, val_acc=0.757]
Epoch 84:  78%|███████▊  | 91/117 [00:04<00:01, 22.38it/s, loss=0.692, v_num=1, val_acc=0.757]
Epoch 84:  79%|███████▊  | 92/117 [00:04<00:01, 22.58it/s, loss=0.692, v_num=1, val_acc=0.757]
Epoch 84:  79%|███████▊  | 92/117 [00:04<00:01, 22.44it/s, loss=0.7, v_num=1, val_acc=0.757]
Epoch 84:  79%|███████▉  | 93/117 [00:04<00:01, 22.63it/s, loss=0.7, v_num=1, val_acc=0.757]
Epoch 84:  79%|███████▉  | 93/117 [00:04<00:01, 22.49it/s, loss=0.703, v_num=1, val_acc=0.757]
Epoch 84:  80%|████████  | 94/117 [00:04<00:01, 22.68it/s, loss=0.703, v_num=1, val_acc=0.757]
Epoch 84:  80%|████████  | 94/117 [00:04<00:01, 22.55it/s, loss=0.697, v_num=1, val_acc=0.757]
Epoch 84:  81%|████████  | 95/117 [00:04<00:00, 22.74it/s, loss=0.697, v_num=1, val_acc=0.757]
Epoch 84:  81%|████████  | 95/117 [00:04<00:00, 22.60it/s, loss=0.698, v_num=1, val_acc=0.757]
Epoch 84:  82%|████████▏ | 96/117 [00:04<00:00, 22.79it/s, loss=0.698, v_num=1, val_acc=0.757]
Epoch 84:  82%|████████▏ | 96/117 [00:04<00:00, 22.65it/s, loss=0.699, v_num=1, val_acc=0.757]
Epoch 84:  83%|████████▎ | 97/117 [00:04<00:00, 22.84it/s, loss=0.699, v_num=1, val_acc=0.757]
Epoch 84:  83%|████████▎ | 97/117 [00:04<00:00, 22.70it/s, loss=0.702, v_num=1, val_acc=0.757]

Validation: 0it [00:00, ?it/s]

Validation:   0%|          | 0/20 [00:00<?, ?it/s]

Validation DataLoader 0:   0%|          | 0/20 [00:00<?, ?it/s]

Validation DataLoader 0:   5%|▌         | 1/20 [00:00<00:00, 130.08it/s]
Epoch 84:  84%|████████▍ | 98/117 [00:05<00:00, 19.17it/s, loss=0.702, v_num=1, val_acc=0.757]

Validation DataLoader 0:  10%|█         | 2/20 [00:00<00:00, 50.22it/s]
Epoch 84:  85%|████████▍ | 99/117 [00:05<00:00, 19.25it/s, loss=0.702, v_num=1, val_acc=0.757]

Validation DataLoader 0:  15%|█▌        | 3/20 [00:00<00:00, 42.97it/s]
Epoch 84:  85%|████████▌ | 100/117 [00:05<00:00, 19.33it/s, loss=0.702, v_num=1, val_acc=0.757]

Validation DataLoader 0:  20%|██        | 4/20 [00:00<00:00, 39.25it/s]
Epoch 84:  86%|████████▋ | 101/117 [00:05<00:00, 19.40it/s, loss=0.702, v_num=1, val_acc=0.757]

Validation DataLoader 0:  25%|██▌       | 5/20 [00:00<00:00, 37.43it/s]
Epoch 84:  87%|████████▋ | 102/117 [00:05<00:00, 19.48it/s, loss=0.702, v_num=1, val_acc=0.757]

Validation DataLoader 0:  30%|███       | 6/20 [00:00<00:00, 36.37it/s]
Epoch 84:  88%|████████▊ | 103/117 [00:05<00:00, 19.55it/s, loss=0.702, v_num=1, val_acc=0.757]

Validation DataLoader 0:  35%|███▌      | 7/20 [00:00<00:00, 35.63it/s]
Epoch 84:  89%|████████▉ | 104/117 [00:05<00:00, 19.62it/s, loss=0.702, v_num=1, val_acc=0.757]

Validation DataLoader 0:  40%|████      | 8/20 [00:00<00:00, 35.07it/s]
Epoch 84:  90%|████████▉ | 105/117 [00:05<00:00, 19.69it/s, loss=0.702, v_num=1, val_acc=0.757]

Validation DataLoader 0:  45%|████▌     | 9/20 [00:00<00:00, 34.65it/s]
Epoch 84:  91%|█████████ | 106/117 [00:05<00:00, 19.77it/s, loss=0.702, v_num=1, val_acc=0.757]

Validation DataLoader 0:  50%|█████     | 10/20 [00:00<00:00, 34.32it/s]
Epoch 84:  91%|█████████▏| 107/117 [00:05<00:00, 19.83it/s, loss=0.702, v_num=1, val_acc=0.757]

Validation DataLoader 0:  55%|█████▌    | 11/20 [00:00<00:00, 34.06it/s]
Epoch 84:  92%|█████████▏| 108/117 [00:05<00:00, 19.90it/s, loss=0.702, v_num=1, val_acc=0.757]

Validation DataLoader 0:  60%|██████    | 12/20 [00:00<00:00, 33.86it/s]
Epoch 84:  93%|█████████▎| 109/117 [00:05<00:00, 19.97it/s, loss=0.702, v_num=1, val_acc=0.757]

Validation DataLoader 0:  65%|██████▌   | 13/20 [00:00<00:00, 33.67it/s]
Epoch 84:  94%|█████████▍| 110/117 [00:05<00:00, 20.04it/s, loss=0.702, v_num=1, val_acc=0.757]

Validation DataLoader 0:  70%|███████   | 14/20 [00:00<00:00, 33.51it/s]
Epoch 84:  95%|█████████▍| 111/117 [00:05<00:00, 20.11it/s, loss=0.702, v_num=1, val_acc=0.757]

Validation DataLoader 0:  75%|███████▌  | 15/20 [00:00<00:00, 33.37it/s]
Epoch 84:  96%|█████████▌| 112/117 [00:05<00:00, 20.17it/s, loss=0.702, v_num=1, val_acc=0.757]

Validation DataLoader 0:  80%|████████  | 16/20 [00:00<00:00, 33.26it/s]
Epoch 84:  97%|█████████▋| 113/117 [00:05<00:00, 20.24it/s, loss=0.702, v_num=1, val_acc=0.757]

Validation DataLoader 0:  85%|████████▌ | 17/20 [00:00<00:00, 33.13it/s]
Epoch 84:  97%|█████████▋| 114/117 [00:05<00:00, 20.30it/s, loss=0.702, v_num=1, val_acc=0.757]

Validation DataLoader 0:  90%|█████████ | 18/20 [00:00<00:00, 33.05it/s]
Epoch 84:  98%|█████████▊| 115/117 [00:05<00:00, 20.36it/s, loss=0.702, v_num=1, val_acc=0.757]

Validation DataLoader 0:  95%|█████████▌| 19/20 [00:00<00:00, 32.97it/s]
Epoch 84:  99%|█████████▉| 116/117 [00:05<00:00, 20.42it/s, loss=0.702, v_num=1, val_acc=0.757]

Validation DataLoader 0: 100%|██████████| 20/20 [00:00<00:00, 32.97it/s]
Epoch 84: 100%|██████████| 117/117 [00:05<00:00, 20.49it/s, loss=0.702, v_num=1, val_acc=0.757]
Epoch 84: 100%|██████████| 117/117 [00:05<00:00, 20.42it/s, loss=0.702, v_num=1, val_acc=0.757]


Epoch 84: 100%|██████████| 117/117 [00:05<00:00, 20.42it/s, loss=0.702, v_num=1, val_acc=0.757]
Epoch 84:   0%|          | 0/117 [00:00<?, ?it/s, loss=0.702, v_num=1, val_acc=0.757]
Epoch 85:   0%|          | 0/117 [00:00<?, ?it/s, loss=0.702, v_num=1, val_acc=0.757]
Epoch 85:   1%|          | 1/117 [00:00<01:48,  1.06it/s, loss=0.702, v_num=1, val_acc=0.757]
Epoch 85:   1%|          | 1/117 [00:00<01:51,  1.04it/s, loss=0.7, v_num=1, val_acc=0.757]
Epoch 85:   2%|▏         | 2/117 [00:00<00:55,  2.06it/s, loss=0.7, v_num=1, val_acc=0.757]
Epoch 85:   2%|▏         | 2/117 [00:00<00:57,  2.01it/s, loss=0.7, v_num=1, val_acc=0.757]
Epoch 85:   3%|▎         | 3/117 [00:01<00:38,  2.97it/s, loss=0.7, v_num=1, val_acc=0.757]
Epoch 85:   3%|▎         | 3/117 [00:01<00:39,  2.91it/s, loss=0.701, v_num=1, val_acc=0.757]
Epoch 85:   3%|▎         | 4/117 [00:01<00:29,  3.84it/s, loss=0.701, v_num=1, val_acc=0.757]
Epoch 85:   3%|▎         | 4/117 [00:01<00:30,  3.75it/s, loss=0.705, v_num=1, val_acc=0.757]
Epoch 85:   4%|▍         | 5/117 [00:01<00:24,  4.64it/s, loss=0.705, v_num=1, val_acc=0.757]
Epoch 85:   4%|▍         | 5/117 [00:01<00:24,  4.54it/s, loss=0.698, v_num=1, val_acc=0.757]
Epoch 85:   5%|▌         | 6/117 [00:01<00:20,  5.40it/s, loss=0.698, v_num=1, val_acc=0.757]
Epoch 85:   5%|▌         | 6/117 [00:01<00:21,  5.28it/s, loss=0.694, v_num=1, val_acc=0.757]
Epoch 85:   6%|▌         | 7/117 [00:01<00:18,  6.11it/s, loss=0.694, v_num=1, val_acc=0.757]
Epoch 85:   6%|▌         | 7/117 [00:01<00:18,  5.98it/s, loss=0.699, v_num=1, val_acc=0.757]
Epoch 85:   7%|▋         | 8/117 [00:01<00:16,  6.78it/s, loss=0.699, v_num=1, val_acc=0.757]
Epoch 85:   7%|▋         | 8/117 [00:01<00:16,  6.64it/s, loss=0.696, v_num=1, val_acc=0.757]
Epoch 85:   8%|▊         | 9/117 [00:01<00:14,  7.36it/s, loss=0.696, v_num=1, val_acc=0.757]
Epoch 85:   8%|▊         | 9/117 [00:01<00:14,  7.22it/s, loss=0.7, v_num=1, val_acc=0.757]
Epoch 85:   9%|▊         | 10/117 [00:01<00:13,  7.97it/s, loss=0.7, v_num=1, val_acc=0.757]
Epoch 85:   9%|▊         | 10/117 [00:01<00:13,  7.81it/s, loss=0.698, v_num=1, val_acc=0.757]
Epoch 85:   9%|▉         | 11/117 [00:01<00:12,  8.54it/s, loss=0.698, v_num=1, val_acc=0.757]
Epoch 85:   9%|▉         | 11/117 [00:01<00:12,  8.37it/s, loss=0.704, v_num=1, val_acc=0.757]
Epoch 85:  10%|█         | 12/117 [00:01<00:11,  9.07it/s, loss=0.704, v_num=1, val_acc=0.757]
Epoch 85:  10%|█         | 12/117 [00:01<00:11,  8.91it/s, loss=0.699, v_num=1, val_acc=0.757]
Epoch 85:  11%|█         | 13/117 [00:01<00:10,  9.58it/s, loss=0.699, v_num=1, val_acc=0.757]
Epoch 85:  11%|█         | 13/117 [00:01<00:11,  9.41it/s, loss=0.703, v_num=1, val_acc=0.757]
Epoch 85:  12%|█▏        | 14/117 [00:01<00:10, 10.04it/s, loss=0.703, v_num=1, val_acc=0.757]
Epoch 85:  12%|█▏        | 14/117 [00:01<00:10,  9.88it/s, loss=0.703, v_num=1, val_acc=0.757]
Epoch 85:  13%|█▎        | 15/117 [00:01<00:09, 10.49it/s, loss=0.703, v_num=1, val_acc=0.757]
Epoch 85:  13%|█▎        | 15/117 [00:01<00:09, 10.32it/s, loss=0.698, v_num=1, val_acc=0.757]
Epoch 85:  14%|█▎        | 16/117 [00:01<00:09, 10.94it/s, loss=0.698, v_num=1, val_acc=0.757]
Epoch 85:  14%|█▎        | 16/117 [00:01<00:09, 10.75it/s, loss=0.696, v_num=1, val_acc=0.757]
Epoch 85:  15%|█▍        | 17/117 [00:01<00:08, 11.33it/s, loss=0.696, v_num=1, val_acc=0.757]
Epoch 85:  15%|█▍        | 17/117 [00:01<00:08, 11.14it/s, loss=0.696, v_num=1, val_acc=0.757]
Epoch 85:  15%|█▌        | 18/117 [00:01<00:08, 11.73it/s, loss=0.696, v_num=1, val_acc=0.757]
Epoch 85:  15%|█▌        | 18/117 [00:01<00:08, 11.54it/s, loss=0.696, v_num=1, val_acc=0.757]
Epoch 85:  16%|█▌        | 19/117 [00:01<00:08, 12.12it/s, loss=0.696, v_num=1, val_acc=0.757]
Epoch 85:  16%|█▌        | 19/117 [00:01<00:08, 11.92it/s, loss=0.7, v_num=1, val_acc=0.757]
Epoch 85:  17%|█▋        | 20/117 [00:01<00:07, 12.49it/s, loss=0.7, v_num=1, val_acc=0.757]
Epoch 85:  17%|█▋        | 20/117 [00:01<00:07, 12.29it/s, loss=0.695, v_num=1, val_acc=0.757]
Epoch 85:  18%|█▊        | 21/117 [00:01<00:07, 12.84it/s, loss=0.695, v_num=1, val_acc=0.757]
Epoch 85:  18%|█▊        | 21/117 [00:01<00:07, 12.64it/s, loss=0.698, v_num=1, val_acc=0.757]
Epoch 85:  19%|█▉        | 22/117 [00:01<00:07, 13.17it/s, loss=0.698, v_num=1, val_acc=0.757]
Epoch 85:  19%|█▉        | 22/117 [00:01<00:07, 12.98it/s, loss=0.694, v_num=1, val_acc=0.757]
Epoch 85:  20%|█▉        | 23/117 [00:01<00:07, 13.43it/s, loss=0.694, v_num=1, val_acc=0.757]
Epoch 85:  20%|█▉        | 23/117 [00:01<00:07, 13.25it/s, loss=0.697, v_num=1, val_acc=0.757]
Epoch 85:  21%|██        | 24/117 [00:01<00:06, 13.75it/s, loss=0.697, v_num=1, val_acc=0.757]
Epoch 85:  21%|██        | 24/117 [00:01<00:06, 13.56it/s, loss=0.696, v_num=1, val_acc=0.757]
Epoch 85:  21%|██▏       | 25/117 [00:01<00:06, 14.06it/s, loss=0.696, v_num=1, val_acc=0.757]
Epoch 85:  21%|██▏       | 25/117 [00:01<00:06, 13.86it/s, loss=0.702, v_num=1, val_acc=0.757]
Epoch 85:  22%|██▏       | 26/117 [00:01<00:06, 14.35it/s, loss=0.702, v_num=1, val_acc=0.757]
Epoch 85:  22%|██▏       | 26/117 [00:01<00:06, 14.15it/s, loss=0.702, v_num=1, val_acc=0.757]
Epoch 85:  23%|██▎       | 27/117 [00:01<00:06, 14.63it/s, loss=0.702, v_num=1, val_acc=0.757]
Epoch 85:  23%|██▎       | 27/117 [00:01<00:06, 14.43it/s, loss=0.699, v_num=1, val_acc=0.757]
Epoch 85:  24%|██▍       | 28/117 [00:01<00:05, 14.90it/s, loss=0.699, v_num=1, val_acc=0.757]
Epoch 85:  24%|██▍       | 28/117 [00:01<00:06, 14.70it/s, loss=0.7, v_num=1, val_acc=0.757]
Epoch 85:  25%|██▍       | 29/117 [00:01<00:05, 15.15it/s, loss=0.7, v_num=1, val_acc=0.757]
Epoch 85:  25%|██▍       | 29/117 [00:01<00:05, 14.95it/s, loss=0.699, v_num=1, val_acc=0.757]
Epoch 85:  26%|██▌       | 30/117 [00:01<00:05, 15.39it/s, loss=0.699, v_num=1, val_acc=0.757]
Epoch 85:  26%|██▌       | 30/117 [00:01<00:05, 15.20it/s, loss=0.702, v_num=1, val_acc=0.757]
Epoch 85:  26%|██▋       | 31/117 [00:01<00:05, 15.62it/s, loss=0.702, v_num=1, val_acc=0.757]
Epoch 85:  26%|██▋       | 31/117 [00:02<00:05, 15.42it/s, loss=0.699, v_num=1, val_acc=0.757]
Epoch 85:  27%|██▋       | 32/117 [00:02<00:05, 15.85it/s, loss=0.699, v_num=1, val_acc=0.757]
Epoch 85:  27%|██▋       | 32/117 [00:02<00:05, 15.66it/s, loss=0.701, v_num=1, val_acc=0.757]
Epoch 85:  28%|██▊       | 33/117 [00:02<00:05, 16.07it/s, loss=0.701, v_num=1, val_acc=0.757]
Epoch 85:  28%|██▊       | 33/117 [00:02<00:05, 15.88it/s, loss=0.699, v_num=1, val_acc=0.757]
Epoch 85:  29%|██▉       | 34/117 [00:02<00:05, 16.29it/s, loss=0.699, v_num=1, val_acc=0.757]
Epoch 85:  29%|██▉       | 34/117 [00:02<00:05, 16.10it/s, loss=0.695, v_num=1, val_acc=0.757]
Epoch 85:  30%|██▉       | 35/117 [00:02<00:04, 16.49it/s, loss=0.695, v_num=1, val_acc=0.757]
Epoch 85:  30%|██▉       | 35/117 [00:02<00:05, 16.30it/s, loss=0.701, v_num=1, val_acc=0.757]
Epoch 85:  31%|███       | 36/117 [00:02<00:04, 16.70it/s, loss=0.701, v_num=1, val_acc=0.757]
Epoch 85:  31%|███       | 36/117 [00:02<00:04, 16.50it/s, loss=0.7, v_num=1, val_acc=0.757]
Epoch 85:  32%|███▏      | 37/117 [00:02<00:04, 16.89it/s, loss=0.7, v_num=1, val_acc=0.757]
Epoch 85:  32%|███▏      | 37/117 [00:02<00:04, 16.70it/s, loss=0.704, v_num=1, val_acc=0.757]
Epoch 85:  32%|███▏      | 38/117 [00:02<00:04, 17.08it/s, loss=0.704, v_num=1, val_acc=0.757]
Epoch 85:  32%|███▏      | 38/117 [00:02<00:04, 16.88it/s, loss=0.699, v_num=1, val_acc=0.757]
Epoch 85:  33%|███▎      | 39/117 [00:02<00:04, 17.25it/s, loss=0.699, v_num=1, val_acc=0.757]
Epoch 85:  33%|███▎      | 39/117 [00:02<00:04, 17.06it/s, loss=0.694, v_num=1, val_acc=0.757]
Epoch 85:  34%|███▍      | 40/117 [00:02<00:04, 17.44it/s, loss=0.694, v_num=1, val_acc=0.757]
Epoch 85:  34%|███▍      | 40/117 [00:02<00:04, 17.25it/s, loss=0.697, v_num=1, val_acc=0.757]
Epoch 85:  35%|███▌      | 41/117 [00:02<00:04, 17.61it/s, loss=0.697, v_num=1, val_acc=0.757]
Epoch 85:  35%|███▌      | 41/117 [00:02<00:04, 17.42it/s, loss=0.693, v_num=1, val_acc=0.757]
Epoch 85:  36%|███▌      | 42/117 [00:02<00:04, 17.77it/s, loss=0.693, v_num=1, val_acc=0.757]
Epoch 85:  36%|███▌      | 42/117 [00:02<00:04, 17.58it/s, loss=0.695, v_num=1, val_acc=0.757]
Epoch 85:  37%|███▋      | 43/117 [00:02<00:04, 17.93it/s, loss=0.695, v_num=1, val_acc=0.757]
Epoch 85:  37%|███▋      | 43/117 [00:02<00:04, 17.75it/s, loss=0.695, v_num=1, val_acc=0.757]
Epoch 85:  38%|███▊      | 44/117 [00:02<00:04, 18.09it/s, loss=0.695, v_num=1, val_acc=0.757]
Epoch 85:  38%|███▊      | 44/117 [00:02<00:04, 17.90it/s, loss=0.695, v_num=1, val_acc=0.757]
Epoch 85:  38%|███▊      | 45/117 [00:02<00:03, 18.24it/s, loss=0.695, v_num=1, val_acc=0.757]
Epoch 85:  38%|███▊      | 45/117 [00:02<00:03, 18.06it/s, loss=0.697, v_num=1, val_acc=0.757]
Epoch 85:  39%|███▉      | 46/117 [00:02<00:03, 18.39it/s, loss=0.697, v_num=1, val_acc=0.757]
Epoch 85:  39%|███▉      | 46/117 [00:02<00:03, 18.21it/s, loss=0.698, v_num=1, val_acc=0.757]
Epoch 85:  40%|████      | 47/117 [00:02<00:03, 18.54it/s, loss=0.698, v_num=1, val_acc=0.757]
Epoch 85:  40%|████      | 47/117 [00:02<00:03, 18.35it/s, loss=0.696, v_num=1, val_acc=0.757]
Epoch 85:  41%|████      | 48/117 [00:02<00:03, 18.68it/s, loss=0.696, v_num=1, val_acc=0.757]
Epoch 85:  41%|████      | 48/117 [00:02<00:03, 18.49it/s, loss=0.698, v_num=1, val_acc=0.757]
Epoch 85:  42%|████▏     | 49/117 [00:02<00:03, 18.81it/s, loss=0.698, v_num=1, val_acc=0.757]
Epoch 85:  42%|████▏     | 49/117 [00:02<00:03, 18.63it/s, loss=0.697, v_num=1, val_acc=0.757]
Epoch 85:  43%|████▎     | 50/117 [00:02<00:03, 18.95it/s, loss=0.697, v_num=1, val_acc=0.757]
Epoch 85:  43%|████▎     | 50/117 [00:02<00:03, 18.77it/s, loss=0.692, v_num=1, val_acc=0.757]
Epoch 85:  44%|████▎     | 51/117 [00:02<00:03, 19.07it/s, loss=0.692, v_num=1, val_acc=0.757]
Epoch 85:  44%|████▎     | 51/117 [00:02<00:03, 18.90it/s, loss=0.697, v_num=1, val_acc=0.757]
Epoch 85:  44%|████▍     | 52/117 [00:02<00:03, 19.20it/s, loss=0.697, v_num=1, val_acc=0.757]
Epoch 85:  44%|████▍     | 52/117 [00:02<00:03, 19.03it/s, loss=0.696, v_num=1, val_acc=0.757]
Epoch 85:  45%|████▌     | 53/117 [00:02<00:03, 19.33it/s, loss=0.696, v_num=1, val_acc=0.757]
Epoch 85:  45%|████▌     | 53/117 [00:02<00:03, 19.15it/s, loss=0.694, v_num=1, val_acc=0.757]
Epoch 85:  46%|████▌     | 54/117 [00:02<00:03, 19.45it/s, loss=0.694, v_num=1, val_acc=0.757]
Epoch 85:  46%|████▌     | 54/117 [00:02<00:03, 19.27it/s, loss=0.692, v_num=1, val_acc=0.757]
Epoch 85:  47%|████▋     | 55/117 [00:02<00:03, 19.52it/s, loss=0.692, v_num=1, val_acc=0.757]
Epoch 85:  47%|████▋     | 55/117 [00:02<00:03, 19.37it/s, loss=0.687, v_num=1, val_acc=0.757]
Epoch 85:  48%|████▊     | 56/117 [00:02<00:03, 19.65it/s, loss=0.687, v_num=1, val_acc=0.757]
Epoch 85:  48%|████▊     | 56/117 [00:02<00:03, 19.48it/s, loss=0.682, v_num=1, val_acc=0.757]
Epoch 85:  49%|████▊     | 57/117 [00:02<00:03, 19.77it/s, loss=0.682, v_num=1, val_acc=0.757]
Epoch 85:  49%|████▊     | 57/117 [00:02<00:03, 19.59it/s, loss=0.683, v_num=1, val_acc=0.757]
Epoch 85:  50%|████▉     | 58/117 [00:02<00:02, 19.88it/s, loss=0.683, v_num=1, val_acc=0.757]
Epoch 85:  50%|████▉     | 58/117 [00:02<00:02, 19.70it/s, loss=0.682, v_num=1, val_acc=0.757]
Epoch 85:  50%|█████     | 59/117 [00:02<00:02, 19.98it/s, loss=0.682, v_num=1, val_acc=0.757]
Epoch 85:  50%|█████     | 59/117 [00:02<00:02, 19.81it/s, loss=0.684, v_num=1, val_acc=0.757]
Epoch 85:  51%|█████▏    | 60/117 [00:02<00:02, 20.09it/s, loss=0.684, v_num=1, val_acc=0.757]
Epoch 85:  51%|█████▏    | 60/117 [00:03<00:02, 19.92it/s, loss=0.681, v_num=1, val_acc=0.757]
Epoch 85:  52%|█████▏    | 61/117 [00:03<00:02, 20.19it/s, loss=0.681, v_num=1, val_acc=0.757]
Epoch 85:  52%|█████▏    | 61/117 [00:03<00:02, 20.02it/s, loss=0.684, v_num=1, val_acc=0.757]
Epoch 85:  53%|█████▎    | 62/117 [00:03<00:02, 20.29it/s, loss=0.684, v_num=1, val_acc=0.757]
Epoch 85:  53%|█████▎    | 62/117 [00:03<00:02, 20.12it/s, loss=0.686, v_num=1, val_acc=0.757]
Epoch 85:  54%|█████▍    | 63/117 [00:03<00:02, 20.38it/s, loss=0.686, v_num=1, val_acc=0.757]
Epoch 85:  54%|█████▍    | 63/117 [00:03<00:02, 20.22it/s, loss=0.684, v_num=1, val_acc=0.757]
Epoch 85:  55%|█████▍    | 64/117 [00:03<00:02, 20.47it/s, loss=0.684, v_num=1, val_acc=0.757]
Epoch 85:  55%|█████▍    | 64/117 [00:03<00:02, 20.31it/s, loss=0.68, v_num=1, val_acc=0.757]
Epoch 85:  56%|█████▌    | 65/117 [00:03<00:02, 20.56it/s, loss=0.68, v_num=1, val_acc=0.757]
Epoch 85:  56%|█████▌    | 65/117 [00:03<00:02, 20.40it/s, loss=0.679, v_num=1, val_acc=0.757]
Epoch 85:  56%|█████▋    | 66/117 [00:03<00:02, 20.65it/s, loss=0.679, v_num=1, val_acc=0.757]
Epoch 85:  56%|█████▋    | 66/117 [00:03<00:02, 20.49it/s, loss=0.677, v_num=1, val_acc=0.757]
Epoch 85:  57%|█████▋    | 67/117 [00:03<00:02, 20.74it/s, loss=0.677, v_num=1, val_acc=0.757]
Epoch 85:  57%|█████▋    | 67/117 [00:03<00:02, 20.58it/s, loss=0.68, v_num=1, val_acc=0.757]
Epoch 85:  58%|█████▊    | 68/117 [00:03<00:02, 20.82it/s, loss=0.68, v_num=1, val_acc=0.757]
Epoch 85:  58%|█████▊    | 68/117 [00:03<00:02, 20.66it/s, loss=0.678, v_num=1, val_acc=0.757]
Epoch 85:  59%|█████▉    | 69/117 [00:03<00:02, 20.91it/s, loss=0.678, v_num=1, val_acc=0.757]
Epoch 85:  59%|█████▉    | 69/117 [00:03<00:02, 20.75it/s, loss=0.676, v_num=1, val_acc=0.757]
Epoch 85:  60%|█████▉    | 70/117 [00:03<00:02, 20.99it/s, loss=0.676, v_num=1, val_acc=0.757]
Epoch 85:  60%|█████▉    | 70/117 [00:03<00:02, 20.83it/s, loss=0.678, v_num=1, val_acc=0.757]
Epoch 85:  61%|██████    | 71/117 [00:03<00:02, 21.07it/s, loss=0.678, v_num=1, val_acc=0.757]
Epoch 85:  61%|██████    | 71/117 [00:03<00:02, 20.91it/s, loss=0.676, v_num=1, val_acc=0.757]
Epoch 85:  62%|██████▏   | 72/117 [00:03<00:02, 21.15it/s, loss=0.676, v_num=1, val_acc=0.757]
Epoch 85:  62%|██████▏   | 72/117 [00:03<00:02, 20.99it/s, loss=0.684, v_num=1, val_acc=0.757]
Epoch 85:  62%|██████▏   | 73/117 [00:03<00:02, 21.23it/s, loss=0.684, v_num=1, val_acc=0.757]
Epoch 85:  62%|██████▏   | 73/117 [00:03<00:02, 21.07it/s, loss=0.684, v_num=1, val_acc=0.757]
Epoch 85:  63%|██████▎   | 74/117 [00:03<00:02, 21.29it/s, loss=0.684, v_num=1, val_acc=0.757]
Epoch 85:  63%|██████▎   | 74/117 [00:03<00:02, 21.14it/s, loss=0.688, v_num=1, val_acc=0.757]
Epoch 85:  64%|██████▍   | 75/117 [00:03<00:01, 21.37it/s, loss=0.688, v_num=1, val_acc=0.757]
Epoch 85:  64%|██████▍   | 75/117 [00:03<00:01, 21.22it/s, loss=0.688, v_num=1, val_acc=0.757]
Epoch 85:  65%|██████▍   | 76/117 [00:03<00:01, 21.45it/s, loss=0.688, v_num=1, val_acc=0.757]
Epoch 85:  65%|██████▍   | 76/117 [00:03<00:01, 21.29it/s, loss=0.698, v_num=1, val_acc=0.757]
Epoch 85:  66%|██████▌   | 77/117 [00:03<00:01, 21.52it/s, loss=0.698, v_num=1, val_acc=0.757]
Epoch 85:  66%|██████▌   | 77/117 [00:03<00:01, 21.37it/s, loss=0.698, v_num=1, val_acc=0.757]
Epoch 85:  67%|██████▋   | 78/117 [00:03<00:01, 21.56it/s, loss=0.698, v_num=1, val_acc=0.757]
Epoch 85:  67%|██████▋   | 78/117 [00:03<00:01, 21.42it/s, loss=0.701, v_num=1, val_acc=0.757]
Epoch 85:  68%|██████▊   | 79/117 [00:03<00:01, 21.64it/s, loss=0.701, v_num=1, val_acc=0.757]
Epoch 85:  68%|██████▊   | 79/117 [00:03<00:01, 21.49it/s, loss=0.701, v_num=1, val_acc=0.757]
Epoch 85:  68%|██████▊   | 80/117 [00:03<00:01, 21.71it/s, loss=0.701, v_num=1, val_acc=0.757]
Epoch 85:  68%|██████▊   | 80/117 [00:03<00:01, 21.56it/s, loss=0.7, v_num=1, val_acc=0.757]
Epoch 85:  69%|██████▉   | 81/117 [00:03<00:01, 21.77it/s, loss=0.7, v_num=1, val_acc=0.757]
Epoch 85:  69%|██████▉   | 81/117 [00:03<00:01, 21.63it/s, loss=0.702, v_num=1, val_acc=0.757]
Epoch 85:  70%|███████   | 82/117 [00:03<00:01, 21.82it/s, loss=0.702, v_num=1, val_acc=0.757]
Epoch 85:  70%|███████   | 82/117 [00:03<00:01, 21.67it/s, loss=0.701, v_num=1, val_acc=0.757]
Epoch 85:  71%|███████   | 83/117 [00:03<00:01, 21.89it/s, loss=0.701, v_num=1, val_acc=0.757]
Epoch 85:  71%|███████   | 83/117 [00:03<00:01, 21.74it/s, loss=0.697, v_num=1, val_acc=0.757]
Epoch 85:  72%|███████▏  | 84/117 [00:03<00:01, 21.95it/s, loss=0.697, v_num=1, val_acc=0.757]
Epoch 85:  72%|███████▏  | 84/117 [00:03<00:01, 21.81it/s, loss=0.695, v_num=1, val_acc=0.757]
Epoch 85:  73%|███████▎  | 85/117 [00:03<00:01, 22.02it/s, loss=0.695, v_num=1, val_acc=0.757]
Epoch 85:  73%|███████▎  | 85/117 [00:03<00:01, 21.87it/s, loss=0.697, v_num=1, val_acc=0.757]
Epoch 85:  74%|███████▎  | 86/117 [00:03<00:01, 22.08it/s, loss=0.697, v_num=1, val_acc=0.757]
Epoch 85:  74%|███████▎  | 86/117 [00:03<00:01, 21.94it/s, loss=0.697, v_num=1, val_acc=0.757]
Epoch 85:  74%|███████▍  | 87/117 [00:03<00:01, 22.14it/s, loss=0.697, v_num=1, val_acc=0.757]
Epoch 85:  74%|███████▍  | 87/117 [00:03<00:01, 22.00it/s, loss=0.692, v_num=1, val_acc=0.757]
Epoch 85:  75%|███████▌  | 88/117 [00:03<00:01, 22.21it/s, loss=0.692, v_num=1, val_acc=0.757]
Epoch 85:  75%|███████▌  | 88/117 [00:03<00:01, 22.06it/s, loss=0.691, v_num=1, val_acc=0.757]
Epoch 85:  76%|███████▌  | 89/117 [00:03<00:01, 22.27it/s, loss=0.691, v_num=1, val_acc=0.757]
Epoch 85:  76%|███████▌  | 89/117 [00:04<00:01, 22.13it/s, loss=0.689, v_num=1, val_acc=0.757]
Epoch 85:  77%|███████▋  | 90/117 [00:04<00:01, 22.32it/s, loss=0.689, v_num=1, val_acc=0.757]
Epoch 85:  77%|███████▋  | 90/117 [00:04<00:01, 22.18it/s, loss=0.692, v_num=1, val_acc=0.757]
Epoch 85:  78%|███████▊  | 91/117 [00:04<00:01, 22.38it/s, loss=0.692, v_num=1, val_acc=0.757]
Epoch 85:  78%|███████▊  | 91/117 [00:04<00:01, 22.24it/s, loss=0.69, v_num=1, val_acc=0.757]
Epoch 85:  79%|███████▊  | 92/117 [00:04<00:01, 22.44it/s, loss=0.69, v_num=1, val_acc=0.757]
Epoch 85:  79%|███████▊  | 92/117 [00:04<00:01, 22.30it/s, loss=0.688, v_num=1, val_acc=0.757]
Epoch 85:  79%|███████▉  | 93/117 [00:04<00:01, 22.49it/s, loss=0.688, v_num=1, val_acc=0.757]
Epoch 85:  79%|███████▉  | 93/117 [00:04<00:01, 22.36it/s, loss=0.687, v_num=1, val_acc=0.757]
Epoch 85:  80%|████████  | 94/117 [00:04<00:01, 22.55it/s, loss=0.687, v_num=1, val_acc=0.757]
Epoch 85:  80%|████████  | 94/117 [00:04<00:01, 22.41it/s, loss=0.683, v_num=1, val_acc=0.757]
Epoch 85:  81%|████████  | 95/117 [00:04<00:00, 22.60it/s, loss=0.683, v_num=1, val_acc=0.757]
Epoch 85:  81%|████████  | 95/117 [00:04<00:00, 22.46it/s, loss=0.683, v_num=1, val_acc=0.757]
Epoch 85:  82%|████████▏ | 96/117 [00:04<00:00, 22.65it/s, loss=0.683, v_num=1, val_acc=0.757]
Epoch 85:  82%|████████▏ | 96/117 [00:04<00:00, 22.52it/s, loss=0.684, v_num=1, val_acc=0.757]
Epoch 85:  83%|████████▎ | 97/117 [00:04<00:00, 22.70it/s, loss=0.684, v_num=1, val_acc=0.757]
Epoch 85:  83%|████████▎ | 97/117 [00:04<00:00, 22.57it/s, loss=0.682, v_num=1, val_acc=0.757]

Validation: 0it [00:00, ?it/s]

Validation:   0%|          | 0/20 [00:00<?, ?it/s]

Validation DataLoader 0:   0%|          | 0/20 [00:00<?, ?it/s]

Validation DataLoader 0:   5%|▌         | 1/20 [00:00<00:00, 192.66it/s]
Epoch 85:  84%|████████▍ | 98/117 [00:05<00:00, 19.06it/s, loss=0.682, v_num=1, val_acc=0.757]

Validation DataLoader 0:  10%|█         | 2/20 [00:00<00:00, 56.09it/s]
Epoch 85:  85%|████████▍ | 99/117 [00:05<00:00, 19.14it/s, loss=0.682, v_num=1, val_acc=0.757]

Validation DataLoader 0:  15%|█▌        | 3/20 [00:00<00:00, 44.78it/s]
Epoch 85:  85%|████████▌ | 100/117 [00:05<00:00, 19.22it/s, loss=0.682, v_num=1, val_acc=0.757]

Validation DataLoader 0:  20%|██        | 4/20 [00:00<00:00, 40.60it/s]
Epoch 85:  86%|████████▋ | 101/117 [00:05<00:00, 19.30it/s, loss=0.682, v_num=1, val_acc=0.757]

Validation DataLoader 0:  25%|██▌       | 5/20 [00:00<00:00, 38.36it/s]
Epoch 85:  87%|████████▋ | 102/117 [00:05<00:00, 19.37it/s, loss=0.682, v_num=1, val_acc=0.757]

Validation DataLoader 0:  30%|███       | 6/20 [00:00<00:00, 37.09it/s]
Epoch 85:  88%|████████▊ | 103/117 [00:05<00:00, 19.44it/s, loss=0.682, v_num=1, val_acc=0.757]

Validation DataLoader 0:  35%|███▌      | 7/20 [00:00<00:00, 36.19it/s]
Epoch 85:  89%|████████▉ | 104/117 [00:05<00:00, 19.52it/s, loss=0.682, v_num=1, val_acc=0.757]

Validation DataLoader 0:  40%|████      | 8/20 [00:00<00:00, 35.53it/s]
Epoch 85:  90%|████████▉ | 105/117 [00:05<00:00, 19.59it/s, loss=0.682, v_num=1, val_acc=0.757]

Validation DataLoader 0:  45%|████▌     | 9/20 [00:00<00:00, 35.00it/s]
Epoch 85:  91%|█████████ | 106/117 [00:05<00:00, 19.66it/s, loss=0.682, v_num=1, val_acc=0.757]

Validation DataLoader 0:  50%|█████     | 10/20 [00:00<00:00, 34.67it/s]
Epoch 85:  91%|█████████▏| 107/117 [00:05<00:00, 19.73it/s, loss=0.682, v_num=1, val_acc=0.757]

Validation DataLoader 0:  55%|█████▌    | 11/20 [00:00<00:00, 34.38it/s]
Epoch 85:  92%|█████████▏| 108/117 [00:05<00:00, 19.80it/s, loss=0.682, v_num=1, val_acc=0.757]

Validation DataLoader 0:  60%|██████    | 12/20 [00:00<00:00, 34.13it/s]
Epoch 85:  93%|█████████▎| 109/117 [00:05<00:00, 19.86it/s, loss=0.682, v_num=1, val_acc=0.757]

Validation DataLoader 0:  65%|██████▌   | 13/20 [00:00<00:00, 33.93it/s]
Epoch 85:  94%|█████████▍| 110/117 [00:05<00:00, 19.93it/s, loss=0.682, v_num=1, val_acc=0.757]

Validation DataLoader 0:  70%|███████   | 14/20 [00:00<00:00, 33.75it/s]
Epoch 85:  95%|█████████▍| 111/117 [00:05<00:00, 20.00it/s, loss=0.682, v_num=1, val_acc=0.757]

Validation DataLoader 0:  75%|███████▌  | 15/20 [00:00<00:00, 33.61it/s]
Epoch 85:  96%|█████████▌| 112/117 [00:05<00:00, 20.06it/s, loss=0.682, v_num=1, val_acc=0.757]

Validation DataLoader 0:  80%|████████  | 16/20 [00:00<00:00, 33.46it/s]
Epoch 85:  97%|█████████▋| 113/117 [00:05<00:00, 20.13it/s, loss=0.682, v_num=1, val_acc=0.757]

Validation DataLoader 0:  85%|████████▌ | 17/20 [00:00<00:00, 33.34it/s]
Epoch 85:  97%|█████████▋| 114/117 [00:05<00:00, 20.19it/s, loss=0.682, v_num=1, val_acc=0.757]

Validation DataLoader 0:  90%|█████████ | 18/20 [00:00<00:00, 33.24it/s]
Epoch 85:  98%|█████████▊| 115/117 [00:05<00:00, 20.26it/s, loss=0.682, v_num=1, val_acc=0.757]

Validation DataLoader 0:  95%|█████████▌| 19/20 [00:00<00:00, 33.16it/s]
Epoch 85:  99%|█████████▉| 116/117 [00:05<00:00, 20.32it/s, loss=0.682, v_num=1, val_acc=0.757]

Validation DataLoader 0: 100%|██████████| 20/20 [00:00<00:00, 33.15it/s]
Epoch 85: 100%|██████████| 117/117 [00:05<00:00, 20.39it/s, loss=0.682, v_num=1, val_acc=0.757]
Epoch 85: 100%|██████████| 117/117 [00:05<00:00, 20.32it/s, loss=0.682, v_num=1, val_acc=0.755]


Epoch 85: 100%|██████████| 117/117 [00:05<00:00, 20.31it/s, loss=0.682, v_num=1, val_acc=0.755]
Epoch 85:   0%|          | 0/117 [00:00<?, ?it/s, loss=0.682, v_num=1, val_acc=0.755]
Epoch 86:   0%|          | 0/117 [00:00<?, ?it/s, loss=0.682, v_num=1, val_acc=0.755]
Epoch 86:   1%|          | 1/117 [00:00<01:45,  1.10it/s, loss=0.682, v_num=1, val_acc=0.755]
Epoch 86:   1%|          | 1/117 [00:00<01:48,  1.07it/s, loss=0.683, v_num=1, val_acc=0.755]
Epoch 86:   2%|▏         | 2/117 [00:00<00:54,  2.12it/s, loss=0.683, v_num=1, val_acc=0.755]
Epoch 86:   2%|▏         | 2/117 [00:00<00:55,  2.07it/s, loss=0.683, v_num=1, val_acc=0.755]
Epoch 86:   3%|▎         | 3/117 [00:00<00:37,  3.06it/s, loss=0.683, v_num=1, val_acc=0.755]
Epoch 86:   3%|▎         | 3/117 [00:01<00:38,  2.98it/s, loss=0.685, v_num=1, val_acc=0.755]
Epoch 86:   3%|▎         | 4/117 [00:01<00:28,  3.94it/s, loss=0.685, v_num=1, val_acc=0.755]
Epoch 86:   3%|▎         | 4/117 [00:01<00:29,  3.85it/s, loss=0.682, v_num=1, val_acc=0.755]
Epoch 86:   4%|▍         | 5/117 [00:01<00:23,  4.77it/s, loss=0.682, v_num=1, val_acc=0.755]
Epoch 86:   4%|▍         | 5/117 [00:01<00:24,  4.66it/s, loss=0.682, v_num=1, val_acc=0.755]
Epoch 86:   5%|▌         | 6/117 [00:01<00:20,  5.55it/s, loss=0.682, v_num=1, val_acc=0.755]
Epoch 86:   5%|▌         | 6/117 [00:01<00:20,  5.42it/s, loss=0.68, v_num=1, val_acc=0.755]
Epoch 86:   6%|▌         | 7/117 [00:01<00:17,  6.28it/s, loss=0.68, v_num=1, val_acc=0.755]
Epoch 86:   6%|▌         | 7/117 [00:01<00:17,  6.14it/s, loss=0.685, v_num=1, val_acc=0.755]
Epoch 86:   7%|▋         | 8/117 [00:01<00:15,  6.96it/s, loss=0.685, v_num=1, val_acc=0.755]
Epoch 86:   7%|▋         | 8/117 [00:01<00:16,  6.81it/s, loss=0.687, v_num=1, val_acc=0.755]
Epoch 86:   8%|▊         | 9/117 [00:01<00:14,  7.54it/s, loss=0.687, v_num=1, val_acc=0.755]
Epoch 86:   8%|▊         | 9/117 [00:01<00:14,  7.39it/s, loss=0.69, v_num=1, val_acc=0.755]
Epoch 86:   9%|▊         | 10/117 [00:01<00:13,  8.16it/s, loss=0.69, v_num=1, val_acc=0.755]
Epoch 86:   9%|▊         | 10/117 [00:01<00:13,  7.99it/s, loss=0.693, v_num=1, val_acc=0.755]
Epoch 86:   9%|▉         | 11/117 [00:01<00:12,  8.73it/s, loss=0.693, v_num=1, val_acc=0.755]
Epoch 86:   9%|▉         | 11/117 [00:01<00:12,  8.56it/s, loss=0.696, v_num=1, val_acc=0.755]
Epoch 86:  10%|█         | 12/117 [00:01<00:11,  9.28it/s, loss=0.696, v_num=1, val_acc=0.755]
Epoch 86:  10%|█         | 12/117 [00:01<00:11,  9.10it/s, loss=0.701, v_num=1, val_acc=0.755]
Epoch 86:  11%|█         | 13/117 [00:01<00:10,  9.80it/s, loss=0.701, v_num=1, val_acc=0.755]
Epoch 86:  11%|█         | 13/117 [00:01<00:10,  9.61it/s, loss=0.698, v_num=1, val_acc=0.755]
Epoch 86:  12%|█▏        | 14/117 [00:01<00:10, 10.29it/s, loss=0.698, v_num=1, val_acc=0.755]
Epoch 86:  12%|█▏        | 14/117 [00:01<00:10, 10.10it/s, loss=0.697, v_num=1, val_acc=0.755]
Epoch 86:  13%|█▎        | 15/117 [00:01<00:09, 10.76it/s, loss=0.697, v_num=1, val_acc=0.755]
Epoch 86:  13%|█▎        | 15/117 [00:01<00:09, 10.56it/s, loss=0.695, v_num=1, val_acc=0.755]
Epoch 86:  14%|█▎        | 16/117 [00:01<00:09, 11.20it/s, loss=0.695, v_num=1, val_acc=0.755]
Epoch 86:  14%|█▎        | 16/117 [00:01<00:09, 11.01it/s, loss=0.699, v_num=1, val_acc=0.755]
Epoch 86:  15%|█▍        | 17/117 [00:01<00:08, 11.60it/s, loss=0.699, v_num=1, val_acc=0.755]
Epoch 86:  15%|█▍        | 17/117 [00:01<00:08, 11.40it/s, loss=0.702, v_num=1, val_acc=0.755]
Epoch 86:  15%|█▌        | 18/117 [00:01<00:08, 12.00it/s, loss=0.702, v_num=1, val_acc=0.755]
Epoch 86:  15%|█▌        | 18/117 [00:01<00:08, 11.80it/s, loss=0.701, v_num=1, val_acc=0.755]
Epoch 86:  16%|█▌        | 19/117 [00:01<00:07, 12.39it/s, loss=0.701, v_num=1, val_acc=0.755]
Epoch 86:  16%|█▌        | 19/117 [00:01<00:08, 12.19it/s, loss=0.695, v_num=1, val_acc=0.755]
Epoch 86:  17%|█▋        | 20/117 [00:01<00:07, 12.76it/s, loss=0.695, v_num=1, val_acc=0.755]
Epoch 86:  17%|█▋        | 20/117 [00:01<00:07, 12.56it/s, loss=0.694, v_num=1, val_acc=0.755]
Epoch 86:  18%|█▊        | 21/117 [00:01<00:07, 13.12it/s, loss=0.694, v_num=1, val_acc=0.755]
Epoch 86:  18%|█▊        | 21/117 [00:01<00:07, 12.91it/s, loss=0.696, v_num=1, val_acc=0.755]
Epoch 86:  19%|█▉        | 22/117 [00:01<00:07, 13.45it/s, loss=0.696, v_num=1, val_acc=0.755]
Epoch 86:  19%|█▉        | 22/117 [00:01<00:07, 13.25it/s, loss=0.695, v_num=1, val_acc=0.755]
Epoch 86:  20%|█▉        | 23/117 [00:01<00:06, 13.77it/s, loss=0.695, v_num=1, val_acc=0.755]
Epoch 86:  20%|█▉        | 23/117 [00:01<00:06, 13.57it/s, loss=0.693, v_num=1, val_acc=0.755]
Epoch 86:  21%|██        | 24/117 [00:01<00:06, 14.08it/s, loss=0.693, v_num=1, val_acc=0.755]
Epoch 86:  21%|██        | 24/117 [00:01<00:06, 13.88it/s, loss=0.698, v_num=1, val_acc=0.755]
Epoch 86:  21%|██▏       | 25/117 [00:01<00:06, 14.36it/s, loss=0.698, v_num=1, val_acc=0.755]
Epoch 86:  21%|██▏       | 25/117 [00:01<00:06, 14.16it/s, loss=0.696, v_num=1, val_acc=0.755]
Epoch 86:  22%|██▏       | 26/117 [00:01<00:06, 14.65it/s, loss=0.696, v_num=1, val_acc=0.755]
Epoch 86:  22%|██▏       | 26/117 [00:01<00:06, 14.45it/s, loss=0.7, v_num=1, val_acc=0.755]
Epoch 86:  23%|██▎       | 27/117 [00:01<00:06, 14.93it/s, loss=0.7, v_num=1, val_acc=0.755]
Epoch 86:  23%|██▎       | 27/117 [00:01<00:06, 14.73it/s, loss=0.698, v_num=1, val_acc=0.755]
Epoch 86:  24%|██▍       | 28/117 [00:01<00:05, 15.20it/s, loss=0.698, v_num=1, val_acc=0.755]
Epoch 86:  24%|██▍       | 28/117 [00:01<00:05, 14.99it/s, loss=0.699, v_num=1, val_acc=0.755]
Epoch 86:  25%|██▍       | 29/117 [00:01<00:05, 15.42it/s, loss=0.699, v_num=1, val_acc=0.755]
Epoch 86:  25%|██▍       | 29/117 [00:01<00:05, 15.23it/s, loss=0.694, v_num=1, val_acc=0.755]
Epoch 86:  26%|██▌       | 30/117 [00:01<00:05, 15.68it/s, loss=0.694, v_num=1, val_acc=0.755]
Epoch 86:  26%|██▌       | 30/117 [00:01<00:05, 15.47it/s, loss=0.691, v_num=1, val_acc=0.755]
Epoch 86:  26%|██▋       | 31/117 [00:01<00:05, 15.91it/s, loss=0.691, v_num=1, val_acc=0.755]
Epoch 86:  26%|██▋       | 31/117 [00:01<00:05, 15.70it/s, loss=0.688, v_num=1, val_acc=0.755]
Epoch 86:  27%|██▋       | 32/117 [00:01<00:05, 16.14it/s, loss=0.688, v_num=1, val_acc=0.755]
Epoch 86:  27%|██▋       | 32/117 [00:02<00:05, 15.93it/s, loss=0.689, v_num=1, val_acc=0.755]
Epoch 86:  28%|██▊       | 33/117 [00:02<00:05, 16.34it/s, loss=0.689, v_num=1, val_acc=0.755]
Epoch 86:  28%|██▊       | 33/117 [00:02<00:05, 16.14it/s, loss=0.69, v_num=1, val_acc=0.755]
Epoch 86:  29%|██▉       | 34/117 [00:02<00:05, 16.56it/s, loss=0.69, v_num=1, val_acc=0.755]
Epoch 86:  29%|██▉       | 34/117 [00:02<00:05, 16.36it/s, loss=0.692, v_num=1, val_acc=0.755]
Epoch 86:  30%|██▉       | 35/117 [00:02<00:04, 16.78it/s, loss=0.692, v_num=1, val_acc=0.755]
Epoch 86:  30%|██▉       | 35/117 [00:02<00:04, 16.57it/s, loss=0.691, v_num=1, val_acc=0.755]
Epoch 86:  31%|███       | 36/117 [00:02<00:04, 16.97it/s, loss=0.691, v_num=1, val_acc=0.755]
Epoch 86:  31%|███       | 36/117 [00:02<00:04, 16.77it/s, loss=0.688, v_num=1, val_acc=0.755]
Epoch 86:  32%|███▏      | 37/117 [00:02<00:04, 17.16it/s, loss=0.688, v_num=1, val_acc=0.755]
Epoch 86:  32%|███▏      | 37/117 [00:02<00:04, 16.97it/s, loss=0.69, v_num=1, val_acc=0.755]
Epoch 86:  32%|███▏      | 38/117 [00:02<00:04, 17.35it/s, loss=0.69, v_num=1, val_acc=0.755]
Epoch 86:  32%|███▏      | 38/117 [00:02<00:04, 17.15it/s, loss=0.692, v_num=1, val_acc=0.755]
Epoch 86:  33%|███▎      | 39/117 [00:02<00:04, 17.53it/s, loss=0.692, v_num=1, val_acc=0.755]
Epoch 86:  33%|███▎      | 39/117 [00:02<00:04, 17.34it/s, loss=0.695, v_num=1, val_acc=0.755]
Epoch 86:  34%|███▍      | 40/117 [00:02<00:04, 17.71it/s, loss=0.695, v_num=1, val_acc=0.755]
Epoch 86:  34%|███▍      | 40/117 [00:02<00:04, 17.51it/s, loss=0.7, v_num=1, val_acc=0.755]
Epoch 86:  35%|███▌      | 41/117 [00:02<00:04, 17.87it/s, loss=0.7, v_num=1, val_acc=0.755]
Epoch 86:  35%|███▌      | 41/117 [00:02<00:04, 17.68it/s, loss=0.698, v_num=1, val_acc=0.755]
Epoch 86:  36%|███▌      | 42/117 [00:02<00:04, 18.05it/s, loss=0.698, v_num=1, val_acc=0.755]
Epoch 86:  36%|███▌      | 42/117 [00:02<00:04, 17.85it/s, loss=0.698, v_num=1, val_acc=0.755]
Epoch 86:  37%|███▋      | 43/117 [00:02<00:04, 18.21it/s, loss=0.698, v_num=1, val_acc=0.755]
Epoch 86:  37%|███▋      | 43/117 [00:02<00:04, 18.01it/s, loss=0.696, v_num=1, val_acc=0.755]
Epoch 86:  38%|███▊      | 44/117 [00:02<00:03, 18.36it/s, loss=0.696, v_num=1, val_acc=0.755]
Epoch 86:  38%|███▊      | 44/117 [00:02<00:04, 18.17it/s, loss=0.695, v_num=1, val_acc=0.755]
Epoch 86:  38%|███▊      | 45/117 [00:02<00:03, 18.51it/s, loss=0.695, v_num=1, val_acc=0.755]
Epoch 86:  38%|███▊      | 45/117 [00:02<00:03, 18.32it/s, loss=0.692, v_num=1, val_acc=0.755]
Epoch 86:  39%|███▉      | 46/117 [00:02<00:03, 18.66it/s, loss=0.692, v_num=1, val_acc=0.755]
Epoch 86:  39%|███▉      | 46/117 [00:02<00:03, 18.47it/s, loss=0.694, v_num=1, val_acc=0.755]
Epoch 86:  40%|████      | 47/117 [00:02<00:03, 18.80it/s, loss=0.694, v_num=1, val_acc=0.755]
Epoch 86:  40%|████      | 47/117 [00:02<00:03, 18.61it/s, loss=0.696, v_num=1, val_acc=0.755]
Epoch 86:  41%|████      | 48/117 [00:02<00:03, 18.94it/s, loss=0.696, v_num=1, val_acc=0.755]
Epoch 86:  41%|████      | 48/117 [00:02<00:03, 18.75it/s, loss=0.695, v_num=1, val_acc=0.755]
Epoch 86:  42%|████▏     | 49/117 [00:02<00:03, 19.08it/s, loss=0.695, v_num=1, val_acc=0.755]
Epoch 86:  42%|████▏     | 49/117 [00:02<00:03, 18.89it/s, loss=0.698, v_num=1, val_acc=0.755]
Epoch 86:  43%|████▎     | 50/117 [00:02<00:03, 19.21it/s, loss=0.698, v_num=1, val_acc=0.755]
Epoch 86:  43%|████▎     | 50/117 [00:02<00:03, 19.02it/s, loss=0.704, v_num=1, val_acc=0.755]
Epoch 86:  44%|████▎     | 51/117 [00:02<00:03, 19.34it/s, loss=0.704, v_num=1, val_acc=0.755]
Epoch 86:  44%|████▎     | 51/117 [00:02<00:03, 19.15it/s, loss=0.706, v_num=1, val_acc=0.755]
Epoch 86:  44%|████▍     | 52/117 [00:02<00:03, 19.46it/s, loss=0.706, v_num=1, val_acc=0.755]
Epoch 86:  44%|████▍     | 52/117 [00:02<00:03, 19.28it/s, loss=0.699, v_num=1, val_acc=0.755]
Epoch 86:  45%|████▌     | 53/117 [00:02<00:03, 19.59it/s, loss=0.699, v_num=1, val_acc=0.755]
Epoch 86:  45%|████▌     | 53/117 [00:02<00:03, 19.40it/s, loss=0.697, v_num=1, val_acc=0.755]
Epoch 86:  46%|████▌     | 54/117 [00:02<00:03, 19.70it/s, loss=0.697, v_num=1, val_acc=0.755]
Epoch 86:  46%|████▌     | 54/117 [00:02<00:03, 19.52it/s, loss=0.695, v_num=1, val_acc=0.755]
Epoch 86:  47%|████▋     | 55/117 [00:02<00:03, 19.82it/s, loss=0.695, v_num=1, val_acc=0.755]
Epoch 86:  47%|████▋     | 55/117 [00:02<00:03, 19.64it/s, loss=0.693, v_num=1, val_acc=0.755]
Epoch 86:  48%|████▊     | 56/117 [00:02<00:03, 19.86it/s, loss=0.693, v_num=1, val_acc=0.755]
Epoch 86:  48%|████▊     | 56/117 [00:02<00:03, 19.70it/s, loss=0.694, v_num=1, val_acc=0.755]
Epoch 86:  49%|████▊     | 57/117 [00:02<00:03, 19.98it/s, loss=0.694, v_num=1, val_acc=0.755]
Epoch 86:  49%|████▊     | 57/117 [00:02<00:03, 19.81it/s, loss=0.693, v_num=1, val_acc=0.755]
Epoch 86:  50%|████▉     | 58/117 [00:02<00:02, 20.08it/s, loss=0.693, v_num=1, val_acc=0.755]
Epoch 86:  50%|████▉     | 58/117 [00:02<00:02, 19.91it/s, loss=0.686, v_num=1, val_acc=0.755]
Epoch 86:  50%|█████     | 59/117 [00:02<00:02, 20.19it/s, loss=0.686, v_num=1, val_acc=0.755]
Epoch 86:  50%|█████     | 59/117 [00:02<00:02, 20.01it/s, loss=0.684, v_num=1, val_acc=0.755]
Epoch 86:  51%|█████▏    | 60/117 [00:02<00:02, 20.28it/s, loss=0.684, v_num=1, val_acc=0.755]
Epoch 86:  51%|█████▏    | 60/117 [00:02<00:02, 20.12it/s, loss=0.685, v_num=1, val_acc=0.755]
Epoch 86:  52%|█████▏    | 61/117 [00:02<00:02, 20.39it/s, loss=0.685, v_num=1, val_acc=0.755]
Epoch 86:  52%|█████▏    | 61/117 [00:03<00:02, 20.22it/s, loss=0.686, v_num=1, val_acc=0.755]
Epoch 86:  53%|█████▎    | 62/117 [00:03<00:02, 20.48it/s, loss=0.686, v_num=1, val_acc=0.755]
Epoch 86:  53%|█████▎    | 62/117 [00:03<00:02, 20.32it/s, loss=0.684, v_num=1, val_acc=0.755]
Epoch 86:  54%|█████▍    | 63/117 [00:03<00:02, 20.57it/s, loss=0.684, v_num=1, val_acc=0.755]
Epoch 86:  54%|█████▍    | 63/117 [00:03<00:02, 20.41it/s, loss=0.687, v_num=1, val_acc=0.755]
Epoch 86:  55%|█████▍    | 64/117 [00:03<00:02, 20.66it/s, loss=0.687, v_num=1, val_acc=0.755]
Epoch 86:  55%|█████▍    | 64/117 [00:03<00:02, 20.50it/s, loss=0.682, v_num=1, val_acc=0.755]
Epoch 86:  56%|█████▌    | 65/117 [00:03<00:02, 20.75it/s, loss=0.682, v_num=1, val_acc=0.755]
Epoch 86:  56%|█████▌    | 65/117 [00:03<00:02, 20.59it/s, loss=0.686, v_num=1, val_acc=0.755]
Epoch 86:  56%|█████▋    | 66/117 [00:03<00:02, 20.83it/s, loss=0.686, v_num=1, val_acc=0.755]
Epoch 86:  56%|█████▋    | 66/117 [00:03<00:02, 20.67it/s, loss=0.683, v_num=1, val_acc=0.755]
Epoch 86:  57%|█████▋    | 67/117 [00:03<00:02, 20.93it/s, loss=0.683, v_num=1, val_acc=0.755]
Epoch 86:  57%|█████▋    | 67/117 [00:03<00:02, 20.76it/s, loss=0.685, v_num=1, val_acc=0.755]
Epoch 86:  58%|█████▊    | 68/117 [00:03<00:02, 21.01it/s, loss=0.685, v_num=1, val_acc=0.755]
Epoch 86:  58%|█████▊    | 68/117 [00:03<00:02, 20.85it/s, loss=0.685, v_num=1, val_acc=0.755]
Epoch 86:  59%|█████▉    | 69/117 [00:03<00:02, 21.09it/s, loss=0.685, v_num=1, val_acc=0.755]
Epoch 86:  59%|█████▉    | 69/117 [00:03<00:02, 20.93it/s, loss=0.69, v_num=1, val_acc=0.755]
Epoch 86:  60%|█████▉    | 70/117 [00:03<00:02, 21.18it/s, loss=0.69, v_num=1, val_acc=0.755]
Epoch 86:  60%|█████▉    | 70/117 [00:03<00:02, 21.02it/s, loss=0.688, v_num=1, val_acc=0.755]
Epoch 86:  61%|██████    | 71/117 [00:03<00:02, 21.26it/s, loss=0.688, v_num=1, val_acc=0.755]
Epoch 86:  61%|██████    | 71/117 [00:03<00:02, 21.10it/s, loss=0.689, v_num=1, val_acc=0.755]
Epoch 86:  62%|██████▏   | 72/117 [00:03<00:02, 21.34it/s, loss=0.689, v_num=1, val_acc=0.755]
Epoch 86:  62%|██████▏   | 72/117 [00:03<00:02, 21.18it/s, loss=0.694, v_num=1, val_acc=0.755]
Epoch 86:  62%|██████▏   | 73/117 [00:03<00:02, 21.41it/s, loss=0.694, v_num=1, val_acc=0.755]
Epoch 86:  62%|██████▏   | 73/117 [00:03<00:02, 21.25it/s, loss=0.697, v_num=1, val_acc=0.755]
Epoch 86:  63%|██████▎   | 74/117 [00:03<00:02, 21.48it/s, loss=0.697, v_num=1, val_acc=0.755]
Epoch 86:  63%|██████▎   | 74/117 [00:03<00:02, 21.33it/s, loss=0.693, v_num=1, val_acc=0.755]
Epoch 86:  64%|██████▍   | 75/117 [00:03<00:01, 21.56it/s, loss=0.693, v_num=1, val_acc=0.755]
Epoch 86:  64%|██████▍   | 75/117 [00:03<00:01, 21.40it/s, loss=0.695, v_num=1, val_acc=0.755]
Epoch 86:  65%|██████▍   | 76/117 [00:03<00:01, 21.63it/s, loss=0.695, v_num=1, val_acc=0.755]
Epoch 86:  65%|██████▍   | 76/117 [00:03<00:01, 21.48it/s, loss=0.69, v_num=1, val_acc=0.755]
Epoch 86:  66%|██████▌   | 77/117 [00:03<00:01, 21.70it/s, loss=0.69, v_num=1, val_acc=0.755]
Epoch 86:  66%|██████▌   | 77/117 [00:03<00:01, 21.55it/s, loss=0.687, v_num=1, val_acc=0.755]
Epoch 86:  67%|██████▋   | 78/117 [00:03<00:01, 21.77it/s, loss=0.687, v_num=1, val_acc=0.755]
Epoch 86:  67%|██████▋   | 78/117 [00:03<00:01, 21.62it/s, loss=0.69, v_num=1, val_acc=0.755]
Epoch 86:  68%|██████▊   | 79/117 [00:03<00:01, 21.84it/s, loss=0.69, v_num=1, val_acc=0.755]
Epoch 86:  68%|██████▊   | 79/117 [00:03<00:01, 21.69it/s, loss=0.686, v_num=1, val_acc=0.755]
Epoch 86:  68%|██████▊   | 80/117 [00:03<00:01, 21.91it/s, loss=0.686, v_num=1, val_acc=0.755]
Epoch 86:  68%|██████▊   | 80/117 [00:03<00:01, 21.76it/s, loss=0.683, v_num=1, val_acc=0.755]
Epoch 86:  69%|██████▉   | 81/117 [00:03<00:01, 21.98it/s, loss=0.683, v_num=1, val_acc=0.755]
Epoch 86:  69%|██████▉   | 81/117 [00:03<00:01, 21.83it/s, loss=0.686, v_num=1, val_acc=0.755]
Epoch 86:  70%|███████   | 82/117 [00:03<00:01, 22.03it/s, loss=0.686, v_num=1, val_acc=0.755]
Epoch 86:  70%|███████   | 82/117 [00:03<00:01, 21.88it/s, loss=0.688, v_num=1, val_acc=0.755]
Epoch 86:  71%|███████   | 83/117 [00:03<00:01, 22.10it/s, loss=0.688, v_num=1, val_acc=0.755]
Epoch 86:  71%|███████   | 83/117 [00:03<00:01, 21.95it/s, loss=0.688, v_num=1, val_acc=0.755]
Epoch 86:  72%|███████▏  | 84/117 [00:03<00:01, 22.16it/s, loss=0.688, v_num=1, val_acc=0.755]
Epoch 86:  72%|███████▏  | 84/117 [00:03<00:01, 22.01it/s, loss=0.687, v_num=1, val_acc=0.755]
Epoch 86:  73%|███████▎  | 85/117 [00:03<00:01, 22.22it/s, loss=0.687, v_num=1, val_acc=0.755]
Epoch 86:  73%|███████▎  | 85/117 [00:03<00:01, 22.08it/s, loss=0.691, v_num=1, val_acc=0.755]
Epoch 86:  74%|███████▎  | 86/117 [00:03<00:01, 22.28it/s, loss=0.691, v_num=1, val_acc=0.755]
Epoch 86:  74%|███████▎  | 86/117 [00:03<00:01, 22.14it/s, loss=0.692, v_num=1, val_acc=0.755]
Epoch 86:  74%|███████▍  | 87/117 [00:03<00:01, 22.35it/s, loss=0.692, v_num=1, val_acc=0.755]
Epoch 86:  74%|███████▍  | 87/117 [00:03<00:01, 22.20it/s, loss=0.688, v_num=1, val_acc=0.755]
Epoch 86:  75%|███████▌  | 88/117 [00:03<00:01, 22.41it/s, loss=0.688, v_num=1, val_acc=0.755]
Epoch 86:  75%|███████▌  | 88/117 [00:03<00:01, 22.26it/s, loss=0.689, v_num=1, val_acc=0.755]
Epoch 86:  76%|███████▌  | 89/117 [00:03<00:01, 22.47it/s, loss=0.689, v_num=1, val_acc=0.755]
Epoch 86:  76%|███████▌  | 89/117 [00:03<00:01, 22.32it/s, loss=0.682, v_num=1, val_acc=0.755]
Epoch 86:  77%|███████▋  | 90/117 [00:03<00:01, 22.52it/s, loss=0.682, v_num=1, val_acc=0.755]
Epoch 86:  77%|███████▋  | 90/117 [00:04<00:01, 22.38it/s, loss=0.677, v_num=1, val_acc=0.755]
Epoch 86:  78%|███████▊  | 91/117 [00:04<00:01, 22.58it/s, loss=0.677, v_num=1, val_acc=0.755]
Epoch 86:  78%|███████▊  | 91/117 [00:04<00:01, 22.44it/s, loss=0.672, v_num=1, val_acc=0.755]
Epoch 86:  79%|███████▊  | 92/117 [00:04<00:01, 22.63it/s, loss=0.672, v_num=1, val_acc=0.755]
Epoch 86:  79%|███████▊  | 92/117 [00:04<00:01, 22.49it/s, loss=0.669, v_num=1, val_acc=0.755]
Epoch 86:  79%|███████▉  | 93/117 [00:04<00:01, 22.69it/s, loss=0.669, v_num=1, val_acc=0.755]
Epoch 86:  79%|███████▉  | 93/117 [00:04<00:01, 22.55it/s, loss=0.672, v_num=1, val_acc=0.755]
Epoch 86:  80%|████████  | 94/117 [00:04<00:01, 22.74it/s, loss=0.672, v_num=1, val_acc=0.755]
Epoch 86:  80%|████████  | 94/117 [00:04<00:01, 22.60it/s, loss=0.675, v_num=1, val_acc=0.755]
Epoch 86:  81%|████████  | 95/117 [00:04<00:00, 22.79it/s, loss=0.675, v_num=1, val_acc=0.755]
Epoch 86:  81%|████████  | 95/117 [00:04<00:00, 22.65it/s, loss=0.668, v_num=1, val_acc=0.755]
Epoch 86:  82%|████████▏ | 96/117 [00:04<00:00, 22.84it/s, loss=0.668, v_num=1, val_acc=0.755]
Epoch 86:  82%|████████▏ | 96/117 [00:04<00:00, 22.71it/s, loss=0.674, v_num=1, val_acc=0.755]
Epoch 86:  83%|████████▎ | 97/117 [00:04<00:00, 22.89it/s, loss=0.674, v_num=1, val_acc=0.755]
Epoch 86:  83%|████████▎ | 97/117 [00:04<00:00, 22.76it/s, loss=0.673, v_num=1, val_acc=0.755]

Validation: 0it [00:00, ?it/s]

Validation:   0%|          | 0/20 [00:00<?, ?it/s]

Validation DataLoader 0:   0%|          | 0/20 [00:00<?, ?it/s]

Validation DataLoader 0:   5%|▌         | 1/20 [00:00<00:00, 163.16it/s]
Epoch 86:  84%|████████▍ | 98/117 [00:05<00:00, 19.15it/s, loss=0.673, v_num=1, val_acc=0.755]

Validation DataLoader 0:  10%|█         | 2/20 [00:00<00:00, 52.79it/s]
Epoch 86:  85%|████████▍ | 99/117 [00:05<00:00, 19.23it/s, loss=0.673, v_num=1, val_acc=0.755]

Validation DataLoader 0:  15%|█▌        | 3/20 [00:00<00:00, 43.51it/s]
Epoch 86:  85%|████████▌ | 100/117 [00:05<00:00, 19.31it/s, loss=0.673, v_num=1, val_acc=0.755]

Validation DataLoader 0:  20%|██        | 4/20 [00:00<00:00, 39.71it/s]
Epoch 86:  86%|████████▋ | 101/117 [00:05<00:00, 19.38it/s, loss=0.673, v_num=1, val_acc=0.755]

Validation DataLoader 0:  25%|██▌       | 5/20 [00:00<00:00, 37.56it/s]
Epoch 86:  87%|████████▋ | 102/117 [00:05<00:00, 19.45it/s, loss=0.673, v_num=1, val_acc=0.755]

Validation DataLoader 0:  30%|███       | 6/20 [00:00<00:00, 36.57it/s]
Epoch 86:  88%|████████▊ | 103/117 [00:05<00:00, 19.53it/s, loss=0.673, v_num=1, val_acc=0.755]

Validation DataLoader 0:  35%|███▌      | 7/20 [00:00<00:00, 35.77it/s]
Epoch 86:  89%|████████▉ | 104/117 [00:05<00:00, 19.60it/s, loss=0.673, v_num=1, val_acc=0.755]

Validation DataLoader 0:  40%|████      | 8/20 [00:00<00:00, 35.18it/s]
Epoch 86:  90%|████████▉ | 105/117 [00:05<00:00, 19.67it/s, loss=0.673, v_num=1, val_acc=0.755]

Validation DataLoader 0:  45%|████▌     | 9/20 [00:00<00:00, 34.60it/s]
Epoch 86:  91%|█████████ | 106/117 [00:05<00:00, 19.74it/s, loss=0.673, v_num=1, val_acc=0.755]

Validation DataLoader 0:  50%|█████     | 10/20 [00:00<00:00, 34.35it/s]
Epoch 86:  91%|█████████▏| 107/117 [00:05<00:00, 19.81it/s, loss=0.673, v_num=1, val_acc=0.755]

Validation DataLoader 0:  55%|█████▌    | 11/20 [00:00<00:00, 34.09it/s]
Epoch 86:  92%|█████████▏| 108/117 [00:05<00:00, 19.88it/s, loss=0.673, v_num=1, val_acc=0.755]

Validation DataLoader 0:  60%|██████    | 12/20 [00:00<00:00, 33.89it/s]
Epoch 86:  93%|█████████▎| 109/117 [00:05<00:00, 19.95it/s, loss=0.673, v_num=1, val_acc=0.755]

Validation DataLoader 0:  65%|██████▌   | 13/20 [00:00<00:00, 33.69it/s]
Epoch 86:  94%|█████████▍| 110/117 [00:05<00:00, 20.01it/s, loss=0.673, v_num=1, val_acc=0.755]

Validation DataLoader 0:  70%|███████   | 14/20 [00:00<00:00, 33.53it/s]
Epoch 86:  95%|█████████▍| 111/117 [00:05<00:00, 20.08it/s, loss=0.673, v_num=1, val_acc=0.755]

Validation DataLoader 0:  75%|███████▌  | 15/20 [00:00<00:00, 33.41it/s]
Epoch 86:  96%|█████████▌| 112/117 [00:05<00:00, 20.15it/s, loss=0.673, v_num=1, val_acc=0.755]

Validation DataLoader 0:  80%|████████  | 16/20 [00:00<00:00, 33.27it/s]
Epoch 86:  97%|█████████▋| 113/117 [00:05<00:00, 20.21it/s, loss=0.673, v_num=1, val_acc=0.755]

Validation DataLoader 0:  85%|████████▌ | 17/20 [00:00<00:00, 33.16it/s]
Epoch 86:  97%|█████████▋| 114/117 [00:05<00:00, 20.27it/s, loss=0.673, v_num=1, val_acc=0.755]

Validation DataLoader 0:  90%|█████████ | 18/20 [00:00<00:00, 33.06it/s]
Epoch 86:  98%|█████████▊| 115/117 [00:05<00:00, 20.34it/s, loss=0.673, v_num=1, val_acc=0.755]

Validation DataLoader 0:  95%|█████████▌| 19/20 [00:00<00:00, 32.99it/s]
Epoch 86:  99%|█████████▉| 116/117 [00:05<00:00, 20.40it/s, loss=0.673, v_num=1, val_acc=0.755]

Validation DataLoader 0: 100%|██████████| 20/20 [00:00<00:00, 32.99it/s]
Epoch 86: 100%|██████████| 117/117 [00:05<00:00, 20.47it/s, loss=0.673, v_num=1, val_acc=0.755]
Epoch 86: 100%|██████████| 117/117 [00:05<00:00, 20.39it/s, loss=0.673, v_num=1, val_acc=0.757]


Epoch 86: 100%|██████████| 117/117 [00:05<00:00, 20.39it/s, loss=0.673, v_num=1, val_acc=0.757]
Epoch 86:   0%|          | 0/117 [00:00<?, ?it/s, loss=0.673, v_num=1, val_acc=0.757]
Epoch 87:   0%|          | 0/117 [00:00<?, ?it/s, loss=0.673, v_num=1, val_acc=0.757]
Epoch 87:   1%|          | 1/117 [00:00<01:41,  1.14it/s, loss=0.673, v_num=1, val_acc=0.757]
Epoch 87:   1%|          | 1/117 [00:00<01:43,  1.12it/s, loss=0.675, v_num=1, val_acc=0.757]
Epoch 87:   2%|▏         | 2/117 [00:00<00:52,  2.20it/s, loss=0.675, v_num=1, val_acc=0.757]
Epoch 87:   2%|▏         | 2/117 [00:00<00:53,  2.14it/s, loss=0.675, v_num=1, val_acc=0.757]
Epoch 87:   3%|▎         | 3/117 [00:00<00:35,  3.19it/s, loss=0.675, v_num=1, val_acc=0.757]
Epoch 87:   3%|▎         | 3/117 [00:00<00:36,  3.10it/s, loss=0.674, v_num=1, val_acc=0.757]
Epoch 87:   3%|▎         | 4/117 [00:00<00:27,  4.09it/s, loss=0.674, v_num=1, val_acc=0.757]
Epoch 87:   3%|▎         | 4/117 [00:01<00:28,  3.99it/s, loss=0.666, v_num=1, val_acc=0.757]
Epoch 87:   4%|▍         | 5/117 [00:01<00:22,  4.93it/s, loss=0.666, v_num=1, val_acc=0.757]
Epoch 87:   4%|▍         | 5/117 [00:01<00:23,  4.81it/s, loss=0.664, v_num=1, val_acc=0.757]
Epoch 87:   5%|▌         | 6/117 [00:01<00:19,  5.72it/s, loss=0.664, v_num=1, val_acc=0.757]
Epoch 87:   5%|▌         | 6/117 [00:01<00:19,  5.59it/s, loss=0.665, v_num=1, val_acc=0.757]
Epoch 87:   6%|▌         | 7/117 [00:01<00:17,  6.47it/s, loss=0.665, v_num=1, val_acc=0.757]
Epoch 87:   6%|▌         | 7/117 [00:01<00:17,  6.32it/s, loss=0.664, v_num=1, val_acc=0.757]
Epoch 87:   7%|▋         | 8/117 [00:01<00:15,  7.17it/s, loss=0.664, v_num=1, val_acc=0.757]
Epoch 87:   7%|▋         | 8/117 [00:01<00:15,  7.01it/s, loss=0.659, v_num=1, val_acc=0.757]
Epoch 87:   8%|▊         | 9/117 [00:01<00:13,  7.76it/s, loss=0.659, v_num=1, val_acc=0.757]
Epoch 87:   8%|▊         | 9/117 [00:01<00:14,  7.61it/s, loss=0.661, v_num=1, val_acc=0.757]
Epoch 87:   9%|▊         | 10/117 [00:01<00:12,  8.39it/s, loss=0.661, v_num=1, val_acc=0.757]
Epoch 87:   9%|▊         | 10/117 [00:01<00:13,  8.22it/s, loss=0.659, v_num=1, val_acc=0.757]
Epoch 87:   9%|▉         | 11/117 [00:01<00:11,  8.98it/s, loss=0.659, v_num=1, val_acc=0.757]
Epoch 87:   9%|▉         | 11/117 [00:01<00:12,  8.79it/s, loss=0.657, v_num=1, val_acc=0.757]
Epoch 87:  10%|█         | 12/117 [00:01<00:11,  9.52it/s, loss=0.657, v_num=1, val_acc=0.757]
Epoch 87:  10%|█         | 12/117 [00:01<00:11,  9.33it/s, loss=0.665, v_num=1, val_acc=0.757]
Epoch 87:  11%|█         | 13/117 [00:01<00:10, 10.05it/s, loss=0.665, v_num=1, val_acc=0.757]
Epoch 87:  11%|█         | 13/117 [00:01<00:10,  9.85it/s, loss=0.669, v_num=1, val_acc=0.757]
Epoch 87:  12%|█▏        | 14/117 [00:01<00:09, 10.55it/s, loss=0.669, v_num=1, val_acc=0.757]
Epoch 87:  12%|█▏        | 14/117 [00:01<00:09, 10.35it/s, loss=0.673, v_num=1, val_acc=0.757]
Epoch 87:  13%|█▎        | 15/117 [00:01<00:09, 11.02it/s, loss=0.673, v_num=1, val_acc=0.757]
Epoch 87:  13%|█▎        | 15/117 [00:01<00:09, 10.82it/s, loss=0.675, v_num=1, val_acc=0.757]
Epoch 87:  14%|█▎        | 16/117 [00:01<00:08, 11.47it/s, loss=0.675, v_num=1, val_acc=0.757]
Epoch 87:  14%|█▎        | 16/117 [00:01<00:08, 11.26it/s, loss=0.666, v_num=1, val_acc=0.757]
Epoch 87:  15%|█▍        | 17/117 [00:01<00:08, 11.86it/s, loss=0.666, v_num=1, val_acc=0.757]
Epoch 87:  15%|█▍        | 17/117 [00:01<00:08, 11.65it/s, loss=0.668, v_num=1, val_acc=0.757]
Epoch 87:  15%|█▌        | 18/117 [00:01<00:08, 12.27it/s, loss=0.668, v_num=1, val_acc=0.757]
Epoch 87:  15%|█▌        | 18/117 [00:01<00:08, 12.06it/s, loss=0.672, v_num=1, val_acc=0.757]
Epoch 87:  16%|█▌        | 19/117 [00:01<00:07, 12.66it/s, loss=0.672, v_num=1, val_acc=0.757]
Epoch 87:  16%|█▌        | 19/117 [00:01<00:07, 12.45it/s, loss=0.671, v_num=1, val_acc=0.757]
Epoch 87:  17%|█▋        | 20/117 [00:01<00:07, 13.03it/s, loss=0.671, v_num=1, val_acc=0.757]
Epoch 87:  17%|█▋        | 20/117 [00:01<00:07, 12.82it/s, loss=0.677, v_num=1, val_acc=0.757]
Epoch 87:  18%|█▊        | 21/117 [00:01<00:07, 13.39it/s, loss=0.677, v_num=1, val_acc=0.757]
Epoch 87:  18%|█▊        | 21/117 [00:01<00:07, 13.17it/s, loss=0.679, v_num=1, val_acc=0.757]
Epoch 87:  19%|█▉        | 22/117 [00:01<00:06, 13.72it/s, loss=0.679, v_num=1, val_acc=0.757]
Epoch 87:  19%|█▉        | 22/117 [00:01<00:07, 13.51it/s, loss=0.679, v_num=1, val_acc=0.757]
Epoch 87:  20%|█▉        | 23/117 [00:01<00:06, 14.04it/s, loss=0.679, v_num=1, val_acc=0.757]
Epoch 87:  20%|█▉        | 23/117 [00:01<00:06, 13.83it/s, loss=0.68, v_num=1, val_acc=0.757]
Epoch 87:  21%|██        | 24/117 [00:01<00:06, 14.35it/s, loss=0.68, v_num=1, val_acc=0.757]
Epoch 87:  21%|██        | 24/117 [00:01<00:06, 14.13it/s, loss=0.683, v_num=1, val_acc=0.757]
Epoch 87:  21%|██▏       | 25/117 [00:01<00:06, 14.60it/s, loss=0.683, v_num=1, val_acc=0.757]
Epoch 87:  21%|██▏       | 25/117 [00:01<00:06, 14.39it/s, loss=0.684, v_num=1, val_acc=0.757]
Epoch 87:  22%|██▏       | 26/117 [00:01<00:06, 14.89it/s, loss=0.684, v_num=1, val_acc=0.757]
Epoch 87:  22%|██▏       | 26/117 [00:01<00:06, 14.68it/s, loss=0.684, v_num=1, val_acc=0.757]
Epoch 87:  23%|██▎       | 27/117 [00:01<00:05, 15.17it/s, loss=0.684, v_num=1, val_acc=0.757]
Epoch 87:  23%|██▎       | 27/117 [00:01<00:06, 14.96it/s, loss=0.689, v_num=1, val_acc=0.757]
Epoch 87:  24%|██▍       | 28/117 [00:01<00:05, 15.45it/s, loss=0.689, v_num=1, val_acc=0.757]
Epoch 87:  24%|██▍       | 28/117 [00:01<00:05, 15.23it/s, loss=0.688, v_num=1, val_acc=0.757]
Epoch 87:  25%|██▍       | 29/117 [00:01<00:05, 15.70it/s, loss=0.688, v_num=1, val_acc=0.757]
Epoch 87:  25%|██▍       | 29/117 [00:01<00:05, 15.48it/s, loss=0.684, v_num=1, val_acc=0.757]
Epoch 87:  26%|██▌       | 30/117 [00:01<00:05, 15.94it/s, loss=0.684, v_num=1, val_acc=0.757]
Epoch 87:  26%|██▌       | 30/117 [00:01<00:05, 15.73it/s, loss=0.687, v_num=1, val_acc=0.757]
Epoch 87:  26%|██▋       | 31/117 [00:01<00:05, 16.17it/s, loss=0.687, v_num=1, val_acc=0.757]
Epoch 87:  26%|██▋       | 31/117 [00:01<00:05, 15.96it/s, loss=0.689, v_num=1, val_acc=0.757]
Epoch 87:  27%|██▋       | 32/117 [00:01<00:05, 16.40it/s, loss=0.689, v_num=1, val_acc=0.757]
Epoch 87:  27%|██▋       | 32/117 [00:01<00:05, 16.19it/s, loss=0.688, v_num=1, val_acc=0.757]
Epoch 87:  28%|██▊       | 33/117 [00:01<00:05, 16.60it/s, loss=0.688, v_num=1, val_acc=0.757]
Epoch 87:  28%|██▊       | 33/117 [00:02<00:05, 16.40it/s, loss=0.69, v_num=1, val_acc=0.757]
Epoch 87:  29%|██▉       | 34/117 [00:02<00:04, 16.82it/s, loss=0.69, v_num=1, val_acc=0.757]
Epoch 87:  29%|██▉       | 34/117 [00:02<00:04, 16.62it/s, loss=0.685, v_num=1, val_acc=0.757]
Epoch 87:  30%|██▉       | 35/117 [00:02<00:04, 17.04it/s, loss=0.685, v_num=1, val_acc=0.757]
Epoch 87:  30%|██▉       | 35/117 [00:02<00:04, 16.83it/s, loss=0.686, v_num=1, val_acc=0.757]
Epoch 87:  31%|███       | 36/117 [00:02<00:04, 17.23it/s, loss=0.686, v_num=1, val_acc=0.757]
Epoch 87:  31%|███       | 36/117 [00:02<00:04, 17.02it/s, loss=0.688, v_num=1, val_acc=0.757]
Epoch 87:  32%|███▏      | 37/117 [00:02<00:04, 17.42it/s, loss=0.688, v_num=1, val_acc=0.757]
Epoch 87:  32%|███▏      | 37/117 [00:02<00:04, 17.22it/s, loss=0.684, v_num=1, val_acc=0.757]
Epoch 87:  32%|███▏      | 38/117 [00:02<00:04, 17.61it/s, loss=0.684, v_num=1, val_acc=0.757]
Epoch 87:  32%|███▏      | 38/117 [00:02<00:04, 17.40it/s, loss=0.687, v_num=1, val_acc=0.757]
Epoch 87:  33%|███▎      | 39/117 [00:02<00:04, 17.79it/s, loss=0.687, v_num=1, val_acc=0.757]
Epoch 87:  33%|███▎      | 39/117 [00:02<00:04, 17.58it/s, loss=0.687, v_num=1, val_acc=0.757]
Epoch 87:  34%|███▍      | 40/117 [00:02<00:04, 17.96it/s, loss=0.687, v_num=1, val_acc=0.757]
Epoch 87:  34%|███▍      | 40/117 [00:02<00:04, 17.76it/s, loss=0.688, v_num=1, val_acc=0.757]
Epoch 87:  35%|███▌      | 41/117 [00:02<00:04, 18.12it/s, loss=0.688, v_num=1, val_acc=0.757]
Epoch 87:  35%|███▌      | 41/117 [00:02<00:04, 17.92it/s, loss=0.685, v_num=1, val_acc=0.757]
Epoch 87:  36%|███▌      | 42/117 [00:02<00:04, 18.29it/s, loss=0.685, v_num=1, val_acc=0.757]
Epoch 87:  36%|███▌      | 42/117 [00:02<00:04, 18.09it/s, loss=0.687, v_num=1, val_acc=0.757]
Epoch 87:  37%|███▋      | 43/117 [00:02<00:04, 18.45it/s, loss=0.687, v_num=1, val_acc=0.757]
Epoch 87:  37%|███▋      | 43/117 [00:02<00:04, 18.25it/s, loss=0.687, v_num=1, val_acc=0.757]
Epoch 87:  38%|███▊      | 44/117 [00:02<00:03, 18.60it/s, loss=0.687, v_num=1, val_acc=0.757]
Epoch 87:  38%|███▊      | 44/117 [00:02<00:03, 18.41it/s, loss=0.682, v_num=1, val_acc=0.757]
Epoch 87:  38%|███▊      | 45/117 [00:02<00:03, 18.75it/s, loss=0.682, v_num=1, val_acc=0.757]
Epoch 87:  38%|███▊      | 45/117 [00:02<00:03, 18.56it/s, loss=0.682, v_num=1, val_acc=0.757]
Epoch 87:  39%|███▉      | 46/117 [00:02<00:03, 18.90it/s, loss=0.682, v_num=1, val_acc=0.757]
Epoch 87:  39%|███▉      | 46/117 [00:02<00:03, 18.70it/s, loss=0.686, v_num=1, val_acc=0.757]
Epoch 87:  40%|████      | 47/117 [00:02<00:03, 19.04it/s, loss=0.686, v_num=1, val_acc=0.757]
Epoch 87:  40%|████      | 47/117 [00:02<00:03, 18.85it/s, loss=0.687, v_num=1, val_acc=0.757]
Epoch 87:  41%|████      | 48/117 [00:02<00:03, 19.18it/s, loss=0.687, v_num=1, val_acc=0.757]
Epoch 87:  41%|████      | 48/117 [00:02<00:03, 18.98it/s, loss=0.688, v_num=1, val_acc=0.757]
Epoch 87:  42%|████▏     | 49/117 [00:02<00:03, 19.31it/s, loss=0.688, v_num=1, val_acc=0.757]
Epoch 87:  42%|████▏     | 49/117 [00:02<00:03, 19.12it/s, loss=0.693, v_num=1, val_acc=0.757]
Epoch 87:  43%|████▎     | 50/117 [00:02<00:03, 19.44it/s, loss=0.693, v_num=1, val_acc=0.757]
Epoch 87:  43%|████▎     | 50/117 [00:02<00:03, 19.25it/s, loss=0.688, v_num=1, val_acc=0.757]
Epoch 87:  44%|████▎     | 51/117 [00:02<00:03, 19.57it/s, loss=0.688, v_num=1, val_acc=0.757]
Epoch 87:  44%|████▎     | 51/117 [00:02<00:03, 19.38it/s, loss=0.682, v_num=1, val_acc=0.757]
Epoch 87:  44%|████▍     | 52/117 [00:02<00:03, 19.69it/s, loss=0.682, v_num=1, val_acc=0.757]
Epoch 87:  44%|████▍     | 52/117 [00:02<00:03, 19.50it/s, loss=0.681, v_num=1, val_acc=0.757]
Epoch 87:  45%|████▌     | 53/117 [00:02<00:03, 19.81it/s, loss=0.681, v_num=1, val_acc=0.757]
Epoch 87:  45%|████▌     | 53/117 [00:02<00:03, 19.63it/s, loss=0.677, v_num=1, val_acc=0.757]
Epoch 87:  46%|████▌     | 54/117 [00:02<00:03, 19.93it/s, loss=0.677, v_num=1, val_acc=0.757]
Epoch 87:  46%|████▌     | 54/117 [00:02<00:03, 19.74it/s, loss=0.681, v_num=1, val_acc=0.757]
Epoch 87:  47%|████▋     | 55/117 [00:02<00:03, 20.04it/s, loss=0.681, v_num=1, val_acc=0.757]
Epoch 87:  47%|████▋     | 55/117 [00:02<00:03, 19.86it/s, loss=0.68, v_num=1, val_acc=0.757]
Epoch 87:  48%|████▊     | 56/117 [00:02<00:03, 20.15it/s, loss=0.68, v_num=1, val_acc=0.757]
Epoch 87:  48%|████▊     | 56/117 [00:02<00:03, 19.97it/s, loss=0.682, v_num=1, val_acc=0.757]
Epoch 87:  49%|████▊     | 57/117 [00:02<00:02, 20.26it/s, loss=0.682, v_num=1, val_acc=0.757]
Epoch 87:  49%|████▊     | 57/117 [00:02<00:02, 20.08it/s, loss=0.683, v_num=1, val_acc=0.757]
Epoch 87:  50%|████▉     | 58/117 [00:02<00:02, 20.37it/s, loss=0.683, v_num=1, val_acc=0.757]
Epoch 87:  50%|████▉     | 58/117 [00:02<00:02, 20.19it/s, loss=0.679, v_num=1, val_acc=0.757]
Epoch 87:  50%|█████     | 59/117 [00:02<00:02, 20.47it/s, loss=0.679, v_num=1, val_acc=0.757]
Epoch 87:  50%|█████     | 59/117 [00:02<00:02, 20.29it/s, loss=0.678, v_num=1, val_acc=0.757]
Epoch 87:  51%|█████▏    | 60/117 [00:02<00:02, 20.57it/s, loss=0.678, v_num=1, val_acc=0.757]
Epoch 87:  51%|█████▏    | 60/117 [00:02<00:02, 20.39it/s, loss=0.679, v_num=1, val_acc=0.757]
Epoch 87:  52%|█████▏    | 61/117 [00:02<00:02, 20.67it/s, loss=0.679, v_num=1, val_acc=0.757]
Epoch 87:  52%|█████▏    | 61/117 [00:02<00:02, 20.49it/s, loss=0.677, v_num=1, val_acc=0.757]
Epoch 87:  53%|█████▎    | 62/117 [00:02<00:02, 20.76it/s, loss=0.677, v_num=1, val_acc=0.757]
Epoch 87:  53%|█████▎    | 62/117 [00:03<00:02, 20.59it/s, loss=0.681, v_num=1, val_acc=0.757]
Epoch 87:  54%|█████▍    | 63/117 [00:03<00:02, 20.85it/s, loss=0.681, v_num=1, val_acc=0.757]
Epoch 87:  54%|█████▍    | 63/117 [00:03<00:02, 20.68it/s, loss=0.684, v_num=1, val_acc=0.757]
Epoch 87:  55%|█████▍    | 64/117 [00:03<00:02, 20.95it/s, loss=0.684, v_num=1, val_acc=0.757]
Epoch 87:  55%|█████▍    | 64/117 [00:03<00:02, 20.77it/s, loss=0.692, v_num=1, val_acc=0.757]
Epoch 87:  56%|█████▌    | 65/117 [00:03<00:02, 21.04it/s, loss=0.692, v_num=1, val_acc=0.757]
Epoch 87:  56%|█████▌    | 65/117 [00:03<00:02, 20.86it/s, loss=0.697, v_num=1, val_acc=0.757]
Epoch 87:  56%|█████▋    | 66/117 [00:03<00:02, 21.12it/s, loss=0.697, v_num=1, val_acc=0.757]
Epoch 87:  56%|█████▋    | 66/117 [00:03<00:02, 20.95it/s, loss=0.695, v_num=1, val_acc=0.757]
Epoch 87:  57%|█████▋    | 67/117 [00:03<00:02, 21.21it/s, loss=0.695, v_num=1, val_acc=0.757]
Epoch 87:  57%|█████▋    | 67/117 [00:03<00:02, 21.04it/s, loss=0.695, v_num=1, val_acc=0.757]
Epoch 87:  58%|█████▊    | 68/117 [00:03<00:02, 21.25it/s, loss=0.695, v_num=1, val_acc=0.757]
Epoch 87:  58%|█████▊    | 68/117 [00:03<00:02, 21.10it/s, loss=0.691, v_num=1, val_acc=0.757]
Epoch 87:  59%|█████▉    | 69/117 [00:03<00:02, 21.35it/s, loss=0.691, v_num=1, val_acc=0.757]
Epoch 87:  59%|█████▉    | 69/117 [00:03<00:02, 21.19it/s, loss=0.695, v_num=1, val_acc=0.757]
Epoch 87:  60%|█████▉    | 70/117 [00:03<00:02, 21.43it/s, loss=0.695, v_num=1, val_acc=0.757]
Epoch 87:  60%|█████▉    | 70/117 [00:03<00:02, 21.27it/s, loss=0.701, v_num=1, val_acc=0.757]
Epoch 87:  61%|██████    | 71/117 [00:03<00:02, 21.51it/s, loss=0.701, v_num=1, val_acc=0.757]
Epoch 87:  61%|██████    | 71/117 [00:03<00:02, 21.35it/s, loss=0.703, v_num=1, val_acc=0.757]
Epoch 87:  62%|██████▏   | 72/117 [00:03<00:02, 21.59it/s, loss=0.703, v_num=1, val_acc=0.757]
Epoch 87:  62%|██████▏   | 72/117 [00:03<00:02, 21.43it/s, loss=0.702, v_num=1, val_acc=0.757]
Epoch 87:  62%|██████▏   | 73/117 [00:03<00:02, 21.66it/s, loss=0.702, v_num=1, val_acc=0.757]
Epoch 87:  62%|██████▏   | 73/117 [00:03<00:02, 21.50it/s, loss=0.702, v_num=1, val_acc=0.757]
Epoch 87:  63%|██████▎   | 74/117 [00:03<00:01, 21.73it/s, loss=0.702, v_num=1, val_acc=0.757]
Epoch 87:  63%|██████▎   | 74/117 [00:03<00:01, 21.57it/s, loss=0.704, v_num=1, val_acc=0.757]
Epoch 87:  64%|██████▍   | 75/117 [00:03<00:01, 21.80it/s, loss=0.704, v_num=1, val_acc=0.757]
Epoch 87:  64%|██████▍   | 75/117 [00:03<00:01, 21.65it/s, loss=0.707, v_num=1, val_acc=0.757]
Epoch 87:  65%|██████▍   | 76/117 [00:03<00:01, 21.87it/s, loss=0.707, v_num=1, val_acc=0.757]
Epoch 87:  65%|██████▍   | 76/117 [00:03<00:01, 21.71it/s, loss=0.707, v_num=1, val_acc=0.757]
Epoch 87:  66%|██████▌   | 77/117 [00:03<00:01, 21.94it/s, loss=0.707, v_num=1, val_acc=0.757]
Epoch 87:  66%|██████▌   | 77/117 [00:03<00:01, 21.78it/s, loss=0.709, v_num=1, val_acc=0.757]
Epoch 87:  67%|██████▋   | 78/117 [00:03<00:01, 22.01it/s, loss=0.709, v_num=1, val_acc=0.757]
Epoch 87:  67%|██████▋   | 78/117 [00:03<00:01, 21.85it/s, loss=0.713, v_num=1, val_acc=0.757]
Epoch 87:  68%|██████▊   | 79/117 [00:03<00:01, 22.07it/s, loss=0.713, v_num=1, val_acc=0.757]
Epoch 87:  68%|██████▊   | 79/117 [00:03<00:01, 21.92it/s, loss=0.712, v_num=1, val_acc=0.757]
Epoch 87:  68%|██████▊   | 80/117 [00:03<00:01, 22.14it/s, loss=0.712, v_num=1, val_acc=0.757]
Epoch 87:  68%|██████▊   | 80/117 [00:03<00:01, 21.99it/s, loss=0.708, v_num=1, val_acc=0.757]
Epoch 87:  69%|██████▉   | 81/117 [00:03<00:01, 22.20it/s, loss=0.708, v_num=1, val_acc=0.757]
Epoch 87:  69%|██████▉   | 81/117 [00:03<00:01, 22.04it/s, loss=0.712, v_num=1, val_acc=0.757]
Epoch 87:  70%|███████   | 82/117 [00:03<00:01, 22.24it/s, loss=0.712, v_num=1, val_acc=0.757]
Epoch 87:  70%|███████   | 82/117 [00:03<00:01, 22.09it/s, loss=0.71, v_num=1, val_acc=0.757]
Epoch 87:  71%|███████   | 83/117 [00:03<00:01, 22.30it/s, loss=0.71, v_num=1, val_acc=0.757]
Epoch 87:  71%|███████   | 83/117 [00:03<00:01, 22.15it/s, loss=0.709, v_num=1, val_acc=0.757]
Epoch 87:  72%|███████▏  | 84/117 [00:03<00:01, 22.36it/s, loss=0.709, v_num=1, val_acc=0.757]
Epoch 87:  72%|███████▏  | 84/117 [00:03<00:01, 22.21it/s, loss=0.711, v_num=1, val_acc=0.757]
Epoch 87:  73%|███████▎  | 85/117 [00:03<00:01, 22.42it/s, loss=0.711, v_num=1, val_acc=0.757]
Epoch 87:  73%|███████▎  | 85/117 [00:03<00:01, 22.27it/s, loss=0.704, v_num=1, val_acc=0.757]
Epoch 87:  74%|███████▎  | 86/117 [00:03<00:01, 22.48it/s, loss=0.704, v_num=1, val_acc=0.757]
Epoch 87:  74%|███████▎  | 86/117 [00:03<00:01, 22.33it/s, loss=0.702, v_num=1, val_acc=0.757]
Epoch 87:  74%|███████▍  | 87/117 [00:03<00:01, 22.54it/s, loss=0.702, v_num=1, val_acc=0.757]
Epoch 87:  74%|███████▍  | 87/117 [00:03<00:01, 22.39it/s, loss=0.695, v_num=1, val_acc=0.757]
Epoch 87:  75%|███████▌  | 88/117 [00:03<00:01, 22.60it/s, loss=0.695, v_num=1, val_acc=0.757]
Epoch 87:  75%|███████▌  | 88/117 [00:03<00:01, 22.45it/s, loss=0.697, v_num=1, val_acc=0.757]
Epoch 87:  76%|███████▌  | 89/117 [00:03<00:01, 22.66it/s, loss=0.697, v_num=1, val_acc=0.757]
Epoch 87:  76%|███████▌  | 89/117 [00:03<00:01, 22.51it/s, loss=0.694, v_num=1, val_acc=0.757]
Epoch 87:  77%|███████▋  | 90/117 [00:03<00:01, 22.71it/s, loss=0.694, v_num=1, val_acc=0.757]
Epoch 87:  77%|███████▋  | 90/117 [00:03<00:01, 22.57it/s, loss=0.69, v_num=1, val_acc=0.757]
Epoch 87:  78%|███████▊  | 91/117 [00:03<00:01, 22.77it/s, loss=0.69, v_num=1, val_acc=0.757]
Epoch 87:  78%|███████▊  | 91/117 [00:04<00:01, 22.62it/s, loss=0.69, v_num=1, val_acc=0.757]
Epoch 87:  79%|███████▊  | 92/117 [00:04<00:01, 22.82it/s, loss=0.69, v_num=1, val_acc=0.757]
Epoch 87:  79%|███████▊  | 92/117 [00:04<00:01, 22.68it/s, loss=0.689, v_num=1, val_acc=0.757]
Epoch 87:  79%|███████▉  | 93/117 [00:04<00:01, 22.88it/s, loss=0.689, v_num=1, val_acc=0.757]
Epoch 87:  79%|███████▉  | 93/117 [00:04<00:01, 22.73it/s, loss=0.693, v_num=1, val_acc=0.757]
Epoch 87:  80%|████████  | 94/117 [00:04<00:01, 22.93it/s, loss=0.693, v_num=1, val_acc=0.757]
Epoch 87:  80%|████████  | 94/117 [00:04<00:01, 22.79it/s, loss=0.689, v_num=1, val_acc=0.757]
Epoch 87:  81%|████████  | 95/117 [00:04<00:00, 22.98it/s, loss=0.689, v_num=1, val_acc=0.757]
Epoch 87:  81%|████████  | 95/117 [00:04<00:00, 22.84it/s, loss=0.686, v_num=1, val_acc=0.757]
Epoch 87:  82%|████████▏ | 96/117 [00:04<00:00, 23.03it/s, loss=0.686, v_num=1, val_acc=0.757]
Epoch 87:  82%|████████▏ | 96/117 [00:04<00:00, 22.89it/s, loss=0.686, v_num=1, val_acc=0.757]
Epoch 87:  83%|████████▎ | 97/117 [00:04<00:00, 23.08it/s, loss=0.686, v_num=1, val_acc=0.757]
Epoch 87:  83%|████████▎ | 97/117 [00:04<00:00, 22.94it/s, loss=0.684, v_num=1, val_acc=0.757]

Validation: 0it [00:00, ?it/s]

Validation:   0%|          | 0/20 [00:00<?, ?it/s]

Validation DataLoader 0:   0%|          | 0/20 [00:00<?, ?it/s]

Validation DataLoader 0:   5%|▌         | 1/20 [00:00<00:00, 137.28it/s]
Epoch 87:  84%|████████▍ | 98/117 [00:05<00:00, 19.30it/s, loss=0.684, v_num=1, val_acc=0.757]

Validation DataLoader 0:  10%|█         | 2/20 [00:00<00:00, 55.79it/s]
Epoch 87:  85%|████████▍ | 99/117 [00:05<00:00, 19.39it/s, loss=0.684, v_num=1, val_acc=0.757]

Validation DataLoader 0:  15%|█▌        | 3/20 [00:00<00:00, 44.47it/s]
Epoch 87:  85%|████████▌ | 100/117 [00:05<00:00, 19.47it/s, loss=0.684, v_num=1, val_acc=0.757]

Validation DataLoader 0:  20%|██        | 4/20 [00:00<00:00, 40.40it/s]
Epoch 87:  86%|████████▋ | 101/117 [00:05<00:00, 19.54it/s, loss=0.684, v_num=1, val_acc=0.757]

Validation DataLoader 0:  25%|██▌       | 5/20 [00:00<00:00, 38.26it/s]
Epoch 87:  87%|████████▋ | 102/117 [00:05<00:00, 19.61it/s, loss=0.684, v_num=1, val_acc=0.757]

Validation DataLoader 0:  30%|███       | 6/20 [00:00<00:00, 37.01it/s]
Epoch 87:  88%|████████▊ | 103/117 [00:05<00:00, 19.69it/s, loss=0.684, v_num=1, val_acc=0.757]

Validation DataLoader 0:  35%|███▌      | 7/20 [00:00<00:00, 36.14it/s]
Epoch 87:  89%|████████▉ | 104/117 [00:05<00:00, 19.76it/s, loss=0.684, v_num=1, val_acc=0.757]

Validation DataLoader 0:  40%|████      | 8/20 [00:00<00:00, 35.46it/s]
Epoch 87:  90%|████████▉ | 105/117 [00:05<00:00, 19.83it/s, loss=0.684, v_num=1, val_acc=0.757]

Validation DataLoader 0:  45%|████▌     | 9/20 [00:00<00:00, 34.96it/s]
Epoch 87:  91%|█████████ | 106/117 [00:05<00:00, 19.90it/s, loss=0.684, v_num=1, val_acc=0.757]

Validation DataLoader 0:  50%|█████     | 10/20 [00:00<00:00, 34.63it/s]
Epoch 87:  91%|█████████▏| 107/117 [00:05<00:00, 19.97it/s, loss=0.684, v_num=1, val_acc=0.757]

Validation DataLoader 0:  55%|█████▌    | 11/20 [00:00<00:00, 34.36it/s]
Epoch 87:  92%|█████████▏| 108/117 [00:05<00:00, 20.04it/s, loss=0.684, v_num=1, val_acc=0.757]

Validation DataLoader 0:  60%|██████    | 12/20 [00:00<00:00, 34.11it/s]
Epoch 87:  93%|█████████▎| 109/117 [00:05<00:00, 20.11it/s, loss=0.684, v_num=1, val_acc=0.757]

Validation DataLoader 0:  65%|██████▌   | 13/20 [00:00<00:00, 33.89it/s]
Epoch 87:  94%|█████████▍| 110/117 [00:05<00:00, 20.17it/s, loss=0.684, v_num=1, val_acc=0.757]

Validation DataLoader 0:  70%|███████   | 14/20 [00:00<00:00, 33.72it/s]
Epoch 87:  95%|█████████▍| 111/117 [00:05<00:00, 20.24it/s, loss=0.684, v_num=1, val_acc=0.757]

Validation DataLoader 0:  75%|███████▌  | 15/20 [00:00<00:00, 33.57it/s]
Epoch 87:  96%|█████████▌| 112/117 [00:05<00:00, 20.30it/s, loss=0.684, v_num=1, val_acc=0.757]

Validation DataLoader 0:  80%|████████  | 16/20 [00:00<00:00, 33.45it/s]
Epoch 87:  97%|█████████▋| 113/117 [00:05<00:00, 20.37it/s, loss=0.684, v_num=1, val_acc=0.757]

Validation DataLoader 0:  85%|████████▌ | 17/20 [00:00<00:00, 33.32it/s]
Epoch 87:  97%|█████████▋| 114/117 [00:05<00:00, 20.43it/s, loss=0.684, v_num=1, val_acc=0.757]

Validation DataLoader 0:  90%|█████████ | 18/20 [00:00<00:00, 33.21it/s]
Epoch 87:  98%|█████████▊| 115/117 [00:05<00:00, 20.49it/s, loss=0.684, v_num=1, val_acc=0.757]

Validation DataLoader 0:  95%|█████████▌| 19/20 [00:00<00:00, 33.13it/s]
Epoch 87:  99%|█████████▉| 116/117 [00:05<00:00, 20.56it/s, loss=0.684, v_num=1, val_acc=0.757]

Validation DataLoader 0: 100%|██████████| 20/20 [00:00<00:00, 33.12it/s]
Epoch 87: 100%|██████████| 117/117 [00:05<00:00, 20.62it/s, loss=0.684, v_num=1, val_acc=0.757]
Epoch 87: 100%|██████████| 117/117 [00:05<00:00, 20.55it/s, loss=0.684, v_num=1, val_acc=0.757]


Epoch 87: 100%|██████████| 117/117 [00:05<00:00, 20.55it/s, loss=0.684, v_num=1, val_acc=0.757]
Epoch 87:   0%|          | 0/117 [00:00<?, ?it/s, loss=0.684, v_num=1, val_acc=0.757]
Epoch 88:   0%|          | 0/117 [00:00<?, ?it/s, loss=0.684, v_num=1, val_acc=0.757]
Epoch 88:   1%|          | 1/117 [00:00<01:44,  1.11it/s, loss=0.684, v_num=1, val_acc=0.757]
Epoch 88:   1%|          | 1/117 [00:00<01:46,  1.08it/s, loss=0.683, v_num=1, val_acc=0.757]
Epoch 88:   2%|▏         | 2/117 [00:00<00:53,  2.15it/s, loss=0.683, v_num=1, val_acc=0.757]
Epoch 88:   2%|▏         | 2/117 [00:00<00:55,  2.09it/s, loss=0.678, v_num=1, val_acc=0.757]
Epoch 88:   3%|▎         | 3/117 [00:00<00:36,  3.11it/s, loss=0.678, v_num=1, val_acc=0.757]
Epoch 88:   3%|▎         | 3/117 [00:00<00:37,  3.03it/s, loss=0.683, v_num=1, val_acc=0.757]
Epoch 88:   3%|▎         | 4/117 [00:01<00:28,  3.98it/s, loss=0.683, v_num=1, val_acc=0.757]
Epoch 88:   3%|▎         | 4/117 [00:01<00:29,  3.88it/s, loss=0.682, v_num=1, val_acc=0.757]
Epoch 88:   4%|▍         | 5/117 [00:01<00:23,  4.81it/s, loss=0.682, v_num=1, val_acc=0.757]
Epoch 88:   4%|▍         | 5/117 [00:01<00:23,  4.70it/s, loss=0.679, v_num=1, val_acc=0.757]
Epoch 88:   5%|▌         | 6/117 [00:01<00:19,  5.59it/s, loss=0.679, v_num=1, val_acc=0.757]
Epoch 88:   5%|▌         | 6/117 [00:01<00:20,  5.46it/s, loss=0.679, v_num=1, val_acc=0.757]
Epoch 88:   6%|▌         | 7/117 [00:01<00:17,  6.33it/s, loss=0.679, v_num=1, val_acc=0.757]
Epoch 88:   6%|▌         | 7/117 [00:01<00:17,  6.19it/s, loss=0.678, v_num=1, val_acc=0.757]
Epoch 88:   7%|▋         | 8/117 [00:01<00:15,  7.02it/s, loss=0.678, v_num=1, val_acc=0.757]
Epoch 88:   7%|▋         | 8/117 [00:01<00:15,  6.86it/s, loss=0.679, v_num=1, val_acc=0.757]
Epoch 88:   8%|▊         | 9/117 [00:01<00:14,  7.66it/s, loss=0.679, v_num=1, val_acc=0.757]
Epoch 88:   8%|▊         | 9/117 [00:01<00:14,  7.50it/s, loss=0.682, v_num=1, val_acc=0.757]
Epoch 88:   9%|▊         | 10/117 [00:01<00:12,  8.26it/s, loss=0.682, v_num=1, val_acc=0.757]
Epoch 88:   9%|▊         | 10/117 [00:01<00:13,  8.09it/s, loss=0.688, v_num=1, val_acc=0.757]
Epoch 88:   9%|▉         | 11/117 [00:01<00:11,  8.84it/s, loss=0.688, v_num=1, val_acc=0.757]
Epoch 88:   9%|▉         | 11/117 [00:01<00:12,  8.67it/s, loss=0.695, v_num=1, val_acc=0.757]
Epoch 88:  10%|█         | 12/117 [00:01<00:11,  9.37it/s, loss=0.695, v_num=1, val_acc=0.757]
Epoch 88:  10%|█         | 12/117 [00:01<00:11,  9.19it/s, loss=0.693, v_num=1, val_acc=0.757]
Epoch 88:  11%|█         | 13/117 [00:01<00:10,  9.89it/s, loss=0.693, v_num=1, val_acc=0.757]
Epoch 88:  11%|█         | 13/117 [00:01<00:10,  9.70it/s, loss=0.697, v_num=1, val_acc=0.757]
Epoch 88:  12%|█▏        | 14/117 [00:01<00:09, 10.38it/s, loss=0.697, v_num=1, val_acc=0.757]
Epoch 88:  12%|█▏        | 14/117 [00:01<00:10, 10.19it/s, loss=0.699, v_num=1, val_acc=0.757]
Epoch 88:  13%|█▎        | 15/117 [00:01<00:09, 10.84it/s, loss=0.699, v_num=1, val_acc=0.757]
Epoch 88:  13%|█▎        | 15/117 [00:01<00:09, 10.65it/s, loss=0.698, v_num=1, val_acc=0.757]
Epoch 88:  14%|█▎        | 16/117 [00:01<00:08, 11.29it/s, loss=0.698, v_num=1, val_acc=0.757]
Epoch 88:  14%|█▎        | 16/117 [00:01<00:09, 11.09it/s, loss=0.694, v_num=1, val_acc=0.757]
Epoch 88:  15%|█▍        | 17/117 [00:01<00:08, 11.70it/s, loss=0.694, v_num=1, val_acc=0.757]
Epoch 88:  15%|█▍        | 17/117 [00:01<00:08, 11.50it/s, loss=0.695, v_num=1, val_acc=0.757]
Epoch 88:  15%|█▌        | 18/117 [00:01<00:08, 12.10it/s, loss=0.695, v_num=1, val_acc=0.757]
Epoch 88:  15%|█▌        | 18/117 [00:01<00:08, 11.90it/s, loss=0.694, v_num=1, val_acc=0.757]
Epoch 88:  16%|█▌        | 19/117 [00:01<00:07, 12.48it/s, loss=0.694, v_num=1, val_acc=0.757]
Epoch 88:  16%|█▌        | 19/117 [00:01<00:07, 12.28it/s, loss=0.695, v_num=1, val_acc=0.757]
Epoch 88:  17%|█▋        | 20/117 [00:01<00:07, 12.83it/s, loss=0.695, v_num=1, val_acc=0.757]
Epoch 88:  17%|█▋        | 20/117 [00:01<00:07, 12.63it/s, loss=0.701, v_num=1, val_acc=0.757]
Epoch 88:  18%|█▊        | 21/117 [00:01<00:07, 13.19it/s, loss=0.701, v_num=1, val_acc=0.757]
Epoch 88:  18%|█▊        | 21/117 [00:01<00:07, 12.98it/s, loss=0.702, v_num=1, val_acc=0.757]
Epoch 88:  19%|█▉        | 22/117 [00:01<00:07, 13.53it/s, loss=0.702, v_num=1, val_acc=0.757]
Epoch 88:  19%|█▉        | 22/117 [00:01<00:07, 13.32it/s, loss=0.702, v_num=1, val_acc=0.757]
Epoch 88:  20%|█▉        | 23/117 [00:01<00:06, 13.86it/s, loss=0.702, v_num=1, val_acc=0.757]
Epoch 88:  20%|█▉        | 23/117 [00:01<00:06, 13.65it/s, loss=0.699, v_num=1, val_acc=0.757]
Epoch 88:  21%|██        | 24/117 [00:01<00:06, 14.16it/s, loss=0.699, v_num=1, val_acc=0.757]
Epoch 88:  21%|██        | 24/117 [00:01<00:06, 13.96it/s, loss=0.696, v_num=1, val_acc=0.757]
Epoch 88:  21%|██▏       | 25/117 [00:01<00:06, 14.46it/s, loss=0.696, v_num=1, val_acc=0.757]
Epoch 88:  21%|██▏       | 25/117 [00:01<00:06, 14.25it/s, loss=0.698, v_num=1, val_acc=0.757]
Epoch 88:  22%|██▏       | 26/117 [00:01<00:06, 14.74it/s, loss=0.698, v_num=1, val_acc=0.757]
Epoch 88:  22%|██▏       | 26/117 [00:01<00:06, 14.54it/s, loss=0.699, v_num=1, val_acc=0.757]
Epoch 88:  23%|██▎       | 27/117 [00:01<00:05, 15.02it/s, loss=0.699, v_num=1, val_acc=0.757]
Epoch 88:  23%|██▎       | 27/117 [00:01<00:06, 14.81it/s, loss=0.695, v_num=1, val_acc=0.757]
Epoch 88:  24%|██▍       | 28/117 [00:01<00:05, 15.27it/s, loss=0.695, v_num=1, val_acc=0.757]
Epoch 88:  24%|██▍       | 28/117 [00:01<00:05, 15.06it/s, loss=0.692, v_num=1, val_acc=0.757]
Epoch 88:  25%|██▍       | 29/117 [00:01<00:05, 15.53it/s, loss=0.692, v_num=1, val_acc=0.757]
Epoch 88:  25%|██▍       | 29/117 [00:01<00:05, 15.32it/s, loss=0.693, v_num=1, val_acc=0.757]
Epoch 88:  26%|██▌       | 30/117 [00:01<00:05, 15.77it/s, loss=0.693, v_num=1, val_acc=0.757]
Epoch 88:  26%|██▌       | 30/117 [00:01<00:05, 15.56it/s, loss=0.691, v_num=1, val_acc=0.757]
Epoch 88:  26%|██▋       | 31/117 [00:01<00:05, 16.01it/s, loss=0.691, v_num=1, val_acc=0.757]
Epoch 88:  26%|██▋       | 31/117 [00:01<00:05, 15.80it/s, loss=0.692, v_num=1, val_acc=0.757]
Epoch 88:  27%|██▋       | 32/117 [00:01<00:05, 16.23it/s, loss=0.692, v_num=1, val_acc=0.757]
Epoch 88:  27%|██▋       | 32/117 [00:01<00:05, 16.03it/s, loss=0.689, v_num=1, val_acc=0.757]
Epoch 88:  28%|██▊       | 33/117 [00:02<00:05, 16.45it/s, loss=0.689, v_num=1, val_acc=0.757]
Epoch 88:  28%|██▊       | 33/117 [00:02<00:05, 16.25it/s, loss=0.688, v_num=1, val_acc=0.757]
Epoch 88:  29%|██▉       | 34/117 [00:02<00:04, 16.67it/s, loss=0.688, v_num=1, val_acc=0.757]
Epoch 88:  29%|██▉       | 34/117 [00:02<00:05, 16.46it/s, loss=0.687, v_num=1, val_acc=0.757]
Epoch 88:  30%|██▉       | 35/117 [00:02<00:04, 16.87it/s, loss=0.687, v_num=1, val_acc=0.757]
Epoch 88:  30%|██▉       | 35/117 [00:02<00:04, 16.67it/s, loss=0.686, v_num=1, val_acc=0.757]
Epoch 88:  31%|███       | 36/117 [00:02<00:04, 17.07it/s, loss=0.686, v_num=1, val_acc=0.757]
Epoch 88:  31%|███       | 36/117 [00:02<00:04, 16.87it/s, loss=0.685, v_num=1, val_acc=0.757]
Epoch 88:  32%|███▏      | 37/117 [00:02<00:04, 17.26it/s, loss=0.685, v_num=1, val_acc=0.757]
Epoch 88:  32%|███▏      | 37/117 [00:02<00:04, 17.06it/s, loss=0.689, v_num=1, val_acc=0.757]
Epoch 88:  32%|███▏      | 38/117 [00:02<00:04, 17.45it/s, loss=0.689, v_num=1, val_acc=0.757]
Epoch 88:  32%|███▏      | 38/117 [00:02<00:04, 17.25it/s, loss=0.694, v_num=1, val_acc=0.757]
Epoch 88:  33%|███▎      | 39/117 [00:02<00:04, 17.63it/s, loss=0.694, v_num=1, val_acc=0.757]
Epoch 88:  33%|███▎      | 39/117 [00:02<00:04, 17.43it/s, loss=0.692, v_num=1, val_acc=0.757]
Epoch 88:  34%|███▍      | 40/117 [00:02<00:04, 17.80it/s, loss=0.692, v_num=1, val_acc=0.757]
Epoch 88:  34%|███▍      | 40/117 [00:02<00:04, 17.61it/s, loss=0.686, v_num=1, val_acc=0.757]
Epoch 88:  35%|███▌      | 41/117 [00:02<00:04, 17.97it/s, loss=0.686, v_num=1, val_acc=0.757]
Epoch 88:  35%|███▌      | 41/117 [00:02<00:04, 17.78it/s, loss=0.685, v_num=1, val_acc=0.757]
Epoch 88:  36%|███▌      | 42/117 [00:02<00:04, 18.11it/s, loss=0.685, v_num=1, val_acc=0.757]
Epoch 88:  36%|███▌      | 42/117 [00:02<00:04, 17.92it/s, loss=0.69, v_num=1, val_acc=0.757]
Epoch 88:  37%|███▋      | 43/117 [00:02<00:04, 18.27it/s, loss=0.69, v_num=1, val_acc=0.757]
Epoch 88:  37%|███▋      | 43/117 [00:02<00:04, 18.08it/s, loss=0.686, v_num=1, val_acc=0.757]
Epoch 88:  38%|███▊      | 44/117 [00:02<00:03, 18.43it/s, loss=0.686, v_num=1, val_acc=0.757]
Epoch 88:  38%|███▊      | 44/117 [00:02<00:04, 18.24it/s, loss=0.689, v_num=1, val_acc=0.757]
Epoch 88:  38%|███▊      | 45/117 [00:02<00:03, 18.58it/s, loss=0.689, v_num=1, val_acc=0.757]
Epoch 88:  38%|███▊      | 45/117 [00:02<00:03, 18.39it/s, loss=0.688, v_num=1, val_acc=0.757]
Epoch 88:  39%|███▉      | 46/117 [00:02<00:03, 18.73it/s, loss=0.688, v_num=1, val_acc=0.757]
Epoch 88:  39%|███▉      | 46/117 [00:02<00:03, 18.54it/s, loss=0.69, v_num=1, val_acc=0.757]
Epoch 88:  40%|████      | 47/117 [00:02<00:03, 18.87it/s, loss=0.69, v_num=1, val_acc=0.757]
Epoch 88:  40%|████      | 47/117 [00:02<00:03, 18.68it/s, loss=0.693, v_num=1, val_acc=0.757]
Epoch 88:  41%|████      | 48/117 [00:02<00:03, 19.01it/s, loss=0.693, v_num=1, val_acc=0.757]
Epoch 88:  41%|████      | 48/117 [00:02<00:03, 18.82it/s, loss=0.694, v_num=1, val_acc=0.757]
Epoch 88:  42%|████▏     | 49/117 [00:02<00:03, 19.14it/s, loss=0.694, v_num=1, val_acc=0.757]
Epoch 88:  42%|████▏     | 49/117 [00:02<00:03, 18.96it/s, loss=0.694, v_num=1, val_acc=0.757]
Epoch 88:  43%|████▎     | 50/117 [00:02<00:03, 19.28it/s, loss=0.694, v_num=1, val_acc=0.757]
Epoch 88:  43%|████▎     | 50/117 [00:02<00:03, 19.09it/s, loss=0.692, v_num=1, val_acc=0.757]
Epoch 88:  44%|████▎     | 51/117 [00:02<00:03, 19.40it/s, loss=0.692, v_num=1, val_acc=0.757]
Epoch 88:  44%|████▎     | 51/117 [00:02<00:03, 19.22it/s, loss=0.684, v_num=1, val_acc=0.757]
Epoch 88:  44%|████▍     | 52/117 [00:02<00:03, 19.53it/s, loss=0.684, v_num=1, val_acc=0.757]
Epoch 88:  44%|████▍     | 52/117 [00:02<00:03, 19.34it/s, loss=0.682, v_num=1, val_acc=0.757]
Epoch 88:  45%|████▌     | 53/117 [00:02<00:03, 19.65it/s, loss=0.682, v_num=1, val_acc=0.757]
Epoch 88:  45%|████▌     | 53/117 [00:02<00:03, 19.47it/s, loss=0.682, v_num=1, val_acc=0.757]
Epoch 88:  46%|████▌     | 54/117 [00:02<00:03, 19.77it/s, loss=0.682, v_num=1, val_acc=0.757]
Epoch 88:  46%|████▌     | 54/117 [00:02<00:03, 19.59it/s, loss=0.677, v_num=1, val_acc=0.757]
Epoch 88:  47%|████▋     | 55/117 [00:02<00:03, 19.88it/s, loss=0.677, v_num=1, val_acc=0.757]
Epoch 88:  47%|████▋     | 55/117 [00:02<00:03, 19.70it/s, loss=0.677, v_num=1, val_acc=0.757]
Epoch 88:  48%|████▊     | 56/117 [00:02<00:03, 20.00it/s, loss=0.677, v_num=1, val_acc=0.757]
Epoch 88:  48%|████▊     | 56/117 [00:02<00:03, 19.82it/s, loss=0.681, v_num=1, val_acc=0.757]
Epoch 88:  49%|████▊     | 57/117 [00:02<00:02, 20.11it/s, loss=0.681, v_num=1, val_acc=0.757]
Epoch 88:  49%|████▊     | 57/117 [00:02<00:03, 19.93it/s, loss=0.675, v_num=1, val_acc=0.757]
Epoch 88:  50%|████▉     | 58/117 [00:02<00:02, 20.21it/s, loss=0.675, v_num=1, val_acc=0.757]
Epoch 88:  50%|████▉     | 58/117 [00:02<00:02, 20.04it/s, loss=0.673, v_num=1, val_acc=0.757]
Epoch 88:  50%|█████     | 59/117 [00:02<00:02, 20.32it/s, loss=0.673, v_num=1, val_acc=0.757]
Epoch 88:  50%|█████     | 59/117 [00:02<00:02, 20.14it/s, loss=0.673, v_num=1, val_acc=0.757]
Epoch 88:  51%|█████▏    | 60/117 [00:02<00:02, 20.42it/s, loss=0.673, v_num=1, val_acc=0.757]
Epoch 88:  51%|█████▏    | 60/117 [00:02<00:02, 20.25it/s, loss=0.675, v_num=1, val_acc=0.757]
Epoch 88:  52%|█████▏    | 61/117 [00:02<00:02, 20.52it/s, loss=0.675, v_num=1, val_acc=0.757]
Epoch 88:  52%|█████▏    | 61/117 [00:02<00:02, 20.35it/s, loss=0.676, v_num=1, val_acc=0.757]
Epoch 88:  53%|█████▎    | 62/117 [00:03<00:02, 20.61it/s, loss=0.676, v_num=1, val_acc=0.757]
Epoch 88:  53%|█████▎    | 62/117 [00:03<00:02, 20.44it/s, loss=0.678, v_num=1, val_acc=0.757]
Epoch 88:  54%|█████▍    | 63/117 [00:03<00:02, 20.71it/s, loss=0.678, v_num=1, val_acc=0.757]
Epoch 88:  54%|█████▍    | 63/117 [00:03<00:02, 20.54it/s, loss=0.685, v_num=1, val_acc=0.757]
Epoch 88:  55%|█████▍    | 64/117 [00:03<00:02, 20.80it/s, loss=0.685, v_num=1, val_acc=0.757]
Epoch 88:  55%|█████▍    | 64/117 [00:03<00:02, 20.63it/s, loss=0.687, v_num=1, val_acc=0.757]
Epoch 88:  56%|█████▌    | 65/117 [00:03<00:02, 20.89it/s, loss=0.687, v_num=1, val_acc=0.757]
Epoch 88:  56%|█████▌    | 65/117 [00:03<00:02, 20.72it/s, loss=0.689, v_num=1, val_acc=0.757]
Epoch 88:  56%|█████▋    | 66/117 [00:03<00:02, 20.98it/s, loss=0.689, v_num=1, val_acc=0.757]
Epoch 88:  56%|█████▋    | 66/117 [00:03<00:02, 20.81it/s, loss=0.686, v_num=1, val_acc=0.757]
Epoch 88:  57%|█████▋    | 67/117 [00:03<00:02, 21.07it/s, loss=0.686, v_num=1, val_acc=0.757]
Epoch 88:  57%|█████▋    | 67/117 [00:03<00:02, 20.90it/s, loss=0.683, v_num=1, val_acc=0.757]
Epoch 88:  58%|█████▊    | 68/117 [00:03<00:02, 21.15it/s, loss=0.683, v_num=1, val_acc=0.757]
Epoch 88:  58%|█████▊    | 68/117 [00:03<00:02, 20.99it/s, loss=0.68, v_num=1, val_acc=0.757]
Epoch 88:  59%|█████▉    | 69/117 [00:03<00:02, 21.24it/s, loss=0.68, v_num=1, val_acc=0.757]
Epoch 88:  59%|█████▉    | 69/117 [00:03<00:02, 21.07it/s, loss=0.68, v_num=1, val_acc=0.757]
Epoch 88:  60%|█████▉    | 70/117 [00:03<00:02, 21.32it/s, loss=0.68, v_num=1, val_acc=0.757]
Epoch 88:  60%|█████▉    | 70/117 [00:03<00:02, 21.16it/s, loss=0.681, v_num=1, val_acc=0.757]
Epoch 88:  61%|██████    | 71/117 [00:03<00:02, 21.40it/s, loss=0.681, v_num=1, val_acc=0.757]
Epoch 88:  61%|██████    | 71/117 [00:03<00:02, 21.24it/s, loss=0.685, v_num=1, val_acc=0.757]
Epoch 88:  62%|██████▏   | 72/117 [00:03<00:02, 21.48it/s, loss=0.685, v_num=1, val_acc=0.757]
Epoch 88:  62%|██████▏   | 72/117 [00:03<00:02, 21.32it/s, loss=0.689, v_num=1, val_acc=0.757]
Epoch 88:  62%|██████▏   | 73/117 [00:03<00:02, 21.56it/s, loss=0.689, v_num=1, val_acc=0.757]
Epoch 88:  62%|██████▏   | 73/117 [00:03<00:02, 21.40it/s, loss=0.691, v_num=1, val_acc=0.757]
Epoch 88:  63%|██████▎   | 74/117 [00:03<00:01, 21.63it/s, loss=0.691, v_num=1, val_acc=0.757]
Epoch 88:  63%|██████▎   | 74/117 [00:03<00:02, 21.47it/s, loss=0.696, v_num=1, val_acc=0.757]
Epoch 88:  64%|██████▍   | 75/117 [00:03<00:01, 21.71it/s, loss=0.696, v_num=1, val_acc=0.757]
Epoch 88:  64%|██████▍   | 75/117 [00:03<00:01, 21.55it/s, loss=0.697, v_num=1, val_acc=0.757]
Epoch 88:  65%|██████▍   | 76/117 [00:03<00:01, 21.78it/s, loss=0.697, v_num=1, val_acc=0.757]
Epoch 88:  65%|██████▍   | 76/117 [00:03<00:01, 21.62it/s, loss=0.694, v_num=1, val_acc=0.757]
Epoch 88:  66%|██████▌   | 77/117 [00:03<00:01, 21.85it/s, loss=0.694, v_num=1, val_acc=0.757]
Epoch 88:  66%|██████▌   | 77/117 [00:03<00:01, 21.69it/s, loss=0.696, v_num=1, val_acc=0.757]
Epoch 88:  67%|██████▋   | 78/117 [00:03<00:01, 21.92it/s, loss=0.696, v_num=1, val_acc=0.757]
Epoch 88:  67%|██████▋   | 78/117 [00:03<00:01, 21.76it/s, loss=0.695, v_num=1, val_acc=0.757]
Epoch 88:  68%|██████▊   | 79/117 [00:03<00:01, 21.99it/s, loss=0.695, v_num=1, val_acc=0.757]
Epoch 88:  68%|██████▊   | 79/117 [00:03<00:01, 21.83it/s, loss=0.691, v_num=1, val_acc=0.757]
Epoch 88:  68%|██████▊   | 80/117 [00:03<00:01, 22.05it/s, loss=0.691, v_num=1, val_acc=0.757]
Epoch 88:  68%|██████▊   | 80/117 [00:03<00:01, 21.90it/s, loss=0.687, v_num=1, val_acc=0.757]
Epoch 88:  69%|██████▉   | 81/117 [00:03<00:01, 22.12it/s, loss=0.687, v_num=1, val_acc=0.757]
Epoch 88:  69%|██████▉   | 81/117 [00:03<00:01, 21.97it/s, loss=0.684, v_num=1, val_acc=0.757]
Epoch 88:  70%|███████   | 82/117 [00:03<00:01, 22.17it/s, loss=0.684, v_num=1, val_acc=0.757]
Epoch 88:  70%|███████   | 82/117 [00:03<00:01, 22.01it/s, loss=0.687, v_num=1, val_acc=0.757]
Epoch 88:  71%|███████   | 83/117 [00:03<00:01, 22.23it/s, loss=0.687, v_num=1, val_acc=0.757]
Epoch 88:  71%|███████   | 83/117 [00:03<00:01, 22.08it/s, loss=0.681, v_num=1, val_acc=0.757]
Epoch 88:  72%|███████▏  | 84/117 [00:03<00:01, 22.29it/s, loss=0.681, v_num=1, val_acc=0.757]
Epoch 88:  72%|███████▏  | 84/117 [00:03<00:01, 22.14it/s, loss=0.677, v_num=1, val_acc=0.757]
Epoch 88:  73%|███████▎  | 85/117 [00:03<00:01, 22.36it/s, loss=0.677, v_num=1, val_acc=0.757]
Epoch 88:  73%|███████▎  | 85/117 [00:03<00:01, 22.21it/s, loss=0.671, v_num=1, val_acc=0.757]
Epoch 88:  74%|███████▎  | 86/117 [00:03<00:01, 22.42it/s, loss=0.671, v_num=1, val_acc=0.757]
Epoch 88:  74%|███████▎  | 86/117 [00:03<00:01, 22.27it/s, loss=0.667, v_num=1, val_acc=0.757]
Epoch 88:  74%|███████▍  | 87/117 [00:03<00:01, 22.48it/s, loss=0.667, v_num=1, val_acc=0.757]
Epoch 88:  74%|███████▍  | 87/117 [00:03<00:01, 22.33it/s, loss=0.667, v_num=1, val_acc=0.757]
Epoch 88:  75%|███████▌  | 88/117 [00:03<00:01, 22.54it/s, loss=0.667, v_num=1, val_acc=0.757]
Epoch 88:  75%|███████▌  | 88/117 [00:03<00:01, 22.39it/s, loss=0.668, v_num=1, val_acc=0.757]
Epoch 88:  76%|███████▌  | 89/117 [00:03<00:01, 22.60it/s, loss=0.668, v_num=1, val_acc=0.757]
Epoch 88:  76%|███████▌  | 89/117 [00:03<00:01, 22.45it/s, loss=0.666, v_num=1, val_acc=0.757]
Epoch 88:  77%|███████▋  | 90/117 [00:03<00:01, 22.65it/s, loss=0.666, v_num=1, val_acc=0.757]
Epoch 88:  77%|███████▋  | 90/117 [00:03<00:01, 22.51it/s, loss=0.669, v_num=1, val_acc=0.757]
Epoch 88:  78%|███████▊  | 91/117 [00:04<00:01, 22.71it/s, loss=0.669, v_num=1, val_acc=0.757]
Epoch 88:  78%|███████▊  | 91/117 [00:04<00:01, 22.56it/s, loss=0.67, v_num=1, val_acc=0.757]
Epoch 88:  79%|███████▊  | 92/117 [00:04<00:01, 22.76it/s, loss=0.67, v_num=1, val_acc=0.757]
Epoch 88:  79%|███████▊  | 92/117 [00:04<00:01, 22.62it/s, loss=0.671, v_num=1, val_acc=0.757]
Epoch 88:  79%|███████▉  | 93/117 [00:04<00:01, 22.81it/s, loss=0.671, v_num=1, val_acc=0.757]
Epoch 88:  79%|███████▉  | 93/117 [00:04<00:01, 22.67it/s, loss=0.668, v_num=1, val_acc=0.757]
Epoch 88:  80%|████████  | 94/117 [00:04<00:01, 22.87it/s, loss=0.668, v_num=1, val_acc=0.757]
Epoch 88:  80%|████████  | 94/117 [00:04<00:01, 22.72it/s, loss=0.668, v_num=1, val_acc=0.757]
Epoch 88:  81%|████████  | 95/117 [00:04<00:00, 22.92it/s, loss=0.668, v_num=1, val_acc=0.757]
Epoch 88:  81%|████████  | 95/117 [00:04<00:00, 22.78it/s, loss=0.664, v_num=1, val_acc=0.757]
Epoch 88:  82%|████████▏ | 96/117 [00:04<00:00, 22.97it/s, loss=0.664, v_num=1, val_acc=0.757]
Epoch 88:  82%|████████▏ | 96/117 [00:04<00:00, 22.83it/s, loss=0.666, v_num=1, val_acc=0.757]
Epoch 88:  83%|████████▎ | 97/117 [00:04<00:00, 23.02it/s, loss=0.666, v_num=1, val_acc=0.757]
Epoch 88:  83%|████████▎ | 97/117 [00:04<00:00, 22.88it/s, loss=0.669, v_num=1, val_acc=0.757]

Validation: 0it [00:00, ?it/s]

Validation:   0%|          | 0/20 [00:00<?, ?it/s]

Validation DataLoader 0:   0%|          | 0/20 [00:00<?, ?it/s]

Validation DataLoader 0:   5%|▌         | 1/20 [00:00<00:00, 182.07it/s]
Epoch 88:  84%|████████▍ | 98/117 [00:05<00:00, 19.36it/s, loss=0.669, v_num=1, val_acc=0.757]

Validation DataLoader 0:  10%|█         | 2/20 [00:00<00:00, 55.71it/s]
Epoch 88:  85%|████████▍ | 99/117 [00:05<00:00, 19.44it/s, loss=0.669, v_num=1, val_acc=0.757]

Validation DataLoader 0:  15%|█▌        | 3/20 [00:00<00:00, 44.35it/s]
Epoch 88:  85%|████████▌ | 100/117 [00:05<00:00, 19.52it/s, loss=0.669, v_num=1, val_acc=0.757]

Validation DataLoader 0:  20%|██        | 4/20 [00:00<00:00, 40.38it/s]
Epoch 88:  86%|████████▋ | 101/117 [00:05<00:00, 19.59it/s, loss=0.669, v_num=1, val_acc=0.757]

Validation DataLoader 0:  25%|██▌       | 5/20 [00:00<00:00, 38.17it/s]
Epoch 88:  87%|████████▋ | 102/117 [00:05<00:00, 19.66it/s, loss=0.669, v_num=1, val_acc=0.757]

Validation DataLoader 0:  30%|███       | 6/20 [00:00<00:00, 36.85it/s]
Epoch 88:  88%|████████▊ | 103/117 [00:05<00:00, 19.73it/s, loss=0.669, v_num=1, val_acc=0.757]

Validation DataLoader 0:  35%|███▌      | 7/20 [00:00<00:00, 36.02it/s]
Epoch 88:  89%|████████▉ | 104/117 [00:05<00:00, 19.81it/s, loss=0.669, v_num=1, val_acc=0.757]

Validation DataLoader 0:  40%|████      | 8/20 [00:00<00:00, 35.42it/s]
Epoch 88:  90%|████████▉ | 105/117 [00:05<00:00, 19.88it/s, loss=0.669, v_num=1, val_acc=0.757]

Validation DataLoader 0:  45%|████▌     | 9/20 [00:00<00:00, 34.93it/s]
Epoch 88:  91%|█████████ | 106/117 [00:05<00:00, 19.95it/s, loss=0.669, v_num=1, val_acc=0.757]

Validation DataLoader 0:  50%|█████     | 10/20 [00:00<00:00, 34.55it/s]
Epoch 88:  91%|█████████▏| 107/117 [00:05<00:00, 20.02it/s, loss=0.669, v_num=1, val_acc=0.757]

Validation DataLoader 0:  55%|█████▌    | 11/20 [00:00<00:00, 34.27it/s]
Epoch 88:  92%|█████████▏| 108/117 [00:05<00:00, 20.08it/s, loss=0.669, v_num=1, val_acc=0.757]

Validation DataLoader 0:  60%|██████    | 12/20 [00:00<00:00, 34.03it/s]
Epoch 88:  93%|█████████▎| 109/117 [00:05<00:00, 20.15it/s, loss=0.669, v_num=1, val_acc=0.757]

Validation DataLoader 0:  65%|██████▌   | 13/20 [00:00<00:00, 33.81it/s]
Epoch 88:  94%|█████████▍| 110/117 [00:05<00:00, 20.22it/s, loss=0.669, v_num=1, val_acc=0.757]

Validation DataLoader 0:  70%|███████   | 14/20 [00:00<00:00, 33.65it/s]
Epoch 88:  95%|█████████▍| 111/117 [00:05<00:00, 20.28it/s, loss=0.669, v_num=1, val_acc=0.757]

Validation DataLoader 0:  75%|███████▌  | 15/20 [00:00<00:00, 33.50it/s]
Epoch 88:  96%|█████████▌| 112/117 [00:05<00:00, 20.35it/s, loss=0.669, v_num=1, val_acc=0.757]

Validation DataLoader 0:  80%|████████  | 16/20 [00:00<00:00, 33.37it/s]
Epoch 88:  97%|█████████▋| 113/117 [00:05<00:00, 20.41it/s, loss=0.669, v_num=1, val_acc=0.757]

Validation DataLoader 0:  85%|████████▌ | 17/20 [00:00<00:00, 33.24it/s]
Epoch 88:  97%|█████████▋| 114/117 [00:05<00:00, 20.47it/s, loss=0.669, v_num=1, val_acc=0.757]

Validation DataLoader 0:  90%|█████████ | 18/20 [00:00<00:00, 33.15it/s]
Epoch 88:  98%|█████████▊| 115/117 [00:05<00:00, 20.54it/s, loss=0.669, v_num=1, val_acc=0.757]

Validation DataLoader 0:  95%|█████████▌| 19/20 [00:00<00:00, 33.07it/s]
Epoch 88:  99%|█████████▉| 116/117 [00:05<00:00, 20.60it/s, loss=0.669, v_num=1, val_acc=0.757]

Validation DataLoader 0: 100%|██████████| 20/20 [00:00<00:00, 33.06it/s]
Epoch 88: 100%|██████████| 117/117 [00:05<00:00, 20.67it/s, loss=0.669, v_num=1, val_acc=0.757]
Epoch 88: 100%|██████████| 117/117 [00:05<00:00, 20.59it/s, loss=0.669, v_num=1, val_acc=0.755]


Epoch 88: 100%|██████████| 117/117 [00:05<00:00, 20.59it/s, loss=0.669, v_num=1, val_acc=0.755]
Epoch 88:   0%|          | 0/117 [00:00<?, ?it/s, loss=0.669, v_num=1, val_acc=0.755]
Epoch 89:   0%|          | 0/117 [00:00<?, ?it/s, loss=0.669, v_num=1, val_acc=0.755]
Epoch 89:   1%|          | 1/117 [00:00<01:42,  1.13it/s, loss=0.669, v_num=1, val_acc=0.755]
Epoch 89:   1%|          | 1/117 [00:00<01:44,  1.11it/s, loss=0.668, v_num=1, val_acc=0.755]
Epoch 89:   2%|▏         | 2/117 [00:00<00:52,  2.19it/s, loss=0.668, v_num=1, val_acc=0.755]
Epoch 89:   2%|▏         | 2/117 [00:00<00:54,  2.13it/s, loss=0.673, v_num=1, val_acc=0.755]
Epoch 89:   3%|▎         | 3/117 [00:00<00:36,  3.16it/s, loss=0.673, v_num=1, val_acc=0.755]
Epoch 89:   3%|▎         | 3/117 [00:00<00:37,  3.08it/s, loss=0.676, v_num=1, val_acc=0.755]
Epoch 89:   3%|▎         | 4/117 [00:00<00:27,  4.07it/s, loss=0.676, v_num=1, val_acc=0.755]
Epoch 89:   3%|▎         | 4/117 [00:01<00:28,  3.96it/s, loss=0.674, v_num=1, val_acc=0.755]
Epoch 89:   4%|▍         | 5/117 [00:01<00:22,  4.91it/s, loss=0.674, v_num=1, val_acc=0.755]
Epoch 89:   4%|▍         | 5/117 [00:01<00:23,  4.79it/s, loss=0.668, v_num=1, val_acc=0.755]
Epoch 89:   5%|▌         | 6/117 [00:01<00:19,  5.70it/s, loss=0.668, v_num=1, val_acc=0.755]
Epoch 89:   5%|▌         | 6/117 [00:01<00:19,  5.56it/s, loss=0.666, v_num=1, val_acc=0.755]
Epoch 89:   6%|▌         | 7/117 [00:01<00:17,  6.43it/s, loss=0.666, v_num=1, val_acc=0.755]
Epoch 89:   6%|▌         | 7/117 [00:01<00:17,  6.28it/s, loss=0.667, v_num=1, val_acc=0.755]
Epoch 89:   7%|▋         | 8/117 [00:01<00:15,  7.13it/s, loss=0.667, v_num=1, val_acc=0.755]
Epoch 89:   7%|▋         | 8/117 [00:01<00:15,  6.97it/s, loss=0.673, v_num=1, val_acc=0.755]
Epoch 89:   8%|▊         | 9/117 [00:01<00:13,  7.78it/s, loss=0.673, v_num=1, val_acc=0.755]
Epoch 89:   8%|▊         | 9/117 [00:01<00:14,  7.61it/s, loss=0.675, v_num=1, val_acc=0.755]
Epoch 89:   9%|▊         | 10/117 [00:01<00:12,  8.35it/s, loss=0.675, v_num=1, val_acc=0.755]
Epoch 89:   9%|▊         | 10/117 [00:01<00:13,  8.18it/s, loss=0.678, v_num=1, val_acc=0.755]
Epoch 89:   9%|▉         | 11/117 [00:01<00:11,  8.94it/s, loss=0.678, v_num=1, val_acc=0.755]
Epoch 89:   9%|▉         | 11/117 [00:01<00:12,  8.76it/s, loss=0.682, v_num=1, val_acc=0.755]
Epoch 89:  10%|█         | 12/117 [00:01<00:11,  9.49it/s, loss=0.682, v_num=1, val_acc=0.755]
Epoch 89:  10%|█         | 12/117 [00:01<00:11,  9.30it/s, loss=0.686, v_num=1, val_acc=0.755]
Epoch 89:  11%|█         | 13/117 [00:01<00:10, 10.01it/s, loss=0.686, v_num=1, val_acc=0.755]
Epoch 89:  11%|█         | 13/117 [00:01<00:10,  9.82it/s, loss=0.687, v_num=1, val_acc=0.755]
Epoch 89:  12%|█▏        | 14/117 [00:01<00:09, 10.51it/s, loss=0.687, v_num=1, val_acc=0.755]
Epoch 89:  12%|█▏        | 14/117 [00:01<00:09, 10.31it/s, loss=0.693, v_num=1, val_acc=0.755]
Epoch 89:  13%|█▎        | 15/117 [00:01<00:09, 10.98it/s, loss=0.693, v_num=1, val_acc=0.755]
Epoch 89:  13%|█▎        | 15/117 [00:01<00:09, 10.78it/s, loss=0.687, v_num=1, val_acc=0.755]
Epoch 89:  14%|█▎        | 16/117 [00:01<00:08, 11.43it/s, loss=0.687, v_num=1, val_acc=0.755]
Epoch 89:  14%|█▎        | 16/117 [00:01<00:08, 11.23it/s, loss=0.689, v_num=1, val_acc=0.755]
Epoch 89:  15%|█▍        | 17/117 [00:01<00:08, 11.85it/s, loss=0.689, v_num=1, val_acc=0.755]
Epoch 89:  15%|█▍        | 17/117 [00:01<00:08, 11.65it/s, loss=0.688, v_num=1, val_acc=0.755]
Epoch 89:  15%|█▌        | 18/117 [00:01<00:08, 12.23it/s, loss=0.688, v_num=1, val_acc=0.755]
Epoch 89:  15%|█▌        | 18/117 [00:01<00:08, 12.03it/s, loss=0.69, v_num=1, val_acc=0.755]
Epoch 89:  16%|█▌        | 19/117 [00:01<00:07, 12.61it/s, loss=0.69, v_num=1, val_acc=0.755]
Epoch 89:  16%|█▌        | 19/117 [00:01<00:07, 12.41it/s, loss=0.688, v_num=1, val_acc=0.755]
Epoch 89:  17%|█▋        | 20/117 [00:01<00:07, 12.99it/s, loss=0.688, v_num=1, val_acc=0.755]
Epoch 89:  17%|█▋        | 20/117 [00:01<00:07, 12.78it/s, loss=0.687, v_num=1, val_acc=0.755]
Epoch 89:  18%|█▊        | 21/117 [00:01<00:07, 13.34it/s, loss=0.687, v_num=1, val_acc=0.755]
Epoch 89:  18%|█▊        | 21/117 [00:01<00:07, 13.13it/s, loss=0.685, v_num=1, val_acc=0.755]
Epoch 89:  19%|█▉        | 22/117 [00:01<00:06, 13.68it/s, loss=0.685, v_num=1, val_acc=0.755]
Epoch 89:  19%|█▉        | 22/117 [00:01<00:07, 13.47it/s, loss=0.688, v_num=1, val_acc=0.755]
Epoch 89:  20%|█▉        | 23/117 [00:01<00:06, 14.00it/s, loss=0.688, v_num=1, val_acc=0.755]
Epoch 89:  20%|█▉        | 23/117 [00:01<00:06, 13.79it/s, loss=0.688, v_num=1, val_acc=0.755]
Epoch 89:  21%|██        | 24/117 [00:01<00:06, 14.31it/s, loss=0.688, v_num=1, val_acc=0.755]
Epoch 89:  21%|██        | 24/117 [00:01<00:06, 14.10it/s, loss=0.685, v_num=1, val_acc=0.755]
Epoch 89:  21%|██▏       | 25/117 [00:01<00:06, 14.60it/s, loss=0.685, v_num=1, val_acc=0.755]
Epoch 89:  21%|██▏       | 25/117 [00:01<00:06, 14.39it/s, loss=0.684, v_num=1, val_acc=0.755]
Epoch 89:  22%|██▏       | 26/117 [00:01<00:06, 14.82it/s, loss=0.684, v_num=1, val_acc=0.755]
Epoch 89:  22%|██▏       | 26/117 [00:01<00:06, 14.63it/s, loss=0.688, v_num=1, val_acc=0.755]
Epoch 89:  23%|██▎       | 27/117 [00:01<00:05, 15.12it/s, loss=0.688, v_num=1, val_acc=0.755]
Epoch 89:  23%|██▎       | 27/117 [00:01<00:06, 14.91it/s, loss=0.686, v_num=1, val_acc=0.755]
Epoch 89:  24%|██▍       | 28/117 [00:01<00:05, 15.39it/s, loss=0.686, v_num=1, val_acc=0.755]
Epoch 89:  24%|██▍       | 28/117 [00:01<00:05, 15.18it/s, loss=0.69, v_num=1, val_acc=0.755]
Epoch 89:  25%|██▍       | 29/117 [00:01<00:05, 15.64it/s, loss=0.69, v_num=1, val_acc=0.755]
Epoch 89:  25%|██▍       | 29/117 [00:01<00:05, 15.43it/s, loss=0.688, v_num=1, val_acc=0.755]
Epoch 89:  26%|██▌       | 30/117 [00:01<00:05, 15.84it/s, loss=0.688, v_num=1, val_acc=0.755]
Epoch 89:  26%|██▌       | 30/117 [00:01<00:05, 15.65it/s, loss=0.687, v_num=1, val_acc=0.755]
Epoch 89:  26%|██▋       | 31/117 [00:01<00:05, 16.06it/s, loss=0.687, v_num=1, val_acc=0.755]
Epoch 89:  26%|██▋       | 31/117 [00:01<00:05, 15.86it/s, loss=0.688, v_num=1, val_acc=0.755]
Epoch 89:  27%|██▋       | 32/117 [00:01<00:05, 16.29it/s, loss=0.688, v_num=1, val_acc=0.755]
Epoch 89:  27%|██▋       | 32/117 [00:01<00:05, 16.09it/s, loss=0.689, v_num=1, val_acc=0.755]
Epoch 89:  28%|██▊       | 33/117 [00:01<00:05, 16.51it/s, loss=0.689, v_num=1, val_acc=0.755]
Epoch 89:  28%|██▊       | 33/117 [00:02<00:05, 16.30it/s, loss=0.686, v_num=1, val_acc=0.755]
Epoch 89:  29%|██▉       | 34/117 [00:02<00:04, 16.71it/s, loss=0.686, v_num=1, val_acc=0.755]
Epoch 89:  29%|██▉       | 34/117 [00:02<00:05, 16.51it/s, loss=0.678, v_num=1, val_acc=0.755]
Epoch 89:  30%|██▉       | 35/117 [00:02<00:04, 16.93it/s, loss=0.678, v_num=1, val_acc=0.755]
Epoch 89:  30%|██▉       | 35/117 [00:02<00:04, 16.72it/s, loss=0.688, v_num=1, val_acc=0.755]
Epoch 89:  31%|███       | 36/117 [00:02<00:04, 17.12it/s, loss=0.688, v_num=1, val_acc=0.755]
Epoch 89:  31%|███       | 36/117 [00:02<00:04, 16.92it/s, loss=0.69, v_num=1, val_acc=0.755]
Epoch 89:  32%|███▏      | 37/117 [00:02<00:04, 17.30it/s, loss=0.69, v_num=1, val_acc=0.755]
Epoch 89:  32%|███▏      | 37/117 [00:02<00:04, 17.10it/s, loss=0.689, v_num=1, val_acc=0.755]
Epoch 89:  32%|███▏      | 38/117 [00:02<00:04, 17.49it/s, loss=0.689, v_num=1, val_acc=0.755]
Epoch 89:  32%|███▏      | 38/117 [00:02<00:04, 17.29it/s, loss=0.687, v_num=1, val_acc=0.755]
Epoch 89:  33%|███▎      | 39/117 [00:02<00:04, 17.66it/s, loss=0.687, v_num=1, val_acc=0.755]
Epoch 89:  33%|███▎      | 39/117 [00:02<00:04, 17.46it/s, loss=0.688, v_num=1, val_acc=0.755]
Epoch 89:  34%|███▍      | 40/117 [00:02<00:04, 17.83it/s, loss=0.688, v_num=1, val_acc=0.755]
Epoch 89:  34%|███▍      | 40/117 [00:02<00:04, 17.64it/s, loss=0.685, v_num=1, val_acc=0.755]
Epoch 89:  35%|███▌      | 41/117 [00:02<00:04, 18.00it/s, loss=0.685, v_num=1, val_acc=0.755]
Epoch 89:  35%|███▌      | 41/117 [00:02<00:04, 17.80it/s, loss=0.684, v_num=1, val_acc=0.755]
Epoch 89:  36%|███▌      | 42/117 [00:02<00:04, 18.16it/s, loss=0.684, v_num=1, val_acc=0.755]
Epoch 89:  36%|███▌      | 42/117 [00:02<00:04, 17.97it/s, loss=0.677, v_num=1, val_acc=0.755]
Epoch 89:  37%|███▋      | 43/117 [00:02<00:04, 18.32it/s, loss=0.677, v_num=1, val_acc=0.755]
Epoch 89:  37%|███▋      | 43/117 [00:02<00:04, 18.12it/s, loss=0.674, v_num=1, val_acc=0.755]
Epoch 89:  38%|███▊      | 44/117 [00:02<00:03, 18.47it/s, loss=0.674, v_num=1, val_acc=0.755]
Epoch 89:  38%|███▊      | 44/117 [00:02<00:03, 18.28it/s, loss=0.68, v_num=1, val_acc=0.755]
Epoch 89:  38%|███▊      | 45/117 [00:02<00:03, 18.61it/s, loss=0.68, v_num=1, val_acc=0.755]
Epoch 89:  38%|███▊      | 45/117 [00:02<00:03, 18.42it/s, loss=0.683, v_num=1, val_acc=0.755]
Epoch 89:  39%|███▉      | 46/117 [00:02<00:03, 18.76it/s, loss=0.683, v_num=1, val_acc=0.755]
Epoch 89:  39%|███▉      | 46/117 [00:02<00:03, 18.57it/s, loss=0.682, v_num=1, val_acc=0.755]
Epoch 89:  40%|████      | 47/117 [00:02<00:03, 18.83it/s, loss=0.682, v_num=1, val_acc=0.755]
Epoch 89:  40%|████      | 47/117 [00:02<00:03, 18.66it/s, loss=0.685, v_num=1, val_acc=0.755]
Epoch 89:  41%|████      | 48/117 [00:02<00:03, 18.94it/s, loss=0.685, v_num=1, val_acc=0.755]
Epoch 89:  41%|████      | 48/117 [00:02<00:03, 18.78it/s, loss=0.678, v_num=1, val_acc=0.755]
Epoch 89:  42%|████▏     | 49/117 [00:02<00:03, 19.10it/s, loss=0.678, v_num=1, val_acc=0.755]
Epoch 89:  42%|████▏     | 49/117 [00:02<00:03, 18.91it/s, loss=0.68, v_num=1, val_acc=0.755]
Epoch 89:  43%|████▎     | 50/117 [00:02<00:03, 19.23it/s, loss=0.68, v_num=1, val_acc=0.755]
Epoch 89:  43%|████▎     | 50/117 [00:02<00:03, 19.04it/s, loss=0.682, v_num=1, val_acc=0.755]
Epoch 89:  44%|████▎     | 51/117 [00:02<00:03, 19.36it/s, loss=0.682, v_num=1, val_acc=0.755]
Epoch 89:  44%|████▎     | 51/117 [00:02<00:03, 19.17it/s, loss=0.677, v_num=1, val_acc=0.755]
Epoch 89:  44%|████▍     | 52/117 [00:02<00:03, 19.48it/s, loss=0.677, v_num=1, val_acc=0.755]
Epoch 89:  44%|████▍     | 52/117 [00:02<00:03, 19.30it/s, loss=0.673, v_num=1, val_acc=0.755]
Epoch 89:  45%|████▌     | 53/117 [00:02<00:03, 19.60it/s, loss=0.673, v_num=1, val_acc=0.755]
Epoch 89:  45%|████▌     | 53/117 [00:02<00:03, 19.42it/s, loss=0.668, v_num=1, val_acc=0.755]
Epoch 89:  46%|████▌     | 54/117 [00:02<00:03, 19.72it/s, loss=0.668, v_num=1, val_acc=0.755]
Epoch 89:  46%|████▌     | 54/117 [00:02<00:03, 19.54it/s, loss=0.669, v_num=1, val_acc=0.755]
Epoch 89:  47%|████▋     | 55/117 [00:02<00:03, 19.84it/s, loss=0.669, v_num=1, val_acc=0.755]
Epoch 89:  47%|████▋     | 55/117 [00:02<00:03, 19.66it/s, loss=0.66, v_num=1, val_acc=0.755]
Epoch 89:  48%|████▊     | 56/117 [00:02<00:03, 19.95it/s, loss=0.66, v_num=1, val_acc=0.755]
Epoch 89:  48%|████▊     | 56/117 [00:02<00:03, 19.77it/s, loss=0.657, v_num=1, val_acc=0.755]
Epoch 89:  49%|████▊     | 57/117 [00:02<00:02, 20.06it/s, loss=0.657, v_num=1, val_acc=0.755]
Epoch 89:  49%|████▊     | 57/117 [00:02<00:03, 19.89it/s, loss=0.659, v_num=1, val_acc=0.755]
Epoch 89:  50%|████▉     | 58/117 [00:02<00:02, 20.17it/s, loss=0.659, v_num=1, val_acc=0.755]
Epoch 89:  50%|████▉     | 58/117 [00:02<00:02, 19.99it/s, loss=0.664, v_num=1, val_acc=0.755]
Epoch 89:  50%|█████     | 59/117 [00:02<00:02, 20.27it/s, loss=0.664, v_num=1, val_acc=0.755]
Epoch 89:  50%|█████     | 59/117 [00:02<00:02, 20.10it/s, loss=0.664, v_num=1, val_acc=0.755]
Epoch 89:  51%|█████▏    | 60/117 [00:02<00:02, 20.37it/s, loss=0.664, v_num=1, val_acc=0.755]
Epoch 89:  51%|█████▏    | 60/117 [00:02<00:02, 20.20it/s, loss=0.664, v_num=1, val_acc=0.755]
Epoch 89:  52%|█████▏    | 61/117 [00:02<00:02, 20.47it/s, loss=0.664, v_num=1, val_acc=0.755]
Epoch 89:  52%|█████▏    | 61/117 [00:03<00:02, 20.30it/s, loss=0.673, v_num=1, val_acc=0.755]
Epoch 89:  53%|█████▎    | 62/117 [00:03<00:02, 20.57it/s, loss=0.673, v_num=1, val_acc=0.755]
Epoch 89:  53%|█████▎    | 62/117 [00:03<00:02, 20.40it/s, loss=0.679, v_num=1, val_acc=0.755]
Epoch 89:  54%|█████▍    | 63/117 [00:03<00:02, 20.66it/s, loss=0.679, v_num=1, val_acc=0.755]
Epoch 89:  54%|█████▍    | 63/117 [00:03<00:02, 20.49it/s, loss=0.677, v_num=1, val_acc=0.755]
Epoch 89:  55%|█████▍    | 64/117 [00:03<00:02, 20.76it/s, loss=0.677, v_num=1, val_acc=0.755]
Epoch 89:  55%|█████▍    | 64/117 [00:03<00:02, 20.59it/s, loss=0.681, v_num=1, val_acc=0.755]
Epoch 89:  56%|█████▌    | 65/117 [00:03<00:02, 20.85it/s, loss=0.681, v_num=1, val_acc=0.755]
Epoch 89:  56%|█████▌    | 65/117 [00:03<00:02, 20.68it/s, loss=0.681, v_num=1, val_acc=0.755]
Epoch 89:  56%|█████▋    | 66/117 [00:03<00:02, 20.94it/s, loss=0.681, v_num=1, val_acc=0.755]
Epoch 89:  56%|█████▋    | 66/117 [00:03<00:02, 20.77it/s, loss=0.681, v_num=1, val_acc=0.755]
Epoch 89:  57%|█████▋    | 67/117 [00:03<00:02, 21.02it/s, loss=0.681, v_num=1, val_acc=0.755]
Epoch 89:  57%|█████▋    | 67/117 [00:03<00:02, 20.86it/s, loss=0.679, v_num=1, val_acc=0.755]
Epoch 89:  58%|█████▊    | 68/117 [00:03<00:02, 21.11it/s, loss=0.679, v_num=1, val_acc=0.755]
Epoch 89:  58%|█████▊    | 68/117 [00:03<00:02, 20.94it/s, loss=0.678, v_num=1, val_acc=0.755]
Epoch 89:  59%|█████▉    | 69/117 [00:03<00:02, 21.19it/s, loss=0.678, v_num=1, val_acc=0.755]
Epoch 89:  59%|█████▉    | 69/117 [00:03<00:02, 21.02it/s, loss=0.681, v_num=1, val_acc=0.755]
Epoch 89:  60%|█████▉    | 70/117 [00:03<00:02, 21.27it/s, loss=0.681, v_num=1, val_acc=0.755]
Epoch 89:  60%|█████▉    | 70/117 [00:03<00:02, 21.11it/s, loss=0.68, v_num=1, val_acc=0.755]
Epoch 89:  61%|██████    | 71/117 [00:03<00:02, 21.35it/s, loss=0.68, v_num=1, val_acc=0.755]
Epoch 89:  61%|██████    | 71/117 [00:03<00:02, 21.19it/s, loss=0.688, v_num=1, val_acc=0.755]
Epoch 89:  62%|██████▏   | 72/117 [00:03<00:02, 21.43it/s, loss=0.688, v_num=1, val_acc=0.755]
Epoch 89:  62%|██████▏   | 72/117 [00:03<00:02, 21.27it/s, loss=0.686, v_num=1, val_acc=0.755]
Epoch 89:  62%|██████▏   | 73/117 [00:03<00:02, 21.51it/s, loss=0.686, v_num=1, val_acc=0.755]
Epoch 89:  62%|██████▏   | 73/117 [00:03<00:02, 21.35it/s, loss=0.695, v_num=1, val_acc=0.755]
Epoch 89:  63%|██████▎   | 74/117 [00:03<00:01, 21.58it/s, loss=0.695, v_num=1, val_acc=0.755]
Epoch 89:  63%|██████▎   | 74/117 [00:03<00:02, 21.42it/s, loss=0.696, v_num=1, val_acc=0.755]
Epoch 89:  64%|██████▍   | 75/117 [00:03<00:01, 21.65it/s, loss=0.696, v_num=1, val_acc=0.755]
Epoch 89:  64%|██████▍   | 75/117 [00:03<00:01, 21.50it/s, loss=0.698, v_num=1, val_acc=0.755]
Epoch 89:  65%|██████▍   | 76/117 [00:03<00:01, 21.73it/s, loss=0.698, v_num=1, val_acc=0.755]
Epoch 89:  65%|██████▍   | 76/117 [00:03<00:01, 21.57it/s, loss=0.696, v_num=1, val_acc=0.755]
Epoch 89:  66%|██████▌   | 77/117 [00:03<00:01, 21.80it/s, loss=0.696, v_num=1, val_acc=0.755]
Epoch 89:  66%|██████▌   | 77/117 [00:03<00:01, 21.64it/s, loss=0.696, v_num=1, val_acc=0.755]
Epoch 89:  67%|██████▋   | 78/117 [00:03<00:01, 21.87it/s, loss=0.696, v_num=1, val_acc=0.755]
Epoch 89:  67%|██████▋   | 78/117 [00:03<00:01, 21.71it/s, loss=0.693, v_num=1, val_acc=0.755]
Epoch 89:  68%|██████▊   | 79/117 [00:03<00:01, 21.93it/s, loss=0.693, v_num=1, val_acc=0.755]
Epoch 89:  68%|██████▊   | 79/117 [00:03<00:01, 21.78it/s, loss=0.694, v_num=1, val_acc=0.755]
Epoch 89:  68%|██████▊   | 80/117 [00:03<00:01, 22.00it/s, loss=0.694, v_num=1, val_acc=0.755]
Epoch 89:  68%|██████▊   | 80/117 [00:03<00:01, 21.85it/s, loss=0.694, v_num=1, val_acc=0.755]
Epoch 89:  69%|██████▉   | 81/117 [00:03<00:01, 22.07it/s, loss=0.694, v_num=1, val_acc=0.755]
Epoch 89:  69%|██████▉   | 81/117 [00:03<00:01, 21.91it/s, loss=0.694, v_num=1, val_acc=0.755]
Epoch 89:  70%|███████   | 82/117 [00:03<00:01, 22.11it/s, loss=0.694, v_num=1, val_acc=0.755]
Epoch 89:  70%|███████   | 82/117 [00:03<00:01, 21.96it/s, loss=0.689, v_num=1, val_acc=0.755]
Epoch 89:  71%|███████   | 83/117 [00:03<00:01, 22.18it/s, loss=0.689, v_num=1, val_acc=0.755]
Epoch 89:  71%|███████   | 83/117 [00:03<00:01, 22.03it/s, loss=0.698, v_num=1, val_acc=0.755]
Epoch 89:  72%|███████▏  | 84/117 [00:03<00:01, 22.24it/s, loss=0.698, v_num=1, val_acc=0.755]
Epoch 89:  72%|███████▏  | 84/117 [00:03<00:01, 22.09it/s, loss=0.694, v_num=1, val_acc=0.755]
Epoch 89:  73%|███████▎  | 85/117 [00:03<00:01, 22.30it/s, loss=0.694, v_num=1, val_acc=0.755]
Epoch 89:  73%|███████▎  | 85/117 [00:03<00:01, 22.16it/s, loss=0.696, v_num=1, val_acc=0.755]
Epoch 89:  74%|███████▎  | 86/117 [00:03<00:01, 22.34it/s, loss=0.696, v_num=1, val_acc=0.755]
Epoch 89:  74%|███████▎  | 86/117 [00:03<00:01, 22.20it/s, loss=0.692, v_num=1, val_acc=0.755]
Epoch 89:  74%|███████▍  | 87/117 [00:03<00:01, 22.41it/s, loss=0.692, v_num=1, val_acc=0.755]
Epoch 89:  74%|███████▍  | 87/117 [00:03<00:01, 22.26it/s, loss=0.695, v_num=1, val_acc=0.755]
Epoch 89:  75%|███████▌  | 88/117 [00:03<00:01, 22.47it/s, loss=0.695, v_num=1, val_acc=0.755]
Epoch 89:  75%|███████▌  | 88/117 [00:03<00:01, 22.32it/s, loss=0.693, v_num=1, val_acc=0.755]
Epoch 89:  76%|███████▌  | 89/117 [00:03<00:01, 22.53it/s, loss=0.693, v_num=1, val_acc=0.755]
Epoch 89:  76%|███████▌  | 89/117 [00:03<00:01, 22.38it/s, loss=0.69, v_num=1, val_acc=0.755]
Epoch 89:  77%|███████▋  | 90/117 [00:03<00:01, 22.58it/s, loss=0.69, v_num=1, val_acc=0.755]
Epoch 89:  77%|███████▋  | 90/117 [00:04<00:01, 22.44it/s, loss=0.683, v_num=1, val_acc=0.755]
Epoch 89:  78%|███████▊  | 91/117 [00:04<00:01, 22.64it/s, loss=0.683, v_num=1, val_acc=0.755]
Epoch 89:  78%|███████▊  | 91/117 [00:04<00:01, 22.50it/s, loss=0.68, v_num=1, val_acc=0.755]
Epoch 89:  79%|███████▊  | 92/117 [00:04<00:01, 22.69it/s, loss=0.68, v_num=1, val_acc=0.755]
Epoch 89:  79%|███████▊  | 92/117 [00:04<00:01, 22.55it/s, loss=0.686, v_num=1, val_acc=0.755]
Epoch 89:  79%|███████▉  | 93/117 [00:04<00:01, 22.75it/s, loss=0.686, v_num=1, val_acc=0.755]
Epoch 89:  79%|███████▉  | 93/117 [00:04<00:01, 22.60it/s, loss=0.684, v_num=1, val_acc=0.755]
Epoch 89:  80%|████████  | 94/117 [00:04<00:01, 22.80it/s, loss=0.684, v_num=1, val_acc=0.755]
Epoch 89:  80%|████████  | 94/117 [00:04<00:01, 22.66it/s, loss=0.681, v_num=1, val_acc=0.755]
Epoch 89:  81%|████████  | 95/117 [00:04<00:00, 22.85it/s, loss=0.681, v_num=1, val_acc=0.755]
Epoch 89:  81%|████████  | 95/117 [00:04<00:00, 22.71it/s, loss=0.684, v_num=1, val_acc=0.755]
Epoch 89:  82%|████████▏ | 96/117 [00:04<00:00, 22.90it/s, loss=0.684, v_num=1, val_acc=0.755]
Epoch 89:  82%|████████▏ | 96/117 [00:04<00:00, 22.76it/s, loss=0.688, v_num=1, val_acc=0.755]
Epoch 89:  83%|████████▎ | 97/117 [00:04<00:00, 22.95it/s, loss=0.688, v_num=1, val_acc=0.755]
Epoch 89:  83%|████████▎ | 97/117 [00:04<00:00, 22.81it/s, loss=0.689, v_num=1, val_acc=0.755]

Validation: 0it [00:00, ?it/s]

Validation:   0%|          | 0/20 [00:00<?, ?it/s]

Validation DataLoader 0:   0%|          | 0/20 [00:00<?, ?it/s]

Validation DataLoader 0:   5%|▌         | 1/20 [00:00<00:00, 161.99it/s]
Epoch 89:  84%|████████▍ | 98/117 [00:05<00:00, 19.14it/s, loss=0.689, v_num=1, val_acc=0.755]

Validation DataLoader 0:  10%|█         | 2/20 [00:00<00:00, 54.32it/s]
Epoch 89:  85%|████████▍ | 99/117 [00:05<00:00, 19.22it/s, loss=0.689, v_num=1, val_acc=0.755]

Validation DataLoader 0:  15%|█▌        | 3/20 [00:00<00:00, 43.72it/s]
Epoch 89:  85%|████████▌ | 100/117 [00:05<00:00, 19.29it/s, loss=0.689, v_num=1, val_acc=0.755]

Validation DataLoader 0:  20%|██        | 4/20 [00:00<00:00, 39.78it/s]
Epoch 89:  86%|████████▋ | 101/117 [00:05<00:00, 19.37it/s, loss=0.689, v_num=1, val_acc=0.755]

Validation DataLoader 0:  25%|██▌       | 5/20 [00:00<00:00, 37.68it/s]
Epoch 89:  87%|████████▋ | 102/117 [00:05<00:00, 19.44it/s, loss=0.689, v_num=1, val_acc=0.755]

Validation DataLoader 0:  30%|███       | 6/20 [00:00<00:00, 36.45it/s]
Epoch 89:  88%|████████▊ | 103/117 [00:05<00:00, 19.51it/s, loss=0.689, v_num=1, val_acc=0.755]

Validation DataLoader 0:  35%|███▌      | 7/20 [00:00<00:00, 35.66it/s]
Epoch 89:  89%|████████▉ | 104/117 [00:05<00:00, 19.58it/s, loss=0.689, v_num=1, val_acc=0.755]

Validation DataLoader 0:  40%|████      | 8/20 [00:00<00:00, 35.09it/s]
Epoch 89:  90%|████████▉ | 105/117 [00:05<00:00, 19.65it/s, loss=0.689, v_num=1, val_acc=0.755]

Validation DataLoader 0:  45%|████▌     | 9/20 [00:00<00:00, 34.15it/s]
Epoch 89:  91%|█████████ | 106/117 [00:05<00:00, 19.71it/s, loss=0.689, v_num=1, val_acc=0.755]

Validation DataLoader 0:  50%|█████     | 10/20 [00:00<00:00, 34.09it/s]
Epoch 89:  91%|█████████▏| 107/117 [00:05<00:00, 19.79it/s, loss=0.689, v_num=1, val_acc=0.755]

Validation DataLoader 0:  55%|█████▌    | 11/20 [00:00<00:00, 33.84it/s]
Epoch 89:  92%|█████████▏| 108/117 [00:05<00:00, 19.86it/s, loss=0.689, v_num=1, val_acc=0.755]

Validation DataLoader 0:  60%|██████    | 12/20 [00:00<00:00, 33.64it/s]
Epoch 89:  93%|█████████▎| 109/117 [00:05<00:00, 19.92it/s, loss=0.689, v_num=1, val_acc=0.755]

Validation DataLoader 0:  65%|██████▌   | 13/20 [00:00<00:00, 33.48it/s]
Epoch 89:  94%|█████████▍| 110/117 [00:05<00:00, 19.99it/s, loss=0.689, v_num=1, val_acc=0.755]

Validation DataLoader 0:  70%|███████   | 14/20 [00:00<00:00, 33.33it/s]
Epoch 89:  95%|█████████▍| 111/117 [00:05<00:00, 20.06it/s, loss=0.689, v_num=1, val_acc=0.755]

Validation DataLoader 0:  75%|███████▌  | 15/20 [00:00<00:00, 33.20it/s]
Epoch 89:  96%|█████████▌| 112/117 [00:05<00:00, 20.12it/s, loss=0.689, v_num=1, val_acc=0.755]

Validation DataLoader 0:  80%|████████  | 16/20 [00:00<00:00, 33.10it/s]
Epoch 89:  97%|█████████▋| 113/117 [00:05<00:00, 20.19it/s, loss=0.689, v_num=1, val_acc=0.755]

Validation DataLoader 0:  85%|████████▌ | 17/20 [00:00<00:00, 32.96it/s]
Epoch 89:  97%|█████████▋| 114/117 [00:05<00:00, 20.25it/s, loss=0.689, v_num=1, val_acc=0.755]

Validation DataLoader 0:  90%|█████████ | 18/20 [00:00<00:00, 32.90it/s]
Epoch 89:  98%|█████████▊| 115/117 [00:05<00:00, 20.31it/s, loss=0.689, v_num=1, val_acc=0.755]

Validation DataLoader 0:  95%|█████████▌| 19/20 [00:00<00:00, 32.82it/s]
Epoch 89:  99%|█████████▉| 116/117 [00:05<00:00, 20.38it/s, loss=0.689, v_num=1, val_acc=0.755]

Validation DataLoader 0: 100%|██████████| 20/20 [00:00<00:00, 32.83it/s]
Epoch 89: 100%|██████████| 117/117 [00:05<00:00, 20.44it/s, loss=0.689, v_num=1, val_acc=0.755]
Epoch 89: 100%|██████████| 117/117 [00:05<00:00, 20.37it/s, loss=0.689, v_num=1, val_acc=0.757]


Epoch 89: 100%|██████████| 117/117 [00:05<00:00, 20.37it/s, loss=0.689, v_num=1, val_acc=0.757]
Epoch 89:   0%|          | 0/117 [00:00<?, ?it/s, loss=0.689, v_num=1, val_acc=0.757]
Epoch 90:   0%|          | 0/117 [00:00<?, ?it/s, loss=0.689, v_num=1, val_acc=0.757]
Epoch 90:   1%|          | 1/117 [00:00<01:44,  1.11it/s, loss=0.689, v_num=1, val_acc=0.757]
Epoch 90:   1%|          | 1/117 [00:00<01:46,  1.09it/s, loss=0.688, v_num=1, val_acc=0.757]
Epoch 90:   2%|▏         | 2/117 [00:00<00:53,  2.15it/s, loss=0.688, v_num=1, val_acc=0.757]
Epoch 90:   2%|▏         | 2/117 [00:00<00:54,  2.09it/s, loss=0.69, v_num=1, val_acc=0.757]
Epoch 90:   3%|▎         | 3/117 [00:00<00:36,  3.11it/s, loss=0.69, v_num=1, val_acc=0.757]
Epoch 90:   3%|▎         | 3/117 [00:00<00:37,  3.03it/s, loss=0.693, v_num=1, val_acc=0.757]
Epoch 90:   3%|▎         | 4/117 [00:00<00:28,  4.00it/s, loss=0.693, v_num=1, val_acc=0.757]
Epoch 90:   3%|▎         | 4/117 [00:01<00:28,  3.90it/s, loss=0.688, v_num=1, val_acc=0.757]
Epoch 90:   4%|▍         | 5/117 [00:01<00:23,  4.84it/s, loss=0.688, v_num=1, val_acc=0.757]
Epoch 90:   4%|▍         | 5/117 [00:01<00:23,  4.72it/s, loss=0.688, v_num=1, val_acc=0.757]
Epoch 90:   5%|▌         | 6/117 [00:01<00:19,  5.60it/s, loss=0.688, v_num=1, val_acc=0.757]
Epoch 90:   5%|▌         | 6/117 [00:01<00:20,  5.48it/s, loss=0.683, v_num=1, val_acc=0.757]
Epoch 90:   6%|▌         | 7/117 [00:01<00:17,  6.34it/s, loss=0.683, v_num=1, val_acc=0.757]
Epoch 90:   6%|▌         | 7/117 [00:01<00:17,  6.19it/s, loss=0.684, v_num=1, val_acc=0.757]
Epoch 90:   7%|▋         | 8/117 [00:01<00:15,  7.02it/s, loss=0.684, v_num=1, val_acc=0.757]
Epoch 90:   7%|▋         | 8/117 [00:01<00:15,  6.87it/s, loss=0.676, v_num=1, val_acc=0.757]
Epoch 90:   8%|▊         | 9/117 [00:01<00:14,  7.65it/s, loss=0.676, v_num=1, val_acc=0.757]
Epoch 90:   8%|▊         | 9/117 [00:01<00:14,  7.49it/s, loss=0.684, v_num=1, val_acc=0.757]
Epoch 90:   9%|▊         | 10/117 [00:01<00:12,  8.26it/s, loss=0.684, v_num=1, val_acc=0.757]
Epoch 90:   9%|▊         | 10/117 [00:01<00:13,  8.10it/s, loss=0.682, v_num=1, val_acc=0.757]
Epoch 90:   9%|▉         | 11/117 [00:01<00:11,  8.84it/s, loss=0.682, v_num=1, val_acc=0.757]
Epoch 90:   9%|▉         | 11/117 [00:01<00:12,  8.67it/s, loss=0.684, v_num=1, val_acc=0.757]
Epoch 90:  10%|█         | 12/117 [00:01<00:11,  9.38it/s, loss=0.684, v_num=1, val_acc=0.757]
Epoch 90:  10%|█         | 12/117 [00:01<00:11,  9.20it/s, loss=0.685, v_num=1, val_acc=0.757]
Epoch 90:  11%|█         | 13/117 [00:01<00:10,  9.89it/s, loss=0.685, v_num=1, val_acc=0.757]
Epoch 90:  11%|█         | 13/117 [00:01<00:10,  9.71it/s, loss=0.691, v_num=1, val_acc=0.757]
Epoch 90:  12%|█▏        | 14/117 [00:01<00:09, 10.38it/s, loss=0.691, v_num=1, val_acc=0.757]
Epoch 90:  12%|█▏        | 14/117 [00:01<00:10, 10.19it/s, loss=0.685, v_num=1, val_acc=0.757]
Epoch 90:  13%|█▎        | 15/117 [00:01<00:09, 10.85it/s, loss=0.685, v_num=1, val_acc=0.757]
Epoch 90:  13%|█▎        | 15/117 [00:01<00:09, 10.65it/s, loss=0.687, v_num=1, val_acc=0.757]
Epoch 90:  14%|█▎        | 16/117 [00:01<00:08, 11.30it/s, loss=0.687, v_num=1, val_acc=0.757]
Epoch 90:  14%|█▎        | 16/117 [00:01<00:09, 11.10it/s, loss=0.688, v_num=1, val_acc=0.757]
Epoch 90:  15%|█▍        | 17/117 [00:01<00:08, 11.70it/s, loss=0.688, v_num=1, val_acc=0.757]
Epoch 90:  15%|█▍        | 17/117 [00:01<00:08, 11.50it/s, loss=0.687, v_num=1, val_acc=0.757]
Epoch 90:  15%|█▌        | 18/117 [00:01<00:08, 12.11it/s, loss=0.687, v_num=1, val_acc=0.757]
Epoch 90:  15%|█▌        | 18/117 [00:01<00:08, 11.91it/s, loss=0.686, v_num=1, val_acc=0.757]
Epoch 90:  16%|█▌        | 19/117 [00:01<00:07, 12.50it/s, loss=0.686, v_num=1, val_acc=0.757]
Epoch 90:  16%|█▌        | 19/117 [00:01<00:07, 12.29it/s, loss=0.681, v_num=1, val_acc=0.757]
Epoch 90:  17%|█▋        | 20/117 [00:01<00:07, 12.87it/s, loss=0.681, v_num=1, val_acc=0.757]
Epoch 90:  17%|█▋        | 20/117 [00:01<00:07, 12.66it/s, loss=0.679, v_num=1, val_acc=0.757]
Epoch 90:  18%|█▊        | 21/117 [00:01<00:07, 13.21it/s, loss=0.679, v_num=1, val_acc=0.757]
Epoch 90:  18%|█▊        | 21/117 [00:01<00:07, 13.00it/s, loss=0.688, v_num=1, val_acc=0.757]
Epoch 90:  19%|█▉        | 22/117 [00:01<00:07, 13.54it/s, loss=0.688, v_num=1, val_acc=0.757]
Epoch 90:  19%|█▉        | 22/117 [00:01<00:07, 13.34it/s, loss=0.684, v_num=1, val_acc=0.757]
Epoch 90:  20%|█▉        | 23/117 [00:01<00:06, 13.86it/s, loss=0.684, v_num=1, val_acc=0.757]
Epoch 90:  20%|█▉        | 23/117 [00:01<00:06, 13.66it/s, loss=0.681, v_num=1, val_acc=0.757]
Epoch 90:  21%|██        | 24/117 [00:01<00:06, 14.17it/s, loss=0.681, v_num=1, val_acc=0.757]
Epoch 90:  21%|██        | 24/117 [00:01<00:06, 13.96it/s, loss=0.68, v_num=1, val_acc=0.757]
Epoch 90:  21%|██▏       | 25/117 [00:01<00:06, 14.47it/s, loss=0.68, v_num=1, val_acc=0.757]
Epoch 90:  21%|██▏       | 25/117 [00:01<00:06, 14.26it/s, loss=0.683, v_num=1, val_acc=0.757]
Epoch 90:  22%|██▏       | 26/117 [00:01<00:06, 14.75it/s, loss=0.683, v_num=1, val_acc=0.757]
Epoch 90:  22%|██▏       | 26/117 [00:01<00:06, 14.55it/s, loss=0.685, v_num=1, val_acc=0.757]
Epoch 90:  23%|██▎       | 27/117 [00:01<00:05, 15.03it/s, loss=0.685, v_num=1, val_acc=0.757]
Epoch 90:  23%|██▎       | 27/117 [00:01<00:06, 14.82it/s, loss=0.688, v_num=1, val_acc=0.757]
Epoch 90:  24%|██▍       | 28/117 [00:01<00:05, 15.29it/s, loss=0.688, v_num=1, val_acc=0.757]
Epoch 90:  24%|██▍       | 28/117 [00:01<00:05, 15.08it/s, loss=0.694, v_num=1, val_acc=0.757]
Epoch 90:  25%|██▍       | 29/117 [00:01<00:05, 15.55it/s, loss=0.694, v_num=1, val_acc=0.757]
Epoch 90:  25%|██▍       | 29/117 [00:01<00:05, 15.34it/s, loss=0.689, v_num=1, val_acc=0.757]
Epoch 90:  26%|██▌       | 30/117 [00:01<00:05, 15.79it/s, loss=0.689, v_num=1, val_acc=0.757]
Epoch 90:  26%|██▌       | 30/117 [00:01<00:05, 15.58it/s, loss=0.691, v_num=1, val_acc=0.757]
Epoch 90:  26%|██▋       | 31/117 [00:01<00:05, 16.03it/s, loss=0.691, v_num=1, val_acc=0.757]
Epoch 90:  26%|██▋       | 31/117 [00:01<00:05, 15.82it/s, loss=0.695, v_num=1, val_acc=0.757]
Epoch 90:  27%|██▋       | 32/117 [00:01<00:05, 16.25it/s, loss=0.695, v_num=1, val_acc=0.757]
Epoch 90:  27%|██▋       | 32/117 [00:01<00:05, 16.05it/s, loss=0.695, v_num=1, val_acc=0.757]
Epoch 90:  28%|██▊       | 33/117 [00:02<00:05, 16.47it/s, loss=0.695, v_num=1, val_acc=0.757]
Epoch 90:  28%|██▊       | 33/117 [00:02<00:05, 16.27it/s, loss=0.698, v_num=1, val_acc=0.757]
Epoch 90:  29%|██▉       | 34/117 [00:02<00:04, 16.68it/s, loss=0.698, v_num=1, val_acc=0.757]
Epoch 90:  29%|██▉       | 34/117 [00:02<00:05, 16.48it/s, loss=0.702, v_num=1, val_acc=0.757]
Epoch 90:  30%|██▉       | 35/117 [00:02<00:04, 16.89it/s, loss=0.702, v_num=1, val_acc=0.757]
Epoch 90:  30%|██▉       | 35/117 [00:02<00:04, 16.68it/s, loss=0.697, v_num=1, val_acc=0.757]
Epoch 90:  31%|███       | 36/117 [00:02<00:04, 17.09it/s, loss=0.697, v_num=1, val_acc=0.757]
Epoch 90:  31%|███       | 36/117 [00:02<00:04, 16.88it/s, loss=0.692, v_num=1, val_acc=0.757]
Epoch 90:  32%|███▏      | 37/117 [00:02<00:04, 17.28it/s, loss=0.692, v_num=1, val_acc=0.757]
Epoch 90:  32%|███▏      | 37/117 [00:02<00:04, 17.08it/s, loss=0.693, v_num=1, val_acc=0.757]
Epoch 90:  32%|███▏      | 38/117 [00:02<00:04, 17.46it/s, loss=0.693, v_num=1, val_acc=0.757]
Epoch 90:  32%|███▏      | 38/117 [00:02<00:04, 17.26it/s, loss=0.691, v_num=1, val_acc=0.757]
Epoch 90:  33%|███▎      | 39/117 [00:02<00:04, 17.64it/s, loss=0.691, v_num=1, val_acc=0.757]
Epoch 90:  33%|███▎      | 39/117 [00:02<00:04, 17.44it/s, loss=0.693, v_num=1, val_acc=0.757]
Epoch 90:  34%|███▍      | 40/117 [00:02<00:04, 17.82it/s, loss=0.693, v_num=1, val_acc=0.757]
Epoch 90:  34%|███▍      | 40/117 [00:02<00:04, 17.62it/s, loss=0.691, v_num=1, val_acc=0.757]
Epoch 90:  35%|███▌      | 41/117 [00:02<00:04, 17.99it/s, loss=0.691, v_num=1, val_acc=0.757]
Epoch 90:  35%|███▌      | 41/117 [00:02<00:04, 17.79it/s, loss=0.685, v_num=1, val_acc=0.757]
Epoch 90:  36%|███▌      | 42/117 [00:02<00:04, 18.15it/s, loss=0.685, v_num=1, val_acc=0.757]
Epoch 90:  36%|███▌      | 42/117 [00:02<00:04, 17.96it/s, loss=0.686, v_num=1, val_acc=0.757]
Epoch 90:  37%|███▋      | 43/117 [00:02<00:04, 18.31it/s, loss=0.686, v_num=1, val_acc=0.757]
Epoch 90:  37%|███▋      | 43/117 [00:02<00:04, 18.12it/s, loss=0.691, v_num=1, val_acc=0.757]
Epoch 90:  38%|███▊      | 44/117 [00:02<00:03, 18.47it/s, loss=0.691, v_num=1, val_acc=0.757]
Epoch 90:  38%|███▊      | 44/117 [00:02<00:03, 18.27it/s, loss=0.694, v_num=1, val_acc=0.757]
Epoch 90:  38%|███▊      | 45/117 [00:02<00:03, 18.62it/s, loss=0.694, v_num=1, val_acc=0.757]
Epoch 90:  38%|███▊      | 45/117 [00:02<00:03, 18.42it/s, loss=0.694, v_num=1, val_acc=0.757]
Epoch 90:  39%|███▉      | 46/117 [00:02<00:03, 18.76it/s, loss=0.694, v_num=1, val_acc=0.757]
Epoch 90:  39%|███▉      | 46/117 [00:02<00:03, 18.57it/s, loss=0.694, v_num=1, val_acc=0.757]
Epoch 90:  40%|████      | 47/117 [00:02<00:03, 18.90it/s, loss=0.694, v_num=1, val_acc=0.757]
Epoch 90:  40%|████      | 47/117 [00:02<00:03, 18.72it/s, loss=0.688, v_num=1, val_acc=0.757]
Epoch 90:  41%|████      | 48/117 [00:02<00:03, 19.04it/s, loss=0.688, v_num=1, val_acc=0.757]
Epoch 90:  41%|████      | 48/117 [00:02<00:03, 18.85it/s, loss=0.687, v_num=1, val_acc=0.757]
Epoch 90:  42%|████▏     | 49/117 [00:02<00:03, 19.18it/s, loss=0.687, v_num=1, val_acc=0.757]
Epoch 90:  42%|████▏     | 49/117 [00:02<00:03, 18.99it/s, loss=0.689, v_num=1, val_acc=0.757]
Epoch 90:  43%|████▎     | 50/117 [00:02<00:03, 19.30it/s, loss=0.689, v_num=1, val_acc=0.757]
Epoch 90:  43%|████▎     | 50/117 [00:02<00:03, 19.12it/s, loss=0.688, v_num=1, val_acc=0.757]
Epoch 90:  44%|████▎     | 51/117 [00:02<00:03, 19.43it/s, loss=0.688, v_num=1, val_acc=0.757]
Epoch 90:  44%|████▎     | 51/117 [00:02<00:03, 19.25it/s, loss=0.685, v_num=1, val_acc=0.757]
Epoch 90:  44%|████▍     | 52/117 [00:02<00:03, 19.56it/s, loss=0.685, v_num=1, val_acc=0.757]
Epoch 90:  44%|████▍     | 52/117 [00:02<00:03, 19.37it/s, loss=0.687, v_num=1, val_acc=0.757]
Epoch 90:  45%|████▌     | 53/117 [00:02<00:03, 19.68it/s, loss=0.687, v_num=1, val_acc=0.757]
Epoch 90:  45%|████▌     | 53/117 [00:02<00:03, 19.49it/s, loss=0.683, v_num=1, val_acc=0.757]
Epoch 90:  46%|████▌     | 54/117 [00:02<00:03, 19.79it/s, loss=0.683, v_num=1, val_acc=0.757]
Epoch 90:  46%|████▌     | 54/117 [00:02<00:03, 19.61it/s, loss=0.685, v_num=1, val_acc=0.757]
Epoch 90:  47%|████▋     | 55/117 [00:02<00:03, 19.91it/s, loss=0.685, v_num=1, val_acc=0.757]
Epoch 90:  47%|████▋     | 55/117 [00:02<00:03, 19.73it/s, loss=0.684, v_num=1, val_acc=0.757]
Epoch 90:  48%|████▊     | 56/117 [00:02<00:03, 20.02it/s, loss=0.684, v_num=1, val_acc=0.757]
Epoch 90:  48%|████▊     | 56/117 [00:02<00:03, 19.84it/s, loss=0.687, v_num=1, val_acc=0.757]
Epoch 90:  49%|████▊     | 57/117 [00:02<00:02, 20.13it/s, loss=0.687, v_num=1, val_acc=0.757]
Epoch 90:  49%|████▊     | 57/117 [00:02<00:03, 19.95it/s, loss=0.688, v_num=1, val_acc=0.757]
Epoch 90:  50%|████▉     | 58/117 [00:02<00:02, 20.24it/s, loss=0.688, v_num=1, val_acc=0.757]
Epoch 90:  50%|████▉     | 58/117 [00:02<00:02, 20.06it/s, loss=0.686, v_num=1, val_acc=0.757]
Epoch 90:  50%|█████     | 59/117 [00:02<00:02, 20.34it/s, loss=0.686, v_num=1, val_acc=0.757]
Epoch 90:  50%|█████     | 59/117 [00:02<00:02, 20.17it/s, loss=0.681, v_num=1, val_acc=0.757]
Epoch 90:  51%|█████▏    | 60/117 [00:02<00:02, 20.44it/s, loss=0.681, v_num=1, val_acc=0.757]
Epoch 90:  51%|█████▏    | 60/117 [00:02<00:02, 20.27it/s, loss=0.681, v_num=1, val_acc=0.757]
Epoch 90:  52%|█████▏    | 61/117 [00:02<00:02, 20.54it/s, loss=0.681, v_num=1, val_acc=0.757]
Epoch 90:  52%|█████▏    | 61/117 [00:02<00:02, 20.37it/s, loss=0.684, v_num=1, val_acc=0.757]
Epoch 90:  53%|█████▎    | 62/117 [00:03<00:02, 20.64it/s, loss=0.684, v_num=1, val_acc=0.757]
Epoch 90:  53%|█████▎    | 62/117 [00:03<00:02, 20.47it/s, loss=0.685, v_num=1, val_acc=0.757]
Epoch 90:  54%|█████▍    | 63/117 [00:03<00:02, 20.74it/s, loss=0.685, v_num=1, val_acc=0.757]
Epoch 90:  54%|█████▍    | 63/117 [00:03<00:02, 20.56it/s, loss=0.684, v_num=1, val_acc=0.757]
Epoch 90:  55%|█████▍    | 64/117 [00:03<00:02, 20.83it/s, loss=0.684, v_num=1, val_acc=0.757]
Epoch 90:  55%|█████▍    | 64/117 [00:03<00:02, 20.66it/s, loss=0.68, v_num=1, val_acc=0.757]
Epoch 90:  56%|█████▌    | 65/117 [00:03<00:02, 20.92it/s, loss=0.68, v_num=1, val_acc=0.757]
Epoch 90:  56%|█████▌    | 65/117 [00:03<00:02, 20.75it/s, loss=0.682, v_num=1, val_acc=0.757]
Epoch 90:  56%|█████▋    | 66/117 [00:03<00:02, 21.01it/s, loss=0.682, v_num=1, val_acc=0.757]
Epoch 90:  56%|█████▋    | 66/117 [00:03<00:02, 20.84it/s, loss=0.678, v_num=1, val_acc=0.757]
Epoch 90:  57%|█████▋    | 67/117 [00:03<00:02, 21.10it/s, loss=0.678, v_num=1, val_acc=0.757]
Epoch 90:  57%|█████▋    | 67/117 [00:03<00:02, 20.93it/s, loss=0.68, v_num=1, val_acc=0.757]
Epoch 90:  58%|█████▊    | 68/117 [00:03<00:02, 21.18it/s, loss=0.68, v_num=1, val_acc=0.757]
Epoch 90:  58%|█████▊    | 68/117 [00:03<00:02, 21.01it/s, loss=0.682, v_num=1, val_acc=0.757]
Epoch 90:  59%|█████▉    | 69/117 [00:03<00:02, 21.26it/s, loss=0.682, v_num=1, val_acc=0.757]
Epoch 90:  59%|█████▉    | 69/117 [00:03<00:02, 21.10it/s, loss=0.681, v_num=1, val_acc=0.757]
Epoch 90:  60%|█████▉    | 70/117 [00:03<00:02, 21.35it/s, loss=0.681, v_num=1, val_acc=0.757]
Epoch 90:  60%|█████▉    | 70/117 [00:03<00:02, 21.18it/s, loss=0.681, v_num=1, val_acc=0.757]
Epoch 90:  61%|██████    | 71/117 [00:03<00:02, 21.42it/s, loss=0.681, v_num=1, val_acc=0.757]
Epoch 90:  61%|██████    | 71/117 [00:03<00:02, 21.26it/s, loss=0.681, v_num=1, val_acc=0.757]
Epoch 90:  62%|██████▏   | 72/117 [00:03<00:02, 21.50it/s, loss=0.681, v_num=1, val_acc=0.757]
Epoch 90:  62%|██████▏   | 72/117 [00:03<00:02, 21.34it/s, loss=0.681, v_num=1, val_acc=0.757]
Epoch 90:  62%|██████▏   | 73/117 [00:03<00:02, 21.57it/s, loss=0.681, v_num=1, val_acc=0.757]
Epoch 90:  62%|██████▏   | 73/117 [00:03<00:02, 21.41it/s, loss=0.684, v_num=1, val_acc=0.757]
Epoch 90:  63%|██████▎   | 74/117 [00:03<00:01, 21.65it/s, loss=0.684, v_num=1, val_acc=0.757]
Epoch 90:  63%|██████▎   | 74/117 [00:03<00:02, 21.49it/s, loss=0.683, v_num=1, val_acc=0.757]
Epoch 90:  64%|██████▍   | 75/117 [00:03<00:01, 21.72it/s, loss=0.683, v_num=1, val_acc=0.757]
Epoch 90:  64%|██████▍   | 75/117 [00:03<00:01, 21.57it/s, loss=0.687, v_num=1, val_acc=0.757]
Epoch 90:  65%|██████▍   | 76/117 [00:03<00:01, 21.80it/s, loss=0.687, v_num=1, val_acc=0.757]
Epoch 90:  65%|██████▍   | 76/117 [00:03<00:01, 21.64it/s, loss=0.69, v_num=1, val_acc=0.757]
Epoch 90:  66%|██████▌   | 77/117 [00:03<00:01, 21.86it/s, loss=0.69, v_num=1, val_acc=0.757]
Epoch 90:  66%|██████▌   | 77/117 [00:03<00:01, 21.71it/s, loss=0.691, v_num=1, val_acc=0.757]
Epoch 90:  67%|██████▋   | 78/117 [00:03<00:01, 21.93it/s, loss=0.691, v_num=1, val_acc=0.757]
Epoch 90:  67%|██████▋   | 78/117 [00:03<00:01, 21.78it/s, loss=0.694, v_num=1, val_acc=0.757]
Epoch 90:  68%|██████▊   | 79/117 [00:03<00:01, 22.00it/s, loss=0.694, v_num=1, val_acc=0.757]
Epoch 90:  68%|██████▊   | 79/117 [00:03<00:01, 21.85it/s, loss=0.7, v_num=1, val_acc=0.757]
Epoch 90:  68%|██████▊   | 80/117 [00:03<00:01, 22.07it/s, loss=0.7, v_num=1, val_acc=0.757]
Epoch 90:  68%|██████▊   | 80/117 [00:03<00:01, 21.92it/s, loss=0.7, v_num=1, val_acc=0.757]
Epoch 90:  69%|██████▉   | 81/117 [00:03<00:01, 22.13it/s, loss=0.7, v_num=1, val_acc=0.757]
Epoch 90:  69%|██████▉   | 81/117 [00:03<00:01, 21.98it/s, loss=0.695, v_num=1, val_acc=0.757]
Epoch 90:  70%|███████   | 82/117 [00:03<00:01, 22.18it/s, loss=0.695, v_num=1, val_acc=0.757]
Epoch 90:  70%|███████   | 82/117 [00:03<00:01, 22.03it/s, loss=0.694, v_num=1, val_acc=0.757]
Epoch 90:  71%|███████   | 83/117 [00:03<00:01, 22.24it/s, loss=0.694, v_num=1, val_acc=0.757]
Epoch 90:  71%|███████   | 83/117 [00:03<00:01, 22.09it/s, loss=0.689, v_num=1, val_acc=0.757]
Epoch 90:  72%|███████▏  | 84/117 [00:03<00:01, 22.31it/s, loss=0.689, v_num=1, val_acc=0.757]
Epoch 90:  72%|███████▏  | 84/117 [00:03<00:01, 22.16it/s, loss=0.693, v_num=1, val_acc=0.757]
Epoch 90:  73%|███████▎  | 85/117 [00:03<00:01, 22.37it/s, loss=0.693, v_num=1, val_acc=0.757]
Epoch 90:  73%|███████▎  | 85/117 [00:03<00:01, 22.22it/s, loss=0.692, v_num=1, val_acc=0.757]
Epoch 90:  74%|███████▎  | 86/117 [00:03<00:01, 22.43it/s, loss=0.692, v_num=1, val_acc=0.757]
Epoch 90:  74%|███████▎  | 86/117 [00:03<00:01, 22.28it/s, loss=0.69, v_num=1, val_acc=0.757]
Epoch 90:  74%|███████▍  | 87/117 [00:03<00:01, 22.49it/s, loss=0.69, v_num=1, val_acc=0.757]
Epoch 90:  74%|███████▍  | 87/117 [00:03<00:01, 22.34it/s, loss=0.688, v_num=1, val_acc=0.757]
Epoch 90:  75%|███████▌  | 88/117 [00:03<00:01, 22.55it/s, loss=0.688, v_num=1, val_acc=0.757]
Epoch 90:  75%|███████▌  | 88/117 [00:03<00:01, 22.40it/s, loss=0.688, v_num=1, val_acc=0.757]
Epoch 90:  76%|███████▌  | 89/117 [00:03<00:01, 22.61it/s, loss=0.688, v_num=1, val_acc=0.757]
Epoch 90:  76%|███████▌  | 89/117 [00:03<00:01, 22.46it/s, loss=0.69, v_num=1, val_acc=0.757]
Epoch 90:  77%|███████▋  | 90/117 [00:03<00:01, 22.66it/s, loss=0.69, v_num=1, val_acc=0.757]
Epoch 90:  77%|███████▋  | 90/117 [00:03<00:01, 22.52it/s, loss=0.689, v_num=1, val_acc=0.757]
Epoch 90:  78%|███████▊  | 91/117 [00:04<00:01, 22.72it/s, loss=0.689, v_num=1, val_acc=0.757]
Epoch 90:  78%|███████▊  | 91/117 [00:04<00:01, 22.57it/s, loss=0.687, v_num=1, val_acc=0.757]
Epoch 90:  79%|███████▊  | 92/117 [00:04<00:01, 22.77it/s, loss=0.687, v_num=1, val_acc=0.757]
Epoch 90:  79%|███████▊  | 92/117 [00:04<00:01, 22.63it/s, loss=0.686, v_num=1, val_acc=0.757]
Epoch 90:  79%|███████▉  | 93/117 [00:04<00:01, 22.82it/s, loss=0.686, v_num=1, val_acc=0.757]
Epoch 90:  79%|███████▉  | 93/117 [00:04<00:01, 22.68it/s, loss=0.684, v_num=1, val_acc=0.757]
Epoch 90:  80%|████████  | 94/117 [00:04<00:01, 22.87it/s, loss=0.684, v_num=1, val_acc=0.757]
Epoch 90:  80%|████████  | 94/117 [00:04<00:01, 22.73it/s, loss=0.684, v_num=1, val_acc=0.757]
Epoch 90:  81%|████████  | 95/117 [00:04<00:00, 22.92it/s, loss=0.684, v_num=1, val_acc=0.757]
Epoch 90:  81%|████████  | 95/117 [00:04<00:00, 22.78it/s, loss=0.68, v_num=1, val_acc=0.757]
Epoch 90:  82%|████████▏ | 96/117 [00:04<00:00, 22.97it/s, loss=0.68, v_num=1, val_acc=0.757]
Epoch 90:  82%|████████▏ | 96/117 [00:04<00:00, 22.83it/s, loss=0.679, v_num=1, val_acc=0.757]
Epoch 90:  83%|████████▎ | 97/117 [00:04<00:00, 23.02it/s, loss=0.679, v_num=1, val_acc=0.757]
Epoch 90:  83%|████████▎ | 97/117 [00:04<00:00, 22.89it/s, loss=0.678, v_num=1, val_acc=0.757]

Validation: 0it [00:00, ?it/s]

Validation:   0%|          | 0/20 [00:00<?, ?it/s]

Validation DataLoader 0:   0%|          | 0/20 [00:00<?, ?it/s]

Validation DataLoader 0:   5%|▌         | 1/20 [00:00<00:00, 130.60it/s]
Epoch 90:  84%|████████▍ | 98/117 [00:05<00:00, 19.19it/s, loss=0.678, v_num=1, val_acc=0.757]

Validation DataLoader 0:  10%|█         | 2/20 [00:00<00:00, 50.03it/s]
Epoch 90:  85%|████████▍ | 99/117 [00:05<00:00, 19.26it/s, loss=0.678, v_num=1, val_acc=0.757]

Validation DataLoader 0:  15%|█▌        | 3/20 [00:00<00:00, 42.64it/s]
Epoch 90:  85%|████████▌ | 100/117 [00:05<00:00, 19.34it/s, loss=0.678, v_num=1, val_acc=0.757]

Validation DataLoader 0:  20%|██        | 4/20 [00:00<00:00, 39.05it/s]
Epoch 90:  86%|████████▋ | 101/117 [00:05<00:00, 19.41it/s, loss=0.678, v_num=1, val_acc=0.757]

Validation DataLoader 0:  25%|██▌       | 5/20 [00:00<00:00, 37.14it/s]
Epoch 90:  87%|████████▋ | 102/117 [00:05<00:00, 19.49it/s, loss=0.678, v_num=1, val_acc=0.757]

Validation DataLoader 0:  30%|███       | 6/20 [00:00<00:00, 36.19it/s]
Epoch 90:  88%|████████▊ | 103/117 [00:05<00:00, 19.56it/s, loss=0.678, v_num=1, val_acc=0.757]

Validation DataLoader 0:  35%|███▌      | 7/20 [00:00<00:00, 35.45it/s]
Epoch 90:  89%|████████▉ | 104/117 [00:05<00:00, 19.63it/s, loss=0.678, v_num=1, val_acc=0.757]

Validation DataLoader 0:  40%|████      | 8/20 [00:00<00:00, 34.95it/s]
Epoch 90:  90%|████████▉ | 105/117 [00:05<00:00, 19.70it/s, loss=0.678, v_num=1, val_acc=0.757]

Validation DataLoader 0:  45%|████▌     | 9/20 [00:00<00:00, 34.51it/s]
Epoch 90:  91%|█████████ | 106/117 [00:05<00:00, 19.77it/s, loss=0.678, v_num=1, val_acc=0.757]

Validation DataLoader 0:  50%|█████     | 10/20 [00:00<00:00, 34.23it/s]
Epoch 90:  91%|█████████▏| 107/117 [00:05<00:00, 19.84it/s, loss=0.678, v_num=1, val_acc=0.757]

Validation DataLoader 0:  55%|█████▌    | 11/20 [00:00<00:00, 33.98it/s]
Epoch 90:  92%|█████████▏| 108/117 [00:05<00:00, 19.91it/s, loss=0.678, v_num=1, val_acc=0.757]

Validation DataLoader 0:  60%|██████    | 12/20 [00:00<00:00, 33.78it/s]
Epoch 90:  93%|█████████▎| 109/117 [00:05<00:00, 19.98it/s, loss=0.678, v_num=1, val_acc=0.757]

Validation DataLoader 0:  65%|██████▌   | 13/20 [00:00<00:00, 33.59it/s]
Epoch 90:  94%|█████████▍| 110/117 [00:05<00:00, 20.05it/s, loss=0.678, v_num=1, val_acc=0.757]

Validation DataLoader 0:  70%|███████   | 14/20 [00:00<00:00, 33.44it/s]
Epoch 90:  95%|█████████▍| 111/117 [00:05<00:00, 20.11it/s, loss=0.678, v_num=1, val_acc=0.757]

Validation DataLoader 0:  75%|███████▌  | 15/20 [00:00<00:00, 33.31it/s]
Epoch 90:  96%|█████████▌| 112/117 [00:05<00:00, 20.18it/s, loss=0.678, v_num=1, val_acc=0.757]

Validation DataLoader 0:  80%|████████  | 16/20 [00:00<00:00, 33.19it/s]
Epoch 90:  97%|█████████▋| 113/117 [00:05<00:00, 20.24it/s, loss=0.678, v_num=1, val_acc=0.757]

Validation DataLoader 0:  85%|████████▌ | 17/20 [00:00<00:00, 33.09it/s]
Epoch 90:  97%|█████████▋| 114/117 [00:05<00:00, 20.31it/s, loss=0.678, v_num=1, val_acc=0.757]

Validation DataLoader 0:  90%|█████████ | 18/20 [00:00<00:00, 33.00it/s]
Epoch 90:  98%|█████████▊| 115/117 [00:05<00:00, 20.37it/s, loss=0.678, v_num=1, val_acc=0.757]

Validation DataLoader 0:  95%|█████████▌| 19/20 [00:00<00:00, 32.92it/s]
Epoch 90:  99%|█████████▉| 116/117 [00:05<00:00, 20.43it/s, loss=0.678, v_num=1, val_acc=0.757]

Validation DataLoader 0: 100%|██████████| 20/20 [00:00<00:00, 32.92it/s]
Epoch 90: 100%|██████████| 117/117 [00:05<00:00, 20.50it/s, loss=0.678, v_num=1, val_acc=0.757]
Epoch 90: 100%|██████████| 117/117 [00:05<00:00, 20.43it/s, loss=0.678, v_num=1, val_acc=0.759]


Epoch 90: 100%|██████████| 117/117 [00:05<00:00, 20.42it/s, loss=0.678, v_num=1, val_acc=0.759]
Epoch 90:   0%|          | 0/117 [00:00<?, ?it/s, loss=0.678, v_num=1, val_acc=0.759]
Epoch 91:   0%|          | 0/117 [00:00<?, ?it/s, loss=0.678, v_num=1, val_acc=0.759]
Epoch 91:   1%|          | 1/117 [00:00<01:46,  1.09it/s, loss=0.678, v_num=1, val_acc=0.759]
Epoch 91:   1%|          | 1/117 [00:00<01:48,  1.07it/s, loss=0.681, v_num=1, val_acc=0.759]
Epoch 91:   2%|▏         | 2/117 [00:00<00:54,  2.11it/s, loss=0.681, v_num=1, val_acc=0.759]
Epoch 91:   2%|▏         | 2/117 [00:00<00:55,  2.05it/s, loss=0.679, v_num=1, val_acc=0.759]
Epoch 91:   3%|▎         | 3/117 [00:00<00:37,  3.05it/s, loss=0.679, v_num=1, val_acc=0.759]
Epoch 91:   3%|▎         | 3/117 [00:01<00:38,  2.98it/s, loss=0.685, v_num=1, val_acc=0.759]
Epoch 91:   3%|▎         | 4/117 [00:01<00:28,  3.94it/s, loss=0.685, v_num=1, val_acc=0.759]
Epoch 91:   3%|▎         | 4/117 [00:01<00:29,  3.84it/s, loss=0.685, v_num=1, val_acc=0.759]
Epoch 91:   4%|▍         | 5/117 [00:01<00:23,  4.75it/s, loss=0.685, v_num=1, val_acc=0.759]
Epoch 91:   4%|▍         | 5/117 [00:01<00:24,  4.64it/s, loss=0.689, v_num=1, val_acc=0.759]
Epoch 91:   5%|▌         | 6/117 [00:01<00:20,  5.52it/s, loss=0.689, v_num=1, val_acc=0.759]
Epoch 91:   5%|▌         | 6/117 [00:01<00:20,  5.39it/s, loss=0.694, v_num=1, val_acc=0.759]
Epoch 91:   6%|▌         | 7/117 [00:01<00:17,  6.24it/s, loss=0.694, v_num=1, val_acc=0.759]
Epoch 91:   6%|▌         | 7/117 [00:01<00:18,  6.10it/s, loss=0.691, v_num=1, val_acc=0.759]
Epoch 91:   7%|▋         | 8/117 [00:01<00:15,  6.92it/s, loss=0.691, v_num=1, val_acc=0.759]
Epoch 91:   7%|▋         | 8/117 [00:01<00:16,  6.78it/s, loss=0.695, v_num=1, val_acc=0.759]
Epoch 91:   8%|▊         | 9/117 [00:01<00:14,  7.56it/s, loss=0.695, v_num=1, val_acc=0.759]
Epoch 91:   8%|▊         | 9/117 [00:01<00:14,  7.40it/s, loss=0.695, v_num=1, val_acc=0.759]
Epoch 91:   9%|▊         | 10/117 [00:01<00:13,  8.12it/s, loss=0.695, v_num=1, val_acc=0.759]
Epoch 91:   9%|▊         | 10/117 [00:01<00:13,  7.96it/s, loss=0.701, v_num=1, val_acc=0.759]
Epoch 91:   9%|▉         | 11/117 [00:01<00:12,  8.70it/s, loss=0.701, v_num=1, val_acc=0.759]
Epoch 91:   9%|▉         | 11/117 [00:01<00:12,  8.53it/s, loss=0.698, v_num=1, val_acc=0.759]
Epoch 91:  10%|█         | 12/117 [00:01<00:11,  9.25it/s, loss=0.698, v_num=1, val_acc=0.759]
Epoch 91:  10%|█         | 12/117 [00:01<00:11,  9.07it/s, loss=0.697, v_num=1, val_acc=0.759]
Epoch 91:  11%|█         | 13/117 [00:01<00:10,  9.76it/s, loss=0.697, v_num=1, val_acc=0.759]
Epoch 91:  11%|█         | 13/117 [00:01<00:10,  9.58it/s, loss=0.702, v_num=1, val_acc=0.759]
Epoch 91:  12%|█▏        | 14/117 [00:01<00:10, 10.26it/s, loss=0.702, v_num=1, val_acc=0.759]
Epoch 91:  12%|█▏        | 14/117 [00:01<00:10, 10.07it/s, loss=0.702, v_num=1, val_acc=0.759]
Epoch 91:  13%|█▎        | 15/117 [00:01<00:09, 10.72it/s, loss=0.702, v_num=1, val_acc=0.759]
Epoch 91:  13%|█▎        | 15/117 [00:01<00:09, 10.53it/s, loss=0.699, v_num=1, val_acc=0.759]
Epoch 91:  14%|█▎        | 16/117 [00:01<00:09, 11.16it/s, loss=0.699, v_num=1, val_acc=0.759]
Epoch 91:  14%|█▎        | 16/117 [00:01<00:09, 10.96it/s, loss=0.699, v_num=1, val_acc=0.759]
Epoch 91:  15%|█▍        | 17/117 [00:01<00:08, 11.58it/s, loss=0.699, v_num=1, val_acc=0.759]
Epoch 91:  15%|█▍        | 17/117 [00:01<00:08, 11.38it/s, loss=0.696, v_num=1, val_acc=0.759]
Epoch 91:  15%|█▌        | 18/117 [00:01<00:08, 11.96it/s, loss=0.696, v_num=1, val_acc=0.759]
Epoch 91:  15%|█▌        | 18/117 [00:01<00:08, 11.76it/s, loss=0.698, v_num=1, val_acc=0.759]
Epoch 91:  16%|█▌        | 19/117 [00:01<00:07, 12.35it/s, loss=0.698, v_num=1, val_acc=0.759]
Epoch 91:  16%|█▌        | 19/117 [00:01<00:08, 12.15it/s, loss=0.694, v_num=1, val_acc=0.759]
Epoch 91:  17%|█▋        | 20/117 [00:01<00:07, 12.73it/s, loss=0.694, v_num=1, val_acc=0.759]
Epoch 91:  17%|█▋        | 20/117 [00:01<00:07, 12.52it/s, loss=0.693, v_num=1, val_acc=0.759]
Epoch 91:  18%|█▊        | 21/117 [00:01<00:07, 13.08it/s, loss=0.693, v_num=1, val_acc=0.759]
Epoch 91:  18%|█▊        | 21/117 [00:01<00:07, 12.88it/s, loss=0.691, v_num=1, val_acc=0.759]
Epoch 91:  19%|█▉        | 22/117 [00:01<00:07, 13.41it/s, loss=0.691, v_num=1, val_acc=0.759]
Epoch 91:  19%|█▉        | 22/117 [00:01<00:07, 13.21it/s, loss=0.693, v_num=1, val_acc=0.759]
Epoch 91:  20%|█▉        | 23/117 [00:01<00:06, 13.74it/s, loss=0.693, v_num=1, val_acc=0.759]
Epoch 91:  20%|█▉        | 23/117 [00:01<00:06, 13.53it/s, loss=0.687, v_num=1, val_acc=0.759]
Epoch 91:  21%|██        | 24/117 [00:01<00:06, 14.03it/s, loss=0.687, v_num=1, val_acc=0.759]
Epoch 91:  21%|██        | 24/117 [00:01<00:06, 13.83it/s, loss=0.687, v_num=1, val_acc=0.759]
Epoch 91:  21%|██▏       | 25/117 [00:01<00:06, 14.33it/s, loss=0.687, v_num=1, val_acc=0.759]
Epoch 91:  21%|██▏       | 25/117 [00:01<00:06, 14.13it/s, loss=0.681, v_num=1, val_acc=0.759]
Epoch 91:  22%|██▏       | 26/117 [00:01<00:06, 14.61it/s, loss=0.681, v_num=1, val_acc=0.759]
Epoch 91:  22%|██▏       | 26/117 [00:01<00:06, 14.40it/s, loss=0.681, v_num=1, val_acc=0.759]
Epoch 91:  23%|██▎       | 27/117 [00:01<00:06, 14.89it/s, loss=0.681, v_num=1, val_acc=0.759]
Epoch 91:  23%|██▎       | 27/117 [00:01<00:06, 14.68it/s, loss=0.684, v_num=1, val_acc=0.759]
Epoch 91:  24%|██▍       | 28/117 [00:01<00:05, 15.16it/s, loss=0.684, v_num=1, val_acc=0.759]
Epoch 91:  24%|██▍       | 28/117 [00:01<00:05, 14.95it/s, loss=0.682, v_num=1, val_acc=0.759]
Epoch 91:  25%|██▍       | 29/117 [00:01<00:05, 15.41it/s, loss=0.682, v_num=1, val_acc=0.759]
Epoch 91:  25%|██▍       | 29/117 [00:01<00:05, 15.21it/s, loss=0.689, v_num=1, val_acc=0.759]
Epoch 91:  26%|██▌       | 30/117 [00:01<00:05, 15.66it/s, loss=0.689, v_num=1, val_acc=0.759]
Epoch 91:  26%|██▌       | 30/117 [00:01<00:05, 15.45it/s, loss=0.687, v_num=1, val_acc=0.759]
Epoch 91:  26%|██▋       | 31/117 [00:01<00:05, 15.89it/s, loss=0.687, v_num=1, val_acc=0.759]
Epoch 91:  26%|██▋       | 31/117 [00:01<00:05, 15.69it/s, loss=0.684, v_num=1, val_acc=0.759]
Epoch 91:  27%|██▋       | 32/117 [00:01<00:05, 16.12it/s, loss=0.684, v_num=1, val_acc=0.759]
Epoch 91:  27%|██▋       | 32/117 [00:02<00:05, 15.92it/s, loss=0.679, v_num=1, val_acc=0.759]
Epoch 91:  28%|██▊       | 33/117 [00:02<00:05, 16.34it/s, loss=0.679, v_num=1, val_acc=0.759]
Epoch 91:  28%|██▊       | 33/117 [00:02<00:05, 16.14it/s, loss=0.673, v_num=1, val_acc=0.759]
Epoch 91:  29%|██▉       | 34/117 [00:02<00:05, 16.55it/s, loss=0.673, v_num=1, val_acc=0.759]
Epoch 91:  29%|██▉       | 34/117 [00:02<00:05, 16.35it/s, loss=0.673, v_num=1, val_acc=0.759]
Epoch 91:  30%|██▉       | 35/117 [00:02<00:04, 16.76it/s, loss=0.673, v_num=1, val_acc=0.759]
Epoch 91:  30%|██▉       | 35/117 [00:02<00:04, 16.56it/s, loss=0.68, v_num=1, val_acc=0.759]
Epoch 91:  31%|███       | 36/117 [00:02<00:04, 16.96it/s, loss=0.68, v_num=1, val_acc=0.759]
Epoch 91:  31%|███       | 36/117 [00:02<00:04, 16.76it/s, loss=0.683, v_num=1, val_acc=0.759]
Epoch 91:  32%|███▏      | 37/117 [00:02<00:04, 17.16it/s, loss=0.683, v_num=1, val_acc=0.759]
Epoch 91:  32%|███▏      | 37/117 [00:02<00:04, 16.96it/s, loss=0.68, v_num=1, val_acc=0.759]
Epoch 91:  32%|███▏      | 38/117 [00:02<00:04, 17.34it/s, loss=0.68, v_num=1, val_acc=0.759]
Epoch 91:  32%|███▏      | 38/117 [00:02<00:04, 17.15it/s, loss=0.679, v_num=1, val_acc=0.759]
Epoch 91:  33%|███▎      | 39/117 [00:02<00:04, 17.52it/s, loss=0.679, v_num=1, val_acc=0.759]
Epoch 91:  33%|███▎      | 39/117 [00:02<00:04, 17.33it/s, loss=0.684, v_num=1, val_acc=0.759]
Epoch 91:  34%|███▍      | 40/117 [00:02<00:04, 17.70it/s, loss=0.684, v_num=1, val_acc=0.759]
Epoch 91:  34%|███▍      | 40/117 [00:02<00:04, 17.50it/s, loss=0.681, v_num=1, val_acc=0.759]
Epoch 91:  35%|███▌      | 41/117 [00:02<00:04, 17.87it/s, loss=0.681, v_num=1, val_acc=0.759]
Epoch 91:  35%|███▌      | 41/117 [00:02<00:04, 17.67it/s, loss=0.68, v_num=1, val_acc=0.759]
Epoch 91:  36%|███▌      | 42/117 [00:02<00:04, 18.03it/s, loss=0.68, v_num=1, val_acc=0.759]
Epoch 91:  36%|███▌      | 42/117 [00:02<00:04, 17.84it/s, loss=0.674, v_num=1, val_acc=0.759]
Epoch 91:  37%|███▋      | 43/117 [00:02<00:04, 18.16it/s, loss=0.674, v_num=1, val_acc=0.759]
Epoch 91:  37%|███▋      | 43/117 [00:02<00:04, 17.98it/s, loss=0.678, v_num=1, val_acc=0.759]
Epoch 91:  38%|███▊      | 44/117 [00:02<00:03, 18.33it/s, loss=0.678, v_num=1, val_acc=0.759]
Epoch 91:  38%|███▊      | 44/117 [00:02<00:04, 18.14it/s, loss=0.683, v_num=1, val_acc=0.759]
Epoch 91:  38%|███▊      | 45/117 [00:02<00:03, 18.48it/s, loss=0.683, v_num=1, val_acc=0.759]
Epoch 91:  38%|███▊      | 45/117 [00:02<00:03, 18.29it/s, loss=0.682, v_num=1, val_acc=0.759]
Epoch 91:  39%|███▉      | 46/117 [00:02<00:03, 18.63it/s, loss=0.682, v_num=1, val_acc=0.759]
Epoch 91:  39%|███▉      | 46/117 [00:02<00:03, 18.44it/s, loss=0.679, v_num=1, val_acc=0.759]
Epoch 91:  40%|████      | 47/117 [00:02<00:03, 18.77it/s, loss=0.679, v_num=1, val_acc=0.759]
Epoch 91:  40%|████      | 47/117 [00:02<00:03, 18.58it/s, loss=0.676, v_num=1, val_acc=0.759]
Epoch 91:  41%|████      | 48/117 [00:02<00:03, 18.91it/s, loss=0.676, v_num=1, val_acc=0.759]
Epoch 91:  41%|████      | 48/117 [00:02<00:03, 18.72it/s, loss=0.675, v_num=1, val_acc=0.759]
Epoch 91:  42%|████▏     | 49/117 [00:02<00:03, 19.05it/s, loss=0.675, v_num=1, val_acc=0.759]
Epoch 91:  42%|████▏     | 49/117 [00:02<00:03, 18.86it/s, loss=0.673, v_num=1, val_acc=0.759]
Epoch 91:  43%|████▎     | 50/117 [00:02<00:03, 19.18it/s, loss=0.673, v_num=1, val_acc=0.759]
Epoch 91:  43%|████▎     | 50/117 [00:02<00:03, 18.99it/s, loss=0.676, v_num=1, val_acc=0.759]
Epoch 91:  44%|████▎     | 51/117 [00:02<00:03, 19.31it/s, loss=0.676, v_num=1, val_acc=0.759]
Epoch 91:  44%|████▎     | 51/117 [00:02<00:03, 19.12it/s, loss=0.685, v_num=1, val_acc=0.759]
Epoch 91:  44%|████▍     | 52/117 [00:02<00:03, 19.43it/s, loss=0.685, v_num=1, val_acc=0.759]
Epoch 91:  44%|████▍     | 52/117 [00:02<00:03, 19.25it/s, loss=0.686, v_num=1, val_acc=0.759]
Epoch 91:  45%|████▌     | 53/117 [00:02<00:03, 19.56it/s, loss=0.686, v_num=1, val_acc=0.759]
Epoch 91:  45%|████▌     | 53/117 [00:02<00:03, 19.37it/s, loss=0.688, v_num=1, val_acc=0.759]
Epoch 91:  46%|████▌     | 54/117 [00:02<00:03, 19.67it/s, loss=0.688, v_num=1, val_acc=0.759]
Epoch 91:  46%|████▌     | 54/117 [00:02<00:03, 19.49it/s, loss=0.689, v_num=1, val_acc=0.759]
Epoch 91:  47%|████▋     | 55/117 [00:02<00:03, 19.79it/s, loss=0.689, v_num=1, val_acc=0.759]
Epoch 91:  47%|████▋     | 55/117 [00:02<00:03, 19.61it/s, loss=0.682, v_num=1, val_acc=0.759]
Epoch 91:  48%|████▊     | 56/117 [00:02<00:03, 19.90it/s, loss=0.682, v_num=1, val_acc=0.759]
Epoch 91:  48%|████▊     | 56/117 [00:02<00:03, 19.73it/s, loss=0.677, v_num=1, val_acc=0.759]
Epoch 91:  49%|████▊     | 57/117 [00:02<00:02, 20.01it/s, loss=0.677, v_num=1, val_acc=0.759]
Epoch 91:  49%|████▊     | 57/117 [00:02<00:03, 19.84it/s, loss=0.68, v_num=1, val_acc=0.759]
Epoch 91:  50%|████▉     | 58/117 [00:02<00:02, 20.12it/s, loss=0.68, v_num=1, val_acc=0.759]
Epoch 91:  50%|████▉     | 58/117 [00:02<00:02, 19.95it/s, loss=0.679, v_num=1, val_acc=0.759]
Epoch 91:  50%|█████     | 59/117 [00:02<00:02, 20.23it/s, loss=0.679, v_num=1, val_acc=0.759]
Epoch 91:  50%|█████     | 59/117 [00:02<00:02, 20.05it/s, loss=0.676, v_num=1, val_acc=0.759]
Epoch 91:  51%|█████▏    | 60/117 [00:02<00:02, 20.33it/s, loss=0.676, v_num=1, val_acc=0.759]
Epoch 91:  51%|█████▏    | 60/117 [00:02<00:02, 20.16it/s, loss=0.684, v_num=1, val_acc=0.759]
Epoch 91:  52%|█████▏    | 61/117 [00:02<00:02, 20.43it/s, loss=0.684, v_num=1, val_acc=0.759]
Epoch 91:  52%|█████▏    | 61/117 [00:03<00:02, 20.25it/s, loss=0.686, v_num=1, val_acc=0.759]
Epoch 91:  53%|█████▎    | 62/117 [00:03<00:02, 20.52it/s, loss=0.686, v_num=1, val_acc=0.759]
Epoch 91:  53%|█████▎    | 62/117 [00:03<00:02, 20.35it/s, loss=0.688, v_num=1, val_acc=0.759]
Epoch 91:  54%|█████▍    | 63/117 [00:03<00:02, 20.62it/s, loss=0.688, v_num=1, val_acc=0.759]
Epoch 91:  54%|█████▍    | 63/117 [00:03<00:02, 20.45it/s, loss=0.686, v_num=1, val_acc=0.759]
Epoch 91:  55%|█████▍    | 64/117 [00:03<00:02, 20.72it/s, loss=0.686, v_num=1, val_acc=0.759]
Epoch 91:  55%|█████▍    | 64/117 [00:03<00:02, 20.55it/s, loss=0.683, v_num=1, val_acc=0.759]
Epoch 91:  56%|█████▌    | 65/117 [00:03<00:02, 20.81it/s, loss=0.683, v_num=1, val_acc=0.759]
Epoch 91:  56%|█████▌    | 65/117 [00:03<00:02, 20.64it/s, loss=0.69, v_num=1, val_acc=0.759]
Epoch 91:  56%|█████▋    | 66/117 [00:03<00:02, 20.90it/s, loss=0.69, v_num=1, val_acc=0.759]
Epoch 91:  56%|█████▋    | 66/117 [00:03<00:02, 20.73it/s, loss=0.693, v_num=1, val_acc=0.759]
Epoch 91:  57%|█████▋    | 67/117 [00:03<00:02, 20.99it/s, loss=0.693, v_num=1, val_acc=0.759]
Epoch 91:  57%|█████▋    | 67/117 [00:03<00:02, 20.82it/s, loss=0.694, v_num=1, val_acc=0.759]
Epoch 91:  58%|█████▊    | 68/117 [00:03<00:02, 21.07it/s, loss=0.694, v_num=1, val_acc=0.759]
Epoch 91:  58%|█████▊    | 68/117 [00:03<00:02, 20.91it/s, loss=0.697, v_num=1, val_acc=0.759]
Epoch 91:  59%|█████▉    | 69/117 [00:03<00:02, 21.15it/s, loss=0.697, v_num=1, val_acc=0.759]
Epoch 91:  59%|█████▉    | 69/117 [00:03<00:02, 20.99it/s, loss=0.699, v_num=1, val_acc=0.759]
Epoch 91:  60%|█████▉    | 70/117 [00:03<00:02, 21.24it/s, loss=0.699, v_num=1, val_acc=0.759]
Epoch 91:  60%|█████▉    | 70/117 [00:03<00:02, 21.08it/s, loss=0.694, v_num=1, val_acc=0.759]
Epoch 91:  61%|██████    | 71/117 [00:03<00:02, 21.32it/s, loss=0.694, v_num=1, val_acc=0.759]
Epoch 91:  61%|██████    | 71/117 [00:03<00:02, 21.16it/s, loss=0.69, v_num=1, val_acc=0.759]
Epoch 91:  62%|██████▏   | 72/117 [00:03<00:02, 21.40it/s, loss=0.69, v_num=1, val_acc=0.759]
Epoch 91:  62%|██████▏   | 72/117 [00:03<00:02, 21.24it/s, loss=0.692, v_num=1, val_acc=0.759]
Epoch 91:  62%|██████▏   | 73/117 [00:03<00:02, 21.47it/s, loss=0.692, v_num=1, val_acc=0.759]
Epoch 91:  62%|██████▏   | 73/117 [00:03<00:02, 21.32it/s, loss=0.693, v_num=1, val_acc=0.759]
Epoch 91:  63%|██████▎   | 74/117 [00:03<00:01, 21.54it/s, loss=0.693, v_num=1, val_acc=0.759]
Epoch 91:  63%|██████▎   | 74/117 [00:03<00:02, 21.39it/s, loss=0.692, v_num=1, val_acc=0.759]
Epoch 91:  64%|██████▍   | 75/117 [00:03<00:01, 21.62it/s, loss=0.692, v_num=1, val_acc=0.759]
Epoch 91:  64%|██████▍   | 75/117 [00:03<00:01, 21.46it/s, loss=0.697, v_num=1, val_acc=0.759]
Epoch 91:  65%|██████▍   | 76/117 [00:03<00:01, 21.69it/s, loss=0.697, v_num=1, val_acc=0.759]
Epoch 91:  65%|██████▍   | 76/117 [00:03<00:01, 21.54it/s, loss=0.699, v_num=1, val_acc=0.759]
Epoch 91:  66%|██████▌   | 77/117 [00:03<00:01, 21.76it/s, loss=0.699, v_num=1, val_acc=0.759]
Epoch 91:  66%|██████▌   | 77/117 [00:03<00:01, 21.61it/s, loss=0.701, v_num=1, val_acc=0.759]
Epoch 91:  67%|██████▋   | 78/117 [00:03<00:01, 21.83it/s, loss=0.701, v_num=1, val_acc=0.759]
Epoch 91:  67%|██████▋   | 78/117 [00:03<00:01, 21.68it/s, loss=0.701, v_num=1, val_acc=0.759]
Epoch 91:  68%|██████▊   | 79/117 [00:03<00:01, 21.90it/s, loss=0.701, v_num=1, val_acc=0.759]
Epoch 91:  68%|██████▊   | 79/117 [00:03<00:01, 21.75it/s, loss=0.701, v_num=1, val_acc=0.759]
Epoch 91:  68%|██████▊   | 80/117 [00:03<00:01, 21.97it/s, loss=0.701, v_num=1, val_acc=0.759]
Epoch 91:  68%|██████▊   | 80/117 [00:03<00:01, 21.82it/s, loss=0.697, v_num=1, val_acc=0.759]
Epoch 91:  69%|██████▉   | 81/117 [00:03<00:01, 22.04it/s, loss=0.697, v_num=1, val_acc=0.759]
Epoch 91:  69%|██████▉   | 81/117 [00:03<00:01, 21.89it/s, loss=0.694, v_num=1, val_acc=0.759]
Epoch 91:  70%|███████   | 82/117 [00:03<00:01, 22.08it/s, loss=0.694, v_num=1, val_acc=0.759]
Epoch 91:  70%|███████   | 82/117 [00:03<00:01, 21.94it/s, loss=0.698, v_num=1, val_acc=0.759]
Epoch 91:  71%|███████   | 83/117 [00:03<00:01, 22.15it/s, loss=0.698, v_num=1, val_acc=0.759]
Epoch 91:  71%|███████   | 83/117 [00:03<00:01, 22.00it/s, loss=0.699, v_num=1, val_acc=0.759]
Epoch 91:  72%|███████▏  | 84/117 [00:03<00:01, 22.22it/s, loss=0.699, v_num=1, val_acc=0.759]
Epoch 91:  72%|███████▏  | 84/117 [00:03<00:01, 22.07it/s, loss=0.697, v_num=1, val_acc=0.759]
Epoch 91:  73%|███████▎  | 85/117 [00:03<00:01, 22.28it/s, loss=0.697, v_num=1, val_acc=0.759]
Epoch 91:  73%|███████▎  | 85/117 [00:03<00:01, 22.13it/s, loss=0.694, v_num=1, val_acc=0.759]
Epoch 91:  74%|███████▎  | 86/117 [00:03<00:01, 22.34it/s, loss=0.694, v_num=1, val_acc=0.759]
Epoch 91:  74%|███████▎  | 86/117 [00:03<00:01, 22.19it/s, loss=0.695, v_num=1, val_acc=0.759]
Epoch 91:  74%|███████▍  | 87/117 [00:03<00:01, 22.40it/s, loss=0.695, v_num=1, val_acc=0.759]
Epoch 91:  74%|███████▍  | 87/117 [00:03<00:01, 22.25it/s, loss=0.69, v_num=1, val_acc=0.759]
Epoch 91:  75%|███████▌  | 88/117 [00:03<00:01, 22.46it/s, loss=0.69, v_num=1, val_acc=0.759]
Epoch 91:  75%|███████▌  | 88/117 [00:03<00:01, 22.31it/s, loss=0.688, v_num=1, val_acc=0.759]
Epoch 91:  76%|███████▌  | 89/117 [00:03<00:01, 22.52it/s, loss=0.688, v_num=1, val_acc=0.759]
Epoch 91:  76%|███████▌  | 89/117 [00:03<00:01, 22.37it/s, loss=0.683, v_num=1, val_acc=0.759]
Epoch 91:  77%|███████▋  | 90/117 [00:03<00:01, 22.57it/s, loss=0.683, v_num=1, val_acc=0.759]
Epoch 91:  77%|███████▋  | 90/117 [00:04<00:01, 22.43it/s, loss=0.685, v_num=1, val_acc=0.759]
Epoch 91:  78%|███████▊  | 91/117 [00:04<00:01, 22.63it/s, loss=0.685, v_num=1, val_acc=0.759]
Epoch 91:  78%|███████▊  | 91/117 [00:04<00:01, 22.49it/s, loss=0.686, v_num=1, val_acc=0.759]
Epoch 91:  79%|███████▊  | 92/117 [00:04<00:01, 22.68it/s, loss=0.686, v_num=1, val_acc=0.759]
Epoch 91:  79%|███████▊  | 92/117 [00:04<00:01, 22.54it/s, loss=0.684, v_num=1, val_acc=0.759]
Epoch 91:  79%|███████▉  | 93/117 [00:04<00:01, 22.74it/s, loss=0.684, v_num=1, val_acc=0.759]
Epoch 91:  79%|███████▉  | 93/117 [00:04<00:01, 22.60it/s, loss=0.683, v_num=1, val_acc=0.759]
Epoch 91:  80%|████████  | 94/117 [00:04<00:01, 22.79it/s, loss=0.683, v_num=1, val_acc=0.759]
Epoch 91:  80%|████████  | 94/117 [00:04<00:01, 22.65it/s, loss=0.683, v_num=1, val_acc=0.759]
Epoch 91:  81%|████████  | 95/117 [00:04<00:00, 22.84it/s, loss=0.683, v_num=1, val_acc=0.759]
Epoch 91:  81%|████████  | 95/117 [00:04<00:00, 22.70it/s, loss=0.683, v_num=1, val_acc=0.759]
Epoch 91:  82%|████████▏ | 96/117 [00:04<00:00, 22.89it/s, loss=0.683, v_num=1, val_acc=0.759]
Epoch 91:  82%|████████▏ | 96/117 [00:04<00:00, 22.76it/s, loss=0.681, v_num=1, val_acc=0.759]
Epoch 91:  83%|████████▎ | 97/117 [00:04<00:00, 22.94it/s, loss=0.681, v_num=1, val_acc=0.759]
Epoch 91:  83%|████████▎ | 97/117 [00:04<00:00, 22.81it/s, loss=0.678, v_num=1, val_acc=0.759]

Validation: 0it [00:00, ?it/s]

Validation:   0%|          | 0/20 [00:00<?, ?it/s]

Validation DataLoader 0:   0%|          | 0/20 [00:00<?, ?it/s]

Validation DataLoader 0:   5%|▌         | 1/20 [00:00<00:00, 178.66it/s]
Epoch 91:  84%|████████▍ | 98/117 [00:05<00:00, 19.11it/s, loss=0.678, v_num=1, val_acc=0.759]

Validation DataLoader 0:  10%|█         | 2/20 [00:00<00:00, 56.08it/s]
Epoch 91:  85%|████████▍ | 99/117 [00:05<00:00, 19.19it/s, loss=0.678, v_num=1, val_acc=0.759]

Validation DataLoader 0:  15%|█▌        | 3/20 [00:00<00:00, 44.54it/s]
Epoch 91:  85%|████████▌ | 100/117 [00:05<00:00, 19.27it/s, loss=0.678, v_num=1, val_acc=0.759]

Validation DataLoader 0:  20%|██        | 4/20 [00:00<00:00, 40.46it/s]
Epoch 91:  86%|████████▋ | 101/117 [00:05<00:00, 19.34it/s, loss=0.678, v_num=1, val_acc=0.759]

Validation DataLoader 0:  25%|██▌       | 5/20 [00:00<00:00, 38.32it/s]
Epoch 91:  87%|████████▋ | 102/117 [00:05<00:00, 19.42it/s, loss=0.678, v_num=1, val_acc=0.759]

Validation DataLoader 0:  30%|███       | 6/20 [00:00<00:00, 37.04it/s]
Epoch 91:  88%|████████▊ | 103/117 [00:05<00:00, 19.49it/s, loss=0.678, v_num=1, val_acc=0.759]

Validation DataLoader 0:  35%|███▌      | 7/20 [00:00<00:00, 36.16it/s]
Epoch 91:  89%|████████▉ | 104/117 [00:05<00:00, 19.56it/s, loss=0.678, v_num=1, val_acc=0.759]

Validation DataLoader 0:  40%|████      | 8/20 [00:00<00:00, 35.53it/s]
Epoch 91:  90%|████████▉ | 105/117 [00:05<00:00, 19.63it/s, loss=0.678, v_num=1, val_acc=0.759]

Validation DataLoader 0:  45%|████▌     | 9/20 [00:00<00:00, 34.99it/s]
Epoch 91:  91%|█████████ | 106/117 [00:05<00:00, 19.70it/s, loss=0.678, v_num=1, val_acc=0.759]

Validation DataLoader 0:  50%|█████     | 10/20 [00:00<00:00, 34.64it/s]
Epoch 91:  91%|█████████▏| 107/117 [00:05<00:00, 19.77it/s, loss=0.678, v_num=1, val_acc=0.759]

Validation DataLoader 0:  55%|█████▌    | 11/20 [00:00<00:00, 34.34it/s]
Epoch 91:  92%|█████████▏| 108/117 [00:05<00:00, 19.84it/s, loss=0.678, v_num=1, val_acc=0.759]

Validation DataLoader 0:  60%|██████    | 12/20 [00:00<00:00, 34.09it/s]
Epoch 91:  93%|█████████▎| 109/117 [00:05<00:00, 19.91it/s, loss=0.678, v_num=1, val_acc=0.759]

Validation DataLoader 0:  65%|██████▌   | 13/20 [00:00<00:00, 33.89it/s]
Epoch 91:  94%|█████████▍| 110/117 [00:05<00:00, 19.98it/s, loss=0.678, v_num=1, val_acc=0.759]

Validation DataLoader 0:  70%|███████   | 14/20 [00:00<00:00, 33.72it/s]
Epoch 91:  95%|█████████▍| 111/117 [00:05<00:00, 20.04it/s, loss=0.678, v_num=1, val_acc=0.759]

Validation DataLoader 0:  75%|███████▌  | 15/20 [00:00<00:00, 33.53it/s]
Epoch 91:  96%|█████████▌| 112/117 [00:05<00:00, 20.11it/s, loss=0.678, v_num=1, val_acc=0.759]

Validation DataLoader 0:  80%|████████  | 16/20 [00:00<00:00, 33.40it/s]
Epoch 91:  97%|█████████▋| 113/117 [00:05<00:00, 20.17it/s, loss=0.678, v_num=1, val_acc=0.759]

Validation DataLoader 0:  85%|████████▌ | 17/20 [00:00<00:00, 33.27it/s]
Epoch 91:  97%|█████████▋| 114/117 [00:05<00:00, 20.24it/s, loss=0.678, v_num=1, val_acc=0.759]

Validation DataLoader 0:  90%|█████████ | 18/20 [00:00<00:00, 33.16it/s]
Epoch 91:  98%|█████████▊| 115/117 [00:05<00:00, 20.30it/s, loss=0.678, v_num=1, val_acc=0.759]

Validation DataLoader 0:  95%|█████████▌| 19/20 [00:00<00:00, 33.09it/s]
Epoch 91:  99%|█████████▉| 116/117 [00:05<00:00, 20.36it/s, loss=0.678, v_num=1, val_acc=0.759]

Validation DataLoader 0: 100%|██████████| 20/20 [00:00<00:00, 33.08it/s]
Epoch 91: 100%|██████████| 117/117 [00:05<00:00, 20.43it/s, loss=0.678, v_num=1, val_acc=0.759]
Epoch 91: 100%|██████████| 117/117 [00:05<00:00, 20.36it/s, loss=0.678, v_num=1, val_acc=0.756]


Epoch 91: 100%|██████████| 117/117 [00:05<00:00, 20.35it/s, loss=0.678, v_num=1, val_acc=0.756]
Epoch 91:   0%|          | 0/117 [00:00<?, ?it/s, loss=0.678, v_num=1, val_acc=0.756]
Epoch 92:   0%|          | 0/117 [00:00<?, ?it/s, loss=0.678, v_num=1, val_acc=0.756]
Epoch 92:   1%|          | 1/117 [00:00<01:44,  1.11it/s, loss=0.678, v_num=1, val_acc=0.756]
Epoch 92:   1%|          | 1/117 [00:00<01:47,  1.08it/s, loss=0.677, v_num=1, val_acc=0.756]
Epoch 92:   2%|▏         | 2/117 [00:00<00:53,  2.14it/s, loss=0.677, v_num=1, val_acc=0.756]
Epoch 92:   2%|▏         | 2/117 [00:00<00:55,  2.09it/s, loss=0.678, v_num=1, val_acc=0.756]
Epoch 92:   3%|▎         | 3/117 [00:00<00:36,  3.10it/s, loss=0.678, v_num=1, val_acc=0.756]
Epoch 92:   3%|▎         | 3/117 [00:00<00:37,  3.02it/s, loss=0.673, v_num=1, val_acc=0.756]
Epoch 92:   3%|▎         | 4/117 [00:01<00:28,  3.98it/s, loss=0.673, v_num=1, val_acc=0.756]
Epoch 92:   3%|▎         | 4/117 [00:01<00:29,  3.89it/s, loss=0.673, v_num=1, val_acc=0.756]
Epoch 92:   4%|▍         | 5/117 [00:01<00:23,  4.82it/s, loss=0.673, v_num=1, val_acc=0.756]
Epoch 92:   4%|▍         | 5/117 [00:01<00:23,  4.70it/s, loss=0.669, v_num=1, val_acc=0.756]
Epoch 92:   5%|▌         | 6/117 [00:01<00:19,  5.58it/s, loss=0.669, v_num=1, val_acc=0.756]
Epoch 92:   5%|▌         | 6/117 [00:01<00:20,  5.45it/s, loss=0.666, v_num=1, val_acc=0.756]
Epoch 92:   6%|▌         | 7/117 [00:01<00:17,  6.31it/s, loss=0.666, v_num=1, val_acc=0.756]
Epoch 92:   6%|▌         | 7/117 [00:01<00:17,  6.17it/s, loss=0.666, v_num=1, val_acc=0.756]
Epoch 92:   7%|▋         | 8/117 [00:01<00:15,  7.00it/s, loss=0.666, v_num=1, val_acc=0.756]
Epoch 92:   7%|▋         | 8/117 [00:01<00:15,  6.85it/s, loss=0.664, v_num=1, val_acc=0.756]
Epoch 92:   8%|▊         | 9/117 [00:01<00:14,  7.60it/s, loss=0.664, v_num=1, val_acc=0.756]
Epoch 92:   8%|▊         | 9/117 [00:01<00:14,  7.45it/s, loss=0.662, v_num=1, val_acc=0.756]
Epoch 92:   9%|▊         | 10/117 [00:01<00:13,  8.22it/s, loss=0.662, v_num=1, val_acc=0.756]
Epoch 92:   9%|▊         | 10/117 [00:01<00:13,  8.05it/s, loss=0.664, v_num=1, val_acc=0.756]
Epoch 92:   9%|▉         | 11/117 [00:01<00:12,  8.80it/s, loss=0.664, v_num=1, val_acc=0.756]
Epoch 92:   9%|▉         | 11/117 [00:01<00:12,  8.62it/s, loss=0.665, v_num=1, val_acc=0.756]
Epoch 92:  10%|█         | 12/117 [00:01<00:11,  9.34it/s, loss=0.665, v_num=1, val_acc=0.756]
Epoch 92:  10%|█         | 12/117 [00:01<00:11,  9.16it/s, loss=0.666, v_num=1, val_acc=0.756]
Epoch 92:  11%|█         | 13/117 [00:01<00:10,  9.86it/s, loss=0.666, v_num=1, val_acc=0.756]
Epoch 92:  11%|█         | 13/117 [00:01<00:10,  9.68it/s, loss=0.663, v_num=1, val_acc=0.756]
Epoch 92:  12%|█▏        | 14/117 [00:01<00:09, 10.36it/s, loss=0.663, v_num=1, val_acc=0.756]
Epoch 92:  12%|█▏        | 14/117 [00:01<00:10, 10.16it/s, loss=0.667, v_num=1, val_acc=0.756]
Epoch 92:  13%|█▎        | 15/117 [00:01<00:09, 10.82it/s, loss=0.667, v_num=1, val_acc=0.756]
Epoch 92:  13%|█▎        | 15/117 [00:01<00:09, 10.63it/s, loss=0.674, v_num=1, val_acc=0.756]
Epoch 92:  14%|█▎        | 16/117 [00:01<00:08, 11.28it/s, loss=0.674, v_num=1, val_acc=0.756]
Epoch 92:  14%|█▎        | 16/117 [00:01<00:09, 11.07it/s, loss=0.672, v_num=1, val_acc=0.756]
Epoch 92:  15%|█▍        | 17/117 [00:01<00:08, 11.68it/s, loss=0.672, v_num=1, val_acc=0.756]
Epoch 92:  15%|█▍        | 17/117 [00:01<00:08, 11.48it/s, loss=0.673, v_num=1, val_acc=0.756]
Epoch 92:  15%|█▌        | 18/117 [00:01<00:08, 12.08it/s, loss=0.673, v_num=1, val_acc=0.756]
Epoch 92:  15%|█▌        | 18/117 [00:01<00:08, 11.88it/s, loss=0.673, v_num=1, val_acc=0.756]
Epoch 92:  16%|█▌        | 19/117 [00:01<00:07, 12.47it/s, loss=0.673, v_num=1, val_acc=0.756]
Epoch 92:  16%|█▌        | 19/117 [00:01<00:07, 12.26it/s, loss=0.675, v_num=1, val_acc=0.756]
Epoch 92:  17%|█▋        | 20/117 [00:01<00:07, 12.84it/s, loss=0.675, v_num=1, val_acc=0.756]
Epoch 92:  17%|█▋        | 20/117 [00:01<00:07, 12.63it/s, loss=0.677, v_num=1, val_acc=0.756]
Epoch 92:  18%|█▊        | 21/117 [00:01<00:07, 13.19it/s, loss=0.677, v_num=1, val_acc=0.756]
Epoch 92:  18%|█▊        | 21/117 [00:01<00:07, 12.98it/s, loss=0.68, v_num=1, val_acc=0.756]
Epoch 92:  19%|█▉        | 22/117 [00:01<00:07, 13.52it/s, loss=0.68, v_num=1, val_acc=0.756]
Epoch 92:  19%|█▉        | 22/117 [00:01<00:07, 13.32it/s, loss=0.679, v_num=1, val_acc=0.756]
Epoch 92:  20%|█▉        | 23/117 [00:01<00:06, 13.85it/s, loss=0.679, v_num=1, val_acc=0.756]
Epoch 92:  20%|█▉        | 23/117 [00:01<00:06, 13.64it/s, loss=0.68, v_num=1, val_acc=0.756]
Epoch 92:  21%|██        | 24/117 [00:01<00:06, 14.16it/s, loss=0.68, v_num=1, val_acc=0.756]
Epoch 92:  21%|██        | 24/117 [00:01<00:06, 13.95it/s, loss=0.678, v_num=1, val_acc=0.756]
Epoch 92:  21%|██▏       | 25/117 [00:01<00:06, 14.44it/s, loss=0.678, v_num=1, val_acc=0.756]
Epoch 92:  21%|██▏       | 25/117 [00:01<00:06, 14.24it/s, loss=0.68, v_num=1, val_acc=0.756]
Epoch 92:  22%|██▏       | 26/117 [00:01<00:06, 14.73it/s, loss=0.68, v_num=1, val_acc=0.756]
Epoch 92:  22%|██▏       | 26/117 [00:01<00:06, 14.52it/s, loss=0.679, v_num=1, val_acc=0.756]
Epoch 92:  23%|██▎       | 27/117 [00:01<00:06, 14.99it/s, loss=0.679, v_num=1, val_acc=0.756]
Epoch 92:  23%|██▎       | 27/117 [00:01<00:06, 14.79it/s, loss=0.683, v_num=1, val_acc=0.756]
Epoch 92:  24%|██▍       | 28/117 [00:01<00:05, 15.26it/s, loss=0.683, v_num=1, val_acc=0.756]
Epoch 92:  24%|██▍       | 28/117 [00:01<00:05, 15.05it/s, loss=0.683, v_num=1, val_acc=0.756]
Epoch 92:  25%|██▍       | 29/117 [00:01<00:05, 15.51it/s, loss=0.683, v_num=1, val_acc=0.756]
Epoch 92:  25%|██▍       | 29/117 [00:01<00:05, 15.30it/s, loss=0.684, v_num=1, val_acc=0.756]
Epoch 92:  26%|██▌       | 30/117 [00:01<00:05, 15.75it/s, loss=0.684, v_num=1, val_acc=0.756]
Epoch 92:  26%|██▌       | 30/117 [00:01<00:05, 15.55it/s, loss=0.683, v_num=1, val_acc=0.756]
Epoch 92:  26%|██▋       | 31/117 [00:01<00:05, 15.99it/s, loss=0.683, v_num=1, val_acc=0.756]
Epoch 92:  26%|██▋       | 31/117 [00:01<00:05, 15.78it/s, loss=0.68, v_num=1, val_acc=0.756]
Epoch 92:  27%|██▋       | 32/117 [00:01<00:05, 16.22it/s, loss=0.68, v_num=1, val_acc=0.756]
Epoch 92:  27%|██▋       | 32/117 [00:01<00:05, 16.01it/s, loss=0.681, v_num=1, val_acc=0.756]
Epoch 92:  28%|██▊       | 33/117 [00:02<00:05, 16.44it/s, loss=0.681, v_num=1, val_acc=0.756]
Epoch 92:  28%|██▊       | 33/117 [00:02<00:05, 16.23it/s, loss=0.685, v_num=1, val_acc=0.756]
Epoch 92:  29%|██▉       | 34/117 [00:02<00:04, 16.65it/s, loss=0.685, v_num=1, val_acc=0.756]
Epoch 92:  29%|██▉       | 34/117 [00:02<00:05, 16.44it/s, loss=0.683, v_num=1, val_acc=0.756]
Epoch 92:  30%|██▉       | 35/117 [00:02<00:04, 16.85it/s, loss=0.683, v_num=1, val_acc=0.756]
Epoch 92:  30%|██▉       | 35/117 [00:02<00:04, 16.65it/s, loss=0.679, v_num=1, val_acc=0.756]
Epoch 92:  31%|███       | 36/117 [00:02<00:04, 17.05it/s, loss=0.679, v_num=1, val_acc=0.756]
Epoch 92:  31%|███       | 36/117 [00:02<00:04, 16.85it/s, loss=0.679, v_num=1, val_acc=0.756]
Epoch 92:  32%|███▏      | 37/117 [00:02<00:04, 17.24it/s, loss=0.679, v_num=1, val_acc=0.756]
Epoch 92:  32%|███▏      | 37/117 [00:02<00:04, 17.04it/s, loss=0.679, v_num=1, val_acc=0.756]
Epoch 92:  32%|███▏      | 38/117 [00:02<00:04, 17.43it/s, loss=0.679, v_num=1, val_acc=0.756]
Epoch 92:  32%|███▏      | 38/117 [00:02<00:04, 17.23it/s, loss=0.679, v_num=1, val_acc=0.756]
Epoch 92:  33%|███▎      | 39/117 [00:02<00:04, 17.61it/s, loss=0.679, v_num=1, val_acc=0.756]
Epoch 92:  33%|███▎      | 39/117 [00:02<00:04, 17.41it/s, loss=0.682, v_num=1, val_acc=0.756]
Epoch 92:  34%|███▍      | 40/117 [00:02<00:04, 17.78it/s, loss=0.682, v_num=1, val_acc=0.756]
Epoch 92:  34%|███▍      | 40/117 [00:02<00:04, 17.59it/s, loss=0.682, v_num=1, val_acc=0.756]
Epoch 92:  35%|███▌      | 41/117 [00:02<00:04, 17.95it/s, loss=0.682, v_num=1, val_acc=0.756]
Epoch 92:  35%|███▌      | 41/117 [00:02<00:04, 17.76it/s, loss=0.678, v_num=1, val_acc=0.756]
Epoch 92:  36%|███▌      | 42/117 [00:02<00:04, 18.12it/s, loss=0.678, v_num=1, val_acc=0.756]
Epoch 92:  36%|███▌      | 42/117 [00:02<00:04, 17.92it/s, loss=0.678, v_num=1, val_acc=0.756]
Epoch 92:  37%|███▋      | 43/117 [00:02<00:04, 18.28it/s, loss=0.678, v_num=1, val_acc=0.756]
Epoch 92:  37%|███▋      | 43/117 [00:02<00:04, 18.08it/s, loss=0.682, v_num=1, val_acc=0.756]
Epoch 92:  38%|███▊      | 44/117 [00:02<00:03, 18.43it/s, loss=0.682, v_num=1, val_acc=0.756]
Epoch 92:  38%|███▊      | 44/117 [00:02<00:04, 18.24it/s, loss=0.684, v_num=1, val_acc=0.756]
Epoch 92:  38%|███▊      | 45/117 [00:02<00:03, 18.58it/s, loss=0.684, v_num=1, val_acc=0.756]
Epoch 92:  38%|███▊      | 45/117 [00:02<00:03, 18.38it/s, loss=0.684, v_num=1, val_acc=0.756]
Epoch 92:  39%|███▉      | 46/117 [00:02<00:03, 18.72it/s, loss=0.684, v_num=1, val_acc=0.756]
Epoch 92:  39%|███▉      | 46/117 [00:02<00:03, 18.53it/s, loss=0.69, v_num=1, val_acc=0.756]
Epoch 92:  40%|████      | 47/117 [00:02<00:03, 18.86it/s, loss=0.69, v_num=1, val_acc=0.756]
Epoch 92:  40%|████      | 47/117 [00:02<00:03, 18.68it/s, loss=0.688, v_num=1, val_acc=0.756]
Epoch 92:  41%|████      | 48/117 [00:02<00:03, 19.00it/s, loss=0.688, v_num=1, val_acc=0.756]
Epoch 92:  41%|████      | 48/117 [00:02<00:03, 18.81it/s, loss=0.688, v_num=1, val_acc=0.756]
Epoch 92:  42%|████▏     | 49/117 [00:02<00:03, 19.14it/s, loss=0.688, v_num=1, val_acc=0.756]
Epoch 92:  42%|████▏     | 49/117 [00:02<00:03, 18.95it/s, loss=0.692, v_num=1, val_acc=0.756]
Epoch 92:  43%|████▎     | 50/117 [00:02<00:03, 19.23it/s, loss=0.692, v_num=1, val_acc=0.756]
Epoch 92:  43%|████▎     | 50/117 [00:02<00:03, 19.05it/s, loss=0.697, v_num=1, val_acc=0.756]
Epoch 92:  44%|████▎     | 51/117 [00:02<00:03, 19.33it/s, loss=0.697, v_num=1, val_acc=0.756]
Epoch 92:  44%|████▎     | 51/117 [00:02<00:03, 19.16it/s, loss=0.697, v_num=1, val_acc=0.756]
Epoch 92:  44%|████▍     | 52/117 [00:02<00:03, 19.47it/s, loss=0.697, v_num=1, val_acc=0.756]
Epoch 92:  44%|████▍     | 52/117 [00:02<00:03, 19.29it/s, loss=0.699, v_num=1, val_acc=0.756]
Epoch 92:  45%|████▌     | 53/117 [00:02<00:03, 19.59it/s, loss=0.699, v_num=1, val_acc=0.756]
Epoch 92:  45%|████▌     | 53/117 [00:02<00:03, 19.41it/s, loss=0.696, v_num=1, val_acc=0.756]
Epoch 92:  46%|████▌     | 54/117 [00:02<00:03, 19.71it/s, loss=0.696, v_num=1, val_acc=0.756]
Epoch 92:  46%|████▌     | 54/117 [00:02<00:03, 19.53it/s, loss=0.693, v_num=1, val_acc=0.756]
Epoch 92:  47%|████▋     | 55/117 [00:02<00:03, 19.83it/s, loss=0.693, v_num=1, val_acc=0.756]
Epoch 92:  47%|████▋     | 55/117 [00:02<00:03, 19.65it/s, loss=0.689, v_num=1, val_acc=0.756]
Epoch 92:  48%|████▊     | 56/117 [00:02<00:03, 19.94it/s, loss=0.689, v_num=1, val_acc=0.756]
Epoch 92:  48%|████▊     | 56/117 [00:02<00:03, 19.76it/s, loss=0.687, v_num=1, val_acc=0.756]
Epoch 92:  49%|████▊     | 57/117 [00:02<00:02, 20.05it/s, loss=0.687, v_num=1, val_acc=0.756]
Epoch 92:  49%|████▊     | 57/117 [00:02<00:03, 19.88it/s, loss=0.69, v_num=1, val_acc=0.756]
Epoch 92:  50%|████▉     | 58/117 [00:02<00:02, 20.16it/s, loss=0.69, v_num=1, val_acc=0.756]
Epoch 92:  50%|████▉     | 58/117 [00:02<00:02, 19.98it/s, loss=0.689, v_num=1, val_acc=0.756]
Epoch 92:  50%|█████     | 59/117 [00:02<00:02, 20.26it/s, loss=0.689, v_num=1, val_acc=0.756]
Epoch 92:  50%|█████     | 59/117 [00:02<00:02, 20.09it/s, loss=0.685, v_num=1, val_acc=0.756]
Epoch 92:  51%|█████▏    | 60/117 [00:02<00:02, 20.37it/s, loss=0.685, v_num=1, val_acc=0.756]
Epoch 92:  51%|█████▏    | 60/117 [00:02<00:02, 20.19it/s, loss=0.682, v_num=1, val_acc=0.756]
Epoch 92:  52%|█████▏    | 61/117 [00:02<00:02, 20.47it/s, loss=0.682, v_num=1, val_acc=0.756]
Epoch 92:  52%|█████▏    | 61/117 [00:03<00:02, 20.30it/s, loss=0.679, v_num=1, val_acc=0.756]
Epoch 92:  53%|█████▎    | 62/117 [00:03<00:02, 20.56it/s, loss=0.679, v_num=1, val_acc=0.756]
Epoch 92:  53%|█████▎    | 62/117 [00:03<00:02, 20.39it/s, loss=0.679, v_num=1, val_acc=0.756]
Epoch 92:  54%|█████▍    | 63/117 [00:03<00:02, 20.66it/s, loss=0.679, v_num=1, val_acc=0.756]
Epoch 92:  54%|█████▍    | 63/117 [00:03<00:02, 20.49it/s, loss=0.674, v_num=1, val_acc=0.756]
Epoch 92:  55%|█████▍    | 64/117 [00:03<00:02, 20.75it/s, loss=0.674, v_num=1, val_acc=0.756]
Epoch 92:  55%|█████▍    | 64/117 [00:03<00:02, 20.59it/s, loss=0.673, v_num=1, val_acc=0.756]
Epoch 92:  56%|█████▌    | 65/117 [00:03<00:02, 20.85it/s, loss=0.673, v_num=1, val_acc=0.756]
Epoch 92:  56%|█████▌    | 65/117 [00:03<00:02, 20.68it/s, loss=0.677, v_num=1, val_acc=0.756]
Epoch 92:  56%|█████▋    | 66/117 [00:03<00:02, 20.93it/s, loss=0.677, v_num=1, val_acc=0.756]
Epoch 92:  56%|█████▋    | 66/117 [00:03<00:02, 20.77it/s, loss=0.672, v_num=1, val_acc=0.756]
Epoch 92:  57%|█████▋    | 67/117 [00:03<00:02, 21.02it/s, loss=0.672, v_num=1, val_acc=0.756]
Epoch 92:  57%|█████▋    | 67/117 [00:03<00:02, 20.86it/s, loss=0.673, v_num=1, val_acc=0.756]
Epoch 92:  58%|█████▊    | 68/117 [00:03<00:02, 21.11it/s, loss=0.673, v_num=1, val_acc=0.756]
Epoch 92:  58%|█████▊    | 68/117 [00:03<00:02, 20.94it/s, loss=0.672, v_num=1, val_acc=0.756]
Epoch 92:  59%|█████▉    | 69/117 [00:03<00:02, 21.19it/s, loss=0.672, v_num=1, val_acc=0.756]
Epoch 92:  59%|█████▉    | 69/117 [00:03<00:02, 21.03it/s, loss=0.667, v_num=1, val_acc=0.756]
Epoch 92:  60%|█████▉    | 70/117 [00:03<00:02, 21.27it/s, loss=0.667, v_num=1, val_acc=0.756]
Epoch 92:  60%|█████▉    | 70/117 [00:03<00:02, 21.11it/s, loss=0.661, v_num=1, val_acc=0.756]
Epoch 92:  61%|██████    | 71/117 [00:03<00:02, 21.35it/s, loss=0.661, v_num=1, val_acc=0.756]
Epoch 92:  61%|██████    | 71/117 [00:03<00:02, 21.19it/s, loss=0.666, v_num=1, val_acc=0.756]
Epoch 92:  62%|██████▏   | 72/117 [00:03<00:02, 21.43it/s, loss=0.666, v_num=1, val_acc=0.756]
Epoch 92:  62%|██████▏   | 72/117 [00:03<00:02, 21.27it/s, loss=0.664, v_num=1, val_acc=0.756]
Epoch 92:  62%|██████▏   | 73/117 [00:03<00:02, 21.50it/s, loss=0.664, v_num=1, val_acc=0.756]
Epoch 92:  62%|██████▏   | 73/117 [00:03<00:02, 21.34it/s, loss=0.659, v_num=1, val_acc=0.756]
Epoch 92:  63%|██████▎   | 74/117 [00:03<00:01, 21.55it/s, loss=0.659, v_num=1, val_acc=0.756]
Epoch 92:  63%|██████▎   | 74/117 [00:03<00:02, 21.40it/s, loss=0.655, v_num=1, val_acc=0.756]
Epoch 92:  64%|██████▍   | 75/117 [00:03<00:01, 21.62it/s, loss=0.655, v_num=1, val_acc=0.756]
Epoch 92:  64%|██████▍   | 75/117 [00:03<00:01, 21.47it/s, loss=0.656, v_num=1, val_acc=0.756]
Epoch 92:  65%|██████▍   | 76/117 [00:03<00:01, 21.70it/s, loss=0.656, v_num=1, val_acc=0.756]
Epoch 92:  65%|██████▍   | 76/117 [00:03<00:01, 21.54it/s, loss=0.662, v_num=1, val_acc=0.756]
Epoch 92:  66%|██████▌   | 77/117 [00:03<00:01, 21.77it/s, loss=0.662, v_num=1, val_acc=0.756]
Epoch 92:  66%|██████▌   | 77/117 [00:03<00:01, 21.61it/s, loss=0.66, v_num=1, val_acc=0.756]
Epoch 92:  67%|██████▋   | 78/117 [00:03<00:01, 21.84it/s, loss=0.66, v_num=1, val_acc=0.756]
Epoch 92:  67%|██████▋   | 78/117 [00:03<00:01, 21.68it/s, loss=0.669, v_num=1, val_acc=0.756]
Epoch 92:  68%|██████▊   | 79/117 [00:03<00:01, 21.91it/s, loss=0.669, v_num=1, val_acc=0.756]
Epoch 92:  68%|██████▊   | 79/117 [00:03<00:01, 21.75it/s, loss=0.667, v_num=1, val_acc=0.756]
Epoch 92:  68%|██████▊   | 80/117 [00:03<00:01, 21.97it/s, loss=0.667, v_num=1, val_acc=0.756]
Epoch 92:  68%|██████▊   | 80/117 [00:03<00:01, 21.82it/s, loss=0.677, v_num=1, val_acc=0.756]
Epoch 92:  69%|██████▉   | 81/117 [00:03<00:01, 22.04it/s, loss=0.677, v_num=1, val_acc=0.756]
Epoch 92:  69%|██████▉   | 81/117 [00:03<00:01, 21.89it/s, loss=0.682, v_num=1, val_acc=0.756]
Epoch 92:  70%|███████   | 82/117 [00:03<00:01, 22.09it/s, loss=0.682, v_num=1, val_acc=0.756]
Epoch 92:  70%|███████   | 82/117 [00:03<00:01, 21.94it/s, loss=0.682, v_num=1, val_acc=0.756]
Epoch 92:  71%|███████   | 83/117 [00:03<00:01, 22.16it/s, loss=0.682, v_num=1, val_acc=0.756]
Epoch 92:  71%|███████   | 83/117 [00:03<00:01, 22.01it/s, loss=0.687, v_num=1, val_acc=0.756]
Epoch 92:  72%|███████▏  | 84/117 [00:03<00:01, 22.22it/s, loss=0.687, v_num=1, val_acc=0.756]
Epoch 92:  72%|███████▏  | 84/117 [00:03<00:01, 22.07it/s, loss=0.687, v_num=1, val_acc=0.756]
Epoch 92:  73%|███████▎  | 85/117 [00:03<00:01, 22.28it/s, loss=0.687, v_num=1, val_acc=0.756]
Epoch 92:  73%|███████▎  | 85/117 [00:03<00:01, 22.14it/s, loss=0.684, v_num=1, val_acc=0.756]
Epoch 92:  74%|███████▎  | 86/117 [00:03<00:01, 22.34it/s, loss=0.684, v_num=1, val_acc=0.756]
Epoch 92:  74%|███████▎  | 86/117 [00:03<00:01, 22.20it/s, loss=0.685, v_num=1, val_acc=0.756]
Epoch 92:  74%|███████▍  | 87/117 [00:03<00:01, 22.41it/s, loss=0.685, v_num=1, val_acc=0.756]
Epoch 92:  74%|███████▍  | 87/117 [00:03<00:01, 22.26it/s, loss=0.686, v_num=1, val_acc=0.756]
Epoch 92:  75%|███████▌  | 88/117 [00:03<00:01, 22.47it/s, loss=0.686, v_num=1, val_acc=0.756]
Epoch 92:  75%|███████▌  | 88/117 [00:03<00:01, 22.32it/s, loss=0.686, v_num=1, val_acc=0.756]
Epoch 92:  76%|███████▌  | 89/117 [00:03<00:01, 22.53it/s, loss=0.686, v_num=1, val_acc=0.756]
Epoch 92:  76%|███████▌  | 89/117 [00:03<00:01, 22.38it/s, loss=0.689, v_num=1, val_acc=0.756]
Epoch 92:  77%|███████▋  | 90/117 [00:03<00:01, 22.58it/s, loss=0.689, v_num=1, val_acc=0.756]
Epoch 92:  77%|███████▋  | 90/117 [00:04<00:01, 22.44it/s, loss=0.692, v_num=1, val_acc=0.756]
Epoch 92:  78%|███████▊  | 91/117 [00:04<00:01, 22.64it/s, loss=0.692, v_num=1, val_acc=0.756]
Epoch 92:  78%|███████▊  | 91/117 [00:04<00:01, 22.49it/s, loss=0.687, v_num=1, val_acc=0.756]
Epoch 92:  79%|███████▊  | 92/117 [00:04<00:01, 22.69it/s, loss=0.687, v_num=1, val_acc=0.756]
Epoch 92:  79%|███████▊  | 92/117 [00:04<00:01, 22.55it/s, loss=0.688, v_num=1, val_acc=0.756]
Epoch 92:  79%|███████▉  | 93/117 [00:04<00:01, 22.75it/s, loss=0.688, v_num=1, val_acc=0.756]
Epoch 92:  79%|███████▉  | 93/117 [00:04<00:01, 22.61it/s, loss=0.696, v_num=1, val_acc=0.756]
Epoch 92:  80%|████████  | 94/117 [00:04<00:01, 22.80it/s, loss=0.696, v_num=1, val_acc=0.756]
Epoch 92:  80%|████████  | 94/117 [00:04<00:01, 22.66it/s, loss=0.701, v_num=1, val_acc=0.756]
Epoch 92:  81%|████████  | 95/117 [00:04<00:00, 22.85it/s, loss=0.701, v_num=1, val_acc=0.756]
Epoch 92:  81%|████████  | 95/117 [00:04<00:00, 22.71it/s, loss=0.703, v_num=1, val_acc=0.756]
Epoch 92:  82%|████████▏ | 96/117 [00:04<00:00, 22.90it/s, loss=0.703, v_num=1, val_acc=0.756]
Epoch 92:  82%|████████▏ | 96/117 [00:04<00:00, 22.76it/s, loss=0.703, v_num=1, val_acc=0.756]
Epoch 92:  83%|████████▎ | 97/117 [00:04<00:00, 22.95it/s, loss=0.703, v_num=1, val_acc=0.756]
Epoch 92:  83%|████████▎ | 97/117 [00:04<00:00, 22.82it/s, loss=0.703, v_num=1, val_acc=0.756]

Validation: 0it [00:00, ?it/s]

Validation:   0%|          | 0/20 [00:00<?, ?it/s]

Validation DataLoader 0:   0%|          | 0/20 [00:00<?, ?it/s]

Validation DataLoader 0:   5%|▌         | 1/20 [00:00<00:00, 131.06it/s]
Epoch 92:  84%|████████▍ | 98/117 [00:05<00:00, 19.20it/s, loss=0.703, v_num=1, val_acc=0.756]

Validation DataLoader 0:  10%|█         | 2/20 [00:00<00:00, 53.50it/s]
Epoch 92:  85%|████████▍ | 99/117 [00:05<00:00, 19.28it/s, loss=0.703, v_num=1, val_acc=0.756]

Validation DataLoader 0:  15%|█▌        | 3/20 [00:00<00:00, 43.38it/s]
Epoch 92:  85%|████████▌ | 100/117 [00:05<00:00, 19.36it/s, loss=0.703, v_num=1, val_acc=0.756]

Validation DataLoader 0:  20%|██        | 4/20 [00:00<00:00, 39.68it/s]
Epoch 92:  86%|████████▋ | 101/117 [00:05<00:00, 19.43it/s, loss=0.703, v_num=1, val_acc=0.756]

Validation DataLoader 0:  25%|██▌       | 5/20 [00:00<00:00, 37.47it/s]
Epoch 92:  87%|████████▋ | 102/117 [00:05<00:00, 19.50it/s, loss=0.703, v_num=1, val_acc=0.756]

Validation DataLoader 0:  30%|███       | 6/20 [00:00<00:00, 36.39it/s]
Epoch 92:  88%|████████▊ | 103/117 [00:05<00:00, 19.57it/s, loss=0.703, v_num=1, val_acc=0.756]

Validation DataLoader 0:  35%|███▌      | 7/20 [00:00<00:00, 35.67it/s]
Epoch 92:  89%|████████▉ | 104/117 [00:05<00:00, 19.65it/s, loss=0.703, v_num=1, val_acc=0.756]

Validation DataLoader 0:  40%|████      | 8/20 [00:00<00:00, 35.09it/s]
Epoch 92:  90%|████████▉ | 105/117 [00:05<00:00, 19.72it/s, loss=0.703, v_num=1, val_acc=0.756]

Validation DataLoader 0:  45%|████▌     | 9/20 [00:00<00:00, 34.65it/s]
Epoch 92:  91%|█████████ | 106/117 [00:05<00:00, 19.79it/s, loss=0.703, v_num=1, val_acc=0.756]

Validation DataLoader 0:  50%|█████     | 10/20 [00:00<00:00, 34.33it/s]
Epoch 92:  91%|█████████▏| 107/117 [00:05<00:00, 19.86it/s, loss=0.703, v_num=1, val_acc=0.756]

Validation DataLoader 0:  55%|█████▌    | 11/20 [00:00<00:00, 34.08it/s]
Epoch 92:  92%|█████████▏| 108/117 [00:05<00:00, 19.93it/s, loss=0.703, v_num=1, val_acc=0.756]

Validation DataLoader 0:  60%|██████    | 12/20 [00:00<00:00, 33.86it/s]
Epoch 92:  93%|█████████▎| 109/117 [00:05<00:00, 19.99it/s, loss=0.703, v_num=1, val_acc=0.756]

Validation DataLoader 0:  65%|██████▌   | 13/20 [00:00<00:00, 33.69it/s]
Epoch 92:  94%|█████████▍| 110/117 [00:05<00:00, 20.06it/s, loss=0.703, v_num=1, val_acc=0.756]

Validation DataLoader 0:  70%|███████   | 14/20 [00:00<00:00, 33.50it/s]
Epoch 92:  95%|█████████▍| 111/117 [00:05<00:00, 20.13it/s, loss=0.703, v_num=1, val_acc=0.756]

Validation DataLoader 0:  75%|███████▌  | 15/20 [00:00<00:00, 33.36it/s]
Epoch 92:  96%|█████████▌| 112/117 [00:05<00:00, 20.19it/s, loss=0.703, v_num=1, val_acc=0.756]

Validation DataLoader 0:  80%|████████  | 16/20 [00:00<00:00, 33.25it/s]
Epoch 92:  97%|█████████▋| 113/117 [00:05<00:00, 20.26it/s, loss=0.703, v_num=1, val_acc=0.756]

Validation DataLoader 0:  85%|████████▌ | 17/20 [00:00<00:00, 33.13it/s]
Epoch 92:  97%|█████████▋| 114/117 [00:05<00:00, 20.32it/s, loss=0.703, v_num=1, val_acc=0.756]

Validation DataLoader 0:  90%|█████████ | 18/20 [00:00<00:00, 33.05it/s]
Epoch 92:  98%|█████████▊| 115/117 [00:05<00:00, 20.38it/s, loss=0.703, v_num=1, val_acc=0.756]

Validation DataLoader 0:  95%|█████████▌| 19/20 [00:00<00:00, 32.96it/s]
Epoch 92:  99%|█████████▉| 116/117 [00:05<00:00, 20.44it/s, loss=0.703, v_num=1, val_acc=0.756]

Validation DataLoader 0: 100%|██████████| 20/20 [00:00<00:00, 32.76it/s]
Epoch 92: 100%|██████████| 117/117 [00:05<00:00, 20.50it/s, loss=0.703, v_num=1, val_acc=0.756]
Epoch 92: 100%|██████████| 117/117 [00:05<00:00, 20.43it/s, loss=0.703, v_num=1, val_acc=0.757]


Epoch 92: 100%|██████████| 117/117 [00:05<00:00, 20.42it/s, loss=0.703, v_num=1, val_acc=0.757]
Epoch 92:   0%|          | 0/117 [00:00<?, ?it/s, loss=0.703, v_num=1, val_acc=0.757]
Epoch 93:   0%|          | 0/117 [00:00<?, ?it/s, loss=0.703, v_num=1, val_acc=0.757]
Epoch 93:   1%|          | 1/117 [00:00<01:45,  1.10it/s, loss=0.703, v_num=1, val_acc=0.757]
Epoch 93:   1%|          | 1/117 [00:00<01:48,  1.07it/s, loss=0.698, v_num=1, val_acc=0.757]
Epoch 93:   2%|▏         | 2/117 [00:00<00:54,  2.12it/s, loss=0.698, v_num=1, val_acc=0.757]
Epoch 93:   2%|▏         | 2/117 [00:00<00:55,  2.06it/s, loss=0.698, v_num=1, val_acc=0.757]
Epoch 93:   3%|▎         | 3/117 [00:00<00:37,  3.06it/s, loss=0.698, v_num=1, val_acc=0.757]
Epoch 93:   3%|▎         | 3/117 [00:01<00:38,  2.99it/s, loss=0.696, v_num=1, val_acc=0.757]
Epoch 93:   3%|▎         | 4/117 [00:01<00:28,  3.94it/s, loss=0.696, v_num=1, val_acc=0.757]
Epoch 93:   3%|▎         | 4/117 [00:01<00:29,  3.85it/s, loss=0.698, v_num=1, val_acc=0.757]
Epoch 93:   4%|▍         | 5/117 [00:01<00:23,  4.77it/s, loss=0.698, v_num=1, val_acc=0.757]
Epoch 93:   4%|▍         | 5/117 [00:01<00:24,  4.65it/s, loss=0.699, v_num=1, val_acc=0.757]
Epoch 93:   5%|▌         | 6/117 [00:01<00:20,  5.53it/s, loss=0.699, v_num=1, val_acc=0.757]
Epoch 93:   5%|▌         | 6/117 [00:01<00:20,  5.41it/s, loss=0.698, v_num=1, val_acc=0.757]
Epoch 93:   6%|▌         | 7/117 [00:01<00:17,  6.26it/s, loss=0.698, v_num=1, val_acc=0.757]
Epoch 93:   6%|▌         | 7/117 [00:01<00:17,  6.12it/s, loss=0.701, v_num=1, val_acc=0.757]
Epoch 93:   7%|▋         | 8/117 [00:01<00:15,  6.88it/s, loss=0.701, v_num=1, val_acc=0.757]
Epoch 93:   7%|▋         | 8/117 [00:01<00:16,  6.74it/s, loss=0.701, v_num=1, val_acc=0.757]
Epoch 93:   8%|▊         | 9/117 [00:01<00:14,  7.51it/s, loss=0.701, v_num=1, val_acc=0.757]
Epoch 93:   8%|▊         | 9/117 [00:01<00:14,  7.36it/s, loss=0.703, v_num=1, val_acc=0.757]
Epoch 93:   9%|▊         | 10/117 [00:01<00:13,  8.12it/s, loss=0.703, v_num=1, val_acc=0.757]
Epoch 93:   9%|▊         | 10/117 [00:01<00:13,  7.95it/s, loss=0.7, v_num=1, val_acc=0.757]
Epoch 93:   9%|▉         | 11/117 [00:01<00:12,  8.69it/s, loss=0.7, v_num=1, val_acc=0.757]
Epoch 93:   9%|▉         | 11/117 [00:01<00:12,  8.52it/s, loss=0.701, v_num=1, val_acc=0.757]
Epoch 93:  10%|█         | 12/117 [00:01<00:11,  9.22it/s, loss=0.701, v_num=1, val_acc=0.757]
Epoch 93:  10%|█         | 12/117 [00:01<00:11,  9.04it/s, loss=0.698, v_num=1, val_acc=0.757]
Epoch 93:  11%|█         | 13/117 [00:01<00:10,  9.73it/s, loss=0.698, v_num=1, val_acc=0.757]
Epoch 93:  11%|█         | 13/117 [00:01<00:10,  9.55it/s, loss=0.7, v_num=1, val_acc=0.757]
Epoch 93:  12%|█▏        | 14/117 [00:01<00:10, 10.23it/s, loss=0.7, v_num=1, val_acc=0.757]
Epoch 93:  12%|█▏        | 14/117 [00:01<00:10, 10.04it/s, loss=0.7, v_num=1, val_acc=0.757]
Epoch 93:  13%|█▎        | 15/117 [00:01<00:09, 10.68it/s, loss=0.7, v_num=1, val_acc=0.757]
Epoch 93:  13%|█▎        | 15/117 [00:01<00:09, 10.50it/s, loss=0.697, v_num=1, val_acc=0.757]
Epoch 93:  14%|█▎        | 16/117 [00:01<00:09, 11.12it/s, loss=0.697, v_num=1, val_acc=0.757]
Epoch 93:  14%|█▎        | 16/117 [00:01<00:09, 10.93it/s, loss=0.691, v_num=1, val_acc=0.757]
Epoch 93:  15%|█▍        | 17/117 [00:01<00:08, 11.52it/s, loss=0.691, v_num=1, val_acc=0.757]
Epoch 93:  15%|█▍        | 17/117 [00:01<00:08, 11.33it/s, loss=0.692, v_num=1, val_acc=0.757]
Epoch 93:  15%|█▌        | 18/117 [00:01<00:08, 11.93it/s, loss=0.692, v_num=1, val_acc=0.757]
Epoch 93:  15%|█▌        | 18/117 [00:01<00:08, 11.73it/s, loss=0.691, v_num=1, val_acc=0.757]
Epoch 93:  16%|█▌        | 19/117 [00:01<00:07, 12.32it/s, loss=0.691, v_num=1, val_acc=0.757]
Epoch 93:  16%|█▌        | 19/117 [00:01<00:08, 12.12it/s, loss=0.695, v_num=1, val_acc=0.757]
Epoch 93:  17%|█▋        | 20/117 [00:01<00:07, 12.68it/s, loss=0.695, v_num=1, val_acc=0.757]
Epoch 93:  17%|█▋        | 20/117 [00:01<00:07, 12.48it/s, loss=0.696, v_num=1, val_acc=0.757]
Epoch 93:  18%|█▊        | 21/117 [00:01<00:07, 13.03it/s, loss=0.696, v_num=1, val_acc=0.757]
Epoch 93:  18%|█▊        | 21/117 [00:01<00:07, 12.83it/s, loss=0.695, v_num=1, val_acc=0.757]
Epoch 93:  19%|█▉        | 22/117 [00:01<00:07, 13.37it/s, loss=0.695, v_num=1, val_acc=0.757]
Epoch 93:  19%|█▉        | 22/117 [00:01<00:07, 13.16it/s, loss=0.693, v_num=1, val_acc=0.757]
Epoch 93:  20%|█▉        | 23/117 [00:01<00:06, 13.68it/s, loss=0.693, v_num=1, val_acc=0.757]
Epoch 93:  20%|█▉        | 23/117 [00:01<00:06, 13.48it/s, loss=0.693, v_num=1, val_acc=0.757]
Epoch 93:  21%|██        | 24/117 [00:01<00:06, 13.99it/s, loss=0.693, v_num=1, val_acc=0.757]
Epoch 93:  21%|██        | 24/117 [00:01<00:06, 13.79it/s, loss=0.694, v_num=1, val_acc=0.757]
Epoch 93:  21%|██▏       | 25/117 [00:01<00:06, 14.26it/s, loss=0.694, v_num=1, val_acc=0.757]
Epoch 93:  21%|██▏       | 25/117 [00:01<00:06, 14.06it/s, loss=0.693, v_num=1, val_acc=0.757]
Epoch 93:  22%|██▏       | 26/117 [00:01<00:06, 14.55it/s, loss=0.693, v_num=1, val_acc=0.757]
Epoch 93:  22%|██▏       | 26/117 [00:01<00:06, 14.35it/s, loss=0.694, v_num=1, val_acc=0.757]
Epoch 93:  23%|██▎       | 27/117 [00:01<00:06, 14.82it/s, loss=0.694, v_num=1, val_acc=0.757]
Epoch 93:  23%|██▎       | 27/117 [00:01<00:06, 14.62it/s, loss=0.688, v_num=1, val_acc=0.757]
Epoch 93:  24%|██▍       | 28/117 [00:01<00:05, 15.08it/s, loss=0.688, v_num=1, val_acc=0.757]
Epoch 93:  24%|██▍       | 28/117 [00:01<00:05, 14.88it/s, loss=0.686, v_num=1, val_acc=0.757]
Epoch 93:  25%|██▍       | 29/117 [00:01<00:05, 15.33it/s, loss=0.686, v_num=1, val_acc=0.757]
Epoch 93:  25%|██▍       | 29/117 [00:01<00:05, 15.13it/s, loss=0.682, v_num=1, val_acc=0.757]
Epoch 93:  26%|██▌       | 30/117 [00:01<00:05, 15.57it/s, loss=0.682, v_num=1, val_acc=0.757]
Epoch 93:  26%|██▌       | 30/117 [00:01<00:05, 15.37it/s, loss=0.684, v_num=1, val_acc=0.757]
Epoch 93:  26%|██▋       | 31/117 [00:01<00:05, 15.80it/s, loss=0.684, v_num=1, val_acc=0.757]
Epoch 93:  26%|██▋       | 31/117 [00:01<00:05, 15.60it/s, loss=0.685, v_num=1, val_acc=0.757]
Epoch 93:  27%|██▋       | 32/117 [00:02<00:05, 15.99it/s, loss=0.685, v_num=1, val_acc=0.757]
Epoch 93:  27%|██▋       | 32/117 [00:02<00:05, 15.81it/s, loss=0.689, v_num=1, val_acc=0.757]
Epoch 93:  28%|██▊       | 33/117 [00:02<00:05, 16.22it/s, loss=0.689, v_num=1, val_acc=0.757]
Epoch 93:  28%|██▊       | 33/117 [00:02<00:05, 16.03it/s, loss=0.687, v_num=1, val_acc=0.757]
Epoch 93:  29%|██▉       | 34/117 [00:02<00:05, 16.44it/s, loss=0.687, v_num=1, val_acc=0.757]
Epoch 93:  29%|██▉       | 34/117 [00:02<00:05, 16.24it/s, loss=0.689, v_num=1, val_acc=0.757]
Epoch 93:  30%|██▉       | 35/117 [00:02<00:04, 16.61it/s, loss=0.689, v_num=1, val_acc=0.757]
Epoch 93:  30%|██▉       | 35/117 [00:02<00:04, 16.42it/s, loss=0.696, v_num=1, val_acc=0.757]
Epoch 93:  31%|███       | 36/117 [00:02<00:04, 16.81it/s, loss=0.696, v_num=1, val_acc=0.757]
Epoch 93:  31%|███       | 36/117 [00:02<00:04, 16.62it/s, loss=0.698, v_num=1, val_acc=0.757]
Epoch 93:  32%|███▏      | 37/117 [00:02<00:04, 17.01it/s, loss=0.698, v_num=1, val_acc=0.757]
Epoch 93:  32%|███▏      | 37/117 [00:02<00:04, 16.81it/s, loss=0.695, v_num=1, val_acc=0.757]
Epoch 93:  32%|███▏      | 38/117 [00:02<00:04, 17.19it/s, loss=0.695, v_num=1, val_acc=0.757]
Epoch 93:  32%|███▏      | 38/117 [00:02<00:04, 17.00it/s, loss=0.698, v_num=1, val_acc=0.757]
Epoch 93:  33%|███▎      | 39/117 [00:02<00:04, 17.37it/s, loss=0.698, v_num=1, val_acc=0.757]
Epoch 93:  33%|███▎      | 39/117 [00:02<00:04, 17.18it/s, loss=0.691, v_num=1, val_acc=0.757]
Epoch 93:  34%|███▍      | 40/117 [00:02<00:04, 17.52it/s, loss=0.691, v_num=1, val_acc=0.757]
Epoch 93:  34%|███▍      | 40/117 [00:02<00:04, 17.35it/s, loss=0.689, v_num=1, val_acc=0.757]
Epoch 93:  35%|███▌      | 41/117 [00:02<00:04, 17.71it/s, loss=0.689, v_num=1, val_acc=0.757]
Epoch 93:  35%|███▌      | 41/117 [00:02<00:04, 17.52it/s, loss=0.684, v_num=1, val_acc=0.757]
Epoch 93:  36%|███▌      | 42/117 [00:02<00:04, 17.88it/s, loss=0.684, v_num=1, val_acc=0.757]
Epoch 93:  36%|███▌      | 42/117 [00:02<00:04, 17.69it/s, loss=0.687, v_num=1, val_acc=0.757]
Epoch 93:  37%|███▋      | 43/117 [00:02<00:04, 18.04it/s, loss=0.687, v_num=1, val_acc=0.757]
Epoch 93:  37%|███▋      | 43/117 [00:02<00:04, 17.85it/s, loss=0.687, v_num=1, val_acc=0.757]
Epoch 93:  38%|███▊      | 44/117 [00:02<00:04, 18.19it/s, loss=0.687, v_num=1, val_acc=0.757]
Epoch 93:  38%|███▊      | 44/117 [00:02<00:04, 18.01it/s, loss=0.681, v_num=1, val_acc=0.757]
Epoch 93:  38%|███▊      | 45/117 [00:02<00:03, 18.35it/s, loss=0.681, v_num=1, val_acc=0.757]
Epoch 93:  38%|███▊      | 45/117 [00:02<00:03, 18.16it/s, loss=0.677, v_num=1, val_acc=0.757]
Epoch 93:  39%|███▉      | 46/117 [00:02<00:03, 18.49it/s, loss=0.677, v_num=1, val_acc=0.757]
Epoch 93:  39%|███▉      | 46/117 [00:02<00:03, 18.31it/s, loss=0.674, v_num=1, val_acc=0.757]
Epoch 93:  40%|████      | 47/117 [00:02<00:03, 18.64it/s, loss=0.674, v_num=1, val_acc=0.757]
Epoch 93:  40%|████      | 47/117 [00:02<00:03, 18.45it/s, loss=0.673, v_num=1, val_acc=0.757]
Epoch 93:  41%|████      | 48/117 [00:02<00:03, 18.78it/s, loss=0.673, v_num=1, val_acc=0.757]
Epoch 93:  41%|████      | 48/117 [00:02<00:03, 18.59it/s, loss=0.679, v_num=1, val_acc=0.757]
Epoch 93:  42%|████▏     | 49/117 [00:02<00:03, 18.91it/s, loss=0.679, v_num=1, val_acc=0.757]
Epoch 93:  42%|████▏     | 49/117 [00:02<00:03, 18.73it/s, loss=0.685, v_num=1, val_acc=0.757]
Epoch 93:  43%|████▎     | 50/117 [00:02<00:03, 19.05it/s, loss=0.685, v_num=1, val_acc=0.757]
Epoch 93:  43%|████▎     | 50/117 [00:02<00:03, 18.86it/s, loss=0.691, v_num=1, val_acc=0.757]
Epoch 93:  44%|████▎     | 51/117 [00:02<00:03, 19.17it/s, loss=0.691, v_num=1, val_acc=0.757]
Epoch 93:  44%|████▎     | 51/117 [00:02<00:03, 18.99it/s, loss=0.691, v_num=1, val_acc=0.757]
Epoch 93:  44%|████▍     | 52/117 [00:02<00:03, 19.30it/s, loss=0.691, v_num=1, val_acc=0.757]
Epoch 93:  44%|████▍     | 52/117 [00:02<00:03, 19.12it/s, loss=0.684, v_num=1, val_acc=0.757]
Epoch 93:  45%|████▌     | 53/117 [00:02<00:03, 19.42it/s, loss=0.684, v_num=1, val_acc=0.757]
Epoch 93:  45%|████▌     | 53/117 [00:02<00:03, 19.24it/s, loss=0.686, v_num=1, val_acc=0.757]
Epoch 93:  46%|████▌     | 54/117 [00:02<00:03, 19.54it/s, loss=0.686, v_num=1, val_acc=0.757]
Epoch 93:  46%|████▌     | 54/117 [00:02<00:03, 19.37it/s, loss=0.685, v_num=1, val_acc=0.757]
Epoch 93:  47%|████▋     | 55/117 [00:02<00:03, 19.66it/s, loss=0.685, v_num=1, val_acc=0.757]
Epoch 93:  47%|████▋     | 55/117 [00:02<00:03, 19.48it/s, loss=0.681, v_num=1, val_acc=0.757]
Epoch 93:  48%|████▊     | 56/117 [00:02<00:03, 19.77it/s, loss=0.681, v_num=1, val_acc=0.757]
Epoch 93:  48%|████▊     | 56/117 [00:02<00:03, 19.60it/s, loss=0.687, v_num=1, val_acc=0.757]
Epoch 93:  49%|████▊     | 57/117 [00:02<00:03, 19.89it/s, loss=0.687, v_num=1, val_acc=0.757]
Epoch 93:  49%|████▊     | 57/117 [00:02<00:03, 19.71it/s, loss=0.686, v_num=1, val_acc=0.757]
Epoch 93:  50%|████▉     | 58/117 [00:02<00:02, 20.00it/s, loss=0.686, v_num=1, val_acc=0.757]
Epoch 93:  50%|████▉     | 58/117 [00:02<00:02, 19.82it/s, loss=0.683, v_num=1, val_acc=0.757]
Epoch 93:  50%|█████     | 59/117 [00:02<00:02, 20.10it/s, loss=0.683, v_num=1, val_acc=0.757]
Epoch 93:  50%|█████     | 59/117 [00:02<00:02, 19.93it/s, loss=0.687, v_num=1, val_acc=0.757]
Epoch 93:  51%|█████▏    | 60/117 [00:02<00:02, 20.20it/s, loss=0.687, v_num=1, val_acc=0.757]
Epoch 93:  51%|█████▏    | 60/117 [00:02<00:02, 20.03it/s, loss=0.685, v_num=1, val_acc=0.757]
Epoch 93:  52%|█████▏    | 61/117 [00:03<00:02, 20.31it/s, loss=0.685, v_num=1, val_acc=0.757]
Epoch 93:  52%|█████▏    | 61/117 [00:03<00:02, 20.14it/s, loss=0.693, v_num=1, val_acc=0.757]
Epoch 93:  53%|█████▎    | 62/117 [00:03<00:02, 20.41it/s, loss=0.693, v_num=1, val_acc=0.757]
Epoch 93:  53%|█████▎    | 62/117 [00:03<00:02, 20.24it/s, loss=0.696, v_num=1, val_acc=0.757]
Epoch 93:  54%|█████▍    | 63/117 [00:03<00:02, 20.50it/s, loss=0.696, v_num=1, val_acc=0.757]
Epoch 93:  54%|█████▍    | 63/117 [00:03<00:02, 20.33it/s, loss=0.693, v_num=1, val_acc=0.757]
Epoch 93:  55%|█████▍    | 64/117 [00:03<00:02, 20.60it/s, loss=0.693, v_num=1, val_acc=0.757]
Epoch 93:  55%|█████▍    | 64/117 [00:03<00:02, 20.43it/s, loss=0.695, v_num=1, val_acc=0.757]
Epoch 93:  56%|█████▌    | 65/117 [00:03<00:02, 20.69it/s, loss=0.695, v_num=1, val_acc=0.757]
Epoch 93:  56%|█████▌    | 65/117 [00:03<00:02, 20.52it/s, loss=0.697, v_num=1, val_acc=0.757]
Epoch 93:  56%|█████▋    | 66/117 [00:03<00:02, 20.78it/s, loss=0.697, v_num=1, val_acc=0.757]
Epoch 93:  56%|█████▋    | 66/117 [00:03<00:02, 20.61it/s, loss=0.702, v_num=1, val_acc=0.757]
Epoch 93:  57%|█████▋    | 67/117 [00:03<00:02, 20.87it/s, loss=0.702, v_num=1, val_acc=0.757]
Epoch 93:  57%|█████▋    | 67/117 [00:03<00:02, 20.71it/s, loss=0.708, v_num=1, val_acc=0.757]
Epoch 93:  58%|█████▊    | 68/117 [00:03<00:02, 20.95it/s, loss=0.708, v_num=1, val_acc=0.757]
Epoch 93:  58%|█████▊    | 68/117 [00:03<00:02, 20.79it/s, loss=0.705, v_num=1, val_acc=0.757]
Epoch 93:  59%|█████▉    | 69/117 [00:03<00:02, 21.04it/s, loss=0.705, v_num=1, val_acc=0.757]
Epoch 93:  59%|█████▉    | 69/117 [00:03<00:02, 20.88it/s, loss=0.703, v_num=1, val_acc=0.757]
Epoch 93:  60%|█████▉    | 70/117 [00:03<00:02, 21.12it/s, loss=0.703, v_num=1, val_acc=0.757]
Epoch 93:  60%|█████▉    | 70/117 [00:03<00:02, 20.96it/s, loss=0.698, v_num=1, val_acc=0.757]
Epoch 93:  61%|██████    | 71/117 [00:03<00:02, 21.21it/s, loss=0.698, v_num=1, val_acc=0.757]
Epoch 93:  61%|██████    | 71/117 [00:03<00:02, 21.05it/s, loss=0.698, v_num=1, val_acc=0.757]
Epoch 93:  62%|██████▏   | 72/117 [00:03<00:02, 21.28it/s, loss=0.698, v_num=1, val_acc=0.757]
Epoch 93:  62%|██████▏   | 72/117 [00:03<00:02, 21.13it/s, loss=0.698, v_num=1, val_acc=0.757]
Epoch 93:  62%|██████▏   | 73/117 [00:03<00:02, 21.36it/s, loss=0.698, v_num=1, val_acc=0.757]
Epoch 93:  62%|██████▏   | 73/117 [00:03<00:02, 21.21it/s, loss=0.699, v_num=1, val_acc=0.757]
Epoch 93:  63%|██████▎   | 74/117 [00:03<00:02, 21.44it/s, loss=0.699, v_num=1, val_acc=0.757]
Epoch 93:  63%|██████▎   | 74/117 [00:03<00:02, 21.28it/s, loss=0.699, v_num=1, val_acc=0.757]
Epoch 93:  64%|██████▍   | 75/117 [00:03<00:01, 21.51it/s, loss=0.699, v_num=1, val_acc=0.757]
Epoch 93:  64%|██████▍   | 75/117 [00:03<00:01, 21.36it/s, loss=0.693, v_num=1, val_acc=0.757]
Epoch 93:  65%|██████▍   | 76/117 [00:03<00:01, 21.59it/s, loss=0.693, v_num=1, val_acc=0.757]
Epoch 93:  65%|██████▍   | 76/117 [00:03<00:01, 21.43it/s, loss=0.686, v_num=1, val_acc=0.757]
Epoch 93:  66%|██████▌   | 77/117 [00:03<00:01, 21.66it/s, loss=0.686, v_num=1, val_acc=0.757]
Epoch 93:  66%|██████▌   | 77/117 [00:03<00:01, 21.51it/s, loss=0.686, v_num=1, val_acc=0.757]
Epoch 93:  67%|██████▋   | 78/117 [00:03<00:01, 21.73it/s, loss=0.686, v_num=1, val_acc=0.757]
Epoch 93:  67%|██████▋   | 78/117 [00:03<00:01, 21.58it/s, loss=0.685, v_num=1, val_acc=0.757]
Epoch 93:  68%|██████▊   | 79/117 [00:03<00:01, 21.80it/s, loss=0.685, v_num=1, val_acc=0.757]
Epoch 93:  68%|██████▊   | 79/117 [00:03<00:01, 21.65it/s, loss=0.681, v_num=1, val_acc=0.757]
Epoch 93:  68%|██████▊   | 80/117 [00:03<00:01, 21.86it/s, loss=0.681, v_num=1, val_acc=0.757]
Epoch 93:  68%|██████▊   | 80/117 [00:03<00:01, 21.71it/s, loss=0.688, v_num=1, val_acc=0.757]
Epoch 93:  69%|██████▉   | 81/117 [00:03<00:01, 21.93it/s, loss=0.688, v_num=1, val_acc=0.757]
Epoch 93:  69%|██████▉   | 81/117 [00:03<00:01, 21.78it/s, loss=0.683, v_num=1, val_acc=0.757]
Epoch 93:  70%|███████   | 82/117 [00:03<00:01, 21.98it/s, loss=0.683, v_num=1, val_acc=0.757]
Epoch 93:  70%|███████   | 82/117 [00:03<00:01, 21.83it/s, loss=0.684, v_num=1, val_acc=0.757]
Epoch 93:  71%|███████   | 83/117 [00:03<00:01, 22.04it/s, loss=0.684, v_num=1, val_acc=0.757]
Epoch 93:  71%|███████   | 83/117 [00:03<00:01, 21.90it/s, loss=0.685, v_num=1, val_acc=0.757]
Epoch 93:  72%|███████▏  | 84/117 [00:03<00:01, 22.11it/s, loss=0.685, v_num=1, val_acc=0.757]
Epoch 93:  72%|███████▏  | 84/117 [00:03<00:01, 21.96it/s, loss=0.68, v_num=1, val_acc=0.757]
Epoch 93:  73%|███████▎  | 85/117 [00:03<00:01, 22.17it/s, loss=0.68, v_num=1, val_acc=0.757]
Epoch 93:  73%|███████▎  | 85/117 [00:03<00:01, 22.03it/s, loss=0.68, v_num=1, val_acc=0.757]
Epoch 93:  74%|███████▎  | 86/117 [00:03<00:01, 22.23it/s, loss=0.68, v_num=1, val_acc=0.757]
Epoch 93:  74%|███████▎  | 86/117 [00:03<00:01, 22.09it/s, loss=0.674, v_num=1, val_acc=0.757]
Epoch 93:  74%|███████▍  | 87/117 [00:03<00:01, 22.30it/s, loss=0.674, v_num=1, val_acc=0.757]
Epoch 93:  74%|███████▍  | 87/117 [00:03<00:01, 22.15it/s, loss=0.674, v_num=1, val_acc=0.757]
Epoch 93:  75%|███████▌  | 88/117 [00:03<00:01, 22.35it/s, loss=0.674, v_num=1, val_acc=0.757]
Epoch 93:  75%|███████▌  | 88/117 [00:03<00:01, 22.21it/s, loss=0.672, v_num=1, val_acc=0.757]
Epoch 93:  76%|███████▌  | 89/117 [00:03<00:01, 22.41it/s, loss=0.672, v_num=1, val_acc=0.757]
Epoch 93:  76%|███████▌  | 89/117 [00:03<00:01, 22.27it/s, loss=0.672, v_num=1, val_acc=0.757]
Epoch 93:  77%|███████▋  | 90/117 [00:04<00:01, 22.47it/s, loss=0.672, v_num=1, val_acc=0.757]
Epoch 93:  77%|███████▋  | 90/117 [00:04<00:01, 22.33it/s, loss=0.674, v_num=1, val_acc=0.757]
Epoch 93:  78%|███████▊  | 91/117 [00:04<00:01, 22.53it/s, loss=0.674, v_num=1, val_acc=0.757]
Epoch 93:  78%|███████▊  | 91/117 [00:04<00:01, 22.39it/s, loss=0.672, v_num=1, val_acc=0.757]
Epoch 93:  79%|███████▊  | 92/117 [00:04<00:01, 22.58it/s, loss=0.672, v_num=1, val_acc=0.757]
Epoch 93:  79%|███████▊  | 92/117 [00:04<00:01, 22.44it/s, loss=0.676, v_num=1, val_acc=0.757]
Epoch 93:  79%|███████▉  | 93/117 [00:04<00:01, 22.64it/s, loss=0.676, v_num=1, val_acc=0.757]
Epoch 93:  79%|███████▉  | 93/117 [00:04<00:01, 22.50it/s, loss=0.676, v_num=1, val_acc=0.757]
Epoch 93:  80%|████████  | 94/117 [00:04<00:01, 22.69it/s, loss=0.676, v_num=1, val_acc=0.757]
Epoch 93:  80%|████████  | 94/117 [00:04<00:01, 22.55it/s, loss=0.678, v_num=1, val_acc=0.757]
Epoch 93:  81%|████████  | 95/117 [00:04<00:00, 22.74it/s, loss=0.678, v_num=1, val_acc=0.757]
Epoch 93:  81%|████████  | 95/117 [00:04<00:00, 22.61it/s, loss=0.682, v_num=1, val_acc=0.757]
Epoch 93:  82%|████████▏ | 96/117 [00:04<00:00, 22.80it/s, loss=0.682, v_num=1, val_acc=0.757]
Epoch 93:  82%|████████▏ | 96/117 [00:04<00:00, 22.66it/s, loss=0.683, v_num=1, val_acc=0.757]
Epoch 93:  83%|████████▎ | 97/117 [00:04<00:00, 22.85it/s, loss=0.683, v_num=1, val_acc=0.757]
Epoch 93:  83%|████████▎ | 97/117 [00:04<00:00, 22.71it/s, loss=0.683, v_num=1, val_acc=0.757]

Validation: 0it [00:00, ?it/s]

Validation:   0%|          | 0/20 [00:00<?, ?it/s]

Validation DataLoader 0:   0%|          | 0/20 [00:00<?, ?it/s]

Validation DataLoader 0:   5%|▌         | 1/20 [00:00<00:00, 183.90it/s]
Epoch 93:  84%|████████▍ | 98/117 [00:05<00:00, 19.13it/s, loss=0.683, v_num=1, val_acc=0.757]

Validation DataLoader 0:  10%|█         | 2/20 [00:00<00:00, 55.56it/s]
Epoch 93:  85%|████████▍ | 99/117 [00:05<00:00, 19.21it/s, loss=0.683, v_num=1, val_acc=0.757]

Validation DataLoader 0:  15%|█▌        | 3/20 [00:00<00:00, 44.06it/s]
Epoch 93:  85%|████████▌ | 100/117 [00:05<00:00, 19.29it/s, loss=0.683, v_num=1, val_acc=0.757]

Validation DataLoader 0:  20%|██        | 4/20 [00:00<00:00, 39.99it/s]
Epoch 93:  86%|████████▋ | 101/117 [00:05<00:00, 19.36it/s, loss=0.683, v_num=1, val_acc=0.757]

Validation DataLoader 0:  25%|██▌       | 5/20 [00:00<00:00, 37.77it/s]
Epoch 93:  87%|████████▋ | 102/117 [00:05<00:00, 19.43it/s, loss=0.683, v_num=1, val_acc=0.757]

Validation DataLoader 0:  30%|███       | 6/20 [00:00<00:00, 36.65it/s]
Epoch 93:  88%|████████▊ | 103/117 [00:05<00:00, 19.51it/s, loss=0.683, v_num=1, val_acc=0.757]

Validation DataLoader 0:  35%|███▌      | 7/20 [00:00<00:00, 35.86it/s]
Epoch 93:  89%|████████▉ | 104/117 [00:05<00:00, 19.58it/s, loss=0.683, v_num=1, val_acc=0.757]

Validation DataLoader 0:  40%|████      | 8/20 [00:00<00:00, 35.27it/s]
Epoch 93:  90%|████████▉ | 105/117 [00:05<00:00, 19.65it/s, loss=0.683, v_num=1, val_acc=0.757]

Validation DataLoader 0:  45%|████▌     | 9/20 [00:00<00:00, 34.76it/s]
Epoch 93:  91%|█████████ | 106/117 [00:05<00:00, 19.72it/s, loss=0.683, v_num=1, val_acc=0.757]

Validation DataLoader 0:  50%|█████     | 10/20 [00:00<00:00, 34.44it/s]
Epoch 93:  91%|█████████▏| 107/117 [00:05<00:00, 19.79it/s, loss=0.683, v_num=1, val_acc=0.757]

Validation DataLoader 0:  55%|█████▌    | 11/20 [00:00<00:00, 34.18it/s]
Epoch 93:  92%|█████████▏| 108/117 [00:05<00:00, 19.86it/s, loss=0.683, v_num=1, val_acc=0.757]

Validation DataLoader 0:  60%|██████    | 12/20 [00:00<00:00, 33.95it/s]
Epoch 93:  93%|█████████▎| 109/117 [00:05<00:00, 19.93it/s, loss=0.683, v_num=1, val_acc=0.757]

Validation DataLoader 0:  65%|██████▌   | 13/20 [00:00<00:00, 33.68it/s]
Epoch 93:  94%|█████████▍| 110/117 [00:05<00:00, 19.99it/s, loss=0.683, v_num=1, val_acc=0.757]

Validation DataLoader 0:  70%|███████   | 14/20 [00:00<00:00, 33.58it/s]
Epoch 93:  95%|█████████▍| 111/117 [00:05<00:00, 20.06it/s, loss=0.683, v_num=1, val_acc=0.757]

Validation DataLoader 0:  75%|███████▌  | 15/20 [00:00<00:00, 33.42it/s]
Epoch 93:  96%|█████████▌| 112/117 [00:05<00:00, 20.13it/s, loss=0.683, v_num=1, val_acc=0.757]

Validation DataLoader 0:  80%|████████  | 16/20 [00:00<00:00, 33.30it/s]
Epoch 93:  97%|█████████▋| 113/117 [00:05<00:00, 20.19it/s, loss=0.683, v_num=1, val_acc=0.757]

Validation DataLoader 0:  85%|████████▌ | 17/20 [00:00<00:00, 33.18it/s]
Epoch 93:  97%|█████████▋| 114/117 [00:05<00:00, 20.25it/s, loss=0.683, v_num=1, val_acc=0.757]

Validation DataLoader 0:  90%|█████████ | 18/20 [00:00<00:00, 33.09it/s]
Epoch 93:  98%|█████████▊| 115/117 [00:05<00:00, 20.32it/s, loss=0.683, v_num=1, val_acc=0.757]

Validation DataLoader 0:  95%|█████████▌| 19/20 [00:00<00:00, 33.01it/s]
Epoch 93:  99%|█████████▉| 116/117 [00:05<00:00, 20.38it/s, loss=0.683, v_num=1, val_acc=0.757]

Validation DataLoader 0: 100%|██████████| 20/20 [00:00<00:00, 33.00it/s]
Epoch 93: 100%|██████████| 117/117 [00:05<00:00, 20.45it/s, loss=0.683, v_num=1, val_acc=0.757]
Epoch 93: 100%|██████████| 117/117 [00:05<00:00, 20.38it/s, loss=0.683, v_num=1, val_acc=0.756]


Epoch 93: 100%|██████████| 117/117 [00:05<00:00, 20.37it/s, loss=0.683, v_num=1, val_acc=0.756]
Epoch 93:   0%|          | 0/117 [00:00<?, ?it/s, loss=0.683, v_num=1, val_acc=0.756]
Epoch 94:   0%|          | 0/117 [00:00<?, ?it/s, loss=0.683, v_num=1, val_acc=0.756]
Epoch 94:   1%|          | 1/117 [00:00<01:45,  1.10it/s, loss=0.683, v_num=1, val_acc=0.756]
Epoch 94:   1%|          | 1/117 [00:00<01:48,  1.07it/s, loss=0.681, v_num=1, val_acc=0.756]
Epoch 94:   2%|▏         | 2/117 [00:00<00:54,  2.12it/s, loss=0.681, v_num=1, val_acc=0.756]
Epoch 94:   2%|▏         | 2/117 [00:00<00:55,  2.06it/s, loss=0.684, v_num=1, val_acc=0.756]
Epoch 94:   3%|▎         | 3/117 [00:00<00:37,  3.06it/s, loss=0.684, v_num=1, val_acc=0.756]
Epoch 94:   3%|▎         | 3/117 [00:01<00:38,  2.99it/s, loss=0.686, v_num=1, val_acc=0.756]
Epoch 94:   3%|▎         | 4/117 [00:01<00:28,  3.94it/s, loss=0.686, v_num=1, val_acc=0.756]
Epoch 94:   3%|▎         | 4/117 [00:01<00:29,  3.85it/s, loss=0.689, v_num=1, val_acc=0.756]
Epoch 94:   4%|▍         | 5/117 [00:01<00:23,  4.76it/s, loss=0.689, v_num=1, val_acc=0.756]
Epoch 94:   4%|▍         | 5/117 [00:01<00:24,  4.65it/s, loss=0.684, v_num=1, val_acc=0.756]
Epoch 94:   5%|▌         | 6/117 [00:01<00:20,  5.53it/s, loss=0.684, v_num=1, val_acc=0.756]
Epoch 94:   5%|▌         | 6/117 [00:01<00:20,  5.40it/s, loss=0.681, v_num=1, val_acc=0.756]
Epoch 94:   6%|▌         | 7/117 [00:01<00:17,  6.26it/s, loss=0.681, v_num=1, val_acc=0.756]
Epoch 94:   6%|▌         | 7/117 [00:01<00:17,  6.12it/s, loss=0.685, v_num=1, val_acc=0.756]
Epoch 94:   7%|▋         | 8/117 [00:01<00:15,  6.95it/s, loss=0.685, v_num=1, val_acc=0.756]
Epoch 94:   7%|▋         | 8/117 [00:01<00:16,  6.79it/s, loss=0.689, v_num=1, val_acc=0.756]
Epoch 94:   8%|▊         | 9/117 [00:01<00:14,  7.54it/s, loss=0.689, v_num=1, val_acc=0.756]
Epoch 94:   8%|▊         | 9/117 [00:01<00:14,  7.39it/s, loss=0.691, v_num=1, val_acc=0.756]
Epoch 94:   9%|▊         | 10/117 [00:01<00:13,  8.15it/s, loss=0.691, v_num=1, val_acc=0.756]
Epoch 94:   9%|▊         | 10/117 [00:01<00:13,  7.99it/s, loss=0.695, v_num=1, val_acc=0.756]
Epoch 94:   9%|▉         | 11/117 [00:01<00:12,  8.73it/s, loss=0.695, v_num=1, val_acc=0.756]
Epoch 94:   9%|▉         | 11/117 [00:01<00:12,  8.56it/s, loss=0.7, v_num=1, val_acc=0.756]
Epoch 94:  10%|█         | 12/117 [00:01<00:11,  9.27it/s, loss=0.7, v_num=1, val_acc=0.756]
Epoch 94:  10%|█         | 12/117 [00:01<00:11,  9.09it/s, loss=0.699, v_num=1, val_acc=0.756]
Epoch 94:  11%|█         | 13/117 [00:01<00:10,  9.79it/s, loss=0.699, v_num=1, val_acc=0.756]
Epoch 94:  11%|█         | 13/117 [00:01<00:10,  9.61it/s, loss=0.695, v_num=1, val_acc=0.756]
Epoch 94:  12%|█▏        | 14/117 [00:01<00:10, 10.29it/s, loss=0.695, v_num=1, val_acc=0.756]
Epoch 94:  12%|█▏        | 14/117 [00:01<00:10, 10.10it/s, loss=0.699, v_num=1, val_acc=0.756]
Epoch 94:  13%|█▎        | 15/117 [00:01<00:09, 10.75it/s, loss=0.699, v_num=1, val_acc=0.756]
Epoch 94:  13%|█▎        | 15/117 [00:01<00:09, 10.56it/s, loss=0.697, v_num=1, val_acc=0.756]
Epoch 94:  14%|█▎        | 16/117 [00:01<00:09, 11.20it/s, loss=0.697, v_num=1, val_acc=0.756]
Epoch 94:  14%|█▎        | 16/117 [00:01<00:09, 11.00it/s, loss=0.694, v_num=1, val_acc=0.756]
Epoch 94:  15%|█▍        | 17/117 [00:01<00:08, 11.59it/s, loss=0.694, v_num=1, val_acc=0.756]
Epoch 94:  15%|█▍        | 17/117 [00:01<00:08, 11.40it/s, loss=0.695, v_num=1, val_acc=0.756]
Epoch 94:  15%|█▌        | 18/117 [00:01<00:08, 12.00it/s, loss=0.695, v_num=1, val_acc=0.756]
Epoch 94:  15%|█▌        | 18/117 [00:01<00:08, 11.80it/s, loss=0.694, v_num=1, val_acc=0.756]
Epoch 94:  16%|█▌        | 19/117 [00:01<00:07, 12.39it/s, loss=0.694, v_num=1, val_acc=0.756]
Epoch 94:  16%|█▌        | 19/117 [00:01<00:08, 12.18it/s, loss=0.695, v_num=1, val_acc=0.756]
Epoch 94:  17%|█▋        | 20/117 [00:01<00:07, 12.76it/s, loss=0.695, v_num=1, val_acc=0.756]
Epoch 94:  17%|█▋        | 20/117 [00:01<00:07, 12.55it/s, loss=0.695, v_num=1, val_acc=0.756]
Epoch 94:  18%|█▊        | 21/117 [00:01<00:07, 13.11it/s, loss=0.695, v_num=1, val_acc=0.756]
Epoch 94:  18%|█▊        | 21/117 [00:01<00:07, 12.91it/s, loss=0.697, v_num=1, val_acc=0.756]
Epoch 94:  19%|█▉        | 22/117 [00:01<00:07, 13.45it/s, loss=0.697, v_num=1, val_acc=0.756]
Epoch 94:  19%|█▉        | 22/117 [00:01<00:07, 13.24it/s, loss=0.695, v_num=1, val_acc=0.756]
Epoch 94:  20%|█▉        | 23/117 [00:01<00:06, 13.77it/s, loss=0.695, v_num=1, val_acc=0.756]
Epoch 94:  20%|█▉        | 23/117 [00:01<00:06, 13.56it/s, loss=0.689, v_num=1, val_acc=0.756]
Epoch 94:  21%|██        | 24/117 [00:01<00:06, 14.08it/s, loss=0.689, v_num=1, val_acc=0.756]
Epoch 94:  21%|██        | 24/117 [00:01<00:06, 13.87it/s, loss=0.689, v_num=1, val_acc=0.756]
Epoch 94:  21%|██▏       | 25/117 [00:01<00:06, 14.36it/s, loss=0.689, v_num=1, val_acc=0.756]
Epoch 94:  21%|██▏       | 25/117 [00:01<00:06, 14.16it/s, loss=0.688, v_num=1, val_acc=0.756]
Epoch 94:  22%|██▏       | 26/117 [00:01<00:06, 14.65it/s, loss=0.688, v_num=1, val_acc=0.756]
Epoch 94:  22%|██▏       | 26/117 [00:01<00:06, 14.45it/s, loss=0.691, v_num=1, val_acc=0.756]
Epoch 94:  23%|██▎       | 27/117 [00:01<00:06, 14.93it/s, loss=0.691, v_num=1, val_acc=0.756]
Epoch 94:  23%|██▎       | 27/117 [00:01<00:06, 14.72it/s, loss=0.689, v_num=1, val_acc=0.756]
Epoch 94:  24%|██▍       | 28/117 [00:01<00:05, 15.18it/s, loss=0.689, v_num=1, val_acc=0.756]
Epoch 94:  24%|██▍       | 28/117 [00:01<00:05, 14.98it/s, loss=0.69, v_num=1, val_acc=0.756]
Epoch 94:  25%|██▍       | 29/117 [00:01<00:05, 15.44it/s, loss=0.69, v_num=1, val_acc=0.756]
Epoch 94:  25%|██▍       | 29/117 [00:01<00:05, 15.23it/s, loss=0.689, v_num=1, val_acc=0.756]
Epoch 94:  26%|██▌       | 30/117 [00:01<00:05, 15.68it/s, loss=0.689, v_num=1, val_acc=0.756]
Epoch 94:  26%|██▌       | 30/117 [00:01<00:05, 15.48it/s, loss=0.683, v_num=1, val_acc=0.756]
Epoch 94:  26%|██▋       | 31/117 [00:01<00:05, 15.92it/s, loss=0.683, v_num=1, val_acc=0.756]
Epoch 94:  26%|██▋       | 31/117 [00:01<00:05, 15.71it/s, loss=0.686, v_num=1, val_acc=0.756]
Epoch 94:  27%|██▋       | 32/117 [00:01<00:05, 16.15it/s, loss=0.686, v_num=1, val_acc=0.756]
Epoch 94:  27%|██▋       | 32/117 [00:02<00:05, 15.94it/s, loss=0.687, v_num=1, val_acc=0.756]
Epoch 94:  28%|██▊       | 33/117 [00:02<00:05, 16.35it/s, loss=0.687, v_num=1, val_acc=0.756]
Epoch 94:  28%|██▊       | 33/117 [00:02<00:05, 16.15it/s, loss=0.687, v_num=1, val_acc=0.756]
Epoch 94:  29%|██▉       | 34/117 [00:02<00:05, 16.57it/s, loss=0.687, v_num=1, val_acc=0.756]
Epoch 94:  29%|██▉       | 34/117 [00:02<00:05, 16.37it/s, loss=0.682, v_num=1, val_acc=0.756]
Epoch 94:  30%|██▉       | 35/117 [00:02<00:04, 16.78it/s, loss=0.682, v_num=1, val_acc=0.756]
Epoch 94:  30%|██▉       | 35/117 [00:02<00:04, 16.57it/s, loss=0.681, v_num=1, val_acc=0.756]
Epoch 94:  31%|███       | 36/117 [00:02<00:04, 16.97it/s, loss=0.681, v_num=1, val_acc=0.756]
Epoch 94:  31%|███       | 36/117 [00:02<00:04, 16.77it/s, loss=0.688, v_num=1, val_acc=0.756]
Epoch 94:  32%|███▏      | 37/117 [00:02<00:04, 17.16it/s, loss=0.688, v_num=1, val_acc=0.756]
Epoch 94:  32%|███▏      | 37/117 [00:02<00:04, 16.97it/s, loss=0.683, v_num=1, val_acc=0.756]
Epoch 94:  32%|███▏      | 38/117 [00:02<00:04, 17.35it/s, loss=0.683, v_num=1, val_acc=0.756]
Epoch 94:  32%|███▏      | 38/117 [00:02<00:04, 17.15it/s, loss=0.683, v_num=1, val_acc=0.756]
Epoch 94:  33%|███▎      | 39/117 [00:02<00:04, 17.53it/s, loss=0.683, v_num=1, val_acc=0.756]
Epoch 94:  33%|███▎      | 39/117 [00:02<00:04, 17.34it/s, loss=0.686, v_num=1, val_acc=0.756]
Epoch 94:  34%|███▍      | 40/117 [00:02<00:04, 17.71it/s, loss=0.686, v_num=1, val_acc=0.756]
Epoch 94:  34%|███▍      | 40/117 [00:02<00:04, 17.51it/s, loss=0.688, v_num=1, val_acc=0.756]
Epoch 94:  35%|███▌      | 41/117 [00:02<00:04, 17.88it/s, loss=0.688, v_num=1, val_acc=0.756]
Epoch 94:  35%|███▌      | 41/117 [00:02<00:04, 17.68it/s, loss=0.684, v_num=1, val_acc=0.756]
Epoch 94:  36%|███▌      | 42/117 [00:02<00:04, 18.04it/s, loss=0.684, v_num=1, val_acc=0.756]
Epoch 94:  36%|███▌      | 42/117 [00:02<00:04, 17.85it/s, loss=0.681, v_num=1, val_acc=0.756]
Epoch 94:  37%|███▋      | 43/117 [00:02<00:04, 18.20it/s, loss=0.681, v_num=1, val_acc=0.756]
Epoch 94:  37%|███▋      | 43/117 [00:02<00:04, 18.01it/s, loss=0.687, v_num=1, val_acc=0.756]
Epoch 94:  38%|███▊      | 44/117 [00:02<00:03, 18.36it/s, loss=0.687, v_num=1, val_acc=0.756]
Epoch 94:  38%|███▊      | 44/117 [00:02<00:04, 18.17it/s, loss=0.687, v_num=1, val_acc=0.756]
Epoch 94:  38%|███▊      | 45/117 [00:02<00:03, 18.51it/s, loss=0.687, v_num=1, val_acc=0.756]
Epoch 94:  38%|███▊      | 45/117 [00:02<00:03, 18.32it/s, loss=0.685, v_num=1, val_acc=0.756]
Epoch 94:  39%|███▉      | 46/117 [00:02<00:03, 18.66it/s, loss=0.685, v_num=1, val_acc=0.756]
Epoch 94:  39%|███▉      | 46/117 [00:02<00:03, 18.47it/s, loss=0.685, v_num=1, val_acc=0.756]
Epoch 94:  40%|████      | 47/117 [00:02<00:03, 18.80it/s, loss=0.685, v_num=1, val_acc=0.756]
Epoch 94:  40%|████      | 47/117 [00:02<00:03, 18.61it/s, loss=0.687, v_num=1, val_acc=0.756]
Epoch 94:  41%|████      | 48/117 [00:02<00:03, 18.94it/s, loss=0.687, v_num=1, val_acc=0.756]
Epoch 94:  41%|████      | 48/117 [00:02<00:03, 18.75it/s, loss=0.685, v_num=1, val_acc=0.756]
Epoch 94:  42%|████▏     | 49/117 [00:02<00:03, 19.07it/s, loss=0.685, v_num=1, val_acc=0.756]
Epoch 94:  42%|████▏     | 49/117 [00:02<00:03, 18.89it/s, loss=0.686, v_num=1, val_acc=0.756]
Epoch 94:  43%|████▎     | 50/117 [00:02<00:03, 19.20it/s, loss=0.686, v_num=1, val_acc=0.756]
Epoch 94:  43%|████▎     | 50/117 [00:02<00:03, 19.02it/s, loss=0.688, v_num=1, val_acc=0.756]
Epoch 94:  44%|████▎     | 51/117 [00:02<00:03, 19.33it/s, loss=0.688, v_num=1, val_acc=0.756]
Epoch 94:  44%|████▎     | 51/117 [00:02<00:03, 19.15it/s, loss=0.685, v_num=1, val_acc=0.756]
Epoch 94:  44%|████▍     | 52/117 [00:02<00:03, 19.46it/s, loss=0.685, v_num=1, val_acc=0.756]
Epoch 94:  44%|████▍     | 52/117 [00:02<00:03, 19.28it/s, loss=0.681, v_num=1, val_acc=0.756]
Epoch 94:  45%|████▌     | 53/117 [00:02<00:03, 19.58it/s, loss=0.681, v_num=1, val_acc=0.756]
Epoch 94:  45%|████▌     | 53/117 [00:02<00:03, 19.40it/s, loss=0.678, v_num=1, val_acc=0.756]
Epoch 94:  46%|████▌     | 54/117 [00:02<00:03, 19.70it/s, loss=0.678, v_num=1, val_acc=0.756]
Epoch 94:  46%|████▌     | 54/117 [00:02<00:03, 19.52it/s, loss=0.683, v_num=1, val_acc=0.756]
Epoch 94:  47%|████▋     | 55/117 [00:02<00:03, 19.81it/s, loss=0.683, v_num=1, val_acc=0.756]
Epoch 94:  47%|████▋     | 55/117 [00:02<00:03, 19.63it/s, loss=0.684, v_num=1, val_acc=0.756]
Epoch 94:  48%|████▊     | 56/117 [00:02<00:03, 19.92it/s, loss=0.684, v_num=1, val_acc=0.756]
Epoch 94:  48%|████▊     | 56/117 [00:02<00:03, 19.75it/s, loss=0.677, v_num=1, val_acc=0.756]
Epoch 94:  49%|████▊     | 57/117 [00:02<00:02, 20.03it/s, loss=0.677, v_num=1, val_acc=0.756]
Epoch 94:  49%|████▊     | 57/117 [00:02<00:03, 19.86it/s, loss=0.681, v_num=1, val_acc=0.756]
Epoch 94:  50%|████▉     | 58/117 [00:02<00:02, 20.14it/s, loss=0.681, v_num=1, val_acc=0.756]
Epoch 94:  50%|████▉     | 58/117 [00:02<00:02, 19.97it/s, loss=0.682, v_num=1, val_acc=0.756]
Epoch 94:  50%|█████     | 59/117 [00:02<00:02, 20.25it/s, loss=0.682, v_num=1, val_acc=0.756]
Epoch 94:  50%|█████     | 59/117 [00:02<00:02, 20.07it/s, loss=0.678, v_num=1, val_acc=0.756]
Epoch 94:  51%|█████▏    | 60/117 [00:02<00:02, 20.35it/s, loss=0.678, v_num=1, val_acc=0.756]
Epoch 94:  51%|█████▏    | 60/117 [00:02<00:02, 20.17it/s, loss=0.677, v_num=1, val_acc=0.756]
Epoch 94:  52%|█████▏    | 61/117 [00:02<00:02, 20.45it/s, loss=0.677, v_num=1, val_acc=0.756]
Epoch 94:  52%|█████▏    | 61/117 [00:03<00:02, 20.27it/s, loss=0.677, v_num=1, val_acc=0.756]
Epoch 94:  53%|█████▎    | 62/117 [00:03<00:02, 20.54it/s, loss=0.677, v_num=1, val_acc=0.756]
Epoch 94:  53%|█████▎    | 62/117 [00:03<00:02, 20.37it/s, loss=0.686, v_num=1, val_acc=0.756]
Epoch 94:  54%|█████▍    | 63/117 [00:03<00:02, 20.64it/s, loss=0.686, v_num=1, val_acc=0.756]
Epoch 94:  54%|█████▍    | 63/117 [00:03<00:02, 20.47it/s, loss=0.683, v_num=1, val_acc=0.756]
Epoch 94:  55%|█████▍    | 64/117 [00:03<00:02, 20.73it/s, loss=0.683, v_num=1, val_acc=0.756]
Epoch 94:  55%|█████▍    | 64/117 [00:03<00:02, 20.56it/s, loss=0.681, v_num=1, val_acc=0.756]
Epoch 94:  56%|█████▌    | 65/117 [00:03<00:02, 20.83it/s, loss=0.681, v_num=1, val_acc=0.756]
Epoch 94:  56%|█████▌    | 65/117 [00:03<00:02, 20.66it/s, loss=0.685, v_num=1, val_acc=0.756]
Epoch 94:  56%|█████▋    | 66/117 [00:03<00:02, 20.92it/s, loss=0.685, v_num=1, val_acc=0.756]
Epoch 94:  56%|█████▋    | 66/117 [00:03<00:02, 20.75it/s, loss=0.684, v_num=1, val_acc=0.756]
Epoch 94:  57%|█████▋    | 67/117 [00:03<00:02, 21.00it/s, loss=0.684, v_num=1, val_acc=0.756]
Epoch 94:  57%|█████▋    | 67/117 [00:03<00:02, 20.84it/s, loss=0.686, v_num=1, val_acc=0.756]
Epoch 94:  58%|█████▊    | 68/117 [00:03<00:02, 21.09it/s, loss=0.686, v_num=1, val_acc=0.756]
Epoch 94:  58%|█████▊    | 68/117 [00:03<00:02, 20.92it/s, loss=0.685, v_num=1, val_acc=0.756]
Epoch 94:  59%|█████▉    | 69/117 [00:03<00:02, 21.17it/s, loss=0.685, v_num=1, val_acc=0.756]
Epoch 94:  59%|█████▉    | 69/117 [00:03<00:02, 21.01it/s, loss=0.683, v_num=1, val_acc=0.756]
Epoch 94:  60%|█████▉    | 70/117 [00:03<00:02, 21.25it/s, loss=0.683, v_num=1, val_acc=0.756]
Epoch 94:  60%|█████▉    | 70/117 [00:03<00:02, 21.09it/s, loss=0.679, v_num=1, val_acc=0.756]
Epoch 94:  61%|██████    | 71/117 [00:03<00:02, 21.33it/s, loss=0.679, v_num=1, val_acc=0.756]
Epoch 94:  61%|██████    | 71/117 [00:03<00:02, 21.17it/s, loss=0.673, v_num=1, val_acc=0.756]
Epoch 94:  62%|██████▏   | 72/117 [00:03<00:02, 21.41it/s, loss=0.673, v_num=1, val_acc=0.756]
Epoch 94:  62%|██████▏   | 72/117 [00:03<00:02, 21.25it/s, loss=0.677, v_num=1, val_acc=0.756]
Epoch 94:  62%|██████▏   | 73/117 [00:03<00:02, 21.49it/s, loss=0.677, v_num=1, val_acc=0.756]
Epoch 94:  62%|██████▏   | 73/117 [00:03<00:02, 21.33it/s, loss=0.68, v_num=1, val_acc=0.756]
Epoch 94:  63%|██████▎   | 74/117 [00:03<00:01, 21.56it/s, loss=0.68, v_num=1, val_acc=0.756]
Epoch 94:  63%|██████▎   | 74/117 [00:03<00:02, 21.41it/s, loss=0.681, v_num=1, val_acc=0.756]
Epoch 94:  64%|██████▍   | 75/117 [00:03<00:01, 21.64it/s, loss=0.681, v_num=1, val_acc=0.756]
Epoch 94:  64%|██████▍   | 75/117 [00:03<00:01, 21.48it/s, loss=0.684, v_num=1, val_acc=0.756]
Epoch 94:  65%|██████▍   | 76/117 [00:03<00:01, 21.71it/s, loss=0.684, v_num=1, val_acc=0.756]
Epoch 94:  65%|██████▍   | 76/117 [00:03<00:01, 21.55it/s, loss=0.685, v_num=1, val_acc=0.756]
Epoch 94:  66%|██████▌   | 77/117 [00:03<00:01, 21.78it/s, loss=0.685, v_num=1, val_acc=0.756]
Epoch 94:  66%|██████▌   | 77/117 [00:03<00:01, 21.63it/s, loss=0.683, v_num=1, val_acc=0.756]
Epoch 94:  67%|██████▋   | 78/117 [00:03<00:01, 21.85it/s, loss=0.683, v_num=1, val_acc=0.756]
Epoch 94:  67%|██████▋   | 78/117 [00:03<00:01, 21.70it/s, loss=0.687, v_num=1, val_acc=0.756]
Epoch 94:  68%|██████▊   | 79/117 [00:03<00:01, 21.92it/s, loss=0.687, v_num=1, val_acc=0.756]
Epoch 94:  68%|██████▊   | 79/117 [00:03<00:01, 21.77it/s, loss=0.683, v_num=1, val_acc=0.756]
Epoch 94:  68%|██████▊   | 80/117 [00:03<00:01, 21.99it/s, loss=0.683, v_num=1, val_acc=0.756]
Epoch 94:  68%|██████▊   | 80/117 [00:03<00:01, 21.84it/s, loss=0.686, v_num=1, val_acc=0.756]
Epoch 94:  69%|██████▉   | 81/117 [00:03<00:01, 22.03it/s, loss=0.686, v_num=1, val_acc=0.756]
Epoch 94:  69%|██████▉   | 81/117 [00:03<00:01, 21.89it/s, loss=0.688, v_num=1, val_acc=0.756]
Epoch 94:  70%|███████   | 82/117 [00:03<00:01, 22.09it/s, loss=0.688, v_num=1, val_acc=0.756]
Epoch 94:  70%|███████   | 82/117 [00:03<00:01, 21.94it/s, loss=0.686, v_num=1, val_acc=0.756]
Epoch 94:  71%|███████   | 83/117 [00:03<00:01, 22.15it/s, loss=0.686, v_num=1, val_acc=0.756]
Epoch 94:  71%|███████   | 83/117 [00:03<00:01, 22.00it/s, loss=0.685, v_num=1, val_acc=0.756]
Epoch 94:  72%|███████▏  | 84/117 [00:03<00:01, 22.21it/s, loss=0.685, v_num=1, val_acc=0.756]
Epoch 94:  72%|███████▏  | 84/117 [00:03<00:01, 22.07it/s, loss=0.687, v_num=1, val_acc=0.756]
Epoch 94:  73%|███████▎  | 85/117 [00:03<00:01, 22.28it/s, loss=0.687, v_num=1, val_acc=0.756]
Epoch 94:  73%|███████▎  | 85/117 [00:03<00:01, 22.13it/s, loss=0.689, v_num=1, val_acc=0.756]
Epoch 94:  74%|███████▎  | 86/117 [00:03<00:01, 22.32it/s, loss=0.689, v_num=1, val_acc=0.756]
Epoch 94:  74%|███████▎  | 86/117 [00:03<00:01, 22.18it/s, loss=0.69, v_num=1, val_acc=0.756]
Epoch 94:  74%|███████▍  | 87/117 [00:03<00:01, 22.38it/s, loss=0.69, v_num=1, val_acc=0.756]
Epoch 94:  74%|███████▍  | 87/117 [00:03<00:01, 22.24it/s, loss=0.693, v_num=1, val_acc=0.756]
Epoch 94:  75%|███████▌  | 88/117 [00:03<00:01, 22.44it/s, loss=0.693, v_num=1, val_acc=0.756]
Epoch 94:  75%|███████▌  | 88/117 [00:03<00:01, 22.30it/s, loss=0.691, v_num=1, val_acc=0.756]
Epoch 94:  76%|███████▌  | 89/117 [00:03<00:01, 22.50it/s, loss=0.691, v_num=1, val_acc=0.756]
Epoch 94:  76%|███████▌  | 89/117 [00:03<00:01, 22.36it/s, loss=0.693, v_num=1, val_acc=0.756]
Epoch 94:  77%|███████▋  | 90/117 [00:03<00:01, 22.56it/s, loss=0.693, v_num=1, val_acc=0.756]
Epoch 94:  77%|███████▋  | 90/117 [00:04<00:01, 22.41it/s, loss=0.699, v_num=1, val_acc=0.756]
Epoch 94:  78%|███████▊  | 91/117 [00:04<00:01, 22.61it/s, loss=0.699, v_num=1, val_acc=0.756]
Epoch 94:  78%|███████▊  | 91/117 [00:04<00:01, 22.47it/s, loss=0.704, v_num=1, val_acc=0.756]
Epoch 94:  79%|███████▊  | 92/117 [00:04<00:01, 22.66it/s, loss=0.704, v_num=1, val_acc=0.756]
Epoch 94:  79%|███████▊  | 92/117 [00:04<00:01, 22.52it/s, loss=0.703, v_num=1, val_acc=0.756]
Epoch 94:  79%|███████▉  | 93/117 [00:04<00:01, 22.72it/s, loss=0.703, v_num=1, val_acc=0.756]
Epoch 94:  79%|███████▉  | 93/117 [00:04<00:01, 22.58it/s, loss=0.703, v_num=1, val_acc=0.756]
Epoch 94:  80%|████████  | 94/117 [00:04<00:01, 22.77it/s, loss=0.703, v_num=1, val_acc=0.756]
Epoch 94:  80%|████████  | 94/117 [00:04<00:01, 22.63it/s, loss=0.697, v_num=1, val_acc=0.756]
Epoch 94:  81%|████████  | 95/117 [00:04<00:00, 22.82it/s, loss=0.697, v_num=1, val_acc=0.756]
Epoch 94:  81%|████████  | 95/117 [00:04<00:00, 22.68it/s, loss=0.691, v_num=1, val_acc=0.756]
Epoch 94:  82%|████████▏ | 96/117 [00:04<00:00, 22.87it/s, loss=0.691, v_num=1, val_acc=0.756]
Epoch 94:  82%|████████▏ | 96/117 [00:04<00:00, 22.73it/s, loss=0.691, v_num=1, val_acc=0.756]
Epoch 94:  83%|████████▎ | 97/117 [00:04<00:00, 22.92it/s, loss=0.691, v_num=1, val_acc=0.756]
Epoch 94:  83%|████████▎ | 97/117 [00:04<00:00, 22.78it/s, loss=0.687, v_num=1, val_acc=0.756]

Validation: 0it [00:00, ?it/s]

Validation:   0%|          | 0/20 [00:00<?, ?it/s]

Validation DataLoader 0:   0%|          | 0/20 [00:00<?, ?it/s]

Validation DataLoader 0:   5%|▌         | 1/20 [00:00<00:00, 172.07it/s]
Epoch 94:  84%|████████▍ | 98/117 [00:05<00:00, 19.19it/s, loss=0.687, v_num=1, val_acc=0.756]

Validation DataLoader 0:  10%|█         | 2/20 [00:00<00:00, 54.91it/s]
Epoch 94:  85%|████████▍ | 99/117 [00:05<00:00, 19.27it/s, loss=0.687, v_num=1, val_acc=0.756]

Validation DataLoader 0:  15%|█▌        | 3/20 [00:00<00:00, 44.34it/s]
Epoch 94:  85%|████████▌ | 100/117 [00:05<00:00, 19.35it/s, loss=0.687, v_num=1, val_acc=0.756]

Validation DataLoader 0:  20%|██        | 4/20 [00:00<00:00, 40.31it/s]
Epoch 94:  86%|████████▋ | 101/117 [00:05<00:00, 19.42it/s, loss=0.687, v_num=1, val_acc=0.756]

Validation DataLoader 0:  25%|██▌       | 5/20 [00:00<00:00, 38.08it/s]
Epoch 94:  87%|████████▋ | 102/117 [00:05<00:00, 19.49it/s, loss=0.687, v_num=1, val_acc=0.756]

Validation DataLoader 0:  30%|███       | 6/20 [00:00<00:00, 36.85it/s]
Epoch 94:  88%|████████▊ | 103/117 [00:05<00:00, 19.57it/s, loss=0.687, v_num=1, val_acc=0.756]

Validation DataLoader 0:  35%|███▌      | 7/20 [00:00<00:00, 35.99it/s]
Epoch 94:  89%|████████▉ | 104/117 [00:05<00:00, 19.64it/s, loss=0.687, v_num=1, val_acc=0.756]

Validation DataLoader 0:  40%|████      | 8/20 [00:00<00:00, 35.40it/s]
Epoch 94:  90%|████████▉ | 105/117 [00:05<00:00, 19.71it/s, loss=0.687, v_num=1, val_acc=0.756]

Validation DataLoader 0:  45%|████▌     | 9/20 [00:00<00:00, 34.89it/s]
Epoch 94:  91%|█████████ | 106/117 [00:05<00:00, 19.78it/s, loss=0.687, v_num=1, val_acc=0.756]

Validation DataLoader 0:  50%|█████     | 10/20 [00:00<00:00, 34.53it/s]
Epoch 94:  91%|█████████▏| 107/117 [00:05<00:00, 19.85it/s, loss=0.687, v_num=1, val_acc=0.756]

Validation DataLoader 0:  55%|█████▌    | 11/20 [00:00<00:00, 34.27it/s]
Epoch 94:  92%|█████████▏| 108/117 [00:05<00:00, 19.92it/s, loss=0.687, v_num=1, val_acc=0.756]

Validation DataLoader 0:  60%|██████    | 12/20 [00:00<00:00, 34.02it/s]
Epoch 94:  93%|█████████▎| 109/117 [00:05<00:00, 19.98it/s, loss=0.687, v_num=1, val_acc=0.756]

Validation DataLoader 0:  65%|██████▌   | 13/20 [00:00<00:00, 33.81it/s]
Epoch 94:  94%|█████████▍| 110/117 [00:05<00:00, 20.05it/s, loss=0.687, v_num=1, val_acc=0.756]

Validation DataLoader 0:  70%|███████   | 14/20 [00:00<00:00, 33.64it/s]
Epoch 94:  95%|█████████▍| 111/117 [00:05<00:00, 20.12it/s, loss=0.687, v_num=1, val_acc=0.756]

Validation DataLoader 0:  75%|███████▌  | 15/20 [00:00<00:00, 33.50it/s]
Epoch 94:  96%|█████████▌| 112/117 [00:05<00:00, 20.18it/s, loss=0.687, v_num=1, val_acc=0.756]

Validation DataLoader 0:  80%|████████  | 16/20 [00:00<00:00, 33.36it/s]
Epoch 94:  97%|█████████▋| 113/117 [00:05<00:00, 20.25it/s, loss=0.687, v_num=1, val_acc=0.756]

Validation DataLoader 0:  85%|████████▌ | 17/20 [00:00<00:00, 33.24it/s]
Epoch 94:  97%|█████████▋| 114/117 [00:05<00:00, 20.31it/s, loss=0.687, v_num=1, val_acc=0.756]

Validation DataLoader 0:  90%|█████████ | 18/20 [00:00<00:00, 33.15it/s]
Epoch 94:  98%|█████████▊| 115/117 [00:05<00:00, 20.37it/s, loss=0.687, v_num=1, val_acc=0.756]

Validation DataLoader 0:  95%|█████████▌| 19/20 [00:00<00:00, 33.06it/s]
Epoch 94:  99%|█████████▉| 116/117 [00:05<00:00, 20.44it/s, loss=0.687, v_num=1, val_acc=0.756]

Validation DataLoader 0: 100%|██████████| 20/20 [00:00<00:00, 33.06it/s]
Epoch 94: 100%|██████████| 117/117 [00:05<00:00, 20.50it/s, loss=0.687, v_num=1, val_acc=0.756]
Epoch 94: 100%|██████████| 117/117 [00:05<00:00, 20.43it/s, loss=0.687, v_num=1, val_acc=0.756]


Epoch 94: 100%|██████████| 117/117 [00:05<00:00, 20.43it/s, loss=0.687, v_num=1, val_acc=0.756]
Epoch 94:   0%|          | 0/117 [00:00<?, ?it/s, loss=0.687, v_num=1, val_acc=0.756]
Epoch 95:   0%|          | 0/117 [00:00<?, ?it/s, loss=0.687, v_num=1, val_acc=0.756]
Epoch 95:   1%|          | 1/117 [00:00<01:44,  1.11it/s, loss=0.687, v_num=1, val_acc=0.756]
Epoch 95:   1%|          | 1/117 [00:00<01:46,  1.09it/s, loss=0.682, v_num=1, val_acc=0.756]
Epoch 95:   2%|▏         | 2/117 [00:00<00:53,  2.14it/s, loss=0.682, v_num=1, val_acc=0.756]
Epoch 95:   2%|▏         | 2/117 [00:00<00:55,  2.09it/s, loss=0.686, v_num=1, val_acc=0.756]
Epoch 95:   3%|▎         | 3/117 [00:00<00:36,  3.10it/s, loss=0.686, v_num=1, val_acc=0.756]
Epoch 95:   3%|▎         | 3/117 [00:00<00:37,  3.02it/s, loss=0.682, v_num=1, val_acc=0.756]
Epoch 95:   3%|▎         | 4/117 [00:01<00:28,  4.00it/s, loss=0.682, v_num=1, val_acc=0.756]
Epoch 95:   3%|▎         | 4/117 [00:01<00:28,  3.90it/s, loss=0.679, v_num=1, val_acc=0.756]
Epoch 95:   4%|▍         | 5/117 [00:01<00:23,  4.83it/s, loss=0.679, v_num=1, val_acc=0.756]
Epoch 95:   4%|▍         | 5/117 [00:01<00:23,  4.72it/s, loss=0.67, v_num=1, val_acc=0.756]
Epoch 95:   5%|▌         | 6/117 [00:01<00:19,  5.61it/s, loss=0.67, v_num=1, val_acc=0.756]
Epoch 95:   5%|▌         | 6/117 [00:01<00:20,  5.48it/s, loss=0.667, v_num=1, val_acc=0.756]
Epoch 95:   6%|▌         | 7/117 [00:01<00:17,  6.33it/s, loss=0.667, v_num=1, val_acc=0.756]
Epoch 95:   6%|▌         | 7/117 [00:01<00:17,  6.19it/s, loss=0.667, v_num=1, val_acc=0.756]
Epoch 95:   7%|▋         | 8/117 [00:01<00:15,  7.03it/s, loss=0.667, v_num=1, val_acc=0.756]
Epoch 95:   7%|▋         | 8/117 [00:01<00:15,  6.87it/s, loss=0.662, v_num=1, val_acc=0.756]
Epoch 95:   8%|▊         | 9/117 [00:01<00:14,  7.67it/s, loss=0.662, v_num=1, val_acc=0.756]
Epoch 95:   8%|▊         | 9/117 [00:01<00:14,  7.51it/s, loss=0.663, v_num=1, val_acc=0.756]
Epoch 95:   9%|▊         | 10/117 [00:01<00:12,  8.27it/s, loss=0.663, v_num=1, val_acc=0.756]
Epoch 95:   9%|▊         | 10/117 [00:01<00:13,  8.10it/s, loss=0.659, v_num=1, val_acc=0.756]
Epoch 95:   9%|▉         | 11/117 [00:01<00:11,  8.85it/s, loss=0.659, v_num=1, val_acc=0.756]
Epoch 95:   9%|▉         | 11/117 [00:01<00:12,  8.67it/s, loss=0.657, v_num=1, val_acc=0.756]
Epoch 95:  10%|█         | 12/117 [00:01<00:11,  9.38it/s, loss=0.657, v_num=1, val_acc=0.756]
Epoch 95:  10%|█         | 12/117 [00:01<00:11,  9.20it/s, loss=0.655, v_num=1, val_acc=0.756]
Epoch 95:  11%|█         | 13/117 [00:01<00:10,  9.90it/s, loss=0.655, v_num=1, val_acc=0.756]
Epoch 95:  11%|█         | 13/117 [00:01<00:10,  9.71it/s, loss=0.651, v_num=1, val_acc=0.756]
Epoch 95:  12%|█▏        | 14/117 [00:01<00:09, 10.39it/s, loss=0.651, v_num=1, val_acc=0.756]
Epoch 95:  12%|█▏        | 14/117 [00:01<00:10, 10.20it/s, loss=0.652, v_num=1, val_acc=0.756]
Epoch 95:  13%|█▎        | 15/117 [00:01<00:09, 10.86it/s, loss=0.652, v_num=1, val_acc=0.756]
Epoch 95:  13%|█▎        | 15/117 [00:01<00:09, 10.67it/s, loss=0.651, v_num=1, val_acc=0.756]
Epoch 95:  14%|█▎        | 16/117 [00:01<00:08, 11.31it/s, loss=0.651, v_num=1, val_acc=0.756]
Epoch 95:  14%|█▎        | 16/117 [00:01<00:09, 11.11it/s, loss=0.653, v_num=1, val_acc=0.756]
Epoch 95:  15%|█▍        | 17/117 [00:01<00:08, 11.73it/s, loss=0.653, v_num=1, val_acc=0.756]
Epoch 95:  15%|█▍        | 17/117 [00:01<00:08, 11.53it/s, loss=0.658, v_num=1, val_acc=0.756]
Epoch 95:  15%|█▌        | 18/117 [00:01<00:08, 12.12it/s, loss=0.658, v_num=1, val_acc=0.756]
Epoch 95:  15%|█▌        | 18/117 [00:01<00:08, 11.92it/s, loss=0.665, v_num=1, val_acc=0.756]
Epoch 95:  16%|█▌        | 19/117 [00:01<00:07, 12.51it/s, loss=0.665, v_num=1, val_acc=0.756]
Epoch 95:  16%|█▌        | 19/117 [00:01<00:07, 12.30it/s, loss=0.663, v_num=1, val_acc=0.756]
Epoch 95:  17%|█▋        | 20/117 [00:01<00:07, 12.87it/s, loss=0.663, v_num=1, val_acc=0.756]
Epoch 95:  17%|█▋        | 20/117 [00:01<00:07, 12.67it/s, loss=0.665, v_num=1, val_acc=0.756]
Epoch 95:  18%|█▊        | 21/117 [00:01<00:07, 13.23it/s, loss=0.665, v_num=1, val_acc=0.756]
Epoch 95:  18%|█▊        | 21/117 [00:01<00:07, 13.02it/s, loss=0.665, v_num=1, val_acc=0.756]
Epoch 95:  19%|█▉        | 22/117 [00:01<00:07, 13.55it/s, loss=0.665, v_num=1, val_acc=0.756]
Epoch 95:  19%|█▉        | 22/117 [00:01<00:07, 13.35it/s, loss=0.665, v_num=1, val_acc=0.756]
Epoch 95:  20%|█▉        | 23/117 [00:01<00:06, 13.88it/s, loss=0.665, v_num=1, val_acc=0.756]
Epoch 95:  20%|█▉        | 23/117 [00:01<00:06, 13.67it/s, loss=0.67, v_num=1, val_acc=0.756]
Epoch 95:  21%|██        | 24/117 [00:01<00:06, 14.19it/s, loss=0.67, v_num=1, val_acc=0.756]
Epoch 95:  21%|██        | 24/117 [00:01<00:06, 13.98it/s, loss=0.671, v_num=1, val_acc=0.756]
Epoch 95:  21%|██▏       | 25/117 [00:01<00:06, 14.48it/s, loss=0.671, v_num=1, val_acc=0.756]
Epoch 95:  21%|██▏       | 25/117 [00:01<00:06, 14.27it/s, loss=0.68, v_num=1, val_acc=0.756]
Epoch 95:  22%|██▏       | 26/117 [00:01<00:06, 14.76it/s, loss=0.68, v_num=1, val_acc=0.756]
Epoch 95:  22%|██▏       | 26/117 [00:01<00:06, 14.56it/s, loss=0.686, v_num=1, val_acc=0.756]
Epoch 95:  23%|██▎       | 27/117 [00:01<00:05, 15.03it/s, loss=0.686, v_num=1, val_acc=0.756]
Epoch 95:  23%|██▎       | 27/117 [00:01<00:06, 14.82it/s, loss=0.687, v_num=1, val_acc=0.756]
Epoch 95:  24%|██▍       | 28/117 [00:01<00:05, 15.25it/s, loss=0.687, v_num=1, val_acc=0.756]
Epoch 95:  24%|██▍       | 28/117 [00:01<00:05, 15.06it/s, loss=0.687, v_num=1, val_acc=0.756]
Epoch 95:  25%|██▍       | 29/117 [00:01<00:05, 15.52it/s, loss=0.687, v_num=1, val_acc=0.756]
Epoch 95:  25%|██▍       | 29/117 [00:01<00:05, 15.31it/s, loss=0.688, v_num=1, val_acc=0.756]
Epoch 95:  26%|██▌       | 30/117 [00:01<00:05, 15.76it/s, loss=0.688, v_num=1, val_acc=0.756]
Epoch 95:  26%|██▌       | 30/117 [00:01<00:05, 15.55it/s, loss=0.692, v_num=1, val_acc=0.756]
Epoch 95:  26%|██▋       | 31/117 [00:01<00:05, 15.99it/s, loss=0.692, v_num=1, val_acc=0.756]
Epoch 95:  26%|██▋       | 31/117 [00:01<00:05, 15.79it/s, loss=0.696, v_num=1, val_acc=0.756]
Epoch 95:  27%|██▋       | 32/117 [00:01<00:05, 16.18it/s, loss=0.696, v_num=1, val_acc=0.756]
Epoch 95:  27%|██▋       | 32/117 [00:02<00:05, 15.99it/s, loss=0.697, v_num=1, val_acc=0.756]
Epoch 95:  28%|██▊       | 33/117 [00:02<00:05, 16.38it/s, loss=0.697, v_num=1, val_acc=0.756]
Epoch 95:  28%|██▊       | 33/117 [00:02<00:05, 16.19it/s, loss=0.695, v_num=1, val_acc=0.756]
Epoch 95:  29%|██▉       | 34/117 [00:02<00:05, 16.58it/s, loss=0.695, v_num=1, val_acc=0.756]
Epoch 95:  29%|██▉       | 34/117 [00:02<00:05, 16.38it/s, loss=0.693, v_num=1, val_acc=0.756]
Epoch 95:  30%|██▉       | 35/117 [00:02<00:04, 16.79it/s, loss=0.693, v_num=1, val_acc=0.756]
Epoch 95:  30%|██▉       | 35/117 [00:02<00:04, 16.59it/s, loss=0.691, v_num=1, val_acc=0.756]
Epoch 95:  31%|███       | 36/117 [00:02<00:04, 16.98it/s, loss=0.691, v_num=1, val_acc=0.756]
Epoch 95:  31%|███       | 36/117 [00:02<00:04, 16.78it/s, loss=0.688, v_num=1, val_acc=0.756]
Epoch 95:  32%|███▏      | 37/117 [00:02<00:04, 17.13it/s, loss=0.688, v_num=1, val_acc=0.756]
Epoch 95:  32%|███▏      | 37/117 [00:02<00:04, 16.96it/s, loss=0.687, v_num=1, val_acc=0.756]
Epoch 95:  32%|███▏      | 38/117 [00:02<00:04, 17.34it/s, loss=0.687, v_num=1, val_acc=0.756]
Epoch 95:  32%|███▏      | 38/117 [00:02<00:04, 17.14it/s, loss=0.684, v_num=1, val_acc=0.756]
Epoch 95:  33%|███▎      | 39/117 [00:02<00:04, 17.51it/s, loss=0.684, v_num=1, val_acc=0.756]
Epoch 95:  33%|███▎      | 39/117 [00:02<00:04, 17.32it/s, loss=0.689, v_num=1, val_acc=0.756]
Epoch 95:  34%|███▍      | 40/117 [00:02<00:04, 17.69it/s, loss=0.689, v_num=1, val_acc=0.756]
Epoch 95:  34%|███▍      | 40/117 [00:02<00:04, 17.50it/s, loss=0.691, v_num=1, val_acc=0.756]
Epoch 95:  35%|███▌      | 41/117 [00:02<00:04, 17.86it/s, loss=0.691, v_num=1, val_acc=0.756]
Epoch 95:  35%|███▌      | 41/117 [00:02<00:04, 17.67it/s, loss=0.694, v_num=1, val_acc=0.756]
Epoch 95:  36%|███▌      | 42/117 [00:02<00:04, 18.02it/s, loss=0.694, v_num=1, val_acc=0.756]
Epoch 95:  36%|███▌      | 42/117 [00:02<00:04, 17.83it/s, loss=0.698, v_num=1, val_acc=0.756]
Epoch 95:  37%|███▋      | 43/117 [00:02<00:04, 18.18it/s, loss=0.698, v_num=1, val_acc=0.756]
Epoch 95:  37%|███▋      | 43/117 [00:02<00:04, 17.99it/s, loss=0.694, v_num=1, val_acc=0.756]
Epoch 95:  38%|███▊      | 44/117 [00:02<00:03, 18.34it/s, loss=0.694, v_num=1, val_acc=0.756]
Epoch 95:  38%|███▊      | 44/117 [00:02<00:04, 18.15it/s, loss=0.697, v_num=1, val_acc=0.756]
Epoch 95:  38%|███▊      | 45/117 [00:02<00:03, 18.49it/s, loss=0.697, v_num=1, val_acc=0.756]
Epoch 95:  38%|███▊      | 45/117 [00:02<00:03, 18.30it/s, loss=0.695, v_num=1, val_acc=0.756]
Epoch 95:  39%|███▉      | 46/117 [00:02<00:03, 18.64it/s, loss=0.695, v_num=1, val_acc=0.756]
Epoch 95:  39%|███▉      | 46/117 [00:02<00:03, 18.45it/s, loss=0.691, v_num=1, val_acc=0.756]
Epoch 95:  40%|████      | 47/117 [00:02<00:03, 18.78it/s, loss=0.691, v_num=1, val_acc=0.756]
Epoch 95:  40%|████      | 47/117 [00:02<00:03, 18.59it/s, loss=0.688, v_num=1, val_acc=0.756]
Epoch 95:  41%|████      | 48/117 [00:02<00:03, 18.92it/s, loss=0.688, v_num=1, val_acc=0.756]
Epoch 95:  41%|████      | 48/117 [00:02<00:03, 18.73it/s, loss=0.69, v_num=1, val_acc=0.756]
Epoch 95:  42%|████▏     | 49/117 [00:02<00:03, 19.05it/s, loss=0.69, v_num=1, val_acc=0.756]
Epoch 95:  42%|████▏     | 49/117 [00:02<00:03, 18.87it/s, loss=0.686, v_num=1, val_acc=0.756]
Epoch 95:  43%|████▎     | 50/117 [00:02<00:03, 19.19it/s, loss=0.686, v_num=1, val_acc=0.756]
Epoch 95:  43%|████▎     | 50/117 [00:02<00:03, 19.00it/s, loss=0.684, v_num=1, val_acc=0.756]
Epoch 95:  44%|████▎     | 51/117 [00:02<00:03, 19.31it/s, loss=0.684, v_num=1, val_acc=0.756]
Epoch 95:  44%|████▎     | 51/117 [00:02<00:03, 19.13it/s, loss=0.684, v_num=1, val_acc=0.756]
Epoch 95:  44%|████▍     | 52/117 [00:02<00:03, 19.44it/s, loss=0.684, v_num=1, val_acc=0.756]
Epoch 95:  44%|████▍     | 52/117 [00:02<00:03, 19.26it/s, loss=0.687, v_num=1, val_acc=0.756]
Epoch 95:  45%|████▌     | 53/117 [00:02<00:03, 19.56it/s, loss=0.687, v_num=1, val_acc=0.756]
Epoch 95:  45%|████▌     | 53/117 [00:02<00:03, 19.38it/s, loss=0.691, v_num=1, val_acc=0.756]
Epoch 95:  46%|████▌     | 54/117 [00:02<00:03, 19.68it/s, loss=0.691, v_num=1, val_acc=0.756]
Epoch 95:  46%|████▌     | 54/117 [00:02<00:03, 19.50it/s, loss=0.689, v_num=1, val_acc=0.756]
Epoch 95:  47%|████▋     | 55/117 [00:02<00:03, 19.80it/s, loss=0.689, v_num=1, val_acc=0.756]
Epoch 95:  47%|████▋     | 55/117 [00:02<00:03, 19.62it/s, loss=0.694, v_num=1, val_acc=0.756]
Epoch 95:  48%|████▊     | 56/117 [00:02<00:03, 19.91it/s, loss=0.694, v_num=1, val_acc=0.756]
Epoch 95:  48%|████▊     | 56/117 [00:02<00:03, 19.73it/s, loss=0.697, v_num=1, val_acc=0.756]
Epoch 95:  49%|████▊     | 57/117 [00:02<00:02, 20.02it/s, loss=0.697, v_num=1, val_acc=0.756]
Epoch 95:  49%|████▊     | 57/117 [00:02<00:03, 19.84it/s, loss=0.694, v_num=1, val_acc=0.756]
Epoch 95:  50%|████▉     | 58/117 [00:02<00:02, 20.13it/s, loss=0.694, v_num=1, val_acc=0.756]
Epoch 95:  50%|████▉     | 58/117 [00:02<00:02, 19.95it/s, loss=0.694, v_num=1, val_acc=0.756]
Epoch 95:  50%|█████     | 59/117 [00:02<00:02, 20.23it/s, loss=0.694, v_num=1, val_acc=0.756]
Epoch 95:  50%|█████     | 59/117 [00:02<00:02, 20.06it/s, loss=0.692, v_num=1, val_acc=0.756]
Epoch 95:  51%|█████▏    | 60/117 [00:02<00:02, 20.34it/s, loss=0.692, v_num=1, val_acc=0.756]
Epoch 95:  51%|█████▏    | 60/117 [00:02<00:02, 20.16it/s, loss=0.694, v_num=1, val_acc=0.756]
Epoch 95:  52%|█████▏    | 61/117 [00:02<00:02, 20.44it/s, loss=0.694, v_num=1, val_acc=0.756]
Epoch 95:  52%|█████▏    | 61/117 [00:03<00:02, 20.26it/s, loss=0.693, v_num=1, val_acc=0.756]
Epoch 95:  53%|█████▎    | 62/117 [00:03<00:02, 20.53it/s, loss=0.693, v_num=1, val_acc=0.756]
Epoch 95:  53%|█████▎    | 62/117 [00:03<00:02, 20.36it/s, loss=0.691, v_num=1, val_acc=0.756]
Epoch 95:  54%|█████▍    | 63/117 [00:03<00:02, 20.63it/s, loss=0.691, v_num=1, val_acc=0.756]
Epoch 95:  54%|█████▍    | 63/117 [00:03<00:02, 20.46it/s, loss=0.691, v_num=1, val_acc=0.756]
Epoch 95:  55%|█████▍    | 64/117 [00:03<00:02, 20.73it/s, loss=0.691, v_num=1, val_acc=0.756]
Epoch 95:  55%|█████▍    | 64/117 [00:03<00:02, 20.56it/s, loss=0.691, v_num=1, val_acc=0.756]
Epoch 95:  56%|█████▌    | 65/117 [00:03<00:02, 20.82it/s, loss=0.691, v_num=1, val_acc=0.756]
Epoch 95:  56%|█████▌    | 65/117 [00:03<00:02, 20.65it/s, loss=0.692, v_num=1, val_acc=0.756]
Epoch 95:  56%|█████▋    | 66/117 [00:03<00:02, 20.91it/s, loss=0.692, v_num=1, val_acc=0.756]
Epoch 95:  56%|█████▋    | 66/117 [00:03<00:02, 20.74it/s, loss=0.692, v_num=1, val_acc=0.756]
Epoch 95:  57%|█████▋    | 67/117 [00:03<00:02, 21.00it/s, loss=0.692, v_num=1, val_acc=0.756]
Epoch 95:  57%|█████▋    | 67/117 [00:03<00:02, 20.83it/s, loss=0.699, v_num=1, val_acc=0.756]
Epoch 95:  58%|█████▊    | 68/117 [00:03<00:02, 21.08it/s, loss=0.699, v_num=1, val_acc=0.756]
Epoch 95:  58%|█████▊    | 68/117 [00:03<00:02, 20.92it/s, loss=0.698, v_num=1, val_acc=0.756]
Epoch 95:  59%|█████▉    | 69/117 [00:03<00:02, 21.16it/s, loss=0.698, v_num=1, val_acc=0.756]
Epoch 95:  59%|█████▉    | 69/117 [00:03<00:02, 21.00it/s, loss=0.702, v_num=1, val_acc=0.756]
Epoch 95:  60%|█████▉    | 70/117 [00:03<00:02, 21.25it/s, loss=0.702, v_num=1, val_acc=0.756]
Epoch 95:  60%|█████▉    | 70/117 [00:03<00:02, 21.09it/s, loss=0.698, v_num=1, val_acc=0.756]
Epoch 95:  61%|██████    | 71/117 [00:03<00:02, 21.33it/s, loss=0.698, v_num=1, val_acc=0.756]
Epoch 95:  61%|██████    | 71/117 [00:03<00:02, 21.17it/s, loss=0.695, v_num=1, val_acc=0.756]
Epoch 95:  62%|██████▏   | 72/117 [00:03<00:02, 21.41it/s, loss=0.695, v_num=1, val_acc=0.756]
Epoch 95:  62%|██████▏   | 72/117 [00:03<00:02, 21.25it/s, loss=0.692, v_num=1, val_acc=0.756]
Epoch 95:  62%|██████▏   | 73/117 [00:03<00:02, 21.48it/s, loss=0.692, v_num=1, val_acc=0.756]
Epoch 95:  62%|██████▏   | 73/117 [00:03<00:02, 21.32it/s, loss=0.688, v_num=1, val_acc=0.756]
Epoch 95:  63%|██████▎   | 74/117 [00:03<00:01, 21.56it/s, loss=0.688, v_num=1, val_acc=0.756]
Epoch 95:  63%|██████▎   | 74/117 [00:03<00:02, 21.40it/s, loss=0.685, v_num=1, val_acc=0.756]
Epoch 95:  64%|██████▍   | 75/117 [00:03<00:01, 21.63it/s, loss=0.685, v_num=1, val_acc=0.756]
Epoch 95:  64%|██████▍   | 75/117 [00:03<00:01, 21.48it/s, loss=0.684, v_num=1, val_acc=0.756]
Epoch 95:  65%|██████▍   | 76/117 [00:03<00:01, 21.71it/s, loss=0.684, v_num=1, val_acc=0.756]
Epoch 95:  65%|██████▍   | 76/117 [00:03<00:01, 21.55it/s, loss=0.685, v_num=1, val_acc=0.756]
Epoch 95:  66%|██████▌   | 77/117 [00:03<00:01, 21.78it/s, loss=0.685, v_num=1, val_acc=0.756]
Epoch 95:  66%|██████▌   | 77/117 [00:03<00:01, 21.62it/s, loss=0.688, v_num=1, val_acc=0.756]
Epoch 95:  67%|██████▋   | 78/117 [00:03<00:01, 21.85it/s, loss=0.688, v_num=1, val_acc=0.756]
Epoch 95:  67%|██████▋   | 78/117 [00:03<00:01, 21.70it/s, loss=0.685, v_num=1, val_acc=0.756]
Epoch 95:  68%|██████▊   | 79/117 [00:03<00:01, 21.92it/s, loss=0.685, v_num=1, val_acc=0.756]
Epoch 95:  68%|██████▊   | 79/117 [00:03<00:01, 21.77it/s, loss=0.683, v_num=1, val_acc=0.756]
Epoch 95:  68%|██████▊   | 80/117 [00:03<00:01, 21.99it/s, loss=0.683, v_num=1, val_acc=0.756]
Epoch 95:  68%|██████▊   | 80/117 [00:03<00:01, 21.83it/s, loss=0.676, v_num=1, val_acc=0.756]
Epoch 95:  69%|██████▉   | 81/117 [00:03<00:01, 22.05it/s, loss=0.676, v_num=1, val_acc=0.756]
Epoch 95:  69%|██████▉   | 81/117 [00:03<00:01, 21.90it/s, loss=0.676, v_num=1, val_acc=0.756]
Epoch 95:  70%|███████   | 82/117 [00:03<00:01, 22.10it/s, loss=0.676, v_num=1, val_acc=0.756]
Epoch 95:  70%|███████   | 82/117 [00:03<00:01, 21.95it/s, loss=0.673, v_num=1, val_acc=0.756]
Epoch 95:  71%|███████   | 83/117 [00:03<00:01, 22.16it/s, loss=0.673, v_num=1, val_acc=0.756]
Epoch 95:  71%|███████   | 83/117 [00:03<00:01, 22.01it/s, loss=0.675, v_num=1, val_acc=0.756]
Epoch 95:  72%|███████▏  | 84/117 [00:03<00:01, 22.23it/s, loss=0.675, v_num=1, val_acc=0.756]
Epoch 95:  72%|███████▏  | 84/117 [00:03<00:01, 22.08it/s, loss=0.672, v_num=1, val_acc=0.756]
Epoch 95:  73%|███████▎  | 85/117 [00:03<00:01, 22.29it/s, loss=0.672, v_num=1, val_acc=0.756]
Epoch 95:  73%|███████▎  | 85/117 [00:03<00:01, 22.14it/s, loss=0.673, v_num=1, val_acc=0.756]
Epoch 95:  74%|███████▎  | 86/117 [00:03<00:01, 22.35it/s, loss=0.673, v_num=1, val_acc=0.756]
Epoch 95:  74%|███████▎  | 86/117 [00:03<00:01, 22.20it/s, loss=0.675, v_num=1, val_acc=0.756]
Epoch 95:  74%|███████▍  | 87/117 [00:03<00:01, 22.40it/s, loss=0.675, v_num=1, val_acc=0.756]
Epoch 95:  74%|███████▍  | 87/117 [00:03<00:01, 22.26it/s, loss=0.67, v_num=1, val_acc=0.756]
Epoch 95:  75%|███████▌  | 88/117 [00:03<00:01, 22.46it/s, loss=0.67, v_num=1, val_acc=0.756]
Epoch 95:  75%|███████▌  | 88/117 [00:03<00:01, 22.32it/s, loss=0.672, v_num=1, val_acc=0.756]
Epoch 95:  76%|███████▌  | 89/117 [00:03<00:01, 22.52it/s, loss=0.672, v_num=1, val_acc=0.756]
Epoch 95:  76%|███████▌  | 89/117 [00:03<00:01, 22.38it/s, loss=0.667, v_num=1, val_acc=0.756]
Epoch 95:  77%|███████▋  | 90/117 [00:03<00:01, 22.58it/s, loss=0.667, v_num=1, val_acc=0.756]
Epoch 95:  77%|███████▋  | 90/117 [00:04<00:01, 22.44it/s, loss=0.671, v_num=1, val_acc=0.756]
Epoch 95:  78%|███████▊  | 91/117 [00:04<00:01, 22.63it/s, loss=0.671, v_num=1, val_acc=0.756]
Epoch 95:  78%|███████▊  | 91/117 [00:04<00:01, 22.49it/s, loss=0.677, v_num=1, val_acc=0.756]
Epoch 95:  79%|███████▊  | 92/117 [00:04<00:01, 22.69it/s, loss=0.677, v_num=1, val_acc=0.756]
Epoch 95:  79%|███████▊  | 92/117 [00:04<00:01, 22.55it/s, loss=0.682, v_num=1, val_acc=0.756]
Epoch 95:  79%|███████▉  | 93/117 [00:04<00:01, 22.74it/s, loss=0.682, v_num=1, val_acc=0.756]
Epoch 95:  79%|███████▉  | 93/117 [00:04<00:01, 22.60it/s, loss=0.69, v_num=1, val_acc=0.756]
Epoch 95:  80%|████████  | 94/117 [00:04<00:01, 22.80it/s, loss=0.69, v_num=1, val_acc=0.756]
Epoch 95:  80%|████████  | 94/117 [00:04<00:01, 22.66it/s, loss=0.694, v_num=1, val_acc=0.756]
Epoch 95:  81%|████████  | 95/117 [00:04<00:00, 22.85it/s, loss=0.694, v_num=1, val_acc=0.756]
Epoch 95:  81%|████████  | 95/117 [00:04<00:00, 22.71it/s, loss=0.694, v_num=1, val_acc=0.756]
Epoch 95:  82%|████████▏ | 96/117 [00:04<00:00, 22.90it/s, loss=0.694, v_num=1, val_acc=0.756]
Epoch 95:  82%|████████▏ | 96/117 [00:04<00:00, 22.76it/s, loss=0.696, v_num=1, val_acc=0.756]
Epoch 95:  83%|████████▎ | 97/117 [00:04<00:00, 22.95it/s, loss=0.696, v_num=1, val_acc=0.756]
Epoch 95:  83%|████████▎ | 97/117 [00:04<00:00, 22.81it/s, loss=0.696, v_num=1, val_acc=0.756]

Validation: 0it [00:00, ?it/s]

Validation:   0%|          | 0/20 [00:00<?, ?it/s]

Validation DataLoader 0:   0%|          | 0/20 [00:00<?, ?it/s]

Validation DataLoader 0:   5%|▌         | 1/20 [00:00<00:00, 152.07it/s]
Epoch 95:  84%|████████▍ | 98/117 [00:05<00:00, 19.24it/s, loss=0.696, v_num=1, val_acc=0.756]

Validation DataLoader 0:  10%|█         | 2/20 [00:00<00:00, 55.31it/s]
Epoch 95:  85%|████████▍ | 99/117 [00:05<00:00, 19.32it/s, loss=0.696, v_num=1, val_acc=0.756]

Validation DataLoader 0:  15%|█▌        | 3/20 [00:00<00:00, 44.44it/s]
Epoch 95:  85%|████████▌ | 100/117 [00:05<00:00, 19.40it/s, loss=0.696, v_num=1, val_acc=0.756]

Validation DataLoader 0:  20%|██        | 4/20 [00:00<00:00, 40.34it/s]
Epoch 95:  86%|████████▋ | 101/117 [00:05<00:00, 19.47it/s, loss=0.696, v_num=1, val_acc=0.756]

Validation DataLoader 0:  25%|██▌       | 5/20 [00:00<00:00, 38.17it/s]
Epoch 95:  87%|████████▋ | 102/117 [00:05<00:00, 19.54it/s, loss=0.696, v_num=1, val_acc=0.756]

Validation DataLoader 0:  30%|███       | 6/20 [00:00<00:00, 36.89it/s]
Epoch 95:  88%|████████▊ | 103/117 [00:05<00:00, 19.62it/s, loss=0.696, v_num=1, val_acc=0.756]

Validation DataLoader 0:  35%|███▌      | 7/20 [00:00<00:00, 36.06it/s]
Epoch 95:  89%|████████▉ | 104/117 [00:05<00:00, 19.69it/s, loss=0.696, v_num=1, val_acc=0.756]

Validation DataLoader 0:  40%|████      | 8/20 [00:00<00:00, 35.41it/s]
Epoch 95:  90%|████████▉ | 105/117 [00:05<00:00, 19.76it/s, loss=0.696, v_num=1, val_acc=0.756]

Validation DataLoader 0:  45%|████▌     | 9/20 [00:00<00:00, 34.91it/s]
Epoch 95:  91%|█████████ | 106/117 [00:05<00:00, 19.83it/s, loss=0.696, v_num=1, val_acc=0.756]

Validation DataLoader 0:  50%|█████     | 10/20 [00:00<00:00, 34.57it/s]
Epoch 95:  91%|█████████▏| 107/117 [00:05<00:00, 19.90it/s, loss=0.696, v_num=1, val_acc=0.756]

Validation DataLoader 0:  55%|█████▌    | 11/20 [00:00<00:00, 34.28it/s]
Epoch 95:  92%|█████████▏| 108/117 [00:05<00:00, 19.97it/s, loss=0.696, v_num=1, val_acc=0.756]

Validation DataLoader 0:  60%|██████    | 12/20 [00:00<00:00, 34.06it/s]
Epoch 95:  93%|█████████▎| 109/117 [00:05<00:00, 20.03it/s, loss=0.696, v_num=1, val_acc=0.756]

Validation DataLoader 0:  65%|██████▌   | 13/20 [00:00<00:00, 33.85it/s]
Epoch 95:  94%|█████████▍| 110/117 [00:05<00:00, 20.10it/s, loss=0.696, v_num=1, val_acc=0.756]

Validation DataLoader 0:  70%|███████   | 14/20 [00:00<00:00, 33.67it/s]
Epoch 95:  95%|█████████▍| 111/117 [00:05<00:00, 20.17it/s, loss=0.696, v_num=1, val_acc=0.756]

Validation DataLoader 0:  75%|███████▌  | 15/20 [00:00<00:00, 33.54it/s]
Epoch 95:  96%|█████████▌| 112/117 [00:05<00:00, 20.23it/s, loss=0.696, v_num=1, val_acc=0.756]

Validation DataLoader 0:  80%|████████  | 16/20 [00:00<00:00, 33.41it/s]
Epoch 95:  97%|█████████▋| 113/117 [00:05<00:00, 20.30it/s, loss=0.696, v_num=1, val_acc=0.756]

Validation DataLoader 0:  85%|████████▌ | 17/20 [00:00<00:00, 33.28it/s]
Epoch 95:  97%|█████████▋| 114/117 [00:05<00:00, 20.36it/s, loss=0.696, v_num=1, val_acc=0.756]

Validation DataLoader 0:  90%|█████████ | 18/20 [00:00<00:00, 33.17it/s]
Epoch 95:  98%|█████████▊| 115/117 [00:05<00:00, 20.42it/s, loss=0.696, v_num=1, val_acc=0.756]

Validation DataLoader 0:  95%|█████████▌| 19/20 [00:00<00:00, 33.08it/s]
Epoch 95:  99%|█████████▉| 116/117 [00:05<00:00, 20.49it/s, loss=0.696, v_num=1, val_acc=0.756]

Validation DataLoader 0: 100%|██████████| 20/20 [00:00<00:00, 33.07it/s]
Epoch 95: 100%|██████████| 117/117 [00:05<00:00, 20.55it/s, loss=0.696, v_num=1, val_acc=0.756]
Epoch 95: 100%|██████████| 117/117 [00:05<00:00, 20.48it/s, loss=0.696, v_num=1, val_acc=0.758]


Epoch 95: 100%|██████████| 117/117 [00:05<00:00, 20.48it/s, loss=0.696, v_num=1, val_acc=0.758]
Epoch 95:   0%|          | 0/117 [00:00<?, ?it/s, loss=0.696, v_num=1, val_acc=0.758]
Epoch 96:   0%|          | 0/117 [00:00<?, ?it/s, loss=0.696, v_num=1, val_acc=0.758]
Epoch 96:   1%|          | 1/117 [00:00<01:43,  1.12it/s, loss=0.696, v_num=1, val_acc=0.758]
Epoch 96:   1%|          | 1/117 [00:00<01:46,  1.09it/s, loss=0.699, v_num=1, val_acc=0.758]
Epoch 96:   2%|▏         | 2/117 [00:00<00:53,  2.15it/s, loss=0.699, v_num=1, val_acc=0.758]
Epoch 96:   2%|▏         | 2/117 [00:00<00:54,  2.10it/s, loss=0.699, v_num=1, val_acc=0.758]
Epoch 96:   3%|▎         | 3/117 [00:00<00:36,  3.11it/s, loss=0.699, v_num=1, val_acc=0.758]
Epoch 96:   3%|▎         | 3/117 [00:00<00:37,  3.04it/s, loss=0.698, v_num=1, val_acc=0.758]
Epoch 96:   3%|▎         | 4/117 [00:00<00:28,  4.01it/s, loss=0.698, v_num=1, val_acc=0.758]
Epoch 96:   3%|▎         | 4/117 [00:01<00:28,  3.91it/s, loss=0.704, v_num=1, val_acc=0.758]
Epoch 96:   4%|▍         | 5/117 [00:01<00:23,  4.83it/s, loss=0.704, v_num=1, val_acc=0.758]
Epoch 96:   4%|▍         | 5/117 [00:01<00:23,  4.72it/s, loss=0.703, v_num=1, val_acc=0.758]
Epoch 96:   5%|▌         | 6/117 [00:01<00:19,  5.62it/s, loss=0.703, v_num=1, val_acc=0.758]
Epoch 96:   5%|▌         | 6/117 [00:01<00:20,  5.48it/s, loss=0.702, v_num=1, val_acc=0.758]
Epoch 96:   6%|▌         | 7/117 [00:01<00:17,  6.35it/s, loss=0.702, v_num=1, val_acc=0.758]
Epoch 96:   6%|▌         | 7/117 [00:01<00:17,  6.21it/s, loss=0.712, v_num=1, val_acc=0.758]
Epoch 96:   7%|▋         | 8/117 [00:01<00:15,  7.04it/s, loss=0.712, v_num=1, val_acc=0.758]
Epoch 96:   7%|▋         | 8/117 [00:01<00:15,  6.88it/s, loss=0.713, v_num=1, val_acc=0.758]
Epoch 96:   8%|▊         | 9/117 [00:01<00:14,  7.68it/s, loss=0.713, v_num=1, val_acc=0.758]
Epoch 96:   8%|▊         | 9/117 [00:01<00:14,  7.51it/s, loss=0.715, v_num=1, val_acc=0.758]
Epoch 96:   9%|▊         | 10/117 [00:01<00:12,  8.29it/s, loss=0.715, v_num=1, val_acc=0.758]
Epoch 96:   9%|▊         | 10/117 [00:01<00:13,  8.12it/s, loss=0.715, v_num=1, val_acc=0.758]
Epoch 96:   9%|▉         | 11/117 [00:01<00:11,  8.85it/s, loss=0.715, v_num=1, val_acc=0.758]
Epoch 96:   9%|▉         | 11/117 [00:01<00:12,  8.68it/s, loss=0.719, v_num=1, val_acc=0.758]
Epoch 96:  10%|█         | 12/117 [00:01<00:11,  9.41it/s, loss=0.719, v_num=1, val_acc=0.758]
Epoch 96:  10%|█         | 12/117 [00:01<00:11,  9.22it/s, loss=0.722, v_num=1, val_acc=0.758]
Epoch 96:  11%|█         | 13/117 [00:01<00:10,  9.92it/s, loss=0.722, v_num=1, val_acc=0.758]
Epoch 96:  11%|█         | 13/117 [00:01<00:10,  9.73it/s, loss=0.721, v_num=1, val_acc=0.758]
Epoch 96:  12%|█▏        | 14/117 [00:01<00:09, 10.41it/s, loss=0.721, v_num=1, val_acc=0.758]
Epoch 96:  12%|█▏        | 14/117 [00:01<00:10, 10.22it/s, loss=0.718, v_num=1, val_acc=0.758]
Epoch 96:  13%|█▎        | 15/117 [00:01<00:09, 10.88it/s, loss=0.718, v_num=1, val_acc=0.758]
Epoch 96:  13%|█▎        | 15/117 [00:01<00:09, 10.68it/s, loss=0.712, v_num=1, val_acc=0.758]
Epoch 96:  14%|█▎        | 16/117 [00:01<00:08, 11.33it/s, loss=0.712, v_num=1, val_acc=0.758]
Epoch 96:  14%|█▎        | 16/117 [00:01<00:09, 11.13it/s, loss=0.713, v_num=1, val_acc=0.758]
Epoch 96:  15%|█▍        | 17/117 [00:01<00:08, 11.74it/s, loss=0.713, v_num=1, val_acc=0.758]
Epoch 96:  15%|█▍        | 17/117 [00:01<00:08, 11.54it/s, loss=0.709, v_num=1, val_acc=0.758]
Epoch 96:  15%|█▌        | 18/117 [00:01<00:08, 12.15it/s, loss=0.709, v_num=1, val_acc=0.758]
Epoch 96:  15%|█▌        | 18/117 [00:01<00:08, 11.94it/s, loss=0.706, v_num=1, val_acc=0.758]
Epoch 96:  16%|█▌        | 19/117 [00:01<00:07, 12.53it/s, loss=0.706, v_num=1, val_acc=0.758]
Epoch 96:  16%|█▌        | 19/117 [00:01<00:07, 12.32it/s, loss=0.701, v_num=1, val_acc=0.758]
Epoch 96:  17%|█▋        | 20/117 [00:01<00:07, 12.90it/s, loss=0.701, v_num=1, val_acc=0.758]
Epoch 96:  17%|█▋        | 20/117 [00:01<00:07, 12.69it/s, loss=0.7, v_num=1, val_acc=0.758]
Epoch 96:  18%|█▊        | 21/117 [00:01<00:07, 13.24it/s, loss=0.7, v_num=1, val_acc=0.758]
Epoch 96:  18%|█▊        | 21/117 [00:01<00:07, 13.03it/s, loss=0.704, v_num=1, val_acc=0.758]
Epoch 96:  19%|█▉        | 22/117 [00:01<00:06, 13.58it/s, loss=0.704, v_num=1, val_acc=0.758]
Epoch 96:  19%|█▉        | 22/117 [00:01<00:07, 13.38it/s, loss=0.706, v_num=1, val_acc=0.758]
Epoch 96:  20%|█▉        | 23/117 [00:01<00:06, 13.91it/s, loss=0.706, v_num=1, val_acc=0.758]
Epoch 96:  20%|█▉        | 23/117 [00:01<00:06, 13.70it/s, loss=0.711, v_num=1, val_acc=0.758]
Epoch 96:  21%|██        | 24/117 [00:01<00:06, 14.21it/s, loss=0.711, v_num=1, val_acc=0.758]
Epoch 96:  21%|██        | 24/117 [00:01<00:06, 14.00it/s, loss=0.708, v_num=1, val_acc=0.758]
Epoch 96:  21%|██▏       | 25/117 [00:01<00:06, 14.51it/s, loss=0.708, v_num=1, val_acc=0.758]
Epoch 96:  21%|██▏       | 25/117 [00:01<00:06, 14.30it/s, loss=0.713, v_num=1, val_acc=0.758]
Epoch 96:  22%|██▏       | 26/117 [00:01<00:06, 14.79it/s, loss=0.713, v_num=1, val_acc=0.758]
Epoch 96:  22%|██▏       | 26/117 [00:01<00:06, 14.59it/s, loss=0.713, v_num=1, val_acc=0.758]
Epoch 96:  23%|██▎       | 27/117 [00:01<00:05, 15.07it/s, loss=0.713, v_num=1, val_acc=0.758]
Epoch 96:  23%|██▎       | 27/117 [00:01<00:06, 14.86it/s, loss=0.703, v_num=1, val_acc=0.758]
Epoch 96:  24%|██▍       | 28/117 [00:01<00:05, 15.33it/s, loss=0.703, v_num=1, val_acc=0.758]
Epoch 96:  24%|██▍       | 28/117 [00:01<00:05, 15.12it/s, loss=0.701, v_num=1, val_acc=0.758]
Epoch 96:  25%|██▍       | 29/117 [00:01<00:05, 15.59it/s, loss=0.701, v_num=1, val_acc=0.758]
Epoch 96:  25%|██▍       | 29/117 [00:01<00:05, 15.38it/s, loss=0.695, v_num=1, val_acc=0.758]
Epoch 96:  26%|██▌       | 30/117 [00:01<00:05, 15.83it/s, loss=0.695, v_num=1, val_acc=0.758]
Epoch 96:  26%|██▌       | 30/117 [00:01<00:05, 15.62it/s, loss=0.696, v_num=1, val_acc=0.758]
Epoch 96:  26%|██▋       | 31/117 [00:01<00:05, 16.07it/s, loss=0.696, v_num=1, val_acc=0.758]
Epoch 96:  26%|██▋       | 31/117 [00:01<00:05, 15.86it/s, loss=0.688, v_num=1, val_acc=0.758]
Epoch 96:  27%|██▋       | 32/117 [00:01<00:05, 16.29it/s, loss=0.688, v_num=1, val_acc=0.758]
Epoch 96:  27%|██▋       | 32/117 [00:01<00:05, 16.09it/s, loss=0.691, v_num=1, val_acc=0.758]
Epoch 96:  28%|██▊       | 33/117 [00:01<00:05, 16.51it/s, loss=0.691, v_num=1, val_acc=0.758]
Epoch 96:  28%|██▊       | 33/117 [00:02<00:05, 16.31it/s, loss=0.694, v_num=1, val_acc=0.758]
Epoch 96:  29%|██▉       | 34/117 [00:02<00:04, 16.73it/s, loss=0.694, v_num=1, val_acc=0.758]
Epoch 96:  29%|██▉       | 34/117 [00:02<00:05, 16.52it/s, loss=0.689, v_num=1, val_acc=0.758]
Epoch 96:  30%|██▉       | 35/117 [00:02<00:04, 16.93it/s, loss=0.689, v_num=1, val_acc=0.758]
Epoch 96:  30%|██▉       | 35/117 [00:02<00:04, 16.73it/s, loss=0.695, v_num=1, val_acc=0.758]
Epoch 96:  31%|███       | 36/117 [00:02<00:04, 17.13it/s, loss=0.695, v_num=1, val_acc=0.758]
Epoch 96:  31%|███       | 36/117 [00:02<00:04, 16.92it/s, loss=0.69, v_num=1, val_acc=0.758]
Epoch 96:  32%|███▏      | 37/117 [00:02<00:04, 17.32it/s, loss=0.69, v_num=1, val_acc=0.758]
Epoch 96:  32%|███▏      | 37/117 [00:02<00:04, 17.12it/s, loss=0.691, v_num=1, val_acc=0.758]
Epoch 96:  32%|███▏      | 38/117 [00:02<00:04, 17.51it/s, loss=0.691, v_num=1, val_acc=0.758]
Epoch 96:  32%|███▏      | 38/117 [00:02<00:04, 17.31it/s, loss=0.692, v_num=1, val_acc=0.758]
Epoch 96:  33%|███▎      | 39/117 [00:02<00:04, 17.68it/s, loss=0.692, v_num=1, val_acc=0.758]
Epoch 96:  33%|███▎      | 39/117 [00:02<00:04, 17.48it/s, loss=0.687, v_num=1, val_acc=0.758]
Epoch 96:  34%|███▍      | 40/117 [00:02<00:04, 17.86it/s, loss=0.687, v_num=1, val_acc=0.758]
Epoch 96:  34%|███▍      | 40/117 [00:02<00:04, 17.66it/s, loss=0.688, v_num=1, val_acc=0.758]
Epoch 96:  35%|███▌      | 41/117 [00:02<00:04, 18.03it/s, loss=0.688, v_num=1, val_acc=0.758]
Epoch 96:  35%|███▌      | 41/117 [00:02<00:04, 17.83it/s, loss=0.689, v_num=1, val_acc=0.758]
Epoch 96:  36%|███▌      | 42/117 [00:02<00:04, 18.19it/s, loss=0.689, v_num=1, val_acc=0.758]
Epoch 96:  36%|███▌      | 42/117 [00:02<00:04, 17.99it/s, loss=0.687, v_num=1, val_acc=0.758]
Epoch 96:  37%|███▋      | 43/117 [00:02<00:04, 18.35it/s, loss=0.687, v_num=1, val_acc=0.758]
Epoch 96:  37%|███▋      | 43/117 [00:02<00:04, 18.15it/s, loss=0.686, v_num=1, val_acc=0.758]
Epoch 96:  38%|███▊      | 44/117 [00:02<00:03, 18.47it/s, loss=0.686, v_num=1, val_acc=0.758]
Epoch 96:  38%|███▊      | 44/117 [00:02<00:03, 18.29it/s, loss=0.682, v_num=1, val_acc=0.758]
Epoch 96:  38%|███▊      | 45/117 [00:02<00:03, 18.63it/s, loss=0.682, v_num=1, val_acc=0.758]
Epoch 96:  38%|███▊      | 45/117 [00:02<00:03, 18.44it/s, loss=0.678, v_num=1, val_acc=0.758]
Epoch 96:  39%|███▉      | 46/117 [00:02<00:03, 18.77it/s, loss=0.678, v_num=1, val_acc=0.758]
Epoch 96:  39%|███▉      | 46/117 [00:02<00:03, 18.58it/s, loss=0.68, v_num=1, val_acc=0.758]
Epoch 96:  40%|████      | 47/117 [00:02<00:03, 18.92it/s, loss=0.68, v_num=1, val_acc=0.758]
Epoch 96:  40%|████      | 47/117 [00:02<00:03, 18.73it/s, loss=0.679, v_num=1, val_acc=0.758]
Epoch 96:  41%|████      | 48/117 [00:02<00:03, 19.05it/s, loss=0.679, v_num=1, val_acc=0.758]
Epoch 96:  41%|████      | 48/117 [00:02<00:03, 18.86it/s, loss=0.679, v_num=1, val_acc=0.758]
Epoch 96:  42%|████▏     | 49/117 [00:02<00:03, 19.19it/s, loss=0.679, v_num=1, val_acc=0.758]
Epoch 96:  42%|████▏     | 49/117 [00:02<00:03, 19.00it/s, loss=0.683, v_num=1, val_acc=0.758]
Epoch 96:  43%|████▎     | 50/117 [00:02<00:03, 19.31it/s, loss=0.683, v_num=1, val_acc=0.758]
Epoch 96:  43%|████▎     | 50/117 [00:02<00:03, 19.12it/s, loss=0.68, v_num=1, val_acc=0.758]
Epoch 96:  44%|████▎     | 51/117 [00:02<00:03, 19.44it/s, loss=0.68, v_num=1, val_acc=0.758]
Epoch 96:  44%|████▎     | 51/117 [00:02<00:03, 19.25it/s, loss=0.684, v_num=1, val_acc=0.758]
Epoch 96:  44%|████▍     | 52/117 [00:02<00:03, 19.56it/s, loss=0.684, v_num=1, val_acc=0.758]
Epoch 96:  44%|████▍     | 52/117 [00:02<00:03, 19.38it/s, loss=0.676, v_num=1, val_acc=0.758]
Epoch 96:  45%|████▌     | 53/117 [00:02<00:03, 19.68it/s, loss=0.676, v_num=1, val_acc=0.758]
Epoch 96:  45%|████▌     | 53/117 [00:02<00:03, 19.50it/s, loss=0.679, v_num=1, val_acc=0.758]
Epoch 96:  46%|████▌     | 54/117 [00:02<00:03, 19.80it/s, loss=0.679, v_num=1, val_acc=0.758]
Epoch 96:  46%|████▌     | 54/117 [00:02<00:03, 19.62it/s, loss=0.68, v_num=1, val_acc=0.758]
Epoch 96:  47%|████▋     | 55/117 [00:02<00:03, 19.92it/s, loss=0.68, v_num=1, val_acc=0.758]
Epoch 96:  47%|████▋     | 55/117 [00:02<00:03, 19.74it/s, loss=0.675, v_num=1, val_acc=0.758]
Epoch 96:  48%|████▊     | 56/117 [00:02<00:03, 20.03it/s, loss=0.675, v_num=1, val_acc=0.758]
Epoch 96:  48%|████▊     | 56/117 [00:02<00:03, 19.85it/s, loss=0.676, v_num=1, val_acc=0.758]
Epoch 96:  49%|████▊     | 57/117 [00:02<00:02, 20.14it/s, loss=0.676, v_num=1, val_acc=0.758]
Epoch 96:  49%|████▊     | 57/117 [00:02<00:03, 19.96it/s, loss=0.677, v_num=1, val_acc=0.758]
Epoch 96:  50%|████▉     | 58/117 [00:02<00:02, 20.25it/s, loss=0.677, v_num=1, val_acc=0.758]
Epoch 96:  50%|████▉     | 58/117 [00:02<00:02, 20.07it/s, loss=0.677, v_num=1, val_acc=0.758]
Epoch 96:  50%|█████     | 59/117 [00:02<00:02, 20.35it/s, loss=0.677, v_num=1, val_acc=0.758]
Epoch 96:  50%|█████     | 59/117 [00:02<00:02, 20.18it/s, loss=0.682, v_num=1, val_acc=0.758]
Epoch 96:  51%|█████▏    | 60/117 [00:02<00:02, 20.45it/s, loss=0.682, v_num=1, val_acc=0.758]
Epoch 96:  51%|█████▏    | 60/117 [00:02<00:02, 20.28it/s, loss=0.682, v_num=1, val_acc=0.758]
Epoch 96:  52%|█████▏    | 61/117 [00:02<00:02, 20.55it/s, loss=0.682, v_num=1, val_acc=0.758]
Epoch 96:  52%|█████▏    | 61/117 [00:02<00:02, 20.38it/s, loss=0.68, v_num=1, val_acc=0.758]
Epoch 96:  53%|█████▎    | 62/117 [00:03<00:02, 20.64it/s, loss=0.68, v_num=1, val_acc=0.758]
Epoch 96:  53%|█████▎    | 62/117 [00:03<00:02, 20.47it/s, loss=0.679, v_num=1, val_acc=0.758]
Epoch 96:  54%|█████▍    | 63/117 [00:03<00:02, 20.74it/s, loss=0.679, v_num=1, val_acc=0.758]
Epoch 96:  54%|█████▍    | 63/117 [00:03<00:02, 20.57it/s, loss=0.678, v_num=1, val_acc=0.758]
Epoch 96:  55%|█████▍    | 64/117 [00:03<00:02, 20.83it/s, loss=0.678, v_num=1, val_acc=0.758]
Epoch 96:  55%|█████▍    | 64/117 [00:03<00:02, 20.66it/s, loss=0.681, v_num=1, val_acc=0.758]
Epoch 96:  56%|█████▌    | 65/117 [00:03<00:02, 20.92it/s, loss=0.681, v_num=1, val_acc=0.758]
Epoch 96:  56%|█████▌    | 65/117 [00:03<00:02, 20.75it/s, loss=0.682, v_num=1, val_acc=0.758]
Epoch 96:  56%|█████▋    | 66/117 [00:03<00:02, 21.00it/s, loss=0.682, v_num=1, val_acc=0.758]
Epoch 96:  56%|█████▋    | 66/117 [00:03<00:02, 20.83it/s, loss=0.681, v_num=1, val_acc=0.758]
Epoch 96:  57%|█████▋    | 67/117 [00:03<00:02, 21.09it/s, loss=0.681, v_num=1, val_acc=0.758]
Epoch 96:  57%|█████▋    | 67/117 [00:03<00:02, 20.92it/s, loss=0.683, v_num=1, val_acc=0.758]
Epoch 96:  58%|█████▊    | 68/117 [00:03<00:02, 21.14it/s, loss=0.683, v_num=1, val_acc=0.758]
Epoch 96:  58%|█████▊    | 68/117 [00:03<00:02, 20.99it/s, loss=0.684, v_num=1, val_acc=0.758]
Epoch 96:  59%|█████▉    | 69/117 [00:03<00:02, 21.21it/s, loss=0.684, v_num=1, val_acc=0.758]
Epoch 96:  59%|█████▉    | 69/117 [00:03<00:02, 21.06it/s, loss=0.683, v_num=1, val_acc=0.758]
Epoch 96:  60%|█████▉    | 70/117 [00:03<00:02, 21.31it/s, loss=0.683, v_num=1, val_acc=0.758]
Epoch 96:  60%|█████▉    | 70/117 [00:03<00:02, 21.14it/s, loss=0.686, v_num=1, val_acc=0.758]
Epoch 96:  61%|██████    | 71/117 [00:03<00:02, 21.38it/s, loss=0.686, v_num=1, val_acc=0.758]
Epoch 96:  61%|██████    | 71/117 [00:03<00:02, 21.22it/s, loss=0.688, v_num=1, val_acc=0.758]
Epoch 96:  62%|██████▏   | 72/117 [00:03<00:02, 21.46it/s, loss=0.688, v_num=1, val_acc=0.758]
Epoch 96:  62%|██████▏   | 72/117 [00:03<00:02, 21.30it/s, loss=0.693, v_num=1, val_acc=0.758]
Epoch 96:  62%|██████▏   | 73/117 [00:03<00:02, 21.54it/s, loss=0.693, v_num=1, val_acc=0.758]
Epoch 96:  62%|██████▏   | 73/117 [00:03<00:02, 21.38it/s, loss=0.688, v_num=1, val_acc=0.758]
Epoch 96:  63%|██████▎   | 74/117 [00:03<00:01, 21.58it/s, loss=0.688, v_num=1, val_acc=0.758]
Epoch 96:  63%|██████▎   | 74/117 [00:03<00:02, 21.43it/s, loss=0.692, v_num=1, val_acc=0.758]
Epoch 96:  64%|██████▍   | 75/117 [00:03<00:01, 21.66it/s, loss=0.692, v_num=1, val_acc=0.758]
Epoch 96:  64%|██████▍   | 75/117 [00:03<00:01, 21.50it/s, loss=0.693, v_num=1, val_acc=0.758]
Epoch 96:  65%|██████▍   | 76/117 [00:03<00:01, 21.74it/s, loss=0.693, v_num=1, val_acc=0.758]
Epoch 96:  65%|██████▍   | 76/117 [00:03<00:01, 21.58it/s, loss=0.691, v_num=1, val_acc=0.758]
Epoch 96:  66%|██████▌   | 77/117 [00:03<00:01, 21.81it/s, loss=0.691, v_num=1, val_acc=0.758]
Epoch 96:  66%|██████▌   | 77/117 [00:03<00:01, 21.65it/s, loss=0.691, v_num=1, val_acc=0.758]
Epoch 96:  67%|██████▋   | 78/117 [00:03<00:01, 21.87it/s, loss=0.691, v_num=1, val_acc=0.758]
Epoch 96:  67%|██████▋   | 78/117 [00:03<00:01, 21.72it/s, loss=0.691, v_num=1, val_acc=0.758]
Epoch 96:  68%|██████▊   | 79/117 [00:03<00:01, 21.94it/s, loss=0.691, v_num=1, val_acc=0.758]
Epoch 96:  68%|██████▊   | 79/117 [00:03<00:01, 21.79it/s, loss=0.688, v_num=1, val_acc=0.758]
Epoch 96:  68%|██████▊   | 80/117 [00:03<00:01, 22.00it/s, loss=0.688, v_num=1, val_acc=0.758]
Epoch 96:  68%|██████▊   | 80/117 [00:03<00:01, 21.85it/s, loss=0.687, v_num=1, val_acc=0.758]
Epoch 96:  69%|██████▉   | 81/117 [00:03<00:01, 22.07it/s, loss=0.687, v_num=1, val_acc=0.758]
Epoch 96:  69%|██████▉   | 81/117 [00:03<00:01, 21.92it/s, loss=0.687, v_num=1, val_acc=0.758]
Epoch 96:  70%|███████   | 82/117 [00:03<00:01, 22.12it/s, loss=0.687, v_num=1, val_acc=0.758]
Epoch 96:  70%|███████   | 82/117 [00:03<00:01, 21.97it/s, loss=0.693, v_num=1, val_acc=0.758]
Epoch 96:  71%|███████   | 83/117 [00:03<00:01, 22.19it/s, loss=0.693, v_num=1, val_acc=0.758]
Epoch 96:  71%|███████   | 83/117 [00:03<00:01, 22.04it/s, loss=0.688, v_num=1, val_acc=0.758]
Epoch 96:  72%|███████▏  | 84/117 [00:03<00:01, 22.25it/s, loss=0.688, v_num=1, val_acc=0.758]
Epoch 96:  72%|███████▏  | 84/117 [00:03<00:01, 22.10it/s, loss=0.688, v_num=1, val_acc=0.758]
Epoch 96:  73%|███████▎  | 85/117 [00:03<00:01, 22.31it/s, loss=0.688, v_num=1, val_acc=0.758]
Epoch 96:  73%|███████▎  | 85/117 [00:03<00:01, 22.17it/s, loss=0.687, v_num=1, val_acc=0.758]
Epoch 96:  74%|███████▎  | 86/117 [00:03<00:01, 22.38it/s, loss=0.687, v_num=1, val_acc=0.758]
Epoch 96:  74%|███████▎  | 86/117 [00:03<00:01, 22.23it/s, loss=0.685, v_num=1, val_acc=0.758]
Epoch 96:  74%|███████▍  | 87/117 [00:03<00:01, 22.44it/s, loss=0.685, v_num=1, val_acc=0.758]
Epoch 96:  74%|███████▍  | 87/117 [00:03<00:01, 22.29it/s, loss=0.685, v_num=1, val_acc=0.758]
Epoch 96:  75%|███████▌  | 88/117 [00:03<00:01, 22.50it/s, loss=0.685, v_num=1, val_acc=0.758]
Epoch 96:  75%|███████▌  | 88/117 [00:03<00:01, 22.35it/s, loss=0.686, v_num=1, val_acc=0.758]
Epoch 96:  76%|███████▌  | 89/117 [00:03<00:01, 22.55it/s, loss=0.686, v_num=1, val_acc=0.758]
Epoch 96:  76%|███████▌  | 89/117 [00:03<00:01, 22.41it/s, loss=0.688, v_num=1, val_acc=0.758]
Epoch 96:  77%|███████▋  | 90/117 [00:03<00:01, 22.61it/s, loss=0.688, v_num=1, val_acc=0.758]
Epoch 96:  77%|███████▋  | 90/117 [00:04<00:01, 22.46it/s, loss=0.682, v_num=1, val_acc=0.758]
Epoch 96:  78%|███████▊  | 91/117 [00:04<00:01, 22.66it/s, loss=0.682, v_num=1, val_acc=0.758]
Epoch 96:  78%|███████▊  | 91/117 [00:04<00:01, 22.52it/s, loss=0.682, v_num=1, val_acc=0.758]
Epoch 96:  79%|███████▊  | 92/117 [00:04<00:01, 22.72it/s, loss=0.682, v_num=1, val_acc=0.758]
Epoch 96:  79%|███████▊  | 92/117 [00:04<00:01, 22.58it/s, loss=0.682, v_num=1, val_acc=0.758]
Epoch 96:  79%|███████▉  | 93/117 [00:04<00:01, 22.77it/s, loss=0.682, v_num=1, val_acc=0.758]
Epoch 96:  79%|███████▉  | 93/117 [00:04<00:01, 22.63it/s, loss=0.683, v_num=1, val_acc=0.758]
Epoch 96:  80%|████████  | 94/117 [00:04<00:01, 22.82it/s, loss=0.683, v_num=1, val_acc=0.758]
Epoch 96:  80%|████████  | 94/117 [00:04<00:01, 22.68it/s, loss=0.682, v_num=1, val_acc=0.758]
Epoch 96:  81%|████████  | 95/117 [00:04<00:00, 22.88it/s, loss=0.682, v_num=1, val_acc=0.758]
Epoch 96:  81%|████████  | 95/117 [00:04<00:00, 22.74it/s, loss=0.682, v_num=1, val_acc=0.758]
Epoch 96:  82%|████████▏ | 96/117 [00:04<00:00, 22.92it/s, loss=0.682, v_num=1, val_acc=0.758]
Epoch 96:  82%|████████▏ | 96/117 [00:04<00:00, 22.78it/s, loss=0.683, v_num=1, val_acc=0.758]
Epoch 96:  83%|████████▎ | 97/117 [00:04<00:00, 22.95it/s, loss=0.683, v_num=1, val_acc=0.758]
Epoch 96:  83%|████████▎ | 97/117 [00:04<00:00, 22.82it/s, loss=0.684, v_num=1, val_acc=0.758]

Validation: 0it [00:00, ?it/s]

Validation:   0%|          | 0/20 [00:00<?, ?it/s]

Validation DataLoader 0:   0%|          | 0/20 [00:00<?, ?it/s]

Validation DataLoader 0:   5%|▌         | 1/20 [00:00<00:00, 129.95it/s]
Epoch 96:  84%|████████▍ | 98/117 [00:05<00:00, 19.27it/s, loss=0.684, v_num=1, val_acc=0.758]

Validation DataLoader 0:  10%|█         | 2/20 [00:00<00:00, 50.29it/s]
Epoch 96:  85%|████████▍ | 99/117 [00:05<00:00, 19.35it/s, loss=0.684, v_num=1, val_acc=0.758]

Validation DataLoader 0:  15%|█▌        | 3/20 [00:00<00:00, 40.97it/s]
Epoch 96:  85%|████████▌ | 100/117 [00:05<00:00, 19.41it/s, loss=0.684, v_num=1, val_acc=0.758]

Validation DataLoader 0:  20%|██        | 4/20 [00:00<00:00, 38.63it/s]
Epoch 96:  86%|████████▋ | 101/117 [00:05<00:00, 19.49it/s, loss=0.684, v_num=1, val_acc=0.758]

Validation DataLoader 0:  25%|██▌       | 5/20 [00:00<00:00, 36.91it/s]
Epoch 96:  87%|████████▋ | 102/117 [00:05<00:00, 19.57it/s, loss=0.684, v_num=1, val_acc=0.758]

Validation DataLoader 0:  30%|███       | 6/20 [00:00<00:00, 35.77it/s]
Epoch 96:  88%|████████▊ | 103/117 [00:05<00:00, 19.64it/s, loss=0.684, v_num=1, val_acc=0.758]

Validation DataLoader 0:  35%|███▌      | 7/20 [00:00<00:00, 35.20it/s]
Epoch 96:  89%|████████▉ | 104/117 [00:05<00:00, 19.71it/s, loss=0.684, v_num=1, val_acc=0.758]

Validation DataLoader 0:  40%|████      | 8/20 [00:00<00:00, 34.69it/s]
Epoch 96:  90%|████████▉ | 105/117 [00:05<00:00, 19.78it/s, loss=0.684, v_num=1, val_acc=0.758]

Validation DataLoader 0:  45%|████▌     | 9/20 [00:00<00:00, 34.27it/s]
Epoch 96:  91%|█████████ | 106/117 [00:05<00:00, 19.85it/s, loss=0.684, v_num=1, val_acc=0.758]

Validation DataLoader 0:  50%|█████     | 10/20 [00:00<00:00, 34.03it/s]
Epoch 96:  91%|█████████▏| 107/117 [00:05<00:00, 19.92it/s, loss=0.684, v_num=1, val_acc=0.758]

Validation DataLoader 0:  55%|█████▌    | 11/20 [00:00<00:00, 33.81it/s]
Epoch 96:  92%|█████████▏| 108/117 [00:05<00:00, 19.99it/s, loss=0.684, v_num=1, val_acc=0.758]

Validation DataLoader 0:  60%|██████    | 12/20 [00:00<00:00, 33.59it/s]
Epoch 96:  93%|█████████▎| 109/117 [00:05<00:00, 20.06it/s, loss=0.684, v_num=1, val_acc=0.758]

Validation DataLoader 0:  65%|██████▌   | 13/20 [00:00<00:00, 33.44it/s]
Epoch 96:  94%|█████████▍| 110/117 [00:05<00:00, 20.12it/s, loss=0.684, v_num=1, val_acc=0.758]

Validation DataLoader 0:  70%|███████   | 14/20 [00:00<00:00, 33.31it/s]
Epoch 96:  95%|█████████▍| 111/117 [00:05<00:00, 20.19it/s, loss=0.684, v_num=1, val_acc=0.758]

Validation DataLoader 0:  75%|███████▌  | 15/20 [00:00<00:00, 33.19it/s]
Epoch 96:  96%|█████████▌| 112/117 [00:05<00:00, 20.26it/s, loss=0.684, v_num=1, val_acc=0.758]

Validation DataLoader 0:  80%|████████  | 16/20 [00:00<00:00, 33.06it/s]
Epoch 96:  97%|█████████▋| 113/117 [00:05<00:00, 20.32it/s, loss=0.684, v_num=1, val_acc=0.758]

Validation DataLoader 0:  85%|████████▌ | 17/20 [00:00<00:00, 32.95it/s]
Epoch 96:  97%|█████████▋| 114/117 [00:05<00:00, 20.38it/s, loss=0.684, v_num=1, val_acc=0.758]

Validation DataLoader 0:  90%|█████████ | 18/20 [00:00<00:00, 32.89it/s]
Epoch 96:  98%|█████████▊| 115/117 [00:05<00:00, 20.45it/s, loss=0.684, v_num=1, val_acc=0.758]

Validation DataLoader 0:  95%|█████████▌| 19/20 [00:00<00:00, 32.81it/s]
Epoch 96:  99%|█████████▉| 116/117 [00:05<00:00, 20.51it/s, loss=0.684, v_num=1, val_acc=0.758]

Validation DataLoader 0: 100%|██████████| 20/20 [00:00<00:00, 32.82it/s]
Epoch 96: 100%|██████████| 117/117 [00:05<00:00, 20.57it/s, loss=0.684, v_num=1, val_acc=0.758]
Epoch 96: 100%|██████████| 117/117 [00:05<00:00, 20.50it/s, loss=0.684, v_num=1, val_acc=0.757]


Epoch 96: 100%|██████████| 117/117 [00:05<00:00, 20.50it/s, loss=0.684, v_num=1, val_acc=0.757]
Epoch 96:   0%|          | 0/117 [00:00<?, ?it/s, loss=0.684, v_num=1, val_acc=0.757]
Epoch 97:   0%|          | 0/117 [00:00<?, ?it/s, loss=0.684, v_num=1, val_acc=0.757]
Epoch 97:   1%|          | 1/117 [00:00<01:47,  1.08it/s, loss=0.684, v_num=1, val_acc=0.757]
Epoch 97:   1%|          | 1/117 [00:00<01:50,  1.05it/s, loss=0.685, v_num=1, val_acc=0.757]
Epoch 97:   2%|▏         | 2/117 [00:00<00:55,  2.08it/s, loss=0.685, v_num=1, val_acc=0.757]
Epoch 97:   2%|▏         | 2/117 [00:00<00:56,  2.03it/s, loss=0.685, v_num=1, val_acc=0.757]
Epoch 97:   3%|▎         | 3/117 [00:00<00:37,  3.02it/s, loss=0.685, v_num=1, val_acc=0.757]
Epoch 97:   3%|▎         | 3/117 [00:01<00:38,  2.94it/s, loss=0.682, v_num=1, val_acc=0.757]
Epoch 97:   3%|▎         | 4/117 [00:01<00:29,  3.89it/s, loss=0.682, v_num=1, val_acc=0.757]
Epoch 97:   3%|▎         | 4/117 [00:01<00:29,  3.80it/s, loss=0.679, v_num=1, val_acc=0.757]
Epoch 97:   4%|▍         | 5/117 [00:01<00:23,  4.70it/s, loss=0.679, v_num=1, val_acc=0.757]
Epoch 97:   4%|▍         | 5/117 [00:01<00:24,  4.59it/s, loss=0.675, v_num=1, val_acc=0.757]
Epoch 97:   5%|▌         | 6/117 [00:01<00:20,  5.45it/s, loss=0.675, v_num=1, val_acc=0.757]
Epoch 97:   5%|▌         | 6/117 [00:01<00:20,  5.33it/s, loss=0.679, v_num=1, val_acc=0.757]
Epoch 97:   6%|▌         | 7/117 [00:01<00:17,  6.17it/s, loss=0.679, v_num=1, val_acc=0.757]
Epoch 97:   6%|▌         | 7/117 [00:01<00:18,  6.04it/s, loss=0.676, v_num=1, val_acc=0.757]
Epoch 97:   7%|▋         | 8/117 [00:01<00:15,  6.85it/s, loss=0.676, v_num=1, val_acc=0.757]
Epoch 97:   7%|▋         | 8/117 [00:01<00:16,  6.71it/s, loss=0.676, v_num=1, val_acc=0.757]
Epoch 97:   8%|▊         | 9/117 [00:01<00:14,  7.46it/s, loss=0.676, v_num=1, val_acc=0.757]
Epoch 97:   8%|▊         | 9/117 [00:01<00:14,  7.32it/s, loss=0.679, v_num=1, val_acc=0.757]
Epoch 97:   9%|▊         | 10/117 [00:01<00:13,  8.07it/s, loss=0.679, v_num=1, val_acc=0.757]
Epoch 97:   9%|▊         | 10/117 [00:01<00:13,  7.91it/s, loss=0.675, v_num=1, val_acc=0.757]
Epoch 97:   9%|▉         | 11/117 [00:01<00:12,  8.61it/s, loss=0.675, v_num=1, val_acc=0.757]
Epoch 97:   9%|▉         | 11/117 [00:01<00:12,  8.45it/s, loss=0.673, v_num=1, val_acc=0.757]
Epoch 97:  10%|█         | 12/117 [00:01<00:11,  9.16it/s, loss=0.673, v_num=1, val_acc=0.757]
Epoch 97:  10%|█         | 12/117 [00:01<00:11,  8.98it/s, loss=0.67, v_num=1, val_acc=0.757]
Epoch 97:  11%|█         | 13/117 [00:01<00:10,  9.67it/s, loss=0.67, v_num=1, val_acc=0.757]
Epoch 97:  11%|█         | 13/117 [00:01<00:10,  9.49it/s, loss=0.673, v_num=1, val_acc=0.757]
Epoch 97:  12%|█▏        | 14/117 [00:01<00:10, 10.15it/s, loss=0.673, v_num=1, val_acc=0.757]
Epoch 97:  12%|█▏        | 14/117 [00:01<00:10,  9.97it/s, loss=0.667, v_num=1, val_acc=0.757]
Epoch 97:  13%|█▎        | 15/117 [00:01<00:09, 10.62it/s, loss=0.667, v_num=1, val_acc=0.757]
Epoch 97:  13%|█▎        | 15/117 [00:01<00:09, 10.43it/s, loss=0.668, v_num=1, val_acc=0.757]
Epoch 97:  14%|█▎        | 16/117 [00:01<00:09, 11.07it/s, loss=0.668, v_num=1, val_acc=0.757]
Epoch 97:  14%|█▎        | 16/117 [00:01<00:09, 10.87it/s, loss=0.67, v_num=1, val_acc=0.757]
Epoch 97:  15%|█▍        | 17/117 [00:01<00:08, 11.48it/s, loss=0.67, v_num=1, val_acc=0.757]
Epoch 97:  15%|█▍        | 17/117 [00:01<00:08, 11.29it/s, loss=0.67, v_num=1, val_acc=0.757]
Epoch 97:  15%|█▌        | 18/117 [00:01<00:08, 11.88it/s, loss=0.67, v_num=1, val_acc=0.757]
Epoch 97:  15%|█▌        | 18/117 [00:01<00:08, 11.68it/s, loss=0.671, v_num=1, val_acc=0.757]
Epoch 97:  16%|█▌        | 19/117 [00:01<00:07, 12.25it/s, loss=0.671, v_num=1, val_acc=0.757]
Epoch 97:  16%|█▌        | 19/117 [00:01<00:08, 12.06it/s, loss=0.669, v_num=1, val_acc=0.757]
Epoch 97:  17%|█▋        | 20/117 [00:01<00:07, 12.62it/s, loss=0.669, v_num=1, val_acc=0.757]
Epoch 97:  17%|█▋        | 20/117 [00:01<00:07, 12.43it/s, loss=0.672, v_num=1, val_acc=0.757]
Epoch 97:  18%|█▊        | 21/117 [00:01<00:07, 12.98it/s, loss=0.672, v_num=1, val_acc=0.757]
Epoch 97:  18%|█▊        | 21/117 [00:01<00:07, 12.78it/s, loss=0.672, v_num=1, val_acc=0.757]
Epoch 97:  19%|█▉        | 22/117 [00:01<00:07, 13.31it/s, loss=0.672, v_num=1, val_acc=0.757]
Epoch 97:  19%|█▉        | 22/117 [00:01<00:07, 13.11it/s, loss=0.672, v_num=1, val_acc=0.757]
Epoch 97:  20%|█▉        | 23/117 [00:01<00:06, 13.64it/s, loss=0.672, v_num=1, val_acc=0.757]
Epoch 97:  20%|█▉        | 23/117 [00:01<00:06, 13.43it/s, loss=0.675, v_num=1, val_acc=0.757]
Epoch 97:  21%|██        | 24/117 [00:01<00:06, 13.95it/s, loss=0.675, v_num=1, val_acc=0.757]
Epoch 97:  21%|██        | 24/117 [00:01<00:06, 13.74it/s, loss=0.678, v_num=1, val_acc=0.757]
Epoch 97:  21%|██▏       | 25/117 [00:01<00:06, 14.24it/s, loss=0.678, v_num=1, val_acc=0.757]
Epoch 97:  21%|██▏       | 25/117 [00:01<00:06, 14.04it/s, loss=0.676, v_num=1, val_acc=0.757]
Epoch 97:  22%|██▏       | 26/117 [00:01<00:06, 14.53it/s, loss=0.676, v_num=1, val_acc=0.757]
Epoch 97:  22%|██▏       | 26/117 [00:01<00:06, 14.32it/s, loss=0.674, v_num=1, val_acc=0.757]
Epoch 97:  23%|██▎       | 27/117 [00:01<00:06, 14.80it/s, loss=0.674, v_num=1, val_acc=0.757]
Epoch 97:  23%|██▎       | 27/117 [00:01<00:06, 14.59it/s, loss=0.678, v_num=1, val_acc=0.757]
Epoch 97:  24%|██▍       | 28/117 [00:01<00:05, 15.07it/s, loss=0.678, v_num=1, val_acc=0.757]
Epoch 97:  24%|██▍       | 28/117 [00:01<00:05, 14.86it/s, loss=0.682, v_num=1, val_acc=0.757]
Epoch 97:  25%|██▍       | 29/117 [00:01<00:05, 15.32it/s, loss=0.682, v_num=1, val_acc=0.757]
Epoch 97:  25%|██▍       | 29/117 [00:01<00:05, 15.12it/s, loss=0.683, v_num=1, val_acc=0.757]
Epoch 97:  26%|██▌       | 30/117 [00:01<00:05, 15.57it/s, loss=0.683, v_num=1, val_acc=0.757]
Epoch 97:  26%|██▌       | 30/117 [00:01<00:05, 15.36it/s, loss=0.685, v_num=1, val_acc=0.757]
Epoch 97:  26%|██▋       | 31/117 [00:01<00:05, 15.80it/s, loss=0.685, v_num=1, val_acc=0.757]
Epoch 97:  26%|██▋       | 31/117 [00:01<00:05, 15.60it/s, loss=0.688, v_num=1, val_acc=0.757]
Epoch 97:  27%|██▋       | 32/117 [00:01<00:05, 16.03it/s, loss=0.688, v_num=1, val_acc=0.757]
Epoch 97:  27%|██▋       | 32/117 [00:02<00:05, 15.83it/s, loss=0.694, v_num=1, val_acc=0.757]
Epoch 97:  28%|██▊       | 33/117 [00:02<00:05, 16.26it/s, loss=0.694, v_num=1, val_acc=0.757]
Epoch 97:  28%|██▊       | 33/117 [00:02<00:05, 16.06it/s, loss=0.692, v_num=1, val_acc=0.757]
Epoch 97:  29%|██▉       | 34/117 [00:02<00:05, 16.47it/s, loss=0.692, v_num=1, val_acc=0.757]
Epoch 97:  29%|██▉       | 34/117 [00:02<00:05, 16.27it/s, loss=0.697, v_num=1, val_acc=0.757]
Epoch 97:  30%|██▉       | 35/117 [00:02<00:04, 16.68it/s, loss=0.697, v_num=1, val_acc=0.757]
Epoch 97:  30%|██▉       | 35/117 [00:02<00:04, 16.48it/s, loss=0.697, v_num=1, val_acc=0.757]
Epoch 97:  31%|███       | 36/117 [00:02<00:04, 16.88it/s, loss=0.697, v_num=1, val_acc=0.757]
Epoch 97:  31%|███       | 36/117 [00:02<00:04, 16.68it/s, loss=0.699, v_num=1, val_acc=0.757]
Epoch 97:  32%|███▏      | 37/117 [00:02<00:04, 17.07it/s, loss=0.699, v_num=1, val_acc=0.757]
Epoch 97:  32%|███▏      | 37/117 [00:02<00:04, 16.88it/s, loss=0.699, v_num=1, val_acc=0.757]
Epoch 97:  32%|███▏      | 38/117 [00:02<00:04, 17.26it/s, loss=0.699, v_num=1, val_acc=0.757]
Epoch 97:  32%|███▏      | 38/117 [00:02<00:04, 17.06it/s, loss=0.698, v_num=1, val_acc=0.757]
Epoch 97:  33%|███▎      | 39/117 [00:02<00:04, 17.44it/s, loss=0.698, v_num=1, val_acc=0.757]
Epoch 97:  33%|███▎      | 39/117 [00:02<00:04, 17.25it/s, loss=0.698, v_num=1, val_acc=0.757]
Epoch 97:  34%|███▍      | 40/117 [00:02<00:04, 17.62it/s, loss=0.698, v_num=1, val_acc=0.757]
Epoch 97:  34%|███▍      | 40/117 [00:02<00:04, 17.43it/s, loss=0.691, v_num=1, val_acc=0.757]
Epoch 97:  35%|███▌      | 41/117 [00:02<00:04, 17.79it/s, loss=0.691, v_num=1, val_acc=0.757]
Epoch 97:  35%|███▌      | 41/117 [00:02<00:04, 17.60it/s, loss=0.688, v_num=1, val_acc=0.757]
Epoch 97:  36%|███▌      | 42/117 [00:02<00:04, 17.95it/s, loss=0.688, v_num=1, val_acc=0.757]
Epoch 97:  36%|███▌      | 42/117 [00:02<00:04, 17.76it/s, loss=0.687, v_num=1, val_acc=0.757]
Epoch 97:  37%|███▋      | 43/117 [00:02<00:04, 18.11it/s, loss=0.687, v_num=1, val_acc=0.757]
Epoch 97:  37%|███▋      | 43/117 [00:02<00:04, 17.92it/s, loss=0.689, v_num=1, val_acc=0.757]
Epoch 97:  38%|███▊      | 44/117 [00:02<00:03, 18.27it/s, loss=0.689, v_num=1, val_acc=0.757]
Epoch 97:  38%|███▊      | 44/117 [00:02<00:04, 18.08it/s, loss=0.685, v_num=1, val_acc=0.757]
Epoch 97:  38%|███▊      | 45/117 [00:02<00:03, 18.42it/s, loss=0.685, v_num=1, val_acc=0.757]
Epoch 97:  38%|███▊      | 45/117 [00:02<00:03, 18.23it/s, loss=0.688, v_num=1, val_acc=0.757]
Epoch 97:  39%|███▉      | 46/117 [00:02<00:03, 18.57it/s, loss=0.688, v_num=1, val_acc=0.757]
Epoch 97:  39%|███▉      | 46/117 [00:02<00:03, 18.38it/s, loss=0.695, v_num=1, val_acc=0.757]
Epoch 97:  40%|████      | 47/117 [00:02<00:03, 18.71it/s, loss=0.695, v_num=1, val_acc=0.757]
Epoch 97:  40%|████      | 47/117 [00:02<00:03, 18.53it/s, loss=0.7, v_num=1, val_acc=0.757]
Epoch 97:  41%|████      | 48/117 [00:02<00:03, 18.86it/s, loss=0.7, v_num=1, val_acc=0.757]
Epoch 97:  41%|████      | 48/117 [00:02<00:03, 18.67it/s, loss=0.695, v_num=1, val_acc=0.757]
Epoch 97:  42%|████▏     | 49/117 [00:02<00:03, 18.99it/s, loss=0.695, v_num=1, val_acc=0.757]
Epoch 97:  42%|████▏     | 49/117 [00:02<00:03, 18.81it/s, loss=0.691, v_num=1, val_acc=0.757]
Epoch 97:  43%|████▎     | 50/117 [00:02<00:03, 19.13it/s, loss=0.691, v_num=1, val_acc=0.757]
Epoch 97:  43%|████▎     | 50/117 [00:02<00:03, 18.94it/s, loss=0.693, v_num=1, val_acc=0.757]
Epoch 97:  44%|████▎     | 51/117 [00:02<00:03, 19.26it/s, loss=0.693, v_num=1, val_acc=0.757]
Epoch 97:  44%|████▎     | 51/117 [00:02<00:03, 19.07it/s, loss=0.684, v_num=1, val_acc=0.757]
Epoch 97:  44%|████▍     | 52/117 [00:02<00:03, 19.38it/s, loss=0.684, v_num=1, val_acc=0.757]
Epoch 97:  44%|████▍     | 52/117 [00:02<00:03, 19.20it/s, loss=0.678, v_num=1, val_acc=0.757]
Epoch 97:  45%|████▌     | 53/117 [00:02<00:03, 19.50it/s, loss=0.678, v_num=1, val_acc=0.757]
Epoch 97:  45%|████▌     | 53/117 [00:02<00:03, 19.32it/s, loss=0.681, v_num=1, val_acc=0.757]
Epoch 97:  46%|████▌     | 54/117 [00:02<00:03, 19.62it/s, loss=0.681, v_num=1, val_acc=0.757]
Epoch 97:  46%|████▌     | 54/117 [00:02<00:03, 19.44it/s, loss=0.679, v_num=1, val_acc=0.757]
Epoch 97:  47%|████▋     | 55/117 [00:02<00:03, 19.73it/s, loss=0.679, v_num=1, val_acc=0.757]
Epoch 97:  47%|████▋     | 55/117 [00:02<00:03, 19.56it/s, loss=0.678, v_num=1, val_acc=0.757]
Epoch 97:  48%|████▊     | 56/117 [00:02<00:03, 19.85it/s, loss=0.678, v_num=1, val_acc=0.757]
Epoch 97:  48%|████▊     | 56/117 [00:02<00:03, 19.67it/s, loss=0.672, v_num=1, val_acc=0.757]
Epoch 97:  49%|████▊     | 57/117 [00:02<00:03, 19.96it/s, loss=0.672, v_num=1, val_acc=0.757]
Epoch 97:  49%|████▊     | 57/117 [00:02<00:03, 19.78it/s, loss=0.666, v_num=1, val_acc=0.757]
Epoch 97:  50%|████▉     | 58/117 [00:02<00:02, 20.07it/s, loss=0.666, v_num=1, val_acc=0.757]
Epoch 97:  50%|████▉     | 58/117 [00:02<00:02, 19.90it/s, loss=0.67, v_num=1, val_acc=0.757]
Epoch 97:  50%|█████     | 59/117 [00:02<00:02, 20.17it/s, loss=0.67, v_num=1, val_acc=0.757]
Epoch 97:  50%|█████     | 59/117 [00:02<00:02, 20.00it/s, loss=0.67, v_num=1, val_acc=0.757]
Epoch 97:  51%|█████▏    | 60/117 [00:02<00:02, 20.28it/s, loss=0.67, v_num=1, val_acc=0.757]
Epoch 97:  51%|█████▏    | 60/117 [00:02<00:02, 20.11it/s, loss=0.672, v_num=1, val_acc=0.757]
Epoch 97:  52%|█████▏    | 61/117 [00:02<00:02, 20.38it/s, loss=0.672, v_num=1, val_acc=0.757]
Epoch 97:  52%|█████▏    | 61/117 [00:03<00:02, 20.21it/s, loss=0.672, v_num=1, val_acc=0.757]
Epoch 97:  53%|█████▎    | 62/117 [00:03<00:02, 20.48it/s, loss=0.672, v_num=1, val_acc=0.757]
Epoch 97:  53%|█████▎    | 62/117 [00:03<00:02, 20.31it/s, loss=0.678, v_num=1, val_acc=0.757]
Epoch 97:  54%|█████▍    | 63/117 [00:03<00:02, 20.57it/s, loss=0.678, v_num=1, val_acc=0.757]
Epoch 97:  54%|█████▍    | 63/117 [00:03<00:02, 20.41it/s, loss=0.673, v_num=1, val_acc=0.757]
Epoch 97:  55%|█████▍    | 64/117 [00:03<00:02, 20.67it/s, loss=0.673, v_num=1, val_acc=0.757]
Epoch 97:  55%|█████▍    | 64/117 [00:03<00:02, 20.50it/s, loss=0.68, v_num=1, val_acc=0.757]
Epoch 97:  56%|█████▌    | 65/117 [00:03<00:02, 20.76it/s, loss=0.68, v_num=1, val_acc=0.757]
Epoch 97:  56%|█████▌    | 65/117 [00:03<00:02, 20.60it/s, loss=0.679, v_num=1, val_acc=0.757]
Epoch 97:  56%|█████▋    | 66/117 [00:03<00:02, 20.85it/s, loss=0.679, v_num=1, val_acc=0.757]
Epoch 97:  56%|█████▋    | 66/117 [00:03<00:02, 20.69it/s, loss=0.677, v_num=1, val_acc=0.757]
Epoch 97:  57%|█████▋    | 67/117 [00:03<00:02, 20.94it/s, loss=0.677, v_num=1, val_acc=0.757]
Epoch 97:  57%|█████▋    | 67/117 [00:03<00:02, 20.78it/s, loss=0.678, v_num=1, val_acc=0.757]
Epoch 97:  58%|█████▊    | 68/117 [00:03<00:02, 21.03it/s, loss=0.678, v_num=1, val_acc=0.757]
Epoch 97:  58%|█████▊    | 68/117 [00:03<00:02, 20.87it/s, loss=0.68, v_num=1, val_acc=0.757]
Epoch 97:  59%|█████▉    | 69/117 [00:03<00:02, 21.11it/s, loss=0.68, v_num=1, val_acc=0.757]
Epoch 97:  59%|█████▉    | 69/117 [00:03<00:02, 20.95it/s, loss=0.682, v_num=1, val_acc=0.757]
Epoch 97:  60%|█████▉    | 70/117 [00:03<00:02, 21.19it/s, loss=0.682, v_num=1, val_acc=0.757]
Epoch 97:  60%|█████▉    | 70/117 [00:03<00:02, 21.03it/s, loss=0.683, v_num=1, val_acc=0.757]
Epoch 97:  61%|██████    | 71/117 [00:03<00:02, 21.28it/s, loss=0.683, v_num=1, val_acc=0.757]
Epoch 97:  61%|██████    | 71/117 [00:03<00:02, 21.12it/s, loss=0.688, v_num=1, val_acc=0.757]
Epoch 97:  62%|██████▏   | 72/117 [00:03<00:02, 21.36it/s, loss=0.688, v_num=1, val_acc=0.757]
Epoch 97:  62%|██████▏   | 72/117 [00:03<00:02, 21.20it/s, loss=0.69, v_num=1, val_acc=0.757]
Epoch 97:  62%|██████▏   | 73/117 [00:03<00:02, 21.44it/s, loss=0.69, v_num=1, val_acc=0.757]
Epoch 97:  62%|██████▏   | 73/117 [00:03<00:02, 21.28it/s, loss=0.689, v_num=1, val_acc=0.757]
Epoch 97:  63%|██████▎   | 74/117 [00:03<00:01, 21.51it/s, loss=0.689, v_num=1, val_acc=0.757]
Epoch 97:  63%|██████▎   | 74/117 [00:03<00:02, 21.35it/s, loss=0.686, v_num=1, val_acc=0.757]
Epoch 97:  64%|██████▍   | 75/117 [00:03<00:01, 21.56it/s, loss=0.686, v_num=1, val_acc=0.757]
Epoch 97:  64%|██████▍   | 75/117 [00:03<00:01, 21.41it/s, loss=0.68, v_num=1, val_acc=0.757]
Epoch 97:  65%|██████▍   | 76/117 [00:03<00:01, 21.64it/s, loss=0.68, v_num=1, val_acc=0.757]
Epoch 97:  65%|██████▍   | 76/117 [00:03<00:01, 21.49it/s, loss=0.684, v_num=1, val_acc=0.757]
Epoch 97:  66%|██████▌   | 77/117 [00:03<00:01, 21.68it/s, loss=0.684, v_num=1, val_acc=0.757]
Epoch 97:  66%|██████▌   | 77/117 [00:03<00:01, 21.54it/s, loss=0.692, v_num=1, val_acc=0.757]
Epoch 97:  67%|██████▋   | 78/117 [00:03<00:01, 21.73it/s, loss=0.692, v_num=1, val_acc=0.757]
Epoch 97:  67%|██████▋   | 78/117 [00:03<00:01, 21.59it/s, loss=0.69, v_num=1, val_acc=0.757]
Epoch 97:  68%|██████▊   | 79/117 [00:03<00:01, 21.79it/s, loss=0.69, v_num=1, val_acc=0.757]
Epoch 97:  68%|██████▊   | 79/117 [00:03<00:01, 21.65it/s, loss=0.69, v_num=1, val_acc=0.757]
Epoch 97:  68%|██████▊   | 80/117 [00:03<00:01, 21.86it/s, loss=0.69, v_num=1, val_acc=0.757]
Epoch 97:  68%|██████▊   | 80/117 [00:03<00:01, 21.71it/s, loss=0.692, v_num=1, val_acc=0.757]
Epoch 97:  69%|██████▉   | 81/117 [00:03<00:01, 21.93it/s, loss=0.692, v_num=1, val_acc=0.757]
Epoch 97:  69%|██████▉   | 81/117 [00:03<00:01, 21.78it/s, loss=0.694, v_num=1, val_acc=0.757]
Epoch 97:  70%|███████   | 82/117 [00:03<00:01, 21.98it/s, loss=0.694, v_num=1, val_acc=0.757]
Epoch 97:  70%|███████   | 82/117 [00:03<00:01, 21.84it/s, loss=0.693, v_num=1, val_acc=0.757]
Epoch 97:  71%|███████   | 83/117 [00:03<00:01, 22.05it/s, loss=0.693, v_num=1, val_acc=0.757]
Epoch 97:  71%|███████   | 83/117 [00:03<00:01, 21.90it/s, loss=0.693, v_num=1, val_acc=0.757]
Epoch 97:  72%|███████▏  | 84/117 [00:03<00:01, 22.12it/s, loss=0.693, v_num=1, val_acc=0.757]
Epoch 97:  72%|███████▏  | 84/117 [00:03<00:01, 21.97it/s, loss=0.691, v_num=1, val_acc=0.757]
Epoch 97:  73%|███████▎  | 85/117 [00:03<00:01, 22.18it/s, loss=0.691, v_num=1, val_acc=0.757]
Epoch 97:  73%|███████▎  | 85/117 [00:03<00:01, 22.03it/s, loss=0.688, v_num=1, val_acc=0.757]
Epoch 97:  74%|███████▎  | 86/117 [00:03<00:01, 22.24it/s, loss=0.688, v_num=1, val_acc=0.757]
Epoch 97:  74%|███████▎  | 86/117 [00:03<00:01, 22.10it/s, loss=0.684, v_num=1, val_acc=0.757]
Epoch 97:  74%|███████▍  | 87/117 [00:03<00:01, 22.30it/s, loss=0.684, v_num=1, val_acc=0.757]
Epoch 97:  74%|███████▍  | 87/117 [00:03<00:01, 22.16it/s, loss=0.678, v_num=1, val_acc=0.757]
Epoch 97:  75%|███████▌  | 88/117 [00:03<00:01, 22.36it/s, loss=0.678, v_num=1, val_acc=0.757]
Epoch 97:  75%|███████▌  | 88/117 [00:03<00:01, 22.22it/s, loss=0.682, v_num=1, val_acc=0.757]
Epoch 97:  76%|███████▌  | 89/117 [00:03<00:01, 22.42it/s, loss=0.682, v_num=1, val_acc=0.757]
Epoch 97:  76%|███████▌  | 89/117 [00:03<00:01, 22.28it/s, loss=0.68, v_num=1, val_acc=0.757]
Epoch 97:  77%|███████▋  | 90/117 [00:04<00:01, 22.48it/s, loss=0.68, v_num=1, val_acc=0.757]
Epoch 97:  77%|███████▋  | 90/117 [00:04<00:01, 22.34it/s, loss=0.679, v_num=1, val_acc=0.757]
Epoch 97:  78%|███████▊  | 91/117 [00:04<00:01, 22.54it/s, loss=0.679, v_num=1, val_acc=0.757]
Epoch 97:  78%|███████▊  | 91/117 [00:04<00:01, 22.40it/s, loss=0.678, v_num=1, val_acc=0.757]
Epoch 97:  79%|███████▊  | 92/117 [00:04<00:01, 22.59it/s, loss=0.678, v_num=1, val_acc=0.757]
Epoch 97:  79%|███████▊  | 92/117 [00:04<00:01, 22.45it/s, loss=0.679, v_num=1, val_acc=0.757]
Epoch 97:  79%|███████▉  | 93/117 [00:04<00:01, 22.64it/s, loss=0.679, v_num=1, val_acc=0.757]
Epoch 97:  79%|███████▉  | 93/117 [00:04<00:01, 22.51it/s, loss=0.686, v_num=1, val_acc=0.757]
Epoch 97:  80%|████████  | 94/117 [00:04<00:01, 22.70it/s, loss=0.686, v_num=1, val_acc=0.757]
Epoch 97:  80%|████████  | 94/117 [00:04<00:01, 22.56it/s, loss=0.688, v_num=1, val_acc=0.757]
Epoch 97:  81%|████████  | 95/117 [00:04<00:00, 22.75it/s, loss=0.688, v_num=1, val_acc=0.757]
Epoch 97:  81%|████████  | 95/117 [00:04<00:00, 22.61it/s, loss=0.691, v_num=1, val_acc=0.757]
Epoch 97:  82%|████████▏ | 96/117 [00:04<00:00, 22.80it/s, loss=0.691, v_num=1, val_acc=0.757]
Epoch 97:  82%|████████▏ | 96/117 [00:04<00:00, 22.66it/s, loss=0.687, v_num=1, val_acc=0.757]
Epoch 97:  83%|████████▎ | 97/117 [00:04<00:00, 22.85it/s, loss=0.687, v_num=1, val_acc=0.757]
Epoch 97:  83%|████████▎ | 97/117 [00:04<00:00, 22.72it/s, loss=0.68, v_num=1, val_acc=0.757]

Validation: 0it [00:00, ?it/s]

Validation:   0%|          | 0/20 [00:00<?, ?it/s]

Validation DataLoader 0:   0%|          | 0/20 [00:00<?, ?it/s]

Validation DataLoader 0:   5%|▌         | 1/20 [00:00<00:00, 182.04it/s]
Epoch 97:  84%|████████▍ | 98/117 [00:05<00:00, 19.15it/s, loss=0.68, v_num=1, val_acc=0.757]

Validation DataLoader 0:  10%|█         | 2/20 [00:00<00:00, 56.14it/s]
Epoch 97:  85%|████████▍ | 99/117 [00:05<00:00, 19.23it/s, loss=0.68, v_num=1, val_acc=0.757]

Validation DataLoader 0:  15%|█▌        | 3/20 [00:00<00:00, 44.54it/s]
Epoch 97:  85%|████████▌ | 100/117 [00:05<00:00, 19.31it/s, loss=0.68, v_num=1, val_acc=0.757]

Validation DataLoader 0:  20%|██        | 4/20 [00:00<00:00, 40.48it/s]
Epoch 97:  86%|████████▋ | 101/117 [00:05<00:00, 19.38it/s, loss=0.68, v_num=1, val_acc=0.757]

Validation DataLoader 0:  25%|██▌       | 5/20 [00:00<00:00, 38.33it/s]
Epoch 97:  87%|████████▋ | 102/117 [00:05<00:00, 19.45it/s, loss=0.68, v_num=1, val_acc=0.757]

Validation DataLoader 0:  30%|███       | 6/20 [00:00<00:00, 37.04it/s]
Epoch 97:  88%|████████▊ | 103/117 [00:05<00:00, 19.53it/s, loss=0.68, v_num=1, val_acc=0.757]

Validation DataLoader 0:  35%|███▌      | 7/20 [00:00<00:00, 36.15it/s]
Epoch 97:  89%|████████▉ | 104/117 [00:05<00:00, 19.60it/s, loss=0.68, v_num=1, val_acc=0.757]

Validation DataLoader 0:  40%|████      | 8/20 [00:00<00:00, 35.51it/s]
Epoch 97:  90%|████████▉ | 105/117 [00:05<00:00, 19.67it/s, loss=0.68, v_num=1, val_acc=0.757]

Validation DataLoader 0:  45%|████▌     | 9/20 [00:00<00:00, 34.99it/s]
Epoch 97:  91%|█████████ | 106/117 [00:05<00:00, 19.74it/s, loss=0.68, v_num=1, val_acc=0.757]

Validation DataLoader 0:  50%|█████     | 10/20 [00:00<00:00, 34.65it/s]
Epoch 97:  91%|█████████▏| 107/117 [00:05<00:00, 19.81it/s, loss=0.68, v_num=1, val_acc=0.757]

Validation DataLoader 0:  55%|█████▌    | 11/20 [00:00<00:00, 34.37it/s]
Epoch 97:  92%|█████████▏| 108/117 [00:05<00:00, 19.88it/s, loss=0.68, v_num=1, val_acc=0.757]

Validation DataLoader 0:  60%|██████    | 12/20 [00:00<00:00, 34.14it/s]
Epoch 97:  93%|█████████▎| 109/117 [00:05<00:00, 19.95it/s, loss=0.68, v_num=1, val_acc=0.757]

Validation DataLoader 0:  65%|██████▌   | 13/20 [00:00<00:00, 33.92it/s]
Epoch 97:  94%|█████████▍| 110/117 [00:05<00:00, 20.02it/s, loss=0.68, v_num=1, val_acc=0.757]

Validation DataLoader 0:  70%|███████   | 14/20 [00:00<00:00, 33.74it/s]
Epoch 97:  95%|█████████▍| 111/117 [00:05<00:00, 20.08it/s, loss=0.68, v_num=1, val_acc=0.757]

Validation DataLoader 0:  75%|███████▌  | 15/20 [00:00<00:00, 33.58it/s]
Epoch 97:  96%|█████████▌| 112/117 [00:05<00:00, 20.15it/s, loss=0.68, v_num=1, val_acc=0.757]

Validation DataLoader 0:  80%|████████  | 16/20 [00:00<00:00, 33.44it/s]
Epoch 97:  97%|█████████▋| 113/117 [00:05<00:00, 20.21it/s, loss=0.68, v_num=1, val_acc=0.757]

Validation DataLoader 0:  85%|████████▌ | 17/20 [00:00<00:00, 33.32it/s]
Epoch 97:  97%|█████████▋| 114/117 [00:05<00:00, 20.28it/s, loss=0.68, v_num=1, val_acc=0.757]

Validation DataLoader 0:  90%|█████████ | 18/20 [00:00<00:00, 33.22it/s]
Epoch 97:  98%|█████████▊| 115/117 [00:05<00:00, 20.34it/s, loss=0.68, v_num=1, val_acc=0.757]

Validation DataLoader 0:  95%|█████████▌| 19/20 [00:00<00:00, 33.12it/s]
Epoch 97:  99%|█████████▉| 116/117 [00:05<00:00, 20.40it/s, loss=0.68, v_num=1, val_acc=0.757]

Validation DataLoader 0: 100%|██████████| 20/20 [00:00<00:00, 33.11it/s]
Epoch 97: 100%|██████████| 117/117 [00:05<00:00, 20.47it/s, loss=0.68, v_num=1, val_acc=0.757]
Epoch 97: 100%|██████████| 117/117 [00:05<00:00, 20.40it/s, loss=0.68, v_num=1, val_acc=0.757]


Epoch 97: 100%|██████████| 117/117 [00:05<00:00, 20.39it/s, loss=0.68, v_num=1, val_acc=0.757]
Epoch 97:   0%|          | 0/117 [00:00<?, ?it/s, loss=0.68, v_num=1, val_acc=0.757]
Epoch 98:   0%|          | 0/117 [00:00<?, ?it/s, loss=0.68, v_num=1, val_acc=0.757]
Epoch 98:   1%|          | 1/117 [00:00<01:45,  1.10it/s, loss=0.68, v_num=1, val_acc=0.757]
Epoch 98:   1%|          | 1/117 [00:00<01:48,  1.07it/s, loss=0.68, v_num=1, val_acc=0.757]
Epoch 98:   2%|▏         | 2/117 [00:00<00:54,  2.11it/s, loss=0.68, v_num=1, val_acc=0.757]
Epoch 98:   2%|▏         | 2/117 [00:00<00:55,  2.06it/s, loss=0.686, v_num=1, val_acc=0.757]
Epoch 98:   3%|▎         | 3/117 [00:00<00:37,  3.05it/s, loss=0.686, v_num=1, val_acc=0.757]
Epoch 98:   3%|▎         | 3/117 [00:01<00:38,  2.97it/s, loss=0.692, v_num=1, val_acc=0.757]
Epoch 98:   3%|▎         | 4/117 [00:01<00:28,  3.93it/s, loss=0.692, v_num=1, val_acc=0.757]
Epoch 98:   3%|▎         | 4/117 [00:01<00:29,  3.83it/s, loss=0.691, v_num=1, val_acc=0.757]
Epoch 98:   4%|▍         | 5/117 [00:01<00:23,  4.75it/s, loss=0.691, v_num=1, val_acc=0.757]
Epoch 98:   4%|▍         | 5/117 [00:01<00:24,  4.64it/s, loss=0.689, v_num=1, val_acc=0.757]
Epoch 98:   5%|▌         | 6/117 [00:01<00:20,  5.52it/s, loss=0.689, v_num=1, val_acc=0.757]
Epoch 98:   5%|▌         | 6/117 [00:01<00:20,  5.39it/s, loss=0.69, v_num=1, val_acc=0.757]
Epoch 98:   6%|▌         | 7/117 [00:01<00:17,  6.24it/s, loss=0.69, v_num=1, val_acc=0.757]
Epoch 98:   6%|▌         | 7/117 [00:01<00:18,  6.10it/s, loss=0.69, v_num=1, val_acc=0.757]
Epoch 98:   7%|▋         | 8/117 [00:01<00:15,  6.92it/s, loss=0.69, v_num=1, val_acc=0.757]
Epoch 98:   7%|▋         | 8/117 [00:01<00:16,  6.77it/s, loss=0.696, v_num=1, val_acc=0.757]
Epoch 98:   8%|▊         | 9/117 [00:01<00:14,  7.56it/s, loss=0.696, v_num=1, val_acc=0.757]
Epoch 98:   8%|▊         | 9/117 [00:01<00:14,  7.40it/s, loss=0.696, v_num=1, val_acc=0.757]
Epoch 98:   9%|▊         | 10/117 [00:01<00:13,  8.16it/s, loss=0.696, v_num=1, val_acc=0.757]
Epoch 98:   9%|▊         | 10/117 [00:01<00:13,  7.99it/s, loss=0.695, v_num=1, val_acc=0.757]
Epoch 98:   9%|▉         | 11/117 [00:01<00:12,  8.72it/s, loss=0.695, v_num=1, val_acc=0.757]
Epoch 98:   9%|▉         | 11/117 [00:01<00:12,  8.55it/s, loss=0.692, v_num=1, val_acc=0.757]
Epoch 98:  10%|█         | 12/117 [00:01<00:11,  9.26it/s, loss=0.692, v_num=1, val_acc=0.757]
Epoch 98:  10%|█         | 12/117 [00:01<00:11,  9.08it/s, loss=0.693, v_num=1, val_acc=0.757]
Epoch 98:  11%|█         | 13/117 [00:01<00:10,  9.78it/s, loss=0.693, v_num=1, val_acc=0.757]
Epoch 98:  11%|█         | 13/117 [00:01<00:10,  9.60it/s, loss=0.698, v_num=1, val_acc=0.757]
Epoch 98:  12%|█▏        | 14/117 [00:01<00:10, 10.27it/s, loss=0.698, v_num=1, val_acc=0.757]
Epoch 98:  12%|█▏        | 14/117 [00:01<00:10, 10.08it/s, loss=0.7, v_num=1, val_acc=0.757]
Epoch 98:  13%|█▎        | 15/117 [00:01<00:09, 10.73it/s, loss=0.7, v_num=1, val_acc=0.757]
Epoch 98:  13%|█▎        | 15/117 [00:01<00:09, 10.54it/s, loss=0.701, v_num=1, val_acc=0.757]
Epoch 98:  14%|█▎        | 16/117 [00:01<00:09, 11.18it/s, loss=0.701, v_num=1, val_acc=0.757]
Epoch 98:  14%|█▎        | 16/117 [00:01<00:09, 10.98it/s, loss=0.696, v_num=1, val_acc=0.757]
Epoch 98:  15%|█▍        | 17/117 [00:01<00:08, 11.60it/s, loss=0.696, v_num=1, val_acc=0.757]
Epoch 98:  15%|█▍        | 17/117 [00:01<00:08, 11.40it/s, loss=0.695, v_num=1, val_acc=0.757]
Epoch 98:  15%|█▌        | 18/117 [00:01<00:08, 11.99it/s, loss=0.695, v_num=1, val_acc=0.757]
Epoch 98:  15%|█▌        | 18/117 [00:01<00:08, 11.79it/s, loss=0.694, v_num=1, val_acc=0.757]
Epoch 98:  16%|█▌        | 19/117 [00:01<00:07, 12.38it/s, loss=0.694, v_num=1, val_acc=0.757]
Epoch 98:  16%|█▌        | 19/117 [00:01<00:08, 12.17it/s, loss=0.697, v_num=1, val_acc=0.757]
Epoch 98:  17%|█▋        | 20/117 [00:01<00:07, 12.75it/s, loss=0.697, v_num=1, val_acc=0.757]
Epoch 98:  17%|█▋        | 20/117 [00:01<00:07, 12.54it/s, loss=0.702, v_num=1, val_acc=0.757]
Epoch 98:  18%|█▊        | 21/117 [00:01<00:07, 13.10it/s, loss=0.702, v_num=1, val_acc=0.757]
Epoch 98:  18%|█▊        | 21/117 [00:01<00:07, 12.89it/s, loss=0.698, v_num=1, val_acc=0.757]
Epoch 98:  19%|█▉        | 22/117 [00:01<00:07, 13.43it/s, loss=0.698, v_num=1, val_acc=0.757]
Epoch 98:  19%|█▉        | 22/117 [00:01<00:07, 13.23it/s, loss=0.693, v_num=1, val_acc=0.757]
Epoch 98:  20%|█▉        | 23/117 [00:01<00:06, 13.75it/s, loss=0.693, v_num=1, val_acc=0.757]
Epoch 98:  20%|█▉        | 23/117 [00:01<00:06, 13.55it/s, loss=0.682, v_num=1, val_acc=0.757]
Epoch 98:  21%|██        | 24/117 [00:01<00:06, 14.06it/s, loss=0.682, v_num=1, val_acc=0.757]
Epoch 98:  21%|██        | 24/117 [00:01<00:06, 13.86it/s, loss=0.682, v_num=1, val_acc=0.757]
Epoch 98:  21%|██▏       | 25/117 [00:01<00:06, 14.36it/s, loss=0.682, v_num=1, val_acc=0.757]
Epoch 98:  21%|██▏       | 25/117 [00:01<00:06, 14.15it/s, loss=0.681, v_num=1, val_acc=0.757]
Epoch 98:  22%|██▏       | 26/117 [00:01<00:06, 14.64it/s, loss=0.681, v_num=1, val_acc=0.757]
Epoch 98:  22%|██▏       | 26/117 [00:01<00:06, 14.44it/s, loss=0.681, v_num=1, val_acc=0.757]
Epoch 98:  23%|██▎       | 27/117 [00:01<00:06, 14.92it/s, loss=0.681, v_num=1, val_acc=0.757]
Epoch 98:  23%|██▎       | 27/117 [00:01<00:06, 14.71it/s, loss=0.677, v_num=1, val_acc=0.757]
Epoch 98:  24%|██▍       | 28/117 [00:01<00:05, 15.18it/s, loss=0.677, v_num=1, val_acc=0.757]
Epoch 98:  24%|██▍       | 28/117 [00:01<00:05, 14.97it/s, loss=0.679, v_num=1, val_acc=0.757]
Epoch 98:  25%|██▍       | 29/117 [00:01<00:05, 15.44it/s, loss=0.679, v_num=1, val_acc=0.757]
Epoch 98:  25%|██▍       | 29/117 [00:01<00:05, 15.23it/s, loss=0.681, v_num=1, val_acc=0.757]
Epoch 98:  26%|██▌       | 30/117 [00:01<00:05, 15.68it/s, loss=0.681, v_num=1, val_acc=0.757]
Epoch 98:  26%|██▌       | 30/117 [00:01<00:05, 15.47it/s, loss=0.68, v_num=1, val_acc=0.757]
Epoch 98:  26%|██▋       | 31/117 [00:01<00:05, 15.90it/s, loss=0.68, v_num=1, val_acc=0.757]
Epoch 98:  26%|██▋       | 31/117 [00:01<00:05, 15.70it/s, loss=0.682, v_num=1, val_acc=0.757]
Epoch 98:  27%|██▋       | 32/117 [00:01<00:05, 16.13it/s, loss=0.682, v_num=1, val_acc=0.757]
Epoch 98:  27%|██▋       | 32/117 [00:02<00:05, 15.93it/s, loss=0.684, v_num=1, val_acc=0.757]
Epoch 98:  28%|██▊       | 33/117 [00:02<00:05, 16.35it/s, loss=0.684, v_num=1, val_acc=0.757]
Epoch 98:  28%|██▊       | 33/117 [00:02<00:05, 16.15it/s, loss=0.676, v_num=1, val_acc=0.757]
Epoch 98:  29%|██▉       | 34/117 [00:02<00:05, 16.57it/s, loss=0.676, v_num=1, val_acc=0.757]
Epoch 98:  29%|██▉       | 34/117 [00:02<00:05, 16.37it/s, loss=0.681, v_num=1, val_acc=0.757]
Epoch 98:  30%|██▉       | 35/117 [00:02<00:04, 16.77it/s, loss=0.681, v_num=1, val_acc=0.757]
Epoch 98:  30%|██▉       | 35/117 [00:02<00:04, 16.57it/s, loss=0.683, v_num=1, val_acc=0.757]
Epoch 98:  31%|███       | 36/117 [00:02<00:04, 16.97it/s, loss=0.683, v_num=1, val_acc=0.757]
Epoch 98:  31%|███       | 36/117 [00:02<00:04, 16.77it/s, loss=0.681, v_num=1, val_acc=0.757]
Epoch 98:  32%|███▏      | 37/117 [00:02<00:04, 17.17it/s, loss=0.681, v_num=1, val_acc=0.757]
Epoch 98:  32%|███▏      | 37/117 [00:02<00:04, 16.97it/s, loss=0.682, v_num=1, val_acc=0.757]
Epoch 98:  32%|███▏      | 38/117 [00:02<00:04, 17.35it/s, loss=0.682, v_num=1, val_acc=0.757]
Epoch 98:  32%|███▏      | 38/117 [00:02<00:04, 17.15it/s, loss=0.682, v_num=1, val_acc=0.757]
Epoch 98:  33%|███▎      | 39/117 [00:02<00:04, 17.53it/s, loss=0.682, v_num=1, val_acc=0.757]
Epoch 98:  33%|███▎      | 39/117 [00:02<00:04, 17.33it/s, loss=0.686, v_num=1, val_acc=0.757]
Epoch 98:  34%|███▍      | 40/117 [00:02<00:04, 17.70it/s, loss=0.686, v_num=1, val_acc=0.757]
Epoch 98:  34%|███▍      | 40/117 [00:02<00:04, 17.50it/s, loss=0.685, v_num=1, val_acc=0.757]
Epoch 98:  35%|███▌      | 41/117 [00:02<00:04, 17.82it/s, loss=0.685, v_num=1, val_acc=0.757]
Epoch 98:  35%|███▌      | 41/117 [00:02<00:04, 17.65it/s, loss=0.684, v_num=1, val_acc=0.757]
Epoch 98:  36%|███▌      | 42/117 [00:02<00:04, 18.01it/s, loss=0.684, v_num=1, val_acc=0.757]
Epoch 98:  36%|███▌      | 42/117 [00:02<00:04, 17.81it/s, loss=0.685, v_num=1, val_acc=0.757]
Epoch 98:  37%|███▋      | 43/117 [00:02<00:04, 18.17it/s, loss=0.685, v_num=1, val_acc=0.757]
Epoch 98:  37%|███▋      | 43/117 [00:02<00:04, 17.98it/s, loss=0.689, v_num=1, val_acc=0.757]
Epoch 98:  38%|███▊      | 44/117 [00:02<00:03, 18.32it/s, loss=0.689, v_num=1, val_acc=0.757]
Epoch 98:  38%|███▊      | 44/117 [00:02<00:04, 18.13it/s, loss=0.689, v_num=1, val_acc=0.757]
Epoch 98:  38%|███▊      | 45/117 [00:02<00:03, 18.47it/s, loss=0.689, v_num=1, val_acc=0.757]
Epoch 98:  38%|███▊      | 45/117 [00:02<00:03, 18.28it/s, loss=0.694, v_num=1, val_acc=0.757]
Epoch 98:  39%|███▉      | 46/117 [00:02<00:03, 18.61it/s, loss=0.694, v_num=1, val_acc=0.757]
Epoch 98:  39%|███▉      | 46/117 [00:02<00:03, 18.43it/s, loss=0.701, v_num=1, val_acc=0.757]
Epoch 98:  40%|████      | 47/117 [00:02<00:03, 18.76it/s, loss=0.701, v_num=1, val_acc=0.757]
Epoch 98:  40%|████      | 47/117 [00:02<00:03, 18.57it/s, loss=0.7, v_num=1, val_acc=0.757]
Epoch 98:  41%|████      | 48/117 [00:02<00:03, 18.89it/s, loss=0.7, v_num=1, val_acc=0.757]
Epoch 98:  41%|████      | 48/117 [00:02<00:03, 18.71it/s, loss=0.698, v_num=1, val_acc=0.757]
Epoch 98:  42%|████▏     | 49/117 [00:02<00:03, 19.03it/s, loss=0.698, v_num=1, val_acc=0.757]
Epoch 98:  42%|████▏     | 49/117 [00:02<00:03, 18.84it/s, loss=0.696, v_num=1, val_acc=0.757]
Epoch 98:  43%|████▎     | 50/117 [00:02<00:03, 19.16it/s, loss=0.696, v_num=1, val_acc=0.757]
Epoch 98:  43%|████▎     | 50/117 [00:02<00:03, 18.98it/s, loss=0.698, v_num=1, val_acc=0.757]
Epoch 98:  44%|████▎     | 51/117 [00:02<00:03, 19.29it/s, loss=0.698, v_num=1, val_acc=0.757]
Epoch 98:  44%|████▎     | 51/117 [00:02<00:03, 19.11it/s, loss=0.694, v_num=1, val_acc=0.757]
Epoch 98:  44%|████▍     | 52/117 [00:02<00:03, 19.41it/s, loss=0.694, v_num=1, val_acc=0.757]
Epoch 98:  44%|████▍     | 52/117 [00:02<00:03, 19.23it/s, loss=0.692, v_num=1, val_acc=0.757]
Epoch 98:  45%|████▌     | 53/117 [00:02<00:03, 19.54it/s, loss=0.692, v_num=1, val_acc=0.757]
Epoch 98:  45%|████▌     | 53/117 [00:02<00:03, 19.35it/s, loss=0.697, v_num=1, val_acc=0.757]
Epoch 98:  46%|████▌     | 54/117 [00:02<00:03, 19.65it/s, loss=0.697, v_num=1, val_acc=0.757]
Epoch 98:  46%|████▌     | 54/117 [00:02<00:03, 19.47it/s, loss=0.692, v_num=1, val_acc=0.757]
Epoch 98:  47%|████▋     | 55/117 [00:02<00:03, 19.73it/s, loss=0.692, v_num=1, val_acc=0.757]
Epoch 98:  47%|████▋     | 55/117 [00:02<00:03, 19.57it/s, loss=0.686, v_num=1, val_acc=0.757]
Epoch 98:  48%|████▊     | 56/117 [00:02<00:03, 19.86it/s, loss=0.686, v_num=1, val_acc=0.757]
Epoch 98:  48%|████▊     | 56/117 [00:02<00:03, 19.68it/s, loss=0.683, v_num=1, val_acc=0.757]
Epoch 98:  49%|████▊     | 57/117 [00:02<00:03, 19.97it/s, loss=0.683, v_num=1, val_acc=0.757]
Epoch 98:  49%|████▊     | 57/117 [00:02<00:03, 19.79it/s, loss=0.678, v_num=1, val_acc=0.757]
Epoch 98:  50%|████▉     | 58/117 [00:02<00:02, 20.07it/s, loss=0.678, v_num=1, val_acc=0.757]
Epoch 98:  50%|████▉     | 58/117 [00:02<00:02, 19.90it/s, loss=0.678, v_num=1, val_acc=0.757]
Epoch 98:  50%|█████     | 59/117 [00:02<00:02, 20.18it/s, loss=0.678, v_num=1, val_acc=0.757]
Epoch 98:  50%|█████     | 59/117 [00:02<00:02, 20.00it/s, loss=0.674, v_num=1, val_acc=0.757]
Epoch 98:  51%|█████▏    | 60/117 [00:02<00:02, 20.28it/s, loss=0.674, v_num=1, val_acc=0.757]
Epoch 98:  51%|█████▏    | 60/117 [00:02<00:02, 20.11it/s, loss=0.675, v_num=1, val_acc=0.757]
Epoch 98:  52%|█████▏    | 61/117 [00:02<00:02, 20.38it/s, loss=0.675, v_num=1, val_acc=0.757]
Epoch 98:  52%|█████▏    | 61/117 [00:03<00:02, 20.21it/s, loss=0.675, v_num=1, val_acc=0.757]
Epoch 98:  53%|█████▎    | 62/117 [00:03<00:02, 20.47it/s, loss=0.675, v_num=1, val_acc=0.757]
Epoch 98:  53%|█████▎    | 62/117 [00:03<00:02, 20.31it/s, loss=0.679, v_num=1, val_acc=0.757]
Epoch 98:  54%|█████▍    | 63/117 [00:03<00:02, 20.56it/s, loss=0.679, v_num=1, val_acc=0.757]
Epoch 98:  54%|█████▍    | 63/117 [00:03<00:02, 20.40it/s, loss=0.683, v_num=1, val_acc=0.757]
Epoch 98:  55%|█████▍    | 64/117 [00:03<00:02, 20.66it/s, loss=0.683, v_num=1, val_acc=0.757]
Epoch 98:  55%|█████▍    | 64/117 [00:03<00:02, 20.49it/s, loss=0.682, v_num=1, val_acc=0.757]
Epoch 98:  56%|█████▌    | 65/117 [00:03<00:02, 20.75it/s, loss=0.682, v_num=1, val_acc=0.757]
Epoch 98:  56%|█████▌    | 65/117 [00:03<00:02, 20.58it/s, loss=0.68, v_num=1, val_acc=0.757]
Epoch 98:  56%|█████▋    | 66/117 [00:03<00:02, 20.84it/s, loss=0.68, v_num=1, val_acc=0.757]
Epoch 98:  56%|█████▋    | 66/117 [00:03<00:02, 20.67it/s, loss=0.676, v_num=1, val_acc=0.757]
Epoch 98:  57%|█████▋    | 67/117 [00:03<00:02, 20.93it/s, loss=0.676, v_num=1, val_acc=0.757]
Epoch 98:  57%|█████▋    | 67/117 [00:03<00:02, 20.76it/s, loss=0.68, v_num=1, val_acc=0.757]
Epoch 98:  58%|█████▊    | 68/117 [00:03<00:02, 21.00it/s, loss=0.68, v_num=1, val_acc=0.757]
Epoch 98:  58%|█████▊    | 68/117 [00:03<00:02, 20.84it/s, loss=0.674, v_num=1, val_acc=0.757]
Epoch 98:  59%|█████▉    | 69/117 [00:03<00:02, 21.09it/s, loss=0.674, v_num=1, val_acc=0.757]
Epoch 98:  59%|█████▉    | 69/117 [00:03<00:02, 20.93it/s, loss=0.674, v_num=1, val_acc=0.757]
Epoch 98:  60%|█████▉    | 70/117 [00:03<00:02, 21.16it/s, loss=0.674, v_num=1, val_acc=0.757]
Epoch 98:  60%|█████▉    | 70/117 [00:03<00:02, 21.01it/s, loss=0.671, v_num=1, val_acc=0.757]
Epoch 98:  61%|██████    | 71/117 [00:03<00:02, 21.25it/s, loss=0.671, v_num=1, val_acc=0.757]
Epoch 98:  61%|██████    | 71/117 [00:03<00:02, 21.09it/s, loss=0.675, v_num=1, val_acc=0.757]
Epoch 98:  62%|██████▏   | 72/117 [00:03<00:02, 21.33it/s, loss=0.675, v_num=1, val_acc=0.757]
Epoch 98:  62%|██████▏   | 72/117 [00:03<00:02, 21.17it/s, loss=0.675, v_num=1, val_acc=0.757]
Epoch 98:  62%|██████▏   | 73/117 [00:03<00:02, 21.40it/s, loss=0.675, v_num=1, val_acc=0.757]
Epoch 98:  62%|██████▏   | 73/117 [00:03<00:02, 21.25it/s, loss=0.672, v_num=1, val_acc=0.757]
Epoch 98:  63%|██████▎   | 74/117 [00:03<00:02, 21.48it/s, loss=0.672, v_num=1, val_acc=0.757]
Epoch 98:  63%|██████▎   | 74/117 [00:03<00:02, 21.32it/s, loss=0.673, v_num=1, val_acc=0.757]
Epoch 98:  64%|██████▍   | 75/117 [00:03<00:01, 21.56it/s, loss=0.673, v_num=1, val_acc=0.757]
Epoch 98:  64%|██████▍   | 75/117 [00:03<00:01, 21.40it/s, loss=0.671, v_num=1, val_acc=0.757]
Epoch 98:  65%|██████▍   | 76/117 [00:03<00:01, 21.63it/s, loss=0.671, v_num=1, val_acc=0.757]
Epoch 98:  65%|██████▍   | 76/117 [00:03<00:01, 21.47it/s, loss=0.673, v_num=1, val_acc=0.757]
Epoch 98:  66%|██████▌   | 77/117 [00:03<00:01, 21.70it/s, loss=0.673, v_num=1, val_acc=0.757]
Epoch 98:  66%|██████▌   | 77/117 [00:03<00:01, 21.55it/s, loss=0.675, v_num=1, val_acc=0.757]
Epoch 98:  67%|██████▋   | 78/117 [00:03<00:01, 21.77it/s, loss=0.675, v_num=1, val_acc=0.757]
Epoch 98:  67%|██████▋   | 78/117 [00:03<00:01, 21.62it/s, loss=0.676, v_num=1, val_acc=0.757]
Epoch 98:  68%|██████▊   | 79/117 [00:03<00:01, 21.84it/s, loss=0.676, v_num=1, val_acc=0.757]
Epoch 98:  68%|██████▊   | 79/117 [00:03<00:01, 21.69it/s, loss=0.674, v_num=1, val_acc=0.757]
Epoch 98:  68%|██████▊   | 80/117 [00:03<00:01, 21.91it/s, loss=0.674, v_num=1, val_acc=0.757]
Epoch 98:  68%|██████▊   | 80/117 [00:03<00:01, 21.76it/s, loss=0.668, v_num=1, val_acc=0.757]
Epoch 98:  69%|██████▉   | 81/117 [00:03<00:01, 21.97it/s, loss=0.668, v_num=1, val_acc=0.757]
Epoch 98:  69%|██████▉   | 81/117 [00:03<00:01, 21.82it/s, loss=0.671, v_num=1, val_acc=0.757]
Epoch 98:  70%|███████   | 82/117 [00:03<00:01, 22.02it/s, loss=0.671, v_num=1, val_acc=0.757]
Epoch 98:  70%|███████   | 82/117 [00:03<00:01, 21.87it/s, loss=0.672, v_num=1, val_acc=0.757]
Epoch 98:  71%|███████   | 83/117 [00:03<00:01, 22.09it/s, loss=0.672, v_num=1, val_acc=0.757]
Epoch 98:  71%|███████   | 83/117 [00:03<00:01, 21.94it/s, loss=0.671, v_num=1, val_acc=0.757]
Epoch 98:  72%|███████▏  | 84/117 [00:03<00:01, 22.15it/s, loss=0.671, v_num=1, val_acc=0.757]
Epoch 98:  72%|███████▏  | 84/117 [00:03<00:01, 22.00it/s, loss=0.671, v_num=1, val_acc=0.757]
Epoch 98:  73%|███████▎  | 85/117 [00:03<00:01, 22.21it/s, loss=0.671, v_num=1, val_acc=0.757]
Epoch 98:  73%|███████▎  | 85/117 [00:03<00:01, 22.07it/s, loss=0.668, v_num=1, val_acc=0.757]
Epoch 98:  74%|███████▎  | 86/117 [00:03<00:01, 22.28it/s, loss=0.668, v_num=1, val_acc=0.757]
Epoch 98:  74%|███████▎  | 86/117 [00:03<00:01, 22.13it/s, loss=0.673, v_num=1, val_acc=0.757]
Epoch 98:  74%|███████▍  | 87/117 [00:03<00:01, 22.34it/s, loss=0.673, v_num=1, val_acc=0.757]
Epoch 98:  74%|███████▍  | 87/117 [00:03<00:01, 22.19it/s, loss=0.669, v_num=1, val_acc=0.757]
Epoch 98:  75%|███████▌  | 88/117 [00:03<00:01, 22.40it/s, loss=0.669, v_num=1, val_acc=0.757]
Epoch 98:  75%|███████▌  | 88/117 [00:03<00:01, 22.25it/s, loss=0.671, v_num=1, val_acc=0.757]
Epoch 98:  76%|███████▌  | 89/117 [00:03<00:01, 22.46it/s, loss=0.671, v_num=1, val_acc=0.757]
Epoch 98:  76%|███████▌  | 89/117 [00:03<00:01, 22.31it/s, loss=0.673, v_num=1, val_acc=0.757]
Epoch 98:  77%|███████▋  | 90/117 [00:03<00:01, 22.51it/s, loss=0.673, v_num=1, val_acc=0.757]
Epoch 98:  77%|███████▋  | 90/117 [00:04<00:01, 22.37it/s, loss=0.676, v_num=1, val_acc=0.757]
Epoch 98:  78%|███████▊  | 91/117 [00:04<00:01, 22.57it/s, loss=0.676, v_num=1, val_acc=0.757]
Epoch 98:  78%|███████▊  | 91/117 [00:04<00:01, 22.43it/s, loss=0.676, v_num=1, val_acc=0.757]
Epoch 98:  79%|███████▊  | 92/117 [00:04<00:01, 22.62it/s, loss=0.676, v_num=1, val_acc=0.757]
Epoch 98:  79%|███████▊  | 92/117 [00:04<00:01, 22.48it/s, loss=0.674, v_num=1, val_acc=0.757]
Epoch 98:  79%|███████▉  | 93/117 [00:04<00:01, 22.65it/s, loss=0.674, v_num=1, val_acc=0.757]
Epoch 98:  79%|███████▉  | 93/117 [00:04<00:01, 22.52it/s, loss=0.674, v_num=1, val_acc=0.757]
Epoch 98:  80%|████████  | 94/117 [00:04<00:01, 22.72it/s, loss=0.674, v_num=1, val_acc=0.757]
Epoch 98:  80%|████████  | 94/117 [00:04<00:01, 22.58it/s, loss=0.677, v_num=1, val_acc=0.757]
Epoch 98:  81%|████████  | 95/117 [00:04<00:00, 22.76it/s, loss=0.677, v_num=1, val_acc=0.757]
Epoch 98:  81%|████████  | 95/117 [00:04<00:00, 22.63it/s, loss=0.679, v_num=1, val_acc=0.757]
Epoch 98:  82%|████████▏ | 96/117 [00:04<00:00, 22.82it/s, loss=0.679, v_num=1, val_acc=0.757]
Epoch 98:  82%|████████▏ | 96/117 [00:04<00:00, 22.68it/s, loss=0.683, v_num=1, val_acc=0.757]
Epoch 98:  83%|████████▎ | 97/117 [00:04<00:00, 22.87it/s, loss=0.683, v_num=1, val_acc=0.757]
Epoch 98:  83%|████████▎ | 97/117 [00:04<00:00, 22.73it/s, loss=0.685, v_num=1, val_acc=0.757]

Validation: 0it [00:00, ?it/s]

Validation:   0%|          | 0/20 [00:00<?, ?it/s]

Validation DataLoader 0:   0%|          | 0/20 [00:00<?, ?it/s]

Validation DataLoader 0:   5%|▌         | 1/20 [00:00<00:00, 179.64it/s]
Epoch 98:  84%|████████▍ | 98/117 [00:05<00:00, 19.20it/s, loss=0.685, v_num=1, val_acc=0.757]

Validation DataLoader 0:  10%|█         | 2/20 [00:00<00:00, 55.22it/s]
Epoch 98:  85%|████████▍ | 99/117 [00:05<00:00, 19.28it/s, loss=0.685, v_num=1, val_acc=0.757]

Validation DataLoader 0:  15%|█▌        | 3/20 [00:00<00:00, 44.00it/s]
Epoch 98:  85%|████████▌ | 100/117 [00:05<00:00, 19.35it/s, loss=0.685, v_num=1, val_acc=0.757]

Validation DataLoader 0:  20%|██        | 4/20 [00:00<00:00, 39.98it/s]
Epoch 98:  86%|████████▋ | 101/117 [00:05<00:00, 19.42it/s, loss=0.685, v_num=1, val_acc=0.757]

Validation DataLoader 0:  25%|██▌       | 5/20 [00:00<00:00, 37.81it/s]
Epoch 98:  87%|████████▋ | 102/117 [00:05<00:00, 19.50it/s, loss=0.685, v_num=1, val_acc=0.757]

Validation DataLoader 0:  30%|███       | 6/20 [00:00<00:00, 36.56it/s]
Epoch 98:  88%|████████▊ | 103/117 [00:05<00:00, 19.57it/s, loss=0.685, v_num=1, val_acc=0.757]

Validation DataLoader 0:  35%|███▌      | 7/20 [00:00<00:00, 35.67it/s]
Epoch 98:  89%|████████▉ | 104/117 [00:05<00:00, 19.64it/s, loss=0.685, v_num=1, val_acc=0.757]

Validation DataLoader 0:  40%|████      | 8/20 [00:00<00:00, 35.11it/s]
Epoch 98:  90%|████████▉ | 105/117 [00:05<00:00, 19.71it/s, loss=0.685, v_num=1, val_acc=0.757]

Validation DataLoader 0:  45%|████▌     | 9/20 [00:00<00:00, 34.66it/s]
Epoch 98:  91%|█████████ | 106/117 [00:05<00:00, 19.78it/s, loss=0.685, v_num=1, val_acc=0.757]

Validation DataLoader 0:  50%|█████     | 10/20 [00:00<00:00, 34.35it/s]
Epoch 98:  91%|█████████▏| 107/117 [00:05<00:00, 19.85it/s, loss=0.685, v_num=1, val_acc=0.757]

Validation DataLoader 0:  55%|█████▌    | 11/20 [00:00<00:00, 34.07it/s]
Epoch 98:  92%|█████████▏| 108/117 [00:05<00:00, 19.92it/s, loss=0.685, v_num=1, val_acc=0.757]

Validation DataLoader 0:  60%|██████    | 12/20 [00:00<00:00, 33.89it/s]
Epoch 98:  93%|█████████▎| 109/117 [00:05<00:00, 19.99it/s, loss=0.685, v_num=1, val_acc=0.757]

Validation DataLoader 0:  65%|██████▌   | 13/20 [00:00<00:00, 33.69it/s]
Epoch 98:  94%|█████████▍| 110/117 [00:05<00:00, 20.05it/s, loss=0.685, v_num=1, val_acc=0.757]

Validation DataLoader 0:  70%|███████   | 14/20 [00:00<00:00, 33.52it/s]
Epoch 98:  95%|█████████▍| 111/117 [00:05<00:00, 20.12it/s, loss=0.685, v_num=1, val_acc=0.757]

Validation DataLoader 0:  75%|███████▌  | 15/20 [00:00<00:00, 33.38it/s]
Epoch 98:  96%|█████████▌| 112/117 [00:05<00:00, 20.18it/s, loss=0.685, v_num=1, val_acc=0.757]

Validation DataLoader 0:  80%|████████  | 16/20 [00:00<00:00, 33.26it/s]
Epoch 98:  97%|█████████▋| 113/117 [00:05<00:00, 20.25it/s, loss=0.685, v_num=1, val_acc=0.757]

Validation DataLoader 0:  85%|████████▌ | 17/20 [00:00<00:00, 33.14it/s]
Epoch 98:  97%|█████████▋| 114/117 [00:05<00:00, 20.31it/s, loss=0.685, v_num=1, val_acc=0.757]

Validation DataLoader 0:  90%|█████████ | 18/20 [00:00<00:00, 33.06it/s]
Epoch 98:  98%|█████████▊| 115/117 [00:05<00:00, 20.38it/s, loss=0.685, v_num=1, val_acc=0.757]

Validation DataLoader 0:  95%|█████████▌| 19/20 [00:00<00:00, 32.97it/s]
Epoch 98:  99%|█████████▉| 116/117 [00:05<00:00, 20.44it/s, loss=0.685, v_num=1, val_acc=0.757]

Validation DataLoader 0: 100%|██████████| 20/20 [00:00<00:00, 32.98it/s]
Epoch 98: 100%|██████████| 117/117 [00:05<00:00, 20.50it/s, loss=0.685, v_num=1, val_acc=0.757]
Epoch 98: 100%|██████████| 117/117 [00:05<00:00, 20.43it/s, loss=0.685, v_num=1, val_acc=0.758]


Epoch 98: 100%|██████████| 117/117 [00:05<00:00, 20.43it/s, loss=0.685, v_num=1, val_acc=0.758]
Epoch 98:   0%|          | 0/117 [00:00<?, ?it/s, loss=0.685, v_num=1, val_acc=0.758]
Epoch 99:   0%|          | 0/117 [00:00<?, ?it/s, loss=0.685, v_num=1, val_acc=0.758]
Epoch 99:   1%|          | 1/117 [00:00<01:43,  1.12it/s, loss=0.685, v_num=1, val_acc=0.758]
Epoch 99:   1%|          | 1/117 [00:00<01:46,  1.09it/s, loss=0.686, v_num=1, val_acc=0.758]
Epoch 99:   2%|▏         | 2/117 [00:00<00:53,  2.14it/s, loss=0.686, v_num=1, val_acc=0.758]
Epoch 99:   2%|▏         | 2/117 [00:00<00:54,  2.09it/s, loss=0.689, v_num=1, val_acc=0.758]
Epoch 99:   3%|▎         | 3/117 [00:00<00:36,  3.10it/s, loss=0.689, v_num=1, val_acc=0.758]
Epoch 99:   3%|▎         | 3/117 [00:00<00:37,  3.02it/s, loss=0.696, v_num=1, val_acc=0.758]
Epoch 99:   3%|▎         | 4/117 [00:01<00:28,  3.98it/s, loss=0.696, v_num=1, val_acc=0.758]
Epoch 99:   3%|▎         | 4/117 [00:01<00:29,  3.88it/s, loss=0.696, v_num=1, val_acc=0.758]
Epoch 99:   4%|▍         | 5/117 [00:01<00:23,  4.81it/s, loss=0.696, v_num=1, val_acc=0.758]
Epoch 99:   4%|▍         | 5/117 [00:01<00:23,  4.70it/s, loss=0.69, v_num=1, val_acc=0.758]
Epoch 99:   5%|▌         | 6/117 [00:01<00:19,  5.58it/s, loss=0.69, v_num=1, val_acc=0.758]
Epoch 99:   5%|▌         | 6/117 [00:01<00:20,  5.46it/s, loss=0.696, v_num=1, val_acc=0.758]
Epoch 99:   6%|▌         | 7/117 [00:01<00:17,  6.32it/s, loss=0.696, v_num=1, val_acc=0.758]
Epoch 99:   6%|▌         | 7/117 [00:01<00:17,  6.18it/s, loss=0.693, v_num=1, val_acc=0.758]
Epoch 99:   7%|▋         | 8/117 [00:01<00:15,  7.00it/s, loss=0.693, v_num=1, val_acc=0.758]
Epoch 99:   7%|▋         | 8/117 [00:01<00:15,  6.85it/s, loss=0.695, v_num=1, val_acc=0.758]
Epoch 99:   8%|▊         | 9/117 [00:01<00:14,  7.64it/s, loss=0.695, v_num=1, val_acc=0.758]
Epoch 99:   8%|▊         | 9/117 [00:01<00:14,  7.48it/s, loss=0.686, v_num=1, val_acc=0.758]
Epoch 99:   9%|▊         | 10/117 [00:01<00:12,  8.23it/s, loss=0.686, v_num=1, val_acc=0.758]
Epoch 99:   9%|▊         | 10/117 [00:01<00:13,  8.07it/s, loss=0.686, v_num=1, val_acc=0.758]
Epoch 99:   9%|▉         | 11/117 [00:01<00:12,  8.79it/s, loss=0.686, v_num=1, val_acc=0.758]
Epoch 99:   9%|▉         | 11/117 [00:01<00:12,  8.62it/s, loss=0.689, v_num=1, val_acc=0.758]
Epoch 99:  10%|█         | 12/117 [00:01<00:11,  9.33it/s, loss=0.689, v_num=1, val_acc=0.758]
Epoch 99:  10%|█         | 12/117 [00:01<00:11,  9.15it/s, loss=0.686, v_num=1, val_acc=0.758]
Epoch 99:  11%|█         | 13/117 [00:01<00:10,  9.85it/s, loss=0.686, v_num=1, val_acc=0.758]
Epoch 99:  11%|█         | 13/117 [00:01<00:10,  9.66it/s, loss=0.686, v_num=1, val_acc=0.758]
Epoch 99:  12%|█▏        | 14/117 [00:01<00:09, 10.34it/s, loss=0.686, v_num=1, val_acc=0.758]
Epoch 99:  12%|█▏        | 14/117 [00:01<00:10, 10.15it/s, loss=0.685, v_num=1, val_acc=0.758]
Epoch 99:  13%|█▎        | 15/117 [00:01<00:09, 10.81it/s, loss=0.685, v_num=1, val_acc=0.758]
Epoch 99:  13%|█▎        | 15/117 [00:01<00:09, 10.62it/s, loss=0.689, v_num=1, val_acc=0.758]
Epoch 99:  14%|█▎        | 16/117 [00:01<00:08, 11.25it/s, loss=0.689, v_num=1, val_acc=0.758]
Epoch 99:  14%|█▎        | 16/117 [00:01<00:09, 11.06it/s, loss=0.693, v_num=1, val_acc=0.758]
Epoch 99:  15%|█▍        | 17/117 [00:01<00:08, 11.67it/s, loss=0.693, v_num=1, val_acc=0.758]
Epoch 99:  15%|█▍        | 17/117 [00:01<00:08, 11.47it/s, loss=0.687, v_num=1, val_acc=0.758]
Epoch 99:  15%|█▌        | 18/117 [00:01<00:08, 12.07it/s, loss=0.687, v_num=1, val_acc=0.758]
Epoch 99:  15%|█▌        | 18/117 [00:01<00:08, 11.87it/s, loss=0.69, v_num=1, val_acc=0.758]
Epoch 99:  16%|█▌        | 19/117 [00:01<00:07, 12.45it/s, loss=0.69, v_num=1, val_acc=0.758]
Epoch 99:  16%|█▌        | 19/117 [00:01<00:08, 12.24it/s, loss=0.685, v_num=1, val_acc=0.758]
Epoch 99:  17%|█▋        | 20/117 [00:01<00:07, 12.81it/s, loss=0.685, v_num=1, val_acc=0.758]
Epoch 99:  17%|█▋        | 20/117 [00:01<00:07, 12.60it/s, loss=0.685, v_num=1, val_acc=0.758]
Epoch 99:  18%|█▊        | 21/117 [00:01<00:07, 13.17it/s, loss=0.685, v_num=1, val_acc=0.758]
Epoch 99:  18%|█▊        | 21/117 [00:01<00:07, 12.96it/s, loss=0.681, v_num=1, val_acc=0.758]
Epoch 99:  19%|█▉        | 22/117 [00:01<00:07, 13.51it/s, loss=0.681, v_num=1, val_acc=0.758]
Epoch 99:  19%|█▉        | 22/117 [00:01<00:07, 13.30it/s, loss=0.679, v_num=1, val_acc=0.758]
Epoch 99:  20%|█▉        | 23/117 [00:01<00:06, 13.83it/s, loss=0.679, v_num=1, val_acc=0.758]
Epoch 99:  20%|█▉        | 23/117 [00:01<00:06, 13.62it/s, loss=0.682, v_num=1, val_acc=0.758]
Epoch 99:  21%|██        | 24/117 [00:01<00:06, 14.14it/s, loss=0.682, v_num=1, val_acc=0.758]
Epoch 99:  21%|██        | 24/117 [00:01<00:06, 13.93it/s, loss=0.679, v_num=1, val_acc=0.758]
Epoch 99:  21%|██▏       | 25/117 [00:01<00:06, 14.43it/s, loss=0.679, v_num=1, val_acc=0.758]
Epoch 99:  21%|██▏       | 25/117 [00:01<00:06, 14.22it/s, loss=0.686, v_num=1, val_acc=0.758]
Epoch 99:  22%|██▏       | 26/117 [00:01<00:06, 14.70it/s, loss=0.686, v_num=1, val_acc=0.758]
Epoch 99:  22%|██▏       | 26/117 [00:01<00:06, 14.49it/s, loss=0.681, v_num=1, val_acc=0.758]
Epoch 99:  23%|██▎       | 27/117 [00:01<00:06, 14.98it/s, loss=0.681, v_num=1, val_acc=0.758]
Epoch 99:  23%|██▎       | 27/117 [00:01<00:06, 14.77it/s, loss=0.684, v_num=1, val_acc=0.758]
Epoch 99:  24%|██▍       | 28/117 [00:01<00:05, 15.23it/s, loss=0.684, v_num=1, val_acc=0.758]
Epoch 99:  24%|██▍       | 28/117 [00:01<00:05, 15.03it/s, loss=0.685, v_num=1, val_acc=0.758]
Epoch 99:  25%|██▍       | 29/117 [00:01<00:05, 15.50it/s, loss=0.685, v_num=1, val_acc=0.758]
Epoch 99:  25%|██▍       | 29/117 [00:01<00:05, 15.29it/s, loss=0.687, v_num=1, val_acc=0.758]
Epoch 99:  26%|██▌       | 30/117 [00:01<00:05, 15.74it/s, loss=0.687, v_num=1, val_acc=0.758]
Epoch 99:  26%|██▌       | 30/117 [00:01<00:05, 15.53it/s, loss=0.69, v_num=1, val_acc=0.758]
Epoch 99:  26%|██▋       | 31/117 [00:01<00:05, 15.97it/s, loss=0.69, v_num=1, val_acc=0.758]
Epoch 99:  26%|██▋       | 31/117 [00:01<00:05, 15.76it/s, loss=0.69, v_num=1, val_acc=0.758]
Epoch 99:  27%|██▋       | 32/117 [00:01<00:05, 16.19it/s, loss=0.69, v_num=1, val_acc=0.758]
Epoch 99:  27%|██▋       | 32/117 [00:02<00:05, 15.99it/s, loss=0.693, v_num=1, val_acc=0.758]
Epoch 99:  28%|██▊       | 33/117 [00:02<00:05, 16.40it/s, loss=0.693, v_num=1, val_acc=0.758]
Epoch 99:  28%|██▊       | 33/117 [00:02<00:05, 16.20it/s, loss=0.691, v_num=1, val_acc=0.758]
Epoch 99:  29%|██▉       | 34/117 [00:02<00:04, 16.62it/s, loss=0.691, v_num=1, val_acc=0.758]
Epoch 99:  29%|██▉       | 34/117 [00:02<00:05, 16.42it/s, loss=0.687, v_num=1, val_acc=0.758]
Epoch 99:  30%|██▉       | 35/117 [00:02<00:04, 16.82it/s, loss=0.687, v_num=1, val_acc=0.758]
Epoch 99:  30%|██▉       | 35/117 [00:02<00:04, 16.62it/s, loss=0.682, v_num=1, val_acc=0.758]
Epoch 99:  31%|███       | 36/117 [00:02<00:04, 17.02it/s, loss=0.682, v_num=1, val_acc=0.758]
Epoch 99:  31%|███       | 36/117 [00:02<00:04, 16.82it/s, loss=0.682, v_num=1, val_acc=0.758]
Epoch 99:  32%|███▏      | 37/117 [00:02<00:04, 17.21it/s, loss=0.682, v_num=1, val_acc=0.758]
Epoch 99:  32%|███▏      | 37/117 [00:02<00:04, 17.01it/s, loss=0.689, v_num=1, val_acc=0.758]
Epoch 99:  32%|███▏      | 38/117 [00:02<00:04, 17.40it/s, loss=0.689, v_num=1, val_acc=0.758]
Epoch 99:  32%|███▏      | 38/117 [00:02<00:04, 17.20it/s, loss=0.685, v_num=1, val_acc=0.758]
Epoch 99:  33%|███▎      | 39/117 [00:02<00:04, 17.58it/s, loss=0.685, v_num=1, val_acc=0.758]
Epoch 99:  33%|███▎      | 39/117 [00:02<00:04, 17.38it/s, loss=0.692, v_num=1, val_acc=0.758]
Epoch 99:  34%|███▍      | 40/117 [00:02<00:04, 17.76it/s, loss=0.692, v_num=1, val_acc=0.758]
Epoch 99:  34%|███▍      | 40/117 [00:02<00:04, 17.56it/s, loss=0.697, v_num=1, val_acc=0.758]
Epoch 99:  35%|███▌      | 41/117 [00:02<00:04, 17.91it/s, loss=0.697, v_num=1, val_acc=0.758]
Epoch 99:  35%|███▌      | 41/117 [00:02<00:04, 17.72it/s, loss=0.699, v_num=1, val_acc=0.758]
Epoch 99:  36%|███▌      | 42/117 [00:02<00:04, 18.08it/s, loss=0.699, v_num=1, val_acc=0.758]
Epoch 99:  36%|███▌      | 42/117 [00:02<00:04, 17.88it/s, loss=0.699, v_num=1, val_acc=0.758]
Epoch 99:  37%|███▋      | 43/117 [00:02<00:04, 18.24it/s, loss=0.699, v_num=1, val_acc=0.758]
Epoch 99:  37%|███▋      | 43/117 [00:02<00:04, 18.05it/s, loss=0.696, v_num=1, val_acc=0.758]
Epoch 99:  38%|███▊      | 44/117 [00:02<00:03, 18.40it/s, loss=0.696, v_num=1, val_acc=0.758]
Epoch 99:  38%|███▊      | 44/117 [00:02<00:04, 18.20it/s, loss=0.699, v_num=1, val_acc=0.758]
Epoch 99:  38%|███▊      | 45/117 [00:02<00:03, 18.55it/s, loss=0.699, v_num=1, val_acc=0.758]
Epoch 99:  38%|███▊      | 45/117 [00:02<00:03, 18.36it/s, loss=0.697, v_num=1, val_acc=0.758]
Epoch 99:  39%|███▉      | 46/117 [00:02<00:03, 18.69it/s, loss=0.697, v_num=1, val_acc=0.758]
Epoch 99:  39%|███▉      | 46/117 [00:02<00:03, 18.50it/s, loss=0.696, v_num=1, val_acc=0.758]
Epoch 99:  40%|████      | 47/117 [00:02<00:03, 18.84it/s, loss=0.696, v_num=1, val_acc=0.758]
Epoch 99:  40%|████      | 47/117 [00:02<00:03, 18.65it/s, loss=0.696, v_num=1, val_acc=0.758]
Epoch 99:  41%|████      | 48/117 [00:02<00:03, 18.96it/s, loss=0.696, v_num=1, val_acc=0.758]
Epoch 99:  41%|████      | 48/117 [00:02<00:03, 18.78it/s, loss=0.691, v_num=1, val_acc=0.758]
Epoch 99:  42%|████▏     | 49/117 [00:02<00:03, 19.10it/s, loss=0.691, v_num=1, val_acc=0.758]
Epoch 99:  42%|████▏     | 49/117 [00:02<00:03, 18.92it/s, loss=0.692, v_num=1, val_acc=0.758]
Epoch 99:  43%|████▎     | 50/117 [00:02<00:03, 19.24it/s, loss=0.692, v_num=1, val_acc=0.758]
Epoch 99:  43%|████▎     | 50/117 [00:02<00:03, 19.05it/s, loss=0.692, v_num=1, val_acc=0.758]
Epoch 99:  44%|████▎     | 51/117 [00:02<00:03, 19.36it/s, loss=0.692, v_num=1, val_acc=0.758]
Epoch 99:  44%|████▎     | 51/117 [00:02<00:03, 19.18it/s, loss=0.691, v_num=1, val_acc=0.758]
Epoch 99:  44%|████▍     | 52/117 [00:02<00:03, 19.49it/s, loss=0.691, v_num=1, val_acc=0.758]
Epoch 99:  44%|████▍     | 52/117 [00:02<00:03, 19.31it/s, loss=0.689, v_num=1, val_acc=0.758]
Epoch 99:  45%|████▌     | 53/117 [00:02<00:03, 19.61it/s, loss=0.689, v_num=1, val_acc=0.758]
Epoch 99:  45%|████▌     | 53/117 [00:02<00:03, 19.43it/s, loss=0.688, v_num=1, val_acc=0.758]
Epoch 99:  46%|████▌     | 54/117 [00:02<00:03, 19.73it/s, loss=0.688, v_num=1, val_acc=0.758]
Epoch 99:  46%|████▌     | 54/117 [00:02<00:03, 19.55it/s, loss=0.696, v_num=1, val_acc=0.758]
Epoch 99:  47%|████▋     | 55/117 [00:02<00:03, 19.85it/s, loss=0.696, v_num=1, val_acc=0.758]
Epoch 99:  47%|████▋     | 55/117 [00:02<00:03, 19.67it/s, loss=0.7, v_num=1, val_acc=0.758]
Epoch 99:  48%|████▊     | 56/117 [00:02<00:03, 19.96it/s, loss=0.7, v_num=1, val_acc=0.758]
Epoch 99:  48%|████▊     | 56/117 [00:02<00:03, 19.78it/s, loss=0.698, v_num=1, val_acc=0.758]
Epoch 99:  49%|████▊     | 57/117 [00:02<00:02, 20.07it/s, loss=0.698, v_num=1, val_acc=0.758]
Epoch 99:  49%|████▊     | 57/117 [00:02<00:03, 19.89it/s, loss=0.693, v_num=1, val_acc=0.758]
Epoch 99:  50%|████▉     | 58/117 [00:02<00:02, 20.17it/s, loss=0.693, v_num=1, val_acc=0.758]
Epoch 99:  50%|████▉     | 58/117 [00:02<00:02, 20.00it/s, loss=0.695, v_num=1, val_acc=0.758]
Epoch 99:  50%|█████     | 59/117 [00:02<00:02, 20.27it/s, loss=0.695, v_num=1, val_acc=0.758]
Epoch 99:  50%|█████     | 59/117 [00:02<00:02, 20.10it/s, loss=0.691, v_num=1, val_acc=0.758]
Epoch 99:  51%|█████▏    | 60/117 [00:02<00:02, 20.37it/s, loss=0.691, v_num=1, val_acc=0.758]
Epoch 99:  51%|█████▏    | 60/117 [00:02<00:02, 20.20it/s, loss=0.687, v_num=1, val_acc=0.758]
Epoch 99:  52%|█████▏    | 61/117 [00:02<00:02, 20.47it/s, loss=0.687, v_num=1, val_acc=0.758]
Epoch 99:  52%|█████▏    | 61/117 [00:03<00:02, 20.30it/s, loss=0.687, v_num=1, val_acc=0.758]
Epoch 99:  53%|█████▎    | 62/117 [00:03<00:02, 20.57it/s, loss=0.687, v_num=1, val_acc=0.758]
Epoch 99:  53%|█████▎    | 62/117 [00:03<00:02, 20.40it/s, loss=0.692, v_num=1, val_acc=0.758]
Epoch 99:  54%|█████▍    | 63/117 [00:03<00:02, 20.66it/s, loss=0.692, v_num=1, val_acc=0.758]
Epoch 99:  54%|█████▍    | 63/117 [00:03<00:02, 20.49it/s, loss=0.69, v_num=1, val_acc=0.758]
Epoch 99:  55%|█████▍    | 64/117 [00:03<00:02, 20.76it/s, loss=0.69, v_num=1, val_acc=0.758]
Epoch 99:  55%|█████▍    | 64/117 [00:03<00:02, 20.59it/s, loss=0.691, v_num=1, val_acc=0.758]
Epoch 99:  56%|█████▌    | 65/117 [00:03<00:02, 20.84it/s, loss=0.691, v_num=1, val_acc=0.758]
Epoch 99:  56%|█████▌    | 65/117 [00:03<00:02, 20.68it/s, loss=0.688, v_num=1, val_acc=0.758]
Epoch 99:  56%|█████▋    | 66/117 [00:03<00:02, 20.92it/s, loss=0.688, v_num=1, val_acc=0.758]
Epoch 99:  56%|█████▋    | 66/117 [00:03<00:02, 20.76it/s, loss=0.685, v_num=1, val_acc=0.758]
Epoch 99:  57%|█████▋    | 67/117 [00:03<00:02, 21.01it/s, loss=0.685, v_num=1, val_acc=0.758]
Epoch 99:  57%|█████▋    | 67/117 [00:03<00:02, 20.84it/s, loss=0.691, v_num=1, val_acc=0.758]
Epoch 99:  58%|█████▊    | 68/117 [00:03<00:02, 21.09it/s, loss=0.691, v_num=1, val_acc=0.758]
Epoch 99:  58%|█████▊    | 68/117 [00:03<00:02, 20.93it/s, loss=0.697, v_num=1, val_acc=0.758]
Epoch 99:  59%|█████▉    | 69/117 [00:03<00:02, 21.17it/s, loss=0.697, v_num=1, val_acc=0.758]
Epoch 99:  59%|█████▉    | 69/117 [00:03<00:02, 21.01it/s, loss=0.695, v_num=1, val_acc=0.758]
Epoch 99:  60%|█████▉    | 70/117 [00:03<00:02, 21.26it/s, loss=0.695, v_num=1, val_acc=0.758]
Epoch 99:  60%|█████▉    | 70/117 [00:03<00:02, 21.09it/s, loss=0.693, v_num=1, val_acc=0.758]
Epoch 99:  61%|██████    | 71/117 [00:03<00:02, 21.34it/s, loss=0.693, v_num=1, val_acc=0.758]
Epoch 99:  61%|██████    | 71/117 [00:03<00:02, 21.18it/s, loss=0.691, v_num=1, val_acc=0.758]
Epoch 99:  62%|██████▏   | 72/117 [00:03<00:02, 21.42it/s, loss=0.691, v_num=1, val_acc=0.758]
Epoch 99:  62%|██████▏   | 72/117 [00:03<00:02, 21.26it/s, loss=0.693, v_num=1, val_acc=0.758]
Epoch 99:  62%|██████▏   | 73/117 [00:03<00:02, 21.49it/s, loss=0.693, v_num=1, val_acc=0.758]
Epoch 99:  62%|██████▏   | 73/117 [00:03<00:02, 21.33it/s, loss=0.691, v_num=1, val_acc=0.758]
Epoch 99:  63%|██████▎   | 74/117 [00:03<00:01, 21.56it/s, loss=0.691, v_num=1, val_acc=0.758]
Epoch 99:  63%|██████▎   | 74/117 [00:03<00:02, 21.40it/s, loss=0.685, v_num=1, val_acc=0.758]
Epoch 99:  64%|██████▍   | 75/117 [00:03<00:01, 21.63it/s, loss=0.685, v_num=1, val_acc=0.758]
Epoch 99:  64%|██████▍   | 75/117 [00:03<00:01, 21.47it/s, loss=0.683, v_num=1, val_acc=0.758]
Epoch 99:  65%|██████▍   | 76/117 [00:03<00:01, 21.70it/s, loss=0.683, v_num=1, val_acc=0.758]
Epoch 99:  65%|██████▍   | 76/117 [00:03<00:01, 21.54it/s, loss=0.683, v_num=1, val_acc=0.758]
Epoch 99:  66%|██████▌   | 77/117 [00:03<00:01, 21.77it/s, loss=0.683, v_num=1, val_acc=0.758]
Epoch 99:  66%|██████▌   | 77/117 [00:03<00:01, 21.62it/s, loss=0.685, v_num=1, val_acc=0.758]
Epoch 99:  67%|██████▋   | 78/117 [00:03<00:01, 21.84it/s, loss=0.685, v_num=1, val_acc=0.758]
Epoch 99:  67%|██████▋   | 78/117 [00:03<00:01, 21.69it/s, loss=0.683, v_num=1, val_acc=0.758]
Epoch 99:  68%|██████▊   | 79/117 [00:03<00:01, 21.91it/s, loss=0.683, v_num=1, val_acc=0.758]
Epoch 99:  68%|██████▊   | 79/117 [00:03<00:01, 21.76it/s, loss=0.683, v_num=1, val_acc=0.758]
Epoch 99:  68%|██████▊   | 80/117 [00:03<00:01, 21.98it/s, loss=0.683, v_num=1, val_acc=0.758]
Epoch 99:  68%|██████▊   | 80/117 [00:03<00:01, 21.82it/s, loss=0.686, v_num=1, val_acc=0.758]
Epoch 99:  69%|██████▉   | 81/117 [00:03<00:01, 22.04it/s, loss=0.686, v_num=1, val_acc=0.758]
Epoch 99:  69%|██████▉   | 81/117 [00:03<00:01, 21.89it/s, loss=0.688, v_num=1, val_acc=0.758]
Epoch 99:  70%|███████   | 82/117 [00:03<00:01, 22.09it/s, loss=0.688, v_num=1, val_acc=0.758]
Epoch 99:  70%|███████   | 82/117 [00:03<00:01, 21.94it/s, loss=0.682, v_num=1, val_acc=0.758]
Epoch 99:  71%|███████   | 83/117 [00:03<00:01, 22.16it/s, loss=0.682, v_num=1, val_acc=0.758]
Epoch 99:  71%|███████   | 83/117 [00:03<00:01, 22.01it/s, loss=0.68, v_num=1, val_acc=0.758]
Epoch 99:  72%|███████▏  | 84/117 [00:03<00:01, 22.22it/s, loss=0.68, v_num=1, val_acc=0.758]
Epoch 99:  72%|███████▏  | 84/117 [00:03<00:01, 22.07it/s, loss=0.68, v_num=1, val_acc=0.758]
Epoch 99:  73%|███████▎  | 85/117 [00:03<00:01, 22.28it/s, loss=0.68, v_num=1, val_acc=0.758]
Epoch 99:  73%|███████▎  | 85/117 [00:03<00:01, 22.14it/s, loss=0.68, v_num=1, val_acc=0.758]
Epoch 99:  74%|███████▎  | 86/117 [00:03<00:01, 22.35it/s, loss=0.68, v_num=1, val_acc=0.758]
Epoch 99:  74%|███████▎  | 86/117 [00:03<00:01, 22.20it/s, loss=0.68, v_num=1, val_acc=0.758]
Epoch 99:  74%|███████▍  | 87/117 [00:03<00:01, 22.41it/s, loss=0.68, v_num=1, val_acc=0.758]
Epoch 99:  74%|███████▍  | 87/117 [00:03<00:01, 22.26it/s, loss=0.678, v_num=1, val_acc=0.758]
Epoch 99:  75%|███████▌  | 88/117 [00:03<00:01, 22.47it/s, loss=0.678, v_num=1, val_acc=0.758]
Epoch 99:  75%|███████▌  | 88/117 [00:03<00:01, 22.32it/s, loss=0.677, v_num=1, val_acc=0.758]
Epoch 99:  76%|███████▌  | 89/117 [00:03<00:01, 22.53it/s, loss=0.677, v_num=1, val_acc=0.758]
Epoch 99:  76%|███████▌  | 89/117 [00:03<00:01, 22.38it/s, loss=0.676, v_num=1, val_acc=0.758]
Epoch 99:  77%|███████▋  | 90/117 [00:03<00:01, 22.58it/s, loss=0.676, v_num=1, val_acc=0.758]
Epoch 99:  77%|███████▋  | 90/117 [00:04<00:01, 22.44it/s, loss=0.674, v_num=1, val_acc=0.758]
Epoch 99:  78%|███████▊  | 91/117 [00:04<00:01, 22.64it/s, loss=0.674, v_num=1, val_acc=0.758]
Epoch 99:  78%|███████▊  | 91/117 [00:04<00:01, 22.49it/s, loss=0.675, v_num=1, val_acc=0.758]
Epoch 99:  79%|███████▊  | 92/117 [00:04<00:01, 22.69it/s, loss=0.675, v_num=1, val_acc=0.758]
Epoch 99:  79%|███████▊  | 92/117 [00:04<00:01, 22.55it/s, loss=0.673, v_num=1, val_acc=0.758]
Epoch 99:  79%|███████▉  | 93/117 [00:04<00:01, 22.75it/s, loss=0.673, v_num=1, val_acc=0.758]
Epoch 99:  79%|███████▉  | 93/117 [00:04<00:01, 22.61it/s, loss=0.675, v_num=1, val_acc=0.758]
Epoch 99:  80%|████████  | 94/117 [00:04<00:01, 22.80it/s, loss=0.675, v_num=1, val_acc=0.758]
Epoch 99:  80%|████████  | 94/117 [00:04<00:01, 22.66it/s, loss=0.674, v_num=1, val_acc=0.758]
Epoch 99:  81%|████████  | 95/117 [00:04<00:00, 22.85it/s, loss=0.674, v_num=1, val_acc=0.758]
Epoch 99:  81%|████████  | 95/117 [00:04<00:00, 22.71it/s, loss=0.674, v_num=1, val_acc=0.758]
Epoch 99:  82%|████████▏ | 96/117 [00:04<00:00, 22.90it/s, loss=0.674, v_num=1, val_acc=0.758]
Epoch 99:  82%|████████▏ | 96/117 [00:04<00:00, 22.76it/s, loss=0.673, v_num=1, val_acc=0.758]
Epoch 99:  83%|████████▎ | 97/117 [00:04<00:00, 22.95it/s, loss=0.673, v_num=1, val_acc=0.758]
Epoch 99:  83%|████████▎ | 97/117 [00:04<00:00, 22.82it/s, loss=0.677, v_num=1, val_acc=0.758]

Validation: 0it [00:00, ?it/s]

Validation:   0%|          | 0/20 [00:00<?, ?it/s]

Validation DataLoader 0:   0%|          | 0/20 [00:00<?, ?it/s]

Validation DataLoader 0:   5%|▌         | 1/20 [00:00<00:00, 188.49it/s]
Epoch 99:  84%|████████▍ | 98/117 [00:05<00:00, 19.18it/s, loss=0.677, v_num=1, val_acc=0.758]

Validation DataLoader 0:  10%|█         | 2/20 [00:00<00:00, 56.07it/s]
Epoch 99:  85%|████████▍ | 99/117 [00:05<00:00, 19.26it/s, loss=0.677, v_num=1, val_acc=0.758]

Validation DataLoader 0:  15%|█▌        | 3/20 [00:00<00:00, 44.44it/s]
Epoch 99:  85%|████████▌ | 100/117 [00:05<00:00, 19.33it/s, loss=0.677, v_num=1, val_acc=0.758]

Validation DataLoader 0:  20%|██        | 4/20 [00:00<00:00, 40.55it/s]
Epoch 99:  86%|████████▋ | 101/117 [00:05<00:00, 19.41it/s, loss=0.677, v_num=1, val_acc=0.758]

Validation DataLoader 0:  25%|██▌       | 5/20 [00:00<00:00, 38.33it/s]
Epoch 99:  87%|████████▋ | 102/117 [00:05<00:00, 19.48it/s, loss=0.677, v_num=1, val_acc=0.758]

Validation DataLoader 0:  30%|███       | 6/20 [00:00<00:00, 37.04it/s]
Epoch 99:  88%|████████▊ | 103/117 [00:05<00:00, 19.55it/s, loss=0.677, v_num=1, val_acc=0.758]

Validation DataLoader 0:  35%|███▌      | 7/20 [00:00<00:00, 36.16it/s]
Epoch 99:  89%|████████▉ | 104/117 [00:05<00:00, 19.63it/s, loss=0.677, v_num=1, val_acc=0.758]

Validation DataLoader 0:  40%|████      | 8/20 [00:00<00:00, 35.52it/s]
Epoch 99:  90%|████████▉ | 105/117 [00:05<00:00, 19.70it/s, loss=0.677, v_num=1, val_acc=0.758]

Validation DataLoader 0:  45%|████▌     | 9/20 [00:00<00:00, 35.04it/s]
Epoch 99:  91%|█████████ | 106/117 [00:05<00:00, 19.77it/s, loss=0.677, v_num=1, val_acc=0.758]

Validation DataLoader 0:  50%|█████     | 10/20 [00:00<00:00, 34.68it/s]
Epoch 99:  91%|█████████▏| 107/117 [00:05<00:00, 19.84it/s, loss=0.677, v_num=1, val_acc=0.758]

Validation DataLoader 0:  55%|█████▌    | 11/20 [00:00<00:00, 34.35it/s]
Epoch 99:  92%|█████████▏| 108/117 [00:05<00:00, 19.91it/s, loss=0.677, v_num=1, val_acc=0.758]

Validation DataLoader 0:  60%|██████    | 12/20 [00:00<00:00, 34.14it/s]
Epoch 99:  93%|█████████▎| 109/117 [00:05<00:00, 19.97it/s, loss=0.677, v_num=1, val_acc=0.758]

Validation DataLoader 0:  65%|██████▌   | 13/20 [00:00<00:00, 33.93it/s]
Epoch 99:  94%|█████████▍| 110/117 [00:05<00:00, 20.04it/s, loss=0.677, v_num=1, val_acc=0.758]

Validation DataLoader 0:  70%|███████   | 14/20 [00:00<00:00, 33.76it/s]
Epoch 99:  95%|█████████▍| 111/117 [00:05<00:00, 20.11it/s, loss=0.677, v_num=1, val_acc=0.758]

Validation DataLoader 0:  75%|███████▌  | 15/20 [00:00<00:00, 33.60it/s]
Epoch 99:  96%|█████████▌| 112/117 [00:05<00:00, 20.17it/s, loss=0.677, v_num=1, val_acc=0.758]

Validation DataLoader 0:  80%|████████  | 16/20 [00:00<00:00, 33.47it/s]
Epoch 99:  97%|█████████▋| 113/117 [00:05<00:00, 20.24it/s, loss=0.677, v_num=1, val_acc=0.758]

Validation DataLoader 0:  85%|████████▌ | 17/20 [00:00<00:00, 33.34it/s]
Epoch 99:  97%|█████████▋| 114/117 [00:05<00:00, 20.30it/s, loss=0.677, v_num=1, val_acc=0.758]

Validation DataLoader 0:  90%|█████████ | 18/20 [00:00<00:00, 33.24it/s]
Epoch 99:  98%|█████████▊| 115/117 [00:05<00:00, 20.37it/s, loss=0.677, v_num=1, val_acc=0.758]

Validation DataLoader 0:  95%|█████████▌| 19/20 [00:00<00:00, 33.15it/s]
Epoch 99:  99%|█████████▉| 116/117 [00:05<00:00, 20.43it/s, loss=0.677, v_num=1, val_acc=0.758]

Validation DataLoader 0: 100%|██████████| 20/20 [00:00<00:00, 33.13it/s]
Epoch 99: 100%|██████████| 117/117 [00:05<00:00, 20.49it/s, loss=0.677, v_num=1, val_acc=0.758]
Epoch 99: 100%|██████████| 117/117 [00:05<00:00, 20.42it/s, loss=0.677, v_num=1, val_acc=0.758]


Epoch 99: 100%|██████████| 117/117 [00:05<00:00, 20.42it/s, loss=0.677, v_num=1, val_acc=0.758]
Epoch 99: 100%|██████████| 117/117 [00:06<00:00, 17.35it/s, loss=0.677, v_num=1, val_acc=0.758]

Checkout the tensorboard logs while the model is training.

Run tensorboard –logdir lightning_logs/ to start tensorboard

Note

If you run the code on a remote machine you can’t just access the tensorboard logs. You need to forward the port. You can do this by using an editor such as Visual Studio Code which has a port forwarding functionality (make sure the remote extensions are installed and are connected with your machine).

Or you can use a shell command similar to this one to forward port 6006 from your remote machine to your local machine:

ssh username:host -N -L localhost:6006:localhost:6006