Demo: Fitting a sine curve
[1]:
%load_ext autoreload
%autoreload 2
import warnings
warnings.filterwarnings("ignore", category=UserWarning, module="multiprocessing.resource_tracker")
import numpy as np
import matplotlib.pyplot as plt
import nbi
[2]:
print(nbi.__version__)
0.4.1
This notebook provides a minimal example that could be used as a template to adapt to your specific tasks.
Let us consider a very simple sine curve model, where \(t\) is time, \(\omega\) is angular frequency, \(A\) is amplitude, and \(\phi_0\) is initial phase: \(f(t) = A\cdot\sin(\omega\cdot t+\phi_0\))
Assume parameters from the following uniform distribution: \(\phi_0\in[0,2\pi]\), \(A\in[-4,4]\), \(\omega\in[2\pi,12\pi]\)
Note that the amplitude is allowed to be negative. Thus expect bi-modal posteriors in the amplitude.
Also assume Gaussian measurement noise fixed to be \(\sigma_0\): \(x_{\rm obs}\sim N(f(t), \sigma=\sigma_0)\)
[3]:
t = np.linspace(0,1,50)
def sine(param):
phi0, A, omega = param
return np.sin(omega * t + phi0) * A
[4]:
# nbi requires prior to be defined with scipy functions
# alternatively, you may supply pre-generated parameters with numpy arrays
from scipy.stats import uniform, truncnorm
prior = {
'phi0': uniform(loc=0, scale=np.pi*2),
'A': uniform(loc=-4, scale=8),
'omega': uniform(loc=2*np.pi, scale=10*np.pi)
}
labels = list(prior.keys())
priors = [prior[k] for k in labels]
[5]:
# a randomly drawn sine curve for illustration
plt.figure(figsize=(5,3))
np.random.seed(0)
# draw random parameter from prior
y_true = [var.rvs(1)[0] for var in priors]
# add fixed gaussian noise of 1
x_err = 0.2
x_obs = sine(y_true) + np.random.normal(size=50) * x_err
plt.errorbar(t, x_obs, yerr=x_err, fmt='.')
plt.show()
Use case 1: Amortized Neural Posterior Estimation
if we want to derive the posterior for a large number of different x_obs, then train nbi for 1 round on a large number of samples generated from the prior.
[6]:
# the noise function can include any component of the forward model that is cheap
# therefore it takes in both data (x) and parameter (y) as input
# Here let us only consider iid Gaussian noise
def noise(x, y):
rand = np.random.normal(0, 1, size=x.shape[0])
# let's say x_err is drawn from [0.05, 0.5]
x_err = np.random.uniform() * 0.45 + 0.05
x_noise = x + rand * x_err
return x_noise, y
[7]:
# hyperparameters for the normalizing flow
flow = {
'n_dims': 3, # dimension of parameter space
'flow_hidden': 128,
'num_blocks': 5,
'n_mog':4 # Number of Mixture of Gaussian as base density
}
# the NBI package provides the "ResNet-GRU" network as the default
# featurizer network for sequential data
featurizer = {
'type': 'resnet-gru',
'norm': 'weight_norm',
'dim_in': 1, # Number of channels for input data
'dim_out': 128, # Output feature vector dimension
'dim_conv_max': 256, # Maximum hidden dimension for CNN
'depth': 3 # Number of 1D ResNet layers
}
# initialize NBI engine
engine = nbi.NBI(
flow=flow,
featurizer=featurizer,
simulator=sine,
priors=priors,
labels=labels,
device='cpu',
path='test2',
n_jobs=10
)
[8]:
engine.fit(
n_sims=12800,
n_rounds=1,
n_epochs=300,
batch_size=512,
lr=0.001,
early_stop_patience=250,
noise=noise # this can also be an array if fixed noise
)
Auto learning rate to min_lr = 1.3333333333333334e-06
Generating simulations
1280it [00:00, 2693.36it/s]
/Users/Keming/anaconda3/envs/py311-arm/lib/python3.11/multiprocessing/resource_tracker.py:224: UserWarning: resource_tracker: There appear to be 1 leaked semaphore objects to clean up at shutdown
warnings.warn('resource_tracker: There appear to be %d '
/Users/Keming/anaconda3/envs/py311-arm/lib/python3.11/multiprocessing/resource_tracker.py:224: UserWarning: resource_tracker: There appear to be 1 leaked semaphore objects to clean up at shutdown
warnings.warn('resource_tracker: There appear to be %d '
/Users/Keming/anaconda3/envs/py311-arm/lib/python3.11/multiprocessing/resource_tracker.py:224: UserWarning: resource_tracker: There appear to be 1 leaked semaphore objects to clean up at shutdown
warnings.warn('resource_tracker: There appear to be %d '
/Users/Keming/anaconda3/envs/py311-arm/lib/python3.11/multiprocessing/resource_tracker.py:224: UserWarning: resource_tracker: There appear to be 1 leaked semaphore objects to clean up at shutdown
warnings.warn('resource_tracker: There appear to be %d '
/Users/Keming/anaconda3/envs/py311-arm/lib/python3.11/multiprocessing/resource_tracker.py:224: UserWarning: resource_tracker: There appear to be 1 leaked semaphore objects to clean up at shutdown
warnings.warn('resource_tracker: There appear to be %d '
/Users/Keming/anaconda3/envs/py311-arm/lib/python3.11/multiprocessing/resource_tracker.py:224: UserWarning: resource_tracker: There appear to be 1 leaked semaphore objects to clean up at shutdown
warnings.warn('resource_tracker: There appear to be %d '
/Users/Keming/anaconda3/envs/py311-arm/lib/python3.11/multiprocessing/resource_tracker.py:224: UserWarning: resource_tracker: There appear to be 1 leaked semaphore objects to clean up at shutdown
warnings.warn('resource_tracker: There appear to be %d '
/Users/Keming/anaconda3/envs/py311-arm/lib/python3.11/multiprocessing/resource_tracker.py:224: UserWarning: resource_tracker: There appear to be 1 leaked semaphore objects to clean up at shutdown
warnings.warn('resource_tracker: There appear to be %d '
/Users/Keming/anaconda3/envs/py311-arm/lib/python3.11/multiprocessing/resource_tracker.py:224: UserWarning: resource_tracker: There appear to be 1 leaked semaphore objects to clean up at shutdown
warnings.warn('resource_tracker: There appear to be %d '
/Users/Keming/anaconda3/envs/py311-arm/lib/python3.11/multiprocessing/resource_tracker.py:224: UserWarning: resource_tracker: There appear to be 1 leaked semaphore objects to clean up at shutdown
warnings.warn('resource_tracker: There appear to be %d '
---------------------- Round: 0 ----------------------
Epoch 0: Train, Loglike in nats: -3.851653: 98%|▉| 11264/11520 [00:02<00:00
- Val, Loglike in nats: -2.984723: 80%|▊| 1024/1280 [00:00<00:00, 2999.58it
Epoch 1: Train, Loglike in nats: -2.498076: 98%|▉| 11264/11520 [00:02<00:00
- Val, Loglike in nats: -2.240993: 80%|▊| 1024/1280 [00:00<00:00, 3671.05it
Epoch 2: Train, Loglike in nats: -2.853344: 98%|▉| 11264/11520 [00:04<00:00
- Val, Loglike in nats: -2.363469: 80%|▊| 1024/1280 [00:00<00:00, 8830.57it
Epoch 3: Train, Loglike in nats: -2.240685: 98%|▉| 11264/11520 [00:03<00:00
- Val, Loglike in nats: -1.919772: 80%|▊| 1024/1280 [00:00<00:00, 8462.06it
Epoch 4: Train, Loglike in nats: -1.620814: 98%|▉| 11264/11520 [00:02<00:00
- Val, Loglike in nats: -1.600617: 80%|▊| 1024/1280 [00:00<00:00, 9509.40it
Epoch 5: Train, Loglike in nats: -1.647011: 98%|▉| 11264/11520 [00:03<00:00
- Val, Loglike in nats: -1.350998: 80%|▊| 1024/1280 [00:00<00:00, 9575.18it
Epoch 6: Train, Loglike in nats: -1.284166: 98%|▉| 11264/11520 [00:02<00:00
- Val, Loglike in nats: -1.201143: 80%|▊| 1024/1280 [00:00<00:00, 10342.09i
Epoch 7: Train, Loglike in nats: -1.126907: 98%|▉| 11264/11520 [00:02<00:00
- Val, Loglike in nats: -0.892067: 80%|▊| 1024/1280 [00:00<00:00, 9703.31it
Epoch 8: Train, Loglike in nats: -0.873063: 98%|▉| 11264/11520 [00:02<00:00
- Val, Loglike in nats: -0.581992: 80%|▊| 1024/1280 [00:00<00:00, 9966.42it
Epoch 9: Train, Loglike in nats: -0.389662: 98%|▉| 11264/11520 [00:03<00:00
- Val, Loglike in nats: -0.010337: 80%|▊| 1024/1280 [00:00<00:00, 9833.00it
Epoch 10: Train, Loglike in nats: 0.248763: 98%|▉| 11264/11520 [00:02<00:00
- Val, Loglike in nats: 1.072841: 80%|▊| 1024/1280 [00:00<00:00, 9800.09it/
Epoch 11: Train, Loglike in nats: -0.398143: 98%|▉| 11264/11520 [00:02<00:0
- Val, Loglike in nats: 0.714003: 80%|▊| 1024/1280 [00:00<00:00, 9971.46it/
Epoch 12: Train, Loglike in nats: 1.219615: 98%|▉| 11264/11520 [00:02<00:00
- Val, Loglike in nats: 1.337432: 80%|▊| 1024/1280 [00:00<00:00, 9759.74it/
Epoch 13: Train, Loglike in nats: 1.615358: 98%|▉| 11264/11520 [00:03<00:00
- Val, Loglike in nats: -0.473811: 80%|▊| 1024/1280 [00:00<00:00, 9705.31it
Epoch 14: Train, Loglike in nats: 1.239683: 98%|▉| 11264/11520 [00:02<00:00
- Val, Loglike in nats: 1.872741: 80%|▊| 1024/1280 [00:00<00:00, 9798.57it/
Epoch 15: Train, Loglike in nats: 2.123171: 98%|▉| 11264/11520 [00:02<00:00
- Val, Loglike in nats: 2.436503: 80%|▊| 1024/1280 [00:00<00:00, 9982.35it/
Epoch 16: Train, Loglike in nats: 1.984375: 98%|▉| 11264/11520 [00:02<00:00
- Val, Loglike in nats: 2.195008: 80%|▊| 1024/1280 [00:00<00:00, 10073.95it
Epoch 17: Train, Loglike in nats: 2.481320: 98%|▉| 11264/11520 [00:03<00:00
- Val, Loglike in nats: 2.621574: 80%|▊| 1024/1280 [00:00<00:00, 3150.82it/
Epoch 18: Train, Loglike in nats: 1.901767: 98%|▉| 11264/11520 [00:02<00:00
- Val, Loglike in nats: 2.066959: 80%|▊| 1024/1280 [00:00<00:00, 9610.88it/
Epoch 19: Train, Loglike in nats: 2.438454: 98%|▉| 11264/11520 [00:02<00:00
- Val, Loglike in nats: 2.733421: 80%|▊| 1024/1280 [00:00<00:00, 10007.22it
Epoch 20: Train, Loglike in nats: 2.840736: 98%|▉| 11264/11520 [00:02<00:00
- Val, Loglike in nats: 2.403073: 80%|▊| 1024/1280 [00:00<00:00, 9782.39it/
Epoch 21: Train, Loglike in nats: 2.468852: 98%|▉| 11264/11520 [00:02<00:00
- Val, Loglike in nats: 3.099226: 80%|▊| 1024/1280 [00:00<00:00, 4324.23it/
Epoch 22: Train, Loglike in nats: 2.001492: 98%|▉| 11264/11520 [00:02<00:00
- Val, Loglike in nats: 1.776518: 80%|▊| 1024/1280 [00:00<00:00, 9607.55it/
Epoch 23: Train, Loglike in nats: 1.780422: 98%|▉| 11264/11520 [00:02<00:00
- Val, Loglike in nats: 2.564617: 80%|▊| 1024/1280 [00:00<00:00, 9735.31it/
Epoch 24: Train, Loglike in nats: 2.985596: 98%|▉| 11264/11520 [00:02<00:00
- Val, Loglike in nats: 3.067122: 80%|▊| 1024/1280 [00:00<00:00, 9614.73it/
Epoch 25: Train, Loglike in nats: 3.349774: 98%|▉| 11264/11520 [00:02<00:00
- Val, Loglike in nats: 3.073960: 80%|▊| 1024/1280 [00:00<00:00, 10122.69it
Epoch 26: Train, Loglike in nats: 3.362078: 98%|▉| 11264/11520 [00:03<00:00
- Val, Loglike in nats: 3.403142: 80%|▊| 1024/1280 [00:00<00:00, 9832.35it/
Epoch 27: Train, Loglike in nats: 2.625667: 98%|▉| 11264/11520 [00:02<00:00
- Val, Loglike in nats: 2.227534: 80%|▊| 1024/1280 [00:00<00:00, 9904.25it/
Epoch 28: Train, Loglike in nats: 3.055156: 98%|▉| 11264/11520 [00:02<00:00
- Val, Loglike in nats: 3.482126: 80%|▊| 1024/1280 [00:00<00:00, 9950.35it/
Epoch 29: Train, Loglike in nats: 3.519974: 98%|▉| 11264/11520 [00:02<00:00
- Val, Loglike in nats: 3.781979: 80%|▊| 1024/1280 [00:00<00:00, 10020.15it
Epoch 30: Train, Loglike in nats: 3.705919: 98%|▉| 11264/11520 [00:03<00:00
- Val, Loglike in nats: 3.777465: 80%|▊| 1024/1280 [00:00<00:00, 9517.87it/
Epoch 31: Train, Loglike in nats: 3.792369: 98%|▉| 11264/11520 [00:02<00:00
- Val, Loglike in nats: 3.554900: 80%|▊| 1024/1280 [00:00<00:00, 9846.30it/
Epoch 32: Train, Loglike in nats: 3.811675: 98%|▉| 11264/11520 [00:02<00:00
- Val, Loglike in nats: 4.087920: 80%|▊| 1024/1280 [00:00<00:00, 9896.33it/
Epoch 33: Train, Loglike in nats: 3.368757: 98%|▉| 11264/11520 [00:02<00:00
- Val, Loglike in nats: 3.579859: 80%|▊| 1024/1280 [00:00<00:00, 9677.36it/
Epoch 34: Train, Loglike in nats: 3.884577: 98%|▉| 11264/11520 [00:02<00:00
- Val, Loglike in nats: 3.275751: 80%|▊| 1024/1280 [00:00<00:00, 4258.89it/
Epoch 35: Train, Loglike in nats: 3.244787: 98%|▉| 11264/11520 [00:03<00:00
- Val, Loglike in nats: 2.795378: 80%|▊| 1024/1280 [00:00<00:00, 9711.39it/
Epoch 36: Train, Loglike in nats: 3.677319: 98%|▉| 11264/11520 [00:02<00:00
- Val, Loglike in nats: 3.880242: 80%|▊| 1024/1280 [00:00<00:00, 9689.26it/
Epoch 37: Train, Loglike in nats: 3.790177: 98%|▉| 11264/11520 [00:02<00:00
- Val, Loglike in nats: 3.772333: 80%|▊| 1024/1280 [00:00<00:00, 9088.26it/
Epoch 38: Train, Loglike in nats: 2.899288: 98%|▉| 11264/11520 [00:02<00:00
- Val, Loglike in nats: 2.833591: 80%|▊| 1024/1280 [00:00<00:00, 9678.93it/
Epoch 39: Train, Loglike in nats: 3.666038: 98%|▉| 11264/11520 [00:03<00:00
- Val, Loglike in nats: 3.546713: 80%|▊| 1024/1280 [00:00<00:00, 4539.23it/
Epoch 40: Train, Loglike in nats: 3.843576: 98%|▉| 11264/11520 [00:02<00:00
- Val, Loglike in nats: 3.989748: 80%|▊| 1024/1280 [00:00<00:00, 9549.85it/
Epoch 41: Train, Loglike in nats: 4.191560: 98%|▉| 11264/11520 [00:02<00:00
- Val, Loglike in nats: 4.034100: 80%|▊| 1024/1280 [00:00<00:00, 10026.72it
Epoch 42: Train, Loglike in nats: 4.227902: 98%|▉| 11264/11520 [00:02<00:00
- Val, Loglike in nats: 3.976105: 80%|▊| 1024/1280 [00:00<00:00, 9976.23it/
Epoch 43: Train, Loglike in nats: 4.240566: 98%|▉| 11264/11520 [00:02<00:00
- Val, Loglike in nats: 4.241155: 80%|▊| 1024/1280 [00:00<00:00, 3762.98it/
Epoch 44: Train, Loglike in nats: 4.260778: 98%|▉| 11264/11520 [00:03<00:00
- Val, Loglike in nats: 4.282600: 80%|▊| 1024/1280 [00:00<00:00, 9537.10it/
Epoch 45: Train, Loglike in nats: 4.029519: 98%|▉| 11264/11520 [00:02<00:00
- Val, Loglike in nats: 3.595071: 80%|▊| 1024/1280 [00:00<00:00, 9886.37it/
Epoch 46: Train, Loglike in nats: 3.826512: 98%|▉| 11264/11520 [00:02<00:00
- Val, Loglike in nats: 4.256767: 80%|▊| 1024/1280 [00:00<00:00, 9860.84it/
Epoch 47: Train, Loglike in nats: 4.325788: 98%|▉| 11264/11520 [00:03<00:00
- Val, Loglike in nats: 2.841599: 80%|▊| 1024/1280 [00:00<00:00, 9614.02it/
Epoch 48: Train, Loglike in nats: 3.838478: 98%|▉| 11264/11520 [00:02<00:00
- Val, Loglike in nats: 4.202137: 80%|▊| 1024/1280 [00:00<00:00, 8691.08it/
Epoch 49: Train, Loglike in nats: 4.236606: 98%|▉| 11264/11520 [00:02<00:00
- Val, Loglike in nats: 2.871080: 80%|▊| 1024/1280 [00:00<00:00, 9852.79it/
Epoch 50: Train, Loglike in nats: 3.959212: 98%|▉| 11264/11520 [00:02<00:00
- Val, Loglike in nats: 4.223527: 80%|▊| 1024/1280 [00:00<00:00, 9810.30it/
Epoch 51: Train, Loglike in nats: 4.446829: 98%|▉| 11264/11520 [00:03<00:00
- Val, Loglike in nats: 4.428692: 80%|▊| 1024/1280 [00:00<00:00, 9974.86it/
Epoch 52: Train, Loglike in nats: 4.377276: 98%|▉| 11264/11520 [00:02<00:00
- Val, Loglike in nats: 4.429189: 80%|▊| 1024/1280 [00:00<00:00, 9921.32it/
Epoch 53: Train, Loglike in nats: 4.444990: 98%|▉| 11264/11520 [00:02<00:00
- Val, Loglike in nats: 4.276281: 80%|▊| 1024/1280 [00:00<00:00, 9887.60it/
Epoch 54: Train, Loglike in nats: 3.256611: 98%|▉| 11264/11520 [00:02<00:00
- Val, Loglike in nats: 3.587253: 80%|▊| 1024/1280 [00:00<00:00, 9367.15it/
Epoch 55: Train, Loglike in nats: 4.213576: 98%|▉| 11264/11520 [00:03<00:00
- Val, Loglike in nats: 4.282850: 80%|▊| 1024/1280 [00:00<00:00, 9826.30it/
Epoch 56: Train, Loglike in nats: 3.593654: 98%|▉| 11264/11520 [00:02<00:00
- Val, Loglike in nats: 3.533817: 80%|▊| 1024/1280 [00:00<00:00, 8401.16it/
Epoch 57: Train, Loglike in nats: 4.071354: 98%|▉| 11264/11520 [00:02<00:00
- Val, Loglike in nats: 4.336431: 80%|▊| 1024/1280 [00:00<00:00, 9924.11it/
Epoch 58: Train, Loglike in nats: 4.523057: 98%|▉| 11264/11520 [00:02<00:00
- Val, Loglike in nats: 4.639695: 80%|▊| 1024/1280 [00:00<00:00, 9383.29it/
Epoch 59: Train, Loglike in nats: 4.584000: 98%|▉| 11264/11520 [00:03<00:00
- Val, Loglike in nats: 4.797822: 80%|▊| 1024/1280 [00:00<00:00, 9560.60it/
Epoch 60: Train, Loglike in nats: 4.451227: 98%|▉| 11264/11520 [00:02<00:00
- Val, Loglike in nats: 4.397796: 80%|▊| 1024/1280 [00:00<00:00, 9511.95it/
Epoch 61: Train, Loglike in nats: 4.597460: 98%|▉| 11264/11520 [00:02<00:00
- Val, Loglike in nats: 4.642589: 80%|▊| 1024/1280 [00:00<00:00, 9789.95it/
Epoch 62: Train, Loglike in nats: 4.608378: 98%|▉| 11264/11520 [00:02<00:00
- Val, Loglike in nats: 4.271307: 80%|▊| 1024/1280 [00:00<00:00, 9862.38it/
Epoch 63: Train, Loglike in nats: 4.524945: 98%|▉| 11264/11520 [00:03<00:00
- Val, Loglike in nats: 4.542982: 80%|▊| 1024/1280 [00:00<00:00, 9657.99it/
Epoch 64: Train, Loglike in nats: 4.180767: 98%|▉| 11264/11520 [00:02<00:00
- Val, Loglike in nats: 3.689496: 80%|▊| 1024/1280 [00:00<00:00, 9750.23it/
Epoch 65: Train, Loglike in nats: 4.373944: 98%|▉| 11264/11520 [00:02<00:00
- Val, Loglike in nats: 4.675422: 80%|▊| 1024/1280 [00:00<00:00, 9866.28it/
Epoch 66: Train, Loglike in nats: 4.692604: 98%|▉| 11264/11520 [00:02<00:00
- Val, Loglike in nats: 4.092716: 80%|▊| 1024/1280 [00:00<00:00, 10000.88it
Epoch 67: Train, Loglike in nats: 4.693291: 98%|▉| 11264/11520 [00:02<00:00
- Val, Loglike in nats: 4.835148: 80%|▊| 1024/1280 [00:00<00:00, 4596.81it/
Epoch 68: Train, Loglike in nats: 4.714162: 98%|▉| 11264/11520 [00:02<00:00
- Val, Loglike in nats: 4.709657: 80%|▊| 1024/1280 [00:00<00:00, 9798.12it/
Epoch 69: Train, Loglike in nats: 3.702480: 98%|▉| 11264/11520 [00:02<00:00
- Val, Loglike in nats: 4.176120: 80%|▊| 1024/1280 [00:00<00:00, 9810.68it/
Epoch 70: Train, Loglike in nats: 4.596511: 98%|▉| 11264/11520 [00:02<00:00
- Val, Loglike in nats: 4.895304: 80%|▊| 1024/1280 [00:00<00:00, 9745.98it/
Epoch 71: Train, Loglike in nats: 4.744214: 98%|▉| 11264/11520 [00:02<00:00
- Val, Loglike in nats: 4.635634: 80%|▊| 1024/1280 [00:00<00:00, 3372.82it/
Epoch 72: Train, Loglike in nats: 4.747933: 98%|▉| 11264/11520 [00:02<00:00
- Val, Loglike in nats: 4.404232: 80%|▊| 1024/1280 [00:00<00:00, 9886.58it/
Epoch 73: Train, Loglike in nats: 4.754324: 98%|▉| 11264/11520 [00:02<00:00
- Val, Loglike in nats: 4.708319: 80%|▊| 1024/1280 [00:00<00:00, 9816.69it/
Epoch 74: Train, Loglike in nats: 4.764262: 98%|▉| 11264/11520 [00:02<00:00
- Val, Loglike in nats: 4.911592: 80%|▊| 1024/1280 [00:00<00:00, 9560.09it/
Epoch 75: Train, Loglike in nats: 4.751526: 98%|▉| 11264/11520 [00:03<00:00
- Val, Loglike in nats: 4.937023: 80%|▊| 1024/1280 [00:00<00:00, 9830.17it/
Epoch 76: Train, Loglike in nats: 4.845479: 98%|▉| 11264/11520 [00:02<00:00
- Val, Loglike in nats: 4.812368: 80%|▊| 1024/1280 [00:00<00:00, 9621.54it/
Epoch 77: Train, Loglike in nats: 4.756401: 98%|▉| 11264/11520 [00:02<00:00
- Val, Loglike in nats: 4.579947: 80%|▊| 1024/1280 [00:00<00:00, 9523.02it/
Epoch 78: Train, Loglike in nats: 4.751733: 98%|▉| 11264/11520 [00:02<00:00
- Val, Loglike in nats: 4.718035: 80%|▊| 1024/1280 [00:00<00:00, 9685.57it/
Epoch 79: Train, Loglike in nats: 4.659982: 98%|▉| 11264/11520 [00:03<00:00
- Val, Loglike in nats: 4.533284: 80%|▊| 1024/1280 [00:00<00:00, 9395.59it/
Epoch 80: Train, Loglike in nats: 4.834358: 98%|▉| 11264/11520 [00:02<00:00
- Val, Loglike in nats: 4.939500: 80%|▊| 1024/1280 [00:00<00:00, 9704.50it/
Epoch 81: Train, Loglike in nats: 4.158889: 98%|▉| 11264/11520 [00:02<00:00
- Val, Loglike in nats: 4.597799: 80%|▊| 1024/1280 [00:00<00:00, 9613.78it/
Epoch 82: Train, Loglike in nats: 4.799724: 98%|▉| 11264/11520 [00:03<00:00
- Val, Loglike in nats: 4.801846: 80%|▊| 1024/1280 [00:00<00:00, 3328.98it/
Epoch 83: Train, Loglike in nats: 4.938389: 98%|▉| 11264/11520 [00:02<00:00
- Val, Loglike in nats: 4.943264: 80%|▊| 1024/1280 [00:00<00:00, 8806.11it/
Epoch 84: Train, Loglike in nats: 4.793490: 98%|▉| 11264/11520 [00:02<00:00
- Val, Loglike in nats: 4.866713: 80%|▊| 1024/1280 [00:00<00:00, 8939.41it/
Epoch 85: Train, Loglike in nats: 4.981260: 98%|▉| 11264/11520 [00:03<00:00
- Val, Loglike in nats: 4.867730: 80%|▊| 1024/1280 [00:00<00:00, 8745.48it/
Epoch 86: Train, Loglike in nats: 4.620130: 98%|▉| 11264/11520 [00:02<00:00
- Val, Loglike in nats: 4.890939: 80%|▊| 1024/1280 [00:00<00:00, 8800.33it/
Epoch 87: Train, Loglike in nats: 4.935327: 98%|▉| 11264/11520 [00:03<00:00
- Val, Loglike in nats: 5.109634: 80%|▊| 1024/1280 [00:00<00:00, 3369.02it/
Epoch 88: Train, Loglike in nats: 5.010200: 98%|▉| 11264/11520 [00:03<00:00
- Val, Loglike in nats: 4.557707: 80%|▊| 1024/1280 [00:00<00:00, 9224.90it/
Epoch 89: Train, Loglike in nats: 4.949794: 98%|▉| 11264/11520 [00:03<00:00
- Val, Loglike in nats: 5.041967: 80%|▊| 1024/1280 [00:00<00:00, 8892.27it/
Epoch 90: Train, Loglike in nats: 5.044551: 98%|▉| 11264/11520 [00:03<00:00
- Val, Loglike in nats: 4.961290: 80%|▊| 1024/1280 [00:00<00:00, 8944.16it/
Epoch 91: Train, Loglike in nats: 5.020473: 98%|▉| 11264/11520 [00:02<00:00
- Val, Loglike in nats: 4.783405: 80%|▊| 1024/1280 [00:00<00:00, 8682.10it/
Epoch 92: Train, Loglike in nats: 5.048864: 98%|▉| 11264/11520 [00:03<00:00
- Val, Loglike in nats: 4.879153: 80%|▊| 1024/1280 [00:00<00:00, 4046.55it/
Epoch 93: Train, Loglike in nats: 4.972085: 98%|▉| 11264/11520 [00:03<00:00
- Val, Loglike in nats: 5.095383: 80%|▊| 1024/1280 [00:00<00:00, 9264.28it/
Epoch 94: Train, Loglike in nats: 5.011032: 98%|▉| 11264/11520 [00:02<00:00
- Val, Loglike in nats: 4.682728: 80%|▊| 1024/1280 [00:00<00:00, 9485.21it/
Epoch 95: Train, Loglike in nats: 5.034967: 98%|▉| 11264/11520 [00:03<00:00
- Val, Loglike in nats: 4.982537: 80%|▊| 1024/1280 [00:00<00:00, 2814.13it/
Epoch 96: Train, Loglike in nats: 4.959682: 98%|▉| 11264/11520 [00:02<00:00
- Val, Loglike in nats: 5.074445: 80%|▊| 1024/1280 [00:00<00:00, 9143.17it/
Epoch 97: Train, Loglike in nats: 5.148802: 98%|▉| 11264/11520 [00:02<00:00
- Val, Loglike in nats: 5.195337: 80%|▊| 1024/1280 [00:00<00:00, 9187.15it/
Epoch 98: Train, Loglike in nats: 5.189330: 98%|▉| 11264/11520 [00:03<00:00
- Val, Loglike in nats: 5.026703: 80%|▊| 1024/1280 [00:00<00:00, 9295.02it/
Epoch 99: Train, Loglike in nats: 5.186990: 98%|▉| 11264/11520 [00:02<00:00
- Val, Loglike in nats: 4.806613: 80%|▊| 1024/1280 [00:00<00:00, 8731.31it/
Epoch 100: Train, Loglike in nats: 4.410088: 98%|▉| 11264/11520 [00:02<00:0
- Val, Loglike in nats: 4.800928: 80%|▊| 1024/1280 [00:00<00:00, 9437.48it/
Epoch 101: Train, Loglike in nats: 5.033157: 98%|▉| 11264/11520 [00:03<00:0
- Val, Loglike in nats: 4.942412: 80%|▊| 1024/1280 [00:00<00:00, 8906.82it/
Epoch 102: Train, Loglike in nats: 5.235607: 98%|▉| 11264/11520 [00:02<00:0
- Val, Loglike in nats: 5.188683: 80%|▊| 1024/1280 [00:00<00:00, 8963.29it/
Epoch 103: Train, Loglike in nats: 5.226388: 98%|▉| 11264/11520 [00:02<00:0
- Val, Loglike in nats: 5.216347: 80%|▊| 1024/1280 [00:00<00:00, 5639.42it/
Epoch 104: Train, Loglike in nats: 5.231412: 98%|▉| 11264/11520 [00:03<00:0
- Val, Loglike in nats: 5.187630: 80%|▊| 1024/1280 [00:00<00:00, 9436.56it/
Epoch 105: Train, Loglike in nats: 4.746549: 98%|▉| 11264/11520 [00:02<00:0
- Val, Loglike in nats: 3.862481: 80%|▊| 1024/1280 [00:00<00:00, 9128.75it/
Epoch 106: Train, Loglike in nats: 4.637647: 98%|▉| 11264/11520 [00:03<00:0
- Val, Loglike in nats: 5.023439: 80%|▊| 1024/1280 [00:00<00:00, 3347.82it/
Epoch 107: Train, Loglike in nats: 5.183452: 98%|▉| 11264/11520 [00:02<00:0
- Val, Loglike in nats: 4.972174: 80%|▊| 1024/1280 [00:00<00:00, 9162.91it/
Epoch 108: Train, Loglike in nats: 5.198407: 98%|▉| 11264/11520 [00:02<00:0
- Val, Loglike in nats: 5.045882: 80%|▊| 1024/1280 [00:00<00:00, 9146.85it/
Epoch 109: Train, Loglike in nats: 5.246219: 98%|▉| 11264/11520 [00:03<00:0
- Val, Loglike in nats: 5.143646: 80%|▊| 1024/1280 [00:00<00:00, 8695.50it/
Epoch 110: Train, Loglike in nats: 5.315694: 98%|▉| 11264/11520 [00:03<00:0
- Val, Loglike in nats: 5.255485: 80%|▊| 1024/1280 [00:00<00:00, 9071.33it/
Epoch 111: Train, Loglike in nats: 5.331820: 98%|▉| 11264/11520 [00:03<00:0
- Val, Loglike in nats: 4.875888: 80%|▊| 1024/1280 [00:00<00:00, 8933.55it/
Epoch 112: Train, Loglike in nats: 5.283599: 98%|▉| 11264/11520 [00:02<00:0
- Val, Loglike in nats: 5.465637: 80%|▊| 1024/1280 [00:00<00:00, 9557.75it/
Epoch 113: Train, Loglike in nats: 5.402383: 98%|▉| 11264/11520 [00:02<00:0
- Val, Loglike in nats: 5.397207: 80%|▊| 1024/1280 [00:00<00:00, 9627.51it/
Epoch 114: Train, Loglike in nats: 5.212236: 98%|▉| 11264/11520 [00:02<00:0
- Val, Loglike in nats: 4.660688: 80%|▊| 1024/1280 [00:00<00:00, 8635.08it/
Epoch 115: Train, Loglike in nats: 3.903254: 98%|▉| 11264/11520 [00:02<00:0
- Val, Loglike in nats: 4.963943: 80%|▊| 1024/1280 [00:00<00:00, 9256.10it/
Epoch 116: Train, Loglike in nats: 5.131039: 98%|▉| 11264/11520 [00:02<00:0
- Val, Loglike in nats: 5.248237: 80%|▊| 1024/1280 [00:00<00:00, 4741.29it/
Epoch 117: Train, Loglike in nats: 5.332259: 98%|▉| 11264/11520 [00:02<00:0
- Val, Loglike in nats: 5.280462: 80%|▊| 1024/1280 [00:00<00:00, 9437.54it/
Epoch 118: Train, Loglike in nats: 5.310867: 98%|▉| 11264/11520 [00:02<00:0
- Val, Loglike in nats: 5.365846: 80%|▊| 1024/1280 [00:00<00:00, 8837.58it/
Epoch 119: Train, Loglike in nats: 5.397320: 98%|▉| 11264/11520 [00:02<00:0
- Val, Loglike in nats: 5.448100: 80%|▊| 1024/1280 [00:00<00:00, 9051.22it/
Epoch 120: Train, Loglike in nats: 5.294904: 98%|▉| 11264/11520 [00:03<00:0
- Val, Loglike in nats: 5.092909: 80%|▊| 1024/1280 [00:00<00:00, 9444.22it/
Epoch 121: Train, Loglike in nats: 5.403662: 98%|▉| 11264/11520 [00:02<00:0
- Val, Loglike in nats: 5.428323: 80%|▊| 1024/1280 [00:00<00:00, 9349.89it/
Epoch 122: Train, Loglike in nats: 4.936172: 98%|▉| 11264/11520 [00:03<00:0
- Val, Loglike in nats: 4.632895: 80%|▊| 1024/1280 [00:00<00:00, 9073.29it/
Epoch 123: Train, Loglike in nats: 4.890215: 98%|▉| 11264/11520 [00:02<00:0
- Val, Loglike in nats: 5.241644: 80%|▊| 1024/1280 [00:00<00:00, 8893.91it/
Epoch 124: Train, Loglike in nats: 5.355583: 98%|▉| 11264/11520 [00:03<00:0
- Val, Loglike in nats: 5.400315: 80%|▊| 1024/1280 [00:00<00:00, 8969.02it/
Epoch 125: Train, Loglike in nats: 5.431152: 98%|▉| 11264/11520 [00:03<00:0
- Val, Loglike in nats: 5.438829: 80%|▊| 1024/1280 [00:00<00:00, 9106.68it/
Epoch 126: Train, Loglike in nats: 5.402216: 98%|▉| 11264/11520 [00:02<00:0
- Val, Loglike in nats: 5.395393: 80%|▊| 1024/1280 [00:00<00:00, 8714.45it/
Epoch 127: Train, Loglike in nats: 5.436257: 98%|▉| 11264/11520 [00:02<00:0
- Val, Loglike in nats: 5.518850: 80%|▊| 1024/1280 [00:00<00:00, 8462.24it/
Epoch 128: Train, Loglike in nats: 5.470064: 98%|▉| 11264/11520 [00:03<00:0
- Val, Loglike in nats: 5.469751: 80%|▊| 1024/1280 [00:00<00:00, 8691.68it/
Epoch 129: Train, Loglike in nats: 5.401027: 98%|▉| 11264/11520 [00:03<00:0
- Val, Loglike in nats: 5.540334: 80%|▊| 1024/1280 [00:00<00:00, 9273.42it/
Epoch 130: Train, Loglike in nats: 5.290651: 98%|▉| 11264/11520 [00:03<00:0
- Val, Loglike in nats: 4.525930: 80%|▊| 1024/1280 [00:00<00:00, 3103.10it/
Epoch 131: Train, Loglike in nats: 5.193254: 98%|▉| 11264/11520 [00:02<00:0
- Val, Loglike in nats: 5.429794: 80%|▊| 1024/1280 [00:00<00:00, 9134.71it/
Epoch 132: Train, Loglike in nats: 5.392039: 98%|▉| 11264/11520 [00:02<00:0
- Val, Loglike in nats: 5.312921: 80%|▊| 1024/1280 [00:00<00:00, 9025.37it/
Epoch 133: Train, Loglike in nats: 5.464343: 98%|▉| 11264/11520 [00:03<00:0
- Val, Loglike in nats: 5.525427: 80%|▊| 1024/1280 [00:00<00:00, 9260.35it/
Epoch 134: Train, Loglike in nats: 5.527062: 98%|▉| 11264/11520 [00:02<00:0
- Val, Loglike in nats: 5.470475: 80%|▊| 1024/1280 [00:00<00:00, 8726.77it/
Epoch 135: Train, Loglike in nats: 5.161821: 98%|▉| 11264/11520 [00:02<00:0
- Val, Loglike in nats: 5.504158: 80%|▊| 1024/1280 [00:00<00:00, 8916.51it/
Epoch 136: Train, Loglike in nats: 5.545118: 98%|▉| 11264/11520 [00:03<00:0
- Val, Loglike in nats: 5.499725: 80%|▊| 1024/1280 [00:00<00:00, 9071.98it/
Epoch 137: Train, Loglike in nats: 5.584017: 98%|▉| 11264/11520 [00:02<00:0
- Val, Loglike in nats: 5.566711: 80%|▊| 1024/1280 [00:00<00:00, 8864.12it/
Epoch 138: Train, Loglike in nats: 5.560418: 98%|▉| 11264/11520 [00:03<00:0
- Val, Loglike in nats: 5.479045: 80%|▊| 1024/1280 [00:00<00:00, 4167.45it/
Epoch 139: Train, Loglike in nats: 5.583067: 98%|▉| 11264/11520 [00:03<00:0
- Val, Loglike in nats: 5.404629: 80%|▊| 1024/1280 [00:00<00:00, 8566.67it/
Epoch 140: Train, Loglike in nats: 5.499278: 98%|▉| 11264/11520 [00:02<00:0
- Val, Loglike in nats: 5.194180: 80%|▊| 1024/1280 [00:00<00:00, 9151.35it/
Epoch 141: Train, Loglike in nats: 5.478994: 98%|▉| 11264/11520 [00:03<00:0
- Val, Loglike in nats: 5.141514: 80%|▊| 1024/1280 [00:00<00:00, 9006.94it/
Epoch 142: Train, Loglike in nats: 5.513113: 98%|▉| 11264/11520 [00:02<00:0
- Val, Loglike in nats: 5.509935: 80%|▊| 1024/1280 [00:00<00:00, 8835.91it/
Epoch 143: Train, Loglike in nats: 5.606976: 98%|▉| 11264/11520 [00:02<00:0
- Val, Loglike in nats: 5.353518: 80%|▊| 1024/1280 [00:00<00:00, 8432.86it/
Epoch 144: Train, Loglike in nats: 5.556012: 98%|▉| 11264/11520 [00:03<00:0
- Val, Loglike in nats: 5.529669: 80%|▊| 1024/1280 [00:00<00:00, 9035.70it/
Epoch 145: Train, Loglike in nats: 5.557709: 98%|▉| 11264/11520 [00:02<00:0
- Val, Loglike in nats: 5.637734: 80%|▊| 1024/1280 [00:00<00:00, 9365.55it/
Epoch 146: Train, Loglike in nats: 5.603655: 98%|▉| 11264/11520 [00:02<00:0
- Val, Loglike in nats: 5.427556: 80%|▊| 1024/1280 [00:00<00:00, 9342.80it/
Epoch 147: Train, Loglike in nats: 5.493373: 98%|▉| 11264/11520 [00:03<00:0
- Val, Loglike in nats: 4.985003: 80%|▊| 1024/1280 [00:00<00:00, 9056.11it/
Epoch 148: Train, Loglike in nats: 5.163940: 98%|▉| 11264/11520 [00:02<00:0
- Val, Loglike in nats: 5.225825: 80%|▊| 1024/1280 [00:00<00:00, 8907.52it/
Epoch 149: Train, Loglike in nats: 5.390919: 98%|▉| 11264/11520 [00:02<00:0
- Val, Loglike in nats: 5.512096: 80%|▊| 1024/1280 [00:00<00:00, 3878.39it/
Epoch 150: Train, Loglike in nats: 5.563761: 98%|▉| 11264/11520 [00:03<00:0
- Val, Loglike in nats: 5.757576: 80%|▊| 1024/1280 [00:00<00:00, 9103.60it/
Epoch 151: Train, Loglike in nats: 5.659038: 98%|▉| 11264/11520 [00:02<00:0
- Val, Loglike in nats: 5.611406: 80%|▊| 1024/1280 [00:00<00:00, 9320.96it/
Epoch 152: Train, Loglike in nats: 5.726348: 98%|▉| 11264/11520 [00:02<00:0
- Val, Loglike in nats: 5.555246: 80%|▊| 1024/1280 [00:00<00:00, 9146.52it/
Epoch 153: Train, Loglike in nats: 5.600896: 98%|▉| 11264/11520 [00:02<00:0
- Val, Loglike in nats: 5.613087: 80%|▊| 1024/1280 [00:00<00:00, 9125.41it/
Epoch 154: Train, Loglike in nats: 5.136520: 98%|▉| 11264/11520 [00:02<00:0
- Val, Loglike in nats: 4.812824: 80%|▊| 1024/1280 [00:00<00:00, 7323.13it/
Epoch 155: Train, Loglike in nats: 5.125684: 98%|▉| 11264/11520 [00:02<00:0
- Val, Loglike in nats: 5.097010: 80%|▊| 1024/1280 [00:00<00:00, 3785.95it/
Epoch 156: Train, Loglike in nats: 5.510932: 98%|▉| 11264/11520 [00:02<00:0
- Val, Loglike in nats: 5.518552: 80%|▊| 1024/1280 [00:00<00:00, 9420.17it/
Epoch 157: Train, Loglike in nats: 5.649294: 98%|▉| 11264/11520 [00:02<00:0
- Val, Loglike in nats: 5.620698: 80%|▊| 1024/1280 [00:00<00:00, 9148.64it/
Epoch 158: Train, Loglike in nats: 5.640782: 98%|▉| 11264/11520 [00:02<00:0
- Val, Loglike in nats: 5.626383: 80%|▊| 1024/1280 [00:00<00:00, 9523.88it/
Epoch 159: Train, Loglike in nats: 5.649284: 98%|▉| 11264/11520 [00:02<00:0
- Val, Loglike in nats: 5.628625: 80%|▊| 1024/1280 [00:00<00:00, 9511.76it/
Epoch 160: Train, Loglike in nats: 5.646411: 98%|▉| 11264/11520 [00:02<00:0
- Val, Loglike in nats: 5.577348: 80%|▊| 1024/1280 [00:00<00:00, 9199.28it/
Epoch 161: Train, Loglike in nats: 5.624748: 98%|▉| 11264/11520 [00:02<00:0
- Val, Loglike in nats: 5.624774: 80%|▊| 1024/1280 [00:00<00:00, 4714.98it/
Epoch 162: Train, Loglike in nats: 5.749968: 98%|▉| 11264/11520 [00:03<00:0
- Val, Loglike in nats: 5.792416: 80%|▊| 1024/1280 [00:00<00:00, 9005.11it/
Epoch 163: Train, Loglike in nats: 5.768485: 98%|▉| 11264/11520 [00:02<00:0
- Val, Loglike in nats: 5.791962: 80%|▊| 1024/1280 [00:00<00:00, 9167.66it/
Epoch 164: Train, Loglike in nats: 5.813198: 98%|▉| 11264/11520 [00:02<00:0
- Val, Loglike in nats: 5.494507: 80%|▊| 1024/1280 [00:00<00:00, 9091.55it/
Epoch 165: Train, Loglike in nats: 5.487433: 98%|▉| 11264/11520 [00:02<00:0
- Val, Loglike in nats: 5.293005: 80%|▊| 1024/1280 [00:00<00:00, 9121.44it/
Epoch 166: Train, Loglike in nats: 5.668660: 98%|▉| 11264/11520 [00:02<00:0
- Val, Loglike in nats: 5.703479: 80%|▊| 1024/1280 [00:00<00:00, 9244.12it/
Epoch 167: Train, Loglike in nats: 5.764008: 98%|▉| 11264/11520 [00:03<00:0
- Val, Loglike in nats: 5.684761: 80%|▊| 1024/1280 [00:00<00:00, 2754.00it/
Epoch 168: Train, Loglike in nats: 5.502714: 98%|▉| 11264/11520 [00:03<00:0
- Val, Loglike in nats: 5.555971: 80%|▊| 1024/1280 [00:00<00:00, 8929.99it/
Epoch 169: Train, Loglike in nats: 5.602808: 98%|▉| 11264/11520 [00:03<00:0
- Val, Loglike in nats: 5.726156: 80%|▊| 1024/1280 [00:00<00:00, 8835.36it/
Epoch 170: Train, Loglike in nats: 5.743564: 98%|▉| 11264/11520 [00:03<00:0
- Val, Loglike in nats: 5.610476: 80%|▊| 1024/1280 [00:00<00:00, 8582.04it/
Epoch 171: Train, Loglike in nats: 5.600174: 98%|▉| 11264/11520 [00:03<00:0
- Val, Loglike in nats: 4.870948: 80%|▊| 1024/1280 [00:00<00:00, 8936.60it/
Epoch 172: Train, Loglike in nats: 5.443271: 98%|▉| 11264/11520 [00:02<00:0
- Val, Loglike in nats: 5.456948: 80%|▊| 1024/1280 [00:00<00:00, 4551.76it/
Epoch 173: Train, Loglike in nats: 5.688820: 98%|▉| 11264/11520 [00:03<00:0
- Val, Loglike in nats: 5.759488: 80%|▊| 1024/1280 [00:00<00:00, 6678.28it/
Epoch 174: Train, Loglike in nats: 5.863158: 98%|▉| 11264/11520 [00:02<00:0
- Val, Loglike in nats: 5.839815: 80%|▊| 1024/1280 [00:00<00:00, 8779.68it/
Epoch 175: Train, Loglike in nats: 5.826236: 98%|▉| 11264/11520 [00:03<00:0
- Val, Loglike in nats: 5.789112: 80%|▊| 1024/1280 [00:00<00:00, 8776.58it/
Epoch 176: Train, Loglike in nats: 5.864328: 98%|▉| 11264/11520 [00:02<00:0
- Val, Loglike in nats: 5.841046: 80%|▊| 1024/1280 [00:00<00:00, 9252.31it/
Epoch 177: Train, Loglike in nats: 5.817114: 98%|▉| 11264/11520 [00:03<00:0
- Val, Loglike in nats: 5.772132: 80%|▊| 1024/1280 [00:00<00:00, 8582.61it/
Epoch 178: Train, Loglike in nats: 5.864300: 98%|▉| 11264/11520 [00:03<00:0
- Val, Loglike in nats: 5.811681: 80%|▊| 1024/1280 [00:00<00:00, 8744.68it/
Epoch 179: Train, Loglike in nats: 5.878690: 98%|▉| 11264/11520 [00:02<00:0
- Val, Loglike in nats: 5.612947: 80%|▊| 1024/1280 [00:00<00:00, 8825.52it/
Epoch 180: Train, Loglike in nats: 5.813038: 98%|▉| 11264/11520 [00:03<00:0
- Val, Loglike in nats: 5.817533: 80%|▊| 1024/1280 [00:00<00:00, 4110.87it/
Epoch 181: Train, Loglike in nats: 5.788204: 98%|▉| 11264/11520 [00:02<00:0
- Val, Loglike in nats: 5.734297: 80%|▊| 1024/1280 [00:00<00:00, 8817.26it/
Epoch 182: Train, Loglike in nats: 5.840208: 98%|▉| 11264/11520 [00:03<00:0
- Val, Loglike in nats: 5.852358: 80%|▊| 1024/1280 [00:00<00:00, 9053.87it/
Epoch 183: Train, Loglike in nats: 5.907214: 98%|▉| 11264/11520 [00:03<00:0
- Val, Loglike in nats: 5.763256: 80%|▊| 1024/1280 [00:00<00:00, 9166.51it/
Epoch 184: Train, Loglike in nats: 5.852499: 98%|▉| 11264/11520 [00:03<00:0
- Val, Loglike in nats: 5.862482: 80%|▊| 1024/1280 [00:00<00:00, 8775.91it/
Epoch 185: Train, Loglike in nats: 5.802456: 98%|▉| 11264/11520 [00:03<00:0
- Val, Loglike in nats: 5.770654: 80%|▊| 1024/1280 [00:00<00:00, 4140.67it/
Epoch 186: Train, Loglike in nats: 5.839282: 98%|▉| 11264/11520 [00:03<00:0
- Val, Loglike in nats: 5.707422: 80%|▊| 1024/1280 [00:00<00:00, 8670.54it/
Epoch 187: Train, Loglike in nats: 5.907727: 98%|▉| 11264/11520 [00:03<00:0
- Val, Loglike in nats: 5.821457: 80%|▊| 1024/1280 [00:00<00:00, 8987.90it/
Epoch 188: Train, Loglike in nats: 5.913223: 98%|▉| 11264/11520 [00:03<00:0
- Val, Loglike in nats: 5.795648: 80%|▊| 1024/1280 [00:00<00:00, 8452.53it/
Epoch 189: Train, Loglike in nats: 5.868620: 98%|▉| 11264/11520 [00:03<00:0
- Val, Loglike in nats: 5.921119: 80%|▊| 1024/1280 [00:00<00:00, 8634.51it/
Epoch 190: Train, Loglike in nats: 5.916395: 98%|▉| 11264/11520 [00:03<00:0
- Val, Loglike in nats: 5.820592: 80%|▊| 1024/1280 [00:00<00:00, 3827.15it/
Epoch 191: Train, Loglike in nats: 5.783606: 98%|▉| 11264/11520 [00:03<00:0
- Val, Loglike in nats: 5.655878: 80%|▊| 1024/1280 [00:00<00:00, 8920.25it/
Epoch 192: Train, Loglike in nats: 5.930478: 98%|▉| 11264/11520 [00:02<00:0
- Val, Loglike in nats: 5.880970: 80%|▊| 1024/1280 [00:00<00:00, 8703.39it/
Epoch 193: Train, Loglike in nats: 5.958016: 98%|▉| 11264/11520 [00:03<00:0
- Val, Loglike in nats: 5.913445: 80%|▊| 1024/1280 [00:00<00:00, 9190.04it/
Epoch 194: Train, Loglike in nats: 5.962620: 98%|▉| 11264/11520 [00:03<00:0
- Val, Loglike in nats: 5.843554: 80%|▊| 1024/1280 [00:00<00:00, 8877.55it/
Epoch 195: Train, Loglike in nats: 5.979379: 98%|▉| 11264/11520 [00:03<00:0
- Val, Loglike in nats: 5.846795: 80%|▊| 1024/1280 [00:00<00:00, 4059.29it/
Epoch 196: Train, Loglike in nats: 5.970039: 98%|▉| 11264/11520 [00:03<00:0
- Val, Loglike in nats: 5.873135: 80%|▊| 1024/1280 [00:00<00:00, 8630.20it/
Epoch 197: Train, Loglike in nats: 5.933705: 98%|▉| 11264/11520 [00:02<00:0
- Val, Loglike in nats: 5.847226: 80%|▊| 1024/1280 [00:00<00:00, 8702.09it/
Epoch 198: Train, Loglike in nats: 6.035864: 98%|▉| 11264/11520 [00:03<00:0
- Val, Loglike in nats: 5.952021: 80%|▊| 1024/1280 [00:00<00:00, 8835.75it/
Epoch 199: Train, Loglike in nats: 6.031181: 98%|▉| 11264/11520 [00:03<00:0
- Val, Loglike in nats: 5.905683: 80%|▊| 1024/1280 [00:00<00:00, 8928.04it/
Epoch 200: Train, Loglike in nats: 5.976564: 98%|▉| 11264/11520 [00:03<00:0
- Val, Loglike in nats: 5.767876: 80%|▊| 1024/1280 [00:00<00:00, 4212.59it/
Epoch 201: Train, Loglike in nats: 5.867866: 98%|▉| 11264/11520 [00:03<00:0
- Val, Loglike in nats: 5.985537: 80%|▊| 1024/1280 [00:00<00:00, 9176.38it/
Epoch 202: Train, Loglike in nats: 5.999950: 98%|▉| 11264/11520 [00:02<00:0
- Val, Loglike in nats: 5.933154: 80%|▊| 1024/1280 [00:00<00:00, 8880.80it/
Epoch 203: Train, Loglike in nats: 5.997913: 98%|▉| 11264/11520 [00:03<00:0
- Val, Loglike in nats: 5.934641: 80%|▊| 1024/1280 [00:00<00:00, 3114.24it/
Epoch 204: Train, Loglike in nats: 6.016090: 98%|▉| 11264/11520 [00:03<00:0
- Val, Loglike in nats: 5.831066: 80%|▊| 1024/1280 [00:00<00:00, 8482.53it/
Epoch 205: Train, Loglike in nats: 6.028709: 98%|▉| 11264/11520 [00:03<00:0
- Val, Loglike in nats: 5.927909: 80%|▊| 1024/1280 [00:00<00:00, 8480.80it/
Epoch 206: Train, Loglike in nats: 6.028294: 98%|▉| 11264/11520 [00:03<00:0
- Val, Loglike in nats: 5.908641: 80%|▊| 1024/1280 [00:00<00:00, 8542.52it/
Epoch 207: Train, Loglike in nats: 6.023085: 98%|▉| 11264/11520 [00:03<00:0
- Val, Loglike in nats: 5.956295: 80%|▊| 1024/1280 [00:00<00:00, 9020.90it/
Epoch 208: Train, Loglike in nats: 5.969785: 98%|▉| 11264/11520 [00:02<00:0
- Val, Loglike in nats: 5.960278: 80%|▊| 1024/1280 [00:00<00:00, 4130.62it/
Epoch 209: Train, Loglike in nats: 6.031216: 98%|▉| 11264/11520 [00:03<00:0
- Val, Loglike in nats: 5.982039: 80%|▊| 1024/1280 [00:00<00:00, 9087.26it/
Epoch 210: Train, Loglike in nats: 6.069467: 98%|▉| 11264/11520 [00:03<00:0
- Val, Loglike in nats: 6.079695: 80%|▊| 1024/1280 [00:00<00:00, 8758.79it/
Epoch 211: Train, Loglike in nats: 6.058956: 98%|▉| 11264/11520 [00:03<00:0
- Val, Loglike in nats: 6.048627: 80%|▊| 1024/1280 [00:00<00:00, 8766.99it/
Epoch 212: Train, Loglike in nats: 6.098628: 98%|▉| 11264/11520 [00:03<00:0
- Val, Loglike in nats: 6.035763: 80%|▊| 1024/1280 [00:00<00:00, 8962.71it/
Epoch 213: Train, Loglike in nats: 6.042898: 98%|▉| 11264/11520 [00:03<00:0
- Val, Loglike in nats: 6.003551: 80%|▊| 1024/1280 [00:00<00:00, 6201.92it/
Epoch 214: Train, Loglike in nats: 6.053481: 98%|▉| 11264/11520 [00:03<00:0
- Val, Loglike in nats: 5.963653: 80%|▊| 1024/1280 [00:00<00:00, 8837.71it/
Epoch 215: Train, Loglike in nats: 6.071988: 98%|▉| 11264/11520 [00:02<00:0
- Val, Loglike in nats: 5.977085: 80%|▊| 1024/1280 [00:00<00:00, 8339.86it/
Epoch 216: Train, Loglike in nats: 6.081740: 98%|▉| 11264/11520 [00:03<00:0
- Val, Loglike in nats: 5.977153: 80%|▊| 1024/1280 [00:00<00:00, 9069.59it/
Epoch 217: Train, Loglike in nats: 6.076434: 98%|▉| 11264/11520 [00:02<00:0
- Val, Loglike in nats: 5.990683: 80%|▊| 1024/1280 [00:00<00:00, 8634.58it/
Epoch 218: Train, Loglike in nats: 6.065740: 98%|▉| 11264/11520 [00:03<00:0
- Val, Loglike in nats: 5.861808: 80%|▊| 1024/1280 [00:00<00:00, 8997.92it/
Epoch 219: Train, Loglike in nats: 6.065818: 98%|▉| 11264/11520 [00:02<00:0
- Val, Loglike in nats: 5.942234: 80%|▊| 1024/1280 [00:00<00:00, 8868.66it/
Epoch 220: Train, Loglike in nats: 6.134555: 98%|▉| 11264/11520 [00:03<00:0
- Val, Loglike in nats: 6.021082: 80%|▊| 1024/1280 [00:00<00:00, 9039.47it/
Epoch 221: Train, Loglike in nats: 6.082656: 98%|▉| 11264/11520 [00:02<00:0
- Val, Loglike in nats: 6.081383: 80%|▊| 1024/1280 [00:00<00:00, 5831.84it/
Epoch 222: Train, Loglike in nats: 6.091392: 98%|▉| 11264/11520 [00:03<00:0
- Val, Loglike in nats: 5.966986: 80%|▊| 1024/1280 [00:00<00:00, 5201.16it/
Epoch 223: Train, Loglike in nats: 6.097937: 98%|▉| 11264/11520 [00:02<00:0
- Val, Loglike in nats: 6.022796: 80%|▊| 1024/1280 [00:00<00:00, 8698.32it/
Epoch 224: Train, Loglike in nats: 6.104909: 98%|▉| 11264/11520 [00:02<00:0
- Val, Loglike in nats: 5.983981: 80%|▊| 1024/1280 [00:00<00:00, 9118.67it/
Epoch 225: Train, Loglike in nats: 6.089239: 98%|▉| 11264/11520 [00:02<00:0
- Val, Loglike in nats: 5.978047: 80%|▊| 1024/1280 [00:00<00:00, 8860.06it/
Epoch 226: Train, Loglike in nats: 6.107898: 98%|▉| 11264/11520 [00:02<00:0
- Val, Loglike in nats: 6.014693: 80%|▊| 1024/1280 [00:00<00:00, 8717.21it/
Epoch 227: Train, Loglike in nats: 6.120309: 98%|▉| 11264/11520 [00:03<00:0
- Val, Loglike in nats: 6.006057: 80%|▊| 1024/1280 [00:00<00:00, 8375.95it/
Epoch 228: Train, Loglike in nats: 6.101321: 98%|▉| 11264/11520 [00:02<00:0
- Val, Loglike in nats: 6.013000: 80%|▊| 1024/1280 [00:00<00:00, 9173.99it/
Epoch 229: Train, Loglike in nats: 6.103277: 98%|▉| 11264/11520 [00:02<00:0
- Val, Loglike in nats: 5.930502: 80%|▊| 1024/1280 [00:00<00:00, 4906.76it/
Epoch 230: Train, Loglike in nats: 6.103433: 98%|▉| 11264/11520 [00:02<00:0
- Val, Loglike in nats: 6.133472: 80%|▊| 1024/1280 [00:00<00:00, 4004.72it/
Epoch 231: Train, Loglike in nats: 6.133838: 98%|▉| 11264/11520 [00:03<00:0
- Val, Loglike in nats: 6.137036: 80%|▊| 1024/1280 [00:00<00:00, 8936.83it/
Epoch 232: Train, Loglike in nats: 6.146494: 98%|▉| 11264/11520 [00:02<00:0
- Val, Loglike in nats: 5.921103: 80%|▊| 1024/1280 [00:00<00:00, 9032.38it/
Epoch 233: Train, Loglike in nats: 6.133113: 98%|▉| 11264/11520 [00:03<00:0
- Val, Loglike in nats: 6.110283: 80%|▊| 1024/1280 [00:00<00:00, 9605.46it/
Epoch 234: Train, Loglike in nats: 6.145494: 98%|▉| 11264/11520 [00:02<00:0
- Val, Loglike in nats: 6.016614: 80%|▊| 1024/1280 [00:00<00:00, 9014.71it/
Epoch 235: Train, Loglike in nats: 6.124565: 98%|▉| 11264/11520 [00:02<00:0
- Val, Loglike in nats: 6.170072: 80%|▊| 1024/1280 [00:00<00:00, 9011.79it/
Epoch 236: Train, Loglike in nats: 6.157085: 98%|▉| 11264/11520 [00:02<00:0
- Val, Loglike in nats: 6.005931: 80%|▊| 1024/1280 [00:00<00:00, 9075.11it/
Epoch 237: Train, Loglike in nats: 6.126128: 98%|▉| 11264/11520 [00:02<00:0
- Val, Loglike in nats: 6.098151: 80%|▊| 1024/1280 [00:00<00:00, 6846.62it/
Epoch 238: Train, Loglike in nats: 6.175637: 98%|▉| 11264/11520 [00:03<00:0
- Val, Loglike in nats: 5.992302: 80%|▊| 1024/1280 [00:00<00:00, 8850.24it/
Epoch 239: Train, Loglike in nats: 6.169770: 98%|▉| 11264/11520 [00:02<00:0
- Val, Loglike in nats: 6.095167: 80%|▊| 1024/1280 [00:00<00:00, 8975.37it/
Epoch 240: Train, Loglike in nats: 6.162028: 98%|▉| 11264/11520 [00:02<00:0
- Val, Loglike in nats: 6.027113: 80%|▊| 1024/1280 [00:00<00:00, 8647.56it/
Epoch 241: Train, Loglike in nats: 6.150702: 98%|▉| 11264/11520 [00:02<00:0
- Val, Loglike in nats: 6.091898: 80%|▊| 1024/1280 [00:00<00:00, 9325.43it/
Epoch 242: Train, Loglike in nats: 6.202268: 98%|▉| 11264/11520 [00:02<00:0
- Val, Loglike in nats: 6.074091: 80%|▊| 1024/1280 [00:00<00:00, 9097.14it/
Epoch 243: Train, Loglike in nats: 6.195301: 98%|▉| 11264/11520 [00:03<00:0
- Val, Loglike in nats: 6.210519: 80%|▊| 1024/1280 [00:00<00:00, 9122.10it/
Epoch 244: Train, Loglike in nats: 6.201016: 98%|▉| 11264/11520 [00:02<00:0
- Val, Loglike in nats: 6.221901: 80%|▊| 1024/1280 [00:00<00:00, 8993.98it/
Epoch 245: Train, Loglike in nats: 6.191539: 98%|▉| 11264/11520 [00:02<00:0
- Val, Loglike in nats: 6.183374: 80%|▊| 1024/1280 [00:00<00:00, 9100.37it/
Epoch 246: Train, Loglike in nats: 6.205428: 98%|▉| 11264/11520 [00:02<00:0
- Val, Loglike in nats: 6.089732: 80%|▊| 1024/1280 [00:00<00:00, 8974.59it/
Epoch 247: Train, Loglike in nats: 6.155436: 98%|▉| 11264/11520 [00:02<00:0
- Val, Loglike in nats: 6.109187: 80%|▊| 1024/1280 [00:00<00:00, 8889.49it/
Epoch 248: Train, Loglike in nats: 6.160395: 98%|▉| 11264/11520 [00:02<00:0
- Val, Loglike in nats: 6.166186: 80%|▊| 1024/1280 [00:00<00:00, 4535.63it/
Epoch 249: Train, Loglike in nats: 6.218191: 98%|▉| 11264/11520 [00:03<00:0
- Val, Loglike in nats: 6.177854: 80%|▊| 1024/1280 [00:00<00:00, 8780.81it/
Epoch 250: Train, Loglike in nats: 6.203799: 98%|▉| 11264/11520 [00:02<00:0
- Val, Loglike in nats: 6.156746: 80%|▊| 1024/1280 [00:00<00:00, 9049.62it/
Epoch 251: Train, Loglike in nats: 6.183799: 98%|▉| 11264/11520 [00:02<00:0
- Val, Loglike in nats: 6.134890: 80%|▊| 1024/1280 [00:00<00:00, 8978.81it/
Epoch 252: Train, Loglike in nats: 6.192711: 98%|▉| 11264/11520 [00:02<00:0
- Val, Loglike in nats: 6.215394: 80%|▊| 1024/1280 [00:00<00:00, 8987.04it/
Epoch 253: Train, Loglike in nats: 6.202236: 98%|▉| 11264/11520 [00:02<00:0
- Val, Loglike in nats: 6.144240: 80%|▊| 1024/1280 [00:00<00:00, 9499.98it/
Epoch 254: Train, Loglike in nats: 6.226951: 98%|▉| 11264/11520 [00:02<00:0
- Val, Loglike in nats: 6.201624: 80%|▊| 1024/1280 [00:00<00:00, 6926.77it/
Epoch 255: Train, Loglike in nats: 6.228964: 98%|▉| 11264/11520 [00:03<00:0
- Val, Loglike in nats: 6.221393: 80%|▊| 1024/1280 [00:00<00:00, 8973.48it/
Epoch 256: Train, Loglike in nats: 6.216074: 98%|▉| 11264/11520 [00:02<00:0
- Val, Loglike in nats: 6.090775: 80%|▊| 1024/1280 [00:00<00:00, 9150.84it/
Epoch 257: Train, Loglike in nats: 6.247015: 98%|▉| 11264/11520 [00:02<00:0
- Val, Loglike in nats: 6.176671: 80%|▊| 1024/1280 [00:00<00:00, 9582.45it/
Epoch 258: Train, Loglike in nats: 6.218173: 98%|▉| 11264/11520 [00:02<00:0
- Val, Loglike in nats: 6.134167: 80%|▊| 1024/1280 [00:00<00:00, 9110.34it/
Epoch 259: Train, Loglike in nats: 6.243144: 98%|▉| 11264/11520 [00:02<00:0
- Val, Loglike in nats: 6.259633: 80%|▊| 1024/1280 [00:00<00:00, 8868.73it/
Epoch 260: Train, Loglike in nats: 6.229244: 98%|▉| 11264/11520 [00:02<00:0
- Val, Loglike in nats: 6.070783: 80%|▊| 1024/1280 [00:00<00:00, 5754.37it/
Epoch 261: Train, Loglike in nats: 6.223459: 98%|▉| 11264/11520 [00:03<00:0
- Val, Loglike in nats: 6.175782: 80%|▊| 1024/1280 [00:00<00:00, 8954.42it/
Epoch 262: Train, Loglike in nats: 6.238076: 98%|▉| 11264/11520 [00:02<00:0
- Val, Loglike in nats: 6.192896: 80%|▊| 1024/1280 [00:00<00:00, 8817.41it/
Epoch 263: Train, Loglike in nats: 6.228003: 98%|▉| 11264/11520 [00:02<00:0
- Val, Loglike in nats: 6.087106: 80%|▊| 1024/1280 [00:00<00:00, 9041.96it/
Epoch 264: Train, Loglike in nats: 6.239620: 98%|▉| 11264/11520 [00:02<00:0
- Val, Loglike in nats: 6.196321: 80%|▊| 1024/1280 [00:00<00:00, 8469.52it/
Epoch 265: Train, Loglike in nats: 6.240774: 98%|▉| 11264/11520 [00:02<00:0
- Val, Loglike in nats: 6.130541: 80%|▊| 1024/1280 [00:00<00:00, 9059.14it/
Epoch 266: Train, Loglike in nats: 6.258704: 98%|▉| 11264/11520 [00:02<00:0
- Val, Loglike in nats: 6.134007: 80%|▊| 1024/1280 [00:00<00:00, 8928.99it/
Epoch 267: Train, Loglike in nats: 6.240042: 98%|▉| 11264/11520 [00:02<00:0
- Val, Loglike in nats: 6.201356: 80%|▊| 1024/1280 [00:00<00:00, 3442.43it/
Epoch 268: Train, Loglike in nats: 6.225747: 98%|▉| 11264/11520 [00:02<00:0
- Val, Loglike in nats: 6.070212: 80%|▊| 1024/1280 [00:00<00:00, 9378.93it/
Epoch 269: Train, Loglike in nats: 6.202410: 98%|▉| 11264/11520 [00:02<00:0
- Val, Loglike in nats: 6.229268: 80%|▊| 1024/1280 [00:00<00:00, 8724.09it/
Epoch 270: Train, Loglike in nats: 6.238284: 98%|▉| 11264/11520 [00:02<00:0
- Val, Loglike in nats: 6.154505: 80%|▊| 1024/1280 [00:00<00:00, 8554.72it/
Epoch 271: Train, Loglike in nats: 6.255405: 98%|▉| 11264/11520 [00:02<00:0
- Val, Loglike in nats: 6.183676: 80%|▊| 1024/1280 [00:00<00:00, 8894.28it/
Epoch 272: Train, Loglike in nats: 6.251064: 98%|▉| 11264/11520 [00:03<00:0
- Val, Loglike in nats: 6.109962: 80%|▊| 1024/1280 [00:00<00:00, 8777.35it/
Epoch 273: Train, Loglike in nats: 6.222325: 98%|▉| 11264/11520 [00:03<00:0
- Val, Loglike in nats: 6.216261: 80%|▊| 1024/1280 [00:00<00:00, 4552.89it/
Epoch 274: Train, Loglike in nats: 6.230293: 98%|▉| 11264/11520 [00:02<00:0
- Val, Loglike in nats: 6.085872: 80%|▊| 1024/1280 [00:00<00:00, 9135.93it/
Epoch 275: Train, Loglike in nats: 6.239738: 98%|▉| 11264/11520 [00:02<00:0
- Val, Loglike in nats: 6.084197: 80%|▊| 1024/1280 [00:00<00:00, 8925.68it/
Epoch 276: Train, Loglike in nats: 6.242204: 98%|▉| 11264/11520 [00:02<00:0
- Val, Loglike in nats: 6.218448: 80%|▊| 1024/1280 [00:00<00:00, 8773.06it/
Epoch 277: Train, Loglike in nats: 6.265805: 98%|▉| 11264/11520 [00:02<00:0
- Val, Loglike in nats: 6.248243: 80%|▊| 1024/1280 [00:00<00:00, 8622.22it/
Epoch 278: Train, Loglike in nats: 6.281532: 98%|▉| 11264/11520 [00:03<00:0
- Val, Loglike in nats: 6.252408: 80%|▊| 1024/1280 [00:00<00:00, 8575.13it/
Epoch 279: Train, Loglike in nats: 6.275621: 98%|▉| 11264/11520 [00:02<00:0
- Val, Loglike in nats: 6.258754: 80%|▊| 1024/1280 [00:00<00:00, 5241.85it/
Epoch 280: Train, Loglike in nats: 6.264493: 98%|▉| 11264/11520 [00:02<00:0
- Val, Loglike in nats: 6.190695: 80%|▊| 1024/1280 [00:00<00:00, 4368.48it/
Epoch 281: Train, Loglike in nats: 6.252128: 98%|▉| 11264/11520 [00:02<00:0
- Val, Loglike in nats: 6.139920: 80%|▊| 1024/1280 [00:00<00:00, 4147.97it/
Epoch 282: Train, Loglike in nats: 6.280600: 98%|▉| 11264/11520 [00:02<00:0
- Val, Loglike in nats: 6.094954: 80%|▊| 1024/1280 [00:00<00:00, 9193.49it/
Epoch 283: Train, Loglike in nats: 6.248595: 98%|▉| 11264/11520 [00:03<00:0
- Val, Loglike in nats: 6.147238: 80%|▊| 1024/1280 [00:00<00:00, 8943.62it/
Epoch 284: Train, Loglike in nats: 6.253563: 98%|▉| 11264/11520 [00:02<00:0
- Val, Loglike in nats: 6.219102: 80%|▊| 1024/1280 [00:00<00:00, 8768.69it/
Epoch 285: Train, Loglike in nats: 6.248441: 98%|▉| 11264/11520 [00:03<00:0
- Val, Loglike in nats: 6.253283: 80%|▊| 1024/1280 [00:00<00:00, 8753.32it/
Epoch 286: Train, Loglike in nats: 6.274932: 98%|▉| 11264/11520 [00:02<00:0
- Val, Loglike in nats: 6.201911: 80%|▊| 1024/1280 [00:00<00:00, 9119.97it/
Epoch 287: Train, Loglike in nats: 6.282821: 98%|▉| 11264/11520 [00:03<00:0
- Val, Loglike in nats: 6.179048: 80%|▊| 1024/1280 [00:00<00:00, 9206.63it/
Epoch 288: Train, Loglike in nats: 6.283505: 98%|▉| 11264/11520 [00:02<00:0
- Val, Loglike in nats: 6.161070: 80%|▊| 1024/1280 [00:00<00:00, 8414.15it/
Epoch 289: Train, Loglike in nats: 6.253220: 98%|▉| 11264/11520 [00:03<00:0
- Val, Loglike in nats: 6.129789: 80%|▊| 1024/1280 [00:00<00:00, 8541.32it/
Epoch 290: Train, Loglike in nats: 6.281913: 98%|▉| 11264/11520 [00:02<00:0
- Val, Loglike in nats: 6.177587: 80%|▊| 1024/1280 [00:00<00:00, 3787.79it/
Epoch 291: Train, Loglike in nats: 6.260824: 98%|▉| 11264/11520 [00:03<00:0
- Val, Loglike in nats: 6.169320: 80%|▊| 1024/1280 [00:00<00:00, 3484.71it/
Epoch 292: Train, Loglike in nats: 6.284425: 98%|▉| 11264/11520 [00:03<00:0
- Val, Loglike in nats: 6.072508: 80%|▊| 1024/1280 [00:00<00:00, 9032.30it/
Epoch 293: Train, Loglike in nats: 6.253657: 98%|▉| 11264/11520 [00:02<00:0
- Val, Loglike in nats: 6.129054: 80%|▊| 1024/1280 [00:00<00:00, 8892.14it/
Epoch 294: Train, Loglike in nats: 6.269070: 98%|▉| 11264/11520 [00:03<00:0
- Val, Loglike in nats: 6.288439: 80%|▊| 1024/1280 [00:00<00:00, 9185.50it/
Epoch 295: Train, Loglike in nats: 6.219231: 98%|▉| 11264/11520 [00:02<00:0
- Val, Loglike in nats: 6.162266: 80%|▊| 1024/1280 [00:00<00:00, 9304.28it/
Epoch 296: Train, Loglike in nats: 6.251959: 98%|▉| 11264/11520 [00:03<00:0
- Val, Loglike in nats: 6.235776: 80%|▊| 1024/1280 [00:00<00:00, 9260.95it/
Epoch 297: Train, Loglike in nats: 6.250069: 98%|▉| 11264/11520 [00:02<00:0
- Val, Loglike in nats: 6.188086: 80%|▊| 1024/1280 [00:00<00:00, 9132.09it/
Epoch 298: Train, Loglike in nats: 6.266000: 98%|▉| 11264/11520 [00:03<00:0
- Val, Loglike in nats: 6.193928: 80%|▊| 1024/1280 [00:00<00:00, 8817.64it/
Epoch 299: Train, Loglike in nats: 6.284518: 98%|▉| 11264/11520 [00:03<00:0
- Val, Loglike in nats: 6.120339: 80%|▊| 1024/1280 [00:00<00:00, 5651.68it/
Now we can apply the trained model to derive the model posterior for any sine curve. Nbi uses importance sampling to deliver asymptotically exact results if you specify x_err in engine.predict().
[16]:
plt.figure(figsize=(5,3))
np.random.seed(4)
# draw random parameter from prior
y_true = [var.rvs(1)[0] for var in priors]
x_err = 0.1
x_obs = sine(y_true) + np.random.normal(size=50) * x_err
plt.errorbar(t, x_obs, yerr=x_err, fmt='.')
plt.show()
y_pred, weights = engine.predict(x_obs, x_err=np.array([0.1]*50), y_true=y_true, n_samples=12800, corner=True, corner_reweight=True,seed=0)
plt.show()
Samples outside prior N = 1512
surrogate posterior
Generating simulations
1129it [00:00, 2181.67it/s]
WARNING:root:Too few points to create valid contours
Effective Sample Size = 2656.2
Sampling efficiency = 20.8%
[14]:
# You can now easily distribute the trained model by sending the best checkpoint:
best_model = engine.best_params
print('Best model checkpoint is saved to:', best_model)
Best model checkpoint is saved to: test2/0/299.pth
[17]:
# Others can easily load the trained model for inference using the state_dict parameter
# Since the state_dict contains the network hyperparameters, no need to supply flow and featurizer dictionaries
engine_loaded = nbi.NBI(
state_dict=best_model,
simulator=sine,
priors=priors,
labels=labels,
device='cpu',
path='test2',
n_jobs=10
)
y_pred2, weights2 = engine_loaded.predict(x_obs, x_err=np.array([0.1]*50), y_true=y_true, n_samples=12800, seed=0)
Samples outside prior N = 1512
Generating simulations
1129it [00:00, 2437.05it/s]
Effective Sample Size = 2656.2
Sampling efficiency = 20.8%
[19]:
# the loaded model produces the identical result
np.allclose(y_pred2,y_pred)
[19]:
True
Use case 2: Sequential Neural Posterior Estimation (SNPE)
Let’s say we only want to fit the specific sine curve above.
In this case, we can specify n_rounds > 1 to train the model over multiple rounds to reduce the number of training samples required. The basic idea is to generate more training samples near the final posterior (as opposed to the broad prior).
[8]:
# hyperparameters remain the same as ANPE
flow = {
'n_dims': 3, # dimension of parameter space
'flow_hidden': 128,
'num_blocks': 5,
'n_mog':4
}
# the NBI package provides the "ResNet-GRU" network as the default
# featurizer network for sequential data
featurizer = {
'type': 'resnet-gru',
'norm': 'weight_norm',
'dim_in': 1,
'dim_out': 128,
'dim_conv_max': 256,
'depth': 3
}
# initializtion is teh same with ANPE
engine = nbi.NBI(
flow=flow,
featurizer=featurizer,
simulator=sine,
priors=priors,
labels=labels,
path='test',
device='cpu',
n_jobs=10,
)
[9]:
engine.fit(
x_obs=x_obs,
y_true=y_true,
n_sims=2560, # N = 5120 per round
n_rounds=5, # Max 5 rounds. (also see early_stop_traing)
n_epochs=300,
batch_size=128,
lr=0.0005,
early_stop_train=True, # If sampling efficiency is reduced for this round, stop and revert to previous round
early_stop_patience=50, # Within a round, wait this many epochs before stopping training
noise=np.array([0.1]*50) # assume homogeneous noise; used for importance sampling
)
Auto learning rate to min_lr = 8.333333333333333e-07
Generating simulations
256it [00:00, 2883.50it/s]
Effective sample size for current/all rounds 0.0/0.0
---------------------- Round: 0 ----------------------
Epoch 0: Train, Loglike in nats: -3.268526: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: -2.459209: 100%|█| 256/256 [00:00<00:00, 1261.47it/s
Epoch 1: Train, Loglike in nats: -2.159331: 100%|█| 2304/2304 [00:01<00:00,
- Val, Loglike in nats: -1.682208: 100%|█| 256/256 [00:00<00:00, 5980.08it/s
Epoch 2: Train, Loglike in nats: -1.848469: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: -1.720842: 100%|█| 256/256 [00:00<00:00, 5995.34it/s
Epoch 3: Train, Loglike in nats: -1.418813: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: -1.714325: 100%|█| 256/256 [00:00<00:00, 2912.96it/s
Epoch 4: Train, Loglike in nats: -1.574528: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: -1.149077: 100%|█| 256/256 [00:00<00:00, 6075.26it/s
Epoch 5: Train, Loglike in nats: -1.042438: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: -0.894966: 100%|█| 256/256 [00:00<00:00, 6068.22it/s
Epoch 6: Train, Loglike in nats: -1.492501: 100%|█| 2304/2304 [00:01<00:00,
- Val, Loglike in nats: -0.985928: 100%|█| 256/256 [00:00<00:00, 6169.26it/s
Epoch 7: Train, Loglike in nats: -0.870418: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: -1.858480: 100%|█| 256/256 [00:00<00:00, 6307.59it/s
Epoch 8: Train, Loglike in nats: -1.463720: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: -0.996620: 100%|█| 256/256 [00:00<00:00, 4096.20it/s
Epoch 9: Train, Loglike in nats: -0.352051: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: -0.155534: 100%|█| 256/256 [00:00<00:00, 6595.59it/s
Epoch 10: Train, Loglike in nats: 0.064110: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: -0.162349: 100%|█| 256/256 [00:00<00:00, 6389.30it/s
Epoch 11: Train, Loglike in nats: 0.033803: 100%|█| 2304/2304 [00:01<00:00,
- Val, Loglike in nats: 0.437606: 100%|█| 256/256 [00:00<00:00, 6336.63it/s]
Epoch 12: Train, Loglike in nats: 0.734700: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 1.128706: 100%|█| 256/256 [00:00<00:00, 6170.47it/s]
Epoch 13: Train, Loglike in nats: 0.713297: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 0.360700: 100%|█| 256/256 [00:00<00:00, 4876.74it/s]
Epoch 14: Train, Loglike in nats: 0.514453: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 0.425054: 100%|█| 256/256 [00:00<00:00, 6240.54it/s]
Epoch 15: Train, Loglike in nats: 0.929215: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 1.359069: 100%|█| 256/256 [00:00<00:00, 5791.86it/s]
Epoch 16: Train, Loglike in nats: 1.220240: 100%|█| 2304/2304 [00:01<00:00,
- Val, Loglike in nats: 1.527185: 100%|█| 256/256 [00:00<00:00, 6140.12it/s]
Epoch 17: Train, Loglike in nats: 0.711048: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 1.133904: 100%|█| 256/256 [00:00<00:00, 6629.71it/s]
Epoch 18: Train, Loglike in nats: 1.415741: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 1.513332: 100%|█| 256/256 [00:00<00:00, 1634.17it/s]
Epoch 19: Train, Loglike in nats: 1.074183: 100%|█| 2304/2304 [00:01<00:00,
- Val, Loglike in nats: 0.832191: 100%|█| 256/256 [00:00<00:00, 6499.61it/s]
Epoch 20: Train, Loglike in nats: 1.293864: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 1.259685: 100%|█| 256/256 [00:00<00:00, 6307.11it/s]
Epoch 21: Train, Loglike in nats: 1.439562: 100%|█| 2304/2304 [00:01<00:00,
- Val, Loglike in nats: 1.355938: 100%|█| 256/256 [00:00<00:00, 6386.91it/s]
Epoch 22: Train, Loglike in nats: 1.374695: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 0.132194: 100%|█| 256/256 [00:00<00:00, 6079.77it/s]
Epoch 23: Train, Loglike in nats: 0.716420: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 1.554517: 100%|█| 256/256 [00:00<00:00, 4842.89it/s]
Epoch 24: Train, Loglike in nats: 1.595632: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 1.770648: 100%|█| 256/256 [00:00<00:00, 6380.08it/s]
Epoch 25: Train, Loglike in nats: 1.967934: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 1.051805: 100%|█| 256/256 [00:00<00:00, 6309.63it/s]
Epoch 26: Train, Loglike in nats: -0.527291: 100%|█| 2304/2304 [00:01<00:00,
- Val, Loglike in nats: 0.457400: 100%|█| 256/256 [00:00<00:00, 6251.52it/s]
Epoch 27: Train, Loglike in nats: 1.125868: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 1.251953: 100%|█| 256/256 [00:00<00:00, 6726.02it/s]
Epoch 28: Train, Loglike in nats: 1.543339: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 1.801289: 100%|█| 256/256 [00:00<00:00, 6317.58it/s]
Epoch 29: Train, Loglike in nats: 1.911407: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 1.962026: 100%|█| 256/256 [00:00<00:00, 6368.61it/s]
Epoch 30: Train, Loglike in nats: 0.037019: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 0.268609: 100%|█| 256/256 [00:00<00:00, 6307.45it/s]
Epoch 31: Train, Loglike in nats: 0.250173: 100%|█| 2304/2304 [00:01<00:00,
- Val, Loglike in nats: 0.763747: 100%|█| 256/256 [00:00<00:00, 6089.01it/s]
Epoch 32: Train, Loglike in nats: 1.401325: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 1.665264: 100%|█| 256/256 [00:00<00:00, 6457.98it/s]
Epoch 33: Train, Loglike in nats: 1.984000: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 2.180026: 100%|█| 256/256 [00:00<00:00, 4943.61it/s]
Epoch 34: Train, Loglike in nats: 2.048396: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 1.844047: 100%|█| 256/256 [00:00<00:00, 6295.46it/s]
Epoch 35: Train, Loglike in nats: 1.620334: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 1.313894: 100%|█| 256/256 [00:00<00:00, 6130.55it/s]
Epoch 36: Train, Loglike in nats: 1.512009: 100%|█| 2304/2304 [00:01<00:00,
- Val, Loglike in nats: 1.536890: 100%|█| 256/256 [00:00<00:00, 6033.04it/s]
Epoch 37: Train, Loglike in nats: 1.894795: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 2.025642: 100%|█| 256/256 [00:00<00:00, 5940.91it/s]
Epoch 38: Train, Loglike in nats: 2.259384: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 2.483783: 100%|█| 256/256 [00:00<00:00, 1330.48it/s]
Epoch 39: Train, Loglike in nats: 2.342173: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 2.026701: 100%|█| 256/256 [00:00<00:00, 6246.50it/s]
Epoch 40: Train, Loglike in nats: 1.204104: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 0.647072: 100%|█| 256/256 [00:00<00:00, 5923.05it/s]
Epoch 41: Train, Loglike in nats: 1.778243: 100%|█| 2304/2304 [00:01<00:00,
- Val, Loglike in nats: 1.732202: 100%|█| 256/256 [00:00<00:00, 6028.94it/s]
Epoch 42: Train, Loglike in nats: 2.145499: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 2.264459: 100%|█| 256/256 [00:00<00:00, 6059.05it/s]
Epoch 43: Train, Loglike in nats: 2.471862: 100%|█| 2304/2304 [00:01<00:00,
- Val, Loglike in nats: 2.704911: 100%|█| 256/256 [00:00<00:00, 5937.75it/s]
Epoch 44: Train, Loglike in nats: 2.117804: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 2.275875: 100%|█| 256/256 [00:00<00:00, 6285.00it/s]
Epoch 45: Train, Loglike in nats: 0.706343: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 1.236873: 100%|█| 256/256 [00:00<00:00, 5896.28it/s]
Epoch 46: Train, Loglike in nats: 2.225131: 100%|█| 2304/2304 [00:01<00:00,
- Val, Loglike in nats: 2.611018: 100%|█| 256/256 [00:00<00:00, 5948.94it/s]
Epoch 47: Train, Loglike in nats: 2.906169: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 3.025538: 100%|█| 256/256 [00:00<00:00, 6114.46it/s]
Epoch 48: Train, Loglike in nats: 3.254640: 100%|█| 2304/2304 [00:01<00:00,
- Val, Loglike in nats: 3.117925: 100%|█| 256/256 [00:00<00:00, 6070.52it/s]
Epoch 49: Train, Loglike in nats: 2.208368: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 1.511522: 100%|█| 256/256 [00:00<00:00, 6092.50it/s]
Epoch 50: Train, Loglike in nats: 0.267897: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 2.196132: 100%|█| 256/256 [00:00<00:00, 1537.70it/s]
Epoch 51: Train, Loglike in nats: 2.917408: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 3.254388: 100%|█| 256/256 [00:00<00:00, 6633.85it/s]
Epoch 52: Train, Loglike in nats: 3.546430: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 3.643027: 100%|█| 256/256 [00:00<00:00, 6455.34it/s]
Epoch 53: Train, Loglike in nats: 3.714629: 100%|█| 2304/2304 [00:01<00:00,
- Val, Loglike in nats: 3.687727: 100%|█| 256/256 [00:00<00:00, 6390.10it/s]
Epoch 54: Train, Loglike in nats: 3.723377: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 3.727478: 100%|█| 256/256 [00:00<00:00, 6687.23it/s]
Epoch 55: Train, Loglike in nats: 3.166823: 100%|█| 2304/2304 [00:01<00:00,
- Val, Loglike in nats: 1.733759: 100%|█| 256/256 [00:00<00:00, 6281.76it/s]
Epoch 56: Train, Loglike in nats: 3.368278: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 3.668584: 100%|█| 256/256 [00:00<00:00, 6511.99it/s]
Epoch 57: Train, Loglike in nats: 3.880386: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.082314: 100%|█| 256/256 [00:00<00:00, 6652.96it/s]
Epoch 58: Train, Loglike in nats: 4.114445: 100%|█| 2304/2304 [00:01<00:00,
- Val, Loglike in nats: 4.050641: 100%|█| 256/256 [00:00<00:00, 6616.19it/s]
Epoch 59: Train, Loglike in nats: 3.763349: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 3.134168: 100%|█| 256/256 [00:00<00:00, 6589.48it/s]
Epoch 60: Train, Loglike in nats: 3.282981: 100%|█| 2304/2304 [00:01<00:00,
- Val, Loglike in nats: 3.616098: 100%|█| 256/256 [00:00<00:00, 6412.85it/s]
Epoch 61: Train, Loglike in nats: 4.023603: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.176076: 100%|█| 256/256 [00:00<00:00, 6790.68it/s]
Epoch 62: Train, Loglike in nats: 4.472724: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.489458: 100%|█| 256/256 [00:00<00:00, 6416.53it/s]
Epoch 63: Train, Loglike in nats: 4.359788: 100%|█| 2304/2304 [00:01<00:00,
- Val, Loglike in nats: 4.409226: 100%|█| 256/256 [00:00<00:00, 6229.75it/s]
Epoch 64: Train, Loglike in nats: 3.739900: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.325349: 100%|█| 256/256 [00:00<00:00, 6471.64it/s]
Epoch 65: Train, Loglike in nats: 4.625143: 100%|█| 2304/2304 [00:01<00:00,
- Val, Loglike in nats: 4.595809: 100%|█| 256/256 [00:00<00:00, 6779.70it/s]
Epoch 66: Train, Loglike in nats: 4.712687: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.558172: 100%|█| 256/256 [00:00<00:00, 6508.67it/s]
Epoch 67: Train, Loglike in nats: 4.634473: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.542986: 100%|█| 256/256 [00:00<00:00, 6633.32it/s]
Epoch 68: Train, Loglike in nats: 4.698652: 100%|█| 2304/2304 [00:01<00:00,
- Val, Loglike in nats: 4.720885: 100%|█| 256/256 [00:00<00:00, 6428.78it/s]
Epoch 69: Train, Loglike in nats: 3.947856: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 2.944192: 100%|█| 256/256 [00:00<00:00, 6437.80it/s]
Epoch 70: Train, Loglike in nats: 4.448578: 100%|█| 2304/2304 [00:01<00:00,
- Val, Loglike in nats: 4.082244: 100%|█| 256/256 [00:00<00:00, 6629.06it/s]
Epoch 71: Train, Loglike in nats: 4.788922: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.949507: 100%|█| 256/256 [00:00<00:00, 6749.61it/s]
Epoch 72: Train, Loglike in nats: 4.978190: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.942903: 100%|█| 256/256 [00:00<00:00, 1460.23it/s]
Epoch 73: Train, Loglike in nats: 4.892810: 100%|█| 2304/2304 [00:01<00:00,
- Val, Loglike in nats: 4.318020: 100%|█| 256/256 [00:00<00:00, 6285.96it/s]
Epoch 74: Train, Loglike in nats: 2.601273: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 3.881264: 100%|█| 256/256 [00:00<00:00, 6373.83it/s]
Epoch 75: Train, Loglike in nats: 4.411237: 100%|█| 2304/2304 [00:01<00:00,
- Val, Loglike in nats: 4.428556: 100%|█| 256/256 [00:00<00:00, 6526.00it/s]
Epoch 76: Train, Loglike in nats: 4.798160: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.791045: 100%|█| 256/256 [00:00<00:00, 6663.53it/s]
Epoch 77: Train, Loglike in nats: 5.071071: 100%|█| 2304/2304 [00:01<00:00,
- Val, Loglike in nats: 4.851388: 100%|█| 256/256 [00:00<00:00, 6373.91it/s]
Epoch 78: Train, Loglike in nats: 5.101960: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.549327: 100%|█| 256/256 [00:00<00:00, 5811.86it/s]
Epoch 79: Train, Loglike in nats: 5.037960: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.690504: 100%|█| 256/256 [00:00<00:00, 5669.21it/s]
Epoch 80: Train, Loglike in nats: 4.213198: 100%|█| 2304/2304 [00:01<00:00,
- Val, Loglike in nats: 4.821634: 100%|█| 256/256 [00:00<00:00, 6268.63it/s]
Epoch 81: Train, Loglike in nats: 4.719924: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 5.144917: 100%|█| 256/256 [00:00<00:00, 6301.52it/s]
Epoch 82: Train, Loglike in nats: 5.324505: 100%|█| 2304/2304 [00:01<00:00,
- Val, Loglike in nats: 5.265930: 100%|█| 256/256 [00:00<00:00, 6158.44it/s]
Epoch 83: Train, Loglike in nats: 4.917983: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.838337: 100%|█| 256/256 [00:00<00:00, 6288.35it/s]
Epoch 84: Train, Loglike in nats: 5.263070: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 5.360596: 100%|█| 256/256 [00:00<00:00, 6268.34it/s]
Epoch 85: Train, Loglike in nats: 5.480107: 100%|█| 2304/2304 [00:01<00:00,
- Val, Loglike in nats: 5.295392: 100%|█| 256/256 [00:00<00:00, 5964.60it/s]
Epoch 86: Train, Loglike in nats: 5.351205: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.789269: 100%|█| 256/256 [00:00<00:00, 5830.90it/s]
Epoch 87: Train, Loglike in nats: 4.893774: 100%|█| 2304/2304 [00:01<00:00,
- Val, Loglike in nats: 4.206510: 100%|█| 256/256 [00:00<00:00, 6414.73it/s]
Epoch 88: Train, Loglike in nats: 4.854108: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.709023: 100%|█| 256/256 [00:00<00:00, 6088.73it/s]
Epoch 89: Train, Loglike in nats: 5.183822: 100%|█| 2304/2304 [00:01<00:00,
- Val, Loglike in nats: 5.275519: 100%|█| 256/256 [00:00<00:00, 5933.06it/s]
Epoch 90: Train, Loglike in nats: 5.462302: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 5.404655: 100%|█| 256/256 [00:00<00:00, 6086.83it/s]
Epoch 91: Train, Loglike in nats: 5.478829: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 5.444710: 100%|█| 256/256 [00:00<00:00, 6074.85it/s]
Epoch 92: Train, Loglike in nats: 5.184221: 100%|█| 2304/2304 [00:01<00:00,
- Val, Loglike in nats: 4.115625: 100%|█| 256/256 [00:00<00:00, 6139.25it/s]
Epoch 93: Train, Loglike in nats: 5.066727: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 5.575367: 100%|█| 256/256 [00:00<00:00, 6355.83it/s]
Epoch 94: Train, Loglike in nats: 5.498914: 100%|█| 2304/2304 [00:01<00:00,
- Val, Loglike in nats: 5.554475: 100%|█| 256/256 [00:00<00:00, 6413.92it/s]
Epoch 95: Train, Loglike in nats: 5.521467: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 5.059930: 100%|█| 256/256 [00:00<00:00, 6179.84it/s]
Epoch 96: Train, Loglike in nats: 4.965427: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 3.261661: 100%|█| 256/256 [00:00<00:00, 6291.78it/s]
Epoch 97: Train, Loglike in nats: 4.968622: 100%|█| 2304/2304 [00:01<00:00,
- Val, Loglike in nats: 5.169197: 100%|█| 256/256 [00:00<00:00, 6325.69it/s]
Epoch 98: Train, Loglike in nats: 5.541847: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 5.742117: 100%|█| 256/256 [00:00<00:00, 6243.30it/s]
Epoch 99: Train, Loglike in nats: 5.661441: 100%|█| 2304/2304 [00:01<00:00,
- Val, Loglike in nats: 5.223972: 100%|█| 256/256 [00:00<00:00, 5850.21it/s]
Epoch 100: Train, Loglike in nats: 4.972398: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 5.572842: 100%|█| 256/256 [00:00<00:00, 6295.65it/s]
Epoch 101: Train, Loglike in nats: 5.779009: 100%|█| 2304/2304 [00:01<00:00,
- Val, Loglike in nats: 5.781581: 100%|█| 256/256 [00:00<00:00, 6259.79it/s]
Epoch 102: Train, Loglike in nats: 5.850139: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 5.807649: 100%|█| 256/256 [00:00<00:00, 6041.42it/s]
Epoch 103: Train, Loglike in nats: 5.958394: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 5.970178: 100%|█| 256/256 [00:00<00:00, 6045.71it/s]
Epoch 104: Train, Loglike in nats: 5.922030: 100%|█| 2304/2304 [00:01<00:00,
- Val, Loglike in nats: 5.640943: 100%|█| 256/256 [00:00<00:00, 6191.64it/s]
Epoch 105: Train, Loglike in nats: 5.830493: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 5.658373: 100%|█| 256/256 [00:00<00:00, 6261.18it/s]
Epoch 106: Train, Loglike in nats: 5.917760: 100%|█| 2304/2304 [00:01<00:00,
- Val, Loglike in nats: 5.658114: 100%|█| 256/256 [00:00<00:00, 5785.68it/s]
Epoch 107: Train, Loglike in nats: 5.942582: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 5.720334: 100%|█| 256/256 [00:00<00:00, 6181.20it/s]
Epoch 108: Train, Loglike in nats: 6.048959: 100%|█| 2304/2304 [00:01<00:00,
- Val, Loglike in nats: 6.026139: 100%|█| 256/256 [00:00<00:00, 5834.19it/s]
Epoch 109: Train, Loglike in nats: 6.068287: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 5.803365: 100%|█| 256/256 [00:00<00:00, 6333.15it/s]
Epoch 110: Train, Loglike in nats: 5.634220: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.819095: 100%|█| 256/256 [00:00<00:00, 6168.09it/s]
Epoch 111: Train, Loglike in nats: 5.769787: 100%|█| 2304/2304 [00:01<00:00,
- Val, Loglike in nats: 5.741638: 100%|█| 256/256 [00:00<00:00, 6521.32it/s]
Epoch 112: Train, Loglike in nats: 5.882873: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 6.010417: 100%|█| 256/256 [00:00<00:00, 6583.86it/s]
Epoch 113: Train, Loglike in nats: 6.009948: 100%|█| 2304/2304 [00:01<00:00,
- Val, Loglike in nats: 5.562791: 100%|█| 256/256 [00:00<00:00, 6101.15it/s]
Epoch 114: Train, Loglike in nats: 6.008356: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 5.888279: 100%|█| 256/256 [00:00<00:00, 6160.84it/s]
Epoch 115: Train, Loglike in nats: 6.052705: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 5.892685: 100%|█| 256/256 [00:00<00:00, 6297.94it/s]
Epoch 116: Train, Loglike in nats: 6.042388: 100%|█| 2304/2304 [00:01<00:00,
- Val, Loglike in nats: 5.901352: 100%|█| 256/256 [00:00<00:00, 6343.74it/s]
Epoch 117: Train, Loglike in nats: 6.034147: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 5.474616: 100%|█| 256/256 [00:00<00:00, 6370.50it/s]
Epoch 118: Train, Loglike in nats: 5.642377: 100%|█| 2304/2304 [00:01<00:00,
- Val, Loglike in nats: 5.856933: 100%|█| 256/256 [00:00<00:00, 6289.01it/s]
Epoch 119: Train, Loglike in nats: 5.894026: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 6.044425: 100%|█| 256/256 [00:00<00:00, 6137.91it/s]
Epoch 120: Train, Loglike in nats: 6.172974: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 6.079485: 100%|█| 256/256 [00:00<00:00, 1686.47it/s]
Epoch 121: Train, Loglike in nats: 6.026621: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 5.917090: 100%|█| 256/256 [00:00<00:00, 6058.33it/s]
Epoch 122: Train, Loglike in nats: 6.219800: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 6.005662: 100%|█| 256/256 [00:00<00:00, 6077.43it/s]
Epoch 123: Train, Loglike in nats: 6.309060: 100%|█| 2304/2304 [00:01<00:00,
- Val, Loglike in nats: 6.213336: 100%|█| 256/256 [00:00<00:00, 6058.02it/s]
Epoch 124: Train, Loglike in nats: 6.197256: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 5.882795: 100%|█| 256/256 [00:00<00:00, 6226.32it/s]
Epoch 125: Train, Loglike in nats: 6.096331: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 6.173139: 100%|█| 256/256 [00:00<00:00, 6019.14it/s]
Epoch 126: Train, Loglike in nats: 5.885933: 100%|█| 2304/2304 [00:01<00:00,
- Val, Loglike in nats: 5.818267: 100%|█| 256/256 [00:00<00:00, 6200.04it/s]
Epoch 127: Train, Loglike in nats: 5.378657: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 5.571177: 100%|█| 256/256 [00:00<00:00, 5992.53it/s]
Epoch 128: Train, Loglike in nats: 5.645857: 100%|█| 2304/2304 [00:01<00:00,
- Val, Loglike in nats: 5.298625: 100%|█| 256/256 [00:00<00:00, 6510.21it/s]
Epoch 129: Train, Loglike in nats: 5.837600: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 5.992451: 100%|█| 256/256 [00:00<00:00, 6344.00it/s]
Epoch 130: Train, Loglike in nats: 6.119033: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 6.149038: 100%|█| 256/256 [00:00<00:00, 6883.53it/s]
Epoch 131: Train, Loglike in nats: 6.245521: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 5.930585: 100%|█| 256/256 [00:00<00:00, 6699.16it/s]
Epoch 132: Train, Loglike in nats: 6.261621: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 5.998144: 100%|█| 256/256 [00:00<00:00, 6566.02it/s]
Epoch 133: Train, Loglike in nats: 6.341798: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 6.346358: 100%|█| 256/256 [00:00<00:00, 6596.60it/s]
Epoch 134: Train, Loglike in nats: 6.401124: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 6.237489: 100%|█| 256/256 [00:00<00:00, 6981.37it/s]
Epoch 135: Train, Loglike in nats: 6.132567: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 6.047589: 100%|█| 256/256 [00:00<00:00, 6708.96it/s]
Epoch 136: Train, Loglike in nats: 6.230725: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 5.994621: 100%|█| 256/256 [00:00<00:00, 6747.62it/s]
Epoch 137: Train, Loglike in nats: 6.246450: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 6.284387: 100%|█| 256/256 [00:00<00:00, 6725.18it/s]
Epoch 138: Train, Loglike in nats: 6.182283: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 6.257266: 100%|█| 256/256 [00:00<00:00, 6654.86it/s]
Epoch 139: Train, Loglike in nats: 6.378484: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 6.369561: 100%|█| 256/256 [00:00<00:00, 6337.90it/s]
Epoch 140: Train, Loglike in nats: 6.480492: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 6.383032: 100%|█| 256/256 [00:00<00:00, 6444.64it/s]
Epoch 141: Train, Loglike in nats: 6.489468: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 6.293998: 100%|█| 256/256 [00:00<00:00, 6710.22it/s]
Epoch 142: Train, Loglike in nats: 6.533051: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 6.425118: 100%|█| 256/256 [00:00<00:00, 6697.87it/s]
Epoch 143: Train, Loglike in nats: 6.455296: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 6.181000: 100%|█| 256/256 [00:00<00:00, 6532.11it/s]
Epoch 144: Train, Loglike in nats: 6.200677: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 5.747252: 100%|█| 256/256 [00:00<00:00, 6332.56it/s]
Epoch 145: Train, Loglike in nats: 6.105745: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 5.781116: 100%|█| 256/256 [00:00<00:00, 6397.76it/s]
Epoch 146: Train, Loglike in nats: 6.144907: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 6.042254: 100%|█| 256/256 [00:00<00:00, 6527.27it/s]
Epoch 147: Train, Loglike in nats: 6.060318: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 6.090507: 100%|█| 256/256 [00:00<00:00, 6646.91it/s]
Epoch 148: Train, Loglike in nats: 6.419754: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 6.284282: 100%|█| 256/256 [00:00<00:00, 6610.04it/s]
Epoch 149: Train, Loglike in nats: 6.500065: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 6.493800: 100%|█| 256/256 [00:00<00:00, 6348.92it/s]
Epoch 150: Train, Loglike in nats: 6.546723: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 6.087693: 100%|█| 256/256 [00:00<00:00, 6234.89it/s]
Epoch 151: Train, Loglike in nats: 6.468393: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 6.122276: 100%|█| 256/256 [00:00<00:00, 6540.94it/s]
Epoch 152: Train, Loglike in nats: 6.583395: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 6.481585: 100%|█| 256/256 [00:00<00:00, 6110.63it/s]
Epoch 153: Train, Loglike in nats: 6.571469: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 6.435233: 100%|█| 256/256 [00:00<00:00, 6414.73it/s]
Epoch 154: Train, Loglike in nats: 6.534500: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 6.312248: 100%|█| 256/256 [00:00<00:00, 6529.25it/s]
Epoch 155: Train, Loglike in nats: 6.627038: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 6.548282: 100%|█| 256/256 [00:00<00:00, 6447.08it/s]
Epoch 156: Train, Loglike in nats: 6.588944: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 6.499773: 100%|█| 256/256 [00:00<00:00, 6890.43it/s]
Epoch 157: Train, Loglike in nats: 6.562883: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 6.519076: 100%|█| 256/256 [00:00<00:00, 6318.99it/s]
Epoch 158: Train, Loglike in nats: 6.608741: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 6.425825: 100%|█| 256/256 [00:00<00:00, 6462.37it/s]
Epoch 159: Train, Loglike in nats: 6.558365: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 6.334709: 100%|█| 256/256 [00:00<00:00, 6423.78it/s]
Epoch 160: Train, Loglike in nats: 6.552215: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 6.399486: 100%|█| 256/256 [00:00<00:00, 6294.91it/s]
Epoch 161: Train, Loglike in nats: 6.655611: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 6.340299: 100%|█| 256/256 [00:00<00:00, 6637.46it/s]
Epoch 162: Train, Loglike in nats: 6.651125: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 6.579459: 100%|█| 256/256 [00:00<00:00, 6802.21it/s]
Epoch 163: Train, Loglike in nats: 6.688755: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 6.509596: 100%|█| 256/256 [00:00<00:00, 6130.66it/s]
Epoch 164: Train, Loglike in nats: 6.641705: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 6.578617: 100%|█| 256/256 [00:00<00:00, 6181.59it/s]
Epoch 165: Train, Loglike in nats: 6.652033: 100%|█| 2304/2304 [00:01<00:00,
- Val, Loglike in nats: 6.501852: 100%|█| 256/256 [00:00<00:00, 6098.69it/s]
Epoch 166: Train, Loglike in nats: 6.695315: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 6.601800: 100%|█| 256/256 [00:00<00:00, 5699.93it/s]
Epoch 167: Train, Loglike in nats: 6.740462: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 6.544092: 100%|█| 256/256 [00:00<00:00, 5968.32it/s]
Epoch 168: Train, Loglike in nats: 6.769489: 100%|█| 2304/2304 [00:01<00:00,
- Val, Loglike in nats: 6.610115: 100%|█| 256/256 [00:00<00:00, 6250.46it/s]
Epoch 169: Train, Loglike in nats: 6.754818: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 6.583900: 100%|█| 256/256 [00:00<00:00, 6161.55it/s]
Epoch 170: Train, Loglike in nats: 6.728368: 100%|█| 2304/2304 [00:01<00:00,
- Val, Loglike in nats: 6.433847: 100%|█| 256/256 [00:00<00:00, 6122.79it/s]
Epoch 171: Train, Loglike in nats: 5.814623: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 6.100624: 100%|█| 256/256 [00:00<00:00, 6103.06it/s]
Epoch 172: Train, Loglike in nats: 6.252972: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 6.292130: 100%|█| 256/256 [00:00<00:00, 1814.75it/s]
Epoch 173: Train, Loglike in nats: 6.469107: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 6.249124: 100%|█| 256/256 [00:00<00:00, 6305.74it/s]
Epoch 174: Train, Loglike in nats: 6.617064: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 6.365734: 100%|█| 256/256 [00:00<00:00, 6289.16it/s]
Epoch 175: Train, Loglike in nats: 6.779203: 100%|█| 2304/2304 [00:01<00:00,
- Val, Loglike in nats: 6.570490: 100%|█| 256/256 [00:00<00:00, 6326.32it/s]
Epoch 176: Train, Loglike in nats: 6.786192: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 6.652312: 100%|█| 256/256 [00:00<00:00, 6574.18it/s]
Epoch 177: Train, Loglike in nats: 6.838615: 100%|█| 2304/2304 [00:01<00:00,
- Val, Loglike in nats: 6.647413: 100%|█| 256/256 [00:00<00:00, 6475.46it/s]
Epoch 178: Train, Loglike in nats: 6.867536: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 6.653259: 100%|█| 256/256 [00:00<00:00, 6538.95it/s]
Epoch 179: Train, Loglike in nats: 6.817409: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 6.631561: 100%|█| 256/256 [00:00<00:00, 6505.91it/s]
Epoch 180: Train, Loglike in nats: 6.831194: 100%|█| 2304/2304 [00:01<00:00,
- Val, Loglike in nats: 6.713398: 100%|█| 256/256 [00:00<00:00, 6680.78it/s]
Epoch 181: Train, Loglike in nats: 6.880255: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 6.747829: 100%|█| 256/256 [00:00<00:00, 6326.29it/s]
Epoch 182: Train, Loglike in nats: 6.865285: 100%|█| 2304/2304 [00:01<00:00,
- Val, Loglike in nats: 6.633148: 100%|█| 256/256 [00:00<00:00, 6515.98it/s]
Epoch 183: Train, Loglike in nats: 6.836265: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 6.745353: 100%|█| 256/256 [00:00<00:00, 6167.46it/s]
Epoch 184: Train, Loglike in nats: 6.809363: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 6.620671: 100%|█| 256/256 [00:00<00:00, 6354.89it/s]
Epoch 185: Train, Loglike in nats: 6.810407: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 6.665987: 100%|█| 256/256 [00:00<00:00, 5770.70it/s]
Epoch 186: Train, Loglike in nats: 6.903464: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 6.718751: 100%|█| 256/256 [00:00<00:00, 6524.77it/s]
Epoch 187: Train, Loglike in nats: 6.888197: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 6.679201: 100%|█| 256/256 [00:00<00:00, 3655.99it/s]
Epoch 188: Train, Loglike in nats: 6.892800: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 6.746929: 100%|█| 256/256 [00:00<00:00, 6605.61it/s]
Epoch 189: Train, Loglike in nats: 6.929261: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 6.784347: 100%|█| 256/256 [00:00<00:00, 4970.87it/s]
Epoch 190: Train, Loglike in nats: 6.902624: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 6.666506: 100%|█| 256/256 [00:00<00:00, 6124.50it/s]
Epoch 191: Train, Loglike in nats: 6.884923: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 6.703870: 100%|█| 256/256 [00:00<00:00, 5761.22it/s]
Epoch 192: Train, Loglike in nats: 6.912938: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 6.814867: 100%|█| 256/256 [00:00<00:00, 5764.22it/s]
Epoch 193: Train, Loglike in nats: 6.906339: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 6.639987: 100%|█| 256/256 [00:00<00:00, 5835.52it/s]
Epoch 194: Train, Loglike in nats: 6.959879: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 6.855103: 100%|█| 256/256 [00:00<00:00, 6027.38it/s]
Epoch 195: Train, Loglike in nats: 6.985030: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 6.678816: 100%|█| 256/256 [00:00<00:00, 6013.47it/s]
Epoch 196: Train, Loglike in nats: 6.999685: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 6.808109: 100%|█| 256/256 [00:00<00:00, 5925.69it/s]
Epoch 197: Train, Loglike in nats: 7.021703: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 6.759712: 100%|█| 256/256 [00:00<00:00, 5961.49it/s]
Epoch 198: Train, Loglike in nats: 7.042663: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 6.783630: 100%|█| 256/256 [00:00<00:00, 6524.81it/s]
Epoch 199: Train, Loglike in nats: 6.993849: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 6.784029: 100%|█| 256/256 [00:00<00:00, 5300.52it/s]
Epoch 200: Train, Loglike in nats: 7.002424: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 6.748533: 100%|█| 256/256 [00:00<00:00, 6204.70it/s]
Epoch 201: Train, Loglike in nats: 7.012407: 100%|█| 2304/2304 [00:01<00:00,
- Val, Loglike in nats: 6.860180: 100%|█| 256/256 [00:00<00:00, 3633.31it/s]
Epoch 202: Train, Loglike in nats: 6.953123: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 6.838411: 100%|█| 256/256 [00:00<00:00, 6253.70it/s]
Epoch 203: Train, Loglike in nats: 7.038790: 100%|█| 2304/2304 [00:01<00:00,
- Val, Loglike in nats: 6.843570: 100%|█| 256/256 [00:00<00:00, 2620.69it/s]
Epoch 204: Train, Loglike in nats: 7.013794: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 6.860623: 100%|█| 256/256 [00:00<00:00, 5836.50it/s]
Epoch 205: Train, Loglike in nats: 7.036593: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 6.772624: 100%|█| 256/256 [00:00<00:00, 6114.60it/s]
Epoch 206: Train, Loglike in nats: 7.053233: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 6.794318: 100%|█| 256/256 [00:00<00:00, 6186.90it/s]
Epoch 207: Train, Loglike in nats: 7.078134: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 6.932597: 100%|█| 256/256 [00:00<00:00, 6422.13it/s]
Epoch 208: Train, Loglike in nats: 7.057461: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 6.850798: 100%|█| 256/256 [00:00<00:00, 6722.15it/s]
Epoch 209: Train, Loglike in nats: 7.077501: 100%|█| 2304/2304 [00:01<00:00,
- Val, Loglike in nats: 6.900552: 100%|█| 256/256 [00:00<00:00, 5401.88it/s]
Epoch 210: Train, Loglike in nats: 7.080196: 100%|█| 2304/2304 [00:01<00:00,
- Val, Loglike in nats: 6.857109: 100%|█| 256/256 [00:00<00:00, 5633.93it/s]
Epoch 211: Train, Loglike in nats: 7.114897: 100%|█| 2304/2304 [00:01<00:00,
- Val, Loglike in nats: 6.912014: 100%|█| 256/256 [00:00<00:00, 4374.14it/s]
Epoch 212: Train, Loglike in nats: 7.128048: 100%|█| 2304/2304 [00:01<00:00,
- Val, Loglike in nats: 6.849624: 100%|█| 256/256 [00:00<00:00, 4464.29it/s]
Epoch 213: Train, Loglike in nats: 7.143510: 100%|█| 2304/2304 [00:01<00:00,
- Val, Loglike in nats: 6.848959: 100%|█| 256/256 [00:00<00:00, 3617.30it/s]
Epoch 214: Train, Loglike in nats: 7.088161: 100%|█| 2304/2304 [00:01<00:00,
- Val, Loglike in nats: 6.936358: 100%|█| 256/256 [00:00<00:00, 5338.33it/s]
Epoch 215: Train, Loglike in nats: 7.116961: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 6.940352: 100%|█| 256/256 [00:00<00:00, 4689.83it/s]
Epoch 216: Train, Loglike in nats: 7.121807: 100%|█| 2304/2304 [00:01<00:00,
- Val, Loglike in nats: 6.835408: 100%|█| 256/256 [00:00<00:00, 5121.86it/s]
Epoch 217: Train, Loglike in nats: 7.098231: 100%|█| 2304/2304 [00:01<00:00,
- Val, Loglike in nats: 6.857529: 100%|█| 256/256 [00:00<00:00, 4665.74it/s]
Epoch 218: Train, Loglike in nats: 7.107583: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 6.848279: 100%|█| 256/256 [00:00<00:00, 5203.22it/s]
Epoch 219: Train, Loglike in nats: 7.154936: 100%|█| 2304/2304 [00:01<00:00,
- Val, Loglike in nats: 6.872961: 100%|█| 256/256 [00:00<00:00, 4903.65it/s]
Epoch 220: Train, Loglike in nats: 7.113741: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 6.871563: 100%|█| 256/256 [00:00<00:00, 5313.37it/s]
Epoch 221: Train, Loglike in nats: 7.158687: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 6.966138: 100%|█| 256/256 [00:00<00:00, 4899.51it/s]
Epoch 222: Train, Loglike in nats: 7.149098: 100%|█| 2304/2304 [00:01<00:00,
- Val, Loglike in nats: 6.841647: 100%|█| 256/256 [00:00<00:00, 5525.21it/s]
Epoch 223: Train, Loglike in nats: 7.155971: 100%|█| 2304/2304 [00:01<00:00,
- Val, Loglike in nats: 6.948618: 100%|█| 256/256 [00:00<00:00, 3561.99it/s]
Epoch 224: Train, Loglike in nats: 7.183771: 100%|█| 2304/2304 [00:01<00:00,
- Val, Loglike in nats: 6.890191: 100%|█| 256/256 [00:00<00:00, 5595.38it/s]
Epoch 225: Train, Loglike in nats: 7.138261: 100%|█| 2304/2304 [00:01<00:00,
- Val, Loglike in nats: 6.933090: 100%|█| 256/256 [00:00<00:00, 2250.73it/s]
Epoch 226: Train, Loglike in nats: 7.139557: 100%|█| 2304/2304 [00:01<00:00,
- Val, Loglike in nats: 6.847615: 100%|█| 256/256 [00:00<00:00, 5188.89it/s]
Epoch 227: Train, Loglike in nats: 7.189766: 100%|█| 2304/2304 [00:01<00:00,
- Val, Loglike in nats: 6.976440: 100%|█| 256/256 [00:00<00:00, 2123.72it/s]
Epoch 228: Train, Loglike in nats: 7.204551: 100%|█| 2304/2304 [00:01<00:00,
- Val, Loglike in nats: 6.932121: 100%|█| 256/256 [00:00<00:00, 5167.54it/s]
Epoch 229: Train, Loglike in nats: 7.198164: 100%|█| 2304/2304 [00:01<00:00,
- Val, Loglike in nats: 6.939200: 100%|█| 256/256 [00:00<00:00, 5386.97it/s]
Epoch 230: Train, Loglike in nats: 7.184942: 100%|█| 2304/2304 [00:01<00:00,
- Val, Loglike in nats: 6.868310: 100%|█| 256/256 [00:00<00:00, 2147.27it/s]
Epoch 231: Train, Loglike in nats: 7.207561: 100%|█| 2304/2304 [00:01<00:00,
- Val, Loglike in nats: 6.894862: 100%|█| 256/256 [00:00<00:00, 2809.85it/s]
Epoch 232: Train, Loglike in nats: 7.180940: 100%|█| 2304/2304 [00:01<00:00,
- Val, Loglike in nats: 6.903001: 100%|█| 256/256 [00:00<00:00, 3005.85it/s]
Epoch 233: Train, Loglike in nats: 7.182276: 100%|█| 2304/2304 [00:01<00:00,
- Val, Loglike in nats: 6.897264: 100%|█| 256/256 [00:00<00:00, 3164.32it/s]
Epoch 234: Train, Loglike in nats: 7.205443: 100%|█| 2304/2304 [00:01<00:00,
- Val, Loglike in nats: 6.981925: 100%|█| 256/256 [00:00<00:00, 3249.22it/s]
Epoch 235: Train, Loglike in nats: 7.215735: 100%|█| 2304/2304 [00:01<00:00,
- Val, Loglike in nats: 6.998847: 100%|█| 256/256 [00:00<00:00, 4806.43it/s]
Epoch 236: Train, Loglike in nats: 7.226037: 100%|█| 2304/2304 [00:01<00:00,
- Val, Loglike in nats: 6.854257: 100%|█| 256/256 [00:00<00:00, 3148.60it/s]
Epoch 237: Train, Loglike in nats: 7.204447: 100%|█| 2304/2304 [00:01<00:00,
- Val, Loglike in nats: 6.961008: 100%|█| 256/256 [00:00<00:00, 4398.85it/s]
Epoch 238: Train, Loglike in nats: 7.210616: 100%|█| 2304/2304 [00:01<00:00,
- Val, Loglike in nats: 6.983492: 100%|█| 256/256 [00:00<00:00, 3515.27it/s]
Epoch 239: Train, Loglike in nats: 7.245856: 100%|█| 2304/2304 [00:01<00:00,
- Val, Loglike in nats: 7.004025: 100%|█| 256/256 [00:00<00:00, 3712.49it/s]
Epoch 240: Train, Loglike in nats: 7.254111: 100%|█| 2304/2304 [00:01<00:00,
- Val, Loglike in nats: 6.970000: 100%|█| 256/256 [00:00<00:00, 2715.86it/s]
Epoch 241: Train, Loglike in nats: 7.248875: 100%|█| 2304/2304 [00:01<00:00,
- Val, Loglike in nats: 6.948079: 100%|█| 256/256 [00:00<00:00, 3404.53it/s]
Epoch 242: Train, Loglike in nats: 7.245370: 100%|█| 2304/2304 [00:01<00:00,
- Val, Loglike in nats: 6.983081: 100%|█| 256/256 [00:00<00:00, 4193.96it/s]
Epoch 243: Train, Loglike in nats: 7.256679: 100%|█| 2304/2304 [00:01<00:00,
- Val, Loglike in nats: 6.984150: 100%|█| 256/256 [00:00<00:00, 5436.86it/s]
Epoch 244: Train, Loglike in nats: 7.242065: 100%|█| 2304/2304 [00:01<00:00,
- Val, Loglike in nats: 6.965386: 100%|█| 256/256 [00:00<00:00, 4771.21it/s]
Epoch 245: Train, Loglike in nats: 7.256324: 100%|█| 2304/2304 [00:01<00:00,
- Val, Loglike in nats: 6.956080: 100%|█| 256/256 [00:00<00:00, 4771.76it/s]
Epoch 246: Train, Loglike in nats: 7.237340: 100%|█| 2304/2304 [00:01<00:00,
- Val, Loglike in nats: 7.065677: 100%|█| 256/256 [00:00<00:00, 4344.65it/s]
Epoch 247: Train, Loglike in nats: 7.264074: 100%|█| 2304/2304 [00:01<00:00,
- Val, Loglike in nats: 7.035882: 100%|█| 256/256 [00:00<00:00, 1993.49it/s]
Epoch 248: Train, Loglike in nats: 7.265508: 100%|█| 2304/2304 [00:01<00:00,
- Val, Loglike in nats: 7.046490: 100%|█| 256/256 [00:00<00:00, 4600.34it/s]
Epoch 249: Train, Loglike in nats: 7.254757: 100%|█| 2304/2304 [00:01<00:00,
- Val, Loglike in nats: 7.050386: 100%|█| 256/256 [00:00<00:00, 4308.74it/s]
Epoch 250: Train, Loglike in nats: 7.261817: 100%|█| 2304/2304 [00:02<00:00,
- Val, Loglike in nats: 6.974447: 100%|█| 256/256 [00:00<00:00, 2424.29it/s]
Epoch 251: Train, Loglike in nats: 7.272326: 100%|█| 2304/2304 [00:01<00:00,
- Val, Loglike in nats: 7.011924: 100%|█| 256/256 [00:00<00:00, 2394.45it/s]
Epoch 252: Train, Loglike in nats: 7.272482: 100%|█| 2304/2304 [00:01<00:00,
- Val, Loglike in nats: 7.034987: 100%|█| 256/256 [00:00<00:00, 2596.25it/s]
Epoch 253: Train, Loglike in nats: 7.273192: 100%|█| 2304/2304 [00:01<00:00,
- Val, Loglike in nats: 7.038661: 100%|█| 256/256 [00:00<00:00, 3571.27it/s]
Epoch 254: Train, Loglike in nats: 7.278097: 100%|█| 2304/2304 [00:01<00:00,
- Val, Loglike in nats: 7.051842: 100%|█| 256/256 [00:00<00:00, 1602.09it/s]
Epoch 255: Train, Loglike in nats: 7.274506: 100%|█| 2304/2304 [00:01<00:00,
- Val, Loglike in nats: 7.105392: 100%|█| 256/256 [00:00<00:00, 3935.99it/s]
Epoch 256: Train, Loglike in nats: 7.307196: 100%|█| 2304/2304 [00:01<00:00,
- Val, Loglike in nats: 7.070848: 100%|█| 256/256 [00:00<00:00, 3127.44it/s]
Epoch 257: Train, Loglike in nats: 7.287526: 100%|█| 2304/2304 [00:01<00:00,
- Val, Loglike in nats: 7.013665: 100%|█| 256/256 [00:00<00:00, 1881.80it/s]
Epoch 258: Train, Loglike in nats: 7.297325: 100%|█| 2304/2304 [00:01<00:00,
- Val, Loglike in nats: 7.028750: 100%|█| 256/256 [00:00<00:00, 1680.49it/s]
Epoch 259: Train, Loglike in nats: 7.298551: 100%|█| 2304/2304 [00:01<00:00,
- Val, Loglike in nats: 6.936582: 100%|█| 256/256 [00:00<00:00, 3390.14it/s]
Epoch 260: Train, Loglike in nats: 7.295615: 100%|█| 2304/2304 [00:01<00:00,
- Val, Loglike in nats: 7.098983: 100%|█| 256/256 [00:00<00:00, 3543.75it/s]
Epoch 261: Train, Loglike in nats: 7.278522: 100%|█| 2304/2304 [00:01<00:00,
- Val, Loglike in nats: 7.017798: 100%|█| 256/256 [00:00<00:00, 4716.12it/s]
Epoch 262: Train, Loglike in nats: 7.273079: 100%|█| 2304/2304 [00:01<00:00,
- Val, Loglike in nats: 7.047269: 100%|█| 256/256 [00:00<00:00, 4272.80it/s]
Epoch 263: Train, Loglike in nats: 7.304631: 100%|█| 2304/2304 [00:01<00:00,
- Val, Loglike in nats: 7.013604: 100%|█| 256/256 [00:00<00:00, 3246.06it/s]
Epoch 264: Train, Loglike in nats: 7.305711: 100%|█| 2304/2304 [00:01<00:00,
- Val, Loglike in nats: 6.999825: 100%|█| 256/256 [00:00<00:00, 3514.80it/s]
Epoch 265: Train, Loglike in nats: 7.304676: 100%|█| 2304/2304 [00:01<00:00,
- Val, Loglike in nats: 7.008645: 100%|█| 256/256 [00:00<00:00, 3489.73it/s]
Epoch 266: Train, Loglike in nats: 7.279627: 100%|█| 2304/2304 [00:01<00:00,
- Val, Loglike in nats: 7.096175: 100%|█| 256/256 [00:00<00:00, 3291.83it/s]
Epoch 267: Train, Loglike in nats: 7.292471: 100%|█| 2304/2304 [00:01<00:00,
- Val, Loglike in nats: 7.023993: 100%|█| 256/256 [00:00<00:00, 4433.65it/s]
Epoch 268: Train, Loglike in nats: 7.318467: 100%|█| 2304/2304 [00:01<00:00,
- Val, Loglike in nats: 7.014885: 100%|█| 256/256 [00:00<00:00, 2584.37it/s]
Epoch 269: Train, Loglike in nats: 7.307246: 100%|█| 2304/2304 [00:01<00:00,
- Val, Loglike in nats: 7.107642: 100%|█| 256/256 [00:00<00:00, 3373.40it/s]
Epoch 270: Train, Loglike in nats: 7.321354: 100%|█| 2304/2304 [00:01<00:00,
- Val, Loglike in nats: 7.015020: 100%|█| 256/256 [00:00<00:00, 3856.87it/s]
Epoch 271: Train, Loglike in nats: 7.330850: 100%|█| 2304/2304 [00:01<00:00,
- Val, Loglike in nats: 7.065150: 100%|█| 256/256 [00:00<00:00, 3234.12it/s]
Epoch 272: Train, Loglike in nats: 7.298432: 100%|█| 2304/2304 [00:01<00:00,
- Val, Loglike in nats: 7.078562: 100%|█| 256/256 [00:00<00:00, 4202.66it/s]
Epoch 273: Train, Loglike in nats: 7.319243: 100%|█| 2304/2304 [00:01<00:00,
- Val, Loglike in nats: 7.084467: 100%|█| 256/256 [00:00<00:00, 1926.89it/s]
Epoch 274: Train, Loglike in nats: 7.308819: 100%|█| 2304/2304 [00:01<00:00,
- Val, Loglike in nats: 7.038202: 100%|█| 256/256 [00:00<00:00, 2776.60it/s]
Epoch 275: Train, Loglike in nats: 7.297086: 100%|█| 2304/2304 [00:02<00:00,
- Val, Loglike in nats: 7.083919: 100%|█| 256/256 [00:00<00:00, 1895.41it/s]
Epoch 276: Train, Loglike in nats: 7.316991: 100%|█| 2304/2304 [00:01<00:00,
- Val, Loglike in nats: 7.125168: 100%|█| 256/256 [00:00<00:00, 4807.23it/s]
Epoch 277: Train, Loglike in nats: 7.338279: 100%|█| 2304/2304 [00:01<00:00,
- Val, Loglike in nats: 7.100325: 100%|█| 256/256 [00:00<00:00, 3618.11it/s]
Epoch 278: Train, Loglike in nats: 7.316423: 100%|█| 2304/2304 [00:01<00:00,
- Val, Loglike in nats: 7.031301: 100%|█| 256/256 [00:00<00:00, 2889.69it/s]
Epoch 279: Train, Loglike in nats: 7.329750: 100%|█| 2304/2304 [00:01<00:00,
- Val, Loglike in nats: 6.976141: 100%|█| 256/256 [00:00<00:00, 4578.78it/s]
Epoch 280: Train, Loglike in nats: 7.328092: 100%|█| 2304/2304 [00:01<00:00,
- Val, Loglike in nats: 7.105322: 100%|█| 256/256 [00:00<00:00, 4358.87it/s]
Epoch 281: Train, Loglike in nats: 7.303649: 100%|█| 2304/2304 [00:01<00:00,
- Val, Loglike in nats: 7.059430: 100%|█| 256/256 [00:00<00:00, 4501.89it/s]
Epoch 282: Train, Loglike in nats: 7.344545: 100%|█| 2304/2304 [00:01<00:00,
- Val, Loglike in nats: 7.046972: 100%|█| 256/256 [00:00<00:00, 1959.23it/s]
Epoch 283: Train, Loglike in nats: 7.329625: 100%|█| 2304/2304 [00:01<00:00,
- Val, Loglike in nats: 7.020240: 100%|█| 256/256 [00:00<00:00, 2283.18it/s]
Epoch 284: Train, Loglike in nats: 7.335547: 100%|█| 2304/2304 [00:01<00:00,
- Val, Loglike in nats: 7.041233: 100%|█| 256/256 [00:00<00:00, 3231.71it/s]
Epoch 285: Train, Loglike in nats: 7.334932: 100%|█| 2304/2304 [00:01<00:00,
- Val, Loglike in nats: 6.936577: 100%|█| 256/256 [00:00<00:00, 3648.55it/s]
Epoch 286: Train, Loglike in nats: 7.341789: 100%|█| 2304/2304 [00:01<00:00,
- Val, Loglike in nats: 7.013749: 100%|█| 256/256 [00:00<00:00, 3991.15it/s]
Epoch 287: Train, Loglike in nats: 7.332159: 100%|█| 2304/2304 [00:01<00:00,
- Val, Loglike in nats: 7.064516: 100%|█| 256/256 [00:00<00:00, 4158.34it/s]
Epoch 288: Train, Loglike in nats: 7.351825: 100%|█| 2304/2304 [00:01<00:00,
- Val, Loglike in nats: 7.080848: 100%|█| 256/256 [00:00<00:00, 3911.26it/s]
Epoch 289: Train, Loglike in nats: 7.335212: 100%|█| 2304/2304 [00:01<00:00,
- Val, Loglike in nats: 7.069468: 100%|█| 256/256 [00:00<00:00, 4895.58it/s]
Epoch 290: Train, Loglike in nats: 7.331078: 100%|█| 2304/2304 [00:01<00:00,
- Val, Loglike in nats: 7.139069: 100%|█| 256/256 [00:00<00:00, 2995.73it/s]
Epoch 291: Train, Loglike in nats: 7.348450: 100%|█| 2304/2304 [00:01<00:00,
- Val, Loglike in nats: 7.058819: 100%|█| 256/256 [00:00<00:00, 3143.73it/s]
Epoch 292: Train, Loglike in nats: 7.327452: 100%|█| 2304/2304 [00:01<00:00,
- Val, Loglike in nats: 7.028440: 100%|█| 256/256 [00:00<00:00, 2791.38it/s]
Epoch 293: Train, Loglike in nats: 7.324356: 100%|█| 2304/2304 [00:01<00:00,
- Val, Loglike in nats: 6.991703: 100%|█| 256/256 [00:00<00:00, 4643.73it/s]
Epoch 294: Train, Loglike in nats: 7.326188: 100%|█| 2304/2304 [00:01<00:00,
- Val, Loglike in nats: 7.054939: 100%|█| 256/256 [00:00<00:00, 4476.46it/s]
Epoch 295: Train, Loglike in nats: 7.329691: 100%|█| 2304/2304 [00:01<00:00,
- Val, Loglike in nats: 7.035150: 100%|█| 256/256 [00:00<00:00, 2879.57it/s]
Epoch 296: Train, Loglike in nats: 7.334575: 100%|█| 2304/2304 [00:01<00:00,
- Val, Loglike in nats: 7.072271: 100%|█| 256/256 [00:00<00:00, 4211.15it/s]
Epoch 297: Train, Loglike in nats: 7.334792: 100%|█| 2304/2304 [00:01<00:00,
- Val, Loglike in nats: 7.126701: 100%|█| 256/256 [00:00<00:00, 2566.91it/s]
Epoch 298: Train, Loglike in nats: 7.358398: 100%|█| 2304/2304 [00:01<00:00,
- Val, Loglike in nats: 7.084436: 100%|█| 256/256 [00:00<00:00, 2220.77it/s]
Epoch 299: Train, Loglike in nats: 7.332334: 100%|█| 2304/2304 [00:01<00:00,
- Val, Loglike in nats: 7.055864: 100%|█| 256/256 [00:00<00:00, 4508.77it/s]
Generating simulations
256it [00:00, 3311.77it/s]
WARNING:root:Too few points to create valid contours
Effective sample size for current/all rounds 41.5/41.5
---------------------- Round: 1 ----------------------
Epoch 0: Train, Loglike in nats: -111.074880: 100%|█| 2304/2304 [00:01<00:00
- Val, Loglike in nats: -2.992713: 100%|█| 256/256 [00:00<00:00, 1011.96it/s
Epoch 1: Train, Loglike in nats: -2.200279: 100%|█| 2304/2304 [00:01<00:00,
- Val, Loglike in nats: -1.263758: 100%|█| 256/256 [00:00<00:00, 2931.44it/s
Epoch 2: Train, Loglike in nats: -0.458073: 100%|█| 2304/2304 [00:01<00:00,
- Val, Loglike in nats: 0.593628: 100%|█| 256/256 [00:00<00:00, 1573.11it/s]
Epoch 3: Train, Loglike in nats: 0.448375: 100%|█| 2304/2304 [00:01<00:00, 1
- Val, Loglike in nats: 1.122143: 100%|█| 256/256 [00:00<00:00, 2982.33it/s]
Epoch 4: Train, Loglike in nats: 0.888271: 100%|█| 2304/2304 [00:01<00:00, 1
- Val, Loglike in nats: 1.288034: 100%|█| 256/256 [00:00<00:00, 5056.57it/s]
Epoch 5: Train, Loglike in nats: 1.180175: 100%|█| 2304/2304 [00:01<00:00, 1
- Val, Loglike in nats: 1.176789: 100%|█| 256/256 [00:00<00:00, 1636.73it/s]
Epoch 6: Train, Loglike in nats: 0.437039: 100%|█| 2304/2304 [00:01<00:00, 1
- Val, Loglike in nats: 1.160046: 100%|█| 256/256 [00:00<00:00, 4627.80it/s]
Epoch 7: Train, Loglike in nats: 1.156423: 100%|█| 2304/2304 [00:01<00:00, 1
- Val, Loglike in nats: 1.305726: 100%|█| 256/256 [00:00<00:00, 4260.56it/s]
Epoch 8: Train, Loglike in nats: 1.439486: 100%|█| 2304/2304 [00:01<00:00, 1
- Val, Loglike in nats: 1.423906: 100%|█| 256/256 [00:00<00:00, 2631.07it/s]
Epoch 9: Train, Loglike in nats: 0.334956: 100%|█| 2304/2304 [00:01<00:00, 1
- Val, Loglike in nats: 0.881735: 100%|█| 256/256 [00:00<00:00, 4153.48it/s]
Epoch 10: Train, Loglike in nats: 1.285358: 100%|█| 2304/2304 [00:01<00:00,
- Val, Loglike in nats: 1.543077: 100%|█| 256/256 [00:00<00:00, 2772.33it/s]
Epoch 11: Train, Loglike in nats: 1.688851: 100%|█| 2304/2304 [00:01<00:00,
- Val, Loglike in nats: 2.028180: 100%|█| 256/256 [00:00<00:00, 2095.94it/s]
Epoch 12: Train, Loglike in nats: 1.396050: 100%|█| 2304/2304 [00:01<00:00,
- Val, Loglike in nats: 2.235658: 100%|█| 256/256 [00:00<00:00, 3411.78it/s]
Epoch 13: Train, Loglike in nats: 2.059073: 100%|█| 2304/2304 [00:01<00:00,
- Val, Loglike in nats: 1.859036: 100%|█| 256/256 [00:00<00:00, 4622.52it/s]
Epoch 14: Train, Loglike in nats: 1.812682: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 2.185026: 100%|█| 256/256 [00:00<00:00, 5180.90it/s]
Epoch 15: Train, Loglike in nats: 1.022742: 100%|█| 2304/2304 [00:01<00:00,
- Val, Loglike in nats: 1.421531: 100%|█| 256/256 [00:00<00:00, 5014.18it/s]
Epoch 16: Train, Loglike in nats: 1.589736: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 2.048828: 100%|█| 256/256 [00:00<00:00, 5227.18it/s]
Epoch 17: Train, Loglike in nats: 2.244287: 100%|█| 2304/2304 [00:01<00:00,
- Val, Loglike in nats: 2.458492: 100%|█| 256/256 [00:00<00:00, 5533.72it/s]
Epoch 18: Train, Loglike in nats: 2.408170: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 2.579831: 100%|█| 256/256 [00:00<00:00, 5378.61it/s]
Epoch 19: Train, Loglike in nats: 2.464422: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 2.574936: 100%|█| 256/256 [00:00<00:00, 6135.70it/s]
Epoch 20: Train, Loglike in nats: 1.841877: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 1.567079: 100%|█| 256/256 [00:00<00:00, 5631.44it/s]
Epoch 21: Train, Loglike in nats: 1.699927: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 1.867174: 100%|█| 256/256 [00:00<00:00, 5348.84it/s]
Epoch 22: Train, Loglike in nats: 2.252223: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 2.682520: 100%|█| 256/256 [00:00<00:00, 5644.35it/s]
Epoch 23: Train, Loglike in nats: 2.672771: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 2.756768: 100%|█| 256/256 [00:00<00:00, 6104.73it/s]
Epoch 24: Train, Loglike in nats: 2.675641: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 2.801300: 100%|█| 256/256 [00:00<00:00, 5990.53it/s]
Epoch 25: Train, Loglike in nats: 2.603892: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 2.554320: 100%|█| 256/256 [00:00<00:00, 5988.72it/s]
Epoch 26: Train, Loglike in nats: 2.436226: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 2.693611: 100%|█| 256/256 [00:00<00:00, 5991.53it/s]
Epoch 27: Train, Loglike in nats: 2.694747: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 2.908753: 100%|█| 256/256 [00:00<00:00, 6244.68it/s]
Epoch 28: Train, Loglike in nats: 2.786688: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 2.875337: 100%|█| 256/256 [00:00<00:00, 5821.00it/s]
Epoch 29: Train, Loglike in nats: 2.839208: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 2.993960: 100%|█| 256/256 [00:00<00:00, 5818.48it/s]
Epoch 30: Train, Loglike in nats: 2.429057: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 2.334218: 100%|█| 256/256 [00:00<00:00, 6680.41it/s]
Epoch 31: Train, Loglike in nats: 2.378411: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 2.966625: 100%|█| 256/256 [00:00<00:00, 7189.38it/s]
Epoch 32: Train, Loglike in nats: 2.730419: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 3.067818: 100%|█| 256/256 [00:00<00:00, 6680.07it/s]
Epoch 33: Train, Loglike in nats: 2.804069: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 3.090227: 100%|█| 256/256 [00:00<00:00, 6888.70it/s]
Epoch 34: Train, Loglike in nats: 2.904780: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 3.112225: 100%|█| 256/256 [00:00<00:00, 6688.31it/s]
Epoch 35: Train, Loglike in nats: 2.941289: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 3.174132: 100%|█| 256/256 [00:00<00:00, 6837.03it/s]
Epoch 36: Train, Loglike in nats: 3.059609: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 3.152189: 100%|█| 256/256 [00:00<00:00, 6466.77it/s]
Epoch 37: Train, Loglike in nats: 2.592032: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 3.111625: 100%|█| 256/256 [00:00<00:00, 6641.73it/s]
Epoch 38: Train, Loglike in nats: 3.075136: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 3.227358: 100%|█| 256/256 [00:00<00:00, 5478.39it/s]
Epoch 39: Train, Loglike in nats: 2.279360: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 2.156766: 100%|█| 256/256 [00:00<00:00, 6817.71it/s]
Epoch 40: Train, Loglike in nats: 1.492288: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 2.411548: 100%|█| 256/256 [00:00<00:00, 6492.02it/s]
Epoch 41: Train, Loglike in nats: 2.716307: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 3.030724: 100%|█| 256/256 [00:00<00:00, 6864.17it/s]
Epoch 42: Train, Loglike in nats: 2.965123: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 3.020025: 100%|█| 256/256 [00:00<00:00, 7440.32it/s]
Epoch 43: Train, Loglike in nats: 3.200281: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 2.818868: 100%|█| 256/256 [00:00<00:00, 6929.24it/s]
Epoch 44: Train, Loglike in nats: 3.175573: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 3.390544: 100%|█| 256/256 [00:00<00:00, 6885.48it/s]
Epoch 45: Train, Loglike in nats: 3.308076: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 3.383103: 100%|█| 256/256 [00:00<00:00, 6879.30it/s]
Epoch 46: Train, Loglike in nats: 3.367786: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 3.437356: 100%|█| 256/256 [00:00<00:00, 6793.51it/s]
Epoch 47: Train, Loglike in nats: 3.050139: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 3.672836: 100%|█| 256/256 [00:00<00:00, 7071.02it/s]
Epoch 48: Train, Loglike in nats: 3.210750: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 3.074204: 100%|█| 256/256 [00:00<00:00, 6853.70it/s]
Epoch 49: Train, Loglike in nats: 3.146906: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 3.012418: 100%|█| 256/256 [00:00<00:00, 7034.70it/s]
Epoch 50: Train, Loglike in nats: 3.432348: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 3.808176: 100%|█| 256/256 [00:00<00:00, 6720.08it/s]
Epoch 51: Train, Loglike in nats: 3.692205: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 3.634159: 100%|█| 256/256 [00:00<00:00, 6637.46it/s]
Epoch 52: Train, Loglike in nats: 3.002430: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 2.531565: 100%|█| 256/256 [00:00<00:00, 6952.58it/s]
Epoch 53: Train, Loglike in nats: 3.671081: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.016607: 100%|█| 256/256 [00:00<00:00, 7086.66it/s]
Epoch 54: Train, Loglike in nats: 3.971538: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.120502: 100%|█| 256/256 [00:00<00:00, 6758.15it/s]
Epoch 55: Train, Loglike in nats: 3.898712: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 3.700991: 100%|█| 256/256 [00:00<00:00, 6854.84it/s]
Epoch 56: Train, Loglike in nats: 3.712658: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 3.855739: 100%|█| 256/256 [00:00<00:00, 6845.83it/s]
Epoch 57: Train, Loglike in nats: 3.984127: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.148764: 100%|█| 256/256 [00:00<00:00, 7051.10it/s]
Epoch 58: Train, Loglike in nats: 4.120578: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.072963: 100%|█| 256/256 [00:00<00:00, 7087.12it/s]
Epoch 59: Train, Loglike in nats: 4.048295: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 3.859898: 100%|█| 256/256 [00:00<00:00, 6881.86it/s]
Epoch 60: Train, Loglike in nats: 3.923438: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.131983: 100%|█| 256/256 [00:00<00:00, 6844.22it/s]
Epoch 61: Train, Loglike in nats: 3.902147: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 3.986555: 100%|█| 256/256 [00:00<00:00, 7084.27it/s]
Epoch 62: Train, Loglike in nats: 3.634935: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 3.726820: 100%|█| 256/256 [00:00<00:00, 6909.62it/s]
Epoch 63: Train, Loglike in nats: 3.760851: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 3.847198: 100%|█| 256/256 [00:00<00:00, 7023.52it/s]
Epoch 64: Train, Loglike in nats: 3.964635: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.103169: 100%|█| 256/256 [00:00<00:00, 7195.84it/s]
Epoch 65: Train, Loglike in nats: 4.114371: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 3.683813: 100%|█| 256/256 [00:00<00:00, 6828.81it/s]
Epoch 66: Train, Loglike in nats: 3.949405: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 3.926994: 100%|█| 256/256 [00:00<00:00, 6974.16it/s]
Epoch 67: Train, Loglike in nats: 4.134924: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.332856: 100%|█| 256/256 [00:00<00:00, 7034.15it/s]
Epoch 68: Train, Loglike in nats: 4.173901: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.312083: 100%|█| 256/256 [00:00<00:00, 6939.54it/s]
Epoch 69: Train, Loglike in nats: 4.215352: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.347766: 100%|█| 256/256 [00:00<00:00, 6808.16it/s]
Epoch 70: Train, Loglike in nats: 4.322240: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.269313: 100%|█| 256/256 [00:00<00:00, 6946.50it/s]
Epoch 71: Train, Loglike in nats: 4.059325: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 2.094560: 100%|█| 256/256 [00:00<00:00, 6932.96it/s]
Epoch 72: Train, Loglike in nats: 3.645744: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.082846: 100%|█| 256/256 [00:00<00:00, 6763.39it/s]
Epoch 73: Train, Loglike in nats: 4.212441: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.459779: 100%|█| 256/256 [00:00<00:00, 6779.27it/s]
Epoch 74: Train, Loglike in nats: 4.284605: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.385456: 100%|█| 256/256 [00:00<00:00, 7150.70it/s]
Epoch 75: Train, Loglike in nats: 4.297160: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.336185: 100%|█| 256/256 [00:00<00:00, 6877.23it/s]
Epoch 76: Train, Loglike in nats: 4.333346: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.342100: 100%|█| 256/256 [00:00<00:00, 7229.37it/s]
Epoch 77: Train, Loglike in nats: 4.265670: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.549646: 100%|█| 256/256 [00:00<00:00, 6966.38it/s]
Epoch 78: Train, Loglike in nats: 4.323771: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.423072: 100%|█| 256/256 [00:00<00:00, 6832.29it/s]
Epoch 79: Train, Loglike in nats: 4.381990: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.543144: 100%|█| 256/256 [00:00<00:00, 6808.33it/s]
Epoch 80: Train, Loglike in nats: 4.465274: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.600409: 100%|█| 256/256 [00:00<00:00, 6949.88it/s]
Epoch 81: Train, Loglike in nats: 3.981684: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.516016: 100%|█| 256/256 [00:00<00:00, 6877.27it/s]
Epoch 82: Train, Loglike in nats: 4.335044: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.345150: 100%|█| 256/256 [00:00<00:00, 6953.70it/s]
Epoch 83: Train, Loglike in nats: 4.396036: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.485052: 100%|█| 256/256 [00:00<00:00, 7030.10it/s]
Epoch 84: Train, Loglike in nats: 4.434524: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.509062: 100%|█| 256/256 [00:00<00:00, 6868.78it/s]
Epoch 85: Train, Loglike in nats: 4.457015: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.343770: 100%|█| 256/256 [00:00<00:00, 6982.10it/s]
Epoch 86: Train, Loglike in nats: 4.361277: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.330976: 100%|█| 256/256 [00:00<00:00, 7094.19it/s]
Epoch 87: Train, Loglike in nats: 4.476224: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.604631: 100%|█| 256/256 [00:00<00:00, 6675.88it/s]
Epoch 88: Train, Loglike in nats: 4.423406: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.412801: 100%|█| 256/256 [00:00<00:00, 6920.22it/s]
Epoch 89: Train, Loglike in nats: 3.997995: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 3.975684: 100%|█| 256/256 [00:00<00:00, 7119.27it/s]
Epoch 90: Train, Loglike in nats: 3.941249: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 3.520312: 100%|█| 256/256 [00:00<00:00, 7021.22it/s]
Epoch 91: Train, Loglike in nats: 4.215732: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.296104: 100%|█| 256/256 [00:00<00:00, 6826.34it/s]
Epoch 92: Train, Loglike in nats: 4.370192: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.090794: 100%|█| 256/256 [00:00<00:00, 7004.10it/s]
Epoch 93: Train, Loglike in nats: 3.842001: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 3.613758: 100%|█| 256/256 [00:00<00:00, 6998.80it/s]
Epoch 94: Train, Loglike in nats: 3.747036: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.108294: 100%|█| 256/256 [00:00<00:00, 6785.01it/s]
Epoch 95: Train, Loglike in nats: 4.273025: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.538351: 100%|█| 256/256 [00:00<00:00, 6952.35it/s]
Epoch 96: Train, Loglike in nats: 4.499550: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.592475: 100%|█| 256/256 [00:00<00:00, 6763.39it/s]
Epoch 97: Train, Loglike in nats: 4.576464: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.513281: 100%|█| 256/256 [00:00<00:00, 6665.56it/s]
Epoch 98: Train, Loglike in nats: 4.449008: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.438046: 100%|█| 256/256 [00:00<00:00, 6896.75it/s]
Epoch 99: Train, Loglike in nats: 4.426386: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.289808: 100%|█| 256/256 [00:00<00:00, 6713.53it/s]
Epoch 100: Train, Loglike in nats: 4.380172: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.494611: 100%|█| 256/256 [00:00<00:00, 6938.20it/s]
Epoch 101: Train, Loglike in nats: 4.503746: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.443243: 100%|█| 256/256 [00:00<00:00, 7057.82it/s]
Epoch 102: Train, Loglike in nats: 4.449413: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.437430: 100%|█| 256/256 [00:00<00:00, 7120.45it/s]
Epoch 103: Train, Loglike in nats: 4.535067: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.611163: 100%|█| 256/256 [00:00<00:00, 6977.20it/s]
Epoch 104: Train, Loglike in nats: 4.592947: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.731658: 100%|█| 256/256 [00:00<00:00, 6573.38it/s]
Epoch 105: Train, Loglike in nats: 4.625255: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.550815: 100%|█| 256/256 [00:00<00:00, 6880.05it/s]
Epoch 106: Train, Loglike in nats: 4.543944: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.502524: 100%|█| 256/256 [00:00<00:00, 6871.33it/s]
Epoch 107: Train, Loglike in nats: 4.582432: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.757286: 100%|█| 256/256 [00:00<00:00, 7001.26it/s]
Epoch 108: Train, Loglike in nats: 4.609005: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.654587: 100%|█| 256/256 [00:00<00:00, 6992.42it/s]
Epoch 109: Train, Loglike in nats: 4.604053: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.633290: 100%|█| 256/256 [00:00<00:00, 7110.07it/s]
Epoch 110: Train, Loglike in nats: 4.634672: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.683434: 100%|█| 256/256 [00:00<00:00, 7032.40it/s]
Epoch 111: Train, Loglike in nats: 4.668680: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.722544: 100%|█| 256/256 [00:00<00:00, 7167.07it/s]
Epoch 112: Train, Loglike in nats: 4.610692: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.553889: 100%|█| 256/256 [00:00<00:00, 7078.11it/s]
Epoch 113: Train, Loglike in nats: 4.636194: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.729086: 100%|█| 256/256 [00:00<00:00, 6700.71it/s]
Epoch 114: Train, Loglike in nats: 4.638307: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.639952: 100%|█| 256/256 [00:00<00:00, 6839.47it/s]
Epoch 115: Train, Loglike in nats: 4.649648: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.688537: 100%|█| 256/256 [00:00<00:00, 7066.32it/s]
Epoch 116: Train, Loglike in nats: 4.646255: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.445121: 100%|█| 256/256 [00:00<00:00, 6767.48it/s]
Epoch 117: Train, Loglike in nats: 4.546423: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.684577: 100%|█| 256/256 [00:00<00:00, 7017.00it/s]
Epoch 118: Train, Loglike in nats: 4.664975: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.409183: 100%|█| 256/256 [00:00<00:00, 6955.05it/s]
Epoch 119: Train, Loglike in nats: 4.597261: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.618570: 100%|█| 256/256 [00:00<00:00, 6771.45it/s]
Epoch 120: Train, Loglike in nats: 4.581435: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.448646: 100%|█| 256/256 [00:00<00:00, 6969.95it/s]
Epoch 121: Train, Loglike in nats: 4.430024: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.712512: 100%|█| 256/256 [00:00<00:00, 7052.12it/s]
Epoch 122: Train, Loglike in nats: 4.619772: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.788047: 100%|█| 256/256 [00:00<00:00, 6864.96it/s]
Epoch 123: Train, Loglike in nats: 4.630033: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.620933: 100%|█| 256/256 [00:00<00:00, 7022.14it/s]
Epoch 124: Train, Loglike in nats: 4.619167: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.821687: 100%|█| 256/256 [00:00<00:00, 6705.77it/s]
Epoch 125: Train, Loglike in nats: 4.676330: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.700980: 100%|█| 256/256 [00:00<00:00, 6830.46it/s]
Epoch 126: Train, Loglike in nats: 4.709170: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.638464: 100%|█| 256/256 [00:00<00:00, 7211.50it/s]
Epoch 127: Train, Loglike in nats: 4.695473: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.770936: 100%|█| 256/256 [00:00<00:00, 6206.67it/s]
Epoch 128: Train, Loglike in nats: 4.760443: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.744103: 100%|█| 256/256 [00:00<00:00, 7209.08it/s]
Epoch 129: Train, Loglike in nats: 4.722085: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.267892: 100%|█| 256/256 [00:00<00:00, 7036.78it/s]
Epoch 130: Train, Loglike in nats: 4.662899: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.741573: 100%|█| 256/256 [00:00<00:00, 6607.48it/s]
Epoch 131: Train, Loglike in nats: 4.704491: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.733673: 100%|█| 256/256 [00:00<00:00, 6689.44it/s]
Epoch 132: Train, Loglike in nats: 4.668829: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.765700: 100%|█| 256/256 [00:00<00:00, 6842.52it/s]
Epoch 133: Train, Loglike in nats: 4.766939: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.748709: 100%|█| 256/256 [00:00<00:00, 6789.17it/s]
Epoch 134: Train, Loglike in nats: 4.688504: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.661104: 100%|█| 256/256 [00:00<00:00, 7044.95it/s]
Epoch 135: Train, Loglike in nats: 4.487069: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.504766: 100%|█| 256/256 [00:00<00:00, 6824.30it/s]
Epoch 136: Train, Loglike in nats: 4.740299: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.912984: 100%|█| 256/256 [00:00<00:00, 6779.66it/s]
Epoch 137: Train, Loglike in nats: 4.707845: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.808662: 100%|█| 256/256 [00:00<00:00, 6939.32it/s]
Epoch 138: Train, Loglike in nats: 4.725697: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.816910: 100%|█| 256/256 [00:00<00:00, 6482.85it/s]
Epoch 139: Train, Loglike in nats: 4.753620: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.815832: 100%|█| 256/256 [00:00<00:00, 6778.97it/s]
Epoch 140: Train, Loglike in nats: 4.828905: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.823953: 100%|█| 256/256 [00:00<00:00, 6570.20it/s]
Epoch 141: Train, Loglike in nats: 4.773109: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.783313: 100%|█| 256/256 [00:00<00:00, 6591.66it/s]
Epoch 142: Train, Loglike in nats: 4.819690: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.818953: 100%|█| 256/256 [00:00<00:00, 6597.61it/s]
Epoch 143: Train, Loglike in nats: 4.867340: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.853146: 100%|█| 256/256 [00:00<00:00, 6911.45it/s]
Epoch 144: Train, Loglike in nats: 4.760531: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.905544: 100%|█| 256/256 [00:00<00:00, 6779.32it/s]
Epoch 145: Train, Loglike in nats: 4.727601: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.756484: 100%|█| 256/256 [00:00<00:00, 6892.46it/s]
Epoch 146: Train, Loglike in nats: 4.596042: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.777543: 100%|█| 256/256 [00:00<00:00, 6797.43it/s]
Epoch 147: Train, Loglike in nats: 4.734501: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.892480: 100%|█| 256/256 [00:00<00:00, 6442.86it/s]
Epoch 148: Train, Loglike in nats: 4.830244: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.731425: 100%|█| 256/256 [00:00<00:00, 6402.37it/s]
Epoch 149: Train, Loglike in nats: 4.798859: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.859170: 100%|█| 256/256 [00:00<00:00, 6886.54it/s]
Epoch 150: Train, Loglike in nats: 4.822317: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.817088: 100%|█| 256/256 [00:00<00:00, 7012.74it/s]
Epoch 151: Train, Loglike in nats: 4.815515: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.852090: 100%|█| 256/256 [00:00<00:00, 6727.66it/s]
Epoch 152: Train, Loglike in nats: 4.815280: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.861661: 100%|█| 256/256 [00:00<00:00, 6851.16it/s]
Epoch 153: Train, Loglike in nats: 4.788223: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.944104: 100%|█| 256/256 [00:00<00:00, 6999.35it/s]
Epoch 154: Train, Loglike in nats: 4.833244: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.852159: 100%|█| 256/256 [00:00<00:00, 6862.11it/s]
Epoch 155: Train, Loglike in nats: 4.848967: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.835477: 100%|█| 256/256 [00:00<00:00, 6720.04it/s]
Epoch 156: Train, Loglike in nats: 4.882189: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.911913: 100%|█| 256/256 [00:00<00:00, 7465.46it/s]
Epoch 157: Train, Loglike in nats: 4.876556: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.876873: 100%|█| 256/256 [00:00<00:00, 7640.17it/s]
Epoch 158: Train, Loglike in nats: 4.815367: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.907768: 100%|█| 256/256 [00:00<00:00, 7642.51it/s]
Epoch 159: Train, Loglike in nats: 4.878157: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.991665: 100%|█| 256/256 [00:00<00:00, 7407.36it/s]
Epoch 160: Train, Loglike in nats: 4.877523: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.859263: 100%|█| 256/256 [00:00<00:00, 7600.53it/s]
Epoch 161: Train, Loglike in nats: 4.894128: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.910856: 100%|█| 256/256 [00:00<00:00, 7237.99it/s]
Epoch 162: Train, Loglike in nats: 4.888952: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.894308: 100%|█| 256/256 [00:00<00:00, 7055.50it/s]
Epoch 163: Train, Loglike in nats: 4.890267: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.943397: 100%|█| 256/256 [00:00<00:00, 7306.95it/s]
Epoch 164: Train, Loglike in nats: 4.918437: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.972646: 100%|█| 256/256 [00:00<00:00, 7386.22it/s]
Epoch 165: Train, Loglike in nats: 4.951344: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.925364: 100%|█| 256/256 [00:00<00:00, 7045.00it/s]
Epoch 166: Train, Loglike in nats: 4.911215: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.964138: 100%|█| 256/256 [00:00<00:00, 7330.65it/s]
Epoch 167: Train, Loglike in nats: 4.883754: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.863797: 100%|█| 256/256 [00:00<00:00, 7727.37it/s]
Epoch 168: Train, Loglike in nats: 4.932081: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 5.081136: 100%|█| 256/256 [00:00<00:00, 7586.14it/s]
Epoch 169: Train, Loglike in nats: 4.828330: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.855214: 100%|█| 256/256 [00:00<00:00, 6998.94it/s]
Epoch 170: Train, Loglike in nats: 4.831960: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.973392: 100%|█| 256/256 [00:00<00:00, 7335.25it/s]
Epoch 171: Train, Loglike in nats: 4.858005: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.978397: 100%|█| 256/256 [00:00<00:00, 7498.25it/s]
Epoch 172: Train, Loglike in nats: 4.941252: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.814515: 100%|█| 256/256 [00:00<00:00, 7194.25it/s]
Epoch 173: Train, Loglike in nats: 4.938721: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.900439: 100%|█| 256/256 [00:00<00:00, 7271.27it/s]
Epoch 174: Train, Loglike in nats: 4.924385: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 5.058537: 100%|█| 256/256 [00:00<00:00, 7481.48it/s]
Epoch 175: Train, Loglike in nats: 4.909537: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.874205: 100%|█| 256/256 [00:00<00:00, 7550.29it/s]
Epoch 176: Train, Loglike in nats: 4.926949: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.992140: 100%|█| 256/256 [00:00<00:00, 7476.63it/s]
Epoch 177: Train, Loglike in nats: 4.960558: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.993335: 100%|█| 256/256 [00:00<00:00, 7665.59it/s]
Epoch 178: Train, Loglike in nats: 4.954484: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.720257: 100%|█| 256/256 [00:00<00:00, 7531.65it/s]
Epoch 179: Train, Loglike in nats: 4.889739: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.906847: 100%|█| 256/256 [00:00<00:00, 7340.27it/s]
Epoch 180: Train, Loglike in nats: 4.924509: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.981167: 100%|█| 256/256 [00:00<00:00, 7072.05it/s]
Epoch 181: Train, Loglike in nats: 4.943957: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.909654: 100%|█| 256/256 [00:00<00:00, 7086.66it/s]
Epoch 182: Train, Loglike in nats: 4.891324: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.814131: 100%|█| 256/256 [00:00<00:00, 7149.65it/s]
Epoch 183: Train, Loglike in nats: 4.849531: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.805203: 100%|█| 256/256 [00:00<00:00, 7639.46it/s]
Epoch 184: Train, Loglike in nats: 4.830100: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.874947: 100%|█| 256/256 [00:00<00:00, 7629.26it/s]
Epoch 185: Train, Loglike in nats: 4.969568: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 5.093703: 100%|█| 256/256 [00:00<00:00, 7564.49it/s]
Epoch 186: Train, Loglike in nats: 5.008568: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.956884: 100%|█| 256/256 [00:00<00:00, 7654.39it/s]
Epoch 187: Train, Loglike in nats: 4.979974: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 5.086188: 100%|█| 256/256 [00:00<00:00, 7655.75it/s]
Epoch 188: Train, Loglike in nats: 4.959536: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.992037: 100%|█| 256/256 [00:00<00:00, 7205.74it/s]
Epoch 189: Train, Loglike in nats: 4.972693: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 5.009516: 100%|█| 256/256 [00:00<00:00, 7379.62it/s]
Epoch 190: Train, Loglike in nats: 4.979783: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 5.060404: 100%|█| 256/256 [00:00<00:00, 7361.40it/s]
Epoch 191: Train, Loglike in nats: 4.945945: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.937216: 100%|█| 256/256 [00:00<00:00, 7354.85it/s]
Epoch 192: Train, Loglike in nats: 4.979626: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.894011: 100%|█| 256/256 [00:00<00:00, 7411.04it/s]
Epoch 193: Train, Loglike in nats: 4.960504: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 5.019113: 100%|█| 256/256 [00:00<00:00, 7607.91it/s]
Epoch 194: Train, Loglike in nats: 4.989235: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 5.070102: 100%|█| 256/256 [00:00<00:00, 7618.11it/s]
Epoch 195: Train, Loglike in nats: 4.929754: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 5.124246: 100%|█| 256/256 [00:00<00:00, 7594.72it/s]
Epoch 196: Train, Loglike in nats: 4.981910: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.961595: 100%|█| 256/256 [00:00<00:00, 7456.59it/s]
Epoch 197: Train, Loglike in nats: 4.936925: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.933918: 100%|█| 256/256 [00:00<00:00, 7230.83it/s]
Epoch 198: Train, Loglike in nats: 5.000826: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 5.017155: 100%|█| 256/256 [00:00<00:00, 7091.24it/s]
Epoch 199: Train, Loglike in nats: 5.037700: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.998076: 100%|█| 256/256 [00:00<00:00, 7337.56it/s]
Epoch 200: Train, Loglike in nats: 5.068087: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 5.087027: 100%|█| 256/256 [00:00<00:00, 7130.52it/s]
Epoch 201: Train, Loglike in nats: 5.031738: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 5.011127: 100%|█| 256/256 [00:00<00:00, 7283.90it/s]
Epoch 202: Train, Loglike in nats: 5.044392: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 5.142298: 100%|█| 256/256 [00:00<00:00, 7300.54it/s]
Epoch 203: Train, Loglike in nats: 5.013560: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 5.010705: 100%|█| 256/256 [00:00<00:00, 6451.61it/s]
Epoch 204: Train, Loglike in nats: 4.955142: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 5.136156: 100%|█| 256/256 [00:00<00:00, 7361.15it/s]
Epoch 205: Train, Loglike in nats: 5.023201: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 5.058125: 100%|█| 256/256 [00:00<00:00, 7313.22it/s]
Epoch 206: Train, Loglike in nats: 5.028421: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 5.043618: 100%|█| 256/256 [00:00<00:00, 7105.37it/s]
Epoch 207: Train, Loglike in nats: 5.024207: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 5.064460: 100%|█| 256/256 [00:00<00:00, 7073.40it/s]
Epoch 208: Train, Loglike in nats: 5.071890: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 5.099055: 100%|█| 256/256 [00:00<00:00, 7020.58it/s]
Epoch 209: Train, Loglike in nats: 5.043016: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 5.059133: 100%|█| 256/256 [00:00<00:00, 6684.40it/s]
Epoch 210: Train, Loglike in nats: 5.042257: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 5.132987: 100%|█| 256/256 [00:00<00:00, 7267.78it/s]
Epoch 211: Train, Loglike in nats: 5.046383: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 5.097592: 100%|█| 256/256 [00:00<00:00, 6788.32it/s]
Epoch 212: Train, Loglike in nats: 5.006162: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 5.107549: 100%|█| 256/256 [00:00<00:00, 7571.96it/s]
Epoch 213: Train, Loglike in nats: 5.037832: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 5.116076: 100%|█| 256/256 [00:00<00:00, 7204.00it/s]
Epoch 214: Train, Loglike in nats: 5.043028: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 5.041624: 100%|█| 256/256 [00:00<00:00, 7200.09it/s]
Epoch 215: Train, Loglike in nats: 5.083967: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 5.090517: 100%|█| 256/256 [00:00<00:00, 7171.71it/s]
Epoch 216: Train, Loglike in nats: 5.062029: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.990519: 100%|█| 256/256 [00:00<00:00, 6112.58it/s]
Epoch 217: Train, Loglike in nats: 5.040047: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 5.076622: 100%|█| 256/256 [00:00<00:00, 7185.15it/s]
Epoch 218: Train, Loglike in nats: 5.018942: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 5.046337: 100%|█| 256/256 [00:00<00:00, 7473.36it/s]
Epoch 219: Train, Loglike in nats: 5.122868: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 5.024473: 100%|█| 256/256 [00:00<00:00, 7661.21it/s]
Epoch 220: Train, Loglike in nats: 5.030771: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 5.184031: 100%|█| 256/256 [00:00<00:00, 7381.19it/s]
Epoch 221: Train, Loglike in nats: 5.085471: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 5.068532: 100%|█| 256/256 [00:00<00:00, 7387.54it/s]
Epoch 222: Train, Loglike in nats: 5.048608: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 5.080677: 100%|█| 256/256 [00:00<00:00, 7656.68it/s]
Epoch 223: Train, Loglike in nats: 5.060910: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 5.176305: 100%|█| 256/256 [00:00<00:00, 7185.39it/s]
Epoch 224: Train, Loglike in nats: 5.106030: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 5.163081: 100%|█| 256/256 [00:00<00:00, 7374.30it/s]
Epoch 225: Train, Loglike in nats: 5.079444: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 5.074261: 100%|█| 256/256 [00:00<00:00, 7375.26it/s]
Epoch 226: Train, Loglike in nats: 5.070240: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 5.116743: 100%|█| 256/256 [00:00<00:00, 7364.53it/s]
Epoch 227: Train, Loglike in nats: 5.100734: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 5.150346: 100%|█| 256/256 [00:00<00:00, 7290.13it/s]
Epoch 228: Train, Loglike in nats: 5.087965: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 5.085164: 100%|█| 256/256 [00:00<00:00, 7203.37it/s]
Epoch 229: Train, Loglike in nats: 5.086281: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 5.165950: 100%|█| 256/256 [00:00<00:00, 6531.32it/s]
Epoch 230: Train, Loglike in nats: 5.069295: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 5.023100: 100%|█| 256/256 [00:00<00:00, 6515.62it/s]
Epoch 231: Train, Loglike in nats: 5.081991: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 5.089276: 100%|█| 256/256 [00:00<00:00, 7521.20it/s]
Epoch 232: Train, Loglike in nats: 5.097532: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 5.065683: 100%|█| 256/256 [00:00<00:00, 7097.85it/s]
Epoch 233: Train, Loglike in nats: 5.078255: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 5.193214: 100%|█| 256/256 [00:00<00:00, 7135.30it/s]
Epoch 234: Train, Loglike in nats: 5.106338: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 5.060592: 100%|█| 256/256 [00:00<00:00, 7350.22it/s]
Epoch 235: Train, Loglike in nats: 5.120595: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 5.114061: 100%|█| 256/256 [00:00<00:00, 7522.57it/s]
Epoch 236: Train, Loglike in nats: 5.113690: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 5.137984: 100%|█| 256/256 [00:00<00:00, 7432.95it/s]
Epoch 237: Train, Loglike in nats: 5.140368: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 5.163786: 100%|█| 256/256 [00:00<00:00, 7315.91it/s]
Epoch 238: Train, Loglike in nats: 5.123009: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 5.115195: 100%|█| 256/256 [00:00<00:00, 7411.10it/s]
Epoch 239: Train, Loglike in nats: 5.122023: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 5.115406: 100%|█| 256/256 [00:00<00:00, 7031.25it/s]
Epoch 240: Train, Loglike in nats: 5.123559: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 5.134575: 100%|█| 256/256 [00:00<00:00, 7162.24it/s]
Epoch 241: Train, Loglike in nats: 5.132092: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 5.148455: 100%|█| 256/256 [00:00<00:00, 7141.28it/s]
Epoch 242: Train, Loglike in nats: 5.121586: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 5.235629: 100%|█| 256/256 [00:00<00:00, 7366.71it/s]
Epoch 243: Train, Loglike in nats: 5.114081: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 5.156068: 100%|█| 256/256 [00:00<00:00, 7307.80it/s]
Epoch 244: Train, Loglike in nats: 5.122736: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 5.153957: 100%|█| 256/256 [00:00<00:00, 7497.25it/s]
Epoch 245: Train, Loglike in nats: 5.108798: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 5.181901: 100%|█| 256/256 [00:00<00:00, 7270.04it/s]
Epoch 246: Train, Loglike in nats: 5.126208: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 5.102291: 100%|█| 256/256 [00:00<00:00, 7216.78it/s]
Epoch 247: Train, Loglike in nats: 5.126986: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 5.186876: 100%|█| 256/256 [00:00<00:00, 7357.62it/s]
Epoch 248: Train, Loglike in nats: 5.134367: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 5.102363: 100%|█| 256/256 [00:00<00:00, 7323.25it/s]
Epoch 249: Train, Loglike in nats: 5.106711: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 5.206118: 100%|█| 256/256 [00:00<00:00, 7325.60it/s]
Epoch 250: Train, Loglike in nats: 5.075738: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 5.181466: 100%|█| 256/256 [00:00<00:00, 6652.14it/s]
Epoch 251: Train, Loglike in nats: 5.138174: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 5.117506: 100%|█| 256/256 [00:00<00:00, 7519.04it/s]
Epoch 252: Train, Loglike in nats: 5.104439: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 5.081573: 100%|█| 256/256 [00:00<00:00, 7447.49it/s]
Epoch 253: Train, Loglike in nats: 5.153634: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 5.205510: 100%|█| 256/256 [00:00<00:00, 7461.20it/s]
Epoch 254: Train, Loglike in nats: 5.143805: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 5.254789: 100%|█| 256/256 [00:00<00:00, 7462.66it/s]
Epoch 255: Train, Loglike in nats: 5.123546: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 5.200665: 100%|█| 256/256 [00:00<00:00, 7507.58it/s]
Epoch 256: Train, Loglike in nats: 5.177478: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 5.211371: 100%|█| 256/256 [00:00<00:00, 7220.23it/s]
Epoch 257: Train, Loglike in nats: 5.121754: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 5.106763: 100%|█| 256/256 [00:00<00:00, 6886.89it/s]
Epoch 258: Train, Loglike in nats: 5.167212: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 5.172981: 100%|█| 256/256 [00:00<00:00, 7445.48it/s]
Epoch 259: Train, Loglike in nats: 5.126055: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 5.169009: 100%|█| 256/256 [00:00<00:00, 7382.81it/s]
Epoch 260: Train, Loglike in nats: 5.150400: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 5.154891: 100%|█| 256/256 [00:00<00:00, 7690.68it/s]
Epoch 261: Train, Loglike in nats: 5.127478: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 5.113437: 100%|█| 256/256 [00:00<00:00, 7361.15it/s]
Epoch 262: Train, Loglike in nats: 5.146076: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 5.208222: 100%|█| 256/256 [00:00<00:00, 7639.08it/s]
Epoch 263: Train, Loglike in nats: 5.129072: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 5.155390: 100%|█| 256/256 [00:00<00:00, 6537.44it/s]
Epoch 264: Train, Loglike in nats: 5.156494: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 5.173073: 100%|█| 256/256 [00:00<00:00, 7292.21it/s]
Epoch 265: Train, Loglike in nats: 5.163797: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 5.169765: 100%|█| 256/256 [00:00<00:00, 7081.80it/s]
Epoch 266: Train, Loglike in nats: 5.168819: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 5.263631: 100%|█| 256/256 [00:00<00:00, 7107.34it/s]
Epoch 267: Train, Loglike in nats: 5.158370: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 5.160183: 100%|█| 256/256 [00:00<00:00, 7384.54it/s]
Epoch 268: Train, Loglike in nats: 5.165156: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 5.183895: 100%|█| 256/256 [00:00<00:00, 7563.27it/s]
Epoch 269: Train, Loglike in nats: 5.146857: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 5.193723: 100%|█| 256/256 [00:00<00:00, 7254.03it/s]
Epoch 270: Train, Loglike in nats: 5.160407: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 5.196368: 100%|█| 256/256 [00:00<00:00, 7018.33it/s]
Epoch 271: Train, Loglike in nats: 5.167139: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 5.173479: 100%|█| 256/256 [00:00<00:00, 7325.80it/s]
Epoch 272: Train, Loglike in nats: 5.149775: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 5.257178: 100%|█| 256/256 [00:00<00:00, 7051.15it/s]
Epoch 273: Train, Loglike in nats: 5.142056: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 5.225978: 100%|█| 256/256 [00:00<00:00, 7036.22it/s]
Epoch 274: Train, Loglike in nats: 5.147622: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 5.198354: 100%|█| 256/256 [00:00<00:00, 7277.29it/s]
Epoch 275: Train, Loglike in nats: 5.151979: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 5.228982: 100%|█| 256/256 [00:00<00:00, 6993.79it/s]
Epoch 276: Train, Loglike in nats: 5.157323: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 5.244571: 100%|█| 256/256 [00:00<00:00, 7394.97it/s]
Epoch 277: Train, Loglike in nats: 5.173774: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 5.136812: 100%|█| 256/256 [00:00<00:00, 7471.38it/s]
Epoch 278: Train, Loglike in nats: 5.158896: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 5.059916: 100%|█| 256/256 [00:00<00:00, 7075.54it/s]
Epoch 279: Train, Loglike in nats: 5.152943: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 5.184673: 100%|█| 256/256 [00:00<00:00, 6883.71it/s]
Epoch 280: Train, Loglike in nats: 5.179606: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 5.204752: 100%|█| 256/256 [00:00<00:00, 7311.08it/s]
Epoch 281: Train, Loglike in nats: 5.170100: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 5.212417: 100%|█| 256/256 [00:00<00:00, 6885.08it/s]
Epoch 282: Train, Loglike in nats: 5.138464: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 5.184686: 100%|█| 256/256 [00:00<00:00, 7336.51it/s]
Epoch 283: Train, Loglike in nats: 5.171954: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 5.115675: 100%|█| 256/256 [00:00<00:00, 7474.92it/s]
Epoch 284: Train, Loglike in nats: 5.148740: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 5.175754: 100%|█| 256/256 [00:00<00:00, 7445.94it/s]
Epoch 285: Train, Loglike in nats: 5.161445: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 5.199004: 100%|█| 256/256 [00:00<00:00, 7134.31it/s]
Epoch 286: Train, Loglike in nats: 5.180827: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 5.148674: 100%|█| 256/256 [00:00<00:00, 7171.43it/s]
Epoch 287: Train, Loglike in nats: 5.151980: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 5.112621: 100%|█| 256/256 [00:00<00:00, 7166.88it/s]
Epoch 288: Train, Loglike in nats: 5.186673: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 5.162656: 100%|█| 256/256 [00:00<00:00, 6826.68it/s]
Epoch 289: Train, Loglike in nats: 5.174800: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 5.138060: 100%|█| 256/256 [00:00<00:00, 6726.95it/s]
Epoch 290: Train, Loglike in nats: 5.164673: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 5.187915: 100%|█| 256/256 [00:00<00:00, 7019.11it/s]
Epoch 291: Train, Loglike in nats: 5.160560: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 5.184336: 100%|█| 256/256 [00:00<00:00, 7123.99it/s]
Epoch 292: Train, Loglike in nats: 5.152422: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 5.210833: 100%|█| 256/256 [00:00<00:00, 6749.10it/s]
Epoch 293: Train, Loglike in nats: 5.127267: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 5.233580: 100%|█| 256/256 [00:00<00:00, 7171.00it/s]
Epoch 294: Train, Loglike in nats: 5.148996: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 5.155513: 100%|█| 256/256 [00:00<00:00, 6926.92it/s]
Epoch 295: Train, Loglike in nats: 5.161234: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 5.148299: 100%|█| 256/256 [00:00<00:00, 7294.09it/s]
Epoch 296: Train, Loglike in nats: 5.160137: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 5.261293: 100%|█| 256/256 [00:00<00:00, 7371.16it/s]
Epoch 297: Train, Loglike in nats: 5.185086: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 5.247223: 100%|█| 256/256 [00:00<00:00, 7659.41it/s]
Epoch 298: Train, Loglike in nats: 5.146867: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 5.186357: 100%|█| 256/256 [00:00<00:00, 7685.34it/s]
Epoch 299: Train, Loglike in nats: 5.156577: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 5.203336: 100%|█| 256/256 [00:00<00:00, 7704.14it/s]
Generating simulations
256it [00:00, 2968.50it/s]
WARNING:root:Too few points to create valid contours
Effective sample size for current/all rounds 832.6/874.1
---------------------- Round: 2 ----------------------
Epoch 0: Train, Loglike in nats: -25.459032: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 0.716796: 100%|█| 256/256 [00:00<00:00, 1351.22it/s]
Epoch 1: Train, Loglike in nats: 1.816165: 100%|█| 2304/2304 [00:00<00:00, 3
- Val, Loglike in nats: 2.938455: 100%|█| 256/256 [00:00<00:00, 6964.07it/s]
Epoch 2: Train, Loglike in nats: 3.767795: 100%|█| 2304/2304 [00:00<00:00, 3
- Val, Loglike in nats: 4.019073: 100%|█| 256/256 [00:00<00:00, 7134.31it/s]
Epoch 3: Train, Loglike in nats: 3.963702: 100%|█| 2304/2304 [00:00<00:00, 3
- Val, Loglike in nats: 3.872475: 100%|█| 256/256 [00:00<00:00, 7504.43it/s]
Epoch 4: Train, Loglike in nats: 4.032058: 100%|█| 2304/2304 [00:00<00:00, 3
- Val, Loglike in nats: 4.027811: 100%|█| 256/256 [00:00<00:00, 7622.49it/s]
Epoch 5: Train, Loglike in nats: 4.110664: 100%|█| 2304/2304 [00:00<00:00, 3
- Val, Loglike in nats: 4.155464: 100%|█| 256/256 [00:00<00:00, 7589.03it/s]
Epoch 6: Train, Loglike in nats: 3.645802: 100%|█| 2304/2304 [00:00<00:00, 3
- Val, Loglike in nats: 3.652211: 100%|█| 256/256 [00:00<00:00, 7381.60it/s]
Epoch 7: Train, Loglike in nats: 3.993701: 100%|█| 2304/2304 [00:00<00:00, 3
- Val, Loglike in nats: 4.068994: 100%|█| 256/256 [00:00<00:00, 7692.06it/s]
Epoch 8: Train, Loglike in nats: 3.871829: 100%|█| 2304/2304 [00:00<00:00, 3
- Val, Loglike in nats: 2.962914: 100%|█| 256/256 [00:00<00:00, 7362.67it/s]
Epoch 9: Train, Loglike in nats: 3.788942: 100%|█| 2304/2304 [00:00<00:00, 3
- Val, Loglike in nats: 3.853029: 100%|█| 256/256 [00:00<00:00, 7348.31it/s]
Epoch 10: Train, Loglike in nats: 4.076739: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.330261: 100%|█| 256/256 [00:00<00:00, 7055.69it/s]
Epoch 11: Train, Loglike in nats: 4.015337: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 3.818393: 100%|█| 256/256 [00:00<00:00, 7074.56it/s]
Epoch 12: Train, Loglike in nats: 3.927076: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 3.837148: 100%|█| 256/256 [00:00<00:00, 7640.66it/s]
Epoch 13: Train, Loglike in nats: 4.027839: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.168886: 100%|█| 256/256 [00:00<00:00, 7754.72it/s]
Epoch 14: Train, Loglike in nats: 4.161034: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.196741: 100%|█| 256/256 [00:00<00:00, 6817.19it/s]
Epoch 15: Train, Loglike in nats: 4.160670: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.282686: 100%|█| 256/256 [00:00<00:00, 7199.12it/s]
Epoch 16: Train, Loglike in nats: 4.191583: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.225052: 100%|█| 256/256 [00:00<00:00, 7080.63it/s]
Epoch 17: Train, Loglike in nats: 4.277606: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.220875: 100%|█| 256/256 [00:00<00:00, 7280.99it/s]
Epoch 18: Train, Loglike in nats: 4.190850: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.346900: 100%|█| 256/256 [00:00<00:00, 7307.00it/s]
Epoch 19: Train, Loglike in nats: 4.216282: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.283581: 100%|█| 256/256 [00:00<00:00, 7467.02it/s]
Epoch 20: Train, Loglike in nats: 4.134266: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.185882: 100%|█| 256/256 [00:00<00:00, 7212.95it/s]
Epoch 21: Train, Loglike in nats: 3.997634: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.268462: 100%|█| 256/256 [00:00<00:00, 7552.79it/s]
Epoch 22: Train, Loglike in nats: 4.168719: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.337598: 100%|█| 256/256 [00:00<00:00, 7675.01it/s]
Epoch 23: Train, Loglike in nats: 4.205741: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.159449: 100%|█| 256/256 [00:00<00:00, 7698.07it/s]
Epoch 24: Train, Loglike in nats: 4.218801: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.149680: 100%|█| 256/256 [00:00<00:00, 7372.42it/s]
Epoch 25: Train, Loglike in nats: 4.212697: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.200192: 100%|█| 256/256 [00:00<00:00, 6942.95it/s]
Epoch 26: Train, Loglike in nats: 4.326603: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.346785: 100%|█| 256/256 [00:00<00:00, 7016.41it/s]
Epoch 27: Train, Loglike in nats: 4.271183: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.317245: 100%|█| 256/256 [00:00<00:00, 7195.65it/s]
Epoch 28: Train, Loglike in nats: 4.270976: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.308356: 100%|█| 256/256 [00:00<00:00, 7128.34it/s]
Epoch 29: Train, Loglike in nats: 4.235686: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.278309: 100%|█| 256/256 [00:00<00:00, 7133.31it/s]
Epoch 30: Train, Loglike in nats: 4.255909: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.134195: 100%|█| 256/256 [00:00<00:00, 7478.82it/s]
Epoch 31: Train, Loglike in nats: 4.155123: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.390512: 100%|█| 256/256 [00:00<00:00, 7189.82it/s]
Epoch 32: Train, Loglike in nats: 4.295762: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.168796: 100%|█| 256/256 [00:00<00:00, 6975.11it/s]
Epoch 33: Train, Loglike in nats: 4.149734: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.189861: 100%|█| 256/256 [00:00<00:00, 6938.60it/s]
Epoch 34: Train, Loglike in nats: 4.081147: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.286496: 100%|█| 256/256 [00:00<00:00, 7264.04it/s]
Epoch 35: Train, Loglike in nats: 4.284154: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.275317: 100%|█| 256/256 [00:00<00:00, 6957.62it/s]
Epoch 36: Train, Loglike in nats: 4.278087: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.305576: 100%|█| 256/256 [00:00<00:00, 7134.73it/s]
Epoch 37: Train, Loglike in nats: 4.237536: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.134045: 100%|█| 256/256 [00:00<00:00, 7243.71it/s]
Epoch 38: Train, Loglike in nats: 4.065331: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.244261: 100%|█| 256/256 [00:00<00:00, 6994.15it/s]
Epoch 39: Train, Loglike in nats: 4.031012: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.330646: 100%|█| 256/256 [00:00<00:00, 7187.99it/s]
Epoch 40: Train, Loglike in nats: 3.858065: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.224121: 100%|█| 256/256 [00:00<00:00, 6951.00it/s]
Epoch 41: Train, Loglike in nats: 4.246456: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.343836: 100%|█| 256/256 [00:00<00:00, 6944.08it/s]
Epoch 42: Train, Loglike in nats: 4.154380: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.020471: 100%|█| 256/256 [00:00<00:00, 6986.09it/s]
Epoch 43: Train, Loglike in nats: 4.299876: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.407318: 100%|█| 256/256 [00:00<00:00, 6982.37it/s]
Epoch 44: Train, Loglike in nats: 4.406497: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.413136: 100%|█| 256/256 [00:00<00:00, 6903.01it/s]
Epoch 45: Train, Loglike in nats: 4.393619: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.465865: 100%|█| 256/256 [00:00<00:00, 7166.21it/s]
Epoch 46: Train, Loglike in nats: 4.213091: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.308416: 100%|█| 256/256 [00:00<00:00, 7097.52it/s]
Epoch 47: Train, Loglike in nats: 4.110359: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 3.968832: 100%|█| 256/256 [00:00<00:00, 7168.84it/s]
Epoch 48: Train, Loglike in nats: 4.037476: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.417141: 100%|█| 256/256 [00:00<00:00, 6913.32it/s]
Epoch 49: Train, Loglike in nats: 4.274728: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.454271: 100%|█| 256/256 [00:00<00:00, 6829.94it/s]
Epoch 50: Train, Loglike in nats: 4.260391: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.253131: 100%|█| 256/256 [00:00<00:00, 6899.37it/s]
Epoch 51: Train, Loglike in nats: 3.777712: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 2.940146: 100%|█| 256/256 [00:00<00:00, 7249.28it/s]
Epoch 52: Train, Loglike in nats: 3.553122: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.019976: 100%|█| 256/256 [00:00<00:00, 7343.68it/s]
Epoch 53: Train, Loglike in nats: 4.342750: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.482338: 100%|█| 256/256 [00:00<00:00, 7395.17it/s]
Epoch 54: Train, Loglike in nats: 4.363355: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.321406: 100%|█| 256/256 [00:00<00:00, 7216.39it/s]
Epoch 55: Train, Loglike in nats: 4.389521: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.506277: 100%|█| 256/256 [00:00<00:00, 7238.53it/s]
Epoch 56: Train, Loglike in nats: 4.442504: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.441913: 100%|█| 256/256 [00:00<00:00, 6860.18it/s]
Epoch 57: Train, Loglike in nats: 4.446343: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.528080: 100%|█| 256/256 [00:00<00:00, 6780.04it/s]
Epoch 58: Train, Loglike in nats: 4.398529: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.333248: 100%|█| 256/256 [00:00<00:00, 7196.03it/s]
Epoch 59: Train, Loglike in nats: 4.094214: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 3.507918: 100%|█| 256/256 [00:00<00:00, 7111.11it/s]
Epoch 60: Train, Loglike in nats: 4.185894: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.279068: 100%|█| 256/256 [00:00<00:00, 6841.47it/s]
Epoch 61: Train, Loglike in nats: 4.398495: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.427952: 100%|█| 256/256 [00:00<00:00, 7374.30it/s]
Epoch 62: Train, Loglike in nats: 4.371146: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.536351: 100%|█| 256/256 [00:00<00:00, 7373.69it/s]
Epoch 63: Train, Loglike in nats: 4.218025: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 3.235493: 100%|█| 256/256 [00:00<00:00, 6744.99it/s]
Epoch 64: Train, Loglike in nats: 3.175480: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 3.932615: 100%|█| 256/256 [00:00<00:00, 6793.34it/s]
Epoch 65: Train, Loglike in nats: 4.174471: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.202407: 100%|█| 256/256 [00:00<00:00, 7067.11it/s]
Epoch 66: Train, Loglike in nats: 4.304278: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.359468: 100%|█| 256/256 [00:00<00:00, 7021.59it/s]
Epoch 67: Train, Loglike in nats: 4.264257: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.129058: 100%|█| 256/256 [00:00<00:00, 7119.50it/s]
Epoch 68: Train, Loglike in nats: 4.313629: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.475007: 100%|█| 256/256 [00:00<00:00, 7116.91it/s]
Epoch 69: Train, Loglike in nats: 4.310327: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.398302: 100%|█| 256/256 [00:00<00:00, 7525.26it/s]
Epoch 70: Train, Loglike in nats: 4.390965: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.438315: 100%|█| 256/256 [00:00<00:00, 7156.99it/s]
Epoch 71: Train, Loglike in nats: 4.354778: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.349362: 100%|█| 256/256 [00:00<00:00, 6882.30it/s]
Epoch 72: Train, Loglike in nats: 4.372137: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.310641: 100%|█| 256/256 [00:00<00:00, 6938.78it/s]
Epoch 73: Train, Loglike in nats: 4.348265: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.427760: 100%|█| 256/256 [00:00<00:00, 6915.77it/s]
Epoch 74: Train, Loglike in nats: 4.298110: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.478752: 100%|█| 256/256 [00:00<00:00, 6765.52it/s]
Epoch 75: Train, Loglike in nats: 4.462824: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.478666: 100%|█| 256/256 [00:00<00:00, 7319.95it/s]
Epoch 76: Train, Loglike in nats: 4.403349: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.274703: 100%|█| 256/256 [00:00<00:00, 7136.92it/s]
Epoch 77: Train, Loglike in nats: 4.356835: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.414157: 100%|█| 256/256 [00:00<00:00, 7097.52it/s]
Epoch 78: Train, Loglike in nats: 4.387547: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.316439: 100%|█| 256/256 [00:00<00:00, 7243.90it/s]
Epoch 79: Train, Loglike in nats: 4.408562: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.153494: 100%|█| 256/256 [00:00<00:00, 7394.31it/s]
Epoch 80: Train, Loglike in nats: 4.334682: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.572682: 100%|█| 256/256 [00:00<00:00, 6920.45it/s]
Epoch 81: Train, Loglike in nats: 4.440049: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.425889: 100%|█| 256/256 [00:00<00:00, 6747.11it/s]
Epoch 82: Train, Loglike in nats: 4.376562: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.360289: 100%|█| 256/256 [00:00<00:00, 6831.20it/s]
Epoch 83: Train, Loglike in nats: 4.436251: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.424048: 100%|█| 256/256 [00:00<00:00, 7158.23it/s]
Epoch 84: Train, Loglike in nats: 4.411824: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.485960: 100%|█| 256/256 [00:00<00:00, 6871.20it/s]
Epoch 85: Train, Loglike in nats: 4.428925: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.540188: 100%|█| 256/256 [00:00<00:00, 7150.22it/s]
Epoch 86: Train, Loglike in nats: 4.453360: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.578872: 100%|█| 256/256 [00:00<00:00, 7080.21it/s]
Epoch 87: Train, Loglike in nats: 4.497378: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.507009: 100%|█| 256/256 [00:00<00:00, 6860.31it/s]
Epoch 88: Train, Loglike in nats: 4.459049: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.503995: 100%|█| 256/256 [00:00<00:00, 7383.07it/s]
Epoch 89: Train, Loglike in nats: 4.460312: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.429508: 100%|█| 256/256 [00:00<00:00, 6975.84it/s]
Epoch 90: Train, Loglike in nats: 4.229008: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.471846: 100%|█| 256/256 [00:00<00:00, 6882.08it/s]
Epoch 91: Train, Loglike in nats: 4.401881: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.413384: 100%|█| 256/256 [00:00<00:00, 7392.01it/s]
Epoch 92: Train, Loglike in nats: 4.441780: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.487418: 100%|█| 256/256 [00:00<00:00, 7172.48it/s]
Epoch 93: Train, Loglike in nats: 4.333367: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.381265: 100%|█| 256/256 [00:00<00:00, 7363.27it/s]
Epoch 94: Train, Loglike in nats: 4.354813: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.307774: 100%|█| 256/256 [00:00<00:00, 7229.85it/s]
Epoch 95: Train, Loglike in nats: 4.456592: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.496818: 100%|█| 256/256 [00:00<00:00, 7201.10it/s]
Epoch 96: Train, Loglike in nats: 4.472215: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.544455: 100%|█| 256/256 [00:00<00:00, 7270.83it/s]
Epoch 97: Train, Loglike in nats: 4.485637: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.525896: 100%|█| 256/256 [00:00<00:00, 6695.78it/s]
Epoch 98: Train, Loglike in nats: 4.486530: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.595785: 100%|█| 256/256 [00:00<00:00, 6998.94it/s]
Epoch 99: Train, Loglike in nats: 4.505122: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.633898: 100%|█| 256/256 [00:00<00:00, 6894.85it/s]
Epoch 100: Train, Loglike in nats: 4.478048: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.492528: 100%|█| 256/256 [00:00<00:00, 7030.46it/s]
Epoch 101: Train, Loglike in nats: 4.346496: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.432290: 100%|█| 256/256 [00:00<00:00, 7077.27it/s]
Epoch 102: Train, Loglike in nats: 4.246643: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.041471: 100%|█| 256/256 [00:00<00:00, 6970.18it/s]
Epoch 103: Train, Loglike in nats: 4.245991: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.494583: 100%|█| 256/256 [00:00<00:00, 7093.16it/s]
Epoch 104: Train, Loglike in nats: 4.366352: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.602152: 100%|█| 256/256 [00:00<00:00, 7102.22it/s]
Epoch 105: Train, Loglike in nats: 4.543465: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.552619: 100%|█| 256/256 [00:00<00:00, 6626.11it/s]
Epoch 106: Train, Loglike in nats: 4.551825: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.550610: 100%|█| 256/256 [00:00<00:00, 7086.70it/s]
Epoch 107: Train, Loglike in nats: 4.387917: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.460163: 100%|█| 256/256 [00:00<00:00, 7424.62it/s]
Epoch 108: Train, Loglike in nats: 4.390234: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.568196: 100%|█| 256/256 [00:00<00:00, 7318.70it/s]
Epoch 109: Train, Loglike in nats: 4.547569: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.484544: 100%|█| 256/256 [00:00<00:00, 7530.96it/s]
Epoch 110: Train, Loglike in nats: 4.574683: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.680196: 100%|█| 256/256 [00:00<00:00, 7685.39it/s]
Epoch 111: Train, Loglike in nats: 4.556639: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.572621: 100%|█| 256/256 [00:00<00:00, 7163.05it/s]
Epoch 112: Train, Loglike in nats: 4.444817: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.281064: 100%|█| 256/256 [00:00<00:00, 7220.81it/s]
Epoch 113: Train, Loglike in nats: 4.513227: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.576050: 100%|█| 256/256 [00:00<00:00, 6993.19it/s]
Epoch 114: Train, Loglike in nats: 4.556698: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.611020: 100%|█| 256/256 [00:00<00:00, 6960.69it/s]
Epoch 115: Train, Loglike in nats: 4.482500: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.572237: 100%|█| 256/256 [00:00<00:00, 7431.77it/s]
Epoch 116: Train, Loglike in nats: 4.456186: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.655474: 100%|█| 256/256 [00:00<00:00, 7649.59it/s]
Epoch 117: Train, Loglike in nats: 4.539685: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.389518: 100%|█| 256/256 [00:00<00:00, 7395.02it/s]
Epoch 118: Train, Loglike in nats: 4.500516: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.401004: 100%|█| 256/256 [00:00<00:00, 7670.68it/s]
Epoch 119: Train, Loglike in nats: 4.529864: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.557676: 100%|█| 256/256 [00:00<00:00, 7647.73it/s]
Epoch 120: Train, Loglike in nats: 4.468634: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.548501: 100%|█| 256/256 [00:00<00:00, 7038.95it/s]
Epoch 121: Train, Loglike in nats: 4.563500: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.578938: 100%|█| 256/256 [00:00<00:00, 6985.73it/s]
Epoch 122: Train, Loglike in nats: 4.608435: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.721342: 100%|█| 256/256 [00:00<00:00, 7192.42it/s]
Epoch 123: Train, Loglike in nats: 4.580320: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.665948: 100%|█| 256/256 [00:00<00:00, 7351.02it/s]
Epoch 124: Train, Loglike in nats: 4.532303: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.632061: 100%|█| 256/256 [00:00<00:00, 7418.57it/s]
Epoch 125: Train, Loglike in nats: 4.606361: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.534810: 100%|█| 256/256 [00:00<00:00, 7414.73it/s]
Epoch 126: Train, Loglike in nats: 4.556992: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.507894: 100%|█| 256/256 [00:00<00:00, 7521.47it/s]
Epoch 127: Train, Loglike in nats: 4.586454: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.712366: 100%|█| 256/256 [00:00<00:00, 7189.58it/s]
Epoch 128: Train, Loglike in nats: 4.546159: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.611938: 100%|█| 256/256 [00:00<00:00, 7467.95it/s]
Epoch 129: Train, Loglike in nats: 4.439271: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.402538: 100%|█| 256/256 [00:00<00:00, 6923.79it/s]
Epoch 130: Train, Loglike in nats: 4.560505: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.643305: 100%|█| 256/256 [00:00<00:00, 6947.04it/s]
Epoch 131: Train, Loglike in nats: 4.563086: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.585982: 100%|█| 256/256 [00:00<00:00, 7034.89it/s]
Epoch 132: Train, Loglike in nats: 4.550482: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.686270: 100%|█| 256/256 [00:00<00:00, 6998.62it/s]
Epoch 133: Train, Loglike in nats: 4.442138: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.416639: 100%|█| 256/256 [00:00<00:00, 7178.91it/s]
Epoch 134: Train, Loglike in nats: 4.222669: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.360689: 100%|█| 256/256 [00:00<00:00, 7434.55it/s]
Epoch 135: Train, Loglike in nats: 4.293054: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.129561: 100%|█| 256/256 [00:00<00:00, 7182.89it/s]
Epoch 136: Train, Loglike in nats: 4.519616: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.504741: 100%|█| 256/256 [00:00<00:00, 7097.52it/s]
Epoch 137: Train, Loglike in nats: 4.533878: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.677875: 100%|█| 256/256 [00:00<00:00, 7451.37it/s]
Epoch 138: Train, Loglike in nats: 4.656576: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.739008: 100%|█| 256/256 [00:00<00:00, 7105.93it/s]
Epoch 139: Train, Loglike in nats: 4.671229: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.676918: 100%|█| 256/256 [00:00<00:00, 7023.47it/s]
Epoch 140: Train, Loglike in nats: 4.676200: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.684293: 100%|█| 256/256 [00:00<00:00, 7212.52it/s]
Epoch 141: Train, Loglike in nats: 4.588891: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.553392: 100%|█| 256/256 [00:00<00:00, 6866.59it/s]
Epoch 142: Train, Loglike in nats: 4.572881: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.708003: 100%|█| 256/256 [00:00<00:00, 7046.29it/s]
Epoch 143: Train, Loglike in nats: 4.680336: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.651568: 100%|█| 256/256 [00:00<00:00, 7356.51it/s]
Epoch 144: Train, Loglike in nats: 4.633306: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.630590: 100%|█| 256/256 [00:00<00:00, 7171.28it/s]
Epoch 145: Train, Loglike in nats: 4.517875: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.712124: 100%|█| 256/256 [00:00<00:00, 7206.80it/s]
Epoch 146: Train, Loglike in nats: 4.617796: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.585333: 100%|█| 256/256 [00:00<00:00, 7511.73it/s]
Epoch 147: Train, Loglike in nats: 4.565910: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.725930: 100%|█| 256/256 [00:00<00:00, 7219.45it/s]
Epoch 148: Train, Loglike in nats: 4.627827: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.651860: 100%|█| 256/256 [00:00<00:00, 7304.71it/s]
Epoch 149: Train, Loglike in nats: 4.667055: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.736513: 100%|█| 256/256 [00:00<00:00, 7077.50it/s]
Epoch 150: Train, Loglike in nats: 4.628793: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.659184: 100%|█| 256/256 [00:00<00:00, 7264.88it/s]
Epoch 151: Train, Loglike in nats: 4.675322: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.702706: 100%|█| 256/256 [00:00<00:00, 7119.17it/s]
Epoch 152: Train, Loglike in nats: 4.658490: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.599602: 100%|█| 256/256 [00:00<00:00, 7242.88it/s]
Epoch 153: Train, Loglike in nats: 4.668788: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.724724: 100%|█| 256/256 [00:00<00:00, 7219.60it/s]
Epoch 154: Train, Loglike in nats: 4.626144: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.700100: 100%|█| 256/256 [00:00<00:00, 7323.50it/s]
Epoch 155: Train, Loglike in nats: 4.593838: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.745340: 100%|█| 256/256 [00:00<00:00, 7048.28it/s]
Epoch 156: Train, Loglike in nats: 4.697848: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.755816: 100%|█| 256/256 [00:00<00:00, 6970.72it/s]
Epoch 157: Train, Loglike in nats: 4.710353: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.692124: 100%|█| 256/256 [00:00<00:00, 6988.41it/s]
Epoch 158: Train, Loglike in nats: 4.563360: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.593971: 100%|█| 256/256 [00:00<00:00, 7050.22it/s]
Epoch 159: Train, Loglike in nats: 4.617407: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.748337: 100%|█| 256/256 [00:00<00:00, 7138.05it/s]
Epoch 160: Train, Loglike in nats: 4.683209: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.714194: 100%|█| 256/256 [00:00<00:00, 7395.27it/s]
Epoch 161: Train, Loglike in nats: 4.758719: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.775281: 100%|█| 256/256 [00:00<00:00, 7218.77it/s]
Epoch 162: Train, Loglike in nats: 4.698996: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.720401: 100%|█| 256/256 [00:00<00:00, 7337.36it/s]
Epoch 163: Train, Loglike in nats: 4.685947: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.656868: 100%|█| 256/256 [00:00<00:00, 7658.48it/s]
Epoch 164: Train, Loglike in nats: 4.625983: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.719793: 100%|█| 256/256 [00:00<00:00, 7166.21it/s]
Epoch 165: Train, Loglike in nats: 4.623974: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.793547: 100%|█| 256/256 [00:00<00:00, 7296.77it/s]
Epoch 166: Train, Loglike in nats: 4.707324: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.729740: 100%|█| 256/256 [00:00<00:00, 7019.30it/s]
Epoch 167: Train, Loglike in nats: 4.699100: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.714632: 100%|█| 256/256 [00:00<00:00, 7040.33it/s]
Epoch 168: Train, Loglike in nats: 4.756079: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.839397: 100%|█| 256/256 [00:00<00:00, 6954.47it/s]
Epoch 169: Train, Loglike in nats: 4.684510: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.763081: 100%|█| 256/256 [00:00<00:00, 7609.52it/s]
Epoch 170: Train, Loglike in nats: 4.718971: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.857027: 100%|█| 256/256 [00:00<00:00, 7461.77it/s]
Epoch 171: Train, Loglike in nats: 4.633773: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.685323: 100%|█| 256/256 [00:00<00:00, 7470.03it/s]
Epoch 172: Train, Loglike in nats: 4.613327: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.654237: 100%|█| 256/256 [00:00<00:00, 7586.08it/s]
Epoch 173: Train, Loglike in nats: 4.739897: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.742795: 100%|█| 256/256 [00:00<00:00, 7202.12it/s]
Epoch 174: Train, Loglike in nats: 4.713966: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.818064: 100%|█| 256/256 [00:00<00:00, 7062.23it/s]
Epoch 175: Train, Loglike in nats: 4.730965: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.659272: 100%|█| 256/256 [00:00<00:00, 7077.92it/s]
Epoch 176: Train, Loglike in nats: 4.753417: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.769886: 100%|█| 256/256 [00:00<00:00, 7000.26it/s]
Epoch 177: Train, Loglike in nats: 4.663913: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.757805: 100%|█| 256/256 [00:00<00:00, 6957.26it/s]
Epoch 178: Train, Loglike in nats: 4.670643: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.615166: 100%|█| 256/256 [00:00<00:00, 7381.14it/s]
Epoch 179: Train, Loglike in nats: 4.734698: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.681443: 100%|█| 256/256 [00:00<00:00, 7462.24it/s]
Epoch 180: Train, Loglike in nats: 4.728320: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.766556: 100%|█| 256/256 [00:00<00:00, 7562.57it/s]
Epoch 181: Train, Loglike in nats: 4.744843: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.778620: 100%|█| 256/256 [00:00<00:00, 7395.02it/s]
Epoch 182: Train, Loglike in nats: 4.715136: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.793665: 100%|█| 256/256 [00:00<00:00, 7264.88it/s]
Epoch 183: Train, Loglike in nats: 4.690339: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.787398: 100%|█| 256/256 [00:00<00:00, 6929.38it/s]
Epoch 184: Train, Loglike in nats: 4.762077: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.802665: 100%|█| 256/256 [00:00<00:00, 7123.33it/s]
Epoch 185: Train, Loglike in nats: 4.740115: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.858251: 100%|█| 256/256 [00:00<00:00, 7128.77it/s]
Epoch 186: Train, Loglike in nats: 4.780403: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.793300: 100%|█| 256/256 [00:00<00:00, 7011.96it/s]
Epoch 187: Train, Loglike in nats: 4.747309: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.833971: 100%|█| 256/256 [00:00<00:00, 7154.18it/s]
Epoch 188: Train, Loglike in nats: 4.767345: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.774062: 100%|█| 256/256 [00:00<00:00, 7219.79it/s]
Epoch 189: Train, Loglike in nats: 4.728542: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.710522: 100%|█| 256/256 [00:00<00:00, 7635.44it/s]
Epoch 190: Train, Loglike in nats: 4.754664: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.782536: 100%|█| 256/256 [00:00<00:00, 7116.86it/s]
Epoch 191: Train, Loglike in nats: 4.741723: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.585524: 100%|█| 256/256 [00:00<00:00, 7150.46it/s]
Epoch 192: Train, Loglike in nats: 4.726345: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.567327: 100%|█| 256/256 [00:00<00:00, 6772.69it/s]
Epoch 193: Train, Loglike in nats: 4.703058: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.692782: 100%|█| 256/256 [00:00<00:00, 6847.28it/s]
Epoch 194: Train, Loglike in nats: 4.706592: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.642871: 100%|█| 256/256 [00:00<00:00, 7210.87it/s]
Epoch 195: Train, Loglike in nats: 4.706992: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.749754: 100%|█| 256/256 [00:00<00:00, 7498.72it/s]
Epoch 196: Train, Loglike in nats: 4.716857: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.799282: 100%|█| 256/256 [00:00<00:00, 7269.21it/s]
Epoch 197: Train, Loglike in nats: 4.744892: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.752505: 100%|█| 256/256 [00:00<00:00, 6991.87it/s]
Epoch 198: Train, Loglike in nats: 4.802556: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.759777: 100%|█| 256/256 [00:00<00:00, 6946.68it/s]
Epoch 199: Train, Loglike in nats: 4.775708: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.745548: 100%|█| 256/256 [00:00<00:00, 6697.41it/s]
Epoch 200: Train, Loglike in nats: 4.737733: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.688066: 100%|█| 256/256 [00:00<00:00, 7143.99it/s]
Epoch 201: Train, Loglike in nats: 4.764923: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.741889: 100%|█| 256/256 [00:00<00:00, 6443.17it/s]
Epoch 202: Train, Loglike in nats: 4.791975: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.947197: 100%|█| 256/256 [00:00<00:00, 6858.30it/s]
Epoch 203: Train, Loglike in nats: 4.774905: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.867058: 100%|█| 256/256 [00:00<00:00, 7260.95it/s]
Epoch 204: Train, Loglike in nats: 4.721918: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.797095: 100%|█| 256/256 [00:00<00:00, 6910.34it/s]
Epoch 205: Train, Loglike in nats: 4.757875: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.796571: 100%|█| 256/256 [00:00<00:00, 7313.42it/s]
Epoch 206: Train, Loglike in nats: 4.787943: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.828769: 100%|█| 256/256 [00:00<00:00, 7104.80it/s]
Epoch 207: Train, Loglike in nats: 4.780513: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.793428: 100%|█| 256/256 [00:00<00:00, 6721.14it/s]
Epoch 208: Train, Loglike in nats: 4.802980: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.704525: 100%|█| 256/256 [00:00<00:00, 6579.62it/s]
Epoch 209: Train, Loglike in nats: 4.761561: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.738401: 100%|█| 256/256 [00:00<00:00, 6956.54it/s]
Epoch 210: Train, Loglike in nats: 4.719154: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.782625: 100%|█| 256/256 [00:00<00:00, 6079.29it/s]
Epoch 211: Train, Loglike in nats: 4.791929: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.890286: 100%|█| 256/256 [00:00<00:00, 5768.46it/s]
Epoch 212: Train, Loglike in nats: 4.791015: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.843431: 100%|█| 256/256 [00:00<00:00, 6860.31it/s]
Epoch 213: Train, Loglike in nats: 4.828598: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.838082: 100%|█| 256/256 [00:00<00:00, 7258.30it/s]
Epoch 214: Train, Loglike in nats: 4.775691: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.769201: 100%|█| 256/256 [00:00<00:00, 7301.78it/s]
Epoch 215: Train, Loglike in nats: 4.811089: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.845944: 100%|█| 256/256 [00:00<00:00, 7051.38it/s]
Epoch 216: Train, Loglike in nats: 4.803718: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.749101: 100%|█| 256/256 [00:00<00:00, 7175.88it/s]
Epoch 217: Train, Loglike in nats: 4.814103: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.904918: 100%|█| 256/256 [00:00<00:00, 7270.44it/s]
Epoch 218: Train, Loglike in nats: 4.810892: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.854766: 100%|█| 256/256 [00:00<00:00, 7411.45it/s]
Epoch 219: Train, Loglike in nats: 4.849734: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.791654: 100%|█| 256/256 [00:00<00:00, 7396.29it/s]
Epoch 220: Train, Loglike in nats: 4.773797: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.812427: 100%|█| 256/256 [00:00<00:00, 7094.01it/s]
Epoch 221: Train, Loglike in nats: 4.800320: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.796589: 100%|█| 256/256 [00:00<00:00, 6970.54it/s]
Epoch 222: Train, Loglike in nats: 4.805697: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.763232: 100%|█| 256/256 [00:00<00:00, 6855.76it/s]
Epoch 223: Train, Loglike in nats: 4.784628: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.870389: 100%|█| 256/256 [00:00<00:00, 7452.71it/s]
Epoch 224: Train, Loglike in nats: 4.836376: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.840377: 100%|█| 256/256 [00:00<00:00, 7538.05it/s]
Epoch 225: Train, Loglike in nats: 4.786961: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.804414: 100%|█| 256/256 [00:00<00:00, 7522.78it/s]
Epoch 226: Train, Loglike in nats: 4.807696: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.806514: 100%|█| 256/256 [00:00<00:00, 7561.19it/s]
Epoch 227: Train, Loglike in nats: 4.820759: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.864990: 100%|█| 256/256 [00:00<00:00, 7714.33it/s]
Epoch 228: Train, Loglike in nats: 4.809407: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.887897: 100%|█| 256/256 [00:00<00:00, 7280.44it/s]
Epoch 229: Train, Loglike in nats: 4.837718: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.869583: 100%|█| 256/256 [00:00<00:00, 7524.47it/s]
Epoch 230: Train, Loglike in nats: 4.765549: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.856167: 100%|█| 256/256 [00:00<00:00, 7221.20it/s]
Epoch 231: Train, Loglike in nats: 4.817754: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.792692: 100%|█| 256/256 [00:00<00:00, 7524.15it/s]
Epoch 232: Train, Loglike in nats: 4.817926: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.865110: 100%|█| 256/256 [00:00<00:00, 7695.75it/s]
Epoch 233: Train, Loglike in nats: 4.803393: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.823866: 100%|█| 256/256 [00:00<00:00, 7665.37it/s]
Epoch 234: Train, Loglike in nats: 4.809716: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.768380: 100%|█| 256/256 [00:00<00:00, 7732.05it/s]
Epoch 235: Train, Loglike in nats: 4.805282: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.789787: 100%|█| 256/256 [00:00<00:00, 7712.67it/s]
Epoch 236: Train, Loglike in nats: 4.819271: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.893731: 100%|█| 256/256 [00:00<00:00, 7578.00it/s]
Epoch 237: Train, Loglike in nats: 4.860694: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.866067: 100%|█| 256/256 [00:00<00:00, 7447.90it/s]
Epoch 238: Train, Loglike in nats: 4.851028: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.828249: 100%|█| 256/256 [00:00<00:00, 7291.96it/s]
Epoch 239: Train, Loglike in nats: 4.821402: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.855254: 100%|█| 256/256 [00:00<00:00, 7527.42it/s]
Epoch 240: Train, Loglike in nats: 4.830735: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.796936: 100%|█| 256/256 [00:00<00:00, 7384.80it/s]
Epoch 241: Train, Loglike in nats: 4.848983: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.883338: 100%|█| 256/256 [00:00<00:00, 7595.10it/s]
Epoch 242: Train, Loglike in nats: 4.853800: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.961061: 100%|█| 256/256 [00:00<00:00, 7761.56it/s]
Epoch 243: Train, Loglike in nats: 4.838485: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.889397: 100%|█| 256/256 [00:00<00:00, 7675.01it/s]
Epoch 244: Train, Loglike in nats: 4.840094: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.884178: 100%|█| 256/256 [00:00<00:00, 7436.30it/s]
Epoch 245: Train, Loglike in nats: 4.843608: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.896363: 100%|█| 256/256 [00:00<00:00, 7100.62it/s]
Epoch 246: Train, Loglike in nats: 4.827901: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.865753: 100%|█| 256/256 [00:00<00:00, 6716.34it/s]
Epoch 247: Train, Loglike in nats: 4.872555: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.925087: 100%|█| 256/256 [00:00<00:00, 7156.08it/s]
Epoch 248: Train, Loglike in nats: 4.872678: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.903154: 100%|█| 256/256 [00:00<00:00, 6961.46it/s]
Epoch 249: Train, Loglike in nats: 4.852192: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.876648: 100%|█| 256/256 [00:00<00:00, 7194.83it/s]
Epoch 250: Train, Loglike in nats: 4.808098: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.883813: 100%|█| 256/256 [00:00<00:00, 6944.30it/s]
Epoch 251: Train, Loglike in nats: 4.846334: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.809102: 100%|█| 256/256 [00:00<00:00, 7051.19it/s]
Epoch 252: Train, Loglike in nats: 4.823839: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.847595: 100%|█| 256/256 [00:00<00:00, 6974.16it/s]
Epoch 253: Train, Loglike in nats: 4.840242: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.874866: 100%|█| 256/256 [00:00<00:00, 6789.35it/s]
Epoch 254: Train, Loglike in nats: 4.838672: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.911481: 100%|█| 256/256 [00:00<00:00, 6948.08it/s]
Epoch 255: Train, Loglike in nats: 4.843149: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.881008: 100%|█| 256/256 [00:00<00:00, 7160.28it/s]
Epoch 256: Train, Loglike in nats: 4.875273: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.907650: 100%|█| 256/256 [00:00<00:00, 6743.42it/s]
Epoch 257: Train, Loglike in nats: 4.843125: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.834339: 100%|█| 256/256 [00:00<00:00, 6912.38it/s]
Epoch 258: Train, Loglike in nats: 4.877197: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.887118: 100%|█| 256/256 [00:00<00:00, 6960.69it/s]
Epoch 259: Train, Loglike in nats: 4.845052: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.876871: 100%|█| 256/256 [00:00<00:00, 6924.95it/s]
Epoch 260: Train, Loglike in nats: 4.878731: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.888623: 100%|█| 256/256 [00:00<00:00, 6750.29it/s]
Epoch 261: Train, Loglike in nats: 4.847645: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.865180: 100%|█| 256/256 [00:00<00:00, 6772.13it/s]
Epoch 262: Train, Loglike in nats: 4.869785: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.931800: 100%|█| 256/256 [00:00<00:00, 6877.63it/s]
Epoch 263: Train, Loglike in nats: 4.863113: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.900752: 100%|█| 256/256 [00:00<00:00, 6767.48it/s]
Epoch 264: Train, Loglike in nats: 4.870215: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.864139: 100%|█| 256/256 [00:00<00:00, 6190.14it/s]
Epoch 265: Train, Loglike in nats: 4.872549: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.920706: 100%|█| 256/256 [00:00<00:00, 6733.99it/s]
Epoch 266: Train, Loglike in nats: 4.873785: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.993923: 100%|█| 256/256 [00:00<00:00, 7380.94it/s]
Epoch 267: Train, Loglike in nats: 4.878537: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.871083: 100%|█| 256/256 [00:00<00:00, 7297.61it/s]
Epoch 268: Train, Loglike in nats: 4.872050: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.880050: 100%|█| 256/256 [00:00<00:00, 6932.20it/s]
Epoch 269: Train, Loglike in nats: 4.860022: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.914714: 100%|█| 256/256 [00:00<00:00, 6968.05it/s]
Epoch 270: Train, Loglike in nats: 4.867594: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.940704: 100%|█| 256/256 [00:00<00:00, 6755.86it/s]
Epoch 271: Train, Loglike in nats: 4.877998: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.887568: 100%|█| 256/256 [00:00<00:00, 7434.96it/s]
Epoch 272: Train, Loglike in nats: 4.859782: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.921072: 100%|█| 256/256 [00:00<00:00, 7000.26it/s]
Epoch 273: Train, Loglike in nats: 4.866823: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.944920: 100%|█| 256/256 [00:00<00:00, 6926.38it/s]
Epoch 274: Train, Loglike in nats: 4.876299: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.920372: 100%|█| 256/256 [00:00<00:00, 7201.34it/s]
Epoch 275: Train, Loglike in nats: 4.858252: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.941661: 100%|█| 256/256 [00:00<00:00, 7293.05it/s]
Epoch 276: Train, Loglike in nats: 4.851760: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.926747: 100%|█| 256/256 [00:00<00:00, 6778.25it/s]
Epoch 277: Train, Loglike in nats: 4.897157: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.863073: 100%|█| 256/256 [00:00<00:00, 6747.15it/s]
Epoch 278: Train, Loglike in nats: 4.871885: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.803133: 100%|█| 256/256 [00:00<00:00, 6960.69it/s]
Epoch 279: Train, Loglike in nats: 4.851917: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.947403: 100%|█| 256/256 [00:00<00:00, 6725.85it/s]
Epoch 280: Train, Loglike in nats: 4.887821: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.908969: 100%|█| 256/256 [00:00<00:00, 7295.93it/s]
Epoch 281: Train, Loglike in nats: 4.879801: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.930233: 100%|█| 256/256 [00:00<00:00, 7011.78it/s]
Epoch 282: Train, Loglike in nats: 4.855300: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.889888: 100%|█| 256/256 [00:00<00:00, 7344.94it/s]
Epoch 283: Train, Loglike in nats: 4.884274: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.826675: 100%|█| 256/256 [00:00<00:00, 6856.85it/s]
Epoch 284: Train, Loglike in nats: 4.876749: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.901900: 100%|█| 256/256 [00:00<00:00, 7211.45it/s]
Epoch 285: Train, Loglike in nats: 4.867153: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.936841: 100%|█| 256/256 [00:00<00:00, 6757.13it/s]
Epoch 286: Train, Loglike in nats: 4.879673: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.882199: 100%|█| 256/256 [00:00<00:00, 6971.49it/s]
Epoch 287: Train, Loglike in nats: 4.860911: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.806086: 100%|█| 256/256 [00:00<00:00, 7022.79it/s]
Epoch 288: Train, Loglike in nats: 4.887481: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.871099: 100%|█| 256/256 [00:00<00:00, 7152.03it/s]
Epoch 289: Train, Loglike in nats: 4.886433: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.864386: 100%|█| 256/256 [00:00<00:00, 7095.55it/s]
Epoch 290: Train, Loglike in nats: 4.872854: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.877355: 100%|█| 256/256 [00:00<00:00, 7314.67it/s]
Epoch 291: Train, Loglike in nats: 4.867135: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.947392: 100%|█| 256/256 [00:00<00:00, 7001.81it/s]
Epoch 292: Train, Loglike in nats: 4.858369: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.927133: 100%|█| 256/256 [00:00<00:00, 7379.87it/s]
Epoch 293: Train, Loglike in nats: 4.850555: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.929248: 100%|█| 256/256 [00:00<00:00, 6640.25it/s]
Epoch 294: Train, Loglike in nats: 4.865536: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.871136: 100%|█| 256/256 [00:00<00:00, 7134.26it/s]
Epoch 295: Train, Loglike in nats: 4.879278: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.866585: 100%|█| 256/256 [00:00<00:00, 6871.90it/s]
Epoch 296: Train, Loglike in nats: 4.875204: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.968857: 100%|█| 256/256 [00:00<00:00, 7205.84it/s]
Epoch 297: Train, Loglike in nats: 4.891515: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.951466: 100%|█| 256/256 [00:00<00:00, 7109.74it/s]
Epoch 298: Train, Loglike in nats: 4.865585: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.940246: 100%|█| 256/256 [00:00<00:00, 6996.43it/s]
Epoch 299: Train, Loglike in nats: 4.873398: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.907986: 100%|█| 256/256 [00:00<00:00, 6986.91it/s]
Generating simulations
256it [00:00, 2977.96it/s]
WARNING:root:Too few points to create valid contours
Effective sample size for current/all rounds 981.6/1855.7
---------------------- Round: 3 ----------------------
Epoch 0: Train, Loglike in nats: -2.254916: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 3.607208: 100%|█| 256/256 [00:00<00:00, 1334.22it/s]
Epoch 1: Train, Loglike in nats: 3.961391: 100%|█| 2304/2304 [00:00<00:00, 3
- Val, Loglike in nats: 4.249711: 100%|█| 256/256 [00:00<00:00, 6990.96it/s]
Epoch 2: Train, Loglike in nats: 4.261970: 100%|█| 2304/2304 [00:00<00:00, 3
- Val, Loglike in nats: 4.421974: 100%|█| 256/256 [00:00<00:00, 7016.22it/s]
Epoch 3: Train, Loglike in nats: 4.304015: 100%|█| 2304/2304 [00:00<00:00, 3
- Val, Loglike in nats: 4.360326: 100%|█| 256/256 [00:00<00:00, 7141.28it/s]
Epoch 4: Train, Loglike in nats: 4.237622: 100%|█| 2304/2304 [00:00<00:00, 3
- Val, Loglike in nats: 4.493383: 100%|█| 256/256 [00:00<00:00, 7184.57it/s]
Epoch 5: Train, Loglike in nats: 4.404403: 100%|█| 2304/2304 [00:00<00:00, 3
- Val, Loglike in nats: 4.459258: 100%|█| 256/256 [00:00<00:00, 6830.51it/s]
Epoch 6: Train, Loglike in nats: 4.350708: 100%|█| 2304/2304 [00:00<00:00, 3
- Val, Loglike in nats: 4.407907: 100%|█| 256/256 [00:00<00:00, 7303.42it/s]
Epoch 7: Train, Loglike in nats: 4.355108: 100%|█| 2304/2304 [00:00<00:00, 3
- Val, Loglike in nats: 4.503678: 100%|█| 256/256 [00:00<00:00, 7277.48it/s]
Epoch 8: Train, Loglike in nats: 4.348162: 100%|█| 2304/2304 [00:00<00:00, 3
- Val, Loglike in nats: 4.218352: 100%|█| 256/256 [00:00<00:00, 7318.01it/s]
Epoch 9: Train, Loglike in nats: 4.191212: 100%|█| 2304/2304 [00:00<00:00, 3
- Val, Loglike in nats: 3.973791: 100%|█| 256/256 [00:00<00:00, 7148.41it/s]
Epoch 10: Train, Loglike in nats: 4.302415: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.426634: 100%|█| 256/256 [00:00<00:00, 7131.32it/s]
Epoch 11: Train, Loglike in nats: 4.252123: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.293779: 100%|█| 256/256 [00:00<00:00, 7329.65it/s]
Epoch 12: Train, Loglike in nats: 4.432020: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.513666: 100%|█| 256/256 [00:00<00:00, 7017.55it/s]
Epoch 13: Train, Loglike in nats: 4.391188: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.558033: 100%|█| 256/256 [00:00<00:00, 6985.37it/s]
Epoch 14: Train, Loglike in nats: 4.186291: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.399681: 100%|█| 256/256 [00:00<00:00, 7000.67it/s]
Epoch 15: Train, Loglike in nats: 4.360615: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.640914: 100%|█| 256/256 [00:00<00:00, 7112.24it/s]
Epoch 16: Train, Loglike in nats: 4.545840: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.590468: 100%|█| 256/256 [00:00<00:00, 7168.27it/s]
Epoch 17: Train, Loglike in nats: 4.498627: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.552762: 100%|█| 256/256 [00:00<00:00, 7284.10it/s]
Epoch 18: Train, Loglike in nats: 4.507410: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.645383: 100%|█| 256/256 [00:00<00:00, 7103.63it/s]
Epoch 19: Train, Loglike in nats: 4.481674: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.461302: 100%|█| 256/256 [00:00<00:00, 7131.75it/s]
Epoch 20: Train, Loglike in nats: 4.441385: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.054482: 100%|█| 256/256 [00:00<00:00, 7162.43it/s]
Epoch 21: Train, Loglike in nats: 4.240643: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.526018: 100%|█| 256/256 [00:00<00:00, 7248.01it/s]
Epoch 22: Train, Loglike in nats: 4.449009: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.404407: 100%|█| 256/256 [00:00<00:00, 7274.03it/s]
Epoch 23: Train, Loglike in nats: 4.430830: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.533774: 100%|█| 256/256 [00:00<00:00, 7162.19it/s]
Epoch 24: Train, Loglike in nats: 4.519465: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.677872: 100%|█| 256/256 [00:00<00:00, 7493.49it/s]
Epoch 25: Train, Loglike in nats: 4.518265: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.522072: 100%|█| 256/256 [00:00<00:00, 7223.92it/s]
Epoch 26: Train, Loglike in nats: 4.562395: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.534011: 100%|█| 256/256 [00:00<00:00, 7121.25it/s]
Epoch 27: Train, Loglike in nats: 4.584528: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.586026: 100%|█| 256/256 [00:00<00:00, 7351.68it/s]
Epoch 28: Train, Loglike in nats: 4.462471: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.472850: 100%|█| 256/256 [00:00<00:00, 7036.82it/s]
Epoch 29: Train, Loglike in nats: 4.472151: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.533405: 100%|█| 256/256 [00:00<00:00, 7249.43it/s]
Epoch 30: Train, Loglike in nats: 4.451222: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.603378: 100%|█| 256/256 [00:00<00:00, 7152.84it/s]
Epoch 31: Train, Loglike in nats: 4.409621: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.555896: 100%|█| 256/256 [00:00<00:00, 7419.44it/s]
Epoch 32: Train, Loglike in nats: 4.554532: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.501821: 100%|█| 256/256 [00:00<00:00, 7298.61it/s]
Epoch 33: Train, Loglike in nats: 4.552832: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.754763: 100%|█| 256/256 [00:00<00:00, 7293.25it/s]
Epoch 34: Train, Loglike in nats: 4.606837: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.579247: 100%|█| 256/256 [00:00<00:00, 7115.02it/s]
Epoch 35: Train, Loglike in nats: 4.419414: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.602200: 100%|█| 256/256 [00:00<00:00, 7263.50it/s]
Epoch 36: Train, Loglike in nats: 4.608782: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.745889: 100%|█| 256/256 [00:00<00:00, 6894.19it/s]
Epoch 37: Train, Loglike in nats: 4.432496: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.760521: 100%|█| 256/256 [00:00<00:00, 7105.41it/s]
Epoch 38: Train, Loglike in nats: 4.587770: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.662574: 100%|█| 256/256 [00:00<00:00, 7150.84it/s]
Epoch 39: Train, Loglike in nats: 4.458916: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.421184: 100%|█| 256/256 [00:00<00:00, 7190.44it/s]
Epoch 40: Train, Loglike in nats: 4.348884: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.565992: 100%|█| 256/256 [00:00<00:00, 7223.29it/s]
Epoch 41: Train, Loglike in nats: 4.546117: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.673806: 100%|█| 256/256 [00:00<00:00, 6989.78it/s]
Epoch 42: Train, Loglike in nats: 4.599654: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.709753: 100%|█| 256/256 [00:00<00:00, 7053.51it/s]
Epoch 43: Train, Loglike in nats: 4.625075: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.603225: 100%|█| 256/256 [00:00<00:00, 7310.28it/s]
Epoch 44: Train, Loglike in nats: 4.659478: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.630083: 100%|█| 256/256 [00:00<00:00, 7016.96it/s]
Epoch 45: Train, Loglike in nats: 4.682000: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.732234: 100%|█| 256/256 [00:00<00:00, 6962.40it/s]
Epoch 46: Train, Loglike in nats: 4.554792: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.663981: 100%|█| 256/256 [00:00<00:00, 7155.23it/s]
Epoch 47: Train, Loglike in nats: 4.573297: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.564854: 100%|█| 256/256 [00:00<00:00, 7175.12it/s]
Epoch 48: Train, Loglike in nats: 4.541779: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.738482: 100%|█| 256/256 [00:00<00:00, 7169.51it/s]
Epoch 49: Train, Loglike in nats: 4.509175: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.634123: 100%|█| 256/256 [00:00<00:00, 7196.81it/s]
Epoch 50: Train, Loglike in nats: 4.552632: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.652342: 100%|█| 256/256 [00:00<00:00, 7038.71it/s]
Epoch 51: Train, Loglike in nats: 4.531078: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.396230: 100%|█| 256/256 [00:00<00:00, 7016.13it/s]
Epoch 52: Train, Loglike in nats: 4.492283: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.382210: 100%|█| 256/256 [00:00<00:00, 7154.80it/s]
Epoch 53: Train, Loglike in nats: 4.460400: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.672035: 100%|█| 256/256 [00:00<00:00, 7438.20it/s]
Epoch 54: Train, Loglike in nats: 4.339007: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.002027: 100%|█| 256/256 [00:00<00:00, 6945.16it/s]
Epoch 55: Train, Loglike in nats: 4.277437: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.693196: 100%|█| 256/256 [00:00<00:00, 7248.06it/s]
Epoch 56: Train, Loglike in nats: 4.443362: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.625434: 100%|█| 256/256 [00:00<00:00, 7293.85it/s]
Epoch 57: Train, Loglike in nats: 4.621117: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.820796: 100%|█| 256/256 [00:00<00:00, 7194.25it/s]
Epoch 58: Train, Loglike in nats: 4.700033: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.580562: 100%|█| 256/256 [00:00<00:00, 7323.30it/s]
Epoch 59: Train, Loglike in nats: 4.378896: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.219565: 100%|█| 256/256 [00:00<00:00, 7196.08it/s]
Epoch 60: Train, Loglike in nats: 4.540074: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.595256: 100%|█| 256/256 [00:00<00:00, 7024.49it/s]
Epoch 61: Train, Loglike in nats: 4.683227: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.320597: 100%|█| 256/256 [00:00<00:00, 7355.05it/s]
Epoch 62: Train, Loglike in nats: 4.550050: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.652726: 100%|█| 256/256 [00:00<00:00, 7323.95it/s]
Epoch 63: Train, Loglike in nats: 4.577566: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.612271: 100%|█| 256/256 [00:00<00:00, 6993.56it/s]
Epoch 64: Train, Loglike in nats: 4.538843: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.601538: 100%|█| 256/256 [00:00<00:00, 7233.85it/s]
Epoch 65: Train, Loglike in nats: 4.654364: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.568342: 100%|█| 256/256 [00:00<00:00, 7060.33it/s]
Epoch 66: Train, Loglike in nats: 4.562939: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.683165: 100%|█| 256/256 [00:00<00:00, 7133.88it/s]
Epoch 67: Train, Loglike in nats: 4.586874: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.757002: 100%|█| 256/256 [00:00<00:00, 7076.89it/s]
Epoch 68: Train, Loglike in nats: 4.575104: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.729914: 100%|█| 256/256 [00:00<00:00, 7020.77it/s]
Epoch 69: Train, Loglike in nats: 4.206414: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.259872: 100%|█| 256/256 [00:00<00:00, 7159.42it/s]
Epoch 70: Train, Loglike in nats: 4.548915: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.706856: 100%|█| 256/256 [00:00<00:00, 7115.26it/s]
Epoch 71: Train, Loglike in nats: 4.698675: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.801560: 100%|█| 256/256 [00:00<00:00, 7087.08it/s]
Epoch 72: Train, Loglike in nats: 4.531759: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.770474: 100%|█| 256/256 [00:00<00:00, 7160.43it/s]
Epoch 73: Train, Loglike in nats: 4.546275: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.720428: 100%|█| 256/256 [00:00<00:00, 7092.60it/s]
Epoch 74: Train, Loglike in nats: 4.661378: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.873534: 100%|█| 256/256 [00:00<00:00, 7276.25it/s]
Epoch 75: Train, Loglike in nats: 4.740895: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.830359: 100%|█| 256/256 [00:00<00:00, 7191.02it/s]
Epoch 76: Train, Loglike in nats: 4.737348: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.647756: 100%|█| 256/256 [00:00<00:00, 7183.13it/s]
Epoch 77: Train, Loglike in nats: 4.607565: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.744749: 100%|█| 256/256 [00:00<00:00, 7257.27it/s]
Epoch 78: Train, Loglike in nats: 4.523176: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.638309: 100%|█| 256/256 [00:00<00:00, 7021.78it/s]
Epoch 79: Train, Loglike in nats: 4.543652: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.789568: 100%|█| 256/256 [00:00<00:00, 7170.23it/s]
Epoch 80: Train, Loglike in nats: 4.694047: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.837515: 100%|█| 256/256 [00:00<00:00, 7103.63it/s]
Epoch 81: Train, Loglike in nats: 4.742090: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.797641: 100%|█| 256/256 [00:00<00:00, 7084.79it/s]
Epoch 82: Train, Loglike in nats: 4.536091: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.481468: 100%|█| 256/256 [00:00<00:00, 7161.43it/s]
Epoch 83: Train, Loglike in nats: 4.666183: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.797166: 100%|█| 256/256 [00:00<00:00, 7439.96it/s]
Epoch 84: Train, Loglike in nats: 4.700233: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.829692: 100%|█| 256/256 [00:00<00:00, 7095.93it/s]
Epoch 85: Train, Loglike in nats: 4.740786: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.909887: 100%|█| 256/256 [00:00<00:00, 6972.26it/s]
Epoch 86: Train, Loglike in nats: 4.708581: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.658979: 100%|█| 256/256 [00:00<00:00, 6973.21it/s]
Epoch 87: Train, Loglike in nats: 4.672133: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.794995: 100%|█| 256/256 [00:00<00:00, 7088.06it/s]
Epoch 88: Train, Loglike in nats: 4.684402: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.797291: 100%|█| 256/256 [00:00<00:00, 7179.72it/s]
Epoch 89: Train, Loglike in nats: 4.559476: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.670976: 100%|█| 256/256 [00:00<00:00, 6810.32it/s]
Epoch 90: Train, Loglike in nats: 4.641824: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.758659: 100%|█| 256/256 [00:00<00:00, 6940.26it/s]
Epoch 91: Train, Loglike in nats: 4.744356: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.585352: 100%|█| 256/256 [00:00<00:00, 7100.25it/s]
Epoch 92: Train, Loglike in nats: 4.690108: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.651466: 100%|█| 256/256 [00:00<00:00, 7128.39it/s]
Epoch 93: Train, Loglike in nats: 4.684790: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.754060: 100%|█| 256/256 [00:00<00:00, 7134.50it/s]
Epoch 94: Train, Loglike in nats: 4.719005: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.782381: 100%|█| 256/256 [00:00<00:00, 7038.81it/s]
Epoch 95: Train, Loglike in nats: 4.661931: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.718342: 100%|█| 256/256 [00:00<00:00, 6701.04it/s]
Epoch 96: Train, Loglike in nats: 4.701336: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.633593: 100%|█| 256/256 [00:00<00:00, 7056.80it/s]
Epoch 97: Train, Loglike in nats: 4.697102: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.844307: 100%|█| 256/256 [00:00<00:00, 6608.98it/s]
Epoch 98: Train, Loglike in nats: 4.685904: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.681110: 100%|█| 256/256 [00:00<00:00, 7009.90it/s]
Epoch 99: Train, Loglike in nats: 4.685625: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.812140: 100%|█| 256/256 [00:00<00:00, 6770.81it/s]
Epoch 100: Train, Loglike in nats: 4.724505: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.898593: 100%|█| 256/256 [00:00<00:00, 7114.88it/s]
Epoch 101: Train, Loglike in nats: 4.776207: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.743017: 100%|█| 256/256 [00:00<00:00, 6914.43it/s]
Epoch 102: Train, Loglike in nats: 4.724447: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.904695: 100%|█| 256/256 [00:00<00:00, 6824.90it/s]
Epoch 103: Train, Loglike in nats: 4.760356: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.831684: 100%|█| 256/256 [00:00<00:00, 7001.99it/s]
Epoch 104: Train, Loglike in nats: 4.720137: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.777143: 100%|█| 256/256 [00:00<00:00, 7022.14it/s]
Epoch 105: Train, Loglike in nats: 4.749445: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.824291: 100%|█| 256/256 [00:00<00:00, 7024.30it/s]
Epoch 106: Train, Loglike in nats: 4.739383: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.662352: 100%|█| 256/256 [00:00<00:00, 7214.89it/s]
Epoch 107: Train, Loglike in nats: 4.663712: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.730576: 100%|█| 256/256 [00:00<00:00, 7186.11it/s]
Epoch 108: Train, Loglike in nats: 4.685017: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.662242: 100%|█| 256/256 [00:00<00:00, 7161.81it/s]
Epoch 109: Train, Loglike in nats: 4.420206: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.799919: 100%|█| 256/256 [00:00<00:00, 7222.85it/s]
Epoch 110: Train, Loglike in nats: 4.586950: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.839162: 100%|█| 256/256 [00:00<00:00, 6641.77it/s]
Epoch 111: Train, Loglike in nats: 4.687782: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.866652: 100%|█| 256/256 [00:00<00:00, 7072.79it/s]
Epoch 112: Train, Loglike in nats: 4.816356: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.844614: 100%|█| 256/256 [00:00<00:00, 7073.03it/s]
Epoch 113: Train, Loglike in nats: 4.815367: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.844851: 100%|█| 256/256 [00:00<00:00, 7283.70it/s]
Epoch 114: Train, Loglike in nats: 4.801442: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.782068: 100%|█| 256/256 [00:00<00:00, 7006.38it/s]
Epoch 115: Train, Loglike in nats: 4.712310: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.613576: 100%|█| 256/256 [00:00<00:00, 7382.81it/s]
Epoch 116: Train, Loglike in nats: 4.729708: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.861105: 100%|█| 256/256 [00:00<00:00, 7097.29it/s]
Epoch 117: Train, Loglike in nats: 4.768230: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.556072: 100%|█| 256/256 [00:00<00:00, 7212.13it/s]
Epoch 118: Train, Loglike in nats: 4.769103: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.824241: 100%|█| 256/256 [00:00<00:00, 7655.69it/s]
Epoch 119: Train, Loglike in nats: 4.774367: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.812512: 100%|█| 256/256 [00:00<00:00, 7284.05it/s]
Epoch 120: Train, Loglike in nats: 4.763802: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.676857: 100%|█| 256/256 [00:00<00:00, 7510.00it/s]
Epoch 121: Train, Loglike in nats: 4.766626: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.737663: 100%|█| 256/256 [00:00<00:00, 6953.12it/s]
Epoch 122: Train, Loglike in nats: 4.828807: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.924353: 100%|█| 256/256 [00:00<00:00, 7384.74it/s]
Epoch 123: Train, Loglike in nats: 4.796009: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.932484: 100%|█| 256/256 [00:00<00:00, 7399.45it/s]
Epoch 124: Train, Loglike in nats: 4.831570: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.895680: 100%|█| 256/256 [00:00<00:00, 7358.02it/s]
Epoch 125: Train, Loglike in nats: 4.801763: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.716289: 100%|█| 256/256 [00:00<00:00, 7310.73it/s]
Epoch 126: Train, Loglike in nats: 4.754300: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.878354: 100%|█| 256/256 [00:00<00:00, 7261.59it/s]
Epoch 127: Train, Loglike in nats: 4.798734: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.861428: 100%|█| 256/256 [00:00<00:00, 7362.67it/s]
Epoch 128: Train, Loglike in nats: 4.764201: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.812524: 100%|█| 256/256 [00:00<00:00, 7426.78it/s]
Epoch 129: Train, Loglike in nats: 4.738397: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.804435: 100%|█| 256/256 [00:00<00:00, 6923.03it/s]
Epoch 130: Train, Loglike in nats: 4.825358: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.922467: 100%|█| 256/256 [00:00<00:00, 7172.91it/s]
Epoch 131: Train, Loglike in nats: 4.783786: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.763267: 100%|█| 256/256 [00:00<00:00, 7425.91it/s]
Epoch 132: Train, Loglike in nats: 4.808064: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.885164: 100%|█| 256/256 [00:00<00:00, 6899.37it/s]
Epoch 133: Train, Loglike in nats: 4.829371: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.793253: 100%|█| 256/256 [00:00<00:00, 6901.23it/s]
Epoch 134: Train, Loglike in nats: 4.769795: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.841720: 100%|█| 256/256 [00:00<00:00, 6932.60it/s]
Epoch 135: Train, Loglike in nats: 4.839640: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.795256: 100%|█| 256/256 [00:00<00:00, 7117.99it/s]
Epoch 136: Train, Loglike in nats: 4.870009: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.964134: 100%|█| 256/256 [00:00<00:00, 6903.45it/s]
Epoch 137: Train, Loglike in nats: 4.784118: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.947754: 100%|█| 256/256 [00:00<00:00, 7205.40it/s]
Epoch 138: Train, Loglike in nats: 4.821724: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.933723: 100%|█| 256/256 [00:00<00:00, 6872.65it/s]
Epoch 139: Train, Loglike in nats: 4.878417: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.897148: 100%|█| 256/256 [00:00<00:00, 6874.90it/s]
Epoch 140: Train, Loglike in nats: 4.879096: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.883657: 100%|█| 256/256 [00:00<00:00, 6566.95it/s]
Epoch 141: Train, Loglike in nats: 4.792603: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.710927: 100%|█| 256/256 [00:00<00:00, 7164.82it/s]
Epoch 142: Train, Loglike in nats: 4.771148: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.925281: 100%|█| 256/256 [00:00<00:00, 7520.57it/s]
Epoch 143: Train, Loglike in nats: 4.852556: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.768024: 100%|█| 256/256 [00:00<00:00, 7472.47it/s]
Epoch 144: Train, Loglike in nats: 4.802715: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.756022: 100%|█| 256/256 [00:00<00:00, 7406.34it/s]
Epoch 145: Train, Loglike in nats: 4.688688: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.933115: 100%|█| 256/256 [00:00<00:00, 7404.81it/s]
Epoch 146: Train, Loglike in nats: 4.875092: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.831896: 100%|█| 256/256 [00:00<00:00, 7476.43it/s]
Epoch 147: Train, Loglike in nats: 4.818489: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.981203: 100%|█| 256/256 [00:00<00:00, 7582.07it/s]
Epoch 148: Train, Loglike in nats: 4.865102: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.907088: 100%|█| 256/256 [00:00<00:00, 7416.88it/s]
Epoch 149: Train, Loglike in nats: 4.859244: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.958753: 100%|█| 256/256 [00:00<00:00, 7447.44it/s]
Epoch 150: Train, Loglike in nats: 4.854468: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.884654: 100%|█| 256/256 [00:00<00:00, 5605.46it/s]
Epoch 151: Train, Loglike in nats: 4.817355: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.817810: 100%|█| 256/256 [00:00<00:00, 7374.60it/s]
Epoch 152: Train, Loglike in nats: 4.823654: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.976997: 100%|█| 256/256 [00:00<00:00, 6717.06it/s]
Epoch 153: Train, Loglike in nats: 4.867379: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.957842: 100%|█| 256/256 [00:00<00:00, 6813.08it/s]
Epoch 154: Train, Loglike in nats: 4.846090: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.912516: 100%|█| 256/256 [00:00<00:00, 7653.68it/s]
Epoch 155: Train, Loglike in nats: 4.832615: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.962831: 100%|█| 256/256 [00:00<00:00, 7428.89it/s]
Epoch 156: Train, Loglike in nats: 4.877176: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.918849: 100%|█| 256/256 [00:00<00:00, 7795.88it/s]
Epoch 157: Train, Loglike in nats: 4.891723: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.851194: 100%|█| 256/256 [00:00<00:00, 7380.53it/s]
Epoch 158: Train, Loglike in nats: 4.667483: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.476809: 100%|█| 256/256 [00:00<00:00, 6922.68it/s]
Epoch 159: Train, Loglike in nats: 4.769931: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.942445: 100%|█| 256/256 [00:00<00:00, 6408.49it/s]
Epoch 160: Train, Loglike in nats: 4.880798: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.913004: 100%|█| 256/256 [00:00<00:00, 7519.89it/s]
Epoch 161: Train, Loglike in nats: 4.930751: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.947358: 100%|█| 256/256 [00:00<00:00, 7085.35it/s]
Epoch 162: Train, Loglike in nats: 4.842791: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.882313: 100%|█| 256/256 [00:00<00:00, 7413.40it/s]
Epoch 163: Train, Loglike in nats: 4.823536: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.852108: 100%|█| 256/256 [00:00<00:00, 7592.84it/s]
Epoch 164: Train, Loglike in nats: 4.855254: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.936172: 100%|█| 256/256 [00:00<00:00, 7433.62it/s]
Epoch 165: Train, Loglike in nats: 4.891049: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.928318: 100%|█| 256/256 [00:00<00:00, 7505.95it/s]
Epoch 166: Train, Loglike in nats: 4.855692: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.800160: 100%|█| 256/256 [00:00<00:00, 7678.96it/s]
Epoch 167: Train, Loglike in nats: 4.809008: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.626600: 100%|█| 256/256 [00:00<00:00, 7681.88it/s]
Epoch 168: Train, Loglike in nats: 4.860285: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.986201: 100%|█| 256/256 [00:00<00:00, 7557.20it/s]
Epoch 169: Train, Loglike in nats: 4.852093: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.891025: 100%|█| 256/256 [00:00<00:00, 7441.50it/s]
Epoch 170: Train, Loglike in nats: 4.848801: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 5.009564: 100%|█| 256/256 [00:00<00:00, 7502.07it/s]
Epoch 171: Train, Loglike in nats: 4.877434: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.937558: 100%|█| 256/256 [00:00<00:00, 7402.92it/s]
Epoch 172: Train, Loglike in nats: 4.828379: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.926861: 100%|█| 256/256 [00:00<00:00, 7486.07it/s]
Epoch 173: Train, Loglike in nats: 4.918975: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.916042: 100%|█| 256/256 [00:00<00:00, 7650.46it/s]
Epoch 174: Train, Loglike in nats: 4.867292: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.995896: 100%|█| 256/256 [00:00<00:00, 7810.79it/s]
Epoch 175: Train, Loglike in nats: 4.893898: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.887014: 100%|█| 256/256 [00:00<00:00, 7407.82it/s]
Epoch 176: Train, Loglike in nats: 4.930756: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.928427: 100%|█| 256/256 [00:00<00:00, 7560.98it/s]
Epoch 177: Train, Loglike in nats: 4.860454: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.842382: 100%|█| 256/256 [00:00<00:00, 7499.40it/s]
Epoch 178: Train, Loglike in nats: 4.826075: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.800313: 100%|█| 256/256 [00:00<00:00, 7620.22it/s]
Epoch 179: Train, Loglike in nats: 4.847323: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.832878: 100%|█| 256/256 [00:00<00:00, 7808.41it/s]
Epoch 180: Train, Loglike in nats: 4.785418: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.888988: 100%|█| 256/256 [00:00<00:00, 7248.65it/s]
Epoch 181: Train, Loglike in nats: 4.887916: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 5.003945: 100%|█| 256/256 [00:00<00:00, 7689.74it/s]
Epoch 182: Train, Loglike in nats: 4.878324: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 5.002037: 100%|█| 256/256 [00:00<00:00, 7656.84it/s]
Epoch 183: Train, Loglike in nats: 4.905340: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.948775: 100%|█| 256/256 [00:00<00:00, 7621.51it/s]
Epoch 184: Train, Loglike in nats: 4.917200: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.958248: 100%|█| 256/256 [00:00<00:00, 7435.99it/s]
Epoch 185: Train, Loglike in nats: 4.902764: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 5.019319: 100%|█| 256/256 [00:00<00:00, 7558.79it/s]
Epoch 186: Train, Loglike in nats: 4.950947: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.973337: 100%|█| 256/256 [00:00<00:00, 7723.82it/s]
Epoch 187: Train, Loglike in nats: 4.858890: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 5.047011: 100%|█| 256/256 [00:00<00:00, 7556.35it/s]
Epoch 188: Train, Loglike in nats: 4.907679: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.997971: 100%|█| 256/256 [00:00<00:00, 7443.20it/s]
Epoch 189: Train, Loglike in nats: 4.877380: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.917530: 100%|█| 256/256 [00:00<00:00, 7613.79it/s]
Epoch 190: Train, Loglike in nats: 4.917055: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.976613: 100%|█| 256/256 [00:00<00:00, 7703.15it/s]
Epoch 191: Train, Loglike in nats: 4.903774: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.851151: 100%|█| 256/256 [00:00<00:00, 7672.49it/s]
Epoch 192: Train, Loglike in nats: 4.885668: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.779591: 100%|█| 256/256 [00:00<00:00, 7464.83it/s]
Epoch 193: Train, Loglike in nats: 4.913061: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.933357: 100%|█| 256/256 [00:00<00:00, 7167.88it/s]
Epoch 194: Train, Loglike in nats: 4.854201: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.808918: 100%|█| 256/256 [00:00<00:00, 6969.23it/s]
Epoch 195: Train, Loglike in nats: 4.858738: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.976485: 100%|█| 256/256 [00:00<00:00, 6687.23it/s]
Epoch 196: Train, Loglike in nats: 4.883326: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.989956: 100%|█| 256/256 [00:00<00:00, 7390.89it/s]
Epoch 197: Train, Loglike in nats: 4.916571: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.880527: 100%|█| 256/256 [00:00<00:00, 6527.46it/s]
Epoch 198: Train, Loglike in nats: 4.944581: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.918352: 100%|█| 256/256 [00:00<00:00, 5142.64it/s]
Epoch 199: Train, Loglike in nats: 4.919453: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.931729: 100%|█| 256/256 [00:00<00:00, 7274.77it/s]
Epoch 200: Train, Loglike in nats: 4.863971: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.930439: 100%|█| 256/256 [00:00<00:00, 7322.25it/s]
Epoch 201: Train, Loglike in nats: 4.931427: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.953879: 100%|█| 256/256 [00:00<00:00, 6751.95it/s]
Epoch 202: Train, Loglike in nats: 4.940583: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 5.093653: 100%|█| 256/256 [00:00<00:00, 7374.14it/s]
Epoch 203: Train, Loglike in nats: 4.933789: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 5.026846: 100%|█| 256/256 [00:00<00:00, 7542.97it/s]
Epoch 204: Train, Loglike in nats: 4.901556: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 5.076484: 100%|█| 256/256 [00:00<00:00, 7426.52it/s]
Epoch 205: Train, Loglike in nats: 4.891478: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.938434: 100%|█| 256/256 [00:00<00:00, 7284.35it/s]
Epoch 206: Train, Loglike in nats: 4.905023: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 5.002440: 100%|█| 256/256 [00:00<00:00, 7523.89it/s]
Epoch 207: Train, Loglike in nats: 4.922543: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.946003: 100%|█| 256/256 [00:00<00:00, 7008.90it/s]
Epoch 208: Train, Loglike in nats: 4.933520: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.929842: 100%|█| 256/256 [00:00<00:00, 7421.34it/s]
Epoch 209: Train, Loglike in nats: 4.905619: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 5.001271: 100%|█| 256/256 [00:00<00:00, 7330.65it/s]
Epoch 210: Train, Loglike in nats: 4.923283: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.988173: 100%|█| 256/256 [00:00<00:00, 7337.76it/s]
Epoch 211: Train, Loglike in nats: 4.934201: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 5.032679: 100%|█| 256/256 [00:00<00:00, 7585.39it/s]
Epoch 212: Train, Loglike in nats: 4.943468: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.998631: 100%|█| 256/256 [00:00<00:00, 7383.53it/s]
Epoch 213: Train, Loglike in nats: 4.959769: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 5.023635: 100%|█| 256/256 [00:00<00:00, 7492.13it/s]
Epoch 214: Train, Loglike in nats: 4.937681: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.956433: 100%|█| 256/256 [00:00<00:00, 7380.73it/s]
Epoch 215: Train, Loglike in nats: 4.959364: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 5.026244: 100%|█| 256/256 [00:00<00:00, 6990.14it/s]
Epoch 216: Train, Loglike in nats: 4.938967: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.952768: 100%|█| 256/256 [00:00<00:00, 7575.97it/s]
Epoch 217: Train, Loglike in nats: 4.959960: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 5.049692: 100%|█| 256/256 [00:00<00:00, 7559.86it/s]
Epoch 218: Train, Loglike in nats: 4.943532: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.989525: 100%|█| 256/256 [00:00<00:00, 7709.45it/s]
Epoch 219: Train, Loglike in nats: 4.998487: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.930694: 100%|█| 256/256 [00:00<00:00, 7233.46it/s]
Epoch 220: Train, Loglike in nats: 4.922991: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.968363: 100%|█| 256/256 [00:00<00:00, 7298.41it/s]
Epoch 221: Train, Loglike in nats: 4.944018: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.964511: 100%|█| 256/256 [00:00<00:00, 7098.88it/s]
Epoch 222: Train, Loglike in nats: 4.959001: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.976989: 100%|█| 256/256 [00:00<00:00, 7077.13it/s]
Epoch 223: Train, Loglike in nats: 4.942852: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 5.032462: 100%|█| 256/256 [00:00<00:00, 7606.34it/s]
Epoch 224: Train, Loglike in nats: 4.977668: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.983855: 100%|█| 256/256 [00:00<00:00, 7353.84it/s]
Epoch 225: Train, Loglike in nats: 4.939078: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.935115: 100%|█| 256/256 [00:00<00:00, 7761.56it/s]
Epoch 226: Train, Loglike in nats: 4.953270: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 5.013212: 100%|█| 256/256 [00:00<00:00, 7523.68it/s]
Epoch 227: Train, Loglike in nats: 4.954148: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.978697: 100%|█| 256/256 [00:00<00:00, 7312.62it/s]
Epoch 228: Train, Loglike in nats: 4.941857: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 5.009906: 100%|█| 256/256 [00:00<00:00, 7447.95it/s]
Epoch 229: Train, Loglike in nats: 4.969720: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 5.016267: 100%|█| 256/256 [00:00<00:00, 7122.43it/s]
Epoch 230: Train, Loglike in nats: 4.936580: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 5.001699: 100%|█| 256/256 [00:00<00:00, 7477.26it/s]
Epoch 231: Train, Loglike in nats: 4.953486: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.947896: 100%|█| 256/256 [00:00<00:00, 7471.64it/s]
Epoch 232: Train, Loglike in nats: 4.949690: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.970058: 100%|█| 256/256 [00:00<00:00, 7692.99it/s]
Epoch 233: Train, Loglike in nats: 4.943972: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.994866: 100%|█| 256/256 [00:00<00:00, 7354.45it/s]
Epoch 234: Train, Loglike in nats: 4.946190: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.979137: 100%|█| 256/256 [00:00<00:00, 7566.36it/s]
Epoch 235: Train, Loglike in nats: 4.940177: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.925819: 100%|█| 256/256 [00:00<00:00, 7471.38it/s]
Epoch 236: Train, Loglike in nats: 4.947596: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 5.070110: 100%|█| 256/256 [00:00<00:00, 6911.85it/s]
Epoch 237: Train, Loglike in nats: 4.999313: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 5.032080: 100%|█| 256/256 [00:00<00:00, 7347.65it/s]
Epoch 238: Train, Loglike in nats: 4.981619: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.981657: 100%|█| 256/256 [00:00<00:00, 7010.22it/s]
Epoch 239: Train, Loglike in nats: 4.946543: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.985532: 100%|█| 256/256 [00:00<00:00, 7266.55it/s]
Epoch 240: Train, Loglike in nats: 4.963146: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.995767: 100%|█| 256/256 [00:00<00:00, 7344.94it/s]
Epoch 241: Train, Loglike in nats: 4.983130: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 5.043330: 100%|█| 256/256 [00:00<00:00, 7408.03it/s]
Epoch 242: Train, Loglike in nats: 4.977412: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 5.067501: 100%|█| 256/256 [00:00<00:00, 7592.63it/s]
Epoch 243: Train, Loglike in nats: 4.972563: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 5.040345: 100%|█| 256/256 [00:00<00:00, 7690.40it/s]
Epoch 244: Train, Loglike in nats: 4.975473: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 5.030294: 100%|█| 256/256 [00:00<00:00, 7333.95it/s]
Epoch 245: Train, Loglike in nats: 4.971058: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 5.016021: 100%|█| 256/256 [00:00<00:00, 6894.14it/s]
Epoch 246: Train, Loglike in nats: 4.964948: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.992126: 100%|█| 256/256 [00:00<00:00, 7434.08it/s]
Epoch 247: Train, Loglike in nats: 4.999891: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 5.046591: 100%|█| 256/256 [00:00<00:00, 7580.89it/s]
Epoch 248: Train, Loglike in nats: 5.001117: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 5.025182: 100%|█| 256/256 [00:00<00:00, 7697.79it/s]
Epoch 249: Train, Loglike in nats: 4.974158: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 5.001335: 100%|█| 256/256 [00:00<00:00, 7637.94it/s]
Epoch 250: Train, Loglike in nats: 4.944972: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 5.019472: 100%|█| 256/256 [00:00<00:00, 7649.10it/s]
Epoch 251: Train, Loglike in nats: 4.971719: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.952545: 100%|█| 256/256 [00:00<00:00, 7522.78it/s]
Epoch 252: Train, Loglike in nats: 4.947555: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.969583: 100%|█| 256/256 [00:00<00:00, 6915.19it/s]
Epoch 253: Train, Loglike in nats: 4.972092: 100%|█| 2304/2304 [00:00<00:00,
- Val, Loglike in nats: 4.998250: 100%|█| 256/256 [00:00<00:00, 7167.64it/s]
early stopping, loading state dict from epoch 202
Generating simulations
256it [00:00, 3215.27it/s]
WARNING:root:Too few points to create valid contours
Effective sample size for current/all rounds 321.0/2176.7
Early stop: Surrogate posterior did not improve for this round
[13]:
plt.rcParams['figure.dpi']=100
plt.figure(figsize=(5,5))
plt.subplot(211)
plt.plot(np.array(engine.neff)/2560*100)
plt.plot([0,4],[20,20],label='ANPE: 20%')
plt.legend()
plt.ylabel('Sampling Efficiency [%]')
plt.subplot(212)
plt.plot([np.sum(engine.neff[:i+1]) for i in range(4)])
plt.ylabel('Effective Sample Size')
plt.xlabel('# Round')
plt.tight_layout()
As we see, after the 3rd round of training the sampling efficiency is as high as 40%, meaning the NDE posterior is nearly the true posterior. In comparison, for ANPE we used more training samples and ended up with a lower sampling efficiency of 20%, showcasing the efficacy of SNPE (active learning).
As expected, the 4th round of training degraded the result due to the use of NLL loss (see paper for details). Therefore, the network state is automatically reverted to the 3rd round. Note that every training round contributed to the final effective sample.
To generate more effective posterior samples, let us draw 10000 more samples from the 3nd round NDE. The first corner plot is the (unweighted) NDE surrogate posterior. The second one shows the importance reweighted posterior, which is asymptotically exact
[14]:
engine.best_params
[14]:
'test/2/266.pth'
[16]:
y_pred, weights = engine.predict(x_obs, x_err=np.array([0.1]*50),y_true=y_true, n_samples=10000, corner=True, corner_reweight=True,seed=0)
WARNING:root:Too few points to create valid contours
surrogate posterior
Generating simulations
1000it [00:00, 2913.62it/s]
WARNING:root:Too few points to create valid contours
Effective Sample Size = 3757.0
Sampling efficiency = 37.6%
[ ]: