Test Marginal Distribution

Setting

config = {
    "ignore": ["order_item"],
    "train": {
        "epochs": 500,
        "lr": 0.01,
        "samples": None,
        "naive_dequantization": True,
    },
    "finetune": {
        "activate": False,
        "samples": 1000,
        "epochs": 50,
        "lr": 0.01,
    },
    "eval": {
        "activate": True,
        "samples": 1000,
    },
    "partitions": 5,
}

model_config = EinetConfig(
    num_channels=1,
    num_leaves=5,
    depth=2,
    num_sums=5,
    num_repetitions=5,
    num_classes=1,
    leaf_type=Normal,
    layer_type='einsum',
    dropout=0.0
)

Training

Generating evaluation queries...
Preprocessing data...
Using naive dequantization...
Training model...

Evaluating model...
GMQ: 2.1544432608222936;
50%: 2.1131607190719963;
90%: 2.390177847321101;
95%: 3.5446638521435294;
MAX: 4.285541153729266
Generating finetune queries...
Finetuning model...

Evaluating model...
GMQ: 1.518089337520198;
50%: 1.145707388189137;
90%: 1.359151843719285;
95%: 44.102549254918095;
MAX: 88.17149024981862

Results

Column 0

Column 1

Column 2

Column 3

Column 5

Column 6