diff --git a/records/track_10min_16mb/2026-05-01_PR2101_3Seed_Support/README.md b/records/track_10min_16mb/2026-05-01_PR2101_3Seed_Support/README.md new file mode 100644 index 0000000000..3919f7f0be --- /dev/null +++ b/records/track_10min_16mb/2026-05-01_PR2101_3Seed_Support/README.md @@ -0,0 +1,123 @@ +# 3-Seed Support Package — PR #2101 + +**val_bpb = 1.05879** (3-seed mean ± 0.00098 sample-std) | **15,983,343 B max** | 8×H100 SXM 80GB (RunPod) + +This is a **3-seed independent reproduction and ablation report** for [PR #2101](https://github.com/openai/parameter-golf/pull/2101) by @OnlyJundong (PR #1855 base + AWQ-lite + AsymLogit + GradCentral + LabelSmooth code features). The PR's 3-seed claim is **1.05845 ± 0.00058**; this independent run lands at **1.05879 ± 0.00098** — within +0.00033 of the reported mean. + +The package also contributes three **ablations on the unused author-introduced knobs** (`LABEL_SMOOTH`, `GRAD_CENTRALIZE`) plus a principled hparam probe (`TTT_LOCAL_LR_MULT`), all on seed 42. All three are null-or-negative — useful evidence that PR #2101's tuned stack is at a local optimum on these axes. + +**No new ML technique is introduced.** This package reproduces PR #2101 exactly and ablates flags the author already added to the code. + +## 3-Seed Reproduction (this run) + +| Seed | PR #2101 claim | Our result | Δ | +|---|---:|---:|---:| +| 42 | 1.05897113 | **1.05792641** | −0.00104 | +| 0 | 1.05856489 | **1.05858896** | +0.00002 | +| 1234 | 1.05782711 | **1.05984791** | +0.00202 | +| **Mean** | **1.05845438** | **1.05878776** | **+0.00033** | +| **Std (sample, n−1)** | 0.00058 | **0.00098** | wider | +| **Std (population)** | — | 0.00080 | — | + +Our 3-seed mean is **+0.00033 above** PR #2101's claimed mean — within typical pod-to-pod numerical drift. Our per-seed gap is roughly symmetric around zero (one beat, one match, one above), so the spread (not bias) is the dominant story. + +## Compliance (vs project rules) + +| Seed | Stop step | Train wallclock | Pre-quant BPB | Quant BPB | Total artifact bytes | TTT eval | +|---:|---:|---:|---:|---:|---:|---:| +| 42 | 4855 | 592.04 s | 1.06128455 | 1.06969200 | 15,979,586 | 408.6 s | +| 0 | 4857 | 592.08 s | 1.06208108 | 1.07042006 | 15,977,366 | 405.5 s | +| 1234 | 4856 | 592.14 s | 1.06296914 | 1.07165472 | 15,983,343 | 447.3 s | + +- All `train_wallclock ≤ 600s` ✓ (592.04–592.14 s; 8.0 s reserved for GPTQ) +- All TTT eval `≤ 600s` ✓ (405.5–447.3 s) +- All artifacts `≤ 16,000,000 B` ✓ (worst-case 15,983,343 B; min slack 16,657 B) +- All 782 phased-TTT eval batches drained on every seed + +## Comparison vs Currently-Merged SOTA (PR #1868, 1.06141) + +| Seed | Our BPB | Δ vs 1.06141 | +|---:|---:|---:| +| 42 | 1.05792641 | **−0.00349** | +| 0 | 1.05858896 | **−0.00282** | +| 1234 | 1.05984791 | **−0.00156** | +| **Mean** | **1.05878776** | **−0.00262** | + +Mean improvement vs merged SOTA: **−0.00262 BPB ≈ −0.00181 nats** — below the strict 0.005-nat record threshold, but **all 3 seeds individually beat merged SOTA** by 0.00156–0.00349 BPB. + +## Ablations (seed 42) + +PR #2101 added two new knobs to the codebase but disabled them in the 3-seed runs (default `GRAD_CENTRALIZE=0`, `LABEL_SMOOTH=0.0`). The README explicitly suggests `LABEL_SMOOTH=0.05` as an example value. We tested both, plus a principled `TTT_LOCAL_LR_MULT` probe in the direction PR #2060 was already moving. + +| Variant | Seed 42 BPB | Δ vs baseline (1.05792641) | Verdict | +|---|---:|---:|---| +| **Baseline (GC=0, LS=0.0, TTT_LR_MULT=0.75)** | **1.05792641** | — | reference | +| `LABEL_SMOOTH=0.05` | 1.05800583 | +0.00008 | null (within noise) | +| `GRAD_CENTRALIZE=1` | 1.05796326 | +0.00004 | null (within noise) | +| `TTT_LOCAL_LR_MULT=0.85` | 1.05851093 | +0.00058 | worse | + +Pre-quant deltas track the post-TTT deltas (label-smoothing slightly hurts pre-quant by +0.00022; grad-centralize +0.00009; TTT-LR doesn't affect pre-quant in principle, observed +0.00062 is run-to-run noise). Gradient centralization and label smoothing both leave training dynamics essentially unchanged on this stack — the post-TTT eval converges to the same number within ±0.00008. The TTT-LR=0.85 result tells us the 0.75 → 0.80 → 0.85 trajectory has flipped sign by 0.85; the local-LR optimum on this stack is between 0.75 and 0.80. + +These three ablations (each one full 8×H100 run) cost ~$15 of compute and represent ~10% of project compute spent on negative results — useful evidence for the next contributor that these knobs are not load-bearing on PR #2101's tuned stack. + +## Hardware / Environment + +- 8× NVIDIA H100 80GB HBM3 SXM (RunPod) +- PyTorch 2.9.1+cu128 +- CUDA 12.8 +- FlashAttention 3 (cu128 build) +- lrzip per-group compression +- CaseOps SP8192 dataset on `/dev/shm` + +## Reproduction + +This package uses PR #2101's `train_gpt.py` unchanged (md5 `5606a60541ef66315ac6991e8cc16de8`). Hyperparameters match PR #2101 exactly: + +```bash +SEED=42 \ +MATRIX_LR=0.026 \ +MIN_LR=0.1 \ +MLP_CLIP_SIGMAS=11.5 \ +ATTN_CLIP_SIGMAS=13.0 \ +EMBED_CLIP_SIGMAS=14.0 \ +GRAD_CLIP_NORM=0.3 \ +LQER_RANK=4 LQER_FACTOR_BITS=4 LQER_ASYM_GROUP=64 LQER_TOP_K=3 \ +AWQ_LITE_ENABLED=1 AWQ_LITE_BITS=8 AWQ_LITE_GROUP_TOP_K=1 AWQ_LITE_GROUP_SIZE=64 \ +ASYM_LOGIT_RESCALE=1 \ +PHASED_TTT_NUM_PHASES=3 PHASED_TTT_PREFIX_DOCS=2500 \ +TTT_MASK=no_qv TTT_LOCAL_LR_MULT=0.75 TTT_CHUNK_SIZE=48 \ +TTT_LORA_RANK=80 TTT_LORA_ALPHA=144 \ +GPTQ_RESERVE_SECONDS=8.0 GPTQ_CALIBRATION_BATCHES=16 \ +MUON_BACKEND_STEPS=5 \ +torchrun --standalone --nproc_per_node=8 train_gpt.py +``` + +Replace `SEED=42` with `0` or `1234` for the other two seeds. + +## What this submission is and is not + +- ✅ Independent 3-seed reproduction of PR #2101 (mean within 0.00033 of claim) +- ✅ Confirmation that the technique beats currently-merged SOTA on every seed +- ✅ Three ablations of unused author-introduced knobs (negative results, useful for review) +- ❌ Not a record claim — mean is +0.00033 above PR #2101's claim and only −0.00181 nats below merged SOTA (below 0.005-nat threshold) +- ❌ No new ML technique introduced + +## Credits + +- **@OnlyJundong** — PR #2101 author (AWQ-lite + AsymLogit integration + GradCentral + LabelSmooth code features) +- **@codemath3000** — PR #1855 base +- **@aquariouseworkman** — PR #1851 (SmearGate BOS fix) +- **@dexhunter** — PR #1797 (SmearGate + LQER asymmetric) +- **@nprime06** — PR #1787 (base architecture) +- **@romeerp** — PR #1729 (CaseOps) +- **@clarkkev** — PR #1394 (GPTQ + SP8192) +- **@abaybektursun** — PR #549 (score-first TTT) +- **@cocohearts** — BOS document boundary bug identification + +## Files + +- `submission.json` — full per-seed and ablation results +- `train_seed42.log`, `train_seed0.log`, `train_seed1234.log` — 3-seed reproduction +- `ablation_label_smooth_005_seed42.log` — LABEL_SMOOTH=0.05 ablation +- `ablation_grad_centralize_seed42.log` — GRAD_CENTRALIZE=1 ablation +- `ablation_ttt_local_lr_085_seed42.log` — TTT_LOCAL_LR_MULT=0.85 ablation diff --git a/records/track_10min_16mb/2026-05-01_PR2101_3Seed_Support/ablation_grad_centralize_seed42.log b/records/track_10min_16mb/2026-05-01_PR2101_3Seed_Support/ablation_grad_centralize_seed42.log new file mode 100644 index 0000000000..a50cd60d50 --- /dev/null +++ b/records/track_10min_16mb/2026-05-01_PR2101_3Seed_Support/ablation_grad_centralize_seed42.log @@ -0,0 +1,954 @@ +W0501 08:30:47.312000 1114735 torch/distributed/run.py:803] +W0501 08:30:47.312000 1114735 torch/distributed/run.py:803] ***************************************** +W0501 08:30:47.312000 1114735 torch/distributed/run.py:803] Setting OMP_NUM_THREADS environment variable for each process to be 1 in default, to avoid your system being overloaded, please further tune the variable for optimal performance in your application as needed. +W0501 08:30:47.312000 1114735 torch/distributed/run.py:803] ***************************************** +Hyperparameters: + adam_eps: 1e-08 + adam_wd: 0.02 + artifact_dir: + attn_clip_sigmas: 13.0 + attn_out_gate_enabled: False + attn_out_gate_src: proj + awq_lite_bits: 8 + awq_lite_enabled: True + awq_lite_group_size: 64 + awq_lite_group_top_k: 1 + beta1: 0.9 + beta2: 0.99 + caseops_enabled: True + compressor: pergroup + data_dir: ./data + datasets_dir: ./data/datasets/fineweb10B_sp8192_lossless_caps_caseops_v1_reserved + distributed: True + ema_decay: 0.9965 + embed_bits: 7 + embed_clip_sigmas: 14.0 + embed_lr: 0.6 + embed_wd: 0.085 + enable_looping_at: 0.35 + eval_seq_len: 2560 + eval_stride: 64 + fused_ce_enabled: True + gate_window: 12 + gated_attn_enabled: False + gated_attn_init_std: 0.01 + gated_attn_quant_gate: True + global_ttt_batch_seqs: 32 + global_ttt_chunk_tokens: 32768 + global_ttt_epochs: 1 + global_ttt_grad_clip: 1.0 + global_ttt_lr: 0.001 + global_ttt_momentum: 0.9 + global_ttt_respect_doc_boundaries: True + global_ttt_warmup_chunks: 0 + global_ttt_warmup_start_lr: 0.0 + gptq_calibration_batches: 16 + gptq_reserve_seconds: 8.0 + grad_accum_steps: 1 + grad_centralize: True + grad_clip_norm: 0.3 + is_main_process: True + iterations: 20000 + label_smooth: 0.0 + ln_scale: True + local_rank: 0 + logfile: logs/40fc67d5-b20c-47cc-b654-13c352015fb2.txt + logit_softcap: 30.0 + loop_end: 5 + loop_start: 3 + lqer_asym_enabled: True + lqer_asym_group: 64 + lqer_enabled: True + lqer_factor_bits: 4 + lqer_gain_select: False + lqer_rank: 4 + lqer_scope: all + lqer_top_k: 3 + matrix_bits: 6 + matrix_clip_sigmas: 12.85 + matrix_lr: 0.026 + max_wallclock_seconds: 600.0 + min_lr: 0.1 + mlp_clip_sigmas: 11.5 + mlp_mult: 4.0 + model_dim: 512 + model_path: final_model.pt + muon_backend_steps: 5 + muon_momentum: 0.97 + muon_momentum_warmup_start: 0.92 + muon_momentum_warmup_steps: 1500 + muon_row_normalize: True + muon_wd: 0.095 + num_heads: 8 + num_kv_heads: 4 + num_layers: 11 + num_loops: 2 + parallel_final_lane: mean + parallel_start_layer: 8 + phased_ttt_num_phases: 3 + phased_ttt_prefix_docs: 2500 + qk_gain_init: 5.25 + quantized_model_path: final_model.int6.ptz + rank: 0 + rope_base: 10000.0 + rope_dims: 16 + rope_train_seq_len: 2048 + rope_yarn: False + run_id: 40fc67d5-b20c-47cc-b654-13c352015fb2 + scalar_lr: 0.02 + seed: 42 + skip_gates_enabled: True + smear_gate_enabled: True + sparse_attn_gate_enabled: True + sparse_attn_gate_init_std: 0.0 + sparse_attn_gate_scale: 0.5 + tie_embeddings: True + tied_embed_init_std: 0.005 + tied_embed_lr: 0.03 + tokenizer_path: ./tokenizers/fineweb_8192_bpe_lossless_caps_caseops_v1_reserved.model + train_batch_tokens: 786432 + train_files: ./data/datasets/fineweb10B_sp8192_lossless_caps_caseops_v1_reserved/fineweb_train_*.bin + train_log_every: 500 + train_seq_len: 2048 + ttt_batch_size: 64 + ttt_beta1: 0.0 + ttt_beta2: 0.99 + ttt_chunk_size: 48 + ttt_enabled: True + ttt_eval_batches: + ttt_eval_seq_len: 2560 + ttt_grad_steps: 1 + ttt_k_lora: True + ttt_local_lr_mult: 0.75 + ttt_lora_lr: 0.0001 + ttt_lora_rank: 80 + ttt_mask: no_qv + ttt_mlp_lora: True + ttt_o_lora: True + ttt_optimizer: adam + ttt_q_lora: False + ttt_v_lora: False + ttt_weight_decay: 0.5 + val_batch_tokens: 524288 + val_bytes_files: ./data/datasets/fineweb10B_sp8192_lossless_caps_caseops_v1_reserved/fineweb_val_bytes_*.bin + val_doc_fraction: 1.0 + val_files: ./data/datasets/fineweb10B_sp8192_lossless_caps_caseops_v1_reserved/fineweb_val_*.bin + val_loss_every: 0 + vocab_size: 8192 + warmdown_frac: 0.85 + warmup_steps: 20 + world_size: 8 + xsa_last_n: 11 +train_shards: 80 +val_tokens: 47851520 +model_params:35945673 +gptq:reserving 8s, effective=592000ms +warmup_cu_buckets:64,128,192,256 iters_each:3 +warmup_step: 1/20 +warmup_step: 2/20 +warmup_step: 3/20 +warmup_step: 4/20 +warmup_step: 5/20 +warmup_step: 6/20 +warmup_step: 10/20 +warmup_step: 20/20 +loop_warmup:enabled encoder:[0, 1, 2, 3, 4, 5, 3, 4] decoder:[5, 3, 4, 5, 6, 7, 8, 9, 10] +loop_warmup_step: 1/20 +loop_warmup_step: 2/20 +loop_warmup_step: 3/20 +loop_warmup_step: 4/20 +loop_warmup_step: 5/20 +loop_warmup_step: 6/20 +loop_warmup_step: 10/20 +loop_warmup_step: 20/20 +1/20000 train_loss: 9.0087 train_time: 0.0m tok/s: 16834899 +2/20000 train_loss: 12.8338 train_time: 0.0m tok/s: 7729390 +3/20000 train_loss: 10.2154 train_time: 0.0m tok/s: 7928338 +4/20000 train_loss: 8.6919 train_time: 0.0m tok/s: 8042056 +5/20000 train_loss: 7.9452 train_time: 0.0m tok/s: 8087293 +500/20000 train_loss: 2.5659 train_time: 0.8m tok/s: 8151624 +1000/20000 train_loss: 2.7961 train_time: 1.6m tok/s: 8113600 +1500/20000 train_loss: 2.6162 train_time: 2.4m tok/s: 8100058 +2000/20000 train_loss: 2.6500 train_time: 3.2m tok/s: 8097191 +layer_loop:enabled step:2133 frac:0.350 encoder:[0, 1, 2, 3, 4, 5, 3, 4] decoder:[5, 3, 4, 5, 6, 7, 8, 9, 10] +2500/20000 train_loss: 2.5369 train_time: 4.3m tok/s: 7586450 +3000/20000 train_loss: 2.5476 train_time: 5.5m tok/s: 7150181 +3500/20000 train_loss: 2.5507 train_time: 6.7m tok/s: 6868669 +4000/20000 train_loss: 2.3958 train_time: 7.9m tok/s: 6672102 +4500/20000 train_loss: 2.2661 train_time: 9.0m tok/s: 6527776 +4853/20000 val_loss: 2.3478 val_bpb: 1.0727 +stopping_early: wallclock_cap train_time: 592073ms step: 4853/20000 +peak memory allocated: 41707 MiB reserved: 46952 MiB +ema:applying EMA weights +diagnostic pre-quantization post-ema val_loss:2.32286637 val_bpb:1.06136678 eval_time:9614ms +Serialized model: 135418111 bytes +Code size (uncompressed): 172613 bytes +Code size (compressed): 34386 bytes +GPTQ:collecting Hessians from calibration data... +GPTQ:collected 67 Hessians in 4.1s +Quantized weights: + gate_int8_row: blocks.attn.attn_gate_w + gptq (int6): blocks.attn.c_k.weight, blocks.attn.c_q.weight, blocks.attn.c_v.weight, blocks.attn.proj.weight, blocks.mlp.fc.weight, blocks.mlp.proj.weight + gptq (int6)+lqer_asym: blocks.mlp.fc.weight + gptq (int7)+awqgrpint8+lqer_asym: tok_emb.weight + passthrough (float16): blocks.attn.q_gain, blocks.attn_scale, blocks.mlp_scale, blocks.resid_mix, parallel_post_lambdas, parallel_resid_lambdas, skip_gates, skip_weights, smear_gate.weight, smear_lambda, softcap_neg, softcap_pos +Serialize: per-group lrzip compression... +Serialize: per-group compression done in 121.2s +Serialized model quantized+pergroup: 15946752 bytes +Total submission size quantized+pergroup: 15981138 bytes +Deserialize: per-group lrzip decompression... +Deserialize: decompression done in 20.8s +diagnostic quantized val_loss:2.34098749 val_bpb:1.06964670 eval_time:13179ms +Deserialize: per-group lrzip decompression... +Deserialize: decompression done in 20.7s +ttt_lora:warming up compile (random tokens, no val data) +ttt_lora:compile warmup done (92.3s) + +beginning TTT eval timer +ttt_phased: total_docs:50000 prefix_docs:2500 suffix_docs:47500 num_phases:3 boundaries:[833, 1666, 2500] +ttp: b775/782 bl:2.2704 bb:1.0555 rl:2.2704 rb:1.0555 dl:6892-7524 gd:0 +ttp: b774/782 bl:2.2772 bb:1.0602 rl:2.2736 rb:1.0578 dl:6447-6872 gd:0 +ttp: b770/782 bl:2.2795 bb:1.0761 rl:2.2753 rb:1.0629 dl:5311-5522 gd:0 +ttp: b763/782 bl:2.4115 bb:1.0958 rl:2.2997 rb:1.0689 dl:4142-4283 gd:0 +ttpp: phase:1/3 pd:1296 gd:833 t:188.7s +tttg: c1/131 lr:0.001000 t:0.3s +tttg: c2/131 lr:0.001000 t:0.4s +tttg: c3/131 lr:0.000999 t:0.5s +tttg: c4/131 lr:0.000999 t:0.6s +tttg: c5/131 lr:0.000998 t:0.7s +tttg: c6/131 lr:0.000996 t:0.8s +tttg: c7/131 lr:0.000995 t:0.8s +tttg: c8/131 lr:0.000993 t:0.9s +tttg: c9/131 lr:0.000991 t:1.0s +tttg: c10/131 lr:0.000988 t:1.1s +tttg: c11/131 lr:0.000985 t:1.1s +tttg: c12/131 lr:0.000982 t:1.2s +tttg: c13/131 lr:0.000979 t:1.3s +tttg: c14/131 lr:0.000976 t:1.4s +tttg: c15/131 lr:0.000972 t:1.5s +tttg: c16/131 lr:0.000968 t:1.5s +tttg: c17/131 lr:0.000963 t:1.6s +tttg: c18/131 lr:0.000958 t:1.7s +tttg: c19/131 lr:0.000953 t:1.8s +tttg: c20/131 lr:0.000948 t:1.8s +tttg: c21/131 lr:0.000943 t:1.9s +tttg: c22/131 lr:0.000937 t:2.0s +tttg: c23/131 lr:0.000931 t:2.1s +tttg: c24/131 lr:0.000925 t:2.1s +tttg: c25/131 lr:0.000918 t:2.2s +tttg: c26/131 lr:0.000911 t:2.3s +tttg: c27/131 lr:0.000905 t:2.4s +tttg: c28/131 lr:0.000897 t:2.4s +tttg: c29/131 lr:0.000890 t:2.5s +tttg: c30/131 lr:0.000882 t:2.6s +tttg: c31/131 lr:0.000874 t:2.7s +tttg: c32/131 lr:0.000866 t:2.8s +tttg: c33/131 lr:0.000858 t:2.8s +tttg: c34/131 lr:0.000849 t:2.9s +tttg: c35/131 lr:0.000841 t:3.0s +tttg: c36/131 lr:0.000832 t:3.1s +tttg: c37/131 lr:0.000822 t:3.1s +tttg: c38/131 lr:0.000813 t:3.2s +tttg: c39/131 lr:0.000804 t:3.3s +tttg: c40/131 lr:0.000794 t:3.4s +tttg: c41/131 lr:0.000784 t:3.4s +tttg: c42/131 lr:0.000774 t:3.5s +tttg: c43/131 lr:0.000764 t:3.6s +tttg: c44/131 lr:0.000753 t:3.7s +tttg: c45/131 lr:0.000743 t:3.8s +tttg: c46/131 lr:0.000732 t:3.8s +tttg: c47/131 lr:0.000722 t:3.9s +tttg: c48/131 lr:0.000711 t:4.0s +tttg: c49/131 lr:0.000700 t:4.1s +tttg: c50/131 lr:0.000689 t:4.1s +tttg: c51/131 lr:0.000677 t:4.2s +tttg: c52/131 lr:0.000666 t:4.3s +tttg: c53/131 lr:0.000655 t:4.4s +tttg: c54/131 lr:0.000643 t:4.4s +tttg: c55/131 lr:0.000631 t:4.5s +tttg: c56/131 lr:0.000620 t:4.6s +tttg: c57/131 lr:0.000608 t:4.7s +tttg: c58/131 lr:0.000596 t:4.8s +tttg: c59/131 lr:0.000584 t:4.8s +tttg: c60/131 lr:0.000572 t:4.9s +tttg: c61/131 lr:0.000560 t:5.0s +tttg: c62/131 lr:0.000548 t:5.1s +tttg: c63/131 lr:0.000536 t:5.1s +tttg: c64/131 lr:0.000524 t:5.2s +tttg: c65/131 lr:0.000512 t:5.3s +tttg: c66/131 lr:0.000500 t:5.4s +tttg: c67/131 lr:0.000488 t:5.5s +tttg: c68/131 lr:0.000476 t:5.5s +tttg: c69/131 lr:0.000464 t:5.6s +tttg: c70/131 lr:0.000452 t:5.7s +tttg: c71/131 lr:0.000440 t:5.8s +tttg: c72/131 lr:0.000428 t:5.8s +tttg: c73/131 lr:0.000416 t:5.9s +tttg: c74/131 lr:0.000404 t:6.0s +tttg: c75/131 lr:0.000392 t:6.1s +tttg: c76/131 lr:0.000380 t:6.1s +tttg: c77/131 lr:0.000369 t:6.2s +tttg: c78/131 lr:0.000357 t:6.3s +tttg: c79/131 lr:0.000345 t:6.4s +tttg: c80/131 lr:0.000334 t:6.4s +tttg: c81/131 lr:0.000323 t:6.5s +tttg: c82/131 lr:0.000311 t:6.6s +tttg: c83/131 lr:0.000300 t:6.7s +tttg: c84/131 lr:0.000289 t:6.8s +tttg: c85/131 lr:0.000278 t:6.8s +tttg: c86/131 lr:0.000268 t:6.9s +tttg: c87/131 lr:0.000257 t:7.0s +tttg: c88/131 lr:0.000247 t:7.1s +tttg: c89/131 lr:0.000236 t:7.1s +tttg: c90/131 lr:0.000226 t:7.2s +tttg: c91/131 lr:0.000216 t:7.3s +tttg: c92/131 lr:0.000206 t:7.4s +tttg: c93/131 lr:0.000196 t:7.4s +tttg: c94/131 lr:0.000187 t:7.5s +tttg: c95/131 lr:0.000178 t:7.6s +tttg: c96/131 lr:0.000168 t:7.7s +tttg: c97/131 lr:0.000159 t:7.7s +tttg: c98/131 lr:0.000151 t:7.8s +tttg: c99/131 lr:0.000142 t:7.9s +tttg: c100/131 lr:0.000134 t:8.0s +tttg: c101/131 lr:0.000126 t:8.0s +tttg: c102/131 lr:0.000118 t:8.1s +tttg: c103/131 lr:0.000110 t:8.2s +tttg: c104/131 lr:0.000103 t:8.3s +tttg: c105/131 lr:0.000095 t:8.4s +tttg: c106/131 lr:0.000089 t:8.4s +tttg: c107/131 lr:0.000082 t:8.5s +tttg: c108/131 lr:0.000075 t:8.6s +tttg: c109/131 lr:0.000069 t:8.7s +tttg: c110/131 lr:0.000063 t:8.7s +tttg: c111/131 lr:0.000057 t:8.8s +tttg: c112/131 lr:0.000052 t:8.9s +tttg: c113/131 lr:0.000047 t:9.0s +tttg: c114/131 lr:0.000042 t:9.1s +tttg: c115/131 lr:0.000037 t:9.1s +tttg: c116/131 lr:0.000032 t:9.2s +tttg: c117/131 lr:0.000028 t:9.3s +tttg: c118/131 lr:0.000024 t:9.4s +tttg: c119/131 lr:0.000021 t:9.4s +tttg: c120/131 lr:0.000018 t:9.5s +tttg: c121/131 lr:0.000015 t:9.6s +tttg: c122/131 lr:0.000012 t:9.7s +tttg: c123/131 lr:0.000009 t:9.7s +tttg: c124/131 lr:0.000007 t:9.8s +tttg: c125/131 lr:0.000005 t:9.9s +tttg: c126/131 lr:0.000004 t:10.0s +tttg: c127/131 lr:0.000002 t:10.1s +tttg: c128/131 lr:0.000001 t:10.1s +tttg: c129/131 lr:0.000001 t:10.2s +tttg: c130/131 lr:0.000000 t:10.3s +ttpr: phase:1/3 t:200.0s +ttp: b757/782 bl:2.2759 bb:1.0594 rl:2.2966 rb:1.0677 dl:3550-3633 gd:0 +ttp: b752/782 bl:2.3250 bb:1.0688 rl:2.2996 rb:1.0678 dl:3222-3283 gd:0 +ttpp: phase:2/3 pd:2128 gd:1666 t:258.9s +tttg: c1/219 lr:0.001000 t:0.1s +tttg: c2/219 lr:0.001000 t:0.1s +tttg: c3/219 lr:0.001000 t:0.2s +tttg: c4/219 lr:0.001000 t:0.3s +tttg: c5/219 lr:0.000999 t:0.4s +tttg: c6/219 lr:0.000999 t:0.4s +tttg: c7/219 lr:0.000998 t:0.5s +tttg: c8/219 lr:0.000997 t:0.6s +tttg: c9/219 lr:0.000997 t:0.7s +tttg: c10/219 lr:0.000996 t:0.7s +tttg: c11/219 lr:0.000995 t:0.8s +tttg: c12/219 lr:0.000994 t:0.9s +tttg: c13/219 lr:0.000993 t:1.0s +tttg: c14/219 lr:0.000991 t:1.0s +tttg: c15/219 lr:0.000990 t:1.1s +tttg: c16/219 lr:0.000988 t:1.2s +tttg: c17/219 lr:0.000987 t:1.3s +tttg: c18/219 lr:0.000985 t:1.4s +tttg: c19/219 lr:0.000983 t:1.4s +tttg: c20/219 lr:0.000981 t:1.5s +tttg: c21/219 lr:0.000979 t:1.6s +tttg: c22/219 lr:0.000977 t:1.7s +tttg: c23/219 lr:0.000975 t:1.7s +tttg: c24/219 lr:0.000973 t:1.8s +tttg: c25/219 lr:0.000970 t:1.9s +tttg: c26/219 lr:0.000968 t:2.0s +tttg: c27/219 lr:0.000965 t:2.1s +tttg: c28/219 lr:0.000963 t:2.1s +tttg: c29/219 lr:0.000960 t:2.2s +tttg: c30/219 lr:0.000957 t:2.3s +tttg: c31/219 lr:0.000954 t:2.4s +tttg: c32/219 lr:0.000951 t:2.4s +tttg: c33/219 lr:0.000948 t:2.5s +tttg: c34/219 lr:0.000945 t:2.6s +tttg: c35/219 lr:0.000941 t:2.7s +tttg: c36/219 lr:0.000938 t:2.7s +tttg: c37/219 lr:0.000934 t:2.8s +tttg: c38/219 lr:0.000931 t:2.9s +tttg: c39/219 lr:0.000927 t:3.0s +tttg: c40/219 lr:0.000923 t:3.0s +tttg: c41/219 lr:0.000919 t:3.1s +tttg: c42/219 lr:0.000915 t:3.2s +tttg: c43/219 lr:0.000911 t:3.3s +tttg: c44/219 lr:0.000907 t:3.4s +tttg: c45/219 lr:0.000903 t:3.4s +tttg: c46/219 lr:0.000898 t:3.5s +tttg: c47/219 lr:0.000894 t:3.6s +tttg: c48/219 lr:0.000890 t:3.7s +tttg: c49/219 lr:0.000885 t:3.8s +tttg: c50/219 lr:0.000880 t:3.8s +tttg: c51/219 lr:0.000876 t:3.9s +tttg: c52/219 lr:0.000871 t:4.0s +tttg: c53/219 lr:0.000866 t:4.1s +tttg: c54/219 lr:0.000861 t:4.2s +tttg: c55/219 lr:0.000856 t:4.2s +tttg: c56/219 lr:0.000851 t:4.3s +tttg: c57/219 lr:0.000846 t:4.4s +tttg: c58/219 lr:0.000841 t:4.5s +tttg: c59/219 lr:0.000835 t:4.5s +tttg: c60/219 lr:0.000830 t:4.6s +tttg: c61/219 lr:0.000824 t:4.7s +tttg: c62/219 lr:0.000819 t:4.8s +tttg: c63/219 lr:0.000813 t:4.8s +tttg: c64/219 lr:0.000808 t:4.9s +tttg: c65/219 lr:0.000802 t:5.0s +tttg: c66/219 lr:0.000796 t:5.1s +tttg: c67/219 lr:0.000790 t:5.1s +tttg: c68/219 lr:0.000784 t:5.2s +tttg: c69/219 lr:0.000779 t:5.3s +tttg: c70/219 lr:0.000773 t:5.4s +tttg: c71/219 lr:0.000766 t:5.5s +tttg: c72/219 lr:0.000760 t:5.5s +tttg: c73/219 lr:0.000754 t:5.6s +tttg: c74/219 lr:0.000748 t:5.7s +tttg: c75/219 lr:0.000742 t:5.8s +tttg: c76/219 lr:0.000735 t:5.9s +tttg: c77/219 lr:0.000729 t:5.9s +tttg: c78/219 lr:0.000722 t:6.0s +tttg: c79/219 lr:0.000716 t:6.1s +tttg: c80/219 lr:0.000709 t:6.2s +tttg: c81/219 lr:0.000703 t:6.2s +tttg: c82/219 lr:0.000696 t:6.3s +tttg: c83/219 lr:0.000690 t:6.4s +tttg: c84/219 lr:0.000683 t:6.5s +tttg: c85/219 lr:0.000676 t:6.5s +tttg: c86/219 lr:0.000670 t:6.6s +tttg: c87/219 lr:0.000663 t:6.7s +tttg: c88/219 lr:0.000656 t:6.8s +tttg: c89/219 lr:0.000649 t:6.9s +tttg: c90/219 lr:0.000642 t:6.9s +tttg: c91/219 lr:0.000635 t:7.0s +tttg: c92/219 lr:0.000628 t:7.1s +tttg: c93/219 lr:0.000621 t:7.2s +tttg: c94/219 lr:0.000614 t:7.2s +tttg: c95/219 lr:0.000607 t:7.3s +tttg: c96/219 lr:0.000600 t:7.4s +tttg: c97/219 lr:0.000593 t:7.5s +tttg: c98/219 lr:0.000586 t:7.6s +tttg: c99/219 lr:0.000579 t:7.6s +tttg: c100/219 lr:0.000572 t:7.7s +tttg: c101/219 lr:0.000565 t:7.8s +tttg: c102/219 lr:0.000558 t:7.9s +tttg: c103/219 lr:0.000550 t:7.9s +tttg: c104/219 lr:0.000543 t:8.0s +tttg: c105/219 lr:0.000536 t:8.1s +tttg: c106/219 lr:0.000529 t:8.2s +tttg: c107/219 lr:0.000522 t:8.2s +tttg: c108/219 lr:0.000514 t:8.3s +tttg: c109/219 lr:0.000507 t:8.4s +tttg: c110/219 lr:0.000500 t:8.5s +tttg: c111/219 lr:0.000493 t:8.6s +tttg: c112/219 lr:0.000486 t:8.6s +tttg: c113/219 lr:0.000478 t:8.7s +tttg: c114/219 lr:0.000471 t:8.8s +tttg: c115/219 lr:0.000464 t:8.9s +tttg: c116/219 lr:0.000457 t:9.0s +tttg: c117/219 lr:0.000450 t:9.0s +tttg: c118/219 lr:0.000442 t:9.1s +tttg: c119/219 lr:0.000435 t:9.2s +tttg: c120/219 lr:0.000428 t:9.3s +tttg: c121/219 lr:0.000421 t:9.3s +tttg: c122/219 lr:0.000414 t:9.4s +tttg: c123/219 lr:0.000407 t:9.5s +tttg: c124/219 lr:0.000400 t:9.6s +tttg: c125/219 lr:0.000393 t:9.6s +tttg: c126/219 lr:0.000386 t:9.7s +tttg: c127/219 lr:0.000379 t:9.8s +tttg: c128/219 lr:0.000372 t:9.9s +tttg: c129/219 lr:0.000365 t:10.0s +tttg: c130/219 lr:0.000358 t:10.0s +tttg: c131/219 lr:0.000351 t:10.1s +tttg: c132/219 lr:0.000344 t:10.2s +tttg: c133/219 lr:0.000337 t:10.3s +tttg: c134/219 lr:0.000330 t:10.4s +tttg: c135/219 lr:0.000324 t:11.7s +tttg: c136/219 lr:0.000317 t:11.8s +tttg: c137/219 lr:0.000310 t:11.9s +tttg: c138/219 lr:0.000304 t:11.9s +tttg: c139/219 lr:0.000297 t:12.0s +tttg: c140/219 lr:0.000291 t:12.1s +tttg: c141/219 lr:0.000284 t:12.2s +tttg: c142/219 lr:0.000278 t:12.2s +tttg: c143/219 lr:0.000271 t:12.3s +tttg: c144/219 lr:0.000265 t:12.4s +tttg: c145/219 lr:0.000258 t:12.5s +tttg: c146/219 lr:0.000252 t:12.5s +tttg: c147/219 lr:0.000246 t:12.6s +tttg: c148/219 lr:0.000240 t:12.7s +tttg: c149/219 lr:0.000234 t:12.8s +tttg: c150/219 lr:0.000227 t:12.8s +tttg: c151/219 lr:0.000221 t:12.9s +tttg: c152/219 lr:0.000216 t:13.0s +tttg: c153/219 lr:0.000210 t:13.1s +tttg: c154/219 lr:0.000204 t:13.1s +tttg: c155/219 lr:0.000198 t:13.2s +tttg: c156/219 lr:0.000192 t:13.3s +tttg: c157/219 lr:0.000187 t:13.4s +tttg: c158/219 lr:0.000181 t:13.4s +tttg: c159/219 lr:0.000176 t:13.5s +tttg: c160/219 lr:0.000170 t:13.6s +tttg: c161/219 lr:0.000165 t:13.7s +tttg: c162/219 lr:0.000159 t:13.8s +tttg: c163/219 lr:0.000154 t:13.8s +tttg: c164/219 lr:0.000149 t:13.9s +tttg: c165/219 lr:0.000144 t:14.0s +tttg: c166/219 lr:0.000139 t:14.1s +tttg: c167/219 lr:0.000134 t:14.1s +tttg: c168/219 lr:0.000129 t:14.2s +tttg: c169/219 lr:0.000124 t:14.3s +tttg: c170/219 lr:0.000120 t:14.4s +tttg: c171/219 lr:0.000115 t:14.4s +tttg: c172/219 lr:0.000110 t:14.5s +tttg: c173/219 lr:0.000106 t:14.6s +tttg: c174/219 lr:0.000102 t:14.7s +tttg: c175/219 lr:0.000097 t:14.8s +tttg: c176/219 lr:0.000093 t:14.8s +tttg: c177/219 lr:0.000089 t:14.9s +tttg: c178/219 lr:0.000085 t:15.0s +tttg: c179/219 lr:0.000081 t:15.1s +tttg: c180/219 lr:0.000077 t:15.1s +tttg: c181/219 lr:0.000073 t:15.2s +tttg: c182/219 lr:0.000069 t:15.3s +tttg: c183/219 lr:0.000066 t:15.4s +tttg: c184/219 lr:0.000062 t:15.5s +tttg: c185/219 lr:0.000059 t:15.5s +tttg: c186/219 lr:0.000055 t:15.6s +tttg: c187/219 lr:0.000052 t:15.7s +tttg: c188/219 lr:0.000049 t:15.8s +tttg: c189/219 lr:0.000046 t:15.8s +tttg: c190/219 lr:0.000043 t:15.9s +tttg: c191/219 lr:0.000040 t:16.0s +tttg: c192/219 lr:0.000037 t:16.1s +tttg: c193/219 lr:0.000035 t:16.2s +tttg: c194/219 lr:0.000032 t:16.2s +tttg: c195/219 lr:0.000030 t:16.3s +tttg: c196/219 lr:0.000027 t:16.4s +tttg: c197/219 lr:0.000025 t:16.5s +tttg: c198/219 lr:0.000023 t:16.6s +tttg: c199/219 lr:0.000021 t:16.6s +tttg: c200/219 lr:0.000019 t:16.7s +tttg: c201/219 lr:0.000017 t:16.8s +tttg: c202/219 lr:0.000015 t:16.9s +tttg: c203/219 lr:0.000013 t:16.9s +tttg: c204/219 lr:0.000012 t:17.0s +tttg: c205/219 lr:0.000010 t:17.1s +tttg: c206/219 lr:0.000009 t:17.2s +tttg: c207/219 lr:0.000007 t:17.2s +tttg: c208/219 lr:0.000006 t:17.3s +tttg: c209/219 lr:0.000005 t:17.4s +tttg: c210/219 lr:0.000004 t:17.5s +tttg: c211/219 lr:0.000003 t:17.5s +tttg: c212/219 lr:0.000003 t:17.6s +tttg: c213/219 lr:0.000002 t:17.7s +tttg: c214/219 lr:0.000001 t:17.8s +tttg: c215/219 lr:0.000001 t:17.9s +tttg: c216/219 lr:0.000000 t:17.9s +tttg: c217/219 lr:0.000000 t:18.0s +tttg: c218/219 lr:0.000000 t:18.1s +ttpr: phase:2/3 t:278.1s +ttp: b744/782 bl:2.3965 bb:1.0781 rl:2.3079 rb:1.0687 dl:2806-2842 gd:0 +ttp: b737/782 bl:2.3107 bb:1.0388 rl:2.3081 rb:1.0665 dl:2550-2583 gd:0 +ttpp: phase:3/3 pd:2960 gd:2500 t:292.9s +tttg: c1/289 lr:0.001000 t:0.1s +tttg: c2/289 lr:0.001000 t:0.1s +tttg: c3/289 lr:0.001000 t:0.2s +tttg: c4/289 lr:0.001000 t:0.3s +tttg: c5/289 lr:0.001000 t:0.4s +tttg: c6/289 lr:0.000999 t:0.4s +tttg: c7/289 lr:0.000999 t:0.5s +tttg: c8/289 lr:0.000999 t:1.9s +tttg: c9/289 lr:0.000998 t:2.0s +tttg: c10/289 lr:0.000998 t:2.1s +tttg: c11/289 lr:0.000997 t:2.2s +tttg: c12/289 lr:0.000996 t:2.2s +tttg: c13/289 lr:0.000996 t:2.3s +tttg: c14/289 lr:0.000995 t:2.4s +tttg: c15/289 lr:0.000994 t:2.5s +tttg: c16/289 lr:0.000993 t:2.5s +tttg: c17/289 lr:0.000992 t:2.6s +tttg: c18/289 lr:0.000991 t:2.7s +tttg: c19/289 lr:0.000990 t:2.8s +tttg: c20/289 lr:0.000989 t:2.8s +tttg: c21/289 lr:0.000988 t:2.9s +tttg: c22/289 lr:0.000987 t:3.0s +tttg: c23/289 lr:0.000986 t:3.1s +tttg: c24/289 lr:0.000984 t:3.1s +tttg: c25/289 lr:0.000983 t:3.2s +tttg: c26/289 lr:0.000982 t:3.3s +tttg: c27/289 lr:0.000980 t:3.4s +tttg: c28/289 lr:0.000978 t:3.5s +tttg: c29/289 lr:0.000977 t:3.5s +tttg: c30/289 lr:0.000975 t:3.6s +tttg: c31/289 lr:0.000973 t:3.7s +tttg: c32/289 lr:0.000972 t:3.8s +tttg: c33/289 lr:0.000970 t:3.8s +tttg: c34/289 lr:0.000968 t:3.9s +tttg: c35/289 lr:0.000966 t:4.0s +tttg: c36/289 lr:0.000964 t:4.1s +tttg: c37/289 lr:0.000962 t:4.1s +tttg: c38/289 lr:0.000960 t:4.2s +tttg: c39/289 lr:0.000958 t:4.3s +tttg: c40/289 lr:0.000955 t:4.4s +tttg: c41/289 lr:0.000953 t:4.4s +tttg: c42/289 lr:0.000951 t:4.5s +tttg: c43/289 lr:0.000948 t:4.6s +tttg: c44/289 lr:0.000946 t:4.7s +tttg: c45/289 lr:0.000944 t:4.7s +tttg: c46/289 lr:0.000941 t:4.8s +tttg: c47/289 lr:0.000938 t:4.9s +tttg: c48/289 lr:0.000936 t:5.0s +tttg: c49/289 lr:0.000933 t:5.1s +tttg: c50/289 lr:0.000930 t:5.1s +tttg: c51/289 lr:0.000927 t:5.2s +tttg: c52/289 lr:0.000925 t:5.3s +tttg: c53/289 lr:0.000922 t:5.4s +tttg: c54/289 lr:0.000919 t:5.4s +tttg: c55/289 lr:0.000916 t:5.5s +tttg: c56/289 lr:0.000913 t:5.6s +tttg: c57/289 lr:0.000910 t:5.7s +tttg: c58/289 lr:0.000906 t:5.7s +tttg: c59/289 lr:0.000903 t:5.8s +tttg: c60/289 lr:0.000900 t:5.9s +tttg: c61/289 lr:0.000897 t:6.0s +tttg: c62/289 lr:0.000893 t:6.0s +tttg: c63/289 lr:0.000890 t:6.1s +tttg: c64/289 lr:0.000887 t:6.2s +tttg: c65/289 lr:0.000883 t:6.3s +tttg: c66/289 lr:0.000879 t:6.4s +tttg: c67/289 lr:0.000876 t:6.4s +tttg: c68/289 lr:0.000872 t:6.5s +tttg: c69/289 lr:0.000869 t:6.6s +tttg: c70/289 lr:0.000865 t:6.7s +tttg: c71/289 lr:0.000861 t:6.8s +tttg: c72/289 lr:0.000857 t:6.8s +tttg: c73/289 lr:0.000854 t:6.9s +tttg: c74/289 lr:0.000850 t:7.0s +tttg: c75/289 lr:0.000846 t:7.1s +tttg: c76/289 lr:0.000842 t:7.1s +tttg: c77/289 lr:0.000838 t:7.2s +tttg: c78/289 lr:0.000834 t:7.3s +tttg: c79/289 lr:0.000830 t:7.4s +tttg: c80/289 lr:0.000826 t:7.4s +tttg: c81/289 lr:0.000821 t:7.5s +tttg: c82/289 lr:0.000817 t:7.6s +tttg: c83/289 lr:0.000813 t:7.7s +tttg: c84/289 lr:0.000809 t:7.7s +tttg: c85/289 lr:0.000804 t:7.8s +tttg: c86/289 lr:0.000800 t:7.9s +tttg: c87/289 lr:0.000796 t:8.0s +tttg: c88/289 lr:0.000791 t:8.0s +tttg: c89/289 lr:0.000787 t:8.1s +tttg: c90/289 lr:0.000782 t:8.2s +tttg: c91/289 lr:0.000778 t:8.3s +tttg: c92/289 lr:0.000773 t:8.3s +tttg: c93/289 lr:0.000769 t:8.4s +tttg: c94/289 lr:0.000764 t:8.5s +tttg: c95/289 lr:0.000759 t:8.6s +tttg: c96/289 lr:0.000755 t:8.7s +tttg: c97/289 lr:0.000750 t:8.7s +tttg: c98/289 lr:0.000745 t:8.8s +tttg: c99/289 lr:0.000740 t:8.9s +tttg: c100/289 lr:0.000736 t:9.0s +tttg: c101/289 lr:0.000731 t:9.0s +tttg: c102/289 lr:0.000726 t:9.1s +tttg: c103/289 lr:0.000721 t:9.2s +tttg: c104/289 lr:0.000716 t:9.3s +tttg: c105/289 lr:0.000711 t:9.3s +tttg: c106/289 lr:0.000706 t:9.4s +tttg: c107/289 lr:0.000701 t:9.5s +tttg: c108/289 lr:0.000696 t:9.6s +tttg: c109/289 lr:0.000691 t:9.7s +tttg: c110/289 lr:0.000686 t:9.7s +tttg: c111/289 lr:0.000681 t:9.8s +tttg: c112/289 lr:0.000676 t:9.9s +tttg: c113/289 lr:0.000671 t:10.0s +tttg: c114/289 lr:0.000666 t:10.0s +tttg: c115/289 lr:0.000661 t:10.1s +tttg: c116/289 lr:0.000656 t:10.2s +tttg: c117/289 lr:0.000650 t:10.3s +tttg: c118/289 lr:0.000645 t:10.3s +tttg: c119/289 lr:0.000640 t:10.4s +tttg: c120/289 lr:0.000635 t:10.5s +tttg: c121/289 lr:0.000629 t:10.6s +tttg: c122/289 lr:0.000624 t:10.6s +tttg: c123/289 lr:0.000619 t:10.7s +tttg: c124/289 lr:0.000614 t:10.8s +tttg: c125/289 lr:0.000608 t:10.9s +tttg: c126/289 lr:0.000603 t:10.9s +tttg: c127/289 lr:0.000598 t:11.0s +tttg: c128/289 lr:0.000592 t:11.1s +tttg: c129/289 lr:0.000587 t:11.2s +tttg: c130/289 lr:0.000581 t:11.2s +tttg: c131/289 lr:0.000576 t:11.3s +tttg: c132/289 lr:0.000571 t:11.4s +tttg: c133/289 lr:0.000565 t:11.5s +tttg: c134/289 lr:0.000560 t:11.6s +tttg: c135/289 lr:0.000554 t:11.6s +tttg: c136/289 lr:0.000549 t:11.7s +tttg: c137/289 lr:0.000544 t:11.8s +tttg: c138/289 lr:0.000538 t:11.9s +tttg: c139/289 lr:0.000533 t:11.9s +tttg: c140/289 lr:0.000527 t:12.0s +tttg: c141/289 lr:0.000522 t:12.1s +tttg: c142/289 lr:0.000516 t:12.2s +tttg: c143/289 lr:0.000511 t:12.2s +tttg: c144/289 lr:0.000505 t:12.3s +tttg: c145/289 lr:0.000500 t:12.4s +tttg: c146/289 lr:0.000495 t:12.5s +tttg: c147/289 lr:0.000489 t:12.5s +tttg: c148/289 lr:0.000484 t:12.6s +tttg: c149/289 lr:0.000478 t:12.7s +tttg: c150/289 lr:0.000473 t:12.8s +tttg: c151/289 lr:0.000467 t:12.8s +tttg: c152/289 lr:0.000462 t:12.9s +tttg: c153/289 lr:0.000456 t:13.0s +tttg: c154/289 lr:0.000451 t:13.1s +tttg: c155/289 lr:0.000446 t:13.1s +tttg: c156/289 lr:0.000440 t:13.2s +tttg: c157/289 lr:0.000435 t:13.3s +tttg: c158/289 lr:0.000429 t:13.4s +tttg: c159/289 lr:0.000424 t:13.4s +tttg: c160/289 lr:0.000419 t:13.5s +tttg: c161/289 lr:0.000413 t:13.6s +tttg: c162/289 lr:0.000408 t:13.7s +tttg: c163/289 lr:0.000402 t:13.7s +tttg: c164/289 lr:0.000397 t:13.8s +tttg: c165/289 lr:0.000392 t:13.9s +tttg: c166/289 lr:0.000386 t:14.0s +tttg: c167/289 lr:0.000381 t:14.1s +tttg: c168/289 lr:0.000376 t:14.1s +tttg: c169/289 lr:0.000371 t:14.2s +tttg: c170/289 lr:0.000365 t:14.3s +tttg: c171/289 lr:0.000360 t:14.4s +tttg: c172/289 lr:0.000355 t:14.5s +tttg: c173/289 lr:0.000350 t:14.5s +tttg: c174/289 lr:0.000344 t:14.6s +tttg: c175/289 lr:0.000339 t:14.7s +tttg: c176/289 lr:0.000334 t:14.8s +tttg: c177/289 lr:0.000329 t:14.8s +tttg: c178/289 lr:0.000324 t:14.9s +tttg: c179/289 lr:0.000319 t:15.0s +tttg: c180/289 lr:0.000314 t:15.1s +tttg: c181/289 lr:0.000309 t:15.1s +tttg: c182/289 lr:0.000304 t:15.2s +tttg: c183/289 lr:0.000299 t:15.3s +tttg: c184/289 lr:0.000294 t:15.4s +tttg: c185/289 lr:0.000289 t:15.5s +tttg: c186/289 lr:0.000284 t:15.5s +tttg: c187/289 lr:0.000279 t:15.6s +tttg: c188/289 lr:0.000274 t:15.7s +tttg: c189/289 lr:0.000269 t:15.8s +tttg: c190/289 lr:0.000264 t:15.8s +tttg: c191/289 lr:0.000260 t:15.9s +tttg: c192/289 lr:0.000255 t:16.0s +tttg: c193/289 lr:0.000250 t:16.1s +tttg: c194/289 lr:0.000245 t:16.1s +tttg: c195/289 lr:0.000241 t:16.2s +tttg: c196/289 lr:0.000236 t:16.3s +tttg: c197/289 lr:0.000231 t:16.4s +tttg: c198/289 lr:0.000227 t:16.5s +tttg: c199/289 lr:0.000222 t:16.5s +tttg: c200/289 lr:0.000218 t:16.6s +tttg: c201/289 lr:0.000213 t:16.7s +tttg: c202/289 lr:0.000209 t:16.8s +tttg: c203/289 lr:0.000204 t:16.8s +tttg: c204/289 lr:0.000200 t:16.9s +tttg: c205/289 lr:0.000196 t:17.0s +tttg: c206/289 lr:0.000191 t:17.1s +tttg: c207/289 lr:0.000187 t:17.1s +tttg: c208/289 lr:0.000183 t:17.2s +tttg: c209/289 lr:0.000179 t:17.3s +tttg: c210/289 lr:0.000174 t:17.4s +tttg: c211/289 lr:0.000170 t:17.4s +tttg: c212/289 lr:0.000166 t:17.5s +tttg: c213/289 lr:0.000162 t:17.6s +tttg: c214/289 lr:0.000158 t:17.7s +tttg: c215/289 lr:0.000154 t:17.7s +tttg: c216/289 lr:0.000150 t:17.8s +tttg: c217/289 lr:0.000146 t:17.9s +tttg: c218/289 lr:0.000143 t:18.0s +tttg: c219/289 lr:0.000139 t:18.1s +tttg: c220/289 lr:0.000135 t:18.1s +tttg: c221/289 lr:0.000131 t:18.2s +tttg: c222/289 lr:0.000128 t:18.3s +tttg: c223/289 lr:0.000124 t:18.4s +tttg: c224/289 lr:0.000121 t:18.4s +tttg: c225/289 lr:0.000117 t:18.5s +tttg: c226/289 lr:0.000113 t:18.6s +tttg: c227/289 lr:0.000110 t:18.7s +tttg: c228/289 lr:0.000107 t:18.8s +tttg: c229/289 lr:0.000103 t:18.8s +tttg: c230/289 lr:0.000100 t:18.9s +tttg: c231/289 lr:0.000097 t:19.0s +tttg: c232/289 lr:0.000094 t:19.1s +tttg: c233/289 lr:0.000090 t:19.1s +tttg: c234/289 lr:0.000087 t:19.2s +tttg: c235/289 lr:0.000084 t:19.3s +tttg: c236/289 lr:0.000081 t:19.4s +tttg: c237/289 lr:0.000078 t:19.4s +tttg: c238/289 lr:0.000075 t:19.5s +tttg: c239/289 lr:0.000073 t:19.6s +tttg: c240/289 lr:0.000070 t:19.7s +tttg: c241/289 lr:0.000067 t:19.8s +tttg: c242/289 lr:0.000064 t:19.8s +tttg: c243/289 lr:0.000062 t:19.9s +tttg: c244/289 lr:0.000059 t:20.0s +tttg: c245/289 lr:0.000056 t:20.1s +tttg: c246/289 lr:0.000054 t:20.1s +tttg: c247/289 lr:0.000052 t:20.2s +tttg: c248/289 lr:0.000049 t:20.3s +tttg: c249/289 lr:0.000047 t:20.4s +tttg: c250/289 lr:0.000045 t:20.4s +tttg: c251/289 lr:0.000042 t:20.5s +tttg: c252/289 lr:0.000040 t:20.6s +tttg: c253/289 lr:0.000038 t:20.7s +tttg: c254/289 lr:0.000036 t:20.8s +tttg: c255/289 lr:0.000034 t:20.8s +tttg: c256/289 lr:0.000032 t:20.9s +tttg: c257/289 lr:0.000030 t:21.0s +tttg: c258/289 lr:0.000028 t:21.1s +tttg: c259/289 lr:0.000027 t:21.1s +tttg: c260/289 lr:0.000025 t:21.2s +tttg: c261/289 lr:0.000023 t:21.3s +tttg: c262/289 lr:0.000022 t:21.4s +tttg: c263/289 lr:0.000020 t:21.4s +tttg: c264/289 lr:0.000018 t:21.5s +tttg: c265/289 lr:0.000017 t:21.6s +tttg: c266/289 lr:0.000016 t:21.7s +tttg: c267/289 lr:0.000014 t:21.7s +tttg: c268/289 lr:0.000013 t:21.8s +tttg: c269/289 lr:0.000012 t:21.9s +tttg: c270/289 lr:0.000011 t:22.0s +tttg: c271/289 lr:0.000010 t:22.1s +tttg: c272/289 lr:0.000009 t:22.1s +tttg: c273/289 lr:0.000008 t:22.2s +tttg: c274/289 lr:0.000007 t:22.3s +tttg: c275/289 lr:0.000006 t:22.4s +tttg: c276/289 lr:0.000005 t:22.4s +tttg: c277/289 lr:0.000004 t:22.5s +tttg: c278/289 lr:0.000004 t:22.6s +tttg: c279/289 lr:0.000003 t:22.7s +tttg: c280/289 lr:0.000002 t:22.7s +tttg: c281/289 lr:0.000002 t:22.8s +tttg: c282/289 lr:0.000001 t:22.9s +tttg: c283/289 lr:0.000001 t:23.0s +tttg: c284/289 lr:0.000001 t:23.1s +tttg: c285/289 lr:0.000000 t:23.1s +tttg: c286/289 lr:0.000000 t:23.2s +tttg: c287/289 lr:0.000000 t:23.3s +tttg: c288/289 lr:0.000000 t:23.4s +ttpr: phase:3/3 t:317.3s +ttp: b735/782 bl:2.3813 bb:1.0955 rl:2.3129 rb:1.0684 dl:2495-2526 gd:1 +ttp: b721/782 bl:2.3026 bb:1.0225 rl:2.3123 rb:1.0658 dl:2144-2163 gd:1 +ttp: b713/782 bl:2.2470 bb:1.0098 rl:2.3092 rb:1.0631 dl:2002-2017 gd:1 +ttp: b709/782 bl:2.4408 bb:1.0918 rl:2.3150 rb:1.0644 dl:1937-1952 gd:1 +ttp: b701/782 bl:2.3056 bb:1.0338 rl:2.3146 rb:1.0632 dl:1835-1847 gd:1 +ttp: b689/782 bl:2.3865 bb:1.0745 rl:2.3172 rb:1.0636 dl:1706-1715 gd:1 +ttp: b686/782 bl:2.4372 bb:1.0729 rl:2.3213 rb:1.0639 dl:1675-1685 gd:1 +ttp: b673/782 bl:2.3595 bb:1.0592 rl:2.3224 rb:1.0638 dl:1562-1571 gd:1 +ttp: b670/782 bl:2.3370 bb:1.0634 rl:2.3229 rb:1.0637 dl:1537-1544 gd:1 +ttp: b656/782 bl:2.3228 bb:1.1081 rl:2.3229 rb:1.0649 dl:1439-1445 gd:1 +ttp: b648/782 bl:2.2769 bb:1.0047 rl:2.3217 rb:1.0633 dl:1387-1392 gd:1 +ttp: b640/782 bl:2.3037 bb:1.0494 rl:2.3213 rb:1.0630 dl:1337-1343 gd:1 +ttp: b632/782 bl:2.3454 bb:1.0319 rl:2.3218 rb:1.0623 dl:1290-1297 gd:1 +ttp: b624/782 bl:2.3527 bb:1.0650 rl:2.3225 rb:1.0623 dl:1249-1255 gd:1 +ttp: b616/782 bl:2.3984 bb:1.0404 rl:2.3240 rb:1.0619 dl:1205-1211 gd:1 +ttp: b608/782 bl:2.3433 bb:1.0766 rl:2.3244 rb:1.0621 dl:1168-1172 gd:1 +ttp: b600/782 bl:2.2553 bb:1.0105 rl:2.3231 rb:1.0612 dl:1133-1137 gd:1 +ttp: b592/782 bl:2.2183 bb:0.9904 rl:2.3213 rb:1.0600 dl:1098-1103 gd:1 +ttp: b585/782 bl:2.2784 bb:1.0334 rl:2.3206 rb:1.0595 dl:1069-1073 gd:1 +ttp: b577/782 bl:2.2813 bb:1.0268 rl:2.3200 rb:1.0590 dl:1037-1041 gd:1 +ttp: b569/782 bl:2.2988 bb:1.0394 rl:2.3197 rb:1.0587 dl:1007-1010 gd:1 +ttp: b561/782 bl:2.2413 bb:1.0110 rl:2.3185 rb:1.0580 dl:979-983 gd:1 +ttp: b553/782 bl:2.2805 bb:1.0282 rl:2.3180 rb:1.0576 dl:952-955 gd:1 +ttp: b545/782 bl:2.3275 bb:1.0292 rl:2.3181 rb:1.0572 dl:927-930 gd:1 +ttp: b537/782 bl:2.3698 bb:1.0689 rl:2.3188 rb:1.0573 dl:902-905 gd:1 +ttp: b529/782 bl:2.3029 bb:1.0116 rl:2.3186 rb:1.0568 dl:878-882 gd:1 +ttp: b521/782 bl:2.3481 bb:1.0643 rl:2.3190 rb:1.0569 dl:854-858 gd:1 +ttp: b513/782 bl:2.3642 bb:1.0379 rl:2.3195 rb:1.0566 dl:832-835 gd:1 +ttp: b505/782 bl:2.3202 bb:1.0610 rl:2.3195 rb:1.0567 dl:809-812 gd:1 +ttp: b497/782 bl:2.3348 bb:1.0412 rl:2.3196 rb:1.0565 dl:788-791 gd:1 +ttp: b489/782 bl:2.3825 bb:1.0719 rl:2.3203 rb:1.0567 dl:769-771 gd:1 +ttp: b481/782 bl:2.2936 bb:1.0426 rl:2.3200 rb:1.0565 dl:749-752 gd:1 +ttp: b473/782 bl:2.2590 bb:1.0278 rl:2.3194 rb:1.0563 dl:730-733 gd:1 +ttp: b465/782 bl:2.3819 bb:1.0624 rl:2.3200 rb:1.0563 dl:712-714 gd:1 +ttp: b457/782 bl:2.2535 bb:1.0317 rl:2.3194 rb:1.0561 dl:695-697 gd:1 +ttp: b449/782 bl:2.4091 bb:1.0585 rl:2.3202 rb:1.0561 dl:678-680 gd:1 +ttp: b442/782 bl:2.2522 bb:1.0278 rl:2.3196 rb:1.0559 dl:664-666 gd:1 +ttp: b435/782 bl:2.3098 bb:1.0202 rl:2.3195 rb:1.0556 dl:648-651 gd:1 +ttp: b427/782 bl:2.2501 bb:1.0593 rl:2.3190 rb:1.0556 dl:634-636 gd:1 +ttp: b419/782 bl:2.3109 bb:1.0477 rl:2.3189 rb:1.0556 dl:618-620 gd:1 +ttp: b411/782 bl:2.3542 bb:1.0566 rl:2.3192 rb:1.0556 dl:603-605 gd:1 +ttp: b403/782 bl:2.3195 bb:1.0408 rl:2.3192 rb:1.0555 dl:588-590 gd:1 +ttp: b395/782 bl:2.2627 bb:1.0480 rl:2.3188 rb:1.0554 dl:573-575 gd:1 +ttp: b388/782 bl:2.2978 bb:1.0363 rl:2.3187 rb:1.0553 dl:561-562 gd:1 +ttp: b381/782 bl:2.4224 bb:1.1012 rl:2.3193 rb:1.0556 dl:549-550 gd:1 +ttp: b374/782 bl:2.2945 bb:1.0344 rl:2.3192 rb:1.0554 dl:537-538 gd:1 +ttp: b368/782 bl:2.3543 bb:1.0965 rl:2.3194 rb:1.0557 dl:527-528 gd:1 +ttp: b363/782 bl:2.3738 bb:1.0625 rl:2.3197 rb:1.0557 dl:518-521 gd:1 +ttp: b356/782 bl:2.3340 bb:1.0510 rl:2.3198 rb:1.0557 dl:506-508 gd:1 +ttp: b349/782 bl:2.3464 bb:1.0233 rl:2.3200 rb:1.0555 dl:495-496 gd:1 +ttp: b341/782 bl:2.2955 bb:1.0752 rl:2.3198 rb:1.0556 dl:483-485 gd:1 +ttp: b333/782 bl:2.4247 bb:1.0792 rl:2.3204 rb:1.0557 dl:471-472 gd:1 +ttp: b325/782 bl:2.3455 bb:1.0789 rl:2.3205 rb:1.0559 dl:459-461 gd:1 +ttp: b317/782 bl:2.2996 bb:1.0448 rl:2.3204 rb:1.0558 dl:446-448 gd:1 +ttp: b309/782 bl:2.4068 bb:1.1044 rl:2.3208 rb:1.0560 dl:435-437 gd:1 +ttp: b300/782 bl:2.3338 bb:1.0542 rl:2.3209 rb:1.0560 dl:421-422 gd:1 +ttp: b292/782 bl:2.3297 bb:1.1030 rl:2.3209 rb:1.0562 dl:409-410 gd:1 +ttp: b284/782 bl:2.4433 bb:1.1377 rl:2.3215 rb:1.0566 dl:398-399 gd:1 +ttp: b276/782 bl:2.3842 bb:1.1020 rl:2.3217 rb:1.0568 dl:387-388 gd:1 +ttp: b266/782 bl:2.3691 bb:1.1023 rl:2.3219 rb:1.0570 dl:374-375 gd:1 +ttp: b259/782 bl:2.3339 bb:1.0945 rl:2.3220 rb:1.0571 dl:365-366 gd:1 +ttp: b252/782 bl:2.3737 bb:1.0639 rl:2.3222 rb:1.0571 dl:356-357 gd:1 +ttp: b244/782 bl:2.3321 bb:1.1097 rl:2.3222 rb:1.0573 dl:346-347 gd:1 +ttp: b237/782 bl:2.3326 bb:1.0957 rl:2.3222 rb:1.0575 dl:337-338 gd:1 +ttp: b226/782 bl:2.3612 bb:1.0951 rl:2.3224 rb:1.0576 dl:324-325 gd:1 +ttp: b218/782 bl:2.4511 bb:1.1056 rl:2.3228 rb:1.0577 dl:315-316 gd:1 +ttp: b212/782 bl:2.3598 bb:1.0772 rl:2.3229 rb:1.0578 dl:308-309 gd:1 +ttp: b204/782 bl:2.4458 bb:1.1476 rl:2.3233 rb:1.0581 dl:300-301 gd:1 +ttp: b196/782 bl:2.4429 bb:1.1148 rl:2.3237 rb:1.0583 dl:291-292 gd:1 +ttp: b187/782 bl:2.4506 bb:1.1324 rl:2.3241 rb:1.0585 dl:281-282 gd:1 +ttp: b179/782 bl:2.3559 bb:1.1231 rl:2.3242 rb:1.0587 dl:273-274 gd:1 +ttp: b172/782 bl:2.5095 bb:1.1505 rl:2.3247 rb:1.0589 dl:266-267 gd:1 +ttp: b164/782 bl:2.4296 bb:1.1493 rl:2.3250 rb:1.0591 dl:259-260 gd:1 +ttp: b157/782 bl:2.3534 bb:1.1272 rl:2.3250 rb:1.0593 dl:252-253 gd:1 +ttp: b149/782 bl:2.3502 bb:1.1448 rl:2.3251 rb:1.0595 dl:244-245 gd:1 +ttp: b141/782 bl:2.4674 bb:1.1260 rl:2.3254 rb:1.0597 dl:236-237 gd:1 +ttp: b133/782 bl:2.3613 bb:1.1326 rl:2.3255 rb:1.0598 dl:229-230 gd:1 +ttp: b124/782 bl:2.3828 bb:1.1639 rl:2.3257 rb:1.0601 dl:220-222 gd:1 +ttp: b117/782 bl:2.4728 bb:1.2015 rl:2.3260 rb:1.0604 dl:214-215 gd:1 +ttp: b109/782 bl:2.4835 bb:1.1835 rl:2.3263 rb:1.0606 dl:207-208 gd:1 +ttp: b102/782 bl:2.5815 bb:1.1966 rl:2.3268 rb:1.0609 dl:201-202 gd:1 +ttp: b96/782 bl:2.4825 bb:1.2052 rl:2.3272 rb:1.0611 dl:195-196 gd:1 +ttp: b90/782 bl:2.4703 bb:1.2097 rl:2.3274 rb:1.0614 dl:190-190 gd:1 +ttp: b81/782 bl:2.4658 bb:1.1191 rl:2.3277 rb:1.0615 dl:182-183 gd:1 +ttp: b75/782 bl:2.5601 bb:1.1869 rl:2.3281 rb:1.0617 dl:176-177 gd:1 +ttp: b67/782 bl:2.5390 bb:1.2020 rl:2.3285 rb:1.0620 dl:169-170 gd:1 +ttp: b59/782 bl:2.4934 bb:1.1878 rl:2.3287 rb:1.0622 dl:162-163 gd:1 +ttp: b51/782 bl:2.4779 bb:1.1855 rl:2.3290 rb:1.0624 dl:154-155 gd:1 +ttp: b43/782 bl:2.5053 bb:1.2231 rl:2.3292 rb:1.0626 dl:146-147 gd:1 +ttp: b35/782 bl:2.6154 bb:1.2687 rl:2.3296 rb:1.0628 dl:138-139 gd:1 +ttp: b27/782 bl:2.5855 bb:1.2222 rl:2.3300 rb:1.0630 dl:130-131 gd:1 +ttp: b19/782 bl:2.6287 bb:1.2070 rl:2.3303 rb:1.0632 dl:121-122 gd:1 +ttp: b11/782 bl:2.6283 bb:1.2153 rl:2.3307 rb:1.0634 dl:109-110 gd:1 +ttp: b3/782 bl:2.6534 bb:1.1820 rl:2.3309 rb:1.0635 dl:89-93 gd:1 +quantized_ttt_phased val_loss:2.31521576 val_bpb:1.05796326 eval_time:407368ms +total_eval_time:407.4s diff --git a/records/track_10min_16mb/2026-05-01_PR2101_3Seed_Support/ablation_label_smooth_005_seed42.log b/records/track_10min_16mb/2026-05-01_PR2101_3Seed_Support/ablation_label_smooth_005_seed42.log new file mode 100644 index 0000000000..6a3392817c --- /dev/null +++ b/records/track_10min_16mb/2026-05-01_PR2101_3Seed_Support/ablation_label_smooth_005_seed42.log @@ -0,0 +1,954 @@ +W0501 06:50:57.315000 826694 torch/distributed/run.py:803] +W0501 06:50:57.315000 826694 torch/distributed/run.py:803] ***************************************** +W0501 06:50:57.315000 826694 torch/distributed/run.py:803] Setting OMP_NUM_THREADS environment variable for each process to be 1 in default, to avoid your system being overloaded, please further tune the variable for optimal performance in your application as needed. +W0501 06:50:57.315000 826694 torch/distributed/run.py:803] ***************************************** +Hyperparameters: + adam_eps: 1e-08 + adam_wd: 0.02 + artifact_dir: + attn_clip_sigmas: 13.0 + attn_out_gate_enabled: False + attn_out_gate_src: proj + awq_lite_bits: 8 + awq_lite_enabled: True + awq_lite_group_size: 64 + awq_lite_group_top_k: 1 + beta1: 0.9 + beta2: 0.99 + caseops_enabled: True + compressor: pergroup + data_dir: ./data + datasets_dir: ./data/datasets/fineweb10B_sp8192_lossless_caps_caseops_v1_reserved + distributed: True + ema_decay: 0.9965 + embed_bits: 7 + embed_clip_sigmas: 14.0 + embed_lr: 0.6 + embed_wd: 0.085 + enable_looping_at: 0.35 + eval_seq_len: 2560 + eval_stride: 64 + fused_ce_enabled: True + gate_window: 12 + gated_attn_enabled: False + gated_attn_init_std: 0.01 + gated_attn_quant_gate: True + global_ttt_batch_seqs: 32 + global_ttt_chunk_tokens: 32768 + global_ttt_epochs: 1 + global_ttt_grad_clip: 1.0 + global_ttt_lr: 0.001 + global_ttt_momentum: 0.9 + global_ttt_respect_doc_boundaries: True + global_ttt_warmup_chunks: 0 + global_ttt_warmup_start_lr: 0.0 + gptq_calibration_batches: 16 + gptq_reserve_seconds: 8.0 + grad_accum_steps: 1 + grad_centralize: False + grad_clip_norm: 0.3 + is_main_process: True + iterations: 20000 + label_smooth: 0.05 + ln_scale: True + local_rank: 0 + logfile: logs/395f4594-e227-4b1c-be98-b670bf0b0a9d.txt + logit_softcap: 30.0 + loop_end: 5 + loop_start: 3 + lqer_asym_enabled: True + lqer_asym_group: 64 + lqer_enabled: True + lqer_factor_bits: 4 + lqer_gain_select: False + lqer_rank: 4 + lqer_scope: all + lqer_top_k: 3 + matrix_bits: 6 + matrix_clip_sigmas: 12.85 + matrix_lr: 0.026 + max_wallclock_seconds: 600.0 + min_lr: 0.1 + mlp_clip_sigmas: 11.5 + mlp_mult: 4.0 + model_dim: 512 + model_path: final_model.pt + muon_backend_steps: 5 + muon_momentum: 0.97 + muon_momentum_warmup_start: 0.92 + muon_momentum_warmup_steps: 1500 + muon_row_normalize: True + muon_wd: 0.095 + num_heads: 8 + num_kv_heads: 4 + num_layers: 11 + num_loops: 2 + parallel_final_lane: mean + parallel_start_layer: 8 + phased_ttt_num_phases: 3 + phased_ttt_prefix_docs: 2500 + qk_gain_init: 5.25 + quantized_model_path: final_model.int6.ptz + rank: 0 + rope_base: 10000.0 + rope_dims: 16 + rope_train_seq_len: 2048 + rope_yarn: False + run_id: 395f4594-e227-4b1c-be98-b670bf0b0a9d + scalar_lr: 0.02 + seed: 42 + skip_gates_enabled: True + smear_gate_enabled: True + sparse_attn_gate_enabled: True + sparse_attn_gate_init_std: 0.0 + sparse_attn_gate_scale: 0.5 + tie_embeddings: True + tied_embed_init_std: 0.005 + tied_embed_lr: 0.03 + tokenizer_path: ./tokenizers/fineweb_8192_bpe_lossless_caps_caseops_v1_reserved.model + train_batch_tokens: 786432 + train_files: ./data/datasets/fineweb10B_sp8192_lossless_caps_caseops_v1_reserved/fineweb_train_*.bin + train_log_every: 500 + train_seq_len: 2048 + ttt_batch_size: 64 + ttt_beta1: 0.0 + ttt_beta2: 0.99 + ttt_chunk_size: 48 + ttt_enabled: True + ttt_eval_batches: + ttt_eval_seq_len: 2560 + ttt_grad_steps: 1 + ttt_k_lora: True + ttt_local_lr_mult: 0.75 + ttt_lora_lr: 0.0001 + ttt_lora_rank: 80 + ttt_mask: no_qv + ttt_mlp_lora: True + ttt_o_lora: True + ttt_optimizer: adam + ttt_q_lora: False + ttt_v_lora: False + ttt_weight_decay: 0.5 + val_batch_tokens: 524288 + val_bytes_files: ./data/datasets/fineweb10B_sp8192_lossless_caps_caseops_v1_reserved/fineweb_val_bytes_*.bin + val_doc_fraction: 1.0 + val_files: ./data/datasets/fineweb10B_sp8192_lossless_caps_caseops_v1_reserved/fineweb_val_*.bin + val_loss_every: 0 + vocab_size: 8192 + warmdown_frac: 0.85 + warmup_steps: 20 + world_size: 8 + xsa_last_n: 11 +train_shards: 80 +val_tokens: 47851520 +model_params:35945673 +gptq:reserving 8s, effective=592000ms +warmup_cu_buckets:64,128,192,256 iters_each:3 +warmup_step: 1/20 +warmup_step: 2/20 +warmup_step: 3/20 +warmup_step: 4/20 +warmup_step: 5/20 +warmup_step: 6/20 +warmup_step: 10/20 +warmup_step: 20/20 +loop_warmup:enabled encoder:[0, 1, 2, 3, 4, 5, 3, 4] decoder:[5, 3, 4, 5, 6, 7, 8, 9, 10] +loop_warmup_step: 1/20 +loop_warmup_step: 2/20 +loop_warmup_step: 3/20 +loop_warmup_step: 4/20 +loop_warmup_step: 5/20 +loop_warmup_step: 6/20 +loop_warmup_step: 10/20 +loop_warmup_step: 20/20 +1/20000 train_loss: 9.0088 train_time: 0.0m tok/s: 17323321 +2/20000 train_loss: 12.6326 train_time: 0.0m tok/s: 8545371 +3/20000 train_loss: 10.1525 train_time: 0.0m tok/s: 8500363 +4/20000 train_loss: 8.7004 train_time: 0.0m tok/s: 8480310 +5/20000 train_loss: 7.9940 train_time: 0.0m tok/s: 8447114 +500/20000 train_loss: 2.8892 train_time: 0.8m tok/s: 8172949 +1000/20000 train_loss: 3.1035 train_time: 1.6m tok/s: 8129280 +1500/20000 train_loss: 2.9351 train_time: 2.4m tok/s: 8110236 +2000/20000 train_loss: 2.9678 train_time: 3.2m tok/s: 8106935 +layer_loop:enabled step:2136 frac:0.350 encoder:[0, 1, 2, 3, 4, 5, 3, 4] decoder:[5, 3, 4, 5, 6, 7, 8, 9, 10] +2500/20000 train_loss: 2.8574 train_time: 4.3m tok/s: 7598626 +3000/20000 train_loss: 2.8739 train_time: 5.5m tok/s: 7161003 +3500/20000 train_loss: 2.8759 train_time: 6.7m tok/s: 6879052 +4000/20000 train_loss: 2.7257 train_time: 7.8m tok/s: 6682505 +4500/20000 train_loss: 2.6026 train_time: 9.0m tok/s: 6538054 +4859/20000 val_loss: 2.3483 val_bpb: 1.0730 +stopping_early: wallclock_cap train_time: 592044ms step: 4859/20000 +peak memory allocated: 41707 MiB reserved: 46954 MiB +ema:applying EMA weights +diagnostic pre-quantization post-ema val_loss:2.32316870 val_bpb:1.06150492 eval_time:9603ms +Serialized model: 135418111 bytes +Code size (uncompressed): 172613 bytes +Code size (compressed): 34386 bytes +GPTQ:collecting Hessians from calibration data... +GPTQ:collected 67 Hessians in 4.1s +Quantized weights: + gate_int8_row: blocks.attn.attn_gate_w + gptq (int6): blocks.attn.c_k.weight, blocks.attn.c_q.weight, blocks.attn.c_v.weight, blocks.attn.proj.weight, blocks.mlp.fc.weight, blocks.mlp.proj.weight + gptq (int6)+lqer_asym: blocks.mlp.fc.weight + gptq (int7)+awqgrpint8+lqer_asym: tok_emb.weight + passthrough (float16): blocks.attn.q_gain, blocks.attn_scale, blocks.mlp_scale, blocks.resid_mix, parallel_post_lambdas, parallel_resid_lambdas, skip_gates, skip_weights, smear_gate.weight, smear_lambda, softcap_neg, softcap_pos +Serialize: per-group lrzip compression... +Serialize: per-group compression done in 128.0s +Serialized model quantized+pergroup: 15946695 bytes +Total submission size quantized+pergroup: 15981081 bytes +Deserialize: per-group lrzip decompression... +Deserialize: decompression done in 21.4s +diagnostic quantized val_loss:2.34127731 val_bpb:1.06977913 eval_time:14714ms +Deserialize: per-group lrzip decompression... +Deserialize: decompression done in 21.0s +ttt_lora:warming up compile (random tokens, no val data) +ttt_lora:compile warmup done (93.3s) + +beginning TTT eval timer +ttt_phased: total_docs:50000 prefix_docs:2500 suffix_docs:47500 num_phases:3 boundaries:[833, 1666, 2500] +ttp: b780/782 bl:2.2315 bb:1.0750 rl:2.2315 rb:1.0750 dl:13091-17244 gd:0 +ttp: b764/782 bl:2.2842 bb:1.0699 rl:2.2435 rb:1.0738 dl:4284-4392 gd:0 +ttpp: phase:1/3 pd:1296 gd:833 t:220.1s +tttg: c1/131 lr:0.001000 t:0.3s +tttg: c2/131 lr:0.001000 t:0.4s +tttg: c3/131 lr:0.000999 t:0.5s +tttg: c4/131 lr:0.000999 t:0.6s +tttg: c5/131 lr:0.000998 t:0.6s +tttg: c6/131 lr:0.000996 t:0.7s +tttg: c7/131 lr:0.000995 t:0.8s +tttg: c8/131 lr:0.000993 t:0.9s +tttg: c9/131 lr:0.000991 t:1.0s +tttg: c10/131 lr:0.000988 t:1.0s +tttg: c11/131 lr:0.000985 t:1.1s +tttg: c12/131 lr:0.000982 t:1.2s +tttg: c13/131 lr:0.000979 t:1.3s +tttg: c14/131 lr:0.000976 t:1.4s +tttg: c15/131 lr:0.000972 t:1.4s +tttg: c16/131 lr:0.000968 t:1.5s +tttg: c17/131 lr:0.000963 t:1.6s +tttg: c18/131 lr:0.000958 t:1.7s +tttg: c19/131 lr:0.000953 t:1.8s +tttg: c20/131 lr:0.000948 t:1.8s +tttg: c21/131 lr:0.000943 t:1.9s +tttg: c22/131 lr:0.000937 t:2.0s +tttg: c23/131 lr:0.000931 t:2.1s +tttg: c24/131 lr:0.000925 t:2.1s +tttg: c25/131 lr:0.000918 t:2.2s +tttg: c26/131 lr:0.000911 t:2.3s +tttg: c27/131 lr:0.000905 t:2.4s +tttg: c28/131 lr:0.000897 t:2.5s +tttg: c29/131 lr:0.000890 t:2.5s +tttg: c30/131 lr:0.000882 t:2.6s +tttg: c31/131 lr:0.000874 t:2.7s +tttg: c32/131 lr:0.000866 t:2.8s +tttg: c33/131 lr:0.000858 t:2.9s +tttg: c34/131 lr:0.000849 t:2.9s +tttg: c35/131 lr:0.000841 t:3.0s +tttg: c36/131 lr:0.000832 t:3.1s +tttg: c37/131 lr:0.000822 t:3.2s +tttg: c38/131 lr:0.000813 t:3.2s +tttg: c39/131 lr:0.000804 t:3.3s +tttg: c40/131 lr:0.000794 t:3.4s +tttg: c41/131 lr:0.000784 t:3.5s +tttg: c42/131 lr:0.000774 t:3.6s +tttg: c43/131 lr:0.000764 t:3.6s +tttg: c44/131 lr:0.000753 t:3.7s +tttg: c45/131 lr:0.000743 t:3.8s +tttg: c46/131 lr:0.000732 t:3.9s +tttg: c47/131 lr:0.000722 t:4.0s +tttg: c48/131 lr:0.000711 t:4.0s +tttg: c49/131 lr:0.000700 t:4.1s +tttg: c50/131 lr:0.000689 t:4.2s +tttg: c51/131 lr:0.000677 t:4.3s +tttg: c52/131 lr:0.000666 t:4.4s +tttg: c53/131 lr:0.000655 t:4.4s +tttg: c54/131 lr:0.000643 t:4.5s +tttg: c55/131 lr:0.000631 t:4.6s +tttg: c56/131 lr:0.000620 t:4.7s +tttg: c57/131 lr:0.000608 t:4.8s +tttg: c58/131 lr:0.000596 t:4.8s +tttg: c59/131 lr:0.000584 t:4.9s +tttg: c60/131 lr:0.000572 t:5.0s +tttg: c61/131 lr:0.000560 t:5.1s +tttg: c62/131 lr:0.000548 t:5.1s +tttg: c63/131 lr:0.000536 t:5.2s +tttg: c64/131 lr:0.000524 t:5.3s +tttg: c65/131 lr:0.000512 t:5.4s +tttg: c66/131 lr:0.000500 t:5.5s +tttg: c67/131 lr:0.000488 t:5.6s +tttg: c68/131 lr:0.000476 t:5.6s +tttg: c69/131 lr:0.000464 t:5.7s +tttg: c70/131 lr:0.000452 t:5.8s +tttg: c71/131 lr:0.000440 t:5.9s +tttg: c72/131 lr:0.000428 t:5.9s +tttg: c73/131 lr:0.000416 t:6.0s +tttg: c74/131 lr:0.000404 t:6.1s +tttg: c75/131 lr:0.000392 t:6.2s +tttg: c76/131 lr:0.000380 t:6.3s +tttg: c77/131 lr:0.000369 t:6.4s +tttg: c78/131 lr:0.000357 t:6.4s +tttg: c79/131 lr:0.000345 t:6.5s +tttg: c80/131 lr:0.000334 t:6.6s +tttg: c81/131 lr:0.000323 t:6.7s +tttg: c82/131 lr:0.000311 t:6.7s +tttg: c83/131 lr:0.000300 t:6.8s +tttg: c84/131 lr:0.000289 t:6.9s +tttg: c85/131 lr:0.000278 t:7.0s +tttg: c86/131 lr:0.000268 t:7.1s +tttg: c87/131 lr:0.000257 t:7.1s +tttg: c88/131 lr:0.000247 t:7.2s +tttg: c89/131 lr:0.000236 t:7.3s +tttg: c90/131 lr:0.000226 t:7.4s +tttg: c91/131 lr:0.000216 t:7.4s +tttg: c92/131 lr:0.000206 t:7.5s +tttg: c93/131 lr:0.000196 t:7.6s +tttg: c94/131 lr:0.000187 t:7.7s +tttg: c95/131 lr:0.000178 t:7.8s +tttg: c96/131 lr:0.000168 t:7.8s +tttg: c97/131 lr:0.000159 t:7.9s +tttg: c98/131 lr:0.000151 t:8.0s +tttg: c99/131 lr:0.000142 t:8.1s +tttg: c100/131 lr:0.000134 t:8.2s +tttg: c101/131 lr:0.000126 t:8.2s +tttg: c102/131 lr:0.000118 t:8.3s +tttg: c103/131 lr:0.000110 t:8.4s +tttg: c104/131 lr:0.000103 t:8.5s +tttg: c105/131 lr:0.000095 t:8.5s +tttg: c106/131 lr:0.000089 t:8.6s +tttg: c107/131 lr:0.000082 t:8.7s +tttg: c108/131 lr:0.000075 t:8.8s +tttg: c109/131 lr:0.000069 t:8.9s +tttg: c110/131 lr:0.000063 t:8.9s +tttg: c111/131 lr:0.000057 t:9.0s +tttg: c112/131 lr:0.000052 t:9.1s +tttg: c113/131 lr:0.000047 t:9.2s +tttg: c114/131 lr:0.000042 t:9.3s +tttg: c115/131 lr:0.000037 t:9.3s +tttg: c116/131 lr:0.000032 t:9.4s +tttg: c117/131 lr:0.000028 t:9.5s +tttg: c118/131 lr:0.000024 t:9.6s +tttg: c119/131 lr:0.000021 t:9.6s +tttg: c120/131 lr:0.000018 t:9.7s +tttg: c121/131 lr:0.000015 t:9.8s +tttg: c122/131 lr:0.000012 t:9.9s +tttg: c123/131 lr:0.000009 t:10.0s +tttg: c124/131 lr:0.000007 t:10.0s +tttg: c125/131 lr:0.000005 t:10.1s +tttg: c126/131 lr:0.000004 t:10.2s +tttg: c127/131 lr:0.000002 t:10.3s +tttg: c128/131 lr:0.000001 t:10.3s +tttg: c129/131 lr:0.000001 t:10.4s +tttg: c130/131 lr:0.000000 t:10.5s +ttpr: phase:1/3 t:231.7s +ttp: b760/782 bl:2.3431 bb:1.0375 rl:2.2603 rb:1.0673 dl:3817-3916 gd:0 +ttp: b750/782 bl:2.3784 bb:1.0686 rl:2.2745 rb:1.0674 dl:3090-3149 gd:0 +ttpp: phase:2/3 pd:2128 gd:1666 t:286.4s +tttg: c1/219 lr:0.001000 t:0.1s +tttg: c2/219 lr:0.001000 t:0.1s +tttg: c3/219 lr:0.001000 t:0.2s +tttg: c4/219 lr:0.001000 t:0.3s +tttg: c5/219 lr:0.000999 t:0.4s +tttg: c6/219 lr:0.000999 t:0.4s +tttg: c7/219 lr:0.000998 t:0.5s +tttg: c8/219 lr:0.000997 t:0.6s +tttg: c9/219 lr:0.000997 t:0.7s +tttg: c10/219 lr:0.000996 t:0.8s +tttg: c11/219 lr:0.000995 t:0.8s +tttg: c12/219 lr:0.000994 t:0.9s +tttg: c13/219 lr:0.000993 t:1.0s +tttg: c14/219 lr:0.000991 t:1.1s +tttg: c15/219 lr:0.000990 t:1.1s +tttg: c16/219 lr:0.000988 t:1.2s +tttg: c17/219 lr:0.000987 t:1.3s +tttg: c18/219 lr:0.000985 t:1.4s +tttg: c19/219 lr:0.000983 t:1.5s +tttg: c20/219 lr:0.000981 t:1.5s +tttg: c21/219 lr:0.000979 t:1.6s +tttg: c22/219 lr:0.000977 t:1.7s +tttg: c23/219 lr:0.000975 t:1.8s +tttg: c24/219 lr:0.000973 t:1.8s +tttg: c25/219 lr:0.000970 t:1.9s +tttg: c26/219 lr:0.000968 t:2.0s +tttg: c27/219 lr:0.000965 t:2.1s +tttg: c28/219 lr:0.000963 t:2.2s +tttg: c29/219 lr:0.000960 t:2.2s +tttg: c30/219 lr:0.000957 t:2.3s +tttg: c31/219 lr:0.000954 t:2.4s +tttg: c32/219 lr:0.000951 t:2.5s +tttg: c33/219 lr:0.000948 t:2.6s +tttg: c34/219 lr:0.000945 t:2.6s +tttg: c35/219 lr:0.000941 t:2.7s +tttg: c36/219 lr:0.000938 t:2.8s +tttg: c37/219 lr:0.000934 t:2.9s +tttg: c38/219 lr:0.000931 t:2.9s +tttg: c39/219 lr:0.000927 t:3.0s +tttg: c40/219 lr:0.000923 t:3.1s +tttg: c41/219 lr:0.000919 t:3.2s +tttg: c42/219 lr:0.000915 t:3.2s +tttg: c43/219 lr:0.000911 t:3.3s +tttg: c44/219 lr:0.000907 t:3.4s +tttg: c45/219 lr:0.000903 t:3.5s +tttg: c46/219 lr:0.000898 t:3.5s +tttg: c47/219 lr:0.000894 t:3.6s +tttg: c48/219 lr:0.000890 t:3.7s +tttg: c49/219 lr:0.000885 t:3.8s +tttg: c50/219 lr:0.000880 t:3.9s +tttg: c51/219 lr:0.000876 t:3.9s +tttg: c52/219 lr:0.000871 t:4.0s +tttg: c53/219 lr:0.000866 t:4.1s +tttg: c54/219 lr:0.000861 t:4.2s +tttg: c55/219 lr:0.000856 t:4.2s +tttg: c56/219 lr:0.000851 t:4.3s +tttg: c57/219 lr:0.000846 t:4.4s +tttg: c58/219 lr:0.000841 t:4.5s +tttg: c59/219 lr:0.000835 t:4.6s +tttg: c60/219 lr:0.000830 t:4.6s +tttg: c61/219 lr:0.000824 t:4.7s +tttg: c62/219 lr:0.000819 t:4.8s +tttg: c63/219 lr:0.000813 t:4.9s +tttg: c64/219 lr:0.000808 t:4.9s +tttg: c65/219 lr:0.000802 t:5.0s +tttg: c66/219 lr:0.000796 t:5.1s +tttg: c67/219 lr:0.000790 t:5.2s +tttg: c68/219 lr:0.000784 t:5.3s +tttg: c69/219 lr:0.000779 t:5.3s +tttg: c70/219 lr:0.000773 t:5.4s +tttg: c71/219 lr:0.000766 t:5.5s +tttg: c72/219 lr:0.000760 t:5.6s +tttg: c73/219 lr:0.000754 t:5.6s +tttg: c74/219 lr:0.000748 t:5.7s +tttg: c75/219 lr:0.000742 t:5.8s +tttg: c76/219 lr:0.000735 t:5.9s +tttg: c77/219 lr:0.000729 t:6.0s +tttg: c78/219 lr:0.000722 t:6.0s +tttg: c79/219 lr:0.000716 t:6.1s +tttg: c80/219 lr:0.000709 t:6.2s +tttg: c81/219 lr:0.000703 t:6.3s +tttg: c82/219 lr:0.000696 t:6.3s +tttg: c83/219 lr:0.000690 t:6.4s +tttg: c84/219 lr:0.000683 t:6.5s +tttg: c85/219 lr:0.000676 t:6.6s +tttg: c86/219 lr:0.000670 t:6.7s +tttg: c87/219 lr:0.000663 t:6.7s +tttg: c88/219 lr:0.000656 t:6.8s +tttg: c89/219 lr:0.000649 t:6.9s +tttg: c90/219 lr:0.000642 t:7.0s +tttg: c91/219 lr:0.000635 t:7.0s +tttg: c92/219 lr:0.000628 t:7.1s +tttg: c93/219 lr:0.000621 t:7.2s +tttg: c94/219 lr:0.000614 t:7.3s +tttg: c95/219 lr:0.000607 t:7.4s +tttg: c96/219 lr:0.000600 t:7.4s +tttg: c97/219 lr:0.000593 t:7.5s +tttg: c98/219 lr:0.000586 t:7.6s +tttg: c99/219 lr:0.000579 t:7.7s +tttg: c100/219 lr:0.000572 t:7.7s +tttg: c101/219 lr:0.000565 t:7.8s +tttg: c102/219 lr:0.000558 t:7.9s +tttg: c103/219 lr:0.000550 t:8.0s +tttg: c104/219 lr:0.000543 t:8.0s +tttg: c105/219 lr:0.000536 t:8.1s +tttg: c106/219 lr:0.000529 t:8.2s +tttg: c107/219 lr:0.000522 t:8.3s +tttg: c108/219 lr:0.000514 t:8.3s +tttg: c109/219 lr:0.000507 t:8.4s +tttg: c110/219 lr:0.000500 t:8.5s +tttg: c111/219 lr:0.000493 t:8.6s +tttg: c112/219 lr:0.000486 t:8.7s +tttg: c113/219 lr:0.000478 t:8.7s +tttg: c114/219 lr:0.000471 t:8.8s +tttg: c115/219 lr:0.000464 t:8.9s +tttg: c116/219 lr:0.000457 t:9.0s +tttg: c117/219 lr:0.000450 t:9.1s +tttg: c118/219 lr:0.000442 t:9.1s +tttg: c119/219 lr:0.000435 t:9.2s +tttg: c120/219 lr:0.000428 t:9.3s +tttg: c121/219 lr:0.000421 t:9.4s +tttg: c122/219 lr:0.000414 t:9.4s +tttg: c123/219 lr:0.000407 t:9.5s +tttg: c124/219 lr:0.000400 t:9.6s +tttg: c125/219 lr:0.000393 t:9.7s +tttg: c126/219 lr:0.000386 t:9.7s +tttg: c127/219 lr:0.000379 t:9.8s +tttg: c128/219 lr:0.000372 t:9.9s +tttg: c129/219 lr:0.000365 t:10.0s +tttg: c130/219 lr:0.000358 t:10.0s +tttg: c131/219 lr:0.000351 t:10.1s +tttg: c132/219 lr:0.000344 t:10.2s +tttg: c133/219 lr:0.000337 t:10.3s +tttg: c134/219 lr:0.000330 t:10.4s +tttg: c135/219 lr:0.000324 t:10.4s +tttg: c136/219 lr:0.000317 t:10.5s +tttg: c137/219 lr:0.000310 t:10.6s +tttg: c138/219 lr:0.000304 t:10.7s +tttg: c139/219 lr:0.000297 t:10.8s +tttg: c140/219 lr:0.000291 t:10.8s +tttg: c141/219 lr:0.000284 t:10.9s +tttg: c142/219 lr:0.000278 t:11.0s +tttg: c143/219 lr:0.000271 t:11.1s +tttg: c144/219 lr:0.000265 t:11.1s +tttg: c145/219 lr:0.000258 t:11.2s +tttg: c146/219 lr:0.000252 t:11.3s +tttg: c147/219 lr:0.000246 t:11.4s +tttg: c148/219 lr:0.000240 t:11.5s +tttg: c149/219 lr:0.000234 t:11.5s +tttg: c150/219 lr:0.000227 t:11.6s +tttg: c151/219 lr:0.000221 t:11.7s +tttg: c152/219 lr:0.000216 t:11.8s +tttg: c153/219 lr:0.000210 t:11.8s +tttg: c154/219 lr:0.000204 t:11.9s +tttg: c155/219 lr:0.000198 t:12.0s +tttg: c156/219 lr:0.000192 t:12.1s +tttg: c157/219 lr:0.000187 t:12.2s +tttg: c158/219 lr:0.000181 t:12.2s +tttg: c159/219 lr:0.000176 t:12.3s +tttg: c160/219 lr:0.000170 t:12.4s +tttg: c161/219 lr:0.000165 t:12.5s +tttg: c162/219 lr:0.000159 t:12.6s +tttg: c163/219 lr:0.000154 t:12.6s +tttg: c164/219 lr:0.000149 t:12.7s +tttg: c165/219 lr:0.000144 t:12.8s +tttg: c166/219 lr:0.000139 t:12.9s +tttg: c167/219 lr:0.000134 t:12.9s +tttg: c168/219 lr:0.000129 t:13.0s +tttg: c169/219 lr:0.000124 t:13.1s +tttg: c170/219 lr:0.000120 t:13.2s +tttg: c171/219 lr:0.000115 t:13.3s +tttg: c172/219 lr:0.000110 t:13.3s +tttg: c173/219 lr:0.000106 t:13.4s +tttg: c174/219 lr:0.000102 t:13.5s +tttg: c175/219 lr:0.000097 t:13.6s +tttg: c176/219 lr:0.000093 t:13.6s +tttg: c177/219 lr:0.000089 t:13.7s +tttg: c178/219 lr:0.000085 t:13.8s +tttg: c179/219 lr:0.000081 t:13.9s +tttg: c180/219 lr:0.000077 t:14.0s +tttg: c181/219 lr:0.000073 t:14.0s +tttg: c182/219 lr:0.000069 t:14.1s +tttg: c183/219 lr:0.000066 t:14.2s +tttg: c184/219 lr:0.000062 t:14.3s +tttg: c185/219 lr:0.000059 t:14.3s +tttg: c186/219 lr:0.000055 t:14.4s +tttg: c187/219 lr:0.000052 t:14.5s +tttg: c188/219 lr:0.000049 t:14.6s +tttg: c189/219 lr:0.000046 t:14.7s +tttg: c190/219 lr:0.000043 t:14.7s +tttg: c191/219 lr:0.000040 t:14.8s +tttg: c192/219 lr:0.000037 t:14.9s +tttg: c193/219 lr:0.000035 t:15.0s +tttg: c194/219 lr:0.000032 t:15.1s +tttg: c195/219 lr:0.000030 t:15.1s +tttg: c196/219 lr:0.000027 t:15.2s +tttg: c197/219 lr:0.000025 t:15.3s +tttg: c198/219 lr:0.000023 t:15.4s +tttg: c199/219 lr:0.000021 t:15.4s +tttg: c200/219 lr:0.000019 t:15.5s +tttg: c201/219 lr:0.000017 t:15.6s +tttg: c202/219 lr:0.000015 t:15.7s +tttg: c203/219 lr:0.000013 t:15.8s +tttg: c204/219 lr:0.000012 t:15.8s +tttg: c205/219 lr:0.000010 t:15.9s +tttg: c206/219 lr:0.000009 t:16.0s +tttg: c207/219 lr:0.000007 t:16.1s +tttg: c208/219 lr:0.000006 t:16.1s +tttg: c209/219 lr:0.000005 t:16.2s +tttg: c210/219 lr:0.000004 t:16.3s +tttg: c211/219 lr:0.000003 t:16.4s +tttg: c212/219 lr:0.000003 t:16.4s +tttg: c213/219 lr:0.000002 t:16.5s +tttg: c214/219 lr:0.000001 t:16.6s +tttg: c215/219 lr:0.000001 t:16.7s +tttg: c216/219 lr:0.000000 t:16.8s +tttg: c217/219 lr:0.000000 t:16.8s +tttg: c218/219 lr:0.000000 t:16.9s +ttpr: phase:2/3 t:304.5s +ttp: b743/782 bl:2.3246 bb:1.0591 rl:2.2793 rb:1.0666 dl:2762-2805 gd:0 +ttp: b738/782 bl:2.3066 bb:1.0445 rl:2.2816 rb:1.0647 dl:2583-2618 gd:0 +ttpp: phase:3/3 pd:2960 gd:2500 t:319.3s +tttg: c1/289 lr:0.001000 t:0.1s +tttg: c2/289 lr:0.001000 t:0.1s +tttg: c3/289 lr:0.001000 t:0.2s +tttg: c4/289 lr:0.001000 t:0.3s +tttg: c5/289 lr:0.001000 t:0.4s +tttg: c6/289 lr:0.000999 t:0.5s +tttg: c7/289 lr:0.000999 t:0.5s +tttg: c8/289 lr:0.000999 t:0.6s +tttg: c9/289 lr:0.000998 t:0.7s +tttg: c10/289 lr:0.000998 t:0.8s +tttg: c11/289 lr:0.000997 t:0.8s +tttg: c12/289 lr:0.000996 t:0.9s +tttg: c13/289 lr:0.000996 t:1.0s +tttg: c14/289 lr:0.000995 t:1.1s +tttg: c15/289 lr:0.000994 t:1.1s +tttg: c16/289 lr:0.000993 t:1.2s +tttg: c17/289 lr:0.000992 t:1.3s +tttg: c18/289 lr:0.000991 t:1.4s +tttg: c19/289 lr:0.000990 t:1.4s +tttg: c20/289 lr:0.000989 t:1.5s +tttg: c21/289 lr:0.000988 t:1.6s +tttg: c22/289 lr:0.000987 t:1.7s +tttg: c23/289 lr:0.000986 t:1.8s +tttg: c24/289 lr:0.000984 t:1.8s +tttg: c25/289 lr:0.000983 t:1.9s +tttg: c26/289 lr:0.000982 t:2.0s +tttg: c27/289 lr:0.000980 t:2.1s +tttg: c28/289 lr:0.000978 t:2.1s +tttg: c29/289 lr:0.000977 t:2.2s +tttg: c30/289 lr:0.000975 t:2.3s +tttg: c31/289 lr:0.000973 t:2.4s +tttg: c32/289 lr:0.000972 t:2.5s +tttg: c33/289 lr:0.000970 t:2.5s +tttg: c34/289 lr:0.000968 t:2.6s +tttg: c35/289 lr:0.000966 t:2.7s +tttg: c36/289 lr:0.000964 t:2.8s +tttg: c37/289 lr:0.000962 t:2.8s +tttg: c38/289 lr:0.000960 t:2.9s +tttg: c39/289 lr:0.000958 t:3.0s +tttg: c40/289 lr:0.000955 t:3.1s +tttg: c41/289 lr:0.000953 t:3.2s +tttg: c42/289 lr:0.000951 t:3.2s +tttg: c43/289 lr:0.000948 t:3.3s +tttg: c44/289 lr:0.000946 t:3.4s +tttg: c45/289 lr:0.000944 t:3.5s +tttg: c46/289 lr:0.000941 t:3.5s +tttg: c47/289 lr:0.000938 t:3.6s +tttg: c48/289 lr:0.000936 t:3.7s +tttg: c49/289 lr:0.000933 t:3.8s +tttg: c50/289 lr:0.000930 t:3.9s +tttg: c51/289 lr:0.000927 t:3.9s +tttg: c52/289 lr:0.000925 t:4.0s +tttg: c53/289 lr:0.000922 t:4.1s +tttg: c54/289 lr:0.000919 t:4.2s +tttg: c55/289 lr:0.000916 t:4.2s +tttg: c56/289 lr:0.000913 t:4.3s +tttg: c57/289 lr:0.000910 t:4.4s +tttg: c58/289 lr:0.000906 t:4.5s +tttg: c59/289 lr:0.000903 t:4.5s +tttg: c60/289 lr:0.000900 t:4.6s +tttg: c61/289 lr:0.000897 t:4.7s +tttg: c62/289 lr:0.000893 t:4.8s +tttg: c63/289 lr:0.000890 t:4.9s +tttg: c64/289 lr:0.000887 t:4.9s +tttg: c65/289 lr:0.000883 t:5.0s +tttg: c66/289 lr:0.000879 t:5.1s +tttg: c67/289 lr:0.000876 t:5.2s +tttg: c68/289 lr:0.000872 t:5.2s +tttg: c69/289 lr:0.000869 t:5.3s +tttg: c70/289 lr:0.000865 t:5.4s +tttg: c71/289 lr:0.000861 t:5.5s +tttg: c72/289 lr:0.000857 t:5.6s +tttg: c73/289 lr:0.000854 t:5.6s +tttg: c74/289 lr:0.000850 t:5.7s +tttg: c75/289 lr:0.000846 t:5.8s +tttg: c76/289 lr:0.000842 t:5.9s +tttg: c77/289 lr:0.000838 t:5.9s +tttg: c78/289 lr:0.000834 t:6.0s +tttg: c79/289 lr:0.000830 t:6.1s +tttg: c80/289 lr:0.000826 t:6.2s +tttg: c81/289 lr:0.000821 t:6.3s +tttg: c82/289 lr:0.000817 t:6.3s +tttg: c83/289 lr:0.000813 t:6.4s +tttg: c84/289 lr:0.000809 t:6.5s +tttg: c85/289 lr:0.000804 t:6.6s +tttg: c86/289 lr:0.000800 t:6.6s +tttg: c87/289 lr:0.000796 t:6.7s +tttg: c88/289 lr:0.000791 t:6.8s +tttg: c89/289 lr:0.000787 t:6.9s +tttg: c90/289 lr:0.000782 t:7.0s +tttg: c91/289 lr:0.000778 t:7.0s +tttg: c92/289 lr:0.000773 t:7.1s +tttg: c93/289 lr:0.000769 t:7.2s +tttg: c94/289 lr:0.000764 t:7.3s +tttg: c95/289 lr:0.000759 t:7.3s +tttg: c96/289 lr:0.000755 t:7.4s +tttg: c97/289 lr:0.000750 t:7.5s +tttg: c98/289 lr:0.000745 t:7.6s +tttg: c99/289 lr:0.000740 t:7.7s +tttg: c100/289 lr:0.000736 t:7.7s +tttg: c101/289 lr:0.000731 t:7.8s +tttg: c102/289 lr:0.000726 t:7.9s +tttg: c103/289 lr:0.000721 t:8.0s +tttg: c104/289 lr:0.000716 t:8.0s +tttg: c105/289 lr:0.000711 t:8.1s +tttg: c106/289 lr:0.000706 t:8.2s +tttg: c107/289 lr:0.000701 t:8.3s +tttg: c108/289 lr:0.000696 t:8.4s +tttg: c109/289 lr:0.000691 t:8.4s +tttg: c110/289 lr:0.000686 t:8.5s +tttg: c111/289 lr:0.000681 t:8.6s +tttg: c112/289 lr:0.000676 t:8.7s +tttg: c113/289 lr:0.000671 t:8.7s +tttg: c114/289 lr:0.000666 t:8.8s +tttg: c115/289 lr:0.000661 t:8.9s +tttg: c116/289 lr:0.000656 t:9.0s +tttg: c117/289 lr:0.000650 t:9.1s +tttg: c118/289 lr:0.000645 t:9.1s +tttg: c119/289 lr:0.000640 t:9.2s +tttg: c120/289 lr:0.000635 t:9.3s +tttg: c121/289 lr:0.000629 t:9.4s +tttg: c122/289 lr:0.000624 t:9.4s +tttg: c123/289 lr:0.000619 t:9.5s +tttg: c124/289 lr:0.000614 t:9.6s +tttg: c125/289 lr:0.000608 t:9.7s +tttg: c126/289 lr:0.000603 t:9.7s +tttg: c127/289 lr:0.000598 t:9.8s +tttg: c128/289 lr:0.000592 t:9.9s +tttg: c129/289 lr:0.000587 t:10.0s +tttg: c130/289 lr:0.000581 t:10.1s +tttg: c131/289 lr:0.000576 t:10.1s +tttg: c132/289 lr:0.000571 t:10.2s +tttg: c133/289 lr:0.000565 t:10.3s +tttg: c134/289 lr:0.000560 t:10.4s +tttg: c135/289 lr:0.000554 t:10.4s +tttg: c136/289 lr:0.000549 t:10.5s +tttg: c137/289 lr:0.000544 t:10.6s +tttg: c138/289 lr:0.000538 t:10.7s +tttg: c139/289 lr:0.000533 t:10.8s +tttg: c140/289 lr:0.000527 t:10.8s +tttg: c141/289 lr:0.000522 t:10.9s +tttg: c142/289 lr:0.000516 t:11.0s +tttg: c143/289 lr:0.000511 t:11.1s +tttg: c144/289 lr:0.000505 t:11.2s +tttg: c145/289 lr:0.000500 t:11.2s +tttg: c146/289 lr:0.000495 t:11.3s +tttg: c147/289 lr:0.000489 t:11.4s +tttg: c148/289 lr:0.000484 t:11.5s +tttg: c149/289 lr:0.000478 t:11.5s +tttg: c150/289 lr:0.000473 t:11.6s +tttg: c151/289 lr:0.000467 t:11.7s +tttg: c152/289 lr:0.000462 t:11.8s +tttg: c153/289 lr:0.000456 t:11.9s +tttg: c154/289 lr:0.000451 t:11.9s +tttg: c155/289 lr:0.000446 t:12.0s +tttg: c156/289 lr:0.000440 t:12.1s +tttg: c157/289 lr:0.000435 t:12.2s +tttg: c158/289 lr:0.000429 t:12.2s +tttg: c159/289 lr:0.000424 t:12.3s +tttg: c160/289 lr:0.000419 t:12.4s +tttg: c161/289 lr:0.000413 t:12.5s +tttg: c162/289 lr:0.000408 t:12.5s +tttg: c163/289 lr:0.000402 t:12.6s +tttg: c164/289 lr:0.000397 t:12.7s +tttg: c165/289 lr:0.000392 t:12.8s +tttg: c166/289 lr:0.000386 t:12.9s +tttg: c167/289 lr:0.000381 t:12.9s +tttg: c168/289 lr:0.000376 t:13.0s +tttg: c169/289 lr:0.000371 t:13.1s +tttg: c170/289 lr:0.000365 t:13.2s +tttg: c171/289 lr:0.000360 t:13.3s +tttg: c172/289 lr:0.000355 t:13.3s +tttg: c173/289 lr:0.000350 t:13.4s +tttg: c174/289 lr:0.000344 t:13.5s +tttg: c175/289 lr:0.000339 t:13.6s +tttg: c176/289 lr:0.000334 t:13.6s +tttg: c177/289 lr:0.000329 t:13.7s +tttg: c178/289 lr:0.000324 t:13.8s +tttg: c179/289 lr:0.000319 t:13.9s +tttg: c180/289 lr:0.000314 t:14.0s +tttg: c181/289 lr:0.000309 t:14.0s +tttg: c182/289 lr:0.000304 t:14.1s +tttg: c183/289 lr:0.000299 t:14.2s +tttg: c184/289 lr:0.000294 t:14.3s +tttg: c185/289 lr:0.000289 t:14.3s +tttg: c186/289 lr:0.000284 t:14.4s +tttg: c187/289 lr:0.000279 t:14.5s +tttg: c188/289 lr:0.000274 t:14.6s +tttg: c189/289 lr:0.000269 t:14.6s +tttg: c190/289 lr:0.000264 t:14.7s +tttg: c191/289 lr:0.000260 t:14.8s +tttg: c192/289 lr:0.000255 t:14.9s +tttg: c193/289 lr:0.000250 t:15.0s +tttg: c194/289 lr:0.000245 t:15.0s +tttg: c195/289 lr:0.000241 t:15.1s +tttg: c196/289 lr:0.000236 t:15.2s +tttg: c197/289 lr:0.000231 t:15.3s +tttg: c198/289 lr:0.000227 t:15.3s +tttg: c199/289 lr:0.000222 t:15.4s +tttg: c200/289 lr:0.000218 t:15.5s +tttg: c201/289 lr:0.000213 t:15.6s +tttg: c202/289 lr:0.000209 t:15.7s +tttg: c203/289 lr:0.000204 t:15.7s +tttg: c204/289 lr:0.000200 t:15.8s +tttg: c205/289 lr:0.000196 t:15.9s +tttg: c206/289 lr:0.000191 t:16.0s +tttg: c207/289 lr:0.000187 t:16.0s +tttg: c208/289 lr:0.000183 t:16.1s +tttg: c209/289 lr:0.000179 t:16.2s +tttg: c210/289 lr:0.000174 t:16.3s +tttg: c211/289 lr:0.000170 t:16.4s +tttg: c212/289 lr:0.000166 t:16.4s +tttg: c213/289 lr:0.000162 t:16.5s +tttg: c214/289 lr:0.000158 t:16.6s +tttg: c215/289 lr:0.000154 t:16.7s +tttg: c216/289 lr:0.000150 t:16.7s +tttg: c217/289 lr:0.000146 t:16.8s +tttg: c218/289 lr:0.000143 t:16.9s +tttg: c219/289 lr:0.000139 t:17.0s +tttg: c220/289 lr:0.000135 t:17.0s +tttg: c221/289 lr:0.000131 t:17.1s +tttg: c222/289 lr:0.000128 t:17.2s +tttg: c223/289 lr:0.000124 t:17.3s +tttg: c224/289 lr:0.000121 t:17.4s +tttg: c225/289 lr:0.000117 t:17.4s +tttg: c226/289 lr:0.000113 t:17.5s +tttg: c227/289 lr:0.000110 t:17.6s +tttg: c228/289 lr:0.000107 t:17.7s +tttg: c229/289 lr:0.000103 t:17.7s +tttg: c230/289 lr:0.000100 t:17.8s +tttg: c231/289 lr:0.000097 t:17.9s +tttg: c232/289 lr:0.000094 t:18.0s +tttg: c233/289 lr:0.000090 t:18.1s +tttg: c234/289 lr:0.000087 t:18.1s +tttg: c235/289 lr:0.000084 t:18.2s +tttg: c236/289 lr:0.000081 t:18.3s +tttg: c237/289 lr:0.000078 t:18.4s +tttg: c238/289 lr:0.000075 t:18.5s +tttg: c239/289 lr:0.000073 t:18.5s +tttg: c240/289 lr:0.000070 t:18.6s +tttg: c241/289 lr:0.000067 t:18.7s +tttg: c242/289 lr:0.000064 t:18.8s +tttg: c243/289 lr:0.000062 t:18.8s +tttg: c244/289 lr:0.000059 t:18.9s +tttg: c245/289 lr:0.000056 t:19.0s +tttg: c246/289 lr:0.000054 t:19.1s +tttg: c247/289 lr:0.000052 t:19.1s +tttg: c248/289 lr:0.000049 t:19.2s +tttg: c249/289 lr:0.000047 t:19.3s +tttg: c250/289 lr:0.000045 t:19.4s +tttg: c251/289 lr:0.000042 t:19.4s +tttg: c252/289 lr:0.000040 t:19.5s +tttg: c253/289 lr:0.000038 t:19.6s +tttg: c254/289 lr:0.000036 t:19.7s +tttg: c255/289 lr:0.000034 t:19.8s +tttg: c256/289 lr:0.000032 t:19.8s +tttg: c257/289 lr:0.000030 t:19.9s +tttg: c258/289 lr:0.000028 t:20.0s +tttg: c259/289 lr:0.000027 t:20.1s +tttg: c260/289 lr:0.000025 t:20.1s +tttg: c261/289 lr:0.000023 t:20.2s +tttg: c262/289 lr:0.000022 t:20.3s +tttg: c263/289 lr:0.000020 t:20.4s +tttg: c264/289 lr:0.000018 t:20.5s +tttg: c265/289 lr:0.000017 t:20.5s +tttg: c266/289 lr:0.000016 t:20.6s +tttg: c267/289 lr:0.000014 t:20.7s +tttg: c268/289 lr:0.000013 t:20.8s +tttg: c269/289 lr:0.000012 t:20.8s +tttg: c270/289 lr:0.000011 t:20.9s +tttg: c271/289 lr:0.000010 t:21.0s +tttg: c272/289 lr:0.000009 t:21.1s +tttg: c273/289 lr:0.000008 t:21.1s +tttg: c274/289 lr:0.000007 t:21.2s +tttg: c275/289 lr:0.000006 t:21.3s +tttg: c276/289 lr:0.000005 t:21.4s +tttg: c277/289 lr:0.000004 t:21.5s +tttg: c278/289 lr:0.000004 t:21.5s +tttg: c279/289 lr:0.000003 t:21.6s +tttg: c280/289 lr:0.000002 t:21.7s +tttg: c281/289 lr:0.000002 t:21.8s +tttg: c282/289 lr:0.000001 t:21.8s +tttg: c283/289 lr:0.000001 t:21.9s +tttg: c284/289 lr:0.000001 t:22.0s +tttg: c285/289 lr:0.000000 t:22.1s +tttg: c286/289 lr:0.000000 t:22.2s +tttg: c287/289 lr:0.000000 t:22.2s +tttg: c288/289 lr:0.000000 t:22.3s +ttpr: phase:3/3 t:342.7s +ttp: b733/782 bl:2.3733 bb:1.0626 rl:2.2882 rb:1.0646 dl:2441-2468 gd:1 +ttp: b722/782 bl:2.3393 bb:1.0482 rl:2.2913 rb:1.0635 dl:2163-2185 gd:1 +ttp: b713/782 bl:2.2473 bb:1.0099 rl:2.2890 rb:1.0606 dl:2002-2017 gd:1 +ttp: b711/782 bl:2.2817 bb:1.0203 rl:2.2886 rb:1.0586 dl:1966-1983 gd:1 +ttp: b701/782 bl:2.3027 bb:1.0325 rl:2.2892 rb:1.0574 dl:1835-1847 gd:1 +ttp: b692/782 bl:2.2873 bb:1.0268 rl:2.2892 rb:1.0561 dl:1737-1746 gd:1 +ttp: b683/782 bl:2.2636 bb:1.0537 rl:2.2882 rb:1.0560 dl:1646-1657 gd:1 +ttp: b679/782 bl:2.3025 bb:1.0572 rl:2.2887 rb:1.0561 dl:1610-1618 gd:1 +ttp: b669/782 bl:2.3255 bb:1.0397 rl:2.2899 rb:1.0555 dl:1530-1537 gd:1 +ttp: b664/782 bl:2.3336 bb:1.0241 rl:2.2912 rb:1.0546 dl:1493-1499 gd:1 +ttp: b650/782 bl:2.3038 bb:1.0462 rl:2.2915 rb:1.0543 dl:1398-1406 gd:1 +ttp: b644/782 bl:2.3605 bb:1.0480 rl:2.2933 rb:1.0542 dl:1362-1367 gd:1 +ttp: b636/782 bl:2.3781 bb:1.0658 rl:2.2954 rb:1.0544 dl:1314-1320 gd:1 +ttp: b628/782 bl:2.3109 bb:1.0253 rl:2.2958 rb:1.0538 dl:1271-1276 gd:1 +ttp: b620/782 bl:2.3414 bb:1.0546 rl:2.2967 rb:1.0538 dl:1226-1231 gd:1 +ttp: b612/782 bl:2.2322 bb:1.0113 rl:2.2954 rb:1.0529 dl:1186-1190 gd:1 +ttp: b606/782 bl:2.3555 bb:1.0643 rl:2.2966 rb:1.0531 dl:1159-1164 gd:1 +ttp: b596/782 bl:2.2824 bb:1.0434 rl:2.2963 rb:1.0529 dl:1115-1119 gd:1 +ttp: b588/782 bl:2.3142 bb:1.0416 rl:2.2967 rb:1.0527 dl:1081-1086 gd:1 +ttp: b580/782 bl:2.3088 bb:1.0129 rl:2.2969 rb:1.0520 dl:1048-1052 gd:1 +ttp: b575/782 bl:2.2794 bb:1.0373 rl:2.2966 rb:1.0518 dl:1029-1033 gd:1 +ttp: b567/782 bl:2.2607 bb:1.0149 rl:2.2960 rb:1.0512 dl:1001-1004 gd:1 +ttp: b559/782 bl:2.2898 bb:1.0370 rl:2.2959 rb:1.0510 dl:972-975 gd:1 +ttp: b550/782 bl:2.3586 bb:1.0553 rl:2.2968 rb:1.0510 dl:943-946 gd:1 +ttp: b542/782 bl:2.3192 bb:1.0356 rl:2.2971 rb:1.0508 dl:918-921 gd:1 +ttp: b533/782 bl:2.3701 bb:1.0662 rl:2.2981 rb:1.0510 dl:890-892 gd:1 +ttp: b525/782 bl:2.3455 bb:1.0166 rl:2.2987 rb:1.0506 dl:866-869 gd:1 +ttp: b515/782 bl:2.3358 bb:1.0401 rl:2.2991 rb:1.0504 dl:838-841 gd:1 +ttp: b508/782 bl:2.3920 bb:1.0517 rl:2.3002 rb:1.0505 dl:817-820 gd:1 +ttp: b498/782 bl:2.3496 bb:1.0500 rl:2.3008 rb:1.0505 dl:791-794 gd:1 +ttp: b490/782 bl:2.3867 bb:1.0540 rl:2.3017 rb:1.0505 dl:771-773 gd:1 +ttp: b482/782 bl:2.3245 bb:1.0450 rl:2.3019 rb:1.0504 dl:752-754 gd:1 +ttp: b474/782 bl:2.3335 bb:1.0685 rl:2.3022 rb:1.0506 dl:733-735 gd:1 +ttp: b466/782 bl:2.3841 bb:1.0279 rl:2.3030 rb:1.0504 dl:714-717 gd:1 +ttp: b464/782 bl:2.2630 bb:1.0141 rl:2.3026 rb:1.0500 dl:710-712 gd:1 +ttp: b456/782 bl:2.3444 bb:1.0385 rl:2.3030 rb:1.0499 dl:693-695 gd:1 +ttp: b448/782 bl:2.3139 bb:1.0087 rl:2.3031 rb:1.0495 dl:677-678 gd:1 +ttp: b439/782 bl:2.3230 bb:1.0365 rl:2.3033 rb:1.0494 dl:657-659 gd:1 +ttp: b431/782 bl:2.3675 bb:1.0503 rl:2.3038 rb:1.0494 dl:642-643 gd:1 +ttp: b423/782 bl:2.2985 bb:1.0487 rl:2.3038 rb:1.0494 dl:626-629 gd:1 +ttp: b411/782 bl:2.3525 bb:1.0559 rl:2.3042 rb:1.0495 dl:603-605 gd:1 +ttp: b403/782 bl:2.3195 bb:1.0407 rl:2.3043 rb:1.0494 dl:588-590 gd:1 +ttp: b395/782 bl:2.2635 bb:1.0484 rl:2.3040 rb:1.0494 dl:573-575 gd:1 +ttp: b392/782 bl:2.2465 bb:1.0333 rl:2.3036 rb:1.0493 dl:568-570 gd:1 +ttp: b384/782 bl:2.3348 bb:1.0503 rl:2.3038 rb:1.0493 dl:554-555 gd:1 +ttp: b376/782 bl:2.3154 bb:1.0384 rl:2.3039 rb:1.0492 dl:540-542 gd:1 +ttp: b368/782 bl:2.3583 bb:1.0983 rl:2.3042 rb:1.0495 dl:527-528 gd:1 +ttp: b360/782 bl:2.3036 bb:1.0777 rl:2.3042 rb:1.0497 dl:513-515 gd:1 +ttp: b352/782 bl:2.4205 bb:1.0953 rl:2.3049 rb:1.0500 dl:499-501 gd:1 +ttp: b344/782 bl:2.3814 bb:1.0613 rl:2.3053 rb:1.0500 dl:488-489 gd:1 +ttp: b336/782 bl:2.3990 bb:1.0811 rl:2.3059 rb:1.0502 dl:476-477 gd:1 +ttp: b328/782 bl:2.2796 bb:1.0133 rl:2.3057 rb:1.0500 dl:463-465 gd:1 +ttp: b320/782 bl:2.3391 bb:1.0816 rl:2.3059 rb:1.0502 dl:451-453 gd:1 +ttp: b312/782 bl:2.3070 bb:1.0509 rl:2.3059 rb:1.0502 dl:439-440 gd:1 +ttp: b304/782 bl:2.3402 bb:1.0734 rl:2.3061 rb:1.0503 dl:427-429 gd:1 +ttp: b296/782 bl:2.3836 bb:1.0975 rl:2.3065 rb:1.0505 dl:415-417 gd:1 +ttp: b288/782 bl:2.2297 bb:1.0149 rl:2.3061 rb:1.0504 dl:403-405 gd:1 +ttp: b280/782 bl:2.3284 bb:1.0856 rl:2.3062 rb:1.0505 dl:392-394 gd:1 +ttp: b272/782 bl:2.3570 bb:1.0887 rl:2.3064 rb:1.0507 dl:382-383 gd:1 +ttp: b264/782 bl:2.4102 bb:1.0983 rl:2.3069 rb:1.0509 dl:371-372 gd:1 +ttp: b256/782 bl:2.5327 bb:1.1179 rl:2.3078 rb:1.0512 dl:361-362 gd:1 +ttp: b248/782 bl:2.4555 bb:1.1851 rl:2.3084 rb:1.0517 dl:351-352 gd:1 +ttp: b242/782 bl:2.3759 bb:1.0998 rl:2.3086 rb:1.0518 dl:344-345 gd:1 +ttp: b235/782 bl:2.2831 bb:1.0992 rl:2.3085 rb:1.0520 dl:335-336 gd:1 +ttp: b228/782 bl:2.3264 bb:1.0831 rl:2.3086 rb:1.0521 dl:327-328 gd:1 +ttp: b221/782 bl:2.3992 bb:1.1180 rl:2.3089 rb:1.0524 dl:318-320 gd:1 +ttp: b214/782 bl:2.3305 bb:1.1152 rl:2.3090 rb:1.0526 dl:310-312 gd:1 +ttp: b207/782 bl:2.3480 bb:1.1284 rl:2.3091 rb:1.0528 dl:303-304 gd:1 +ttp: b200/782 bl:2.3594 bb:1.0909 rl:2.3093 rb:1.0529 dl:296-297 gd:1 +ttp: b192/782 bl:2.3703 bb:1.1511 rl:2.3095 rb:1.0532 dl:286-288 gd:1 +ttp: b185/782 bl:2.4299 bb:1.1141 rl:2.3099 rb:1.0534 dl:279-280 gd:1 +ttp: b178/782 bl:2.3388 bb:1.0941 rl:2.3099 rb:1.0535 dl:272-273 gd:1 +ttp: b171/782 bl:2.4659 bb:1.1371 rl:2.3104 rb:1.0538 dl:266-266 gd:1 +ttp: b165/782 bl:2.3487 bb:1.1154 rl:2.3105 rb:1.0539 dl:260-260 gd:1 +ttp: b157/782 bl:2.3622 bb:1.1314 rl:2.3106 rb:1.0541 dl:252-253 gd:1 +ttp: b150/782 bl:2.3186 bb:1.1009 rl:2.3107 rb:1.0542 dl:245-246 gd:1 +ttp: b145/782 bl:2.5246 bb:1.1670 rl:2.3112 rb:1.0545 dl:240-241 gd:1 +ttp: b139/782 bl:2.4272 bb:1.1307 rl:2.3115 rb:1.0547 dl:234-235 gd:1 +ttp: b131/782 bl:2.3944 bb:1.1561 rl:2.3117 rb:1.0550 dl:227-228 gd:1 +ttp: b124/782 bl:2.3777 bb:1.1615 rl:2.3119 rb:1.0552 dl:220-222 gd:1 +ttp: b118/782 bl:2.4564 bb:1.1212 rl:2.3122 rb:1.0553 dl:215-216 gd:1 +ttp: b112/782 bl:2.4770 bb:1.1823 rl:2.3126 rb:1.0556 dl:210-210 gd:1 +ttp: b104/782 bl:2.4873 bb:1.1742 rl:2.3129 rb:1.0559 dl:202-203 gd:1 +ttp: b97/782 bl:2.4535 bb:1.1613 rl:2.3132 rb:1.0561 dl:196-197 gd:1 +ttp: b89/782 bl:2.4903 bb:1.1507 rl:2.3136 rb:1.0562 dl:189-190 gd:1 +ttp: b83/782 bl:2.4174 bb:1.1408 rl:2.3138 rb:1.0564 dl:183-184 gd:1 +ttp: b76/782 bl:2.4938 bb:1.1713 rl:2.3141 rb:1.0566 dl:177-178 gd:1 +ttp: b68/782 bl:2.5067 bb:1.1699 rl:2.3145 rb:1.0568 dl:170-171 gd:1 +ttp: b60/782 bl:2.4620 bb:1.1833 rl:2.3147 rb:1.0570 dl:163-164 gd:1 +ttp: b52/782 bl:2.6676 bb:1.2452 rl:2.3153 rb:1.0573 dl:155-156 gd:1 +ttp: b45/782 bl:2.4579 bb:1.1761 rl:2.3155 rb:1.0575 dl:148-149 gd:1 +ttp: b37/782 bl:2.5579 bb:1.2056 rl:2.3159 rb:1.0577 dl:140-141 gd:1 +ttp: b29/782 bl:2.6402 bb:1.2213 rl:2.3163 rb:1.0579 dl:132-133 gd:1 +ttp: b21/782 bl:2.6102 bb:1.2313 rl:2.3167 rb:1.0581 dl:123-124 gd:1 +ttp: b13/782 bl:2.6774 bb:1.2130 rl:2.3171 rb:1.0583 dl:112-114 gd:1 +ttp: b5/782 bl:2.6948 bb:1.2261 rl:2.3175 rb:1.0585 dl:96-99 gd:1 +quantized_ttt_phased val_loss:2.31530893 val_bpb:1.05800583 eval_time:429672ms +total_eval_time:429.7s diff --git a/records/track_10min_16mb/2026-05-01_PR2101_3Seed_Support/ablation_ttt_local_lr_085_seed42.log b/records/track_10min_16mb/2026-05-01_PR2101_3Seed_Support/ablation_ttt_local_lr_085_seed42.log new file mode 100644 index 0000000000..b4abfc4759 --- /dev/null +++ b/records/track_10min_16mb/2026-05-01_PR2101_3Seed_Support/ablation_ttt_local_lr_085_seed42.log @@ -0,0 +1,944 @@ +W0501 09:03:58.792000 1204779 torch/distributed/run.py:803] +W0501 09:03:58.792000 1204779 torch/distributed/run.py:803] ***************************************** +W0501 09:03:58.792000 1204779 torch/distributed/run.py:803] Setting OMP_NUM_THREADS environment variable for each process to be 1 in default, to avoid your system being overloaded, please further tune the variable for optimal performance in your application as needed. +W0501 09:03:58.792000 1204779 torch/distributed/run.py:803] ***************************************** +Hyperparameters: + adam_eps: 1e-08 + adam_wd: 0.02 + artifact_dir: + attn_clip_sigmas: 13.0 + attn_out_gate_enabled: False + attn_out_gate_src: proj + awq_lite_bits: 8 + awq_lite_enabled: True + awq_lite_group_size: 64 + awq_lite_group_top_k: 1 + beta1: 0.9 + beta2: 0.99 + caseops_enabled: True + compressor: pergroup + data_dir: ./data + datasets_dir: ./data/datasets/fineweb10B_sp8192_lossless_caps_caseops_v1_reserved + distributed: True + ema_decay: 0.9965 + embed_bits: 7 + embed_clip_sigmas: 14.0 + embed_lr: 0.6 + embed_wd: 0.085 + enable_looping_at: 0.35 + eval_seq_len: 2560 + eval_stride: 64 + fused_ce_enabled: True + gate_window: 12 + gated_attn_enabled: False + gated_attn_init_std: 0.01 + gated_attn_quant_gate: True + global_ttt_batch_seqs: 32 + global_ttt_chunk_tokens: 32768 + global_ttt_epochs: 1 + global_ttt_grad_clip: 1.0 + global_ttt_lr: 0.001 + global_ttt_momentum: 0.9 + global_ttt_respect_doc_boundaries: True + global_ttt_warmup_chunks: 0 + global_ttt_warmup_start_lr: 0.0 + gptq_calibration_batches: 16 + gptq_reserve_seconds: 8.0 + grad_accum_steps: 1 + grad_centralize: False + grad_clip_norm: 0.3 + is_main_process: True + iterations: 20000 + label_smooth: 0.0 + ln_scale: True + local_rank: 0 + logfile: logs/bcf9831c-e105-48a5-9094-044208a39411.txt + logit_softcap: 30.0 + loop_end: 5 + loop_start: 3 + lqer_asym_enabled: True + lqer_asym_group: 64 + lqer_enabled: True + lqer_factor_bits: 4 + lqer_gain_select: False + lqer_rank: 4 + lqer_scope: all + lqer_top_k: 3 + matrix_bits: 6 + matrix_clip_sigmas: 12.85 + matrix_lr: 0.026 + max_wallclock_seconds: 600.0 + min_lr: 0.1 + mlp_clip_sigmas: 11.5 + mlp_mult: 4.0 + model_dim: 512 + model_path: final_model.pt + muon_backend_steps: 5 + muon_momentum: 0.97 + muon_momentum_warmup_start: 0.92 + muon_momentum_warmup_steps: 1500 + muon_row_normalize: True + muon_wd: 0.095 + num_heads: 8 + num_kv_heads: 4 + num_layers: 11 + num_loops: 2 + parallel_final_lane: mean + parallel_start_layer: 8 + phased_ttt_num_phases: 3 + phased_ttt_prefix_docs: 2500 + qk_gain_init: 5.25 + quantized_model_path: final_model.int6.ptz + rank: 0 + rope_base: 10000.0 + rope_dims: 16 + rope_train_seq_len: 2048 + rope_yarn: False + run_id: bcf9831c-e105-48a5-9094-044208a39411 + scalar_lr: 0.02 + seed: 42 + skip_gates_enabled: True + smear_gate_enabled: True + sparse_attn_gate_enabled: True + sparse_attn_gate_init_std: 0.0 + sparse_attn_gate_scale: 0.5 + tie_embeddings: True + tied_embed_init_std: 0.005 + tied_embed_lr: 0.03 + tokenizer_path: ./tokenizers/fineweb_8192_bpe_lossless_caps_caseops_v1_reserved.model + train_batch_tokens: 786432 + train_files: ./data/datasets/fineweb10B_sp8192_lossless_caps_caseops_v1_reserved/fineweb_train_*.bin + train_log_every: 500 + train_seq_len: 2048 + ttt_batch_size: 64 + ttt_beta1: 0.0 + ttt_beta2: 0.99 + ttt_chunk_size: 48 + ttt_enabled: True + ttt_eval_batches: + ttt_eval_seq_len: 2560 + ttt_grad_steps: 1 + ttt_k_lora: True + ttt_local_lr_mult: 0.85 + ttt_lora_lr: 0.0001 + ttt_lora_rank: 80 + ttt_mask: no_qv + ttt_mlp_lora: True + ttt_o_lora: True + ttt_optimizer: adam + ttt_q_lora: False + ttt_v_lora: False + ttt_weight_decay: 0.5 + val_batch_tokens: 524288 + val_bytes_files: ./data/datasets/fineweb10B_sp8192_lossless_caps_caseops_v1_reserved/fineweb_val_bytes_*.bin + val_doc_fraction: 1.0 + val_files: ./data/datasets/fineweb10B_sp8192_lossless_caps_caseops_v1_reserved/fineweb_val_*.bin + val_loss_every: 0 + vocab_size: 8192 + warmdown_frac: 0.85 + warmup_steps: 20 + world_size: 8 + xsa_last_n: 11 +train_shards: 80 +val_tokens: 47851520 +model_params:35945673 +gptq:reserving 8s, effective=592000ms +warmup_cu_buckets:64,128,192,256 iters_each:3 +warmup_step: 1/20 +warmup_step: 2/20 +warmup_step: 3/20 +warmup_step: 4/20 +warmup_step: 5/20 +warmup_step: 6/20 +warmup_step: 10/20 +warmup_step: 20/20 +loop_warmup:enabled encoder:[0, 1, 2, 3, 4, 5, 3, 4] decoder:[5, 3, 4, 5, 6, 7, 8, 9, 10] +loop_warmup_step: 1/20 +loop_warmup_step: 2/20 +loop_warmup_step: 3/20 +loop_warmup_step: 4/20 +loop_warmup_step: 5/20 +loop_warmup_step: 6/20 +loop_warmup_step: 10/20 +loop_warmup_step: 20/20 +1/20000 train_loss: 9.0087 train_time: 0.0m tok/s: 17383322 +2/20000 train_loss: 12.8294 train_time: 0.0m tok/s: 11003709 +3/20000 train_loss: 10.2089 train_time: 0.0m tok/s: 10064808 +4/20000 train_loss: 8.6850 train_time: 0.0m tok/s: 9588217 +5/20000 train_loss: 7.9417 train_time: 0.0m tok/s: 9291577 +500/20000 train_loss: 2.5639 train_time: 0.8m tok/s: 8162953 +1000/20000 train_loss: 2.7959 train_time: 1.6m tok/s: 8120088 +1500/20000 train_loss: 2.6181 train_time: 2.4m tok/s: 8104463 +2000/20000 train_loss: 2.6506 train_time: 3.2m tok/s: 8101441 +layer_loop:enabled step:2135 frac:0.350 encoder:[0, 1, 2, 3, 4, 5, 3, 4] decoder:[5, 3, 4, 5, 6, 7, 8, 9, 10] +2500/20000 train_loss: 2.5405 train_time: 4.3m tok/s: 7591213 +3000/20000 train_loss: 2.5476 train_time: 5.5m tok/s: 7156824 +3500/20000 train_loss: 2.5560 train_time: 6.7m tok/s: 6874952 +4000/20000 train_loss: 2.3993 train_time: 7.9m tok/s: 6678649 +4500/20000 train_loss: 2.2674 train_time: 9.0m tok/s: 6533799 +4857/20000 val_loss: 2.3493 val_bpb: 1.0735 +stopping_early: wallclock_cap train_time: 592095ms step: 4857/20000 +peak memory allocated: 41707 MiB reserved: 46952 MiB +ema:applying EMA weights +diagnostic pre-quantization post-ema val_loss:2.32402973 val_bpb:1.06189835 eval_time:9651ms +Serialized model: 135418111 bytes +Code size (uncompressed): 172613 bytes +Code size (compressed): 34386 bytes +GPTQ:collecting Hessians from calibration data... +GPTQ:collected 67 Hessians in 4.1s +Quantized weights: + gate_int8_row: blocks.attn.attn_gate_w + gptq (int6): blocks.attn.c_k.weight, blocks.attn.c_q.weight, blocks.attn.c_v.weight, blocks.attn.proj.weight, blocks.mlp.fc.weight, blocks.mlp.proj.weight + gptq (int6)+lqer_asym: blocks.mlp.fc.weight + gptq (int7)+awqgrpint8+lqer_asym: tok_emb.weight + passthrough (float16): blocks.attn.q_gain, blocks.attn_scale, blocks.mlp_scale, blocks.resid_mix, parallel_post_lambdas, parallel_resid_lambdas, skip_gates, skip_weights, smear_gate.weight, smear_lambda, softcap_neg, softcap_pos +Serialize: per-group lrzip compression... +Serialize: per-group compression done in 118.9s +Serialized model quantized+pergroup: 15946349 bytes +Total submission size quantized+pergroup: 15980735 bytes +Deserialize: per-group lrzip decompression... +Deserialize: decompression done in 21.0s +diagnostic quantized val_loss:2.34240975 val_bpb:1.07029656 eval_time:13027ms +Deserialize: per-group lrzip decompression... +Deserialize: decompression done in 21.0s +ttt_lora:warming up compile (random tokens, no val data) +ttt_lora:compile warmup done (91.2s) + +beginning TTT eval timer +ttt_phased: total_docs:50000 prefix_docs:2500 suffix_docs:47500 num_phases:3 boundaries:[833, 1666, 2500] +ttp: b782/782 bl:2.1378 bb:1.0123 rl:2.1378 rb:1.0123 dl:30339-97114 gd:0 +ttpp: phase:1/3 pd:1296 gd:833 t:188.5s +tttg: c1/131 lr:0.001000 t:0.3s +tttg: c2/131 lr:0.001000 t:0.4s +tttg: c3/131 lr:0.000999 t:0.5s +tttg: c4/131 lr:0.000999 t:0.6s +tttg: c5/131 lr:0.000998 t:0.6s +tttg: c6/131 lr:0.000996 t:0.7s +tttg: c7/131 lr:0.000995 t:0.8s +tttg: c8/131 lr:0.000993 t:0.9s +tttg: c9/131 lr:0.000991 t:0.9s +tttg: c10/131 lr:0.000988 t:1.0s +tttg: c11/131 lr:0.000985 t:1.1s +tttg: c12/131 lr:0.000982 t:1.2s +tttg: c13/131 lr:0.000979 t:1.3s +tttg: c14/131 lr:0.000976 t:1.3s +tttg: c15/131 lr:0.000972 t:1.4s +tttg: c16/131 lr:0.000968 t:1.5s +tttg: c17/131 lr:0.000963 t:1.6s +tttg: c18/131 lr:0.000958 t:1.6s +tttg: c19/131 lr:0.000953 t:1.7s +tttg: c20/131 lr:0.000948 t:1.8s +tttg: c21/131 lr:0.000943 t:1.9s +tttg: c22/131 lr:0.000937 t:2.0s +tttg: c23/131 lr:0.000931 t:2.0s +tttg: c24/131 lr:0.000925 t:2.1s +tttg: c25/131 lr:0.000918 t:2.2s +tttg: c26/131 lr:0.000911 t:2.3s +tttg: c27/131 lr:0.000905 t:2.3s +tttg: c28/131 lr:0.000897 t:2.4s +tttg: c29/131 lr:0.000890 t:2.5s +tttg: c30/131 lr:0.000882 t:2.6s +tttg: c31/131 lr:0.000874 t:2.7s +tttg: c32/131 lr:0.000866 t:2.7s +tttg: c33/131 lr:0.000858 t:2.8s +tttg: c34/131 lr:0.000849 t:2.9s +tttg: c35/131 lr:0.000841 t:3.0s +tttg: c36/131 lr:0.000832 t:3.0s +tttg: c37/131 lr:0.000822 t:3.1s +tttg: c38/131 lr:0.000813 t:3.2s +tttg: c39/131 lr:0.000804 t:3.3s +tttg: c40/131 lr:0.000794 t:3.4s +tttg: c41/131 lr:0.000784 t:3.4s +tttg: c42/131 lr:0.000774 t:3.5s +tttg: c43/131 lr:0.000764 t:3.6s +tttg: c44/131 lr:0.000753 t:3.7s +tttg: c45/131 lr:0.000743 t:3.7s +tttg: c46/131 lr:0.000732 t:3.8s +tttg: c47/131 lr:0.000722 t:3.9s +tttg: c48/131 lr:0.000711 t:4.0s +tttg: c49/131 lr:0.000700 t:4.1s +tttg: c50/131 lr:0.000689 t:4.1s +tttg: c51/131 lr:0.000677 t:4.2s +tttg: c52/131 lr:0.000666 t:4.3s +tttg: c53/131 lr:0.000655 t:4.4s +tttg: c54/131 lr:0.000643 t:4.4s +tttg: c55/131 lr:0.000631 t:4.5s +tttg: c56/131 lr:0.000620 t:4.6s +tttg: c57/131 lr:0.000608 t:4.7s +tttg: c58/131 lr:0.000596 t:4.7s +tttg: c59/131 lr:0.000584 t:4.8s +tttg: c60/131 lr:0.000572 t:4.9s +tttg: c61/131 lr:0.000560 t:5.0s +tttg: c62/131 lr:0.000548 t:5.1s +tttg: c63/131 lr:0.000536 t:5.1s +tttg: c64/131 lr:0.000524 t:5.2s +tttg: c65/131 lr:0.000512 t:5.3s +tttg: c66/131 lr:0.000500 t:5.4s +tttg: c67/131 lr:0.000488 t:5.4s +tttg: c68/131 lr:0.000476 t:5.5s +tttg: c69/131 lr:0.000464 t:5.6s +tttg: c70/131 lr:0.000452 t:5.7s +tttg: c71/131 lr:0.000440 t:5.7s +tttg: c72/131 lr:0.000428 t:5.8s +tttg: c73/131 lr:0.000416 t:5.9s +tttg: c74/131 lr:0.000404 t:6.0s +tttg: c75/131 lr:0.000392 t:6.1s +tttg: c76/131 lr:0.000380 t:6.1s +tttg: c77/131 lr:0.000369 t:6.2s +tttg: c78/131 lr:0.000357 t:6.3s +tttg: c79/131 lr:0.000345 t:6.4s +tttg: c80/131 lr:0.000334 t:6.4s +tttg: c81/131 lr:0.000323 t:6.5s +tttg: c82/131 lr:0.000311 t:6.6s +tttg: c83/131 lr:0.000300 t:6.7s +tttg: c84/131 lr:0.000289 t:6.8s +tttg: c85/131 lr:0.000278 t:6.8s +tttg: c86/131 lr:0.000268 t:6.9s +tttg: c87/131 lr:0.000257 t:7.0s +tttg: c88/131 lr:0.000247 t:7.1s +tttg: c89/131 lr:0.000236 t:7.1s +tttg: c90/131 lr:0.000226 t:7.2s +tttg: c91/131 lr:0.000216 t:7.3s +tttg: c92/131 lr:0.000206 t:7.4s +tttg: c93/131 lr:0.000196 t:7.4s +tttg: c94/131 lr:0.000187 t:7.5s +tttg: c95/131 lr:0.000178 t:7.6s +tttg: c96/131 lr:0.000168 t:7.7s +tttg: c97/131 lr:0.000159 t:7.8s +tttg: c98/131 lr:0.000151 t:7.8s +tttg: c99/131 lr:0.000142 t:7.9s +tttg: c100/131 lr:0.000134 t:8.0s +tttg: c101/131 lr:0.000126 t:8.1s +tttg: c102/131 lr:0.000118 t:8.1s +tttg: c103/131 lr:0.000110 t:8.2s +tttg: c104/131 lr:0.000103 t:8.3s +tttg: c105/131 lr:0.000095 t:8.4s +tttg: c106/131 lr:0.000089 t:8.5s +tttg: c107/131 lr:0.000082 t:8.5s +tttg: c108/131 lr:0.000075 t:8.6s +tttg: c109/131 lr:0.000069 t:8.7s +tttg: c110/131 lr:0.000063 t:8.8s +tttg: c111/131 lr:0.000057 t:8.8s +tttg: c112/131 lr:0.000052 t:8.9s +tttg: c113/131 lr:0.000047 t:9.0s +tttg: c114/131 lr:0.000042 t:9.1s +tttg: c115/131 lr:0.000037 t:9.2s +tttg: c116/131 lr:0.000032 t:9.2s +tttg: c117/131 lr:0.000028 t:9.3s +tttg: c118/131 lr:0.000024 t:9.4s +tttg: c119/131 lr:0.000021 t:9.5s +tttg: c120/131 lr:0.000018 t:9.5s +tttg: c121/131 lr:0.000015 t:9.6s +tttg: c122/131 lr:0.000012 t:9.7s +tttg: c123/131 lr:0.000009 t:9.8s +tttg: c124/131 lr:0.000007 t:9.9s +tttg: c125/131 lr:0.000005 t:9.9s +tttg: c126/131 lr:0.000004 t:10.0s +tttg: c127/131 lr:0.000002 t:10.1s +tttg: c128/131 lr:0.000001 t:10.2s +tttg: c129/131 lr:0.000001 t:10.2s +tttg: c130/131 lr:0.000000 t:10.3s +ttpr: phase:1/3 t:199.9s +ttp: b761/782 bl:2.4074 bb:1.1099 rl:2.2036 rb:1.0366 dl:3916-4032 gd:0 +ttpp: phase:2/3 pd:2128 gd:1666 t:259.0s +tttg: c1/219 lr:0.001000 t:0.1s +tttg: c2/219 lr:0.001000 t:0.2s +tttg: c3/219 lr:0.001000 t:0.2s +tttg: c4/219 lr:0.001000 t:0.3s +tttg: c5/219 lr:0.000999 t:0.4s +tttg: c6/219 lr:0.000999 t:0.5s +tttg: c7/219 lr:0.000998 t:0.5s +tttg: c8/219 lr:0.000997 t:0.6s +tttg: c9/219 lr:0.000997 t:0.7s +tttg: c10/219 lr:0.000996 t:0.8s +tttg: c11/219 lr:0.000995 t:0.9s +tttg: c12/219 lr:0.000994 t:0.9s +tttg: c13/219 lr:0.000993 t:1.0s +tttg: c14/219 lr:0.000991 t:1.1s +tttg: c15/219 lr:0.000990 t:2.4s +tttg: c16/219 lr:0.000988 t:2.5s +tttg: c17/219 lr:0.000987 t:2.6s +tttg: c18/219 lr:0.000985 t:2.7s +tttg: c19/219 lr:0.000983 t:2.7s +tttg: c20/219 lr:0.000981 t:2.8s +tttg: c21/219 lr:0.000979 t:2.9s +tttg: c22/219 lr:0.000977 t:3.0s +tttg: c23/219 lr:0.000975 t:3.1s +tttg: c24/219 lr:0.000973 t:3.1s +tttg: c25/219 lr:0.000970 t:3.2s +tttg: c26/219 lr:0.000968 t:3.3s +tttg: c27/219 lr:0.000965 t:3.4s +tttg: c28/219 lr:0.000963 t:3.4s +tttg: c29/219 lr:0.000960 t:3.5s +tttg: c30/219 lr:0.000957 t:3.6s +tttg: c31/219 lr:0.000954 t:3.7s +tttg: c32/219 lr:0.000951 t:3.8s +tttg: c33/219 lr:0.000948 t:3.8s +tttg: c34/219 lr:0.000945 t:3.9s +tttg: c35/219 lr:0.000941 t:4.0s +tttg: c36/219 lr:0.000938 t:4.1s +tttg: c37/219 lr:0.000934 t:4.2s +tttg: c38/219 lr:0.000931 t:4.2s +tttg: c39/219 lr:0.000927 t:4.3s +tttg: c40/219 lr:0.000923 t:4.4s +tttg: c41/219 lr:0.000919 t:4.5s +tttg: c42/219 lr:0.000915 t:4.6s +tttg: c43/219 lr:0.000911 t:4.6s +tttg: c44/219 lr:0.000907 t:4.7s +tttg: c45/219 lr:0.000903 t:4.8s +tttg: c46/219 lr:0.000898 t:4.9s +tttg: c47/219 lr:0.000894 t:4.9s +tttg: c48/219 lr:0.000890 t:5.0s +tttg: c49/219 lr:0.000885 t:5.1s +tttg: c50/219 lr:0.000880 t:5.2s +tttg: c51/219 lr:0.000876 t:5.2s +tttg: c52/219 lr:0.000871 t:5.3s +tttg: c53/219 lr:0.000866 t:5.4s +tttg: c54/219 lr:0.000861 t:5.5s +tttg: c55/219 lr:0.000856 t:5.5s +tttg: c56/219 lr:0.000851 t:5.6s +tttg: c57/219 lr:0.000846 t:5.7s +tttg: c58/219 lr:0.000841 t:5.8s +tttg: c59/219 lr:0.000835 t:5.9s +tttg: c60/219 lr:0.000830 t:5.9s +tttg: c61/219 lr:0.000824 t:6.0s +tttg: c62/219 lr:0.000819 t:6.1s +tttg: c63/219 lr:0.000813 t:6.2s +tttg: c64/219 lr:0.000808 t:6.3s +tttg: c65/219 lr:0.000802 t:6.3s +tttg: c66/219 lr:0.000796 t:6.4s +tttg: c67/219 lr:0.000790 t:6.5s +tttg: c68/219 lr:0.000784 t:6.6s +tttg: c69/219 lr:0.000779 t:6.6s +tttg: c70/219 lr:0.000773 t:6.7s +tttg: c71/219 lr:0.000766 t:6.8s +tttg: c72/219 lr:0.000760 t:6.9s +tttg: c73/219 lr:0.000754 t:7.0s +tttg: c74/219 lr:0.000748 t:7.0s +tttg: c75/219 lr:0.000742 t:7.1s +tttg: c76/219 lr:0.000735 t:7.2s +tttg: c77/219 lr:0.000729 t:7.3s +tttg: c78/219 lr:0.000722 t:7.3s +tttg: c79/219 lr:0.000716 t:7.4s +tttg: c80/219 lr:0.000709 t:7.5s +tttg: c81/219 lr:0.000703 t:7.6s +tttg: c82/219 lr:0.000696 t:7.7s +tttg: c83/219 lr:0.000690 t:7.7s +tttg: c84/219 lr:0.000683 t:7.8s +tttg: c85/219 lr:0.000676 t:7.9s +tttg: c86/219 lr:0.000670 t:8.0s +tttg: c87/219 lr:0.000663 t:8.0s +tttg: c88/219 lr:0.000656 t:8.1s +tttg: c89/219 lr:0.000649 t:8.2s +tttg: c90/219 lr:0.000642 t:8.3s +tttg: c91/219 lr:0.000635 t:8.4s +tttg: c92/219 lr:0.000628 t:8.4s +tttg: c93/219 lr:0.000621 t:8.5s +tttg: c94/219 lr:0.000614 t:8.6s +tttg: c95/219 lr:0.000607 t:8.7s +tttg: c96/219 lr:0.000600 t:8.8s +tttg: c97/219 lr:0.000593 t:8.8s +tttg: c98/219 lr:0.000586 t:8.9s +tttg: c99/219 lr:0.000579 t:9.0s +tttg: c100/219 lr:0.000572 t:9.1s +tttg: c101/219 lr:0.000565 t:9.1s +tttg: c102/219 lr:0.000558 t:9.2s +tttg: c103/219 lr:0.000550 t:9.3s +tttg: c104/219 lr:0.000543 t:9.4s +tttg: c105/219 lr:0.000536 t:9.4s +tttg: c106/219 lr:0.000529 t:9.5s +tttg: c107/219 lr:0.000522 t:9.6s +tttg: c108/219 lr:0.000514 t:9.7s +tttg: c109/219 lr:0.000507 t:9.8s +tttg: c110/219 lr:0.000500 t:9.8s +tttg: c111/219 lr:0.000493 t:9.9s +tttg: c112/219 lr:0.000486 t:10.0s +tttg: c113/219 lr:0.000478 t:10.1s +tttg: c114/219 lr:0.000471 t:10.2s +tttg: c115/219 lr:0.000464 t:10.2s +tttg: c116/219 lr:0.000457 t:10.3s +tttg: c117/219 lr:0.000450 t:10.4s +tttg: c118/219 lr:0.000442 t:10.5s +tttg: c119/219 lr:0.000435 t:10.6s +tttg: c120/219 lr:0.000428 t:10.6s +tttg: c121/219 lr:0.000421 t:10.7s +tttg: c122/219 lr:0.000414 t:10.8s +tttg: c123/219 lr:0.000407 t:10.9s +tttg: c124/219 lr:0.000400 t:10.9s +tttg: c125/219 lr:0.000393 t:11.0s +tttg: c126/219 lr:0.000386 t:11.1s +tttg: c127/219 lr:0.000379 t:11.2s +tttg: c128/219 lr:0.000372 t:11.2s +tttg: c129/219 lr:0.000365 t:11.3s +tttg: c130/219 lr:0.000358 t:11.4s +tttg: c131/219 lr:0.000351 t:11.5s +tttg: c132/219 lr:0.000344 t:11.6s +tttg: c133/219 lr:0.000337 t:11.6s +tttg: c134/219 lr:0.000330 t:11.7s +tttg: c135/219 lr:0.000324 t:11.8s +tttg: c136/219 lr:0.000317 t:11.9s +tttg: c137/219 lr:0.000310 t:12.0s +tttg: c138/219 lr:0.000304 t:12.0s +tttg: c139/219 lr:0.000297 t:12.1s +tttg: c140/219 lr:0.000291 t:12.2s +tttg: c141/219 lr:0.000284 t:12.3s +tttg: c142/219 lr:0.000278 t:12.3s +tttg: c143/219 lr:0.000271 t:12.4s +tttg: c144/219 lr:0.000265 t:12.5s +tttg: c145/219 lr:0.000258 t:12.6s +tttg: c146/219 lr:0.000252 t:12.6s +tttg: c147/219 lr:0.000246 t:12.7s +tttg: c148/219 lr:0.000240 t:12.8s +tttg: c149/219 lr:0.000234 t:12.9s +tttg: c150/219 lr:0.000227 t:13.0s +tttg: c151/219 lr:0.000221 t:13.0s +tttg: c152/219 lr:0.000216 t:13.1s +tttg: c153/219 lr:0.000210 t:13.2s +tttg: c154/219 lr:0.000204 t:13.3s +tttg: c155/219 lr:0.000198 t:13.3s +tttg: c156/219 lr:0.000192 t:13.4s +tttg: c157/219 lr:0.000187 t:13.5s +tttg: c158/219 lr:0.000181 t:13.6s +tttg: c159/219 lr:0.000176 t:13.6s +tttg: c160/219 lr:0.000170 t:13.7s +tttg: c161/219 lr:0.000165 t:13.8s +tttg: c162/219 lr:0.000159 t:13.9s +tttg: c163/219 lr:0.000154 t:14.0s +tttg: c164/219 lr:0.000149 t:14.0s +tttg: c165/219 lr:0.000144 t:14.1s +tttg: c166/219 lr:0.000139 t:14.2s +tttg: c167/219 lr:0.000134 t:14.3s +tttg: c168/219 lr:0.000129 t:14.3s +tttg: c169/219 lr:0.000124 t:14.4s +tttg: c170/219 lr:0.000120 t:14.5s +tttg: c171/219 lr:0.000115 t:14.6s +tttg: c172/219 lr:0.000110 t:14.6s +tttg: c173/219 lr:0.000106 t:14.7s +tttg: c174/219 lr:0.000102 t:14.8s +tttg: c175/219 lr:0.000097 t:14.9s +tttg: c176/219 lr:0.000093 t:15.0s +tttg: c177/219 lr:0.000089 t:15.0s +tttg: c178/219 lr:0.000085 t:15.1s +tttg: c179/219 lr:0.000081 t:15.2s +tttg: c180/219 lr:0.000077 t:15.3s +tttg: c181/219 lr:0.000073 t:15.3s +tttg: c182/219 lr:0.000069 t:15.4s +tttg: c183/219 lr:0.000066 t:15.5s +tttg: c184/219 lr:0.000062 t:15.6s +tttg: c185/219 lr:0.000059 t:15.7s +tttg: c186/219 lr:0.000055 t:15.7s +tttg: c187/219 lr:0.000052 t:15.8s +tttg: c188/219 lr:0.000049 t:15.9s +tttg: c189/219 lr:0.000046 t:16.0s +tttg: c190/219 lr:0.000043 t:16.0s +tttg: c191/219 lr:0.000040 t:16.1s +tttg: c192/219 lr:0.000037 t:16.2s +tttg: c193/219 lr:0.000035 t:16.3s +tttg: c194/219 lr:0.000032 t:16.4s +tttg: c195/219 lr:0.000030 t:16.4s +tttg: c196/219 lr:0.000027 t:16.5s +tttg: c197/219 lr:0.000025 t:16.6s +tttg: c198/219 lr:0.000023 t:16.7s +tttg: c199/219 lr:0.000021 t:16.8s +tttg: c200/219 lr:0.000019 t:16.8s +tttg: c201/219 lr:0.000017 t:16.9s +tttg: c202/219 lr:0.000015 t:17.0s +tttg: c203/219 lr:0.000013 t:17.1s +tttg: c204/219 lr:0.000012 t:17.1s +tttg: c205/219 lr:0.000010 t:17.2s +tttg: c206/219 lr:0.000009 t:17.3s +tttg: c207/219 lr:0.000007 t:17.4s +tttg: c208/219 lr:0.000006 t:17.5s +tttg: c209/219 lr:0.000005 t:17.5s +tttg: c210/219 lr:0.000004 t:17.6s +tttg: c211/219 lr:0.000003 t:17.7s +tttg: c212/219 lr:0.000003 t:17.8s +tttg: c213/219 lr:0.000002 t:17.8s +tttg: c214/219 lr:0.000001 t:17.9s +tttg: c215/219 lr:0.000001 t:18.0s +tttg: c216/219 lr:0.000000 t:18.1s +tttg: c217/219 lr:0.000000 t:18.2s +tttg: c218/219 lr:0.000000 t:18.2s +ttpr: phase:2/3 t:278.3s +ttp: b748/782 bl:2.3138 bb:1.0798 rl:2.2209 rb:1.0434 dl:2992-3039 gd:0 +ttpp: phase:3/3 pd:2960 gd:2500 t:294.0s +tttg: c1/289 lr:0.001000 t:0.1s +tttg: c2/289 lr:0.001000 t:0.2s +tttg: c3/289 lr:0.001000 t:0.2s +tttg: c4/289 lr:0.001000 t:0.3s +tttg: c5/289 lr:0.001000 t:0.4s +tttg: c6/289 lr:0.000999 t:0.5s +tttg: c7/289 lr:0.000999 t:0.5s +tttg: c8/289 lr:0.000999 t:0.6s +tttg: c9/289 lr:0.000998 t:0.7s +tttg: c10/289 lr:0.000998 t:0.8s +tttg: c11/289 lr:0.000997 t:0.8s +tttg: c12/289 lr:0.000996 t:0.9s +tttg: c13/289 lr:0.000996 t:1.0s +tttg: c14/289 lr:0.000995 t:1.1s +tttg: c15/289 lr:0.000994 t:1.2s +tttg: c16/289 lr:0.000993 t:1.2s +tttg: c17/289 lr:0.000992 t:1.3s +tttg: c18/289 lr:0.000991 t:1.4s +tttg: c19/289 lr:0.000990 t:1.5s +tttg: c20/289 lr:0.000989 t:1.5s +tttg: c21/289 lr:0.000988 t:1.6s +tttg: c22/289 lr:0.000987 t:1.7s +tttg: c23/289 lr:0.000986 t:1.8s +tttg: c24/289 lr:0.000984 t:1.9s +tttg: c25/289 lr:0.000983 t:1.9s +tttg: c26/289 lr:0.000982 t:2.0s +tttg: c27/289 lr:0.000980 t:2.1s +tttg: c28/289 lr:0.000978 t:2.2s +tttg: c29/289 lr:0.000977 t:2.3s +tttg: c30/289 lr:0.000975 t:2.3s +tttg: c31/289 lr:0.000973 t:2.4s +tttg: c32/289 lr:0.000972 t:2.5s +tttg: c33/289 lr:0.000970 t:2.6s +tttg: c34/289 lr:0.000968 t:2.6s +tttg: c35/289 lr:0.000966 t:2.7s +tttg: c36/289 lr:0.000964 t:2.8s +tttg: c37/289 lr:0.000962 t:2.9s +tttg: c38/289 lr:0.000960 t:2.9s +tttg: c39/289 lr:0.000958 t:3.0s +tttg: c40/289 lr:0.000955 t:3.1s +tttg: c41/289 lr:0.000953 t:3.2s +tttg: c42/289 lr:0.000951 t:3.3s +tttg: c43/289 lr:0.000948 t:3.3s +tttg: c44/289 lr:0.000946 t:3.4s +tttg: c45/289 lr:0.000944 t:3.5s +tttg: c46/289 lr:0.000941 t:3.6s +tttg: c47/289 lr:0.000938 t:3.6s +tttg: c48/289 lr:0.000936 t:3.7s +tttg: c49/289 lr:0.000933 t:3.8s +tttg: c50/289 lr:0.000930 t:3.9s +tttg: c51/289 lr:0.000927 t:4.0s +tttg: c52/289 lr:0.000925 t:4.0s +tttg: c53/289 lr:0.000922 t:4.1s +tttg: c54/289 lr:0.000919 t:4.2s +tttg: c55/289 lr:0.000916 t:4.3s +tttg: c56/289 lr:0.000913 t:4.3s +tttg: c57/289 lr:0.000910 t:4.4s +tttg: c58/289 lr:0.000906 t:4.5s +tttg: c59/289 lr:0.000903 t:4.6s +tttg: c60/289 lr:0.000900 t:4.6s +tttg: c61/289 lr:0.000897 t:4.7s +tttg: c62/289 lr:0.000893 t:4.8s +tttg: c63/289 lr:0.000890 t:4.9s +tttg: c64/289 lr:0.000887 t:4.9s +tttg: c65/289 lr:0.000883 t:5.0s +tttg: c66/289 lr:0.000879 t:5.1s +tttg: c67/289 lr:0.000876 t:5.2s +tttg: c68/289 lr:0.000872 t:5.2s +tttg: c69/289 lr:0.000869 t:5.3s +tttg: c70/289 lr:0.000865 t:5.4s +tttg: c71/289 lr:0.000861 t:5.5s +tttg: c72/289 lr:0.000857 t:5.6s +tttg: c73/289 lr:0.000854 t:5.6s +tttg: c74/289 lr:0.000850 t:5.7s +tttg: c75/289 lr:0.000846 t:5.8s +tttg: c76/289 lr:0.000842 t:5.9s +tttg: c77/289 lr:0.000838 t:5.9s +tttg: c78/289 lr:0.000834 t:6.0s +tttg: c79/289 lr:0.000830 t:6.1s +tttg: c80/289 lr:0.000826 t:6.2s +tttg: c81/289 lr:0.000821 t:6.2s +tttg: c82/289 lr:0.000817 t:6.3s +tttg: c83/289 lr:0.000813 t:6.4s +tttg: c84/289 lr:0.000809 t:6.5s +tttg: c85/289 lr:0.000804 t:6.6s +tttg: c86/289 lr:0.000800 t:6.6s +tttg: c87/289 lr:0.000796 t:6.7s +tttg: c88/289 lr:0.000791 t:6.8s +tttg: c89/289 lr:0.000787 t:6.9s +tttg: c90/289 lr:0.000782 t:6.9s +tttg: c91/289 lr:0.000778 t:7.0s +tttg: c92/289 lr:0.000773 t:7.1s +tttg: c93/289 lr:0.000769 t:7.2s +tttg: c94/289 lr:0.000764 t:7.3s +tttg: c95/289 lr:0.000759 t:7.3s +tttg: c96/289 lr:0.000755 t:7.4s +tttg: c97/289 lr:0.000750 t:7.5s +tttg: c98/289 lr:0.000745 t:7.6s +tttg: c99/289 lr:0.000740 t:7.6s +tttg: c100/289 lr:0.000736 t:7.7s +tttg: c101/289 lr:0.000731 t:7.8s +tttg: c102/289 lr:0.000726 t:7.9s +tttg: c103/289 lr:0.000721 t:8.0s +tttg: c104/289 lr:0.000716 t:8.0s +tttg: c105/289 lr:0.000711 t:8.1s +tttg: c106/289 lr:0.000706 t:8.2s +tttg: c107/289 lr:0.000701 t:8.3s +tttg: c108/289 lr:0.000696 t:8.3s +tttg: c109/289 lr:0.000691 t:8.4s +tttg: c110/289 lr:0.000686 t:8.5s +tttg: c111/289 lr:0.000681 t:8.6s +tttg: c112/289 lr:0.000676 t:8.7s +tttg: c113/289 lr:0.000671 t:8.7s +tttg: c114/289 lr:0.000666 t:8.8s +tttg: c115/289 lr:0.000661 t:8.9s +tttg: c116/289 lr:0.000656 t:9.0s +tttg: c117/289 lr:0.000650 t:9.0s +tttg: c118/289 lr:0.000645 t:9.1s +tttg: c119/289 lr:0.000640 t:9.2s +tttg: c120/289 lr:0.000635 t:9.3s +tttg: c121/289 lr:0.000629 t:9.4s +tttg: c122/289 lr:0.000624 t:9.4s +tttg: c123/289 lr:0.000619 t:9.5s +tttg: c124/289 lr:0.000614 t:9.6s +tttg: c125/289 lr:0.000608 t:9.7s +tttg: c126/289 lr:0.000603 t:9.7s +tttg: c127/289 lr:0.000598 t:9.8s +tttg: c128/289 lr:0.000592 t:9.9s +tttg: c129/289 lr:0.000587 t:10.0s +tttg: c130/289 lr:0.000581 t:10.1s +tttg: c131/289 lr:0.000576 t:10.1s +tttg: c132/289 lr:0.000571 t:10.2s +tttg: c133/289 lr:0.000565 t:10.3s +tttg: c134/289 lr:0.000560 t:10.4s +tttg: c135/289 lr:0.000554 t:10.4s +tttg: c136/289 lr:0.000549 t:10.5s +tttg: c137/289 lr:0.000544 t:10.6s +tttg: c138/289 lr:0.000538 t:10.7s +tttg: c139/289 lr:0.000533 t:10.7s +tttg: c140/289 lr:0.000527 t:10.8s +tttg: c141/289 lr:0.000522 t:10.9s +tttg: c142/289 lr:0.000516 t:11.0s +tttg: c143/289 lr:0.000511 t:11.1s +tttg: c144/289 lr:0.000505 t:11.1s +tttg: c145/289 lr:0.000500 t:11.2s +tttg: c146/289 lr:0.000495 t:11.3s +tttg: c147/289 lr:0.000489 t:11.4s +tttg: c148/289 lr:0.000484 t:11.5s +tttg: c149/289 lr:0.000478 t:11.5s +tttg: c150/289 lr:0.000473 t:11.6s +tttg: c151/289 lr:0.000467 t:11.7s +tttg: c152/289 lr:0.000462 t:11.8s +tttg: c153/289 lr:0.000456 t:11.8s +tttg: c154/289 lr:0.000451 t:11.9s +tttg: c155/289 lr:0.000446 t:12.0s +tttg: c156/289 lr:0.000440 t:12.1s +tttg: c157/289 lr:0.000435 t:12.1s +tttg: c158/289 lr:0.000429 t:12.2s +tttg: c159/289 lr:0.000424 t:12.3s +tttg: c160/289 lr:0.000419 t:12.4s +tttg: c161/289 lr:0.000413 t:12.5s +tttg: c162/289 lr:0.000408 t:12.5s +tttg: c163/289 lr:0.000402 t:12.6s +tttg: c164/289 lr:0.000397 t:12.7s +tttg: c165/289 lr:0.000392 t:12.8s +tttg: c166/289 lr:0.000386 t:12.8s +tttg: c167/289 lr:0.000381 t:12.9s +tttg: c168/289 lr:0.000376 t:13.0s +tttg: c169/289 lr:0.000371 t:13.1s +tttg: c170/289 lr:0.000365 t:13.2s +tttg: c171/289 lr:0.000360 t:13.3s +tttg: c172/289 lr:0.000355 t:13.3s +tttg: c173/289 lr:0.000350 t:13.4s +tttg: c174/289 lr:0.000344 t:13.5s +tttg: c175/289 lr:0.000339 t:13.6s +tttg: c176/289 lr:0.000334 t:13.6s +tttg: c177/289 lr:0.000329 t:13.7s +tttg: c178/289 lr:0.000324 t:13.8s +tttg: c179/289 lr:0.000319 t:13.9s +tttg: c180/289 lr:0.000314 t:13.9s +tttg: c181/289 lr:0.000309 t:14.0s +tttg: c182/289 lr:0.000304 t:14.1s +tttg: c183/289 lr:0.000299 t:14.2s +tttg: c184/289 lr:0.000294 t:14.2s +tttg: c185/289 lr:0.000289 t:14.3s +tttg: c186/289 lr:0.000284 t:14.4s +tttg: c187/289 lr:0.000279 t:14.5s +tttg: c188/289 lr:0.000274 t:14.6s +tttg: c189/289 lr:0.000269 t:14.6s +tttg: c190/289 lr:0.000264 t:14.7s +tttg: c191/289 lr:0.000260 t:14.8s +tttg: c192/289 lr:0.000255 t:14.9s +tttg: c193/289 lr:0.000250 t:15.0s +tttg: c194/289 lr:0.000245 t:15.0s +tttg: c195/289 lr:0.000241 t:15.1s +tttg: c196/289 lr:0.000236 t:15.2s +tttg: c197/289 lr:0.000231 t:15.3s +tttg: c198/289 lr:0.000227 t:15.3s +tttg: c199/289 lr:0.000222 t:15.4s +tttg: c200/289 lr:0.000218 t:15.5s +tttg: c201/289 lr:0.000213 t:15.6s +tttg: c202/289 lr:0.000209 t:15.7s +tttg: c203/289 lr:0.000204 t:15.7s +tttg: c204/289 lr:0.000200 t:15.8s +tttg: c205/289 lr:0.000196 t:15.9s +tttg: c206/289 lr:0.000191 t:16.0s +tttg: c207/289 lr:0.000187 t:16.0s +tttg: c208/289 lr:0.000183 t:16.1s +tttg: c209/289 lr:0.000179 t:16.2s +tttg: c210/289 lr:0.000174 t:16.3s +tttg: c211/289 lr:0.000170 t:16.3s +tttg: c212/289 lr:0.000166 t:16.4s +tttg: c213/289 lr:0.000162 t:16.5s +tttg: c214/289 lr:0.000158 t:16.6s +tttg: c215/289 lr:0.000154 t:16.6s +tttg: c216/289 lr:0.000150 t:16.7s +tttg: c217/289 lr:0.000146 t:16.8s +tttg: c218/289 lr:0.000143 t:16.9s +tttg: c219/289 lr:0.000139 t:17.0s +tttg: c220/289 lr:0.000135 t:17.0s +tttg: c221/289 lr:0.000131 t:17.1s +tttg: c222/289 lr:0.000128 t:17.2s +tttg: c223/289 lr:0.000124 t:17.3s +tttg: c224/289 lr:0.000121 t:17.3s +tttg: c225/289 lr:0.000117 t:17.4s +tttg: c226/289 lr:0.000113 t:17.5s +tttg: c227/289 lr:0.000110 t:17.6s +tttg: c228/289 lr:0.000107 t:17.7s +tttg: c229/289 lr:0.000103 t:17.7s +tttg: c230/289 lr:0.000100 t:17.8s +tttg: c231/289 lr:0.000097 t:17.9s +tttg: c232/289 lr:0.000094 t:18.0s +tttg: c233/289 lr:0.000090 t:18.0s +tttg: c234/289 lr:0.000087 t:18.1s +tttg: c235/289 lr:0.000084 t:18.2s +tttg: c236/289 lr:0.000081 t:18.3s +tttg: c237/289 lr:0.000078 t:18.4s +tttg: c238/289 lr:0.000075 t:18.4s +tttg: c239/289 lr:0.000073 t:18.5s +tttg: c240/289 lr:0.000070 t:18.6s +tttg: c241/289 lr:0.000067 t:18.7s +tttg: c242/289 lr:0.000064 t:18.7s +tttg: c243/289 lr:0.000062 t:18.8s +tttg: c244/289 lr:0.000059 t:18.9s +tttg: c245/289 lr:0.000056 t:19.0s +tttg: c246/289 lr:0.000054 t:19.1s +tttg: c247/289 lr:0.000052 t:19.1s +tttg: c248/289 lr:0.000049 t:19.2s +tttg: c249/289 lr:0.000047 t:19.3s +tttg: c250/289 lr:0.000045 t:19.4s +tttg: c251/289 lr:0.000042 t:19.4s +tttg: c252/289 lr:0.000040 t:19.5s +tttg: c253/289 lr:0.000038 t:19.6s +tttg: c254/289 lr:0.000036 t:19.7s +tttg: c255/289 lr:0.000034 t:19.7s +tttg: c256/289 lr:0.000032 t:19.8s +tttg: c257/289 lr:0.000030 t:19.9s +tttg: c258/289 lr:0.000028 t:20.0s +tttg: c259/289 lr:0.000027 t:20.1s +tttg: c260/289 lr:0.000025 t:20.1s +tttg: c261/289 lr:0.000023 t:20.2s +tttg: c262/289 lr:0.000022 t:20.3s +tttg: c263/289 lr:0.000020 t:20.4s +tttg: c264/289 lr:0.000018 t:20.5s +tttg: c265/289 lr:0.000017 t:20.5s +tttg: c266/289 lr:0.000016 t:20.6s +tttg: c267/289 lr:0.000014 t:20.7s +tttg: c268/289 lr:0.000013 t:20.8s +tttg: c269/289 lr:0.000012 t:20.8s +tttg: c270/289 lr:0.000011 t:20.9s +tttg: c271/289 lr:0.000010 t:21.0s +tttg: c272/289 lr:0.000009 t:21.1s +tttg: c273/289 lr:0.000008 t:21.2s +tttg: c274/289 lr:0.000007 t:21.2s +tttg: c275/289 lr:0.000006 t:21.3s +tttg: c276/289 lr:0.000005 t:21.4s +tttg: c277/289 lr:0.000004 t:21.5s +tttg: c278/289 lr:0.000004 t:21.5s +tttg: c279/289 lr:0.000003 t:21.6s +tttg: c280/289 lr:0.000002 t:21.7s +tttg: c281/289 lr:0.000002 t:21.8s +tttg: c282/289 lr:0.000001 t:21.8s +tttg: c283/289 lr:0.000001 t:21.9s +tttg: c284/289 lr:0.000001 t:22.0s +tttg: c285/289 lr:0.000000 t:22.1s +tttg: c286/289 lr:0.000000 t:22.2s +tttg: c287/289 lr:0.000000 t:22.2s +tttg: c288/289 lr:0.000000 t:22.3s +ttpr: phase:3/3 t:317.4s +ttp: b729/782 bl:2.3041 bb:1.0763 rl:2.2299 rb:1.0470 dl:2325-2352 gd:1 +ttp: b726/782 bl:2.3289 bb:1.0359 rl:2.2392 rb:1.0459 dl:2254-2276 gd:1 +ttp: b718/782 bl:2.2866 bb:1.0263 rl:2.2431 rb:1.0443 dl:2089-2106 gd:1 +ttp: b707/782 bl:2.3547 bb:1.0464 rl:2.2507 rb:1.0444 dl:1910-1923 gd:1 +ttp: b699/782 bl:2.4139 bb:1.0537 rl:2.2607 rb:1.0450 dl:1814-1824 gd:1 +ttp: b694/782 bl:2.3092 bb:1.0560 rl:2.2634 rb:1.0456 dl:1758-1769 gd:1 +ttp: b685/782 bl:2.2962 bb:1.0276 rl:2.2651 rb:1.0447 dl:1665-1675 gd:1 +ttp: b679/782 bl:2.3002 bb:1.0561 rl:2.2667 rb:1.0452 dl:1610-1618 gd:1 +ttp: b671/782 bl:2.3017 bb:1.0441 rl:2.2682 rb:1.0452 dl:1544-1552 gd:1 +ttp: b659/782 bl:2.3033 bb:1.0395 rl:2.2696 rb:1.0450 dl:1459-1466 gd:1 +ttp: b653/782 bl:2.2903 bb:1.0383 rl:2.2703 rb:1.0447 dl:1419-1425 gd:1 +ttp: b644/782 bl:2.3612 bb:1.0483 rl:2.2734 rb:1.0448 dl:1362-1367 gd:1 +ttp: b636/782 bl:2.3772 bb:1.0654 rl:2.2766 rb:1.0455 dl:1314-1320 gd:1 +ttp: b627/782 bl:2.3733 bb:1.0685 rl:2.2795 rb:1.0462 dl:1266-1271 gd:1 +ttp: b619/782 bl:2.3214 bb:1.0586 rl:2.2806 rb:1.0465 dl:1221-1226 gd:1 +ttp: b611/782 bl:2.2912 bb:1.0231 rl:2.2809 rb:1.0459 dl:1182-1186 gd:1 +ttp: b603/782 bl:2.4208 bb:1.0603 rl:2.2843 rb:1.0463 dl:1146-1150 gd:1 +ttp: b599/782 bl:2.3627 bb:1.0688 rl:2.2862 rb:1.0468 dl:1129-1133 gd:1 +ttp: b591/782 bl:2.3021 bb:1.0302 rl:2.2865 rb:1.0464 dl:1093-1098 gd:1 +ttp: b582/782 bl:2.3443 bb:1.0297 rl:2.2878 rb:1.0461 dl:1056-1060 gd:1 +ttp: b572/782 bl:2.3080 bb:1.0381 rl:2.2882 rb:1.0459 dl:1017-1021 gd:1 +ttp: b564/782 bl:2.2841 bb:1.0163 rl:2.2881 rb:1.0453 dl:990-993 gd:1 +ttp: b556/782 bl:2.3736 bb:1.0671 rl:2.2896 rb:1.0457 dl:961-965 gd:1 +ttp: b547/782 bl:2.3316 bb:1.0479 rl:2.2904 rb:1.0458 dl:934-937 gd:1 +ttp: b539/782 bl:2.3295 bb:1.0326 rl:2.2910 rb:1.0455 dl:909-912 gd:1 +ttp: b533/782 bl:2.3691 bb:1.0658 rl:2.2923 rb:1.0459 dl:890-892 gd:1 +ttp: b525/782 bl:2.3490 bb:1.0181 rl:2.2931 rb:1.0454 dl:866-869 gd:1 +ttp: b516/782 bl:2.3478 bb:1.0418 rl:2.2939 rb:1.0454 dl:841-843 gd:1 +ttp: b508/782 bl:2.3903 bb:1.0509 rl:2.2953 rb:1.0454 dl:817-820 gd:1 +ttp: b499/782 bl:2.3326 bb:1.0532 rl:2.2958 rb:1.0456 dl:794-796 gd:1 +ttp: b491/782 bl:2.2795 bb:1.0282 rl:2.2956 rb:1.0453 dl:773-776 gd:1 +ttp: b483/782 bl:2.2508 bb:1.0269 rl:2.2950 rb:1.0451 dl:754-756 gd:1 +ttp: b475/782 bl:2.3662 bb:1.0559 rl:2.2959 rb:1.0452 dl:735-737 gd:1 +ttp: b467/782 bl:2.3447 bb:1.0509 rl:2.2964 rb:1.0453 dl:717-719 gd:1 +ttp: b459/782 bl:2.2790 bb:1.0434 rl:2.2962 rb:1.0453 dl:700-701 gd:1 +ttp: b451/782 bl:2.4006 bb:1.0863 rl:2.2974 rb:1.0457 dl:682-685 gd:1 +ttp: b443/782 bl:2.2284 bb:1.0485 rl:2.2967 rb:1.0457 dl:666-668 gd:1 +ttp: b435/782 bl:2.3103 bb:1.0204 rl:2.2968 rb:1.0455 dl:648-651 gd:1 +ttp: b427/782 bl:2.2544 bb:1.0613 rl:2.2964 rb:1.0456 dl:634-636 gd:1 +ttp: b419/782 bl:2.3152 bb:1.0496 rl:2.2966 rb:1.0457 dl:618-620 gd:1 +ttp: b411/782 bl:2.3557 bb:1.0573 rl:2.2971 rb:1.0458 dl:603-605 gd:1 +ttp: b403/782 bl:2.3224 bb:1.0420 rl:2.2973 rb:1.0457 dl:588-590 gd:1 +ttp: b395/782 bl:2.2611 bb:1.0473 rl:2.2970 rb:1.0458 dl:573-575 gd:1 +ttp: b387/782 bl:2.3557 bb:1.0805 rl:2.2975 rb:1.0460 dl:559-561 gd:1 +ttp: b379/782 bl:2.4174 bb:1.0867 rl:2.2984 rb:1.0464 dl:545-547 gd:1 +ttp: b371/782 bl:2.2523 bb:1.0998 rl:2.2981 rb:1.0468 dl:532-533 gd:1 +ttp: b363/782 bl:2.3670 bb:1.0595 rl:2.2986 rb:1.0468 dl:518-521 gd:1 +ttp: b355/782 bl:2.3003 bb:1.0674 rl:2.2986 rb:1.0470 dl:504-506 gd:1 +ttp: b347/782 bl:2.3342 bb:1.1094 rl:2.2989 rb:1.0474 dl:492-494 gd:1 +ttp: b339/782 bl:2.3324 bb:1.0770 rl:2.2991 rb:1.0476 dl:480-482 gd:1 +ttp: b331/782 bl:2.3295 bb:1.0765 rl:2.2993 rb:1.0478 dl:468-469 gd:1 +ttp: b323/782 bl:2.3715 bb:1.0707 rl:2.2997 rb:1.0479 dl:457-458 gd:1 +ttp: b315/782 bl:2.3969 bb:1.1011 rl:2.3003 rb:1.0483 dl:444-445 gd:1 +ttp: b307/782 bl:2.3319 bb:1.1273 rl:2.3005 rb:1.0487 dl:432-433 gd:1 +ttp: b299/782 bl:2.3183 bb:1.1010 rl:2.3006 rb:1.0490 dl:420-421 gd:1 +ttp: b291/782 bl:2.2537 bb:1.0077 rl:2.3004 rb:1.0488 dl:407-409 gd:1 +ttp: b283/782 bl:2.3658 bb:1.1250 rl:2.3007 rb:1.0491 dl:396-398 gd:1 +ttp: b275/782 bl:2.3452 bb:1.0567 rl:2.3009 rb:1.0492 dl:385-386 gd:1 +ttp: b267/782 bl:2.4171 bb:1.1424 rl:2.3015 rb:1.0496 dl:375-376 gd:1 +ttp: b223/782 bl:2.3199 bb:1.1200 rl:2.3016 rb:1.0499 dl:321-322 gd:1 +ttp: b214/782 bl:2.3313 bb:1.1156 rl:2.3017 rb:1.0502 dl:310-312 gd:1 +ttp: b206/782 bl:2.3945 bb:1.1016 rl:2.3021 rb:1.0504 dl:302-303 gd:1 +ttp: b198/782 bl:2.3894 bb:1.0571 rl:2.3024 rb:1.0504 dl:294-295 gd:1 +ttp: b190/782 bl:2.3361 bb:1.0741 rl:2.3025 rb:1.0505 dl:284-285 gd:1 +ttp: b183/782 bl:2.3098 bb:1.0637 rl:2.3026 rb:1.0505 dl:277-278 gd:1 +ttp: b176/782 bl:2.3095 bb:1.1217 rl:2.3026 rb:1.0508 dl:270-271 gd:1 +ttp: b170/782 bl:2.3731 bb:1.1253 rl:2.3028 rb:1.0510 dl:264-265 gd:1 +ttp: b165/782 bl:2.3408 bb:1.1116 rl:2.3030 rb:1.0512 dl:260-260 gd:1 +ttp: b158/782 bl:2.3321 bb:1.1026 rl:2.3031 rb:1.0514 dl:253-254 gd:1 +ttp: b151/782 bl:2.4609 bb:1.1376 rl:2.3035 rb:1.0516 dl:246-247 gd:1 +ttp: b144/782 bl:2.3523 bb:1.1056 rl:2.3037 rb:1.0518 dl:239-240 gd:1 +ttp: b136/782 bl:2.4150 bb:1.1355 rl:2.3040 rb:1.0520 dl:232-233 gd:1 +ttp: b130/782 bl:2.5671 bb:1.1764 rl:2.3048 rb:1.0524 dl:226-227 gd:1 +ttp: b123/782 bl:2.3908 bb:1.1625 rl:2.3050 rb:1.0527 dl:219-220 gd:1 +ttp: b116/782 bl:2.4858 bb:1.1287 rl:2.3055 rb:1.0529 dl:213-214 gd:1 +ttp: b110/782 bl:2.3647 bb:1.1223 rl:2.3057 rb:1.0530 dl:208-208 gd:1 +ttp: b103/782 bl:2.4464 bb:1.1776 rl:2.3060 rb:1.0533 dl:202-202 gd:1 +ttp: b95/782 bl:2.3246 bb:1.1364 rl:2.3061 rb:1.0535 dl:194-195 gd:1 +ttp: b88/782 bl:2.4808 bb:1.1839 rl:2.3065 rb:1.0538 dl:188-189 gd:1 +ttp: b79/782 bl:2.3881 bb:1.1416 rl:2.3066 rb:1.0540 dl:180-181 gd:1 +ttp: b70/782 bl:2.5193 bb:1.2277 rl:2.3071 rb:1.0544 dl:172-173 gd:1 +ttp: b63/782 bl:2.5098 bb:1.1972 rl:2.3075 rb:1.0546 dl:166-166 gd:1 +ttp: b54/782 bl:2.4684 bb:1.2109 rl:2.3078 rb:1.0549 dl:157-158 gd:1 +ttp: b46/782 bl:2.5391 bb:1.2124 rl:2.3082 rb:1.0552 dl:149-150 gd:1 +ttp: b38/782 bl:2.6025 bb:1.1936 rl:2.3088 rb:1.0554 dl:141-142 gd:1 +ttp: b30/782 bl:2.6000 bb:1.2677 rl:2.3092 rb:1.0558 dl:133-134 gd:1 +ttp: b22/782 bl:2.5519 bb:1.1946 rl:2.3096 rb:1.0560 dl:124-126 gd:1 +ttp: b14/782 bl:2.5919 bb:1.1832 rl:2.3100 rb:1.0561 dl:114-115 gd:1 +ttp: b6/782 bl:2.7257 bb:1.2153 rl:2.3105 rb:1.0563 dl:99-101 gd:1 +quantized_ttt_phased val_loss:2.31641428 val_bpb:1.05851093 eval_time:408686ms +total_eval_time:408.7s diff --git a/records/track_10min_16mb/2026-05-01_PR2101_3Seed_Support/submission.json b/records/track_10min_16mb/2026-05-01_PR2101_3Seed_Support/submission.json new file mode 100644 index 0000000000..e98950681b --- /dev/null +++ b/records/track_10min_16mb/2026-05-01_PR2101_3Seed_Support/submission.json @@ -0,0 +1,128 @@ +{ + "author": "Julian Tang", + "github_id": "JulianTang2027", + "name": "3-Seed Reproduction + Ablations — Support for PR #2101", + "date": "2026-05-01", + "track": "10min_16mb", + "submission_type": "record_support", + "supports_pr": 2101, + "val_bpb": 1.05878776, + "val_bpb_std_sample": 0.00098, + "val_bpb_std_population": 0.00080, + "seeds": [42, 0, 1234], + "seed_results": { + "42": { + "val_loss": 2.31513512, + "val_bpb": 1.05792641, + "stop_step": 4855, + "train_wallclock_s": 592.042, + "prequant_val_bpb": 1.06128455, + "quant_val_bpb": 1.06969200, + "model_ptz_bytes": 15945200, + "artifact_bytes": 15979586, + "ttt_eval_time_s": 408.6, + "log": "train_seed42.log" + }, + "0": { + "val_loss": 2.31658504, + "val_bpb": 1.05858896, + "stop_step": 4857, + "train_wallclock_s": 592.076, + "prequant_val_bpb": 1.06208108, + "quant_val_bpb": 1.07042006, + "model_ptz_bytes": 15942980, + "artifact_bytes": 15977366, + "ttt_eval_time_s": 405.5, + "log": "train_seed0.log" + }, + "1234": { + "val_loss": 2.31934009, + "val_bpb": 1.05984791, + "stop_step": 4856, + "train_wallclock_s": 592.141, + "prequant_val_bpb": 1.06296914, + "quant_val_bpb": 1.07165472, + "model_ptz_bytes": 15948957, + "artifact_bytes": 15983343, + "ttt_eval_time_s": 447.3, + "log": "train_seed1234.log" + } + }, + "comparison_pr2101_claim": { + "claim_3seed_mean_bpb": 1.05845438, + "claim_3seed_std_bpb": 0.00058, + "delta_seed42_bpb": -0.00104472, + "delta_seed0_bpb": 0.00002407, + "delta_seed1234_bpb": 0.00202080, + "delta_mean_bpb": 0.00033338, + "notes": "Reproduction within 0.00033 BPB of claimed mean; per-seed gap roughly symmetric around zero, std ~1.7x author's reported std (typical pod-to-pod variance)." + }, + "comparison_merged_sota_pr1868": { + "merged_sota_bpb": 1.06141, + "delta_seed42_bpb": -0.00348359, + "delta_seed0_bpb": -0.00282104, + "delta_seed1234_bpb": -0.00156209, + "delta_mean_bpb": -0.00262224, + "delta_mean_nats_via_loss": -0.00181760, + "all_seeds_beat_merged_sota": true, + "clears_005nat_strict_threshold": false, + "notes": "Mean improvement is 0.00181 nats — below 0.005-nat strict threshold but every seed individually beats merged SOTA by 0.00156-0.00349 BPB." + }, + "ablations_seed42": { + "baseline_bpb": 1.05792641, + "ablation_results": { + "label_smooth_0.05": { + "val_loss": 2.31530893, + "val_bpb": 1.05800583, + "delta_vs_baseline_bpb": 0.00007942, + "verdict": "null (within noise)", + "log": "ablation_label_smooth_005_seed42.log" + }, + "grad_centralize_1": { + "val_loss": 2.31521576, + "val_bpb": 1.05796326, + "delta_vs_baseline_bpb": 0.00003685, + "verdict": "null (within noise)", + "log": "ablation_grad_centralize_seed42.log" + }, + "ttt_local_lr_mult_0.85": { + "val_loss": 2.31641428, + "val_bpb": 1.05851093, + "delta_vs_baseline_bpb": 0.00058452, + "verdict": "worse (overshoots optimum)", + "log": "ablation_ttt_local_lr_085_seed42.log" + } + }, + "notes": "Both author-introduced knobs (LABEL_SMOOTH, GRAD_CENTRALIZE) are nulls — useful negative result. TTT_LOCAL_LR_MULT=0.85 is worse than 0.75; suggests the optimum on this stack is in [0.75, 0.80]." + }, + "compliance": { + "artifact_bytes_max": 15983343, + "artifact_bytes_min_slack_to_16M": 16657, + "train_wallclock_max_s": 592.141, + "ttt_eval_max_s": 447.3, + "gptq_reserve_seconds": 8.0, + "all_phased_ttt_batches_drained": true + }, + "hardware": "8x NVIDIA H100 80GB HBM3 SXM (RunPod)", + "pytorch_version": "2.9.1+cu128", + "cuda_version": "12.8", + "train_gpt_py_md5": "5606a60541ef66315ac6991e8cc16de8", + "code_changes_vs_pr2101": "none (train_gpt.py byte-identical to PR #2101)", + "technique_summary": "PR #1855 base + AWQ-lite (PR #1918) + AsymLogit (PR #2060) + GradCentral/LabelSmooth code features (disabled in 3-seed runs per PR #2101). No new ML.", + "attribution": { + "supports_pr": "#2101 by @OnlyJundong", + "reproduction": "@JulianTang2027 (independent 3-seed run + 3 ablations)", + "technique_prs": [ + "#1787 @nprime06 (base architecture)", + "#1797 @dexhunter (SmearGate + LQER)", + "#1851 @aquariouseworkman (SmearGate BOS fix)", + "#1855 @codemath3000 (9-hparam stack)", + "#1918 @aquariouseworkman (AWQ-lite, technique)", + "#2060 @S0urC10ud (AsymLogit, technique)", + "#2101 @OnlyJundong (integration + GradCentral + LabelSmooth)", + "#1729 @romeerp (CaseOps)", + "#1394 @clarkkev (GPTQ + SP8192)", + "#549 @abaybektursun (score-first TTT)" + ] + } +} diff --git a/records/track_10min_16mb/2026-05-01_PR2101_3Seed_Support/train_seed0.log b/records/track_10min_16mb/2026-05-01_PR2101_3Seed_Support/train_seed0.log new file mode 100644 index 0000000000..b6c87ee083 --- /dev/null +++ b/records/track_10min_16mb/2026-05-01_PR2101_3Seed_Support/train_seed0.log @@ -0,0 +1,954 @@ +W0501 07:24:37.404000 934680 torch/distributed/run.py:803] +W0501 07:24:37.404000 934680 torch/distributed/run.py:803] ***************************************** +W0501 07:24:37.404000 934680 torch/distributed/run.py:803] Setting OMP_NUM_THREADS environment variable for each process to be 1 in default, to avoid your system being overloaded, please further tune the variable for optimal performance in your application as needed. +W0501 07:24:37.404000 934680 torch/distributed/run.py:803] ***************************************** +Hyperparameters: + adam_eps: 1e-08 + adam_wd: 0.02 + artifact_dir: + attn_clip_sigmas: 13.0 + attn_out_gate_enabled: False + attn_out_gate_src: proj + awq_lite_bits: 8 + awq_lite_enabled: True + awq_lite_group_size: 64 + awq_lite_group_top_k: 1 + beta1: 0.9 + beta2: 0.99 + caseops_enabled: True + compressor: pergroup + data_dir: ./data + datasets_dir: ./data/datasets/fineweb10B_sp8192_lossless_caps_caseops_v1_reserved + distributed: True + ema_decay: 0.9965 + embed_bits: 7 + embed_clip_sigmas: 14.0 + embed_lr: 0.6 + embed_wd: 0.085 + enable_looping_at: 0.35 + eval_seq_len: 2560 + eval_stride: 64 + fused_ce_enabled: True + gate_window: 12 + gated_attn_enabled: False + gated_attn_init_std: 0.01 + gated_attn_quant_gate: True + global_ttt_batch_seqs: 32 + global_ttt_chunk_tokens: 32768 + global_ttt_epochs: 1 + global_ttt_grad_clip: 1.0 + global_ttt_lr: 0.001 + global_ttt_momentum: 0.9 + global_ttt_respect_doc_boundaries: True + global_ttt_warmup_chunks: 0 + global_ttt_warmup_start_lr: 0.0 + gptq_calibration_batches: 16 + gptq_reserve_seconds: 8.0 + grad_accum_steps: 1 + grad_centralize: False + grad_clip_norm: 0.3 + is_main_process: True + iterations: 20000 + label_smooth: 0.0 + ln_scale: True + local_rank: 0 + logfile: logs/6490f377-541b-477b-b7ff-0be01bdd4f1e.txt + logit_softcap: 30.0 + loop_end: 5 + loop_start: 3 + lqer_asym_enabled: True + lqer_asym_group: 64 + lqer_enabled: True + lqer_factor_bits: 4 + lqer_gain_select: False + lqer_rank: 4 + lqer_scope: all + lqer_top_k: 3 + matrix_bits: 6 + matrix_clip_sigmas: 12.85 + matrix_lr: 0.026 + max_wallclock_seconds: 600.0 + min_lr: 0.1 + mlp_clip_sigmas: 11.5 + mlp_mult: 4.0 + model_dim: 512 + model_path: final_model.pt + muon_backend_steps: 5 + muon_momentum: 0.97 + muon_momentum_warmup_start: 0.92 + muon_momentum_warmup_steps: 1500 + muon_row_normalize: True + muon_wd: 0.095 + num_heads: 8 + num_kv_heads: 4 + num_layers: 11 + num_loops: 2 + parallel_final_lane: mean + parallel_start_layer: 8 + phased_ttt_num_phases: 3 + phased_ttt_prefix_docs: 2500 + qk_gain_init: 5.25 + quantized_model_path: final_model.int6.ptz + rank: 0 + rope_base: 10000.0 + rope_dims: 16 + rope_train_seq_len: 2048 + rope_yarn: False + run_id: 6490f377-541b-477b-b7ff-0be01bdd4f1e + scalar_lr: 0.02 + seed: 0 + skip_gates_enabled: True + smear_gate_enabled: True + sparse_attn_gate_enabled: True + sparse_attn_gate_init_std: 0.0 + sparse_attn_gate_scale: 0.5 + tie_embeddings: True + tied_embed_init_std: 0.005 + tied_embed_lr: 0.03 + tokenizer_path: ./tokenizers/fineweb_8192_bpe_lossless_caps_caseops_v1_reserved.model + train_batch_tokens: 786432 + train_files: ./data/datasets/fineweb10B_sp8192_lossless_caps_caseops_v1_reserved/fineweb_train_*.bin + train_log_every: 500 + train_seq_len: 2048 + ttt_batch_size: 64 + ttt_beta1: 0.0 + ttt_beta2: 0.99 + ttt_chunk_size: 48 + ttt_enabled: True + ttt_eval_batches: + ttt_eval_seq_len: 2560 + ttt_grad_steps: 1 + ttt_k_lora: True + ttt_local_lr_mult: 0.75 + ttt_lora_lr: 0.0001 + ttt_lora_rank: 80 + ttt_mask: no_qv + ttt_mlp_lora: True + ttt_o_lora: True + ttt_optimizer: adam + ttt_q_lora: False + ttt_v_lora: False + ttt_weight_decay: 0.5 + val_batch_tokens: 524288 + val_bytes_files: ./data/datasets/fineweb10B_sp8192_lossless_caps_caseops_v1_reserved/fineweb_val_bytes_*.bin + val_doc_fraction: 1.0 + val_files: ./data/datasets/fineweb10B_sp8192_lossless_caps_caseops_v1_reserved/fineweb_val_*.bin + val_loss_every: 0 + vocab_size: 8192 + warmdown_frac: 0.85 + warmup_steps: 20 + world_size: 8 + xsa_last_n: 11 +train_shards: 80 +val_tokens: 47851520 +model_params:35945673 +gptq:reserving 8s, effective=592000ms +warmup_cu_buckets:64,128,192,256 iters_each:3 +warmup_step: 1/20 +warmup_step: 2/20 +warmup_step: 3/20 +warmup_step: 4/20 +warmup_step: 5/20 +warmup_step: 6/20 +warmup_step: 10/20 +warmup_step: 20/20 +loop_warmup:enabled encoder:[0, 1, 2, 3, 4, 5, 3, 4] decoder:[5, 3, 4, 5, 6, 7, 8, 9, 10] +loop_warmup_step: 1/20 +loop_warmup_step: 2/20 +loop_warmup_step: 3/20 +loop_warmup_step: 4/20 +loop_warmup_step: 5/20 +loop_warmup_step: 6/20 +loop_warmup_step: 10/20 +loop_warmup_step: 20/20 +1/20000 train_loss: 9.0105 train_time: 0.0m tok/s: 17301909 +2/20000 train_loss: 12.9628 train_time: 0.0m tok/s: 7707310 +3/20000 train_loss: 10.2815 train_time: 0.0m tok/s: 7905047 +4/20000 train_loss: 8.7939 train_time: 0.0m tok/s: 8022008 +5/20000 train_loss: 8.0062 train_time: 0.0m tok/s: 8079897 +500/20000 train_loss: 2.5734 train_time: 0.8m tok/s: 8160843 +1000/20000 train_loss: 2.7977 train_time: 1.6m tok/s: 8122468 +1500/20000 train_loss: 2.6205 train_time: 2.4m tok/s: 8107293 +2000/20000 train_loss: 2.6534 train_time: 3.2m tok/s: 8102393 +layer_loop:enabled step:2135 frac:0.350 encoder:[0, 1, 2, 3, 4, 5, 3, 4] decoder:[5, 3, 4, 5, 6, 7, 8, 9, 10] +2500/20000 train_loss: 2.5350 train_time: 4.3m tok/s: 7594810 +3000/20000 train_loss: 2.5525 train_time: 5.5m tok/s: 7158406 +3500/20000 train_loss: 2.5550 train_time: 6.7m tok/s: 6876647 +4000/20000 train_loss: 2.3964 train_time: 7.8m tok/s: 6680054 +4500/20000 train_loss: 2.2676 train_time: 9.0m tok/s: 6534551 +4857/20000 val_loss: 2.3496 val_bpb: 1.0736 +stopping_early: wallclock_cap train_time: 592076ms step: 4857/20000 +peak memory allocated: 41707 MiB reserved: 46952 MiB +ema:applying EMA weights +diagnostic pre-quantization post-ema val_loss:2.32442967 val_bpb:1.06208108 eval_time:9652ms +Serialized model: 135418111 bytes +Code size (uncompressed): 172613 bytes +Code size (compressed): 34386 bytes +GPTQ:collecting Hessians from calibration data... +GPTQ:collected 67 Hessians in 4.0s +Quantized weights: + gate_int8_row: blocks.attn.attn_gate_w + gptq (int6): blocks.attn.c_k.weight, blocks.attn.c_q.weight, blocks.attn.c_v.weight, blocks.attn.proj.weight, blocks.mlp.fc.weight, blocks.mlp.proj.weight + gptq (int6)+lqer_asym: blocks.mlp.fc.weight + gptq (int7)+awqgrpint8+lqer_asym: tok_emb.weight + passthrough (float16): blocks.attn.q_gain, blocks.attn_scale, blocks.mlp_scale, blocks.resid_mix, parallel_post_lambdas, parallel_resid_lambdas, skip_gates, skip_weights, smear_gate.weight, smear_lambda, softcap_neg, softcap_pos +Serialize: per-group lrzip compression... +Serialize: per-group compression done in 119.5s +Serialized model quantized+pergroup: 15942980 bytes +Total submission size quantized+pergroup: 15977366 bytes +Deserialize: per-group lrzip decompression... +Deserialize: decompression done in 21.1s +diagnostic quantized val_loss:2.34268004 val_bpb:1.07042006 eval_time:13265ms +Deserialize: per-group lrzip decompression... +Deserialize: decompression done in 20.8s +ttt_lora:warming up compile (random tokens, no val data) +ttt_lora:compile warmup done (94.0s) + +beginning TTT eval timer +ttt_phased: total_docs:50000 prefix_docs:2500 suffix_docs:47500 num_phases:3 boundaries:[833, 1666, 2500] +ttp: b779/782 bl:2.2207 bb:1.0505 rl:2.2207 rb:1.0505 dl:10442-13079 gd:0 +ttp: b770/782 bl:2.2822 bb:1.0774 rl:2.2401 rb:1.0590 dl:5311-5522 gd:0 +ttp: b765/782 bl:2.3128 bb:1.0817 rl:2.2551 rb:1.0638 dl:4393-4510 gd:0 +ttpp: phase:1/3 pd:1296 gd:833 t:188.8s +tttg: c1/131 lr:0.001000 t:0.4s +tttg: c2/131 lr:0.001000 t:0.4s +tttg: c3/131 lr:0.000999 t:0.5s +tttg: c4/131 lr:0.000999 t:0.6s +tttg: c5/131 lr:0.000998 t:0.7s +tttg: c6/131 lr:0.000996 t:0.8s +tttg: c7/131 lr:0.000995 t:0.8s +tttg: c8/131 lr:0.000993 t:0.9s +tttg: c9/131 lr:0.000991 t:1.0s +tttg: c10/131 lr:0.000988 t:1.1s +tttg: c11/131 lr:0.000985 t:1.2s +tttg: c12/131 lr:0.000982 t:1.2s +tttg: c13/131 lr:0.000979 t:1.3s +tttg: c14/131 lr:0.000976 t:1.4s +tttg: c15/131 lr:0.000972 t:1.5s +tttg: c16/131 lr:0.000968 t:1.6s +tttg: c17/131 lr:0.000963 t:1.6s +tttg: c18/131 lr:0.000958 t:1.7s +tttg: c19/131 lr:0.000953 t:1.8s +tttg: c20/131 lr:0.000948 t:1.9s +tttg: c21/131 lr:0.000943 t:1.9s +tttg: c22/131 lr:0.000937 t:2.0s +tttg: c23/131 lr:0.000931 t:2.1s +tttg: c24/131 lr:0.000925 t:2.2s +tttg: c25/131 lr:0.000918 t:2.3s +tttg: c26/131 lr:0.000911 t:2.3s +tttg: c27/131 lr:0.000905 t:2.4s +tttg: c28/131 lr:0.000897 t:2.5s +tttg: c29/131 lr:0.000890 t:2.6s +tttg: c30/131 lr:0.000882 t:2.6s +tttg: c31/131 lr:0.000874 t:2.7s +tttg: c32/131 lr:0.000866 t:2.8s +tttg: c33/131 lr:0.000858 t:2.9s +tttg: c34/131 lr:0.000849 t:3.0s +tttg: c35/131 lr:0.000841 t:3.0s +tttg: c36/131 lr:0.000832 t:3.1s +tttg: c37/131 lr:0.000822 t:3.2s +tttg: c38/131 lr:0.000813 t:3.3s +tttg: c39/131 lr:0.000804 t:3.3s +tttg: c40/131 lr:0.000794 t:3.4s +tttg: c41/131 lr:0.000784 t:3.5s +tttg: c42/131 lr:0.000774 t:3.6s +tttg: c43/131 lr:0.000764 t:3.6s +tttg: c44/131 lr:0.000753 t:3.7s +tttg: c45/131 lr:0.000743 t:3.8s +tttg: c46/131 lr:0.000732 t:3.9s +tttg: c47/131 lr:0.000722 t:4.0s +tttg: c48/131 lr:0.000711 t:4.0s +tttg: c49/131 lr:0.000700 t:4.1s +tttg: c50/131 lr:0.000689 t:4.2s +tttg: c51/131 lr:0.000677 t:4.3s +tttg: c52/131 lr:0.000666 t:4.3s +tttg: c53/131 lr:0.000655 t:4.4s +tttg: c54/131 lr:0.000643 t:4.5s +tttg: c55/131 lr:0.000631 t:4.6s +tttg: c56/131 lr:0.000620 t:4.7s +tttg: c57/131 lr:0.000608 t:4.7s +tttg: c58/131 lr:0.000596 t:4.8s +tttg: c59/131 lr:0.000584 t:4.9s +tttg: c60/131 lr:0.000572 t:5.0s +tttg: c61/131 lr:0.000560 t:5.0s +tttg: c62/131 lr:0.000548 t:5.1s +tttg: c63/131 lr:0.000536 t:5.2s +tttg: c64/131 lr:0.000524 t:5.3s +tttg: c65/131 lr:0.000512 t:5.4s +tttg: c66/131 lr:0.000500 t:5.4s +tttg: c67/131 lr:0.000488 t:5.5s +tttg: c68/131 lr:0.000476 t:5.6s +tttg: c69/131 lr:0.000464 t:5.7s +tttg: c70/131 lr:0.000452 t:5.8s +tttg: c71/131 lr:0.000440 t:5.8s +tttg: c72/131 lr:0.000428 t:5.9s +tttg: c73/131 lr:0.000416 t:6.0s +tttg: c74/131 lr:0.000404 t:6.1s +tttg: c75/131 lr:0.000392 t:6.1s +tttg: c76/131 lr:0.000380 t:6.2s +tttg: c77/131 lr:0.000369 t:6.3s +tttg: c78/131 lr:0.000357 t:6.4s +tttg: c79/131 lr:0.000345 t:6.5s +tttg: c80/131 lr:0.000334 t:6.5s +tttg: c81/131 lr:0.000323 t:6.6s +tttg: c82/131 lr:0.000311 t:6.7s +tttg: c83/131 lr:0.000300 t:6.8s +tttg: c84/131 lr:0.000289 t:6.8s +tttg: c85/131 lr:0.000278 t:6.9s +tttg: c86/131 lr:0.000268 t:7.0s +tttg: c87/131 lr:0.000257 t:7.1s +tttg: c88/131 lr:0.000247 t:7.2s +tttg: c89/131 lr:0.000236 t:7.2s +tttg: c90/131 lr:0.000226 t:7.3s +tttg: c91/131 lr:0.000216 t:7.4s +tttg: c92/131 lr:0.000206 t:7.5s +tttg: c93/131 lr:0.000196 t:7.5s +tttg: c94/131 lr:0.000187 t:7.6s +tttg: c95/131 lr:0.000178 t:7.7s +tttg: c96/131 lr:0.000168 t:7.8s +tttg: c97/131 lr:0.000159 t:7.9s +tttg: c98/131 lr:0.000151 t:7.9s +tttg: c99/131 lr:0.000142 t:8.0s +tttg: c100/131 lr:0.000134 t:8.1s +tttg: c101/131 lr:0.000126 t:8.2s +tttg: c102/131 lr:0.000118 t:8.2s +tttg: c103/131 lr:0.000110 t:8.3s +tttg: c104/131 lr:0.000103 t:8.4s +tttg: c105/131 lr:0.000095 t:8.5s +tttg: c106/131 lr:0.000089 t:8.6s +tttg: c107/131 lr:0.000082 t:8.6s +tttg: c108/131 lr:0.000075 t:8.7s +tttg: c109/131 lr:0.000069 t:8.8s +tttg: c110/131 lr:0.000063 t:8.9s +tttg: c111/131 lr:0.000057 t:8.9s +tttg: c112/131 lr:0.000052 t:9.0s +tttg: c113/131 lr:0.000047 t:9.1s +tttg: c114/131 lr:0.000042 t:9.2s +tttg: c115/131 lr:0.000037 t:9.3s +tttg: c116/131 lr:0.000032 t:9.3s +tttg: c117/131 lr:0.000028 t:9.4s +tttg: c118/131 lr:0.000024 t:9.5s +tttg: c119/131 lr:0.000021 t:9.6s +tttg: c120/131 lr:0.000018 t:9.6s +tttg: c121/131 lr:0.000015 t:9.7s +tttg: c122/131 lr:0.000012 t:9.8s +tttg: c123/131 lr:0.000009 t:9.9s +tttg: c124/131 lr:0.000007 t:10.0s +tttg: c125/131 lr:0.000005 t:10.0s +tttg: c126/131 lr:0.000004 t:10.1s +tttg: c127/131 lr:0.000002 t:10.2s +tttg: c128/131 lr:0.000001 t:10.3s +tttg: c129/131 lr:0.000001 t:10.4s +tttg: c130/131 lr:0.000000 t:10.4s +ttpr: phase:1/3 t:201.6s +ttp: b761/782 bl:2.4069 bb:1.1097 rl:2.2788 rb:1.0710 dl:3916-4032 gd:0 +ttp: b750/782 bl:2.3785 bb:1.0687 rl:2.2896 rb:1.0708 dl:3090-3149 gd:0 +ttpp: phase:2/3 pd:2128 gd:1666 t:259.6s +tttg: c1/219 lr:0.001000 t:0.1s +tttg: c2/219 lr:0.001000 t:0.2s +tttg: c3/219 lr:0.001000 t:0.2s +tttg: c4/219 lr:0.001000 t:0.3s +tttg: c5/219 lr:0.000999 t:0.4s +tttg: c6/219 lr:0.000999 t:0.5s +tttg: c7/219 lr:0.000998 t:0.5s +tttg: c8/219 lr:0.000997 t:0.6s +tttg: c9/219 lr:0.000997 t:0.7s +tttg: c10/219 lr:0.000996 t:0.8s +tttg: c11/219 lr:0.000995 t:0.8s +tttg: c12/219 lr:0.000994 t:0.9s +tttg: c13/219 lr:0.000993 t:1.0s +tttg: c14/219 lr:0.000991 t:1.1s +tttg: c15/219 lr:0.000990 t:1.2s +tttg: c16/219 lr:0.000988 t:1.2s +tttg: c17/219 lr:0.000987 t:1.3s +tttg: c18/219 lr:0.000985 t:1.4s +tttg: c19/219 lr:0.000983 t:1.5s +tttg: c20/219 lr:0.000981 t:1.5s +tttg: c21/219 lr:0.000979 t:1.6s +tttg: c22/219 lr:0.000977 t:1.7s +tttg: c23/219 lr:0.000975 t:1.8s +tttg: c24/219 lr:0.000973 t:1.9s +tttg: c25/219 lr:0.000970 t:1.9s +tttg: c26/219 lr:0.000968 t:2.0s +tttg: c27/219 lr:0.000965 t:2.1s +tttg: c28/219 lr:0.000963 t:2.2s +tttg: c29/219 lr:0.000960 t:2.3s +tttg: c30/219 lr:0.000957 t:2.3s +tttg: c31/219 lr:0.000954 t:2.4s +tttg: c32/219 lr:0.000951 t:2.5s +tttg: c33/219 lr:0.000948 t:2.6s +tttg: c34/219 lr:0.000945 t:2.7s +tttg: c35/219 lr:0.000941 t:2.7s +tttg: c36/219 lr:0.000938 t:2.8s +tttg: c37/219 lr:0.000934 t:2.9s +tttg: c38/219 lr:0.000931 t:3.0s +tttg: c39/219 lr:0.000927 t:3.0s +tttg: c40/219 lr:0.000923 t:3.1s +tttg: c41/219 lr:0.000919 t:3.2s +tttg: c42/219 lr:0.000915 t:3.3s +tttg: c43/219 lr:0.000911 t:3.3s +tttg: c44/219 lr:0.000907 t:3.4s +tttg: c45/219 lr:0.000903 t:3.5s +tttg: c46/219 lr:0.000898 t:3.6s +tttg: c47/219 lr:0.000894 t:3.7s +tttg: c48/219 lr:0.000890 t:3.7s +tttg: c49/219 lr:0.000885 t:3.8s +tttg: c50/219 lr:0.000880 t:3.9s +tttg: c51/219 lr:0.000876 t:4.0s +tttg: c52/219 lr:0.000871 t:4.1s +tttg: c53/219 lr:0.000866 t:4.1s +tttg: c54/219 lr:0.000861 t:4.2s +tttg: c55/219 lr:0.000856 t:4.3s +tttg: c56/219 lr:0.000851 t:4.4s +tttg: c57/219 lr:0.000846 t:4.5s +tttg: c58/219 lr:0.000841 t:4.5s +tttg: c59/219 lr:0.000835 t:4.6s +tttg: c60/219 lr:0.000830 t:4.7s +tttg: c61/219 lr:0.000824 t:4.8s +tttg: c62/219 lr:0.000819 t:4.9s +tttg: c63/219 lr:0.000813 t:4.9s +tttg: c64/219 lr:0.000808 t:5.0s +tttg: c65/219 lr:0.000802 t:5.1s +tttg: c66/219 lr:0.000796 t:5.2s +tttg: c67/219 lr:0.000790 t:5.2s +tttg: c68/219 lr:0.000784 t:5.3s +tttg: c69/219 lr:0.000779 t:5.4s +tttg: c70/219 lr:0.000773 t:5.5s +tttg: c71/219 lr:0.000766 t:5.5s +tttg: c72/219 lr:0.000760 t:5.6s +tttg: c73/219 lr:0.000754 t:5.7s +tttg: c74/219 lr:0.000748 t:5.8s +tttg: c75/219 lr:0.000742 t:5.9s +tttg: c76/219 lr:0.000735 t:5.9s +tttg: c77/219 lr:0.000729 t:6.0s +tttg: c78/219 lr:0.000722 t:6.1s +tttg: c79/219 lr:0.000716 t:6.2s +tttg: c80/219 lr:0.000709 t:6.3s +tttg: c81/219 lr:0.000703 t:6.3s +tttg: c82/219 lr:0.000696 t:6.4s +tttg: c83/219 lr:0.000690 t:6.5s +tttg: c84/219 lr:0.000683 t:6.6s +tttg: c85/219 lr:0.000676 t:6.7s +tttg: c86/219 lr:0.000670 t:6.7s +tttg: c87/219 lr:0.000663 t:6.8s +tttg: c88/219 lr:0.000656 t:6.9s +tttg: c89/219 lr:0.000649 t:7.0s +tttg: c90/219 lr:0.000642 t:7.0s +tttg: c91/219 lr:0.000635 t:7.1s +tttg: c92/219 lr:0.000628 t:7.2s +tttg: c93/219 lr:0.000621 t:7.3s +tttg: c94/219 lr:0.000614 t:7.3s +tttg: c95/219 lr:0.000607 t:7.4s +tttg: c96/219 lr:0.000600 t:7.5s +tttg: c97/219 lr:0.000593 t:7.6s +tttg: c98/219 lr:0.000586 t:7.7s +tttg: c99/219 lr:0.000579 t:7.7s +tttg: c100/219 lr:0.000572 t:7.8s +tttg: c101/219 lr:0.000565 t:7.9s +tttg: c102/219 lr:0.000558 t:8.0s +tttg: c103/219 lr:0.000550 t:8.0s +tttg: c104/219 lr:0.000543 t:8.1s +tttg: c105/219 lr:0.000536 t:8.2s +tttg: c106/219 lr:0.000529 t:8.3s +tttg: c107/219 lr:0.000522 t:8.4s +tttg: c108/219 lr:0.000514 t:8.4s +tttg: c109/219 lr:0.000507 t:8.5s +tttg: c110/219 lr:0.000500 t:8.6s +tttg: c111/219 lr:0.000493 t:8.7s +tttg: c112/219 lr:0.000486 t:8.8s +tttg: c113/219 lr:0.000478 t:8.8s +tttg: c114/219 lr:0.000471 t:8.9s +tttg: c115/219 lr:0.000464 t:9.0s +tttg: c116/219 lr:0.000457 t:9.1s +tttg: c117/219 lr:0.000450 t:9.2s +tttg: c118/219 lr:0.000442 t:9.2s +tttg: c119/219 lr:0.000435 t:9.3s +tttg: c120/219 lr:0.000428 t:9.4s +tttg: c121/219 lr:0.000421 t:9.5s +tttg: c122/219 lr:0.000414 t:9.6s +tttg: c123/219 lr:0.000407 t:9.6s +tttg: c124/219 lr:0.000400 t:9.7s +tttg: c125/219 lr:0.000393 t:9.8s +tttg: c126/219 lr:0.000386 t:9.9s +tttg: c127/219 lr:0.000379 t:9.9s +tttg: c128/219 lr:0.000372 t:10.0s +tttg: c129/219 lr:0.000365 t:10.1s +tttg: c130/219 lr:0.000358 t:10.2s +tttg: c131/219 lr:0.000351 t:10.3s +tttg: c132/219 lr:0.000344 t:10.3s +tttg: c133/219 lr:0.000337 t:10.4s +tttg: c134/219 lr:0.000330 t:10.5s +tttg: c135/219 lr:0.000324 t:10.6s +tttg: c136/219 lr:0.000317 t:10.6s +tttg: c137/219 lr:0.000310 t:10.7s +tttg: c138/219 lr:0.000304 t:10.8s +tttg: c139/219 lr:0.000297 t:10.9s +tttg: c140/219 lr:0.000291 t:11.0s +tttg: c141/219 lr:0.000284 t:11.0s +tttg: c142/219 lr:0.000278 t:11.1s +tttg: c143/219 lr:0.000271 t:11.2s +tttg: c144/219 lr:0.000265 t:11.3s +tttg: c145/219 lr:0.000258 t:11.4s +tttg: c146/219 lr:0.000252 t:11.4s +tttg: c147/219 lr:0.000246 t:11.5s +tttg: c148/219 lr:0.000240 t:11.6s +tttg: c149/219 lr:0.000234 t:11.7s +tttg: c150/219 lr:0.000227 t:11.7s +tttg: c151/219 lr:0.000221 t:11.8s +tttg: c152/219 lr:0.000216 t:11.9s +tttg: c153/219 lr:0.000210 t:12.0s +tttg: c154/219 lr:0.000204 t:12.1s +tttg: c155/219 lr:0.000198 t:12.2s +tttg: c156/219 lr:0.000192 t:12.2s +tttg: c157/219 lr:0.000187 t:12.3s +tttg: c158/219 lr:0.000181 t:12.4s +tttg: c159/219 lr:0.000176 t:12.5s +tttg: c160/219 lr:0.000170 t:12.6s +tttg: c161/219 lr:0.000165 t:12.6s +tttg: c162/219 lr:0.000159 t:12.7s +tttg: c163/219 lr:0.000154 t:12.8s +tttg: c164/219 lr:0.000149 t:12.9s +tttg: c165/219 lr:0.000144 t:12.9s +tttg: c166/219 lr:0.000139 t:13.0s +tttg: c167/219 lr:0.000134 t:13.1s +tttg: c168/219 lr:0.000129 t:13.2s +tttg: c169/219 lr:0.000124 t:13.3s +tttg: c170/219 lr:0.000120 t:13.3s +tttg: c171/219 lr:0.000115 t:13.4s +tttg: c172/219 lr:0.000110 t:13.5s +tttg: c173/219 lr:0.000106 t:13.6s +tttg: c174/219 lr:0.000102 t:13.7s +tttg: c175/219 lr:0.000097 t:13.7s +tttg: c176/219 lr:0.000093 t:13.8s +tttg: c177/219 lr:0.000089 t:13.9s +tttg: c178/219 lr:0.000085 t:14.0s +tttg: c179/219 lr:0.000081 t:14.1s +tttg: c180/219 lr:0.000077 t:14.1s +tttg: c181/219 lr:0.000073 t:14.2s +tttg: c182/219 lr:0.000069 t:14.3s +tttg: c183/219 lr:0.000066 t:14.4s +tttg: c184/219 lr:0.000062 t:14.4s +tttg: c185/219 lr:0.000059 t:14.5s +tttg: c186/219 lr:0.000055 t:14.6s +tttg: c187/219 lr:0.000052 t:14.7s +tttg: c188/219 lr:0.000049 t:14.8s +tttg: c189/219 lr:0.000046 t:14.8s +tttg: c190/219 lr:0.000043 t:14.9s +tttg: c191/219 lr:0.000040 t:15.0s +tttg: c192/219 lr:0.000037 t:15.1s +tttg: c193/219 lr:0.000035 t:15.1s +tttg: c194/219 lr:0.000032 t:15.2s +tttg: c195/219 lr:0.000030 t:15.3s +tttg: c196/219 lr:0.000027 t:15.4s +tttg: c197/219 lr:0.000025 t:15.5s +tttg: c198/219 lr:0.000023 t:15.5s +tttg: c199/219 lr:0.000021 t:15.6s +tttg: c200/219 lr:0.000019 t:15.7s +tttg: c201/219 lr:0.000017 t:15.8s +tttg: c202/219 lr:0.000015 t:15.9s +tttg: c203/219 lr:0.000013 t:15.9s +tttg: c204/219 lr:0.000012 t:16.0s +tttg: c205/219 lr:0.000010 t:16.1s +tttg: c206/219 lr:0.000009 t:16.2s +tttg: c207/219 lr:0.000007 t:16.3s +tttg: c208/219 lr:0.000006 t:16.3s +tttg: c209/219 lr:0.000005 t:16.4s +tttg: c210/219 lr:0.000004 t:16.5s +tttg: c211/219 lr:0.000003 t:16.6s +tttg: c212/219 lr:0.000003 t:16.6s +tttg: c213/219 lr:0.000002 t:16.7s +tttg: c214/219 lr:0.000001 t:16.8s +tttg: c215/219 lr:0.000001 t:16.9s +tttg: c216/219 lr:0.000000 t:16.9s +tttg: c217/219 lr:0.000000 t:17.0s +tttg: c218/219 lr:0.000000 t:17.1s +ttpr: phase:2/3 t:277.8s +ttp: b741/782 bl:2.3106 bb:1.0362 rl:2.2914 rb:1.0677 dl:2686-2730 gd:0 +ttp: b740/782 bl:2.2548 bb:1.0350 rl:2.2886 rb:1.0651 dl:2653-2686 gd:0 +ttpp: phase:3/3 pd:2960 gd:2500 t:292.6s +tttg: c1/289 lr:0.001000 t:0.1s +tttg: c2/289 lr:0.001000 t:0.1s +tttg: c3/289 lr:0.001000 t:0.2s +tttg: c4/289 lr:0.001000 t:0.3s +tttg: c5/289 lr:0.001000 t:0.4s +tttg: c6/289 lr:0.000999 t:0.5s +tttg: c7/289 lr:0.000999 t:0.5s +tttg: c8/289 lr:0.000999 t:0.6s +tttg: c9/289 lr:0.000998 t:0.7s +tttg: c10/289 lr:0.000998 t:0.8s +tttg: c11/289 lr:0.000997 t:0.9s +tttg: c12/289 lr:0.000996 t:0.9s +tttg: c13/289 lr:0.000996 t:1.0s +tttg: c14/289 lr:0.000995 t:1.1s +tttg: c15/289 lr:0.000994 t:1.2s +tttg: c16/289 lr:0.000993 t:1.2s +tttg: c17/289 lr:0.000992 t:1.3s +tttg: c18/289 lr:0.000991 t:1.4s +tttg: c19/289 lr:0.000990 t:1.5s +tttg: c20/289 lr:0.000989 t:1.6s +tttg: c21/289 lr:0.000988 t:1.6s +tttg: c22/289 lr:0.000987 t:1.7s +tttg: c23/289 lr:0.000986 t:1.8s +tttg: c24/289 lr:0.000984 t:1.9s +tttg: c25/289 lr:0.000983 t:1.9s +tttg: c26/289 lr:0.000982 t:2.0s +tttg: c27/289 lr:0.000980 t:2.1s +tttg: c28/289 lr:0.000978 t:2.2s +tttg: c29/289 lr:0.000977 t:2.3s +tttg: c30/289 lr:0.000975 t:2.3s +tttg: c31/289 lr:0.000973 t:2.4s +tttg: c32/289 lr:0.000972 t:2.5s +tttg: c33/289 lr:0.000970 t:2.6s +tttg: c34/289 lr:0.000968 t:2.7s +tttg: c35/289 lr:0.000966 t:2.7s +tttg: c36/289 lr:0.000964 t:2.8s +tttg: c37/289 lr:0.000962 t:2.9s +tttg: c38/289 lr:0.000960 t:3.0s +tttg: c39/289 lr:0.000958 t:3.1s +tttg: c40/289 lr:0.000955 t:3.1s +tttg: c41/289 lr:0.000953 t:3.2s +tttg: c42/289 lr:0.000951 t:3.3s +tttg: c43/289 lr:0.000948 t:3.4s +tttg: c44/289 lr:0.000946 t:3.5s +tttg: c45/289 lr:0.000944 t:3.5s +tttg: c46/289 lr:0.000941 t:3.6s +tttg: c47/289 lr:0.000938 t:3.7s +tttg: c48/289 lr:0.000936 t:3.8s +tttg: c49/289 lr:0.000933 t:3.8s +tttg: c50/289 lr:0.000930 t:3.9s +tttg: c51/289 lr:0.000927 t:4.0s +tttg: c52/289 lr:0.000925 t:4.1s +tttg: c53/289 lr:0.000922 t:4.1s +tttg: c54/289 lr:0.000919 t:4.2s +tttg: c55/289 lr:0.000916 t:4.3s +tttg: c56/289 lr:0.000913 t:4.4s +tttg: c57/289 lr:0.000910 t:4.5s +tttg: c58/289 lr:0.000906 t:4.5s +tttg: c59/289 lr:0.000903 t:4.6s +tttg: c60/289 lr:0.000900 t:4.7s +tttg: c61/289 lr:0.000897 t:4.8s +tttg: c62/289 lr:0.000893 t:4.9s +tttg: c63/289 lr:0.000890 t:4.9s +tttg: c64/289 lr:0.000887 t:5.0s +tttg: c65/289 lr:0.000883 t:5.1s +tttg: c66/289 lr:0.000879 t:5.2s +tttg: c67/289 lr:0.000876 t:5.2s +tttg: c68/289 lr:0.000872 t:5.3s +tttg: c69/289 lr:0.000869 t:5.4s +tttg: c70/289 lr:0.000865 t:5.5s +tttg: c71/289 lr:0.000861 t:5.6s +tttg: c72/289 lr:0.000857 t:5.6s +tttg: c73/289 lr:0.000854 t:5.7s +tttg: c74/289 lr:0.000850 t:5.8s +tttg: c75/289 lr:0.000846 t:5.9s +tttg: c76/289 lr:0.000842 t:5.9s +tttg: c77/289 lr:0.000838 t:6.0s +tttg: c78/289 lr:0.000834 t:6.1s +tttg: c79/289 lr:0.000830 t:6.2s +tttg: c80/289 lr:0.000826 t:6.3s +tttg: c81/289 lr:0.000821 t:6.3s +tttg: c82/289 lr:0.000817 t:6.4s +tttg: c83/289 lr:0.000813 t:6.5s +tttg: c84/289 lr:0.000809 t:6.6s +tttg: c85/289 lr:0.000804 t:6.6s +tttg: c86/289 lr:0.000800 t:6.7s +tttg: c87/289 lr:0.000796 t:6.8s +tttg: c88/289 lr:0.000791 t:6.9s +tttg: c89/289 lr:0.000787 t:7.0s +tttg: c90/289 lr:0.000782 t:7.0s +tttg: c91/289 lr:0.000778 t:7.1s +tttg: c92/289 lr:0.000773 t:7.2s +tttg: c93/289 lr:0.000769 t:7.3s +tttg: c94/289 lr:0.000764 t:7.3s +tttg: c95/289 lr:0.000759 t:7.4s +tttg: c96/289 lr:0.000755 t:7.5s +tttg: c97/289 lr:0.000750 t:7.6s +tttg: c98/289 lr:0.000745 t:7.7s +tttg: c99/289 lr:0.000740 t:7.7s +tttg: c100/289 lr:0.000736 t:7.8s +tttg: c101/289 lr:0.000731 t:7.9s +tttg: c102/289 lr:0.000726 t:8.0s +tttg: c103/289 lr:0.000721 t:8.0s +tttg: c104/289 lr:0.000716 t:8.1s +tttg: c105/289 lr:0.000711 t:8.2s +tttg: c106/289 lr:0.000706 t:8.3s +tttg: c107/289 lr:0.000701 t:8.4s +tttg: c108/289 lr:0.000696 t:8.4s +tttg: c109/289 lr:0.000691 t:8.5s +tttg: c110/289 lr:0.000686 t:8.6s +tttg: c111/289 lr:0.000681 t:8.7s +tttg: c112/289 lr:0.000676 t:8.7s +tttg: c113/289 lr:0.000671 t:8.8s +tttg: c114/289 lr:0.000666 t:8.9s +tttg: c115/289 lr:0.000661 t:9.0s +tttg: c116/289 lr:0.000656 t:9.1s +tttg: c117/289 lr:0.000650 t:9.1s +tttg: c118/289 lr:0.000645 t:9.2s +tttg: c119/289 lr:0.000640 t:9.3s +tttg: c120/289 lr:0.000635 t:9.4s +tttg: c121/289 lr:0.000629 t:9.5s +tttg: c122/289 lr:0.000624 t:9.5s +tttg: c123/289 lr:0.000619 t:9.6s +tttg: c124/289 lr:0.000614 t:9.7s +tttg: c125/289 lr:0.000608 t:9.8s +tttg: c126/289 lr:0.000603 t:9.8s +tttg: c127/289 lr:0.000598 t:9.9s +tttg: c128/289 lr:0.000592 t:10.0s +tttg: c129/289 lr:0.000587 t:10.1s +tttg: c130/289 lr:0.000581 t:10.2s +tttg: c131/289 lr:0.000576 t:10.2s +tttg: c132/289 lr:0.000571 t:10.3s +tttg: c133/289 lr:0.000565 t:10.4s +tttg: c134/289 lr:0.000560 t:10.5s +tttg: c135/289 lr:0.000554 t:10.5s +tttg: c136/289 lr:0.000549 t:10.6s +tttg: c137/289 lr:0.000544 t:10.7s +tttg: c138/289 lr:0.000538 t:10.8s +tttg: c139/289 lr:0.000533 t:10.9s +tttg: c140/289 lr:0.000527 t:10.9s +tttg: c141/289 lr:0.000522 t:11.0s +tttg: c142/289 lr:0.000516 t:11.1s +tttg: c143/289 lr:0.000511 t:11.2s +tttg: c144/289 lr:0.000505 t:12.6s +tttg: c145/289 lr:0.000500 t:12.6s +tttg: c146/289 lr:0.000495 t:12.7s +tttg: c147/289 lr:0.000489 t:12.8s +tttg: c148/289 lr:0.000484 t:12.8s +tttg: c149/289 lr:0.000478 t:12.9s +tttg: c150/289 lr:0.000473 t:13.0s +tttg: c151/289 lr:0.000467 t:13.1s +tttg: c152/289 lr:0.000462 t:13.1s +tttg: c153/289 lr:0.000456 t:13.2s +tttg: c154/289 lr:0.000451 t:13.3s +tttg: c155/289 lr:0.000446 t:13.4s +tttg: c156/289 lr:0.000440 t:13.5s +tttg: c157/289 lr:0.000435 t:13.5s +tttg: c158/289 lr:0.000429 t:13.6s +tttg: c159/289 lr:0.000424 t:13.7s +tttg: c160/289 lr:0.000419 t:13.8s +tttg: c161/289 lr:0.000413 t:13.8s +tttg: c162/289 lr:0.000408 t:13.9s +tttg: c163/289 lr:0.000402 t:14.0s +tttg: c164/289 lr:0.000397 t:14.1s +tttg: c165/289 lr:0.000392 t:14.2s +tttg: c166/289 lr:0.000386 t:14.2s +tttg: c167/289 lr:0.000381 t:14.3s +tttg: c168/289 lr:0.000376 t:14.4s +tttg: c169/289 lr:0.000371 t:14.5s +tttg: c170/289 lr:0.000365 t:14.6s +tttg: c171/289 lr:0.000360 t:14.6s +tttg: c172/289 lr:0.000355 t:14.7s +tttg: c173/289 lr:0.000350 t:14.8s +tttg: c174/289 lr:0.000344 t:14.9s +tttg: c175/289 lr:0.000339 t:14.9s +tttg: c176/289 lr:0.000334 t:15.0s +tttg: c177/289 lr:0.000329 t:15.1s +tttg: c178/289 lr:0.000324 t:15.2s +tttg: c179/289 lr:0.000319 t:15.2s +tttg: c180/289 lr:0.000314 t:15.3s +tttg: c181/289 lr:0.000309 t:15.4s +tttg: c182/289 lr:0.000304 t:15.5s +tttg: c183/289 lr:0.000299 t:15.6s +tttg: c184/289 lr:0.000294 t:15.6s +tttg: c185/289 lr:0.000289 t:15.7s +tttg: c186/289 lr:0.000284 t:15.8s +tttg: c187/289 lr:0.000279 t:15.9s +tttg: c188/289 lr:0.000274 t:15.9s +tttg: c189/289 lr:0.000269 t:16.0s +tttg: c190/289 lr:0.000264 t:16.1s +tttg: c191/289 lr:0.000260 t:16.2s +tttg: c192/289 lr:0.000255 t:16.3s +tttg: c193/289 lr:0.000250 t:16.3s +tttg: c194/289 lr:0.000245 t:16.4s +tttg: c195/289 lr:0.000241 t:16.5s +tttg: c196/289 lr:0.000236 t:16.6s +tttg: c197/289 lr:0.000231 t:16.6s +tttg: c198/289 lr:0.000227 t:16.7s +tttg: c199/289 lr:0.000222 t:16.8s +tttg: c200/289 lr:0.000218 t:16.9s +tttg: c201/289 lr:0.000213 t:16.9s +tttg: c202/289 lr:0.000209 t:17.0s +tttg: c203/289 lr:0.000204 t:17.1s +tttg: c204/289 lr:0.000200 t:17.2s +tttg: c205/289 lr:0.000196 t:17.3s +tttg: c206/289 lr:0.000191 t:17.3s +tttg: c207/289 lr:0.000187 t:17.4s +tttg: c208/289 lr:0.000183 t:17.5s +tttg: c209/289 lr:0.000179 t:17.6s +tttg: c210/289 lr:0.000174 t:17.6s +tttg: c211/289 lr:0.000170 t:17.7s +tttg: c212/289 lr:0.000166 t:17.8s +tttg: c213/289 lr:0.000162 t:17.9s +tttg: c214/289 lr:0.000158 t:17.9s +tttg: c215/289 lr:0.000154 t:18.0s +tttg: c216/289 lr:0.000150 t:18.1s +tttg: c217/289 lr:0.000146 t:18.2s +tttg: c218/289 lr:0.000143 t:18.3s +tttg: c219/289 lr:0.000139 t:18.3s +tttg: c220/289 lr:0.000135 t:18.4s +tttg: c221/289 lr:0.000131 t:18.5s +tttg: c222/289 lr:0.000128 t:18.6s +tttg: c223/289 lr:0.000124 t:18.6s +tttg: c224/289 lr:0.000121 t:18.7s +tttg: c225/289 lr:0.000117 t:18.8s +tttg: c226/289 lr:0.000113 t:18.9s +tttg: c227/289 lr:0.000110 t:18.9s +tttg: c228/289 lr:0.000107 t:19.0s +tttg: c229/289 lr:0.000103 t:19.1s +tttg: c230/289 lr:0.000100 t:19.2s +tttg: c231/289 lr:0.000097 t:19.3s +tttg: c232/289 lr:0.000094 t:19.3s +tttg: c233/289 lr:0.000090 t:19.4s +tttg: c234/289 lr:0.000087 t:19.5s +tttg: c235/289 lr:0.000084 t:19.6s +tttg: c236/289 lr:0.000081 t:19.6s +tttg: c237/289 lr:0.000078 t:19.7s +tttg: c238/289 lr:0.000075 t:19.8s +tttg: c239/289 lr:0.000073 t:19.9s +tttg: c240/289 lr:0.000070 t:20.0s +tttg: c241/289 lr:0.000067 t:20.0s +tttg: c242/289 lr:0.000064 t:20.1s +tttg: c243/289 lr:0.000062 t:20.2s +tttg: c244/289 lr:0.000059 t:20.3s +tttg: c245/289 lr:0.000056 t:20.3s +tttg: c246/289 lr:0.000054 t:20.4s +tttg: c247/289 lr:0.000052 t:20.5s +tttg: c248/289 lr:0.000049 t:20.6s +tttg: c249/289 lr:0.000047 t:20.7s +tttg: c250/289 lr:0.000045 t:20.7s +tttg: c251/289 lr:0.000042 t:20.8s +tttg: c252/289 lr:0.000040 t:20.9s +tttg: c253/289 lr:0.000038 t:21.0s +tttg: c254/289 lr:0.000036 t:21.1s +tttg: c255/289 lr:0.000034 t:21.1s +tttg: c256/289 lr:0.000032 t:21.2s +tttg: c257/289 lr:0.000030 t:21.3s +tttg: c258/289 lr:0.000028 t:21.4s +tttg: c259/289 lr:0.000027 t:21.4s +tttg: c260/289 lr:0.000025 t:21.5s +tttg: c261/289 lr:0.000023 t:21.6s +tttg: c262/289 lr:0.000022 t:21.7s +tttg: c263/289 lr:0.000020 t:21.7s +tttg: c264/289 lr:0.000018 t:21.8s +tttg: c265/289 lr:0.000017 t:21.9s +tttg: c266/289 lr:0.000016 t:22.0s +tttg: c267/289 lr:0.000014 t:22.0s +tttg: c268/289 lr:0.000013 t:22.1s +tttg: c269/289 lr:0.000012 t:22.2s +tttg: c270/289 lr:0.000011 t:22.3s +tttg: c271/289 lr:0.000010 t:22.4s +tttg: c272/289 lr:0.000009 t:22.4s +tttg: c273/289 lr:0.000008 t:22.5s +tttg: c274/289 lr:0.000007 t:22.6s +tttg: c275/289 lr:0.000006 t:22.7s +tttg: c276/289 lr:0.000005 t:22.7s +tttg: c277/289 lr:0.000004 t:22.8s +tttg: c278/289 lr:0.000004 t:22.9s +tttg: c279/289 lr:0.000003 t:23.0s +tttg: c280/289 lr:0.000002 t:23.0s +tttg: c281/289 lr:0.000002 t:23.1s +tttg: c282/289 lr:0.000001 t:23.2s +tttg: c283/289 lr:0.000001 t:23.3s +tttg: c284/289 lr:0.000001 t:23.4s +tttg: c285/289 lr:0.000000 t:23.4s +tttg: c286/289 lr:0.000000 t:23.5s +tttg: c287/289 lr:0.000000 t:23.6s +tttg: c288/289 lr:0.000000 t:23.7s +ttpr: phase:3/3 t:317.3s +ttp: b730/782 bl:2.2722 bb:0.9985 rl:2.2875 rb:1.0605 dl:2352-2376 gd:1 +ttp: b725/782 bl:2.3146 bb:1.0412 rl:2.2891 rb:1.0594 dl:2232-2254 gd:1 +ttp: b717/782 bl:2.2499 bb:1.0302 rl:2.2871 rb:1.0579 dl:2070-2088 gd:1 +ttp: b711/782 bl:2.2815 bb:1.0202 rl:2.2868 rb:1.0561 dl:1966-1983 gd:1 +ttp: b697/782 bl:2.3235 bb:1.0309 rl:2.2883 rb:1.0550 dl:1790-1803 gd:1 +ttp: b691/782 bl:2.4464 bb:1.0650 rl:2.2942 rb:1.0554 dl:1725-1737 gd:1 +ttp: b682/782 bl:2.3422 bb:1.0570 rl:2.2959 rb:1.0555 dl:1638-1646 gd:1 +ttp: b677/782 bl:2.3048 bb:1.0326 rl:2.2961 rb:1.0547 dl:1595-1601 gd:1 +ttp: b667/782 bl:2.3617 bb:1.0676 rl:2.2981 rb:1.0551 dl:1514-1521 gd:1 +ttp: b661/782 bl:2.3986 bb:1.0843 rl:2.3009 rb:1.0559 dl:1474-1480 gd:1 +ttp: b654/782 bl:2.2905 bb:1.0360 rl:2.3007 rb:1.0554 dl:1425-1432 gd:1 +ttp: b646/782 bl:2.2662 bb:1.0479 rl:2.2998 rb:1.0552 dl:1375-1382 gd:1 +ttp: b638/782 bl:2.3404 bb:1.0663 rl:2.3007 rb:1.0555 dl:1325-1331 gd:1 +ttp: b630/782 bl:2.3204 bb:1.0381 rl:2.3012 rb:1.0551 dl:1280-1285 gd:1 +ttp: b622/782 bl:2.2570 bb:1.0310 rl:2.3003 rb:1.0546 dl:1237-1243 gd:1 +ttp: b614/782 bl:2.3159 bb:1.0522 rl:2.3006 rb:1.0545 dl:1195-1200 gd:1 +ttp: b607/782 bl:2.3496 bb:1.0511 rl:2.3015 rb:1.0544 dl:1164-1168 gd:1 +ttp: b599/782 bl:2.3618 bb:1.0684 rl:2.3026 rb:1.0547 dl:1129-1133 gd:1 +ttp: b591/782 bl:2.3029 bb:1.0306 rl:2.3026 rb:1.0543 dl:1093-1098 gd:1 +ttp: b583/782 bl:2.3209 bb:1.0313 rl:2.3029 rb:1.0539 dl:1060-1064 gd:1 +ttp: b573/782 bl:2.3619 bb:1.0647 rl:2.3038 rb:1.0541 dl:1021-1025 gd:1 +ttp: b565/782 bl:2.3806 bb:1.0313 rl:2.3050 rb:1.0537 dl:993-997 gd:1 +ttp: b557/782 bl:2.3388 bb:1.0506 rl:2.3054 rb:1.0537 dl:965-968 gd:1 +ttp: b548/782 bl:2.2416 bb:1.0472 rl:2.3046 rb:1.0536 dl:937-939 gd:1 +ttp: b541/782 bl:2.3254 bb:1.0318 rl:2.3048 rb:1.0533 dl:915-918 gd:1 +ttp: b532/782 bl:2.3846 bb:1.0650 rl:2.3058 rb:1.0534 dl:887-889 gd:1 +ttp: b525/782 bl:2.3466 bb:1.0170 rl:2.3063 rb:1.0530 dl:866-869 gd:1 +ttp: b515/782 bl:2.3379 bb:1.0411 rl:2.3067 rb:1.0528 dl:838-841 gd:1 +ttp: b507/782 bl:2.2968 bb:1.0284 rl:2.3066 rb:1.0525 dl:814-817 gd:1 +ttp: b503/782 bl:2.3460 bb:1.0629 rl:2.3070 rb:1.0527 dl:804-807 gd:1 +ttp: b495/782 bl:2.3044 bb:1.0293 rl:2.3070 rb:1.0524 dl:783-785 gd:1 +ttp: b487/782 bl:2.2751 bb:1.0652 rl:2.3067 rb:1.0525 dl:764-766 gd:1 +ttp: b479/782 bl:2.4027 bb:1.0796 rl:2.3076 rb:1.0528 dl:744-747 gd:1 +ttp: b471/782 bl:2.3966 bb:1.0821 rl:2.3085 rb:1.0531 dl:726-728 gd:1 +ttp: b462/782 bl:2.3292 bb:1.0338 rl:2.3086 rb:1.0529 dl:706-708 gd:1 +ttp: b454/782 bl:2.3848 bb:1.0831 rl:2.3093 rb:1.0532 dl:689-691 gd:1 +ttp: b447/782 bl:2.3230 bb:1.0671 rl:2.3094 rb:1.0533 dl:674-676 gd:1 +ttp: b436/782 bl:2.2682 bb:1.0477 rl:2.3091 rb:1.0532 dl:651-653 gd:1 +ttp: b428/782 bl:2.3017 bb:1.0488 rl:2.3090 rb:1.0532 dl:636-638 gd:1 +ttp: b420/782 bl:2.3553 bb:1.0514 rl:2.3094 rb:1.0532 dl:620-622 gd:1 +ttp: b414/782 bl:2.1976 bb:1.0061 rl:2.3086 rb:1.0528 dl:609-611 gd:1 +ttp: b406/782 bl:2.3118 bb:1.0646 rl:2.3086 rb:1.0529 dl:593-595 gd:1 +ttp: b398/782 bl:2.2443 bb:1.0022 rl:2.3081 rb:1.0526 dl:579-581 gd:1 +ttp: b388/782 bl:2.3062 bb:1.0400 rl:2.3081 rb:1.0525 dl:561-562 gd:1 +ttp: b381/782 bl:2.4213 bb:1.1007 rl:2.3089 rb:1.0528 dl:549-550 gd:1 +ttp: b373/782 bl:2.4069 bb:1.0983 rl:2.3095 rb:1.0531 dl:535-537 gd:1 +ttp: b366/782 bl:2.3291 bb:1.0670 rl:2.3096 rb:1.0532 dl:524-525 gd:1 +ttp: b360/782 bl:2.3018 bb:1.0768 rl:2.3096 rb:1.0533 dl:513-515 gd:1 +ttp: b353/782 bl:2.1965 bb:1.0044 rl:2.3089 rb:1.0530 dl:501-503 gd:1 +ttp: b346/782 bl:2.3643 bb:1.0674 rl:2.3092 rb:1.0531 dl:491-492 gd:1 +ttp: b337/782 bl:2.3104 bb:1.0514 rl:2.3092 rb:1.0531 dl:477-478 gd:1 +ttp: b329/782 bl:2.2761 bb:1.0784 rl:2.3090 rb:1.0532 dl:465-466 gd:1 +ttp: b321/782 bl:2.3516 bb:1.0736 rl:2.3093 rb:1.0533 dl:453-455 gd:1 +ttp: b313/782 bl:2.2840 bb:1.0762 rl:2.3091 rb:1.0534 dl:440-442 gd:1 +ttp: b306/782 bl:2.3803 bb:1.0582 rl:2.3095 rb:1.0535 dl:430-432 gd:1 +ttp: b298/782 bl:2.4172 bb:1.1007 rl:2.3100 rb:1.0537 dl:418-420 gd:1 +ttp: b290/782 bl:2.3334 bb:1.0688 rl:2.3101 rb:1.0538 dl:406-407 gd:1 +ttp: b283/782 bl:2.3647 bb:1.1244 rl:2.3103 rb:1.0541 dl:396-398 gd:1 +ttp: b275/782 bl:2.3433 bb:1.0558 rl:2.3105 rb:1.0541 dl:385-386 gd:1 +ttp: b264/782 bl:2.4161 bb:1.1010 rl:2.3109 rb:1.0543 dl:371-372 gd:1 +ttp: b257/782 bl:2.4385 bb:1.1092 rl:2.3114 rb:1.0545 dl:362-364 gd:1 +ttp: b252/782 bl:2.3759 bb:1.0649 rl:2.3117 rb:1.0545 dl:356-357 gd:1 +ttp: b246/782 bl:2.3482 bb:1.0976 rl:2.3118 rb:1.0547 dl:349-350 gd:1 +ttp: b238/782 bl:2.3193 bb:1.1062 rl:2.3118 rb:1.0549 dl:338-340 gd:1 +ttp: b229/782 bl:2.3646 bb:1.0657 rl:2.3120 rb:1.0549 dl:328-329 gd:1 +ttp: b222/782 bl:2.3761 bb:1.1106 rl:2.3122 rb:1.0551 dl:320-321 gd:1 +ttp: b214/782 bl:2.3356 bb:1.1177 rl:2.3123 rb:1.0553 dl:310-312 gd:1 +ttp: b206/782 bl:2.4028 bb:1.1054 rl:2.3126 rb:1.0554 dl:302-303 gd:1 +ttp: b198/782 bl:2.3928 bb:1.0586 rl:2.3129 rb:1.0555 dl:294-295 gd:1 +ttp: b190/782 bl:2.3366 bb:1.0743 rl:2.3129 rb:1.0555 dl:284-285 gd:1 +ttp: b182/782 bl:2.3520 bb:1.1183 rl:2.3130 rb:1.0557 dl:276-277 gd:1 +ttp: b174/782 bl:2.4417 bb:1.1516 rl:2.3134 rb:1.0560 dl:268-269 gd:1 +ttp: b168/782 bl:2.4448 bb:1.1828 rl:2.3138 rb:1.0563 dl:263-263 gd:1 +ttp: b159/782 bl:2.4722 bb:1.1470 rl:2.3142 rb:1.0565 dl:254-255 gd:1 +ttp: b153/782 bl:2.2537 bb:1.0425 rl:2.3140 rb:1.0565 dl:248-249 gd:1 +ttp: b146/782 bl:2.4508 bb:1.1710 rl:2.3144 rb:1.0568 dl:241-242 gd:1 +ttp: b137/782 bl:2.4064 bb:1.1497 rl:2.3146 rb:1.0570 dl:233-233 gd:1 +ttp: b129/782 bl:2.3810 bb:1.1407 rl:2.3148 rb:1.0572 dl:225-226 gd:1 +ttp: b121/782 bl:2.4190 bb:1.1040 rl:2.3150 rb:1.0573 dl:218-219 gd:1 +ttp: b115/782 bl:2.4497 bb:1.1593 rl:2.3153 rb:1.0575 dl:212-213 gd:1 +ttp: b107/782 bl:2.4324 bb:1.1649 rl:2.3156 rb:1.0577 dl:205-206 gd:1 +ttp: b99/782 bl:2.4869 bb:1.1712 rl:2.3159 rb:1.0579 dl:198-199 gd:1 +ttp: b92/782 bl:2.4303 bb:1.1564 rl:2.3161 rb:1.0581 dl:191-192 gd:1 +ttp: b87/782 bl:2.4472 bb:1.1680 rl:2.3164 rb:1.0583 dl:187-188 gd:1 +ttp: b80/782 bl:2.4589 bb:1.1461 rl:2.3166 rb:1.0585 dl:181-182 gd:1 +ttp: b72/782 bl:2.3609 bb:1.1428 rl:2.3167 rb:1.0586 dl:173-174 gd:1 +ttp: b66/782 bl:2.6313 bb:1.2314 rl:2.3173 rb:1.0589 dl:169-169 gd:1 +ttp: b58/782 bl:2.5125 bb:1.2194 rl:2.3176 rb:1.0592 dl:161-162 gd:1 +ttp: b50/782 bl:2.3935 bb:1.1599 rl:2.3177 rb:1.0593 dl:153-154 gd:1 +ttp: b42/782 bl:2.4746 bb:1.2050 rl:2.3179 rb:1.0595 dl:145-146 gd:1 +ttp: b27/782 bl:2.5900 bb:1.2244 rl:2.3183 rb:1.0597 dl:130-131 gd:1 +ttp: b20/782 bl:2.5835 bb:1.2371 rl:2.3186 rb:1.0599 dl:122-123 gd:1 +ttp: b12/782 bl:2.5565 bb:1.1824 rl:2.3189 rb:1.0601 dl:110-112 gd:1 +ttp: b4/782 bl:2.7467 bb:1.2307 rl:2.3193 rb:1.0602 dl:93-96 gd:1 +ttp: b2/782 bl:2.8102 bb:1.2351 rl:2.3197 rb:1.0604 dl:83-89 gd:1 +quantized_ttt_phased val_loss:2.31658504 val_bpb:1.05858896 eval_time:405464ms +total_eval_time:405.5s diff --git a/records/track_10min_16mb/2026-05-01_PR2101_3Seed_Support/train_seed1234.log b/records/track_10min_16mb/2026-05-01_PR2101_3Seed_Support/train_seed1234.log new file mode 100644 index 0000000000..762b73bb1a --- /dev/null +++ b/records/track_10min_16mb/2026-05-01_PR2101_3Seed_Support/train_seed1234.log @@ -0,0 +1,952 @@ +W0501 07:56:24.944000 1024662 torch/distributed/run.py:803] +W0501 07:56:24.944000 1024662 torch/distributed/run.py:803] ***************************************** +W0501 07:56:24.944000 1024662 torch/distributed/run.py:803] Setting OMP_NUM_THREADS environment variable for each process to be 1 in default, to avoid your system being overloaded, please further tune the variable for optimal performance in your application as needed. +W0501 07:56:24.944000 1024662 torch/distributed/run.py:803] ***************************************** +Hyperparameters: + adam_eps: 1e-08 + adam_wd: 0.02 + artifact_dir: + attn_clip_sigmas: 13.0 + attn_out_gate_enabled: False + attn_out_gate_src: proj + awq_lite_bits: 8 + awq_lite_enabled: True + awq_lite_group_size: 64 + awq_lite_group_top_k: 1 + beta1: 0.9 + beta2: 0.99 + caseops_enabled: True + compressor: pergroup + data_dir: ./data + datasets_dir: ./data/datasets/fineweb10B_sp8192_lossless_caps_caseops_v1_reserved + distributed: True + ema_decay: 0.9965 + embed_bits: 7 + embed_clip_sigmas: 14.0 + embed_lr: 0.6 + embed_wd: 0.085 + enable_looping_at: 0.35 + eval_seq_len: 2560 + eval_stride: 64 + fused_ce_enabled: True + gate_window: 12 + gated_attn_enabled: False + gated_attn_init_std: 0.01 + gated_attn_quant_gate: True + global_ttt_batch_seqs: 32 + global_ttt_chunk_tokens: 32768 + global_ttt_epochs: 1 + global_ttt_grad_clip: 1.0 + global_ttt_lr: 0.001 + global_ttt_momentum: 0.9 + global_ttt_respect_doc_boundaries: True + global_ttt_warmup_chunks: 0 + global_ttt_warmup_start_lr: 0.0 + gptq_calibration_batches: 16 + gptq_reserve_seconds: 8.0 + grad_accum_steps: 1 + grad_centralize: False + grad_clip_norm: 0.3 + is_main_process: True + iterations: 20000 + label_smooth: 0.0 + ln_scale: True + local_rank: 0 + logfile: logs/b30cf081-2005-4bea-8345-ca7a941689a8.txt + logit_softcap: 30.0 + loop_end: 5 + loop_start: 3 + lqer_asym_enabled: True + lqer_asym_group: 64 + lqer_enabled: True + lqer_factor_bits: 4 + lqer_gain_select: False + lqer_rank: 4 + lqer_scope: all + lqer_top_k: 3 + matrix_bits: 6 + matrix_clip_sigmas: 12.85 + matrix_lr: 0.026 + max_wallclock_seconds: 600.0 + min_lr: 0.1 + mlp_clip_sigmas: 11.5 + mlp_mult: 4.0 + model_dim: 512 + model_path: final_model.pt + muon_backend_steps: 5 + muon_momentum: 0.97 + muon_momentum_warmup_start: 0.92 + muon_momentum_warmup_steps: 1500 + muon_row_normalize: True + muon_wd: 0.095 + num_heads: 8 + num_kv_heads: 4 + num_layers: 11 + num_loops: 2 + parallel_final_lane: mean + parallel_start_layer: 8 + phased_ttt_num_phases: 3 + phased_ttt_prefix_docs: 2500 + qk_gain_init: 5.25 + quantized_model_path: final_model.int6.ptz + rank: 0 + rope_base: 10000.0 + rope_dims: 16 + rope_train_seq_len: 2048 + rope_yarn: False + run_id: b30cf081-2005-4bea-8345-ca7a941689a8 + scalar_lr: 0.02 + seed: 1234 + skip_gates_enabled: True + smear_gate_enabled: True + sparse_attn_gate_enabled: True + sparse_attn_gate_init_std: 0.0 + sparse_attn_gate_scale: 0.5 + tie_embeddings: True + tied_embed_init_std: 0.005 + tied_embed_lr: 0.03 + tokenizer_path: ./tokenizers/fineweb_8192_bpe_lossless_caps_caseops_v1_reserved.model + train_batch_tokens: 786432 + train_files: ./data/datasets/fineweb10B_sp8192_lossless_caps_caseops_v1_reserved/fineweb_train_*.bin + train_log_every: 500 + train_seq_len: 2048 + ttt_batch_size: 64 + ttt_beta1: 0.0 + ttt_beta2: 0.99 + ttt_chunk_size: 48 + ttt_enabled: True + ttt_eval_batches: + ttt_eval_seq_len: 2560 + ttt_grad_steps: 1 + ttt_k_lora: True + ttt_local_lr_mult: 0.75 + ttt_lora_lr: 0.0001 + ttt_lora_rank: 80 + ttt_mask: no_qv + ttt_mlp_lora: True + ttt_o_lora: True + ttt_optimizer: adam + ttt_q_lora: False + ttt_v_lora: False + ttt_weight_decay: 0.5 + val_batch_tokens: 524288 + val_bytes_files: ./data/datasets/fineweb10B_sp8192_lossless_caps_caseops_v1_reserved/fineweb_val_bytes_*.bin + val_doc_fraction: 1.0 + val_files: ./data/datasets/fineweb10B_sp8192_lossless_caps_caseops_v1_reserved/fineweb_val_*.bin + val_loss_every: 0 + vocab_size: 8192 + warmdown_frac: 0.85 + warmup_steps: 20 + world_size: 8 + xsa_last_n: 11 +train_shards: 80 +val_tokens: 47851520 +model_params:35945673 +gptq:reserving 8s, effective=592000ms +warmup_cu_buckets:64,128,192,256 iters_each:3 +warmup_step: 1/20 +warmup_step: 2/20 +warmup_step: 3/20 +warmup_step: 4/20 +warmup_step: 5/20 +warmup_step: 6/20 +warmup_step: 10/20 +warmup_step: 20/20 +loop_warmup:enabled encoder:[0, 1, 2, 3, 4, 5, 3, 4] decoder:[5, 3, 4, 5, 6, 7, 8, 9, 10] +loop_warmup_step: 1/20 +loop_warmup_step: 2/20 +loop_warmup_step: 3/20 +loop_warmup_step: 4/20 +loop_warmup_step: 5/20 +loop_warmup_step: 6/20 +loop_warmup_step: 10/20 +loop_warmup_step: 20/20 +1/20000 train_loss: 9.0017 train_time: 0.0m tok/s: 17316728 +2/20000 train_loss: 12.9502 train_time: 0.0m tok/s: 10547150 +3/20000 train_loss: 10.2431 train_time: 0.0m tok/s: 9669216 +4/20000 train_loss: 8.7535 train_time: 0.0m tok/s: 9313702 +5/20000 train_loss: 7.9355 train_time: 0.0m tok/s: 9098326 +500/20000 train_loss: 2.5652 train_time: 0.8m tok/s: 8165043 +1000/20000 train_loss: 2.7993 train_time: 1.6m tok/s: 8116262 +1500/20000 train_loss: 2.6259 train_time: 2.4m tok/s: 8102058 +2000/20000 train_loss: 2.6592 train_time: 3.2m tok/s: 8099494 +layer_loop:enabled step:2134 frac:0.350 encoder:[0, 1, 2, 3, 4, 5, 3, 4] decoder:[5, 3, 4, 5, 6, 7, 8, 9, 10] +2500/20000 train_loss: 2.5398 train_time: 4.3m tok/s: 7590506 +3000/20000 train_loss: 2.5569 train_time: 5.5m tok/s: 7154994 +3500/20000 train_loss: 2.5565 train_time: 6.7m tok/s: 6873376 +4000/20000 train_loss: 2.4002 train_time: 7.9m tok/s: 6676912 +4500/20000 train_loss: 2.2704 train_time: 9.0m tok/s: 6531869 +4856/20000 val_loss: 2.3515 val_bpb: 1.0745 +stopping_early: wallclock_cap train_time: 592141ms step: 4856/20000 +peak memory allocated: 41707 MiB reserved: 46952 MiB +ema:applying EMA weights +diagnostic pre-quantization post-ema val_loss:2.32637323 val_bpb:1.06296914 eval_time:10120ms +Serialized model: 135418111 bytes +Code size (uncompressed): 172613 bytes +Code size (compressed): 34386 bytes +GPTQ:collecting Hessians from calibration data... +GPTQ:collected 67 Hessians in 4.1s +Quantized weights: + gate_int8_row: blocks.attn.attn_gate_w + gptq (int6): blocks.attn.c_k.weight, blocks.attn.c_q.weight, blocks.attn.c_v.weight, blocks.attn.proj.weight, blocks.mlp.fc.weight, blocks.mlp.proj.weight + gptq (int6)+lqer_asym: blocks.mlp.fc.weight + gptq (int7)+awqgrpint8+lqer_asym: tok_emb.weight + passthrough (float16): blocks.attn.q_gain, blocks.attn_scale, blocks.mlp_scale, blocks.resid_mix, parallel_post_lambdas, parallel_resid_lambdas, skip_gates, skip_weights, smear_gate.weight, smear_lambda, softcap_neg, softcap_pos +Serialize: per-group lrzip compression... +Serialize: per-group compression done in 117.0s +Serialized model quantized+pergroup: 15948957 bytes +Total submission size quantized+pergroup: 15983343 bytes +Deserialize: per-group lrzip decompression... +Deserialize: decompression done in 21.0s +diagnostic quantized val_loss:2.34538215 val_bpb:1.07165472 eval_time:13602ms +Deserialize: per-group lrzip decompression... +Deserialize: decompression done in 21.0s +ttt_lora:warming up compile (random tokens, no val data) +ttt_lora:compile warmup done (95.8s) + +beginning TTT eval timer +ttt_phased: total_docs:50000 prefix_docs:2500 suffix_docs:47500 num_phases:3 boundaries:[833, 1666, 2500] +ttp: b776/782 bl:2.2540 bb:1.0687 rl:2.2540 rb:1.0687 dl:7534-8350 gd:0 +ttp: b773/782 bl:2.1967 bb:1.0345 rl:2.2286 rb:1.0535 dl:6104-6447 gd:0 +ttp: b768/782 bl:2.2343 bb:1.0405 rl:2.2301 rb:1.0501 dl:4859-5083 gd:0 +ttp: b762/782 bl:2.3492 bb:1.0878 rl:2.2510 rb:1.0568 dl:4032-4142 gd:0 +ttpp: phase:1/3 pd:1296 gd:833 t:232.7s +tttg: c1/131 lr:0.001000 t:0.3s +tttg: c2/131 lr:0.001000 t:0.4s +tttg: c3/131 lr:0.000999 t:0.5s +tttg: c4/131 lr:0.000999 t:0.5s +tttg: c5/131 lr:0.000998 t:0.6s +tttg: c6/131 lr:0.000996 t:0.7s +tttg: c7/131 lr:0.000995 t:0.8s +tttg: c8/131 lr:0.000993 t:0.8s +tttg: c9/131 lr:0.000991 t:0.9s +tttg: c10/131 lr:0.000988 t:1.0s +tttg: c11/131 lr:0.000985 t:1.1s +tttg: c12/131 lr:0.000982 t:1.2s +tttg: c13/131 lr:0.000979 t:1.2s +tttg: c14/131 lr:0.000976 t:1.3s +tttg: c15/131 lr:0.000972 t:1.4s +tttg: c16/131 lr:0.000968 t:1.5s +tttg: c17/131 lr:0.000963 t:1.5s +tttg: c18/131 lr:0.000958 t:1.6s +tttg: c19/131 lr:0.000953 t:1.7s +tttg: c20/131 lr:0.000948 t:1.8s +tttg: c21/131 lr:0.000943 t:1.9s +tttg: c22/131 lr:0.000937 t:1.9s +tttg: c23/131 lr:0.000931 t:2.0s +tttg: c24/131 lr:0.000925 t:2.1s +tttg: c25/131 lr:0.000918 t:2.2s +tttg: c26/131 lr:0.000911 t:2.2s +tttg: c27/131 lr:0.000905 t:2.3s +tttg: c28/131 lr:0.000897 t:2.4s +tttg: c29/131 lr:0.000890 t:2.5s +tttg: c30/131 lr:0.000882 t:2.5s +tttg: c31/131 lr:0.000874 t:2.6s +tttg: c32/131 lr:0.000866 t:2.7s +tttg: c33/131 lr:0.000858 t:2.8s +tttg: c34/131 lr:0.000849 t:2.9s +tttg: c35/131 lr:0.000841 t:2.9s +tttg: c36/131 lr:0.000832 t:3.0s +tttg: c37/131 lr:0.000822 t:3.1s +tttg: c38/131 lr:0.000813 t:3.2s +tttg: c39/131 lr:0.000804 t:3.3s +tttg: c40/131 lr:0.000794 t:3.3s +tttg: c41/131 lr:0.000784 t:3.4s +tttg: c42/131 lr:0.000774 t:3.5s +tttg: c43/131 lr:0.000764 t:3.6s +tttg: c44/131 lr:0.000753 t:3.6s +tttg: c45/131 lr:0.000743 t:3.7s +tttg: c46/131 lr:0.000732 t:3.8s +tttg: c47/131 lr:0.000722 t:3.9s +tttg: c48/131 lr:0.000711 t:3.9s +tttg: c49/131 lr:0.000700 t:4.0s +tttg: c50/131 lr:0.000689 t:4.1s +tttg: c51/131 lr:0.000677 t:4.2s +tttg: c52/131 lr:0.000666 t:4.2s +tttg: c53/131 lr:0.000655 t:4.3s +tttg: c54/131 lr:0.000643 t:4.4s +tttg: c55/131 lr:0.000631 t:4.5s +tttg: c56/131 lr:0.000620 t:4.6s +tttg: c57/131 lr:0.000608 t:4.6s +tttg: c58/131 lr:0.000596 t:4.7s +tttg: c59/131 lr:0.000584 t:4.8s +tttg: c60/131 lr:0.000572 t:4.9s +tttg: c61/131 lr:0.000560 t:4.9s +tttg: c62/131 lr:0.000548 t:5.0s +tttg: c63/131 lr:0.000536 t:5.1s +tttg: c64/131 lr:0.000524 t:5.2s +tttg: c65/131 lr:0.000512 t:5.3s +tttg: c66/131 lr:0.000500 t:5.3s +tttg: c67/131 lr:0.000488 t:5.4s +tttg: c68/131 lr:0.000476 t:5.5s +tttg: c69/131 lr:0.000464 t:5.6s +tttg: c70/131 lr:0.000452 t:5.6s +tttg: c71/131 lr:0.000440 t:5.7s +tttg: c72/131 lr:0.000428 t:5.8s +tttg: c73/131 lr:0.000416 t:5.9s +tttg: c74/131 lr:0.000404 t:5.9s +tttg: c75/131 lr:0.000392 t:6.0s +tttg: c76/131 lr:0.000380 t:6.1s +tttg: c77/131 lr:0.000369 t:6.2s +tttg: c78/131 lr:0.000357 t:6.3s +tttg: c79/131 lr:0.000345 t:6.3s +tttg: c80/131 lr:0.000334 t:6.4s +tttg: c81/131 lr:0.000323 t:6.5s +tttg: c82/131 lr:0.000311 t:6.6s +tttg: c83/131 lr:0.000300 t:6.6s +tttg: c84/131 lr:0.000289 t:6.7s +tttg: c85/131 lr:0.000278 t:6.8s +tttg: c86/131 lr:0.000268 t:6.9s +tttg: c87/131 lr:0.000257 t:7.0s +tttg: c88/131 lr:0.000247 t:7.0s +tttg: c89/131 lr:0.000236 t:7.1s +tttg: c90/131 lr:0.000226 t:7.2s +tttg: c91/131 lr:0.000216 t:7.3s +tttg: c92/131 lr:0.000206 t:7.3s +tttg: c93/131 lr:0.000196 t:7.4s +tttg: c94/131 lr:0.000187 t:7.5s +tttg: c95/131 lr:0.000178 t:7.6s +tttg: c96/131 lr:0.000168 t:7.6s +tttg: c97/131 lr:0.000159 t:7.7s +tttg: c98/131 lr:0.000151 t:7.8s +tttg: c99/131 lr:0.000142 t:7.9s +tttg: c100/131 lr:0.000134 t:8.0s +tttg: c101/131 lr:0.000126 t:8.0s +tttg: c102/131 lr:0.000118 t:8.1s +tttg: c103/131 lr:0.000110 t:8.2s +tttg: c104/131 lr:0.000103 t:8.3s +tttg: c105/131 lr:0.000095 t:8.3s +tttg: c106/131 lr:0.000089 t:8.4s +tttg: c107/131 lr:0.000082 t:8.5s +tttg: c108/131 lr:0.000075 t:8.6s +tttg: c109/131 lr:0.000069 t:8.7s +tttg: c110/131 lr:0.000063 t:8.7s +tttg: c111/131 lr:0.000057 t:8.8s +tttg: c112/131 lr:0.000052 t:8.9s +tttg: c113/131 lr:0.000047 t:9.0s +tttg: c114/131 lr:0.000042 t:9.0s +tttg: c115/131 lr:0.000037 t:9.1s +tttg: c116/131 lr:0.000032 t:9.2s +tttg: c117/131 lr:0.000028 t:9.3s +tttg: c118/131 lr:0.000024 t:9.3s +tttg: c119/131 lr:0.000021 t:9.4s +tttg: c120/131 lr:0.000018 t:9.5s +tttg: c121/131 lr:0.000015 t:9.6s +tttg: c122/131 lr:0.000012 t:9.6s +tttg: c123/131 lr:0.000009 t:9.7s +tttg: c124/131 lr:0.000007 t:9.8s +tttg: c125/131 lr:0.000005 t:9.9s +tttg: c126/131 lr:0.000004 t:10.0s +tttg: c127/131 lr:0.000002 t:10.0s +tttg: c128/131 lr:0.000001 t:10.1s +tttg: c129/131 lr:0.000001 t:10.2s +tttg: c130/131 lr:0.000000 t:10.3s +ttpr: phase:1/3 t:244.1s +ttp: b760/782 bl:2.3473 bb:1.0394 rl:2.2647 rb:1.0542 dl:3817-3916 gd:0 +ttp: b750/782 bl:2.3814 bb:1.0700 rl:2.2768 rb:1.0559 dl:3090-3149 gd:0 +ttpp: phase:2/3 pd:2128 gd:1666 t:301.5s +tttg: c1/219 lr:0.001000 t:0.1s +tttg: c2/219 lr:0.001000 t:0.2s +tttg: c3/219 lr:0.001000 t:0.2s +tttg: c4/219 lr:0.001000 t:0.3s +tttg: c5/219 lr:0.000999 t:0.4s +tttg: c6/219 lr:0.000999 t:0.5s +tttg: c7/219 lr:0.000998 t:0.5s +tttg: c8/219 lr:0.000997 t:0.6s +tttg: c9/219 lr:0.000997 t:0.7s +tttg: c10/219 lr:0.000996 t:0.8s +tttg: c11/219 lr:0.000995 t:0.8s +tttg: c12/219 lr:0.000994 t:0.9s +tttg: c13/219 lr:0.000993 t:1.0s +tttg: c14/219 lr:0.000991 t:1.1s +tttg: c15/219 lr:0.000990 t:1.1s +tttg: c16/219 lr:0.000988 t:1.2s +tttg: c17/219 lr:0.000987 t:1.3s +tttg: c18/219 lr:0.000985 t:1.4s +tttg: c19/219 lr:0.000983 t:1.5s +tttg: c20/219 lr:0.000981 t:1.5s +tttg: c21/219 lr:0.000979 t:1.6s +tttg: c22/219 lr:0.000977 t:1.7s +tttg: c23/219 lr:0.000975 t:1.8s +tttg: c24/219 lr:0.000973 t:1.8s +tttg: c25/219 lr:0.000970 t:1.9s +tttg: c26/219 lr:0.000968 t:2.0s +tttg: c27/219 lr:0.000965 t:2.1s +tttg: c28/219 lr:0.000963 t:2.1s +tttg: c29/219 lr:0.000960 t:2.2s +tttg: c30/219 lr:0.000957 t:2.3s +tttg: c31/219 lr:0.000954 t:2.4s +tttg: c32/219 lr:0.000951 t:2.4s +tttg: c33/219 lr:0.000948 t:2.5s +tttg: c34/219 lr:0.000945 t:2.6s +tttg: c35/219 lr:0.000941 t:2.7s +tttg: c36/219 lr:0.000938 t:2.7s +tttg: c37/219 lr:0.000934 t:2.8s +tttg: c38/219 lr:0.000931 t:2.9s +tttg: c39/219 lr:0.000927 t:3.0s +tttg: c40/219 lr:0.000923 t:3.1s +tttg: c41/219 lr:0.000919 t:3.1s +tttg: c42/219 lr:0.000915 t:3.2s +tttg: c43/219 lr:0.000911 t:3.3s +tttg: c44/219 lr:0.000907 t:3.4s +tttg: c45/219 lr:0.000903 t:3.4s +tttg: c46/219 lr:0.000898 t:3.5s +tttg: c47/219 lr:0.000894 t:3.6s +tttg: c48/219 lr:0.000890 t:3.7s +tttg: c49/219 lr:0.000885 t:5.1s +tttg: c50/219 lr:0.000880 t:5.2s +tttg: c51/219 lr:0.000876 t:5.3s +tttg: c52/219 lr:0.000871 t:5.3s +tttg: c53/219 lr:0.000866 t:5.4s +tttg: c54/219 lr:0.000861 t:5.5s +tttg: c55/219 lr:0.000856 t:5.6s +tttg: c56/219 lr:0.000851 t:5.6s +tttg: c57/219 lr:0.000846 t:5.7s +tttg: c58/219 lr:0.000841 t:5.8s +tttg: c59/219 lr:0.000835 t:5.9s +tttg: c60/219 lr:0.000830 t:6.0s +tttg: c61/219 lr:0.000824 t:6.0s +tttg: c62/219 lr:0.000819 t:6.1s +tttg: c63/219 lr:0.000813 t:6.2s +tttg: c64/219 lr:0.000808 t:6.3s +tttg: c65/219 lr:0.000802 t:6.3s +tttg: c66/219 lr:0.000796 t:6.4s +tttg: c67/219 lr:0.000790 t:6.5s +tttg: c68/219 lr:0.000784 t:6.6s +tttg: c69/219 lr:0.000779 t:6.7s +tttg: c70/219 lr:0.000773 t:6.7s +tttg: c71/219 lr:0.000766 t:6.8s +tttg: c72/219 lr:0.000760 t:6.9s +tttg: c73/219 lr:0.000754 t:7.0s +tttg: c74/219 lr:0.000748 t:7.1s +tttg: c75/219 lr:0.000742 t:7.1s +tttg: c76/219 lr:0.000735 t:7.2s +tttg: c77/219 lr:0.000729 t:7.3s +tttg: c78/219 lr:0.000722 t:7.4s +tttg: c79/219 lr:0.000716 t:7.4s +tttg: c80/219 lr:0.000709 t:7.5s +tttg: c81/219 lr:0.000703 t:7.6s +tttg: c82/219 lr:0.000696 t:7.7s +tttg: c83/219 lr:0.000690 t:7.8s +tttg: c84/219 lr:0.000683 t:7.8s +tttg: c85/219 lr:0.000676 t:7.9s +tttg: c86/219 lr:0.000670 t:8.0s +tttg: c87/219 lr:0.000663 t:8.1s +tttg: c88/219 lr:0.000656 t:8.1s +tttg: c89/219 lr:0.000649 t:8.2s +tttg: c90/219 lr:0.000642 t:8.3s +tttg: c91/219 lr:0.000635 t:8.4s +tttg: c92/219 lr:0.000628 t:8.5s +tttg: c93/219 lr:0.000621 t:8.5s +tttg: c94/219 lr:0.000614 t:8.6s +tttg: c95/219 lr:0.000607 t:8.7s +tttg: c96/219 lr:0.000600 t:8.8s +tttg: c97/219 lr:0.000593 t:8.9s +tttg: c98/219 lr:0.000586 t:8.9s +tttg: c99/219 lr:0.000579 t:9.0s +tttg: c100/219 lr:0.000572 t:9.1s +tttg: c101/219 lr:0.000565 t:9.2s +tttg: c102/219 lr:0.000558 t:9.2s +tttg: c103/219 lr:0.000550 t:9.3s +tttg: c104/219 lr:0.000543 t:9.4s +tttg: c105/219 lr:0.000536 t:9.5s +tttg: c106/219 lr:0.000529 t:9.5s +tttg: c107/219 lr:0.000522 t:9.6s +tttg: c108/219 lr:0.000514 t:9.7s +tttg: c109/219 lr:0.000507 t:9.8s +tttg: c110/219 lr:0.000500 t:9.9s +tttg: c111/219 lr:0.000493 t:9.9s +tttg: c112/219 lr:0.000486 t:10.0s +tttg: c113/219 lr:0.000478 t:10.1s +tttg: c114/219 lr:0.000471 t:10.2s +tttg: c115/219 lr:0.000464 t:10.2s +tttg: c116/219 lr:0.000457 t:10.3s +tttg: c117/219 lr:0.000450 t:10.4s +tttg: c118/219 lr:0.000442 t:10.5s +tttg: c119/219 lr:0.000435 t:10.6s +tttg: c120/219 lr:0.000428 t:10.6s +tttg: c121/219 lr:0.000421 t:10.7s +tttg: c122/219 lr:0.000414 t:10.8s +tttg: c123/219 lr:0.000407 t:10.9s +tttg: c124/219 lr:0.000400 t:11.0s +tttg: c125/219 lr:0.000393 t:11.0s +tttg: c126/219 lr:0.000386 t:11.1s +tttg: c127/219 lr:0.000379 t:11.2s +tttg: c128/219 lr:0.000372 t:11.3s +tttg: c129/219 lr:0.000365 t:11.3s +tttg: c130/219 lr:0.000358 t:11.4s +tttg: c131/219 lr:0.000351 t:11.5s +tttg: c132/219 lr:0.000344 t:11.6s +tttg: c133/219 lr:0.000337 t:11.7s +tttg: c134/219 lr:0.000330 t:11.7s +tttg: c135/219 lr:0.000324 t:11.8s +tttg: c136/219 lr:0.000317 t:11.9s +tttg: c137/219 lr:0.000310 t:12.0s +tttg: c138/219 lr:0.000304 t:12.0s +tttg: c139/219 lr:0.000297 t:12.1s +tttg: c140/219 lr:0.000291 t:12.2s +tttg: c141/219 lr:0.000284 t:12.3s +tttg: c142/219 lr:0.000278 t:12.3s +tttg: c143/219 lr:0.000271 t:12.4s +tttg: c144/219 lr:0.000265 t:12.5s +tttg: c145/219 lr:0.000258 t:12.6s +tttg: c146/219 lr:0.000252 t:12.7s +tttg: c147/219 lr:0.000246 t:12.7s +tttg: c148/219 lr:0.000240 t:12.8s +tttg: c149/219 lr:0.000234 t:12.9s +tttg: c150/219 lr:0.000227 t:13.0s +tttg: c151/219 lr:0.000221 t:13.0s +tttg: c152/219 lr:0.000216 t:13.1s +tttg: c153/219 lr:0.000210 t:13.2s +tttg: c154/219 lr:0.000204 t:13.3s +tttg: c155/219 lr:0.000198 t:13.3s +tttg: c156/219 lr:0.000192 t:13.4s +tttg: c157/219 lr:0.000187 t:13.5s +tttg: c158/219 lr:0.000181 t:13.6s +tttg: c159/219 lr:0.000176 t:13.7s +tttg: c160/219 lr:0.000170 t:13.7s +tttg: c161/219 lr:0.000165 t:13.8s +tttg: c162/219 lr:0.000159 t:13.9s +tttg: c163/219 lr:0.000154 t:14.0s +tttg: c164/219 lr:0.000149 t:14.0s +tttg: c165/219 lr:0.000144 t:14.1s +tttg: c166/219 lr:0.000139 t:14.2s +tttg: c167/219 lr:0.000134 t:14.3s +tttg: c168/219 lr:0.000129 t:14.4s +tttg: c169/219 lr:0.000124 t:14.4s +tttg: c170/219 lr:0.000120 t:14.5s +tttg: c171/219 lr:0.000115 t:14.6s +tttg: c172/219 lr:0.000110 t:14.7s +tttg: c173/219 lr:0.000106 t:14.7s +tttg: c174/219 lr:0.000102 t:14.8s +tttg: c175/219 lr:0.000097 t:14.9s +tttg: c176/219 lr:0.000093 t:15.0s +tttg: c177/219 lr:0.000089 t:15.0s +tttg: c178/219 lr:0.000085 t:15.1s +tttg: c179/219 lr:0.000081 t:15.2s +tttg: c180/219 lr:0.000077 t:15.3s +tttg: c181/219 lr:0.000073 t:15.4s +tttg: c182/219 lr:0.000069 t:15.4s +tttg: c183/219 lr:0.000066 t:15.5s +tttg: c184/219 lr:0.000062 t:15.6s +tttg: c185/219 lr:0.000059 t:15.7s +tttg: c186/219 lr:0.000055 t:15.7s +tttg: c187/219 lr:0.000052 t:15.8s +tttg: c188/219 lr:0.000049 t:15.9s +tttg: c189/219 lr:0.000046 t:16.0s +tttg: c190/219 lr:0.000043 t:16.1s +tttg: c191/219 lr:0.000040 t:16.1s +tttg: c192/219 lr:0.000037 t:16.2s +tttg: c193/219 lr:0.000035 t:16.3s +tttg: c194/219 lr:0.000032 t:16.4s +tttg: c195/219 lr:0.000030 t:16.4s +tttg: c196/219 lr:0.000027 t:16.5s +tttg: c197/219 lr:0.000025 t:16.6s +tttg: c198/219 lr:0.000023 t:16.7s +tttg: c199/219 lr:0.000021 t:16.8s +tttg: c200/219 lr:0.000019 t:16.8s +tttg: c201/219 lr:0.000017 t:16.9s +tttg: c202/219 lr:0.000015 t:18.4s +tttg: c203/219 lr:0.000013 t:18.5s +tttg: c204/219 lr:0.000012 t:18.6s +tttg: c205/219 lr:0.000010 t:18.6s +tttg: c206/219 lr:0.000009 t:18.7s +tttg: c207/219 lr:0.000007 t:18.8s +tttg: c208/219 lr:0.000006 t:18.9s +tttg: c209/219 lr:0.000005 t:18.9s +tttg: c210/219 lr:0.000004 t:19.0s +tttg: c211/219 lr:0.000003 t:19.1s +tttg: c212/219 lr:0.000003 t:19.2s +tttg: c213/219 lr:0.000002 t:19.2s +tttg: c214/219 lr:0.000001 t:19.3s +tttg: c215/219 lr:0.000001 t:19.4s +tttg: c216/219 lr:0.000000 t:19.5s +tttg: c217/219 lr:0.000000 t:19.6s +tttg: c218/219 lr:0.000000 t:19.6s +ttpr: phase:2/3 t:322.3s +ttp: b745/782 bl:2.2355 bb:1.0234 rl:2.2732 rb:1.0530 dl:2842-2883 gd:0 +ttp: b736/782 bl:2.2409 bb:1.0558 rl:2.2709 rb:1.0532 dl:2526-2550 gd:0 +ttpp: phase:3/3 pd:2960 gd:2500 t:337.0s +tttg: c1/289 lr:0.001000 t:0.1s +tttg: c2/289 lr:0.001000 t:0.1s +tttg: c3/289 lr:0.001000 t:0.2s +tttg: c4/289 lr:0.001000 t:0.3s +tttg: c5/289 lr:0.001000 t:0.4s +tttg: c6/289 lr:0.000999 t:0.4s +tttg: c7/289 lr:0.000999 t:0.5s +tttg: c8/289 lr:0.000999 t:0.6s +tttg: c9/289 lr:0.000998 t:0.7s +tttg: c10/289 lr:0.000998 t:0.8s +tttg: c11/289 lr:0.000997 t:0.8s +tttg: c12/289 lr:0.000996 t:0.9s +tttg: c13/289 lr:0.000996 t:1.0s +tttg: c14/289 lr:0.000995 t:1.1s +tttg: c15/289 lr:0.000994 t:1.1s +tttg: c16/289 lr:0.000993 t:1.2s +tttg: c17/289 lr:0.000992 t:1.3s +tttg: c18/289 lr:0.000991 t:1.4s +tttg: c19/289 lr:0.000990 t:1.4s +tttg: c20/289 lr:0.000989 t:1.5s +tttg: c21/289 lr:0.000988 t:1.6s +tttg: c22/289 lr:0.000987 t:1.7s +tttg: c23/289 lr:0.000986 t:1.8s +tttg: c24/289 lr:0.000984 t:1.8s +tttg: c25/289 lr:0.000983 t:1.9s +tttg: c26/289 lr:0.000982 t:2.0s +tttg: c27/289 lr:0.000980 t:2.1s +tttg: c28/289 lr:0.000978 t:2.2s +tttg: c29/289 lr:0.000977 t:2.2s +tttg: c30/289 lr:0.000975 t:2.3s +tttg: c31/289 lr:0.000973 t:2.4s +tttg: c32/289 lr:0.000972 t:2.5s +tttg: c33/289 lr:0.000970 t:2.5s +tttg: c34/289 lr:0.000968 t:2.6s +tttg: c35/289 lr:0.000966 t:2.7s +tttg: c36/289 lr:0.000964 t:2.8s +tttg: c37/289 lr:0.000962 t:2.8s +tttg: c38/289 lr:0.000960 t:2.9s +tttg: c39/289 lr:0.000958 t:3.0s +tttg: c40/289 lr:0.000955 t:3.1s +tttg: c41/289 lr:0.000953 t:3.2s +tttg: c42/289 lr:0.000951 t:3.2s +tttg: c43/289 lr:0.000948 t:3.3s +tttg: c44/289 lr:0.000946 t:3.4s +tttg: c45/289 lr:0.000944 t:3.5s +tttg: c46/289 lr:0.000941 t:3.5s +tttg: c47/289 lr:0.000938 t:3.6s +tttg: c48/289 lr:0.000936 t:3.7s +tttg: c49/289 lr:0.000933 t:3.8s +tttg: c50/289 lr:0.000930 t:3.9s +tttg: c51/289 lr:0.000927 t:3.9s +tttg: c52/289 lr:0.000925 t:4.0s +tttg: c53/289 lr:0.000922 t:4.1s +tttg: c54/289 lr:0.000919 t:4.2s +tttg: c55/289 lr:0.000916 t:4.2s +tttg: c56/289 lr:0.000913 t:4.3s +tttg: c57/289 lr:0.000910 t:4.4s +tttg: c58/289 lr:0.000906 t:4.5s +tttg: c59/289 lr:0.000903 t:4.6s +tttg: c60/289 lr:0.000900 t:4.6s +tttg: c61/289 lr:0.000897 t:4.7s +tttg: c62/289 lr:0.000893 t:4.8s +tttg: c63/289 lr:0.000890 t:4.9s +tttg: c64/289 lr:0.000887 t:4.9s +tttg: c65/289 lr:0.000883 t:5.0s +tttg: c66/289 lr:0.000879 t:5.1s +tttg: c67/289 lr:0.000876 t:5.2s +tttg: c68/289 lr:0.000872 t:5.2s +tttg: c69/289 lr:0.000869 t:5.3s +tttg: c70/289 lr:0.000865 t:5.4s +tttg: c71/289 lr:0.000861 t:5.5s +tttg: c72/289 lr:0.000857 t:5.6s +tttg: c73/289 lr:0.000854 t:5.6s +tttg: c74/289 lr:0.000850 t:5.7s +tttg: c75/289 lr:0.000846 t:5.8s +tttg: c76/289 lr:0.000842 t:5.9s +tttg: c77/289 lr:0.000838 t:5.9s +tttg: c78/289 lr:0.000834 t:6.0s +tttg: c79/289 lr:0.000830 t:6.1s +tttg: c80/289 lr:0.000826 t:6.2s +tttg: c81/289 lr:0.000821 t:6.3s +tttg: c82/289 lr:0.000817 t:6.3s +tttg: c83/289 lr:0.000813 t:6.4s +tttg: c84/289 lr:0.000809 t:6.5s +tttg: c85/289 lr:0.000804 t:6.6s +tttg: c86/289 lr:0.000800 t:6.6s +tttg: c87/289 lr:0.000796 t:6.7s +tttg: c88/289 lr:0.000791 t:6.8s +tttg: c89/289 lr:0.000787 t:6.9s +tttg: c90/289 lr:0.000782 t:7.0s +tttg: c91/289 lr:0.000778 t:7.0s +tttg: c92/289 lr:0.000773 t:7.1s +tttg: c93/289 lr:0.000769 t:7.2s +tttg: c94/289 lr:0.000764 t:7.3s +tttg: c95/289 lr:0.000759 t:7.4s +tttg: c96/289 lr:0.000755 t:7.4s +tttg: c97/289 lr:0.000750 t:7.5s +tttg: c98/289 lr:0.000745 t:7.6s +tttg: c99/289 lr:0.000740 t:7.7s +tttg: c100/289 lr:0.000736 t:7.7s +tttg: c101/289 lr:0.000731 t:7.8s +tttg: c102/289 lr:0.000726 t:7.9s +tttg: c103/289 lr:0.000721 t:8.0s +tttg: c104/289 lr:0.000716 t:8.0s +tttg: c105/289 lr:0.000711 t:8.1s +tttg: c106/289 lr:0.000706 t:8.2s +tttg: c107/289 lr:0.000701 t:8.3s +tttg: c108/289 lr:0.000696 t:8.4s +tttg: c109/289 lr:0.000691 t:8.4s +tttg: c110/289 lr:0.000686 t:8.5s +tttg: c111/289 lr:0.000681 t:8.6s +tttg: c112/289 lr:0.000676 t:8.7s +tttg: c113/289 lr:0.000671 t:8.7s +tttg: c114/289 lr:0.000666 t:8.8s +tttg: c115/289 lr:0.000661 t:8.9s +tttg: c116/289 lr:0.000656 t:9.0s +tttg: c117/289 lr:0.000650 t:9.0s +tttg: c118/289 lr:0.000645 t:9.1s +tttg: c119/289 lr:0.000640 t:9.2s +tttg: c120/289 lr:0.000635 t:9.3s +tttg: c121/289 lr:0.000629 t:9.4s +tttg: c122/289 lr:0.000624 t:9.4s +tttg: c123/289 lr:0.000619 t:9.5s +tttg: c124/289 lr:0.000614 t:9.6s +tttg: c125/289 lr:0.000608 t:9.7s +tttg: c126/289 lr:0.000603 t:9.7s +tttg: c127/289 lr:0.000598 t:9.8s +tttg: c128/289 lr:0.000592 t:9.9s +tttg: c129/289 lr:0.000587 t:10.0s +tttg: c130/289 lr:0.000581 t:10.1s +tttg: c131/289 lr:0.000576 t:10.1s +tttg: c132/289 lr:0.000571 t:10.2s +tttg: c133/289 lr:0.000565 t:10.3s +tttg: c134/289 lr:0.000560 t:10.4s +tttg: c135/289 lr:0.000554 t:10.5s +tttg: c136/289 lr:0.000549 t:10.5s +tttg: c137/289 lr:0.000544 t:10.6s +tttg: c138/289 lr:0.000538 t:10.7s +tttg: c139/289 lr:0.000533 t:10.8s +tttg: c140/289 lr:0.000527 t:10.9s +tttg: c141/289 lr:0.000522 t:10.9s +tttg: c142/289 lr:0.000516 t:11.0s +tttg: c143/289 lr:0.000511 t:11.1s +tttg: c144/289 lr:0.000505 t:11.2s +tttg: c145/289 lr:0.000500 t:11.2s +tttg: c146/289 lr:0.000495 t:11.3s +tttg: c147/289 lr:0.000489 t:11.4s +tttg: c148/289 lr:0.000484 t:11.5s +tttg: c149/289 lr:0.000478 t:11.5s +tttg: c150/289 lr:0.000473 t:11.6s +tttg: c151/289 lr:0.000467 t:11.7s +tttg: c152/289 lr:0.000462 t:11.8s +tttg: c153/289 lr:0.000456 t:11.9s +tttg: c154/289 lr:0.000451 t:11.9s +tttg: c155/289 lr:0.000446 t:12.0s +tttg: c156/289 lr:0.000440 t:12.1s +tttg: c157/289 lr:0.000435 t:12.2s +tttg: c158/289 lr:0.000429 t:12.2s +tttg: c159/289 lr:0.000424 t:12.3s +tttg: c160/289 lr:0.000419 t:12.4s +tttg: c161/289 lr:0.000413 t:12.5s +tttg: c162/289 lr:0.000408 t:12.6s +tttg: c163/289 lr:0.000402 t:12.6s +tttg: c164/289 lr:0.000397 t:12.7s +tttg: c165/289 lr:0.000392 t:12.8s +tttg: c166/289 lr:0.000386 t:12.9s +tttg: c167/289 lr:0.000381 t:12.9s +tttg: c168/289 lr:0.000376 t:13.0s +tttg: c169/289 lr:0.000371 t:13.1s +tttg: c170/289 lr:0.000365 t:13.2s +tttg: c171/289 lr:0.000360 t:13.3s +tttg: c172/289 lr:0.000355 t:13.3s +tttg: c173/289 lr:0.000350 t:13.4s +tttg: c174/289 lr:0.000344 t:13.5s +tttg: c175/289 lr:0.000339 t:13.6s +tttg: c176/289 lr:0.000334 t:13.6s +tttg: c177/289 lr:0.000329 t:13.7s +tttg: c178/289 lr:0.000324 t:13.8s +tttg: c179/289 lr:0.000319 t:13.9s +tttg: c180/289 lr:0.000314 t:14.0s +tttg: c181/289 lr:0.000309 t:14.0s +tttg: c182/289 lr:0.000304 t:14.1s +tttg: c183/289 lr:0.000299 t:14.2s +tttg: c184/289 lr:0.000294 t:14.3s +tttg: c185/289 lr:0.000289 t:14.3s +tttg: c186/289 lr:0.000284 t:14.4s +tttg: c187/289 lr:0.000279 t:14.5s +tttg: c188/289 lr:0.000274 t:14.6s +tttg: c189/289 lr:0.000269 t:14.6s +tttg: c190/289 lr:0.000264 t:14.7s +tttg: c191/289 lr:0.000260 t:14.8s +tttg: c192/289 lr:0.000255 t:14.9s +tttg: c193/289 lr:0.000250 t:15.0s +tttg: c194/289 lr:0.000245 t:15.0s +tttg: c195/289 lr:0.000241 t:15.1s +tttg: c196/289 lr:0.000236 t:15.2s +tttg: c197/289 lr:0.000231 t:15.3s +tttg: c198/289 lr:0.000227 t:15.3s +tttg: c199/289 lr:0.000222 t:15.4s +tttg: c200/289 lr:0.000218 t:15.5s +tttg: c201/289 lr:0.000213 t:15.6s +tttg: c202/289 lr:0.000209 t:15.7s +tttg: c203/289 lr:0.000204 t:15.7s +tttg: c204/289 lr:0.000200 t:15.8s +tttg: c205/289 lr:0.000196 t:15.9s +tttg: c206/289 lr:0.000191 t:16.0s +tttg: c207/289 lr:0.000187 t:16.0s +tttg: c208/289 lr:0.000183 t:16.1s +tttg: c209/289 lr:0.000179 t:16.2s +tttg: c210/289 lr:0.000174 t:16.3s +tttg: c211/289 lr:0.000170 t:16.4s +tttg: c212/289 lr:0.000166 t:16.5s +tttg: c213/289 lr:0.000162 t:16.5s +tttg: c214/289 lr:0.000158 t:16.6s +tttg: c215/289 lr:0.000154 t:16.7s +tttg: c216/289 lr:0.000150 t:16.8s +tttg: c217/289 lr:0.000146 t:16.9s +tttg: c218/289 lr:0.000143 t:16.9s +tttg: c219/289 lr:0.000139 t:17.0s +tttg: c220/289 lr:0.000135 t:17.1s +tttg: c221/289 lr:0.000131 t:17.2s +tttg: c222/289 lr:0.000128 t:17.3s +tttg: c223/289 lr:0.000124 t:17.4s +tttg: c224/289 lr:0.000121 t:17.4s +tttg: c225/289 lr:0.000117 t:17.5s +tttg: c226/289 lr:0.000113 t:17.6s +tttg: c227/289 lr:0.000110 t:17.7s +tttg: c228/289 lr:0.000107 t:17.8s +tttg: c229/289 lr:0.000103 t:17.9s +tttg: c230/289 lr:0.000100 t:17.9s +tttg: c231/289 lr:0.000097 t:18.0s +tttg: c232/289 lr:0.000094 t:18.1s +tttg: c233/289 lr:0.000090 t:18.2s +tttg: c234/289 lr:0.000087 t:18.3s +tttg: c235/289 lr:0.000084 t:18.4s +tttg: c236/289 lr:0.000081 t:18.5s +tttg: c237/289 lr:0.000078 t:18.5s +tttg: c238/289 lr:0.000075 t:18.6s +tttg: c239/289 lr:0.000073 t:18.7s +tttg: c240/289 lr:0.000070 t:18.8s +tttg: c241/289 lr:0.000067 t:18.9s +tttg: c242/289 lr:0.000064 t:18.9s +tttg: c243/289 lr:0.000062 t:19.0s +tttg: c244/289 lr:0.000059 t:19.1s +tttg: c245/289 lr:0.000056 t:19.2s +tttg: c246/289 lr:0.000054 t:19.3s +tttg: c247/289 lr:0.000052 t:19.3s +tttg: c248/289 lr:0.000049 t:19.4s +tttg: c249/289 lr:0.000047 t:19.5s +tttg: c250/289 lr:0.000045 t:19.6s +tttg: c251/289 lr:0.000042 t:19.7s +tttg: c252/289 lr:0.000040 t:19.8s +tttg: c253/289 lr:0.000038 t:19.8s +tttg: c254/289 lr:0.000036 t:19.9s +tttg: c255/289 lr:0.000034 t:20.0s +tttg: c256/289 lr:0.000032 t:20.1s +tttg: c257/289 lr:0.000030 t:20.2s +tttg: c258/289 lr:0.000028 t:20.3s +tttg: c259/289 lr:0.000027 t:20.3s +tttg: c260/289 lr:0.000025 t:20.4s +tttg: c261/289 lr:0.000023 t:20.5s +tttg: c262/289 lr:0.000022 t:20.6s +tttg: c263/289 lr:0.000020 t:20.7s +tttg: c264/289 lr:0.000018 t:20.8s +tttg: c265/289 lr:0.000017 t:20.8s +tttg: c266/289 lr:0.000016 t:20.9s +tttg: c267/289 lr:0.000014 t:21.0s +tttg: c268/289 lr:0.000013 t:21.1s +tttg: c269/289 lr:0.000012 t:21.2s +tttg: c270/289 lr:0.000011 t:21.2s +tttg: c271/289 lr:0.000010 t:21.3s +tttg: c272/289 lr:0.000009 t:21.4s +tttg: c273/289 lr:0.000008 t:21.5s +tttg: c274/289 lr:0.000007 t:21.6s +tttg: c275/289 lr:0.000006 t:21.7s +tttg: c276/289 lr:0.000005 t:21.7s +tttg: c277/289 lr:0.000004 t:21.8s +tttg: c278/289 lr:0.000004 t:21.9s +tttg: c279/289 lr:0.000003 t:22.0s +tttg: c280/289 lr:0.000002 t:22.1s +tttg: c281/289 lr:0.000002 t:22.1s +tttg: c282/289 lr:0.000001 t:22.2s +tttg: c283/289 lr:0.000001 t:22.3s +tttg: c284/289 lr:0.000001 t:22.4s +tttg: c285/289 lr:0.000000 t:22.5s +tttg: c286/289 lr:0.000000 t:22.6s +tttg: c287/289 lr:0.000000 t:22.6s +tttg: c288/289 lr:0.000000 t:22.7s +ttpr: phase:3/3 t:360.8s +ttp: b733/782 bl:2.3752 bb:1.0634 rl:2.2776 rb:1.0539 dl:2441-2468 gd:1 +ttp: b721/782 bl:2.3086 bb:1.0252 rl:2.2793 rb:1.0523 dl:2144-2163 gd:1 +ttp: b714/782 bl:2.3076 bb:1.0221 rl:2.2806 rb:1.0508 dl:2018-2035 gd:1 +ttp: b709/782 bl:2.4427 bb:1.0926 rl:2.2878 rb:1.0527 dl:1937-1952 gd:1 +ttp: b700/782 bl:2.2949 bb:1.0248 rl:2.2881 rb:1.0516 dl:1824-1834 gd:1 +ttp: b689/782 bl:2.3908 bb:1.0764 rl:2.2917 rb:1.0525 dl:1706-1715 gd:1 +ttp: b687/782 bl:2.3090 bb:1.0544 rl:2.2923 rb:1.0525 dl:1685-1696 gd:1 +ttp: b675/782 bl:2.3660 bb:1.0581 rl:2.2946 rb:1.0527 dl:1578-1586 gd:1 +ttp: b666/782 bl:2.4110 bb:1.0642 rl:2.2980 rb:1.0531 dl:1507-1514 gd:1 +ttp: b660/782 bl:2.3712 bb:1.0482 rl:2.2999 rb:1.0529 dl:1466-1474 gd:1 +ttp: b653/782 bl:2.2912 bb:1.0387 rl:2.2997 rb:1.0525 dl:1419-1425 gd:1 +ttp: b645/782 bl:2.2973 bb:1.0278 rl:2.2997 rb:1.0519 dl:1367-1375 gd:1 +ttp: b637/782 bl:2.3658 bb:1.0789 rl:2.3012 rb:1.0526 dl:1320-1325 gd:1 +ttp: b628/782 bl:2.3175 bb:1.0283 rl:2.3015 rb:1.0520 dl:1271-1276 gd:1 +ttp: b621/782 bl:2.3010 bb:1.0508 rl:2.3015 rb:1.0520 dl:1231-1237 gd:1 +ttp: b613/782 bl:2.3361 bb:1.0401 rl:2.3022 rb:1.0518 dl:1190-1195 gd:1 +ttp: b606/782 bl:2.3595 bb:1.0662 rl:2.3032 rb:1.0520 dl:1159-1164 gd:1 +ttp: b598/782 bl:2.3549 bb:1.0651 rl:2.3041 rb:1.0523 dl:1124-1129 gd:1 +ttp: b590/782 bl:2.3064 bb:1.0568 rl:2.3042 rb:1.0523 dl:1089-1093 gd:1 +ttp: b582/782 bl:2.3478 bb:1.0312 rl:2.3049 rb:1.0520 dl:1056-1060 gd:1 +ttp: b571/782 bl:2.2960 bb:1.0044 rl:2.3047 rb:1.0512 dl:1014-1017 gd:1 +ttp: b563/782 bl:2.2611 bb:1.0160 rl:2.3041 rb:1.0507 dl:987-990 gd:1 +ttp: b555/782 bl:2.3166 bb:1.0223 rl:2.3043 rb:1.0503 dl:959-961 gd:1 +ttp: b551/782 bl:2.3342 bb:1.0550 rl:2.3047 rb:1.0504 dl:946-949 gd:1 +ttp: b543/782 bl:2.3378 bb:1.0584 rl:2.3051 rb:1.0505 dl:921-924 gd:1 +ttp: b533/782 bl:2.3757 bb:1.0687 rl:2.3060 rb:1.0507 dl:890-892 gd:1 +ttp: b526/782 bl:2.3229 bb:1.0238 rl:2.3062 rb:1.0504 dl:869-872 gd:1 +ttp: b514/782 bl:2.3071 bb:1.0650 rl:2.3062 rb:1.0505 dl:835-838 gd:1 +ttp: b508/782 bl:2.3898 bb:1.0507 rl:2.3071 rb:1.0505 dl:817-820 gd:1 +ttp: b498/782 bl:2.3487 bb:1.0496 rl:2.3076 rb:1.0505 dl:791-794 gd:1 +ttp: b491/782 bl:2.2799 bb:1.0284 rl:2.3073 rb:1.0503 dl:773-776 gd:1 +ttp: b485/782 bl:2.2923 bb:1.0326 rl:2.3071 rb:1.0501 dl:759-761 gd:1 +ttp: b477/782 bl:2.4047 bb:1.0356 rl:2.3081 rb:1.0500 dl:740-742 gd:1 +ttp: b469/782 bl:2.3219 bb:1.0211 rl:2.3082 rb:1.0497 dl:721-724 gd:1 +ttp: b459/782 bl:2.2817 bb:1.0447 rl:2.3079 rb:1.0497 dl:700-701 gd:1 +ttp: b452/782 bl:2.2609 bb:1.0119 rl:2.3075 rb:1.0493 dl:685-687 gd:1 +ttp: b445/782 bl:2.3617 bb:1.0497 rl:2.3080 rb:1.0493 dl:670-672 gd:1 +ttp: b439/782 bl:2.3227 bb:1.0364 rl:2.3081 rb:1.0492 dl:657-659 gd:1 +ttp: b431/782 bl:2.3723 bb:1.0524 rl:2.3086 rb:1.0493 dl:642-643 gd:1 +ttp: b422/782 bl:2.3040 bb:1.0872 rl:2.3086 rb:1.0495 dl:624-626 gd:1 +ttp: b410/782 bl:2.3212 bb:1.0191 rl:2.3087 rb:1.0493 dl:601-603 gd:1 +ttp: b404/782 bl:2.3651 bb:1.0591 rl:2.3091 rb:1.0494 dl:590-592 gd:1 +ttp: b397/782 bl:2.3561 bb:1.0449 rl:2.3094 rb:1.0493 dl:577-579 gd:1 +ttp: b386/782 bl:2.3393 bb:1.0986 rl:2.3096 rb:1.0497 dl:557-559 gd:1 +ttp: b378/782 bl:2.4273 bb:1.0533 rl:2.3103 rb:1.0497 dl:544-545 gd:1 +ttp: b370/782 bl:2.3690 bb:1.0844 rl:2.3107 rb:1.0499 dl:530-532 gd:1 +ttp: b362/782 bl:2.3586 bb:1.0780 rl:2.3110 rb:1.0501 dl:517-518 gd:1 +ttp: b354/782 bl:2.3036 bb:1.0657 rl:2.3110 rb:1.0502 dl:503-504 gd:1 +ttp: b348/782 bl:2.3632 bb:1.0599 rl:2.3112 rb:1.0502 dl:494-495 gd:1 +ttp: b340/782 bl:2.4566 bb:1.0799 rl:2.3120 rb:1.0504 dl:482-483 gd:1 +ttp: b331/782 bl:2.3366 bb:1.0798 rl:2.3122 rb:1.0505 dl:468-469 gd:1 +ttp: b325/782 bl:2.3494 bb:1.0807 rl:2.3124 rb:1.0507 dl:459-461 gd:1 +ttp: b318/782 bl:2.3368 bb:1.0679 rl:2.3125 rb:1.0508 dl:448-450 gd:1 +ttp: b311/782 bl:2.3421 bb:1.0795 rl:2.3126 rb:1.0509 dl:438-439 gd:1 +ttp: b304/782 bl:2.3388 bb:1.0727 rl:2.3128 rb:1.0510 dl:427-429 gd:1 +ttp: b298/782 bl:2.4138 bb:1.0992 rl:2.3132 rb:1.0512 dl:418-420 gd:1 +ttp: b290/782 bl:2.3381 bb:1.0710 rl:2.3133 rb:1.0513 dl:406-407 gd:1 +ttp: b264/782 bl:2.4253 bb:1.1052 rl:2.3138 rb:1.0515 dl:371-372 gd:1 +ttp: b256/782 bl:2.5424 bb:1.1222 rl:2.3147 rb:1.0518 dl:361-362 gd:1 +ttp: b248/782 bl:2.4562 bb:1.1854 rl:2.3152 rb:1.0523 dl:351-352 gd:1 +ttp: b240/782 bl:2.2974 bb:1.0545 rl:2.3152 rb:1.0523 dl:341-342 gd:1 +ttp: b232/782 bl:2.2991 bb:1.0836 rl:2.3151 rb:1.0524 dl:331-333 gd:1 +ttp: b224/782 bl:2.3780 bb:1.0897 rl:2.3153 rb:1.0526 dl:322-323 gd:1 +ttp: b216/782 bl:2.4761 bb:1.1482 rl:2.3159 rb:1.0529 dl:313-314 gd:1 +ttp: b210/782 bl:2.2544 bb:1.0809 rl:2.3157 rb:1.0530 dl:306-307 gd:1 +ttp: b204/782 bl:2.4621 bb:1.1552 rl:2.3161 rb:1.0533 dl:300-301 gd:1 +ttp: b198/782 bl:2.3931 bb:1.0587 rl:2.3164 rb:1.0533 dl:294-295 gd:1 +ttp: b192/782 bl:2.3753 bb:1.1536 rl:2.3166 rb:1.0536 dl:286-288 gd:1 +ttp: b185/782 bl:2.4274 bb:1.1130 rl:2.3169 rb:1.0537 dl:279-280 gd:1 +ttp: b178/782 bl:2.3347 bb:1.0922 rl:2.3169 rb:1.0539 dl:272-273 gd:1 +ttp: b171/782 bl:2.4749 bb:1.1412 rl:2.3174 rb:1.0541 dl:266-266 gd:1 +ttp: b165/782 bl:2.3439 bb:1.1131 rl:2.3174 rb:1.0542 dl:260-260 gd:1 +ttp: b157/782 bl:2.3604 bb:1.1305 rl:2.3176 rb:1.0544 dl:252-253 gd:1 +ttp: b149/782 bl:2.3697 bb:1.1543 rl:2.3177 rb:1.0547 dl:244-245 gd:1 +ttp: b143/782 bl:2.4091 bb:1.1675 rl:2.3179 rb:1.0549 dl:238-239 gd:1 +ttp: b135/782 bl:2.4255 bb:1.1754 rl:2.3182 rb:1.0552 dl:231-232 gd:1 +ttp: b127/782 bl:2.4736 bb:1.1865 rl:2.3185 rb:1.0555 dl:223-224 gd:1 +ttp: b119/782 bl:2.3772 bb:1.1574 rl:2.3187 rb:1.0557 dl:216-217 gd:1 +ttp: b112/782 bl:2.4800 bb:1.1837 rl:2.3190 rb:1.0560 dl:210-210 gd:1 +ttp: b102/782 bl:2.5821 bb:1.1968 rl:2.3196 rb:1.0563 dl:201-202 gd:1 +ttp: b94/782 bl:2.5646 bb:1.2118 rl:2.3200 rb:1.0566 dl:193-194 gd:1 +ttp: b85/782 bl:2.5074 bb:1.2008 rl:2.3204 rb:1.0568 dl:185-186 gd:1 +ttp: b76/782 bl:2.4891 bb:1.1690 rl:2.3207 rb:1.0570 dl:177-178 gd:1 +ttp: b69/782 bl:2.4613 bb:1.2015 rl:2.3209 rb:1.0572 dl:171-172 gd:1 +ttp: b61/782 bl:2.4498 bb:1.2126 rl:2.3212 rb:1.0575 dl:164-165 gd:1 +ttp: b53/782 bl:2.5220 bb:1.2018 rl:2.3215 rb:1.0577 dl:156-157 gd:1 +ttp: b45/782 bl:2.4571 bb:1.1757 rl:2.3217 rb:1.0579 dl:148-149 gd:1 +ttp: b37/782 bl:2.5716 bb:1.2121 rl:2.3220 rb:1.0581 dl:140-141 gd:1 +ttp: b29/782 bl:2.6352 bb:1.2191 rl:2.3225 rb:1.0583 dl:132-133 gd:1 +ttp: b21/782 bl:2.6071 bb:1.2299 rl:2.3228 rb:1.0585 dl:123-124 gd:1 +ttp: b13/782 bl:2.6894 bb:1.2184 rl:2.3232 rb:1.0587 dl:112-114 gd:1 +ttp: b5/782 bl:2.7054 bb:1.2309 rl:2.3236 rb:1.0588 dl:96-99 gd:1 +quantized_ttt_phased val_loss:2.31934009 val_bpb:1.05984791 eval_time:447286ms +total_eval_time:447.3s diff --git a/records/track_10min_16mb/2026-05-01_PR2101_3Seed_Support/train_seed42.log b/records/track_10min_16mb/2026-05-01_PR2101_3Seed_Support/train_seed42.log new file mode 100644 index 0000000000..f69f584eb8 --- /dev/null +++ b/records/track_10min_16mb/2026-05-01_PR2101_3Seed_Support/train_seed42.log @@ -0,0 +1,953 @@ +W0501 06:00:35.190000 736388 torch/distributed/run.py:803] +W0501 06:00:35.190000 736388 torch/distributed/run.py:803] ***************************************** +W0501 06:00:35.190000 736388 torch/distributed/run.py:803] Setting OMP_NUM_THREADS environment variable for each process to be 1 in default, to avoid your system being overloaded, please further tune the variable for optimal performance in your application as needed. +W0501 06:00:35.190000 736388 torch/distributed/run.py:803] ***************************************** +Hyperparameters: + adam_eps: 1e-08 + adam_wd: 0.02 + artifact_dir: + attn_clip_sigmas: 13.0 + attn_out_gate_enabled: False + attn_out_gate_src: proj + awq_lite_bits: 8 + awq_lite_enabled: True + awq_lite_group_size: 64 + awq_lite_group_top_k: 1 + beta1: 0.9 + beta2: 0.99 + caseops_enabled: True + compressor: pergroup + data_dir: ./data + datasets_dir: ./data/datasets/fineweb10B_sp8192_lossless_caps_caseops_v1_reserved + distributed: True + ema_decay: 0.9965 + embed_bits: 7 + embed_clip_sigmas: 14.0 + embed_lr: 0.6 + embed_wd: 0.085 + enable_looping_at: 0.35 + eval_seq_len: 2560 + eval_stride: 64 + fused_ce_enabled: True + gate_window: 12 + gated_attn_enabled: False + gated_attn_init_std: 0.01 + gated_attn_quant_gate: True + global_ttt_batch_seqs: 32 + global_ttt_chunk_tokens: 32768 + global_ttt_epochs: 1 + global_ttt_grad_clip: 1.0 + global_ttt_lr: 0.001 + global_ttt_momentum: 0.9 + global_ttt_respect_doc_boundaries: True + global_ttt_warmup_chunks: 0 + global_ttt_warmup_start_lr: 0.0 + gptq_calibration_batches: 16 + gptq_reserve_seconds: 8.0 + grad_accum_steps: 1 + grad_centralize: False + grad_clip_norm: 0.3 + is_main_process: True + iterations: 20000 + label_smooth: 0.0 + ln_scale: True + local_rank: 0 + logfile: logs/5cfc14c7-5744-45d2-b1c5-e8b281a84a20.txt + logit_softcap: 30.0 + loop_end: 5 + loop_start: 3 + lqer_asym_enabled: True + lqer_asym_group: 64 + lqer_enabled: True + lqer_factor_bits: 4 + lqer_gain_select: False + lqer_rank: 4 + lqer_scope: all + lqer_top_k: 3 + matrix_bits: 6 + matrix_clip_sigmas: 12.85 + matrix_lr: 0.026 + max_wallclock_seconds: 600.0 + min_lr: 0.1 + mlp_clip_sigmas: 11.5 + mlp_mult: 4.0 + model_dim: 512 + model_path: final_model.pt + muon_backend_steps: 5 + muon_momentum: 0.97 + muon_momentum_warmup_start: 0.92 + muon_momentum_warmup_steps: 1500 + muon_row_normalize: True + muon_wd: 0.095 + num_heads: 8 + num_kv_heads: 4 + num_layers: 11 + num_loops: 2 + parallel_final_lane: mean + parallel_start_layer: 8 + phased_ttt_num_phases: 3 + phased_ttt_prefix_docs: 2500 + qk_gain_init: 5.25 + quantized_model_path: final_model.int6.ptz + rank: 0 + rope_base: 10000.0 + rope_dims: 16 + rope_train_seq_len: 2048 + rope_yarn: False + run_id: 5cfc14c7-5744-45d2-b1c5-e8b281a84a20 + scalar_lr: 0.02 + seed: 42 + skip_gates_enabled: True + smear_gate_enabled: True + sparse_attn_gate_enabled: True + sparse_attn_gate_init_std: 0.0 + sparse_attn_gate_scale: 0.5 + tie_embeddings: True + tied_embed_init_std: 0.005 + tied_embed_lr: 0.03 + tokenizer_path: ./tokenizers/fineweb_8192_bpe_lossless_caps_caseops_v1_reserved.model + train_batch_tokens: 786432 + train_files: ./data/datasets/fineweb10B_sp8192_lossless_caps_caseops_v1_reserved/fineweb_train_*.bin + train_log_every: 500 + train_seq_len: 2048 + ttt_batch_size: 64 + ttt_beta1: 0.0 + ttt_beta2: 0.99 + ttt_chunk_size: 48 + ttt_enabled: True + ttt_eval_batches: + ttt_eval_seq_len: 2560 + ttt_grad_steps: 1 + ttt_k_lora: True + ttt_local_lr_mult: 0.75 + ttt_lora_lr: 0.0001 + ttt_lora_rank: 80 + ttt_mask: no_qv + ttt_mlp_lora: True + ttt_o_lora: True + ttt_optimizer: adam + ttt_q_lora: False + ttt_v_lora: False + ttt_weight_decay: 0.5 + val_batch_tokens: 524288 + val_bytes_files: ./data/datasets/fineweb10B_sp8192_lossless_caps_caseops_v1_reserved/fineweb_val_bytes_*.bin + val_doc_fraction: 1.0 + val_files: ./data/datasets/fineweb10B_sp8192_lossless_caps_caseops_v1_reserved/fineweb_val_*.bin + val_loss_every: 0 + vocab_size: 8192 + warmdown_frac: 0.85 + warmup_steps: 20 + world_size: 8 + xsa_last_n: 11 +train_shards: 80 +val_tokens: 47851520 +model_params:35945673 +gptq:reserving 8s, effective=592000ms +warmup_cu_buckets:64,128,192,256 iters_each:3 +warmup_step: 1/20 +warmup_step: 2/20 +warmup_step: 3/20 +warmup_step: 4/20 +warmup_step: 5/20 +warmup_step: 6/20 +warmup_step: 10/20 +warmup_step: 20/20 +loop_warmup:enabled encoder:[0, 1, 2, 3, 4, 5, 3, 4] decoder:[5, 3, 4, 5, 6, 7, 8, 9, 10] +loop_warmup_step: 1/20 +loop_warmup_step: 2/20 +loop_warmup_step: 3/20 +loop_warmup_step: 4/20 +loop_warmup_step: 5/20 +loop_warmup_step: 6/20 +loop_warmup_step: 10/20 +loop_warmup_step: 20/20 +1/20000 train_loss: 9.0087 train_time: 0.0m tok/s: 17026019 +2/20000 train_loss: 12.8290 train_time: 0.0m tok/s: 11346814 +3/20000 train_loss: 10.2095 train_time: 0.0m tok/s: 10178318 +4/20000 train_loss: 8.6890 train_time: 0.0m tok/s: 9681455 +5/20000 train_loss: 7.9451 train_time: 0.0m tok/s: 9361266 +500/20000 train_loss: 2.5654 train_time: 0.8m tok/s: 8165406 +1000/20000 train_loss: 2.8038 train_time: 1.6m tok/s: 8119882 +1500/20000 train_loss: 2.6145 train_time: 2.4m tok/s: 8103952 +2000/20000 train_loss: 2.6468 train_time: 3.2m tok/s: 8100096 +layer_loop:enabled step:2134 frac:0.350 encoder:[0, 1, 2, 3, 4, 5, 3, 4] decoder:[5, 3, 4, 5, 6, 7, 8, 9, 10] +2500/20000 train_loss: 2.5369 train_time: 4.3m tok/s: 7589269 +3000/20000 train_loss: 2.5478 train_time: 5.5m tok/s: 7154557 +3500/20000 train_loss: 2.5516 train_time: 6.7m tok/s: 6873929 +4000/20000 train_loss: 2.3969 train_time: 7.9m tok/s: 6677152 +4500/20000 train_loss: 2.2644 train_time: 9.0m tok/s: 6531336 +4855/20000 val_loss: 2.3478 val_bpb: 1.0727 +stopping_early: wallclock_cap train_time: 592042ms step: 4855/20000 +peak memory allocated: 41707 MiB reserved: 46952 MiB +ema:applying EMA weights +diagnostic pre-quantization post-ema val_loss:2.32268640 val_bpb:1.06128455 eval_time:9578ms +Serialized model: 135418111 bytes +Code size (uncompressed): 172613 bytes +Code size (compressed): 34386 bytes +GPTQ:collecting Hessians from calibration data... +GPTQ:collected 67 Hessians in 4.1s +Quantized weights: + gate_int8_row: blocks.attn.attn_gate_w + gptq (int6): blocks.attn.c_k.weight, blocks.attn.c_q.weight, blocks.attn.c_v.weight, blocks.attn.proj.weight, blocks.mlp.fc.weight, blocks.mlp.proj.weight + gptq (int6)+lqer_asym: blocks.mlp.fc.weight + gptq (int7)+awqgrpint8+lqer_asym: tok_emb.weight + passthrough (float16): blocks.attn.q_gain, blocks.attn_scale, blocks.mlp_scale, blocks.resid_mix, parallel_post_lambdas, parallel_resid_lambdas, skip_gates, skip_weights, smear_gate.weight, smear_lambda, softcap_neg, softcap_pos +Serialize: per-group lrzip compression... +Serialize: per-group compression done in 119.1s +Serialized model quantized+pergroup: 15945200 bytes +Total submission size quantized+pergroup: 15979586 bytes +Deserialize: per-group lrzip decompression... +Deserialize: decompression done in 20.8s +diagnostic quantized val_loss:2.34108662 val_bpb:1.06969200 eval_time:13261ms +Deserialize: per-group lrzip decompression... +Deserialize: decompression done in 20.9s +ttt_lora:warming up compile (random tokens, no val data) +ttt_lora:compile warmup done (93.7s) + +beginning TTT eval timer +ttt_phased: total_docs:50000 prefix_docs:2500 suffix_docs:47500 num_phases:3 boundaries:[833, 1666, 2500] +ttp: b778/782 bl:2.3792 bb:1.1075 rl:2.3792 rb:1.1075 dl:9244-10426 gd:0 +ttp: b771/782 bl:2.2992 bb:1.0561 rl:2.3498 rb:1.0885 dl:5523-5749 gd:0 +ttp: b766/782 bl:2.1307 bb:0.9996 rl:2.2994 rb:1.0682 dl:4521-4680 gd:0 +ttpp: phase:1/3 pd:1296 gd:833 t:188.7s +tttg: c1/131 lr:0.001000 t:1.7s +tttg: c2/131 lr:0.001000 t:1.8s +tttg: c3/131 lr:0.000999 t:1.8s +tttg: c4/131 lr:0.000999 t:1.9s +tttg: c5/131 lr:0.000998 t:2.0s +tttg: c6/131 lr:0.000996 t:2.1s +tttg: c7/131 lr:0.000995 t:2.2s +tttg: c8/131 lr:0.000993 t:2.2s +tttg: c9/131 lr:0.000991 t:2.3s +tttg: c10/131 lr:0.000988 t:2.4s +tttg: c11/131 lr:0.000985 t:2.5s +tttg: c12/131 lr:0.000982 t:2.5s +tttg: c13/131 lr:0.000979 t:2.6s +tttg: c14/131 lr:0.000976 t:2.7s +tttg: c15/131 lr:0.000972 t:2.8s +tttg: c16/131 lr:0.000968 t:2.8s +tttg: c17/131 lr:0.000963 t:2.9s +tttg: c18/131 lr:0.000958 t:3.0s +tttg: c19/131 lr:0.000953 t:3.1s +tttg: c20/131 lr:0.000948 t:3.2s +tttg: c21/131 lr:0.000943 t:3.2s +tttg: c22/131 lr:0.000937 t:3.3s +tttg: c23/131 lr:0.000931 t:3.4s +tttg: c24/131 lr:0.000925 t:3.5s +tttg: c25/131 lr:0.000918 t:3.5s +tttg: c26/131 lr:0.000911 t:3.6s +tttg: c27/131 lr:0.000905 t:3.7s +tttg: c28/131 lr:0.000897 t:3.8s +tttg: c29/131 lr:0.000890 t:3.9s +tttg: c30/131 lr:0.000882 t:3.9s +tttg: c31/131 lr:0.000874 t:4.0s +tttg: c32/131 lr:0.000866 t:4.1s +tttg: c33/131 lr:0.000858 t:4.2s +tttg: c34/131 lr:0.000849 t:4.3s +tttg: c35/131 lr:0.000841 t:4.3s +tttg: c36/131 lr:0.000832 t:4.4s +tttg: c37/131 lr:0.000822 t:4.5s +tttg: c38/131 lr:0.000813 t:4.6s +tttg: c39/131 lr:0.000804 t:4.7s +tttg: c40/131 lr:0.000794 t:4.7s +tttg: c41/131 lr:0.000784 t:4.8s +tttg: c42/131 lr:0.000774 t:4.9s +tttg: c43/131 lr:0.000764 t:5.0s +tttg: c44/131 lr:0.000753 t:5.0s +tttg: c45/131 lr:0.000743 t:5.1s +tttg: c46/131 lr:0.000732 t:5.2s +tttg: c47/131 lr:0.000722 t:5.3s +tttg: c48/131 lr:0.000711 t:5.4s +tttg: c49/131 lr:0.000700 t:5.4s +tttg: c50/131 lr:0.000689 t:5.5s +tttg: c51/131 lr:0.000677 t:5.6s +tttg: c52/131 lr:0.000666 t:5.7s +tttg: c53/131 lr:0.000655 t:5.7s +tttg: c54/131 lr:0.000643 t:5.8s +tttg: c55/131 lr:0.000631 t:5.9s +tttg: c56/131 lr:0.000620 t:6.0s +tttg: c57/131 lr:0.000608 t:6.1s +tttg: c58/131 lr:0.000596 t:6.1s +tttg: c59/131 lr:0.000584 t:6.2s +tttg: c60/131 lr:0.000572 t:6.3s +tttg: c61/131 lr:0.000560 t:6.4s +tttg: c62/131 lr:0.000548 t:6.5s +tttg: c63/131 lr:0.000536 t:6.5s +tttg: c64/131 lr:0.000524 t:6.6s +tttg: c65/131 lr:0.000512 t:6.7s +tttg: c66/131 lr:0.000500 t:6.8s +tttg: c67/131 lr:0.000488 t:6.8s +tttg: c68/131 lr:0.000476 t:6.9s +tttg: c69/131 lr:0.000464 t:7.0s +tttg: c70/131 lr:0.000452 t:7.1s +tttg: c71/131 lr:0.000440 t:7.2s +tttg: c72/131 lr:0.000428 t:7.2s +tttg: c73/131 lr:0.000416 t:7.3s +tttg: c74/131 lr:0.000404 t:7.4s +tttg: c75/131 lr:0.000392 t:7.5s +tttg: c76/131 lr:0.000380 t:7.6s +tttg: c77/131 lr:0.000369 t:7.6s +tttg: c78/131 lr:0.000357 t:7.7s +tttg: c79/131 lr:0.000345 t:7.8s +tttg: c80/131 lr:0.000334 t:7.9s +tttg: c81/131 lr:0.000323 t:8.0s +tttg: c82/131 lr:0.000311 t:8.0s +tttg: c83/131 lr:0.000300 t:8.1s +tttg: c84/131 lr:0.000289 t:8.2s +tttg: c85/131 lr:0.000278 t:8.3s +tttg: c86/131 lr:0.000268 t:8.3s +tttg: c87/131 lr:0.000257 t:8.4s +tttg: c88/131 lr:0.000247 t:8.5s +tttg: c89/131 lr:0.000236 t:8.6s +tttg: c90/131 lr:0.000226 t:8.7s +tttg: c91/131 lr:0.000216 t:8.7s +tttg: c92/131 lr:0.000206 t:8.8s +tttg: c93/131 lr:0.000196 t:8.9s +tttg: c94/131 lr:0.000187 t:9.0s +tttg: c95/131 lr:0.000178 t:9.0s +tttg: c96/131 lr:0.000168 t:9.1s +tttg: c97/131 lr:0.000159 t:9.2s +tttg: c98/131 lr:0.000151 t:9.3s +tttg: c99/131 lr:0.000142 t:9.4s +tttg: c100/131 lr:0.000134 t:9.4s +tttg: c101/131 lr:0.000126 t:9.5s +tttg: c102/131 lr:0.000118 t:9.6s +tttg: c103/131 lr:0.000110 t:9.7s +tttg: c104/131 lr:0.000103 t:9.8s +tttg: c105/131 lr:0.000095 t:9.8s +tttg: c106/131 lr:0.000089 t:9.9s +tttg: c107/131 lr:0.000082 t:10.0s +tttg: c108/131 lr:0.000075 t:10.1s +tttg: c109/131 lr:0.000069 t:10.1s +tttg: c110/131 lr:0.000063 t:10.2s +tttg: c111/131 lr:0.000057 t:10.3s +tttg: c112/131 lr:0.000052 t:10.4s +tttg: c113/131 lr:0.000047 t:10.5s +tttg: c114/131 lr:0.000042 t:10.5s +tttg: c115/131 lr:0.000037 t:10.6s +tttg: c116/131 lr:0.000032 t:10.7s +tttg: c117/131 lr:0.000028 t:10.8s +tttg: c118/131 lr:0.000024 t:10.8s +tttg: c119/131 lr:0.000021 t:10.9s +tttg: c120/131 lr:0.000018 t:11.0s +tttg: c121/131 lr:0.000015 t:11.1s +tttg: c122/131 lr:0.000012 t:11.2s +tttg: c123/131 lr:0.000009 t:11.2s +tttg: c124/131 lr:0.000007 t:11.3s +tttg: c125/131 lr:0.000005 t:11.4s +tttg: c126/131 lr:0.000004 t:11.5s +tttg: c127/131 lr:0.000002 t:11.5s +tttg: c128/131 lr:0.000001 t:11.6s +tttg: c129/131 lr:0.000001 t:11.7s +tttg: c130/131 lr:0.000000 t:11.8s +ttpr: phase:1/3 t:201.6s +ttp: b757/782 bl:2.2746 bb:1.0588 rl:2.2956 rb:1.0668 dl:3550-3633 gd:0 +ttp: b752/782 bl:2.3264 bb:1.0694 rl:2.2993 rb:1.0671 dl:3222-3283 gd:0 +ttp: b749/782 bl:2.3864 bb:1.0828 rl:2.3083 rb:1.0688 dl:3039-3089 gd:0 +ttpp: phase:2/3 pd:2128 gd:1666 t:259.3s +tttg: c1/219 lr:0.001000 t:0.1s +tttg: c2/219 lr:0.001000 t:0.2s +tttg: c3/219 lr:0.001000 t:0.2s +tttg: c4/219 lr:0.001000 t:0.3s +tttg: c5/219 lr:0.000999 t:0.4s +tttg: c6/219 lr:0.000999 t:0.5s +tttg: c7/219 lr:0.000998 t:0.5s +tttg: c8/219 lr:0.000997 t:0.6s +tttg: c9/219 lr:0.000997 t:0.7s +tttg: c10/219 lr:0.000996 t:0.8s +tttg: c11/219 lr:0.000995 t:0.9s +tttg: c12/219 lr:0.000994 t:0.9s +tttg: c13/219 lr:0.000993 t:1.0s +tttg: c14/219 lr:0.000991 t:1.1s +tttg: c15/219 lr:0.000990 t:1.2s +tttg: c16/219 lr:0.000988 t:1.2s +tttg: c17/219 lr:0.000987 t:1.3s +tttg: c18/219 lr:0.000985 t:1.4s +tttg: c19/219 lr:0.000983 t:1.5s +tttg: c20/219 lr:0.000981 t:1.6s +tttg: c21/219 lr:0.000979 t:1.6s +tttg: c22/219 lr:0.000977 t:1.7s +tttg: c23/219 lr:0.000975 t:1.8s +tttg: c24/219 lr:0.000973 t:1.9s +tttg: c25/219 lr:0.000970 t:2.0s +tttg: c26/219 lr:0.000968 t:2.0s +tttg: c27/219 lr:0.000965 t:2.1s +tttg: c28/219 lr:0.000963 t:2.2s +tttg: c29/219 lr:0.000960 t:2.3s +tttg: c30/219 lr:0.000957 t:2.4s +tttg: c31/219 lr:0.000954 t:2.4s +tttg: c32/219 lr:0.000951 t:2.5s +tttg: c33/219 lr:0.000948 t:2.6s +tttg: c34/219 lr:0.000945 t:2.7s +tttg: c35/219 lr:0.000941 t:2.8s +tttg: c36/219 lr:0.000938 t:2.8s +tttg: c37/219 lr:0.000934 t:2.9s +tttg: c38/219 lr:0.000931 t:3.0s +tttg: c39/219 lr:0.000927 t:3.1s +tttg: c40/219 lr:0.000923 t:3.2s +tttg: c41/219 lr:0.000919 t:3.2s +tttg: c42/219 lr:0.000915 t:3.3s +tttg: c43/219 lr:0.000911 t:3.4s +tttg: c44/219 lr:0.000907 t:3.5s +tttg: c45/219 lr:0.000903 t:3.5s +tttg: c46/219 lr:0.000898 t:3.6s +tttg: c47/219 lr:0.000894 t:3.7s +tttg: c48/219 lr:0.000890 t:3.8s +tttg: c49/219 lr:0.000885 t:3.9s +tttg: c50/219 lr:0.000880 t:3.9s +tttg: c51/219 lr:0.000876 t:4.0s +tttg: c52/219 lr:0.000871 t:4.1s +tttg: c53/219 lr:0.000866 t:4.2s +tttg: c54/219 lr:0.000861 t:4.3s +tttg: c55/219 lr:0.000856 t:4.4s +tttg: c56/219 lr:0.000851 t:4.4s +tttg: c57/219 lr:0.000846 t:4.5s +tttg: c58/219 lr:0.000841 t:4.6s +tttg: c59/219 lr:0.000835 t:4.7s +tttg: c60/219 lr:0.000830 t:4.7s +tttg: c61/219 lr:0.000824 t:4.8s +tttg: c62/219 lr:0.000819 t:4.9s +tttg: c63/219 lr:0.000813 t:5.0s +tttg: c64/219 lr:0.000808 t:5.1s +tttg: c65/219 lr:0.000802 t:5.1s +tttg: c66/219 lr:0.000796 t:5.2s +tttg: c67/219 lr:0.000790 t:5.3s +tttg: c68/219 lr:0.000784 t:5.4s +tttg: c69/219 lr:0.000779 t:5.5s +tttg: c70/219 lr:0.000773 t:5.5s +tttg: c71/219 lr:0.000766 t:5.6s +tttg: c72/219 lr:0.000760 t:5.7s +tttg: c73/219 lr:0.000754 t:5.8s +tttg: c74/219 lr:0.000748 t:5.9s +tttg: c75/219 lr:0.000742 t:5.9s +tttg: c76/219 lr:0.000735 t:6.0s +tttg: c77/219 lr:0.000729 t:6.1s +tttg: c78/219 lr:0.000722 t:6.2s +tttg: c79/219 lr:0.000716 t:6.3s +tttg: c80/219 lr:0.000709 t:6.3s +tttg: c81/219 lr:0.000703 t:6.4s +tttg: c82/219 lr:0.000696 t:6.5s +tttg: c83/219 lr:0.000690 t:6.6s +tttg: c84/219 lr:0.000683 t:6.7s +tttg: c85/219 lr:0.000676 t:6.7s +tttg: c86/219 lr:0.000670 t:6.8s +tttg: c87/219 lr:0.000663 t:6.9s +tttg: c88/219 lr:0.000656 t:7.0s +tttg: c89/219 lr:0.000649 t:7.1s +tttg: c90/219 lr:0.000642 t:7.1s +tttg: c91/219 lr:0.000635 t:7.2s +tttg: c92/219 lr:0.000628 t:7.3s +tttg: c93/219 lr:0.000621 t:7.4s +tttg: c94/219 lr:0.000614 t:7.5s +tttg: c95/219 lr:0.000607 t:7.5s +tttg: c96/219 lr:0.000600 t:7.6s +tttg: c97/219 lr:0.000593 t:7.7s +tttg: c98/219 lr:0.000586 t:7.8s +tttg: c99/219 lr:0.000579 t:7.8s +tttg: c100/219 lr:0.000572 t:7.9s +tttg: c101/219 lr:0.000565 t:8.0s +tttg: c102/219 lr:0.000558 t:8.1s +tttg: c103/219 lr:0.000550 t:8.2s +tttg: c104/219 lr:0.000543 t:8.3s +tttg: c105/219 lr:0.000536 t:8.3s +tttg: c106/219 lr:0.000529 t:8.4s +tttg: c107/219 lr:0.000522 t:8.5s +tttg: c108/219 lr:0.000514 t:8.6s +tttg: c109/219 lr:0.000507 t:8.6s +tttg: c110/219 lr:0.000500 t:8.7s +tttg: c111/219 lr:0.000493 t:8.8s +tttg: c112/219 lr:0.000486 t:8.9s +tttg: c113/219 lr:0.000478 t:9.0s +tttg: c114/219 lr:0.000471 t:9.0s +tttg: c115/219 lr:0.000464 t:9.1s +tttg: c116/219 lr:0.000457 t:9.2s +tttg: c117/219 lr:0.000450 t:9.3s +tttg: c118/219 lr:0.000442 t:9.4s +tttg: c119/219 lr:0.000435 t:9.4s +tttg: c120/219 lr:0.000428 t:9.5s +tttg: c121/219 lr:0.000421 t:9.6s +tttg: c122/219 lr:0.000414 t:9.7s +tttg: c123/219 lr:0.000407 t:9.8s +tttg: c124/219 lr:0.000400 t:9.8s +tttg: c125/219 lr:0.000393 t:9.9s +tttg: c126/219 lr:0.000386 t:10.0s +tttg: c127/219 lr:0.000379 t:10.1s +tttg: c128/219 lr:0.000372 t:10.1s +tttg: c129/219 lr:0.000365 t:10.2s +tttg: c130/219 lr:0.000358 t:10.3s +tttg: c131/219 lr:0.000351 t:10.4s +tttg: c132/219 lr:0.000344 t:10.5s +tttg: c133/219 lr:0.000337 t:10.5s +tttg: c134/219 lr:0.000330 t:10.6s +tttg: c135/219 lr:0.000324 t:10.7s +tttg: c136/219 lr:0.000317 t:10.8s +tttg: c137/219 lr:0.000310 t:10.9s +tttg: c138/219 lr:0.000304 t:10.9s +tttg: c139/219 lr:0.000297 t:11.0s +tttg: c140/219 lr:0.000291 t:11.1s +tttg: c141/219 lr:0.000284 t:11.2s +tttg: c142/219 lr:0.000278 t:11.3s +tttg: c143/219 lr:0.000271 t:11.3s +tttg: c144/219 lr:0.000265 t:11.4s +tttg: c145/219 lr:0.000258 t:11.5s +tttg: c146/219 lr:0.000252 t:11.6s +tttg: c147/219 lr:0.000246 t:11.7s +tttg: c148/219 lr:0.000240 t:11.7s +tttg: c149/219 lr:0.000234 t:11.8s +tttg: c150/219 lr:0.000227 t:11.9s +tttg: c151/219 lr:0.000221 t:12.0s +tttg: c152/219 lr:0.000216 t:12.1s +tttg: c153/219 lr:0.000210 t:12.1s +tttg: c154/219 lr:0.000204 t:12.2s +tttg: c155/219 lr:0.000198 t:12.3s +tttg: c156/219 lr:0.000192 t:12.4s +tttg: c157/219 lr:0.000187 t:12.4s +tttg: c158/219 lr:0.000181 t:12.5s +tttg: c159/219 lr:0.000176 t:12.6s +tttg: c160/219 lr:0.000170 t:12.7s +tttg: c161/219 lr:0.000165 t:12.8s +tttg: c162/219 lr:0.000159 t:12.8s +tttg: c163/219 lr:0.000154 t:12.9s +tttg: c164/219 lr:0.000149 t:13.0s +tttg: c165/219 lr:0.000144 t:13.1s +tttg: c166/219 lr:0.000139 t:13.1s +tttg: c167/219 lr:0.000134 t:13.2s +tttg: c168/219 lr:0.000129 t:13.3s +tttg: c169/219 lr:0.000124 t:13.4s +tttg: c170/219 lr:0.000120 t:13.5s +tttg: c171/219 lr:0.000115 t:13.6s +tttg: c172/219 lr:0.000110 t:13.6s +tttg: c173/219 lr:0.000106 t:13.7s +tttg: c174/219 lr:0.000102 t:13.8s +tttg: c175/219 lr:0.000097 t:13.9s +tttg: c176/219 lr:0.000093 t:14.0s +tttg: c177/219 lr:0.000089 t:14.0s +tttg: c178/219 lr:0.000085 t:14.1s +tttg: c179/219 lr:0.000081 t:14.2s +tttg: c180/219 lr:0.000077 t:14.3s +tttg: c181/219 lr:0.000073 t:14.3s +tttg: c182/219 lr:0.000069 t:14.4s +tttg: c183/219 lr:0.000066 t:14.5s +tttg: c184/219 lr:0.000062 t:14.6s +tttg: c185/219 lr:0.000059 t:14.7s +tttg: c186/219 lr:0.000055 t:14.7s +tttg: c187/219 lr:0.000052 t:14.8s +tttg: c188/219 lr:0.000049 t:14.9s +tttg: c189/219 lr:0.000046 t:15.0s +tttg: c190/219 lr:0.000043 t:15.1s +tttg: c191/219 lr:0.000040 t:15.1s +tttg: c192/219 lr:0.000037 t:15.2s +tttg: c193/219 lr:0.000035 t:15.3s +tttg: c194/219 lr:0.000032 t:15.4s +tttg: c195/219 lr:0.000030 t:15.5s +tttg: c196/219 lr:0.000027 t:15.5s +tttg: c197/219 lr:0.000025 t:15.6s +tttg: c198/219 lr:0.000023 t:15.7s +tttg: c199/219 lr:0.000021 t:15.8s +tttg: c200/219 lr:0.000019 t:15.8s +tttg: c201/219 lr:0.000017 t:15.9s +tttg: c202/219 lr:0.000015 t:16.0s +tttg: c203/219 lr:0.000013 t:16.1s +tttg: c204/219 lr:0.000012 t:16.2s +tttg: c205/219 lr:0.000010 t:16.2s +tttg: c206/219 lr:0.000009 t:16.3s +tttg: c207/219 lr:0.000007 t:16.4s +tttg: c208/219 lr:0.000006 t:16.5s +tttg: c209/219 lr:0.000005 t:16.6s +tttg: c210/219 lr:0.000004 t:16.6s +tttg: c211/219 lr:0.000003 t:16.7s +tttg: c212/219 lr:0.000003 t:16.8s +tttg: c213/219 lr:0.000002 t:16.9s +tttg: c214/219 lr:0.000001 t:17.0s +tttg: c215/219 lr:0.000001 t:17.0s +tttg: c216/219 lr:0.000000 t:17.1s +tttg: c217/219 lr:0.000000 t:17.2s +tttg: c218/219 lr:0.000000 t:17.3s +ttpr: phase:2/3 t:277.6s +ttp: b742/782 bl:2.3200 bb:1.0445 rl:2.3092 rb:1.0667 dl:2730-2762 gd:0 +ttpp: phase:3/3 pd:2960 gd:2500 t:293.7s +tttg: c1/289 lr:0.001000 t:0.1s +tttg: c2/289 lr:0.001000 t:0.2s +tttg: c3/289 lr:0.001000 t:0.2s +tttg: c4/289 lr:0.001000 t:0.3s +tttg: c5/289 lr:0.001000 t:0.4s +tttg: c6/289 lr:0.000999 t:0.5s +tttg: c7/289 lr:0.000999 t:0.5s +tttg: c8/289 lr:0.000999 t:0.6s +tttg: c9/289 lr:0.000998 t:0.7s +tttg: c10/289 lr:0.000998 t:0.8s +tttg: c11/289 lr:0.000997 t:0.9s +tttg: c12/289 lr:0.000996 t:0.9s +tttg: c13/289 lr:0.000996 t:1.0s +tttg: c14/289 lr:0.000995 t:1.1s +tttg: c15/289 lr:0.000994 t:1.2s +tttg: c16/289 lr:0.000993 t:1.3s +tttg: c17/289 lr:0.000992 t:1.3s +tttg: c18/289 lr:0.000991 t:1.4s +tttg: c19/289 lr:0.000990 t:1.5s +tttg: c20/289 lr:0.000989 t:1.6s +tttg: c21/289 lr:0.000988 t:1.7s +tttg: c22/289 lr:0.000987 t:1.7s +tttg: c23/289 lr:0.000986 t:1.8s +tttg: c24/289 lr:0.000984 t:1.9s +tttg: c25/289 lr:0.000983 t:2.0s +tttg: c26/289 lr:0.000982 t:2.0s +tttg: c27/289 lr:0.000980 t:2.1s +tttg: c28/289 lr:0.000978 t:2.2s +tttg: c29/289 lr:0.000977 t:2.3s +tttg: c30/289 lr:0.000975 t:2.4s +tttg: c31/289 lr:0.000973 t:2.5s +tttg: c32/289 lr:0.000972 t:2.5s +tttg: c33/289 lr:0.000970 t:2.6s +tttg: c34/289 lr:0.000968 t:2.7s +tttg: c35/289 lr:0.000966 t:2.8s +tttg: c36/289 lr:0.000964 t:2.9s +tttg: c37/289 lr:0.000962 t:2.9s +tttg: c38/289 lr:0.000960 t:3.0s +tttg: c39/289 lr:0.000958 t:3.1s +tttg: c40/289 lr:0.000955 t:3.2s +tttg: c41/289 lr:0.000953 t:3.2s +tttg: c42/289 lr:0.000951 t:3.3s +tttg: c43/289 lr:0.000948 t:3.4s +tttg: c44/289 lr:0.000946 t:3.5s +tttg: c45/289 lr:0.000944 t:3.6s +tttg: c46/289 lr:0.000941 t:3.6s +tttg: c47/289 lr:0.000938 t:3.7s +tttg: c48/289 lr:0.000936 t:3.8s +tttg: c49/289 lr:0.000933 t:3.9s +tttg: c50/289 lr:0.000930 t:4.0s +tttg: c51/289 lr:0.000927 t:4.0s +tttg: c52/289 lr:0.000925 t:4.1s +tttg: c53/289 lr:0.000922 t:4.2s +tttg: c54/289 lr:0.000919 t:4.3s +tttg: c55/289 lr:0.000916 t:4.4s +tttg: c56/289 lr:0.000913 t:4.4s +tttg: c57/289 lr:0.000910 t:4.5s +tttg: c58/289 lr:0.000906 t:4.6s +tttg: c59/289 lr:0.000903 t:4.7s +tttg: c60/289 lr:0.000900 t:4.8s +tttg: c61/289 lr:0.000897 t:4.8s +tttg: c62/289 lr:0.000893 t:4.9s +tttg: c63/289 lr:0.000890 t:5.0s +tttg: c64/289 lr:0.000887 t:5.1s +tttg: c65/289 lr:0.000883 t:5.2s +tttg: c66/289 lr:0.000879 t:5.2s +tttg: c67/289 lr:0.000876 t:5.3s +tttg: c68/289 lr:0.000872 t:5.4s +tttg: c69/289 lr:0.000869 t:5.5s +tttg: c70/289 lr:0.000865 t:5.5s +tttg: c71/289 lr:0.000861 t:5.6s +tttg: c72/289 lr:0.000857 t:5.7s +tttg: c73/289 lr:0.000854 t:5.8s +tttg: c74/289 lr:0.000850 t:5.9s +tttg: c75/289 lr:0.000846 t:6.0s +tttg: c76/289 lr:0.000842 t:6.0s +tttg: c77/289 lr:0.000838 t:6.1s +tttg: c78/289 lr:0.000834 t:6.2s +tttg: c79/289 lr:0.000830 t:6.3s +tttg: c80/289 lr:0.000826 t:6.3s +tttg: c81/289 lr:0.000821 t:6.4s +tttg: c82/289 lr:0.000817 t:6.5s +tttg: c83/289 lr:0.000813 t:6.6s +tttg: c84/289 lr:0.000809 t:6.7s +tttg: c85/289 lr:0.000804 t:6.7s +tttg: c86/289 lr:0.000800 t:6.8s +tttg: c87/289 lr:0.000796 t:6.9s +tttg: c88/289 lr:0.000791 t:7.0s +tttg: c89/289 lr:0.000787 t:7.1s +tttg: c90/289 lr:0.000782 t:7.1s +tttg: c91/289 lr:0.000778 t:7.2s +tttg: c92/289 lr:0.000773 t:7.3s +tttg: c93/289 lr:0.000769 t:7.4s +tttg: c94/289 lr:0.000764 t:7.5s +tttg: c95/289 lr:0.000759 t:7.5s +tttg: c96/289 lr:0.000755 t:7.6s +tttg: c97/289 lr:0.000750 t:7.7s +tttg: c98/289 lr:0.000745 t:7.8s +tttg: c99/289 lr:0.000740 t:7.8s +tttg: c100/289 lr:0.000736 t:7.9s +tttg: c101/289 lr:0.000731 t:8.0s +tttg: c102/289 lr:0.000726 t:8.1s +tttg: c103/289 lr:0.000721 t:8.2s +tttg: c104/289 lr:0.000716 t:8.2s +tttg: c105/289 lr:0.000711 t:8.3s +tttg: c106/289 lr:0.000706 t:8.4s +tttg: c107/289 lr:0.000701 t:8.5s +tttg: c108/289 lr:0.000696 t:8.6s +tttg: c109/289 lr:0.000691 t:8.6s +tttg: c110/289 lr:0.000686 t:8.7s +tttg: c111/289 lr:0.000681 t:8.8s +tttg: c112/289 lr:0.000676 t:8.9s +tttg: c113/289 lr:0.000671 t:9.0s +tttg: c114/289 lr:0.000666 t:9.0s +tttg: c115/289 lr:0.000661 t:9.1s +tttg: c116/289 lr:0.000656 t:9.2s +tttg: c117/289 lr:0.000650 t:9.3s +tttg: c118/289 lr:0.000645 t:9.4s +tttg: c119/289 lr:0.000640 t:9.4s +tttg: c120/289 lr:0.000635 t:9.5s +tttg: c121/289 lr:0.000629 t:9.6s +tttg: c122/289 lr:0.000624 t:9.7s +tttg: c123/289 lr:0.000619 t:9.7s +tttg: c124/289 lr:0.000614 t:9.8s +tttg: c125/289 lr:0.000608 t:9.9s +tttg: c126/289 lr:0.000603 t:10.0s +tttg: c127/289 lr:0.000598 t:10.1s +tttg: c128/289 lr:0.000592 t:10.1s +tttg: c129/289 lr:0.000587 t:10.2s +tttg: c130/289 lr:0.000581 t:10.3s +tttg: c131/289 lr:0.000576 t:10.4s +tttg: c132/289 lr:0.000571 t:10.4s +tttg: c133/289 lr:0.000565 t:10.5s +tttg: c134/289 lr:0.000560 t:10.6s +tttg: c135/289 lr:0.000554 t:10.7s +tttg: c136/289 lr:0.000549 t:10.8s +tttg: c137/289 lr:0.000544 t:10.8s +tttg: c138/289 lr:0.000538 t:10.9s +tttg: c139/289 lr:0.000533 t:11.0s +tttg: c140/289 lr:0.000527 t:11.1s +tttg: c141/289 lr:0.000522 t:11.1s +tttg: c142/289 lr:0.000516 t:11.2s +tttg: c143/289 lr:0.000511 t:11.3s +tttg: c144/289 lr:0.000505 t:11.4s +tttg: c145/289 lr:0.000500 t:11.5s +tttg: c146/289 lr:0.000495 t:11.5s +tttg: c147/289 lr:0.000489 t:11.6s +tttg: c148/289 lr:0.000484 t:13.1s +tttg: c149/289 lr:0.000478 t:13.2s +tttg: c150/289 lr:0.000473 t:13.3s +tttg: c151/289 lr:0.000467 t:13.3s +tttg: c152/289 lr:0.000462 t:13.4s +tttg: c153/289 lr:0.000456 t:13.5s +tttg: c154/289 lr:0.000451 t:13.5s +tttg: c155/289 lr:0.000446 t:13.6s +tttg: c156/289 lr:0.000440 t:13.7s +tttg: c157/289 lr:0.000435 t:13.8s +tttg: c158/289 lr:0.000429 t:13.9s +tttg: c159/289 lr:0.000424 t:13.9s +tttg: c160/289 lr:0.000419 t:14.0s +tttg: c161/289 lr:0.000413 t:14.1s +tttg: c162/289 lr:0.000408 t:14.2s +tttg: c163/289 lr:0.000402 t:14.2s +tttg: c164/289 lr:0.000397 t:14.3s +tttg: c165/289 lr:0.000392 t:14.4s +tttg: c166/289 lr:0.000386 t:14.5s +tttg: c167/289 lr:0.000381 t:14.6s +tttg: c168/289 lr:0.000376 t:14.6s +tttg: c169/289 lr:0.000371 t:14.7s +tttg: c170/289 lr:0.000365 t:14.8s +tttg: c171/289 lr:0.000360 t:14.9s +tttg: c172/289 lr:0.000355 t:15.0s +tttg: c173/289 lr:0.000350 t:15.0s +tttg: c174/289 lr:0.000344 t:15.1s +tttg: c175/289 lr:0.000339 t:15.2s +tttg: c176/289 lr:0.000334 t:15.3s +tttg: c177/289 lr:0.000329 t:15.3s +tttg: c178/289 lr:0.000324 t:15.4s +tttg: c179/289 lr:0.000319 t:15.5s +tttg: c180/289 lr:0.000314 t:15.6s +tttg: c181/289 lr:0.000309 t:15.7s +tttg: c182/289 lr:0.000304 t:15.7s +tttg: c183/289 lr:0.000299 t:15.8s +tttg: c184/289 lr:0.000294 t:15.9s +tttg: c185/289 lr:0.000289 t:16.0s +tttg: c186/289 lr:0.000284 t:16.1s +tttg: c187/289 lr:0.000279 t:16.1s +tttg: c188/289 lr:0.000274 t:16.2s +tttg: c189/289 lr:0.000269 t:16.3s +tttg: c190/289 lr:0.000264 t:16.4s +tttg: c191/289 lr:0.000260 t:16.5s +tttg: c192/289 lr:0.000255 t:16.5s +tttg: c193/289 lr:0.000250 t:16.6s +tttg: c194/289 lr:0.000245 t:16.7s +tttg: c195/289 lr:0.000241 t:16.8s +tttg: c196/289 lr:0.000236 t:16.8s +tttg: c197/289 lr:0.000231 t:16.9s +tttg: c198/289 lr:0.000227 t:17.0s +tttg: c199/289 lr:0.000222 t:17.1s +tttg: c200/289 lr:0.000218 t:17.2s +tttg: c201/289 lr:0.000213 t:17.2s +tttg: c202/289 lr:0.000209 t:17.3s +tttg: c203/289 lr:0.000204 t:17.4s +tttg: c204/289 lr:0.000200 t:17.5s +tttg: c205/289 lr:0.000196 t:17.6s +tttg: c206/289 lr:0.000191 t:17.7s +tttg: c207/289 lr:0.000187 t:17.7s +tttg: c208/289 lr:0.000183 t:17.8s +tttg: c209/289 lr:0.000179 t:17.9s +tttg: c210/289 lr:0.000174 t:18.0s +tttg: c211/289 lr:0.000170 t:18.0s +tttg: c212/289 lr:0.000166 t:18.1s +tttg: c213/289 lr:0.000162 t:18.2s +tttg: c214/289 lr:0.000158 t:18.3s +tttg: c215/289 lr:0.000154 t:18.4s +tttg: c216/289 lr:0.000150 t:18.4s +tttg: c217/289 lr:0.000146 t:18.5s +tttg: c218/289 lr:0.000143 t:18.6s +tttg: c219/289 lr:0.000139 t:18.7s +tttg: c220/289 lr:0.000135 t:18.7s +tttg: c221/289 lr:0.000131 t:18.8s +tttg: c222/289 lr:0.000128 t:18.9s +tttg: c223/289 lr:0.000124 t:19.0s +tttg: c224/289 lr:0.000121 t:19.1s +tttg: c225/289 lr:0.000117 t:19.1s +tttg: c226/289 lr:0.000113 t:19.2s +tttg: c227/289 lr:0.000110 t:19.3s +tttg: c228/289 lr:0.000107 t:19.4s +tttg: c229/289 lr:0.000103 t:19.5s +tttg: c230/289 lr:0.000100 t:19.5s +tttg: c231/289 lr:0.000097 t:19.6s +tttg: c232/289 lr:0.000094 t:19.7s +tttg: c233/289 lr:0.000090 t:19.8s +tttg: c234/289 lr:0.000087 t:19.9s +tttg: c235/289 lr:0.000084 t:19.9s +tttg: c236/289 lr:0.000081 t:20.0s +tttg: c237/289 lr:0.000078 t:20.1s +tttg: c238/289 lr:0.000075 t:20.2s +tttg: c239/289 lr:0.000073 t:20.3s +tttg: c240/289 lr:0.000070 t:20.3s +tttg: c241/289 lr:0.000067 t:20.4s +tttg: c242/289 lr:0.000064 t:20.5s +tttg: c243/289 lr:0.000062 t:20.6s +tttg: c244/289 lr:0.000059 t:20.7s +tttg: c245/289 lr:0.000056 t:20.7s +tttg: c246/289 lr:0.000054 t:20.8s +tttg: c247/289 lr:0.000052 t:20.9s +tttg: c248/289 lr:0.000049 t:21.0s +tttg: c249/289 lr:0.000047 t:21.0s +tttg: c250/289 lr:0.000045 t:21.1s +tttg: c251/289 lr:0.000042 t:21.2s +tttg: c252/289 lr:0.000040 t:21.3s +tttg: c253/289 lr:0.000038 t:21.4s +tttg: c254/289 lr:0.000036 t:21.4s +tttg: c255/289 lr:0.000034 t:21.5s +tttg: c256/289 lr:0.000032 t:21.6s +tttg: c257/289 lr:0.000030 t:21.7s +tttg: c258/289 lr:0.000028 t:21.8s +tttg: c259/289 lr:0.000027 t:21.8s +tttg: c260/289 lr:0.000025 t:21.9s +tttg: c261/289 lr:0.000023 t:22.0s +tttg: c262/289 lr:0.000022 t:22.1s +tttg: c263/289 lr:0.000020 t:22.1s +tttg: c264/289 lr:0.000018 t:22.2s +tttg: c265/289 lr:0.000017 t:22.3s +tttg: c266/289 lr:0.000016 t:22.4s +tttg: c267/289 lr:0.000014 t:22.5s +tttg: c268/289 lr:0.000013 t:22.5s +tttg: c269/289 lr:0.000012 t:22.6s +tttg: c270/289 lr:0.000011 t:22.7s +tttg: c271/289 lr:0.000010 t:22.8s +tttg: c272/289 lr:0.000009 t:22.9s +tttg: c273/289 lr:0.000008 t:22.9s +tttg: c274/289 lr:0.000007 t:23.0s +tttg: c275/289 lr:0.000006 t:23.1s +tttg: c276/289 lr:0.000005 t:23.2s +tttg: c277/289 lr:0.000004 t:23.3s +tttg: c278/289 lr:0.000004 t:23.3s +tttg: c279/289 lr:0.000003 t:23.4s +tttg: c280/289 lr:0.000002 t:23.5s +tttg: c281/289 lr:0.000002 t:23.6s +tttg: c282/289 lr:0.000001 t:23.6s +tttg: c283/289 lr:0.000001 t:23.7s +tttg: c284/289 lr:0.000001 t:23.8s +tttg: c285/289 lr:0.000000 t:23.9s +tttg: c286/289 lr:0.000000 t:24.0s +tttg: c287/289 lr:0.000000 t:24.0s +tttg: c288/289 lr:0.000000 t:24.1s +ttpr: phase:3/3 t:318.9s +ttp: b729/782 bl:2.3017 bb:1.0752 rl:2.3087 rb:1.0672 dl:2325-2352 gd:1 +ttp: b726/782 bl:2.3261 bb:1.0346 rl:2.3098 rb:1.0652 dl:2254-2276 gd:1 +ttp: b718/782 bl:2.2871 bb:1.0265 rl:2.3086 rb:1.0631 dl:2089-2106 gd:1 +ttp: b710/782 bl:2.2222 bb:1.0404 rl:2.3045 rb:1.0620 dl:1952-1966 gd:1 +ttp: b700/782 bl:2.2926 bb:1.0238 rl:2.3040 rb:1.0603 dl:1824-1834 gd:1 +ttp: b688/782 bl:2.3920 bb:1.0709 rl:2.3073 rb:1.0607 dl:1696-1706 gd:1 +ttp: b684/782 bl:2.3613 bb:1.0403 rl:2.3093 rb:1.0600 dl:1658-1665 gd:1 +ttp: b678/782 bl:2.3406 bb:1.0246 rl:2.3103 rb:1.0587 dl:1601-1610 gd:1 +ttp: b669/782 bl:2.3257 bb:1.0398 rl:2.3108 rb:1.0581 dl:1530-1537 gd:1 +ttp: b662/782 bl:2.2894 bb:1.0234 rl:2.3102 rb:1.0571 dl:1480-1486 gd:1 +ttp: b655/782 bl:2.3719 bb:1.0403 rl:2.3118 rb:1.0566 dl:1432-1439 gd:1 +ttp: b647/782 bl:2.2704 bb:1.0304 rl:2.3108 rb:1.0560 dl:1382-1387 gd:1 +ttp: b638/782 bl:2.3409 bb:1.0666 rl:2.3115 rb:1.0562 dl:1325-1331 gd:1 +ttp: b630/782 bl:2.3184 bb:1.0371 rl:2.3117 rb:1.0558 dl:1280-1285 gd:1 +ttp: b622/782 bl:2.2553 bb:1.0302 rl:2.3105 rb:1.0552 dl:1237-1243 gd:1 +ttp: b614/782 bl:2.3144 bb:1.0516 rl:2.3105 rb:1.0551 dl:1195-1200 gd:1 +ttp: b607/782 bl:2.3478 bb:1.0503 rl:2.3113 rb:1.0550 dl:1164-1168 gd:1 +ttp: b598/782 bl:2.3485 bb:1.0622 rl:2.3119 rb:1.0552 dl:1124-1129 gd:1 +ttp: b589/782 bl:2.2715 bb:1.0088 rl:2.3112 rb:1.0544 dl:1086-1089 gd:1 +ttp: b580/782 bl:2.3060 bb:1.0117 rl:2.3111 rb:1.0536 dl:1048-1052 gd:1 +ttp: b574/782 bl:2.3631 bb:1.0604 rl:2.3120 rb:1.0537 dl:1025-1029 gd:1 +ttp: b566/782 bl:2.2952 bb:1.0252 rl:2.3117 rb:1.0533 dl:997-1001 gd:1 +ttp: b558/782 bl:2.3667 bb:1.0585 rl:2.3125 rb:1.0534 dl:968-972 gd:1 +ttp: b548/782 bl:2.2354 bb:1.0443 rl:2.3114 rb:1.0532 dl:937-939 gd:1 +ttp: b540/782 bl:2.3467 bb:1.0720 rl:2.3119 rb:1.0535 dl:912-915 gd:1 +ttp: b530/782 bl:2.4056 bb:1.0820 rl:2.3131 rb:1.0539 dl:882-884 gd:1 +ttp: b522/782 bl:2.3014 bb:1.0321 rl:2.3130 rb:1.0536 dl:858-860 gd:1 +ttp: b515/782 bl:2.3336 bb:1.0391 rl:2.3132 rb:1.0534 dl:838-841 gd:1 +ttp: b506/782 bl:2.3357 bb:1.0085 rl:2.3135 rb:1.0529 dl:812-814 gd:1 +ttp: b502/782 bl:2.3113 bb:1.0242 rl:2.3134 rb:1.0525 dl:802-804 gd:1 +ttp: b494/782 bl:2.3197 bb:1.0573 rl:2.3135 rb:1.0526 dl:780-783 gd:1 +ttp: b486/782 bl:2.4009 bb:1.0787 rl:2.3144 rb:1.0529 dl:761-764 gd:1 +ttp: b478/782 bl:2.3326 bb:1.0741 rl:2.3146 rb:1.0531 dl:742-744 gd:1 +ttp: b470/782 bl:2.3450 bb:1.0554 rl:2.3149 rb:1.0531 dl:724-726 gd:1 +ttp: b459/782 bl:2.2731 bb:1.0407 rl:2.3145 rb:1.0530 dl:700-701 gd:1 +ttp: b451/782 bl:2.3952 bb:1.0838 rl:2.3152 rb:1.0533 dl:682-685 gd:1 +ttp: b443/782 bl:2.2293 bb:1.0489 rl:2.3145 rb:1.0532 dl:666-668 gd:1 +ttp: b437/782 bl:2.2878 bb:1.0527 rl:2.3143 rb:1.0532 dl:653-655 gd:1 +ttp: b428/782 bl:2.2978 bb:1.0470 rl:2.3141 rb:1.0532 dl:636-638 gd:1 +ttp: b420/782 bl:2.3524 bb:1.0501 rl:2.3144 rb:1.0531 dl:620-622 gd:1 +ttp: b415/782 bl:2.2772 bb:1.0548 rl:2.3141 rb:1.0532 dl:611-613 gd:1 +ttp: b407/782 bl:2.2652 bb:1.0370 rl:2.3138 rb:1.0530 dl:595-597 gd:1 +ttp: b399/782 bl:2.2766 bb:1.0275 rl:2.3135 rb:1.0529 dl:581-582 gd:1 +ttp: b388/782 bl:2.3022 bb:1.0382 rl:2.3134 rb:1.0528 dl:561-562 gd:1 +ttp: b379/782 bl:2.4182 bb:1.0871 rl:2.3141 rb:1.0530 dl:545-547 gd:1 +ttp: b371/782 bl:2.2513 bb:1.0993 rl:2.3137 rb:1.0533 dl:532-533 gd:1 +ttp: b363/782 bl:2.3742 bb:1.0627 rl:2.3141 rb:1.0533 dl:518-521 gd:1 +ttp: b355/782 bl:2.2990 bb:1.0668 rl:2.3140 rb:1.0534 dl:504-506 gd:1 +ttp: b347/782 bl:2.3282 bb:1.1065 rl:2.3141 rb:1.0537 dl:492-494 gd:1 +ttp: b339/782 bl:2.3326 bb:1.0771 rl:2.3142 rb:1.0538 dl:480-482 gd:1 +ttp: b330/782 bl:2.2305 bb:1.0629 rl:2.3137 rb:1.0539 dl:466-468 gd:1 +ttp: b322/782 bl:2.3592 bb:1.0530 rl:2.3140 rb:1.0539 dl:455-457 gd:1 +ttp: b315/782 bl:2.3926 bb:1.0992 rl:2.3144 rb:1.0541 dl:444-445 gd:1 +ttp: b307/782 bl:2.3264 bb:1.1247 rl:2.3144 rb:1.0544 dl:432-433 gd:1 +ttp: b302/782 bl:2.2905 bb:1.0534 rl:2.3143 rb:1.0544 dl:424-426 gd:1 +ttp: b293/782 bl:2.4254 bb:1.0935 rl:2.3149 rb:1.0546 dl:410-412 gd:1 +ttp: b284/782 bl:2.4420 bb:1.1371 rl:2.3154 rb:1.0550 dl:398-399 gd:1 +ttp: b275/782 bl:2.3466 bb:1.0573 rl:2.3156 rb:1.0550 dl:385-386 gd:1 +ttp: b268/782 bl:2.3530 bb:1.0750 rl:2.3157 rb:1.0551 dl:376-378 gd:1 +ttp: b261/782 bl:2.4160 bb:1.1121 rl:2.3161 rb:1.0553 dl:367-369 gd:1 +ttp: b254/782 bl:2.3437 bb:1.1111 rl:2.3162 rb:1.0555 dl:358-360 gd:1 +ttp: b247/782 bl:2.3391 bb:1.0888 rl:2.3163 rb:1.0557 dl:350-351 gd:1 +ttp: b240/782 bl:2.2968 bb:1.0542 rl:2.3163 rb:1.0556 dl:341-342 gd:1 +ttp: b232/782 bl:2.2903 bb:1.0795 rl:2.3162 rb:1.0557 dl:331-333 gd:1 +ttp: b225/782 bl:2.4256 bb:1.1106 rl:2.3166 rb:1.0559 dl:323-324 gd:1 +ttp: b218/782 bl:2.4519 bb:1.1059 rl:2.3170 rb:1.0561 dl:315-316 gd:1 +ttp: b211/782 bl:2.3935 bb:1.0904 rl:2.3173 rb:1.0562 dl:307-308 gd:1 +ttp: b204/782 bl:2.4512 bb:1.1501 rl:2.3177 rb:1.0565 dl:300-301 gd:1 +ttp: b197/782 bl:2.3588 bb:1.1150 rl:2.3179 rb:1.0567 dl:292-294 gd:1 +ttp: b190/782 bl:2.3410 bb:1.0763 rl:2.3179 rb:1.0568 dl:284-285 gd:1 +ttp: b183/782 bl:2.3216 bb:1.0692 rl:2.3179 rb:1.0568 dl:277-278 gd:1 +ttp: b175/782 bl:2.3879 bb:1.1538 rl:2.3181 rb:1.0571 dl:269-270 gd:1 +ttp: b168/782 bl:2.4438 bb:1.1824 rl:2.3185 rb:1.0574 dl:263-263 gd:1 +ttp: b160/782 bl:2.3842 bb:1.1134 rl:2.3187 rb:1.0575 dl:255-255 gd:1 +ttp: b151/782 bl:2.4644 bb:1.1393 rl:2.3191 rb:1.0577 dl:246-247 gd:1 +ttp: b143/782 bl:2.4181 bb:1.1718 rl:2.3193 rb:1.0580 dl:238-239 gd:1 +ttp: b135/782 bl:2.4195 bb:1.1724 rl:2.3195 rb:1.0583 dl:231-232 gd:1 +ttp: b127/782 bl:2.4675 bb:1.1836 rl:2.3199 rb:1.0586 dl:223-224 gd:1 +ttp: b119/782 bl:2.3684 bb:1.1531 rl:2.3200 rb:1.0588 dl:216-217 gd:1 +ttp: b112/782 bl:2.4756 bb:1.1816 rl:2.3204 rb:1.0590 dl:210-210 gd:1 +ttp: b102/782 bl:2.5711 bb:1.1917 rl:2.3209 rb:1.0593 dl:201-202 gd:1 +ttp: b95/782 bl:2.3210 bb:1.1347 rl:2.3209 rb:1.0594 dl:194-195 gd:1 +ttp: b88/782 bl:2.4732 bb:1.1802 rl:2.3212 rb:1.0597 dl:188-189 gd:1 +ttp: b80/782 bl:2.4594 bb:1.1463 rl:2.3214 rb:1.0598 dl:181-182 gd:1 +ttp: b72/782 bl:2.3696 bb:1.1471 rl:2.3215 rb:1.0600 dl:173-174 gd:1 +ttp: b64/782 bl:2.5188 bb:1.1489 rl:2.3219 rb:1.0601 dl:166-167 gd:1 +ttp: b57/782 bl:2.4578 bb:1.1574 rl:2.3221 rb:1.0603 dl:160-161 gd:1 +ttp: b50/782 bl:2.3780 bb:1.1524 rl:2.3222 rb:1.0604 dl:153-154 gd:1 +ttp: b43/782 bl:2.5021 bb:1.2215 rl:2.3225 rb:1.0607 dl:146-147 gd:1 +ttp: b36/782 bl:2.5271 bb:1.2194 rl:2.3228 rb:1.0609 dl:139-140 gd:1 +ttp: b29/782 bl:2.6267 bb:1.2151 rl:2.3232 rb:1.0611 dl:132-133 gd:1 +ttp: b22/782 bl:2.5539 bb:1.1955 rl:2.3235 rb:1.0613 dl:124-126 gd:1 +ttp: b15/782 bl:2.6398 bb:1.2259 rl:2.3238 rb:1.0614 dl:115-117 gd:1 +ttp: b7/782 bl:2.7466 bb:1.2361 rl:2.3243 rb:1.0616 dl:101-103 gd:1 +quantized_ttt_phased val_loss:2.31513512 val_bpb:1.05792641 eval_time:408619ms +total_eval_time:408.6s