{"generated_at":"2026-07-05T19:57:37.144179","metrics":{"architecture":"GraphSAGE-2layer-h64","dropout":0.5,"epochs":60,"eval_label_rule":{"ambiguous_dropped":8,"hi_intensity_threshold":0.5,"min_rows":20,"negative_if_frac_hi_lte":0.25,"positive_if_frac_hi_gte":0.6,"source":"censoredplanet signal_value"},"eval_note":"loocv_auc / perm_pvalue / passed_promote_floor reflect the v2 re-evaluation: a genuine CensoredPlanet signal_value censorship label (62 ASNs that block probes vs 35 that pass them) scored under leakage-safe leave-one-COUNTRY-out CV with density+topology features only (signal-derived features dropped — see reeval_features_dropped_for_leakage). The live /v1/forecast/asn-gnn/{asn} score still comes from gnn_asn_forecast_v1.pkl, which was trained on the older 13-feature set; treat the per-ASN score as indicative and the reeval_v2 block as the audited performance claim.","eval_protocol":"leave-one-COUNTRY-out (leakage-safe grouped leave-AS-out) on a genuine signal_value label","feature_cols":["n_evidence_30d","n_evidence_180d","block_rate_30d","block_rate_180d","n_unique_dates","pct_dns_block","pct_tcp_reset","pct_outage","pct_interference","pct_block","country_risk_tier","log_degree","has_evidence"],"graph_n_edges":841064,"graph_n_nodes":7060,"hidden_dim":16,"honest_caveats":["Re-evaluated 2026-05-22 with a GENUINE censorship label (CensoredPlanet signal_value: 62 ASNs that block probes vs 35 that let them through) and leakage-audited density+topology features. Leave-one-COUNTRY-out CV across 97 ASNs / 30 country folds: AUC 0.7751, permutation p=0.0002 (5000 perms). The GNN beats chance at p<0.05 — passed_promote_floor flipped to true.","Plain leave-one-AS-out (same-country siblings stay in training): AUC 0.7645, p=0.0002.","The old headline (AUC 0.80, n=6) was an underpowered CV on a label that had collapsed to a measurement-density flag — it is superseded by this evaluation.","Per-ASN labels remain CensoredPlanet-only and sparse (97 ASNs). More labeled ASNs would tighten the estimate further."],"loocv_accuracy_at_0.5":0.7216,"loocv_auc":0.7751,"loocv_predictions":[{"asn":5384,"country":"AE","label":1,"score":0.9675572514533997},{"asn":6168,"country":"AE","label":0,"score":0.8854526281356812},{"asn":15802,"country":"AE","label":1,"score":0.9999983310699463},{"asn":20940,"country":"AE","label":0,"score":0.5467635989189148},{"asn":25198,"country":"AE","label":0,"score":0.3975096642971039},{"asn":208922,"country":"AE","label":0,"score":0.9676738977432251},{"asn":29049,"country":"AZ","label":1,"score":0.22863388061523438},{"asn":48830,"country":"AZ","label":1,"score":0.9452638626098633},{"asn":23923,"country":"BD","label":0,"score":0.4325246512889862},{"asn":38203,"country":"BD","label":1,"score":0.8403658866882324},{"asn":45905,"country":"BD","label":1,"score":0.4448074698448181},{"asn":55828,"country":"BD","label":1,"score":0.9890251755714417},{"asn":63969,"country":"BD","label":0,"score":0.8576114177703857},{"asn":142577,"country":"BD","label":1,"score":0.5854402184486389},{"asn":51375,"country":"BH","label":1,"score":0.2786537706851959},{"asn":6697,"country":"BY","label":1,"score":0.9996500015258789},{"asn":38980,"country":"BY","label":1,"score":0.051194991916418076},{"asn":55990,"country":"CN","label":1,"score":0.9999982118606567},{"asn":136190,"country":"CN","label":1,"score":0.6346935629844666},{"asn":137702,"country":"CN","label":1,"score":0.9411860704421997},{"asn":146812,"country":"CN","label":1,"score":0.9863579273223877},{"asn":198734,"country":"CN","label":1,"score":0.41109737753868103},{"asn":27725,"country":"CU","label":1,"score":0.9933203458786011},{"asn":8452,"country":"EG","label":1,"score":0.6623235940933228},{"asn":37585,"country":"EG","label":1,"score":0.33977532386779785},{"asn":27884,"country":"HN","label":0,"score":0.24077108502388},{"asn":263239,"country":"HN","label":0,"score":0.456773966550827},{"asn":56255,"country":"ID","label":1,"score":0.13060785830020905},{"asn":135460,"country":"ID","label":0,"score":0.16786731779575348},{"asn":135473,"country":"ID","label":0,"score":0.03913485258817673},{"asn":141073,"country":"ID","label":1,"score":0.8999216556549072},{"asn":150279,"country":"ID","label":1,"score":0.5911790728569031},{"asn":150509,"country":"ID","label":1,"score":0.1365654170513153},{"asn":150941,"country":"ID","label":1,"score":0.1927771121263504},{"asn":151005,"country":"ID","label":0,"score":0.3540654480457306},{"asn":9498,"country":"IN","label":1,"score":0.9999685287475586},{"asn":9829,"country":"IN","label":0,"score":0.3318082094192505},{"asn":38799,"country":"IN","label":0,"score":0.1845100224018097},{"asn":45830,"country":"IN","label":0,"score":0.3457936942577362},{"asn":54113,"country":"IN","label":0,"score":0.26989078521728516},{"asn":394695,"country":"IN","label":0,"score":0.2469964176416397},{"asn":198169,"country":"IQ","label":1,"score":0.6679753661155701},{"asn":15611,"country":"IR","label":1,"score":0.34256795048713684},{"asn":30058,"country":"IR","label":1,"score":0.4107723534107208},{"asn":43965,"country":"IR","label":1,"score":0.29590389132499695},{"asn":58224,"country":"IR","label":1,"score":0.5033736228942871},{"asn":61173,"country":"IR","label":1,"score":0.6222769021987915},{"asn":204213,"country":"IR","label":1,"score":0.9488309621810913},{"asn":206065,"country":"IR","label":1,"score":0.65695720911026},{"asn":35656,"country":"JO","label":1,"score":0.4134608507156372},{"asn":7712,"country":"KH","label":0,"score":0.2848295271396637},{"asn":131207,"country":"KH","label":0,"score":0.44073519110679626},{"asn":147011,"country":"KH","label":1,"score":0.24415792524814606},{"asn":21050,"country":"KW","label":1,"score":0.682942807674408},{"asn":9198,"country":"KZ","label":1,"score":0.7323864102363586},{"asn":21299,"country":"KZ","label":1,"score":0.9997842907905579},{"asn":41798,"country":"KZ","label":1,"score":0.9736827611923218},{"asn":43994,"country":"KZ","label":1,"score":0.286001592874527},{"asn":207446,"country":"KZ","label":1,"score":0.304375022649765},{"asn":6713,"country":"MA","label":1,"score":0.9987809062004089},{"asn":30983,"country":"MA","label":1,"score":0.3754326105117798},{"asn":136255,"country":"MM","label":0,"score":0.3595653474330902},{"asn":4788,"country":"MY","label":1,"score":0.9999721050262451},{"asn":45839,"country":"MY","label":0,"score":0.2599650025367737},{"asn":55951,"country":"MY","label":0,"score":0.2635897099971771},{"asn":17557,"country":"PK","label":1,"score":0.2611308991909027},{"asn":58515,"country":"PK","label":0,"score":0.33878451585769653},{"asn":132165,"country":"PK","label":1,"score":0.8165570497512817},{"asn":152605,"country":"PK","label":1,"score":0.9999864101409912},{"asn":8781,"country":"QA","label":1,"score":0.9948327541351318},{"asn":12389,"country":"RU","label":1,"score":0.9743453860282898},{"asn":20485,"country":"RU","label":1,"score":0.9995419979095459},{"asn":31370,"country":"RU","label":1,"score":0.6262307167053223},{"asn":43727,"country":"RU","label":0,"score":0.3689045011997223},{"asn":57044,"country":"RU","label":1,"score":0.999962568283081},{"asn":198610,"country":"RU","label":0,"score":0.336747944355011},{"asn":201706,"country":"RU","label":0,"score":0.9291287064552307},{"asn":8895,"country":"SA","label":1,"score":0.9998465776443481},{"asn":29684,"country":"SA","label":0,"score":0.748484194278717},{"asn":3758,"country":"SG","label":1,"score":0.8464627861976624},{"asn":24467,"country":"SG","label":0,"score":0.2978292405605316},{"asn":38077,"country":"SG","label":0,"score":0.31623348593711853},{"asn":44022,"country":"SG","label":0,"score":0.2519398331642151},{"asn":38444,"country":"TH","label":0,"score":0.10997915267944336},{"asn":136907,"country":"TH","label":1,"score":1},{"asn":9121,"country":"TR","label":1,"score":0.9999574422836304},{"asn":47123,"country":"TR","label":0,"score":0.22308677434921265},{"asn":215540,"country":"TR","label":0,"score":0.5069339275360107},{"asn":8193,"country":"UZ","label":1,"score":0.5547710657119751},{"asn":202660,"country":"UZ","label":1,"score":0.49322599172592163},{"asn":8048,"country":"VE","label":1,"score":1},{"asn":38731,"country":"VN","label":1,"score":0.5812614560127258},{"asn":45899,"country":"VN","label":1,"score":0.999868631362915},{"asn":63755,"country":"VN","label":0,"score":0.2492677867412567},{"asn":131368,"country":"VN","label":0,"score":0.29794660210609436},{"asn":135915,"country":"VN","label":1,"score":0.29206791520118713},{"asn":135933,"country":"VN","label":0,"score":0.237898051738739}],"loocv_predictions_as_out":[{"asn":3758,"country":"SG","label":1,"score":0.9794156551361084},{"asn":4788,"country":"MY","label":1,"score":0.9999538660049438},{"asn":5384,"country":"AE","label":1,"score":0.942045271396637},{"asn":6168,"country":"AE","label":0,"score":0.434054434299469},{"asn":6697,"country":"BY","label":1,"score":0.99616938829422},{"asn":6713,"country":"MA","label":1,"score":0.9826291799545288},{"asn":7712,"country":"KH","label":0,"score":0.19972212612628937},{"asn":8048,"country":"VE","label":1,"score":0.9999927282333374},{"asn":8193,"country":"UZ","label":1,"score":0.4347919821739197},{"asn":8452,"country":"EG","label":1,"score":0.9999032020568848},{"asn":8781,"country":"QA","label":1,"score":0.9983757734298706},{"asn":8895,"country":"SA","label":1,"score":0.9999814033508301},{"asn":9121,"country":"TR","label":1,"score":1},{"asn":9198,"country":"KZ","label":1,"score":0.5423862338066101},{"asn":9498,"country":"IN","label":1,"score":0.9999934434890747},{"asn":9829,"country":"IN","label":0,"score":0.22341714799404144},{"asn":12389,"country":"RU","label":1,"score":0.7789539694786072},{"asn":15611,"country":"IR","label":1,"score":0.39532092213630676},{"asn":15802,"country":"AE","label":1,"score":0.9919215440750122},{"asn":17557,"country":"PK","label":1,"score":0.2779673635959625},{"asn":20485,"country":"RU","label":1,"score":0.6814691424369812},{"asn":20940,"country":"AE","label":0,"score":0.6230611801147461},{"asn":21050,"country":"KW","label":1,"score":0.38821718096733093},{"asn":21299,"country":"KZ","label":1,"score":0.9999901056289673},{"asn":23923,"country":"BD","label":0,"score":0.825188934803009},{"asn":24467,"country":"SG","label":0,"score":0.2810932695865631},{"asn":25198,"country":"AE","label":0,"score":0.5876661539077759},{"asn":27725,"country":"CU","label":1,"score":0.999930739402771},{"asn":27884,"country":"HN","label":0,"score":0.27489328384399414},{"asn":29049,"country":"AZ","label":1,"score":0.26949483156204224},{"asn":29684,"country":"SA","label":0,"score":0.6944448947906494},{"asn":30058,"country":"IR","label":1,"score":0.5231512784957886},{"asn":30983,"country":"MA","label":1,"score":0.6287875175476074},{"asn":31370,"country":"RU","label":1,"score":0.3410968780517578},{"asn":35656,"country":"JO","label":1,"score":0.636815071105957},{"asn":37585,"country":"EG","label":1,"score":0.3490593433380127},{"asn":38077,"country":"SG","label":0,"score":0.11624178290367126},{"asn":38203,"country":"BD","label":1,"score":0.9931094646453857},{"asn":38444,"country":"TH","label":0,"score":0.22968202829360962},{"asn":38731,"country":"VN","label":1,"score":0.8256025314331055},{"asn":38799,"country":"IN","label":0,"score":0.15074843168258667},{"asn":38980,"country":"BY","label":1,"score":0.00789089035242796},{"asn":41798,"country":"KZ","label":1,"score":0.6291959881782532},{"asn":43727,"country":"RU","label":0,"score":0.30769428610801697},{"asn":43965,"country":"IR","label":1,"score":0.6749172806739807},{"asn":43994,"country":"KZ","label":1,"score":0.431535005569458},{"asn":44022,"country":"SG","label":0,"score":0.23574917018413544},{"asn":45830,"country":"IN","label":0,"score":0.31094780564308167},{"asn":45839,"country":"MY","label":0,"score":0.29763421416282654},{"asn":45899,"country":"VN","label":1,"score":0.9999995231628418},{"asn":45905,"country":"BD","label":1,"score":0.22887475788593292},{"asn":47123,"country":"TR","label":0,"score":0.29803764820098877},{"asn":48830,"country":"AZ","label":1,"score":0.9018881916999817},{"asn":51375,"country":"BH","label":1,"score":0.19642525911331177},{"asn":54113,"country":"IN","label":0,"score":0.24521683156490326},{"asn":55828,"country":"BD","label":1,"score":0.9998363256454468},{"asn":55951,"country":"MY","label":0,"score":0.29877519607543945},{"asn":55990,"country":"CN","label":1,"score":0.9999423027038574},{"asn":56255,"country":"ID","label":1,"score":0.24929217994213104},{"asn":57044,"country":"RU","label":1,"score":0.8950190544128418},{"asn":58224,"country":"IR","label":1,"score":0.7845755219459534},{"asn":58515,"country":"PK","label":0,"score":0.6922957301139832},{"asn":61173,"country":"IR","label":1,"score":0.818998396396637},{"asn":63755,"country":"VN","label":0,"score":0.23971815407276154},{"asn":63969,"country":"BD","label":0,"score":0.9181634783744812},{"asn":131207,"country":"KH","label":0,"score":0.2717709541320801},{"asn":131368,"country":"VN","label":0,"score":0.6614828705787659},{"asn":132165,"country":"PK","label":1,"score":0.3927259147167206},{"asn":135460,"country":"ID","label":0,"score":0.39757484197616577},{"asn":135473,"country":"ID","label":0,"score":0.29509487748146057},{"asn":135915,"country":"VN","label":1,"score":0.15784211456775665},{"asn":135933,"country":"VN","label":0,"score":0.17350545525550842},{"asn":136190,"country":"CN","label":1,"score":0.5895988941192627},{"asn":136255,"country":"MM","label":0,"score":0.45723679661750793},{"asn":136907,"country":"TH","label":1,"score":0.9896374940872192},{"asn":137702,"country":"CN","label":1,"score":0.9876418113708496},{"asn":141073,"country":"ID","label":1,"score":0.6430891752243042},{"asn":142577,"country":"BD","label":1,"score":0.5194904804229736},{"asn":146812,"country":"CN","label":1,"score":0.5441449880599976},{"asn":147011,"country":"KH","label":1,"score":0.18347179889678955},{"asn":150279,"country":"ID","label":1,"score":0.8142583966255188},{"asn":150509,"country":"ID","label":1,"score":0.29013559222221375},{"asn":150941,"country":"ID","label":1,"score":0.35012173652648926},{"asn":151005,"country":"ID","label":0,"score":0.7566134929656982},{"asn":152605,"country":"PK","label":1,"score":0.9999961853027344},{"asn":198169,"country":"IQ","label":1,"score":0.8676332831382751},{"asn":198610,"country":"RU","label":0,"score":0.45290762186050415},{"asn":198734,"country":"CN","label":1,"score":0.5499598979949951},{"asn":201706,"country":"RU","label":0,"score":0.7622631788253784},{"asn":202660,"country":"UZ","label":1,"score":0.6740133166313171},{"asn":204213,"country":"IR","label":1,"score":0.8501819968223572},{"asn":206065,"country":"IR","label":1,"score":0.7899960875511169},{"asn":207446,"country":"KZ","label":1,"score":0.3110223412513733},{"asn":208922,"country":"AE","label":0,"score":0.4913584589958191},{"asn":215540,"country":"TR","label":0,"score":0.49313852190971375},{"asn":263239,"country":"HN","label":0,"score":0.47577372193336487},{"asn":394695,"country":"IN","label":0,"score":0.21991486847400665}],"lr":0.01,"mean_score_gap":0.2928,"n_country_folds":30,"n_labeled_total":97,"n_loocv_folds":97,"n_tier1_loocv_DEPRECATED":6,"passed_promote_floor":true,"perm_pvalue":0.0002,"promote_floor_auc":0.65,"reeval_feature_cols":["n_evidence_30d","n_evidence_180d","n_unique_dates","n_domains_tested","log_n_evidence_180d","country_risk_tier","log_degree","log_degree_p2p","log_degree_provider"],"reeval_features_dropped_for_leakage":["block_rate_30d","block_rate_180d","pct_dns_block","pct_tcp_reset","pct_outage","pct_interference","pct_block"],"reeval_v2":{"evaluated_at":"2026-05-22T12:43:57.620662Z","leave_one_as_out":{"accuracy_at_0_5":0.7216,"auc":0.7645,"mean_score_gap":0.2707,"n_neg":35,"n_pos":62,"n_scored":97,"perm_auc_mean":0.4997,"perm_auc_p95":0.5987,"perm_pvalue":0.0002,"protocol":"leave-one-AS-out"},"leave_one_country_out":{"accuracy_at_0_5":0.7216,"auc":0.7751,"mean_score_gap":0.2928,"n_neg":35,"n_pos":62,"n_scored":97,"perm_auc_mean":0.4998,"perm_auc_p95":0.6005,"perm_pvalue":0.0002,"protocol":"leave-one-COUNTRY-out"},"n_labeled":97,"n_neg":35,"n_pos":62,"verdict":"GENUINE VERDICT — SIGNIFICANT. With a real censorship label (signal_value-based, 62 pos / 35 neg) and leakage-audited density+topology features, leave-one-COUNTRY-out CV gives AUC 0.7751, permutation p=0.0002 (<0.05, 5000 perms, n=97 held-out ASNs / 30 country folds). The GNN beats chance — passed_promote_floor flipped true."},"schema":"voidly-gnn-asn-forecast/v1","seed":42,"tier1_loocv_asns_DEPRECATED":[8895,146812,135473,215597,47541,43727],"trained_at":"2026-05-21T04:58:09.589520Z","version":"v1","weight_decay":0.0005},"schema":"voidly-gnn-asn-info/v1","summary":{"architecture":"GraphSAGE-2layer-h64","loocv_auc":0.7751,"n_labeled":97,"n_tier1_loocv":null,"passed_promote_floor":true,"perm_pvalue":0.0002,"promote_floor":0.65},"_voidly_pay":{"claim_did":"https://voidly.ai/pay/claim","for_builders":"https://voidly.ai/pay/for-builders","marketplace":"https://api.voidly.ai/v1/pay/marketplace","live_demo":"https://huggingface.co/spaces/emperor-mew/voidly-pay","universal_proxy":{"url":"https://api.voidly.ai/v1/pay/proxy","example":"https://api.voidly.ai/v1/pay/proxy?u=<https-url>&to=did:voidly:<your-did>&price=0.01","page":"https://voidly.ai/pay/proxy","note":"Paywall any public HTTPS URL with one query param. No SDK install required."},"install":{"typescript":"npm install @voidly/pay","python":"pip install voidly-pay","langchain":"pip install voidly-pay-langchain","vercel_ai":"npm install @voidly/pay-vercel-ai","mcp":"npx @voidly/pay-mcp","cli":"npm install -g @voidly/pay-cli"},"note":"Voidly Pay is the open agent-to-agent payment rail. Claim a DID + 10 starter credits in 60s, or paywall any URL via the universal proxy with one query param."}}