Skip to content

Project Structure

DELTA/
|-- delta/                    Core library
|   |-- graph.py              DeltaGraph + sparse COO multi-hop edge adjacency
|   |-- attention.py          Node, edge, dual parallel attention (return_weights)
|   |-- router.py             PostAttentionPruner + LearnedAttentionDropout
|   |-- memory.py             Variational bottleneck tiered memory (hot/warm/cold)
|   |-- partition.py          BFS seed-expansion partitioning O(N+E)
|   |-- reconciliation.py     Node-edge co-update (ReconciliationBridge)
|   |-- constructor.py        Transformer-based graph bootstrap
|   |-- brain.py              BrainEncoder + BrainConstructor (differentiable graph construction)
|   |-- model.py              Full DELTA model
|   |-- baselines.py          GraphGPS + GRIT implementations
|   |-- datasets.py           Dataset loading (load_lp_data for FB15k-237)
|   +-- utils.py              Helpers, synthetic data, benchmark generators
|
|-- experiments/              Phase-by-phase validation (63 phases)
|   |-- phase1-15             Core architecture validation
|   |-- phase16-21            Architectural fix benchmarks
|   |-- phase22-25            Scale & integration on GPU
|   |-- phase26-30            Roadmap validation + multi-seed
|   |-- phase31-37            H100 / Colab experiments
|   |-- phase38-40            Differentiable constructor, self-bootstrap, correct LP
|   |-- phase41-45            Multi-hop compositional reasoning + inference timing
|   |-- phase46-54            Attention temperature optimization + multi-seed validation
|   |-- phase55-58            Brain architecture + multi-seed density validation
|   +-- phase59-63            Scaling & depth management (N=2000, N=5000, subsampling ablation)
|
|-- notebooks/                Colab-ready infrastructure
|   +-- delta_colab_ready.py
|
|-- tests/                    Unit tests (44/44 passing)
|   |-- test_graph.py
|   |-- test_attention.py
|   |-- test_router.py
|   |-- test_memory.py
|   |-- test_utils.py
|   +-- test_baselines.py
|
|-- docs/                     Phase result documentation
|   |-- phase_55.md           Brain architecture port results
|   |-- phase_56.md           Constructor density ablation results
|   |-- phase_57.md           Brain temperature annealing results
|   |-- phase_58.md           Multi-seed density validation results
|   |-- phase_59.md           Depth scaling at N=2000 results
|   |-- phase_60.md           Residual gating results
|   |-- phase_61.md           DELTA vs DistMult controlled comparison
|   |-- phase_62.md           Scale to N=5000 results
|   |-- phase_63.md           E_adj subsampling ablation results
|   +-- PUBLICATION_ROADMAP.md  NeurIPS/ICLR publication strategy
|
|-- mkdocs-src/               Documentation source (this site)
|   |-- index.md              Home page
|   |-- architecture.md       Architecture + bootstrap + timeline + compat
|   |-- ARCHITECTURE_VISUAL.md  Interactive three-paradigm visual
|   |-- the-brain.md          Vision + capacity paradox + roadmap
|   |-- key-findings.md       44 key findings by stage
|   |-- validation-phases.md  Complete phase result tables
|   |-- status-and-roadmap.md Status + gaps + publication pathway
|   |-- research-methodology.md  AI assistance disclosure
|   |-- setup-and-running.md  Setup + commands + cloud GPU
|   +-- project-structure.md  This page
|
|-- requirements.txt
|-- mkdocs.yml
+-- README.md

Core Library (delta/)

File Purpose
graph.py DeltaGraph data structure, sparse COO multi-hop edge adjacency, edge adjacency caching, vectorized incidence matrix
attention.py NodeAttention, EdgeAttention, DualParallelAttention, ReconciliationBridge — all with return_weights support
router.py PostAttentionPruner (soft sigmoid gating), LearnedAttentionDropout, legacy ImportanceRouter
memory.py Tiered memory (hot/warm/cold) with variational bottleneck and KL regularization
partition.py BFS seed-expansion partitioning in O(N+E) with importance-aware seeding
reconciliation.py Node-edge co-update (ReconciliationBridge)
constructor.py Transformer-based graph bootstrap with per-layer edge projections
brain.py BrainEncoder + BrainConstructor — differentiable Gumbel-sigmoid edge selection for self-constructed graphs
model.py DELTAModel — full pipeline: constructor -> partition -> dual attention -> pruner -> reconciliation -> memory
baselines.py GraphGPSModel (2022) and GRITModel (2023) implementations for comparison
datasets.py Dataset loading utilities; load_lp_data() for FB15k-237 experiments
utils.py Synthetic data generators, benchmark tasks, helper functions

Baselines (delta/baselines.py)

Model Reference Params (typical)
GraphGPS Rampasek et al. (2022) ~228K
GRIT Ma et al. (2023) ~197K
CompGCN Vashishth et al. (2020) Via utils.py
TransE Bordes et al. (2013) Via utils.py
RotatE Sun et al. (2019) Via utils.py
DistMult Yang et al. (2015) ~47K