Independent researcher shares recurrent AI architecture DABSN, seeks collaborators

A researcher working independently has spent several months developing DABSN (Dynamic Adaptive Bias State Network), a recurrent neural network architecture designed to handle reasoning, memory, and long-sequence tasks. The first paper focuses on the architecture itself and its performance across a suite of benchmarks: MQAR, Copy, Key-Value retrieval, and A5/60 tasks. To ensure reproducibility, the researcher has released both the preprint and complete code with implementations in PyTorch, C++, and Triton—three of the most widely used frameworks in machine learning research and production.

Beyond the architecture work, the researcher also trained a language model using the same DABSN cell, configured with 24M parameters and trained on 1B pretraining tokens using a GPT-2 tokenizer. The results from this language modeling experiment surprised the researcher, proving substantially more promising than anticipated during the architecture work. This unexpected success has redirected the research focus: the researcher is now writing a second paper that centers entirely on language modeling, long-context behavior, and scaling properties of the architecture.

Recognizing the challenge of advancing this work alone, the researcher is openly seeking collaborators to help with the next phase. The collaboration sought includes independent reproduction of results, broader evaluation, and contribution to the forthcoming language modeling paper. By making both the code and roadmap public, the researcher is inviting the research community to participate in validating and scaling DABSN, a common step when early-stage architectures show promise and require multi-party confirmation before wider adoption.

The release of DABSN represents a notable moment in open-source machine learning research: a solo researcher stepping outside institutional constraints to publish novel architecture work with full reproducibility. The decision to release both the preprint and code simultaneously, across multiple implementation languages, reflects a commitment to enabling the community to verify and extend the work independently.

The researcher's note that results on language modeling proved "much more interesting than expected" signals a potential discovery—whether in efficiency, performance on specific tasks, or scaling behavior—that warrants further investigation. The shift in focus from the original architecture paper to a second paper entirely devoted to language modeling suggests the practical capabilities on text tasks exceeded the initial architectural research goals, a common pattern when foundational work yields unexpectedly strong downstream applications.

The explicit call for collaborators on "independent reproduction" and evaluation is also significant: it acknowledges both the constraints of solo research (validation, reproducibility, scaling all become harder) and the norm in modern ML that credible claims require multi-party confirmation. This openness to external scrutiny at a formative stage is typical of research cultures prioritizing rigor over competitive advantage.

No comments yet. Be the first to share your thoughts!