Skip to content
View iam-saiteja's full-sized avatar

Block or report iam-saiteja

Block user

Prevent this user from interacting with your repositories and sending you notifications. Learn more about blocking users.

You must be logged in to block users.

Maximum 250 characters. Please don’t include any personal information such as legal names or email addresses. Markdown is supported. This note will only be visible to you.
Report abuse

Contact GitHub support about this user’s behavior. Learn more about reporting abuse.

Report abuse
iam-saiteja/README.md

Thanniru Sai Teja

AI Systems Researcher · Building memory, attention and inference systems from first principles

Typing SVG

Portfolio LinkedIn Email


About Me

I'm a B.Tech Computer Science (Data Science) student at BVRIT Hyderabad, currently working as Tech Lead at Stud Entertainments, with prior internship experience at AWS, IBM, and Google. Outside of coursework and internships, I run an independent research track focused on making large-model architectures -- attention, memory, inference -- work under real hardware constraints instead of just on paper.

Most of what is here falls into four buckets:

  • Memory and attention architectures for foundation models -- designing systems that scale sub-quadratically without giving up retrieval quality
  • Consumer-hardware inference engineering -- squeezing large-model workloads onto a single 4GB-VRAM GPU through quantization, caching, and prediction tricks
  • AI-native systems -- building operating system substrates where the AI model is the kernel, not an application running on top of one
  • Developer tooling -- small, sharp tools (compilers, package managers, UI libraries) that solve one problem cleanly

I evaluate my own work adversarially before anyone else gets to. If a result looks too good, I go find out why before I publish it.


Featured Work

Research and Model Architecture

HGDM -- Hierarchical Gated Delta Memory

100% attention-free, byte-level sequence architecture with Hierarchical Temporal Decimation, Factored Bilinear State Highways, and a custom Triton fused scan engine (Nitro). Trained at 1B parameters on 1.46B tokens. Achieves O(1) inference memory -- VRAM footprint stays constant regardless of context length, verified empirically across 20x prompt scaling.

Python Triton CUDA

NCM -- Native Cognitive Memory

Tensor-based episodic memory with state-conditioned retrieval for AI systems. Uses a four-field distance function -- semantic, emotional, state-conditioned, and temporal -- as the native memory subsystem for agent-style architectures. Ported to no_std Rust as the memory core of NOUS.

Python Rust

Active research (not yet public):

  • ZS-ISAB -- a method for scaling TabPFN's attention from quadratic to linear complexity via seeded anchor selection, an online softmax accumulator, and a zero-shot attention mask -- enabling 500K+ row inference on 4GB VRAM. Currently in iteration toward TMLR submission.
  • PAS-Offload -- a consumer-GPU LLM inference engine combining CPU-side low-rank activation prediction, transposed column-major weight caching, and dynamic 2-bit weight slicing, benchmarked on an RTX 3050.

Systems

NOUS -- Cognitive Operating System

A bare-metal AI-native OS in Rust for x86_64. Memory is addressed by semantic embeddings rather than numerical pointers. The resident kernel is not a scheduler for programs -- it is a five-level HTSPC-ED recurrent neural model with NCM integration, event-driven gating, and Hebbian plastic weight updates. Ships a real-time UEFI framebuffer dashboard and a capability-gated intent syscall interface.

Rust x86_64 UEFI no_std

AXIS

A small, rule-based, deterministic compiler that takes a plain app description and generates native Web, Android, and iOS UI code without an LLM in the loop.

TypeScript

PyLite-Manager

A Tkinter GUI for managing Python virtual environments and pip packages -- for when you do not want to remember venv flags.

Python


Applied and Shipped

FormatForge -- Live demo

Streamlit app powered by Gemini 2.5 Flash Image that turns one uploaded photo into platform-ready assets for Amazon, Flipkart, Instagram, Spotify, and more -- with in-place AI re-editing via chat instructions.

Python Streamlit Gemini -- 1 star, 2 forks

react-scroll-media

Lightweight React library for cinematic scroll-driven image sequences -- eager/lazy frame loading, TypeScript support, SSR-safe, and built-in accessibility (respects prefers-reduced-motion).

TypeScript

Other repositories

Tech Stack

Core

Python PyTorch Rust TypeScript C++ CUDA

ML and Infra

Triton HuggingFace Ollama Streamlit React

Cloud and Tools

AWS GCP Git VS Code


GitHub Stats


Activity Graph


Currently

  • Iterating on ZS-ISAB toward TMLR submission -- resolving TabICL baseline verification and regenerating figures against the current seeded-anchor architecture
  • Running a 91-dataset TabZilla benchmark against tree-based baselines
  • Prototyping row-ordering strategies for fusing MiniMax Sparse Attention into a TabPFN-style tabular foundation model
  • Continuing development on NOUS -- next milestone is a persistent NVMe driver replacing the simulated cold storage tier
  • Open to research collaborations on efficient attention, memory-augmented architectures, and consumer-hardware ML systems

Not currently obsessed with anything. Everything above is currently obsessing me.

Pinned Loading

  1. Event-Ticket-Booking-System Event-Ticket-Booking-System Public

    HTML

  2. ailang-py ailang-py Public

    Python

  3. NCM NCM Public

    Native Cognitive Memory - Tensor-based episodic memory with state-conditioned retrieval for AI systems

    Python

  4. openinterpreter/openinterpreter openinterpreter/openinterpreter Public

    A lightweight coding agent for open models like Deepseek, Kimi, and Qwen

    Rust 64.3k 5.6k

  5. CursorTouch/Windows-MCP CursorTouch/Windows-MCP Public

    MCP Server for Computer Use in Windows

    Python 6.4k 770