DOCS / SOURCE REFERENCE

FFN package exports

Makes DenseFFN and SituGLU available from the feed-forward package.

src/kimi_k3/ffn/__init__.py · View pinned source ↗

The module is a single import statement at source L1–L1:

from .dense_ffn import DenseFFN, SituGLU

DenseFFN builds the two-projection gated feed-forward path; SituGLU implements its elementwise activation and optional compiled call. Importing the package exposes these names without instantiating a network. It does import dense_ffn.py, where the shared compiled callable is constructed lazily for execution, so the export itself does not trigger a compiled kernel run. There is no standalone forward method or numerical state in this file.