Skip to content

Pass in pre-unembedding to each ci_fn #305

@danbraunai-goodfire

Description

@danbraunai-goodfire

Give the ci_fns some more power by concatenating the inputs to the current component with the residual stream before the unembedding layer.

Metadata

Metadata

Assignees

No one assigned

    Labels

    Priority: InUImportant & not Urgentexp/investigationA research investigation or experimentfeatureNew feature or request

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions