micm_nlp.models.xpe.enums

XPE enums.

Classes

CrossPromptEncoderReparameterizationType

How the Cross-Prompt Encoder reparameterizes its virtual tokens.

Module Contents

class micm_nlp.models.xpe.enums.CrossPromptEncoderReparameterizationType

Bases: micm_nlp.enums.StrEnum

How the Cross-Prompt Encoder reparameterizes its virtual tokens.

MLP, LSTM and ATTN each map a small trainable tensor to the prompt embeddings through a head of that kind. NONE skips reparameterization entirely, which is what plain soft prompt tuning uses – the embeddings are the parameters.

Initialize self. See help(type(self)) for accurate signature.

ATTN = 'ATTN'

LSTM = 'LSTM'

MLP = 'MLP'

NONE = 'NONE'