Think
LLM
Models
Capabilities
Use Cases
Benchmarks
Papers
Glossary
Search
/
ReLU Activation — Glossary — ThinkLLM
Glossary
/
ReLU Activation
ReLU Activation
techniques
Rectified Linear Unit: a simple neural network activation function that outputs max(0, x).