Please enable JavaScript.

Coggle requires JavaScript to display documents.

Neural Network, Algorithms that predict relationships between data. These…

- - - - Sequential Memory (HUMAN)
        
        Mechanism that helps to recognize sequence patterns
      - Sequential Memory (RNN)
        
        Input layer
        
        Hidden Iayer
        
        Combination of previous inputs
        
        output Iayer
  - - - LSTM (Long Short-Term Memory)
        
        Gate Mechanism, which regulates flow of information. Gates prioritizes information, it stores or discards information as necessary. (LSTM has 3 Gates).
        
        Input
        
        Forget
        
        Output
    - - Gate Mechanishm (2 Gates)
        
        Reset
        
        Update
- - - - Encoder
        
        Gets fed sequence of input data
        
        Decoded outputs are again fed in the encoder
        
        Attention is given base on the ranking mechanism given to words
      - Decoder
        
        Refers to the input sequence + the output sequence. Making the prediction more efficient
        
        Most Attention given here
        
        Outputs keys
        
        Indexes hidden states using mapping scheme
      - Transformer Architecture