Neural Net Arch Genealogy

CNN

AlexNet, '12.12

RNN

Capsule Net, '17.10

LSTM, '97.11

ResNet, '15.12

DenseNet, '16.08

GRU, 14.11

S2S: RNN Encoder-Decoder, '14.06

Attention: Jointly Learning to Align, '14.09

DCN: Dynamic Coattention Networks, '16.08, DCN+, '17.08

ACT: Adaptive Computation Time, '17.05

Memory Networks

Effective Approaches to Attention, Luong et al. '15.08

Transformer: Attention Is All You Need, '17.06

Memory Networks,'14.10

DMN: Dynamic Memory Network, '16.03, DMN+, '16.04

End-to-End Memory Network,'15.03

VggNet, '14.09

GoogLeNet, '14.09

Generative Models

Autoregressive models

Latent variable models

PixelRNN, '16.01.25

NADE, '16.05.07

MADE, '15.02.12

PixelCNN++, '17.01.19

VAE, '13.12.20

GAN, '14.06.10

CVAE, '14.06.20

AAE, '15.11.18

AVB, '17.01.17

Variants

Applications

WGAN, '17.01.26

WGAN-GP, '17.03.31

infoGAN, '16.06.12

ACGAN, '16.10.30

EBGAN, '16.09.11

BEGAN, '17.02.27

Pix2Pix, '16.11.21

StackGAN, '16.12.10

PPGN, '16.11.30

DCGAN, '15.11.19

CGAN, '14.11.06

PixelCNN, '16.06.16

Object Detection

R-CNN

Fast R-CNN

Faster R-CNN

Mask R-CNN

Neural Programming

Neural Programmer,'16.08

Neural Turing Machine,'14.10

Hybrid Computing, '16.10

Neural Random-Access Machines,'16.02

Neural GPUs Learn Algorithms, '16.03

Hierarchical Attentive Memory, '16.02

Super-resolution

SRCNN

VDSR

DRCN

FSRCNN

LabSRN

EDSR

MemNet

YOLO

SSD

R-FCN

Semantic Segmentation

FCN

DeconvNet

DeepLab

U-Net

Neural Module Networks, '16.06

VQ-VAE, '17.11.2

TripleGAN, '17.03.07

SENet: Squeeze-and-Excitation Networks, '17.09

Reinforcement Learning Algorithms

A3C, '16.02.06

DARLA, '17.07.26

ACTKR, '17.08.17

c51, '17.10.27

TTS

Wavenet, '16.09.12