Pytorch Highway network

March 4, 2017 ยท View on GitHub

Highway network implemented in PyTorch.

Highway Equation

Usage

highway = Highway(input_size, num_layers, f=torch.nn.functional.relu)

# input is [batch_size, input_size] shaped tensor
out = highway(input)