Finetune AlexNet with Tensorflow 1.0

Note: This repository is adapted from (https://github.com/kratzert/finetune_alexnet_with_tensorflow)

You can now also train a simple MLP and LeNet.

It was developed in the spirit to serve as tutorial material, to get started with Tensorflow. The dataset used is NotMNIST available here

This repository contains all the code needed to finetune AlexNet on any arbitrary dataset. Beside the comments in the code itself, I also wrote an article which you can fine here with further explanation.

All you need are the pretrained weights, which you can find here or convert yourself from the caffe library using caffe-to-tensorflow. If you convert them on your own, take a look on the structure of the .npy weights file (dict of dicts or dict of lists).

Note: I won't write to much of an explanation here, as I already wrote a long article about the entire code on my blog.

Requirements

• Python 3.5 (Didn't test but should run under 2.7 as well)
• TensorFlow 1.0
• Numpy
• OpenCV (If you want to use the provided ImageDataGenerator in datagenerator.py)

TensorBoard support

The code has TensorFlows summaries implemented so that you can follow the training progress in TensorBoard. (--logdir in the config section of finetune.py)

Content

• alexnet.py: Class with the graph definition of the AlexNet.
• finetune.py: Script to run the finetuning process.
• datagenerator.py: Some auxiliary class I wrote to load images into memory and provide batches of images with their labels on function call. Includes random shuffle and horizontal flipping.
• caffe_classes.py: List of the 1000 class names of ImageNet (copied from here).
• validate_alexnet_on_imagenet.ipynb: Notebook to test the correct implementation of AlexNet and the pretrained weights on some images from the ImageNet database.
• images/*: contains three example images, needed for the notebook.

Additional content

• MLP.py: Class with the graph definition of a simple MLP (Multi Layer Perceptron)
• LeNet.py: Class with the graph definition of LeNet
• train_MLP.py: Script to train an MLP
• train_MLP_tensorboard.py: Script to train an MLP while outputing training progress for tensorboard
• train_LeNet.py: Script to train LeNet
• freeze_graph.py: Script to export a trained graph

Usage

All you need to touch is the finetune.py, although I strongly recommend to take a look at the entire code of this repository. In the finetune.py script you will find a section of configuration settings you have to adapt on your problem. If you do not want to touch the code any further than necessary you have to provide two .txt files to the script (train.txt and val.txt). Each of them list the complete path to your train/val images together with the class number in the following structure.

Example train.txt:
/path/to/train/image1.png 0
/path/to/train/image2.png 1
/path/to/train/image3.png 2
/path/to/train/image4.png 0
.
.

were the first column is the path and the second the class label.

The other option is that you bring your own method of loading images and providing batches of images and labels, but then you have to adapt the code on a few lines.