We document how the experiments reported in Horizontally Fused Training Array: An Effective Hardware Utilization Squeezer for Training Novel Deep Learning Models can be reproduced by following the steps below.