ProjectionHead setting in tf2

[geanshu]

simclr/tf2/model.py

Lines 172 to 178 in 2fc637b

	# for the middle layers, use bias and relu for the output.
	self.linear_layers.append(
	LinearLayer(
	num_classes=lambda input_shape: int(input_shape[-1]),
	use_bias=True,
	use_bn=True,
	name='nl_%d' % j))

simclr/tf2/model.py

Lines 143 to 146 in 2fc637b

	self.dense = tf.keras.layers.Dense(
	num_classes,
	kernel_initializer=tf.keras.initializers.RandomNormal(stddev=0.01),
	use_bias=self.use_bias and not self.use_bn)

You said, "for the middle layers, use bias and relu for the output." But as settings here, there will be no bias in the middle layers.