EI network - Dend Target Prop (BTSP)#
BTSP synaptic weight update
Top-down weight symmetry
Here we will show the analysis for a single example seed of a network described in Galloni et al. 2025.
import EIANN as eiann
from EIANN import utils as ut
eiann.update_plot_defaults()
root_dir = ut.get_project_root()
Load MNIST data#
train_dataloader, val_dataloader, test_dataloader, data_generator = ut.get_MNIST_dataloaders()
Load optimized pre-trained EIANN model#
network_name = "20241212_EIANN_2_hidden_mnist_BTSP_config_5L_complete_optimized"
network_seed = 66049
data_seed = 257
If you want to train this network configuration from scratch, you can build a new network object directly from the .yaml configuration file and then train it:
# Create network object
config_file_path = f"{root_dir}/EIANN/network_config/mnist/{network_name}.yaml"
network = ut.build_EIANN_from_config(config_file_path, network_seed=network_seed)
# Train network
data_generator.manual_seed(data_seed)
network.train(train_dataloader, val_dataloader,
epochs = 1,
samples_per_epoch = 20_000,
val_interval = (0, -1, 100),
store_history = True,
store_history_interval = (0, -1, 100),
store_dynamics = False,
store_params = True,
status_bar = True)
# Optional: Save network object to pickle file
saved_network_path = f"{root_dir}/EIANN/data/mnist/{network_name}_{network_seed}_{data_seed}.pkl"
ut.save_network(spiral_net, path=saved_network_path)
In this case, since we have already trained the network, we will simply load the saved network object that is stored in a pickle (.pkl) file:
saved_network_path = f"{root_dir}/EIANN/data/saved_network_pickles/mnist/{network_name}_{network_seed}_{data_seed}.pkl"
network = ut.load_network(saved_network_path)
network.name = network_name
network.seed = f"{network_seed}_{data_seed}"
Loading network from '/Users/ag1880/github-repos/Milstein-Lab/EIANN/EIANN/data/saved_network_pickles/mnist/20241212_EIANN_2_hidden_mnist_BTSP_config_5L_complete_optimized_66049_257.pkl'
Network successfully loaded from '/Users/ag1880/github-repos/Milstein-Lab/EIANN/EIANN/data/saved_network_pickles/mnist/20241212_EIANN_2_hidden_mnist_BTSP_config_5L_complete_optimized_66049_257.pkl'
3. Training results#
eiann.plot_loss_history(network, ylim=(-0.01, 0.2))
eiann.plot_accuracy_history(network)
eiann.plot_error_history(network)
eiann.plot_loss_landscape(test_dataloader, network, num_points=20, extension=1, vmax_scale=1.2, scale='log')
4. Analyze population activities#
eiann.plot_batch_accuracy(network, test_dataloader, population='E')
Batch accuracy = 93.45999908447266%
pop_dynamics_dict = ut.compute_test_activity_dynamics(network, test_dataloader, plot=True, normalize=True) # We will evaluate the network dynamics by presenting the test dataset and recording the neuron activity.
print(pop_dynamics_dict['H1E'].shape) # Since we are store the dynamics here, each population should have activity of shape (timesteps, data samples, neurons)
torch.Size([15, 10000, 500])
5. Analyze learned representations#
pop_activity_dict, pattern_labels, unit_labels_dict = ut.compute_test_activity(network, test_dataloader, class_average=False, sort=True)
pattern_similarity_matrix_dict, neuron_similarity_matrix_dict = ut.compute_representational_similarity_matrix(pop_activity_dict, pattern_labels, unit_labels_dict, population='E', plot=True)
5.3 Output layer#
receptive_fields_output = ut.compute_maxact_receptive_fields(network.Output.E, test_dataloader=test_dataloader, export=True, export_path=root_dir+f"/EIANN/data/model_hdf5_plot_data/plot_data_{network_name}.h5")
eiann.plot_receptive_fields(receptive_fields_output, sort=False)
Loading maxact_receptive_fields_OutputE from file: /Users/ag1880/github-repos/Milstein-Lab/EIANN/EIANN/data/model_hdf5_plot_data/plot_data_20241212_EIANN_2_hidden_mnist_BTSP_config_5L_complete_optimized.h5
Data key maxact_receptive_fields_OutputE not found in seed 66049_257 of network 20241212_EIANN_2_hidden_mnist_BTSP_config_5L_complete_optimized in file: /Users/ag1880/github-repos/Milstein-Lab/EIANN/EIANN/data/model_hdf5_plot_data/plot_data_20241212_EIANN_2_hidden_mnist_BTSP_config_5L_complete_optimized.h5
Optimizing receptive field images OutputE...
maxact_receptive_fields_OutputE saved to file: /Users/ag1880/github-repos/Milstein-Lab/EIANN/EIANN/data/model_hdf5_plot_data/plot_data_20241212_EIANN_2_hidden_mnist_BTSP_config_5L_complete_optimized.h5
