Skip to content
This repository was archived by the owner on Jun 14, 2024. It is now read-only.

Variational Continual Learning#159

Open
tdiethe wants to merge 40 commits intoamzn:developfrom
tdiethe:examples/vcl
Open

Variational Continual Learning#159
tdiethe wants to merge 40 commits intoamzn:developfrom
tdiethe:examples/vcl

Conversation

@tdiethe
Copy link
Copy Markdown
Contributor

@tdiethe tdiethe commented Feb 26, 2019

Description of changes:
This is an example that attempts to replication the Variational Continual Learning method of Cuong Nguyen, Yingzhen Li, Thang Bui, and Richard Turner. This required some new functionality (ignored variables) which has been incorporated into the core. Currently the the code is running (tested for split MNIST) but the results don't yet match the results from the paper.

By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.

Runnable code (results not great! - requires debugging)
Added callback functions for custom print statements in batch_loop and grad_based_inference
Improved output formatting
Fixed a bug in the batch loop executor
Removed unneeded code in vanilla coreset
Fixed a print statement
Updated model class to support multi-headed models
Updated experiment class to reflect changes
Added custom print function to minibatch loop
# Conflicts:
#	mxfusion/components/variables/variable.py
#	testing/components/functions/operators_test.py
# Conflicts:
#	mxfusion/components/functions/operators/operator_impl.py
#	mxfusion/inference/grad_based_inference.py
#	mxfusion/inference/inference_alg.py
#	mxfusion/models/factor_graph.py
@codecov-io
Copy link
Copy Markdown

Codecov Report

Merging #159 into develop will decrease coverage by 0.46%.
The diff coverage is 55.38%.

Impacted file tree graph

@@             Coverage Diff             @@
##           develop     #159      +/-   ##
===========================================
- Coverage    85.06%   84.59%   -0.47%     
===========================================
  Files           78       78              
  Lines         3897     3947      +50     
  Branches       660      672      +12     
===========================================
+ Hits          3315     3339      +24     
- Misses         383      404      +21     
- Partials       199      204       +5
Impacted Files Coverage Δ
...on/components/functions/mxfusion_gluon_function.py 86.9% <0%> (ø) ⬆️
mxfusion/inference/minibatch_loop.py 72.41% <0%> (-5.37%) ⬇️
mxfusion/inference/meanfield.py 100% <100%> (ø) ⬆️
mxfusion/inference/__init__.py 100% <100%> (ø) ⬆️
mxfusion/inference/grad_based_inference.py 71.42% <33.33%> (-19.88%) ⬇️
mxfusion/inference/forward_sampling.py 76.92% <40%> (-13.08%) ⬇️
mxfusion/models/factor_graph.py 84.11% <40%> (-0.56%) ⬇️
mxfusion/inference/batch_loop.py 81.81% <50%> (-18.19%) ⬇️
mxfusion/inference/variational.py 83.33% <66.66%> (-7.15%) ⬇️
mxfusion/inference/inference_alg.py 91.5% <81.81%> (-1.2%) ⬇️

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 80d9561...17f6841. Read the comment docs.

Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants