Skip to content
Open
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
167 commits
Select commit Hold shift + click to select a range
5fdbf58
first draft of the MCMC toolbox
Aug 28, 2017
1be7848
temp commit before I delete the sysID stuff
Nov 20, 2017
7947202
deleted sys ID
Nov 20, 2017
8fd0e41
changed the ATP deg parameter setup, and named the NTP consumption bi…
Nov 22, 2017
8d4fcc9
added the globalize params function
Nov 22, 2017
1598100
modified the txtl_init files
Nov 22, 2017
299d40c
fixed globalize params
Nov 23, 2017
ba04d29
parameter globalization and rule creation in txtl_transcription and t…
Nov 27, 2017
02bd910
added the mcmc config file
Nov 27, 2017
2c120b2
an mcmc toolbox for simbiology and in particular the txtl modeling to…
Nov 27, 2017
0bbd120
added a gitignore file for the projects directory
Nov 27, 2017
7907f8a
changed the readme file
Nov 28, 2017
1bb7850
changed sbiointegrable to only tolerate 50% non integrability - down …
Nov 28, 2017
ba1f5b1
Massive developments to the MCMC toolbox
Feb 21, 2018
b022ac8
added a file on VNPRL2011, and lots of stubs for the calibration corr…
Feb 26, 2018
f624382
getting ready to run vnprl on nessa and lambda
Feb 26, 2018
d734c39
added a bunch of project and mcmc_info files for artificial data MCMC
Apr 1, 2018
7eabd3b
updates constgfp3ii mcmc info file for running on linux, 200 walkers,…
Apr 1, 2018
c5b9376
updates constgfp3ii apr 1 7 pm PST for running on nessa and lambda
Apr 2, 2018
dbec6dc
updates constgfp3ii mcmc_info smaller step size and number of simulat…
Apr 2, 2018
b09557d
turned proj_protein_constgfp3ii_linux into a function so one does not…
Apr 2, 2018
380fbb3
optional ability to add a previous run as a starting point
Apr 2, 2018
a8360e9
changes to linux file
Apr 3, 2018
2e19d82
changes to file again
Apr 3, 2018
e2fe0f8
added standard deviation tot he linux file
Apr 3, 2018
5a3a379
bugfix in transcription and translation file, some setup of the covar…
Apr 16, 2018
4c4613c
an attempt at the new AGTP regenration system
Apr 18, 2018
c7c5d33
ommit log
Apr 20, 2018
bcda0d7
fixed a bug in the mcmc_info file. zzz
Apr 22, 2018
7371e2b
first set of nessa and lambda runs done. Now extended the parameter r…
Apr 25, 2018
0e6532f
made come changed to the explore regen A file
Apr 25, 2018
70981c0
new gitignore
Apr 25, 2018
9b40709
gitignore fix
Apr 25, 2018
7e3209e
commit of untracked files, getting ready for setting up a minimal wor…
Jul 20, 2018
7a2f40e
deleted a lot of the files that were a work in progress, so that we c…
Jul 28, 2018
7ff29d0
deleted a lot of the files that were a work in progress, so that we c…
Jul 28, 2018
b08fbd7
Merge branch 'minimal_mcmc_simbio' of https://github.com/vipulsinghal…
Jul 28, 2018
372b0f3
Added a readme file in markdown format. Not complete yet; Still need …
Jul 29, 2018
f52b109
Added a readme file in markdown format. Not complete yet; Still need …
Jul 29, 2018
7bb1954
try again with the readme file
Jul 29, 2018
bd45b75
tutorial files for mcmc_simbio in MATLAB markup
Jul 30, 2018
ef868d2
A lot of write up to the mcmc_info.m helpfile. Will point to this fil…
Jul 31, 2018
ab4d313
added tutorials I-III, an mcmc_info help file, a data_info help file,…
Aug 3, 2018
50e2c27
updated the readme file, and deleted some image files
Aug 3, 2018
ad7a070
added support functions needed for this toolbox to function (there we…
Aug 3, 2018
e96e073
changes to the source code to add weighting to trajectories, and the …
Jan 1, 2019
6dea480
modified gitignore to include data tiles, png, tiff, graphclick files
Jan 1, 2019
bbc8d35
testing on aws, first commit
Jan 29, 2019
0819b32
some changes to source files. refacter i next commit. this is from th…
Jan 29, 2019
c8a8d05
modifications to proj_acs_dsg2014_regen_A.m
Jan 30, 2019
fb8a708
changed non integrability limit to 80%
Jan 30, 2019
9800a3c
changed back to 67%
Jan 30, 2019
0e451eb
sorry this is the one
Jan 30, 2019
4cefbc8
added display msg to integrableLHS.m
Jan 30, 2019
b72a4de
more displays
Jan 30, 2019
96713fb
moving to debugging locally, AWS capability is present now. We can do…
Jan 30, 2019
98ce095
changes to tutorialII, and ran it on the cluster
Jan 31, 2019
6d08e9e
not sure what happened here... why was a conflict generated in the gi…
Jan 31, 2019
d23ca58
really screwing up the pushing here. I think I am mixing up the pulli…
Jan 31, 2019
a74a173
added the ability to start from a previous run's endpoint.
Jan 31, 2019
008ed32
bugfix
Jan 31, 2019
f613993
bugfix1
Jan 31, 2019
6cfcc1a
fixed gen residuals
Jan 31, 2019
39c0afb
tutorial II made to start from previous run
Jan 31, 2019
552da29
starting to fix some of the damage dome over the last couple of days.…
vipulsinghal02 Jan 31, 2019
bb5b76f
The error was that with the removal of the step which makes logical f…
Jan 31, 2019
2af3e3e
added parfor in the initial walker positions in gwmcmc_vse
vipulsinghal02 Jan 31, 2019
dd9c639
some changes to the tutorial II file to get it ready for continuation…
vipulsinghal02 Feb 1, 2019
b470318
parallel computing benchmark
Feb 1, 2019
191a4e0
updated the tutorial III file
Feb 1, 2019
c66dee1
changed the number of workers to 60. so 12 extra workers implemented …
Feb 1, 2019
0c8aa57
changed the number of workers to 46. this should keep cpu load low.
Feb 2, 2019
d0a0672
Merged the the minimal_mcmc_simbio_v20190131 with minimal_mcmc_simbio…
vipulsinghal02 Feb 2, 2019
1ed6a99
marged the master branch into the minimal mcmc simbio branch and how …
vipulsinghal02 Feb 3, 2019
fa97bb0
added the dsg files from the master branch, will now work on editing …
vipulsinghal02 Feb 3, 2019
406013a
added temperature ladder capability to the proj_acs_dsg2014_regen_A.m…
vipulsinghal02 Feb 3, 2019
ec88642
fixed a bug that was causing a file not found error. getting ready to…
vipulsinghal02 Feb 3, 2019
b6dff04
added temperature and step size ladder capabilities for simulated ann…
vipulsinghal02 Feb 4, 2019
284ef54
Created proj_acs_dsg2014_regen_C.m, which is a project that has all t…
vipulsinghal02 Feb 4, 2019
07cc902
Not sure what good values are, just made the F rates whole numbers be…
vipulsinghal02 Feb 4, 2019
4bae5d3
Fixed a bug in mcmc_get_walkers that was not gerring the walkers for …
vipulsinghal02 Feb 5, 2019
eac60df
added the ability to specify a particular iteratino ID from a previou…
Feb 6, 2019
dedbceb
temperature ladder defaults
vipulsinghal02 Feb 7, 2019
acc9f4d
Merge branch 'minmcmcv5a' of https://github.com/vipulsinghal02/txtlsi…
vipulsinghal02 Feb 7, 2019
2cfe383
fixed a bug where there was initial DNA concentration. This was causi…
vipulsinghal02 Feb 7, 2019
cb87618
added an option to specify the step size multiplier for each iteration.
vipulsinghal02 Feb 8, 2019
a86074f
added a project file regen_A1, which has expanded ranges of parameter…
vipulsinghal02 Feb 8, 2019
e1ab8d2
added the C1 project:
vipulsinghal02 Feb 8, 2019
c0b8c17
fixed a bug where the master vector was not being initialized properl…
vipulsinghal02 Feb 9, 2019
4b75fba
removed dose weighting, and also flipped the experiment weighting. I …
vipulsinghal02 Feb 9, 2019
bcedfc7
minor bugfix
vipulsinghal02 Feb 9, 2019
d54065d
made some changes to the mcmc_info files to reject the dose weighting.
vipulsinghal02 Feb 9, 2019
a00e32c
unfixed the deg turn on time parameter.
vipulsinghal02 Feb 9, 2019
5709462
proj_acs_dsg2014_regen_D: minimal 10 parameter version, with the rest…
vipulsinghal02 Feb 9, 2019
5e8259f
project regen_G: a very very reduced set of just 6 parameters. the RN…
vipulsinghal02 Feb 9, 2019
22ca5a7
added regen E and F, that are just variations involving 11 and 13 par…
vipulsinghal02 Feb 9, 2019
7b8e0c2
upweighted the tx and tl experiment relative to the rna deg experimen…
vipulsinghal02 Feb 10, 2019
29fc128
two larger parameter estimation problems, H and I, too. 19 and 15 par…
vipulsinghal02 Feb 11, 2019
6ae0791
F1 is F with expanded allowable parameter ranges.
vipulsinghal02 Feb 11, 2019
3a45545
added a vnprl project. It is basically like the ACS 2014 paper, but w…
vipulsinghal02 Feb 17, 2019
6361fb1
added the test015 data and estimation files -- this is the investigat…
vipulsinghal02 Mar 13, 2019
9fc51dd
extended the parameter ranges
vipulsinghal02 Mar 13, 2019
1b41931
the first correction step of the tetR data. (redoing the thesis stuff…
vipulsinghal02 Mar 14, 2019
c85355b
dosedvals bugfix in mcmc_info
vipulsinghal02 Mar 14, 2019
96d29be
another bugfix
vipulsinghal02 Mar 14, 2019
76ff259
flipped the tetR and GFP dose. cannot use unflipped... not sure why. …
vipulsinghal02 Mar 14, 2019
5a641d6
extended the ranges a bit after looking at the plots
vipulsinghal02 Mar 14, 2019
832724b
fixed the forward rate parameters in the corr step 1.
vipulsinghal02 Mar 14, 2019
90e5a7b
made some changes ot the params... opefully removes some of the ill c…
vipulsinghal02 Mar 14, 2019
8627716
using uM data with nM DNA conc was messing up the tetR repression, wh…
vipulsinghal02 Mar 14, 2019
4bb0c41
changed the correction files with the new ESPs estimated using the co…
vipulsinghal02 Mar 15, 2019
1a0110d
trying a more relaxed fixing scheme -- only the forward dimerization …
vipulsinghal02 Mar 15, 2019
f785eb9
make the ranges smaller again to avoid non integrability.
vipulsinghal02 Mar 15, 2019
d809b2b
did not update the est names.... fixed that bug
vipulsinghal02 Mar 15, 2019
0d25301
fixed more parameters... the correction step was not really working
vipulsinghal02 Mar 15, 2019
0f4277a
fixing the kfdg in the calibration experiments, and going to try that.
vipulsinghal02 Mar 15, 2019
4583570
didnt set it up properly. corrected.
vipulsinghal02 Mar 15, 2019
0ec349c
working on figuring out a better scheme for generalization to the tes…
vipulsinghal02 Mar 18, 2019
3fa50da
going to try doing the calibrations with both the extract datasets th…
vipulsinghal02 Mar 20, 2019
1440765
Bug in the proj file--- forgot to change the mcmc_info command in the…
vipulsinghal02 Mar 20, 2019
82ef659
Commit message: Large commit for phase 1 of the IFFL data fitting usi…
vipulsinghal02 Apr 19, 2019
7b00e88
minor bugfix
vipulsinghal02 Apr 19, 2019
ae29a07
phase 1b: fixing more parameters, expanding the range for others. als…
vipulsinghal02 Apr 21, 2019
a31a04b
further readjusted the parameter ranges.
vipulsinghal02 Apr 22, 2019
a82b2de
more param range relaxations
vipulsinghal02 Apr 22, 2019
370433e
further extended the range of parameter values, and fixed a bug in th…
vipulsinghal02 Apr 24, 2019
da77c54
SET UP PHASE 2 WITH THE RIGHT PARAMETERS
vipulsinghal02 Apr 26, 2019
fa5abcd
added trajectory plotting code, and fixed bug in phase 2 mcmc info fi…
vipulsinghal02 Apr 28, 2019
9484194
extended the limits of RNAP and the tetR sequestration parameters.
vipulsinghal02 Apr 29, 2019
de21ede
extended the ranges of a bunch of parameters: Pol, Ribo, Pol KD (tet)…
vipulsinghal02 May 1, 2019
bd14bb3
added the full IFFL training example. (proj and mcmc_info file)
vipulsinghal02 May 1, 2019
3cef2c7
bugfix in the full iffl training file.
vipulsinghal02 May 3, 2019
1aa8641
the plas system was not fitting well enough. there was not enough deG…
vipulsinghal02 May 6, 2019
1438a6f
made the parameter ranges for the unactivated plas promoter Kd broade…
vipulsinghal02 May 7, 2019
27cb38b
Added full training B files:
vipulsinghal02 May 8, 2019
c1b7722
added the file training_fullC, which has expanded parameter ranges, a…
vipulsinghal02 May 9, 2019
f5a6135
added training fullD: relative to training fullC, i fixed 3 parameter…
vipulsinghal02 May 11, 2019
8f338f5
Added training E, that differs from training D in that the ktx and kt…
vipulsinghal02 May 12, 2019
4f1670b
massive changes to many files
vipulsinghal02 Apr 20, 2020
04d2775
deleted large files
vipulsinghal02 Apr 20, 2020
f7c84c3
the aws version where I run F3
May 3, 2020
e9d085b
added IFFL training full F--> this has better parameter search ranges…
vipulsinghal02 May 3, 2020
0d993ed
renamed the unmodified vnprlF3 to keep it.
vipulsinghal02 May 3, 2020
3b5f619
Merge branch 'minmcmcv5a' of https://github.com/vipulsinghal02/txtlsi…
vipulsinghal02 May 3, 2020
026fd2c
bugfix in RNAP parameter ranges of vnprl F3
vipulsinghal02 May 8, 2020
aff7090
ZSIFFL_E updated to F. This is basically using the distribution C par…
vipulsinghal02 May 10, 2020
e60f217
added the ZSIFFL training F project file
vipulsinghal02 May 10, 2020
8ce9a1a
windiows compatible initialization.
vipulsinghal02 May 13, 2020
7c43a85
updated ZSIFFL training F
vipulsinghal02 May 13, 2020
afb92c2
Merge branch 'minmcmcv5a' of https://github.com/vipulsinghal02/txtlsi…
vipulsinghal02 May 13, 2020
88bc0f0
all the project and mcmc info files from the runs done on the big wor…
vipulsinghal02 Jul 26, 2020
381e511
core characterization plots
vipulsinghal02 Jul 26, 2020
d635a62
Merge branch 'minmcmcv5a' of https://github.com/vipulsinghal02/txtlsi…
vipulsinghal02 Jul 27, 2020
785448f
restoring the runsummaries. a complicated thing between dropbox and g…
vipulsinghal02 Jul 31, 2020
7df3900
added the generate paper figs files. thse will be used to add the sam…
vipulsinghal02 Aug 4, 2020
6ec5d85
addressed merge conflict in the core charac file
vipulsinghal02 Aug 4, 2020
bc7f621
.
vipulsinghal02 Aug 4, 2020
9ebd1e6
Merge branch 'minmcmcv5a' of https://github.com/vipulsinghal02/txtlsi…
vipulsinghal02 Aug 4, 2020
dad78d5
gitignore and moved some things around
vipulsinghal02 Aug 4, 2020
2c99e72
incorporating changes to component files from the buildacell repo (wh…
vipulsinghal02 Aug 5, 2020
6bdb164
tutorial and config files from the buildacell repo
vipulsinghal02 Aug 5, 2020
475ab3d
minor changes to geneexpr
vipulsinghal02 Aug 14, 2020
24af225
updated run summaries file
vipulsinghal02 Dec 16, 2020
ce72776
First test of the file proj_vnprl_cluster to deploy the code on the c…
vipulsinghal02 Mar 27, 2022
f77bffd
modifications to get it to run on the corona cluster. The current ver…
vipulsinghal02 Mar 27, 2022
26c12f9
intermediate commit containing some changes to the tetR calibration c…
vipulsinghal02 May 24, 2022
df47672
mcmc runsim
vipulsinghal02 May 24, 2022
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
The table of contents is too big for display.
Diff view
Diff view
  •  
  •  
  •  
79 changes: 79 additions & 0 deletions .gitignore
100644 → 100755
Original file line number Diff line number Diff line change
Expand Up @@ -18,6 +18,10 @@
# Simulink Code Generation
slprj/

# data dirs
/mcmc_simbio/exp_data/Zach_IFFL_raw
mcmc_simbio/exp_data/from_Tierra_Bio_2018_oct

# Session info
octave-workspace

Expand All @@ -26,3 +30,78 @@ octave-workspace

# .DS_store files
.DS_Store

*.sublime-project
*.sublime-workspace

*.txt
*.todo

# Image files
*.png
*.tiff
*.eps
*.jpg
*.svg
# *.fig
# data files
*.gc
*.xlsx
# *.csv

# movie files
*.mp4

youngha_data_conversion/
html/

# Compiled source #
###################
*.com
*.class
*.dll
*.exe
*.o
*.so

# Packages #
############
# it's better to unpack these files and commit the raw source
# git has its own built in compression methods
*.7z
*.dmg
*.gz
*.iso
*.jar
*.rar
*.tar
*.zip

# Logs and databases #
######################
*.log
*.sql
*.sqlite

# OS generated files #
######################
.DS_Store
.DS_Store?
._*
.Spotlight-V100
.Trashes
ehthumbs.db
Thumbs.db

# MATLAB Crash Dumps #
######################
Crash_logs_*/
manual_txtlsim_parameters.m

# reaction files I use
*.reactions*
designing_masterVector_for_IFFL


# directories
/animations/
Empty file modified ChangeLog
100644 → 100755
Empty file.
Empty file modified Makefile
100644 → 100755
Empty file.
Empty file modified Pending
100644 → 100755
Empty file.
23 changes: 0 additions & 23 deletions README

This file was deleted.

45 changes: 45 additions & 0 deletions README.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,45 @@
# Introduction

This package contains two related toolboxes that work with MATALB Simbiology models: txtlsim and mcmc_simbio.

The first toolbox is called txtlsim (ref), and can be used to simulate the chemical reations that occur in the Transcription-Translation (TX-TL) cell-free gene expression system developed at the University of Minnesota (Vincent Noireaux) and Caltech (Richard Murray) (refs). The main features of this toolbox are its ability to track the loading of enzymatic machinery, the consumption of resources, the ease of setting up models, the automatic accounting of retroactivity effects, and the extensibility the reaction networks generated.

The second toolbox is called mcmc_simbio. This is a concurrent Bayesian parameter inference toolbox for MATLAB Simbiology models. The Bayesian parameter inference is performed using a modification of Aslak Grinsted's MATLAB implementation of the affine invariant ensemble Metropolis-Hastings MCMC sampler (ref). We have added support for what we call 'concurrent' parameter inference, which refers to the capability to estimate a common set of parameters that get used simultaneously and in arbitrary combinations in multiple experiments/models. More information can be found below.

# The Toolboxes

## Getting the toolbox and running some simple examples

Clone the repository using

```
git clone https://github.com/BuildACell/txtlsim.git
```

into a directory you wish to put the toolbox in. Alternatively, if you do not plan to version control the toolbox, you can simply download it as a zip file using the green button on the [main page](https://github.com/BuildACell/txtlsim).

Lets call the directory where you cloned or downloaded the repository `trunk`, i.e., this is where directories like `core`, `components`, `examples` and `mcmc_simbio` are. Open MATLAB, and set the current working directory to `trunk`. Type in `txtl_init` and `mcmc_init` into the MATLAB command line. This initializes the txtlsim and mcmc_simbio toolboxes.

Check if both the toolboxes are installed properly by running the follwoing examples:

### txtlsim examples
Start with typing in `geneexpr` into the command window. This should run a constitutive gene expression example in the toolbox, and you should see a plot with three subplots (protein; mRNA and DNA; and resource usage) appear. There should not be any error messages in the command window.

Next, run the `negautoreg` example in the command line. Again, you should see a plot of the species in the system, and no errors. This example simulates the negative autoregulation circuit.

Type in `edit TXTL_tutorial` into the command line to open the tutorial file. You can also use the MATLAB publisher button to publish this file, and look at it in the MATLAB help file markup. We recommend running through the examples in this file, and exploring the reactions, species, etc set up in this file. Familiarity with the MATLAB Simbiology command line is helpful here. To learn more about Simbiology, go to the [Getting Started Using the Simbiology Command Line](https://www.mathworks.com/help/simbio/gs/simbiology-command-line-tutorial.html) page.

### mcmc_simbio examples

Next, open and explore the mcmc_simbio estimation examples given in the files `proj_mcmc_tutorial`, `proj_mcmc_tutorial_II`, and `proj_mcmc_tutorial_III` in the `trunk\mcmc_simbio\proj\` directory. We strongly recommend you skim through the `mcmc_info.m` and `data_info` files (`trunk\mcmc_simbio\models_and_supporting_files\` or type `help mcmc_info` and `help data_info` into the MATLAB command line) to gain an understanding of some of the key functionalities of the parameter inference toolbox. Along with the three tutorial files, the `mcmc_info.m` and the `data_info.m` files provide an initial idea of the capabilities of the toolbox.

## References

More information can be found in the following references:

Z. A. Tuza, V. Singhal, J. Kim and R. M. Murray, "An in silico modeling toolbox for rapid prototyping of circuits in a biomolecular “breadboard” system," 52nd IEEE Conference on Decision and Control, Firenze, 2013, pp. 1404-1410.
doi: 10.1109/CDC.2013.6760079


Vipul Singhal, 2018
California Institute of Technology
Empty file modified auxiliary/WriteODEFunction_externalParameters.m
100644 → 100755
Empty file.
Empty file modified auxiliary/barweb.m
100644 → 100755
Empty file.
45 changes: 45 additions & 0 deletions auxiliary/boundedline/.gitignore
Original file line number Diff line number Diff line change
@@ -0,0 +1,45 @@
# MATLAB #
##########
# Editor autosave files
*~
*.asv
# Compiled MEX binaries (all platforms)
*.mex*

# Compiled source #
###################
*.com
*.class
*.dll
*.exe
*.o
*.so

# Packages #
############
# it's better to unpack these files and commit the raw source
# git has its own built in compression methods
*.7z
*.dmg
*.gz
*.iso
*.jar
*.rar
*.tar
*.zip

# Logs and databases #
######################
*.log
*.sql
*.sqlite

# OS generated files #
######################
.DS_Store
.DS_Store?
._*
.Spotlight-V100
.Trashes
ehthumbs.db
Thumbs.db
37 changes: 37 additions & 0 deletions auxiliary/boundedline/Inpaint_nans/.gitignore
Original file line number Diff line number Diff line change
@@ -0,0 +1,37 @@
# Compiled source #
###################
*.com
*.class
*.dll
*.exe
*.o
*.so

# Packages #
############
# it's better to unpack these files and commit the raw source
# git has its own built in compression methods
*.7z
*.dmg
*.gz
*.iso
*.jar
*.rar
*.tar
*.zip

# Logs and databases #
######################
*.log
*.sql
*.sqlite

# OS generated files #
######################
.DS_Store
.DS_Store?
._*
.Spotlight-V100
.Trashes
ehthumbs.db
Thumbs.db
Loading