Repository navigation

Fix bugs in tensorflow example - #139

Open

swjz wants to merge 643 commits into

scanner-research:masterfrom

swjz:patch-3

Open

Fix bugs in tensorflow example#139
swjz wants to merge 643 commits into
scanner-research:masterfrom
swjz:patch-3

This pull request is big! We're only showing the most recent 250 commits

Commits on Nov 6, 2017
- Fix typo
  fpoms
  committed
  bc3f2ef
Commits on Nov 12, 2017
- Getting build flags no longer requires loading scanner lib
  willcrichton
  committed
  5274b66
- Unnecessary movie
  willcrichton
  committed
  31098c0
- Fixed build flags bug
  willcrichton
  committed
  066824b
- Fixed pythonpath
  willcrichton
  committed
  b00ba95
Commits on Nov 25, 2017
- Attempt to update travis DOCKER_PASS
  willcrichton
  committed
  141e8b2
- Attempt to fix login/push on branch updates
  willcrichton
  committed
  7ca0c60
- Fix docker rmi not removing tagged imaged
  fpoms
  committed
  a3135d4
- Fixes #89
  fpoms
  committed
  cde8dea
- Fixes #88
  fpoms
  committed
  92888e8
- Do not publish build if branch is not master
  fpoms
  committed
  b5dc23a
Commits on Nov 26, 2017
- Use exit instead of return
  fpoms
  committed
  f6b3f60
- Shutdown server when process receives SIGINT, fixes #78
  fpoms
  committed
  3cacff4
- Support batched input for python kernel
  
  qianl15
  authored and
  fpoms
  committed
  fb851e5
- add s3 support
  
  qianl15
  authored and
  fpoms
  committed
  6d8f69d
- Support incomplete jobs/tables, fixes #72
  fpoms
  committed
  33eeea4
- WIP new README
  fpoms
  committed
  c232b69
- WIP new README
  fpoms
  committed
  273ebf7
- Update README, change face pipeline to new NN app style
  fpoms
  committed
  0b48cb9
- Update face detect doc
  fpoms
  committed
  8382bb3
Commits on Nov 27, 2017
- Use absolute python imports (for py3), add basic sphinx docs
  fpoms
  committed
  b3f3143
- Fix tests not passing due to unicode strings
  fpoms
  committed
  480a347
- Add OpenPose Op, closes #97
  fpoms
  committed
  fed2370
Commits on Nov 28, 2017
- Add facenet CPU support
  fpoms
  committed
  6c8fd7a
- Fix db new_table for new commit table
  fpoms
  committed
  f96ca7f
- Fix issue with stenciled kernels
  fpoms
  committed
  4278dd6
- Reorganize examples directory
  fpoms
  committed
  3667047
- Update README to match new example structure
  fpoms
  committed
  c5783d3
- Build facenet kernel always
  fpoms
  committed
  e47fcf6
Commits on Nov 29, 2017
- Fix saved io packets being overwritten
  fpoms
  committed
  af7c2be
- Update apps based on new dir structure
  fpoms
  committed
  049b673
- Build docker from new base images
  fpoms
  committed
  c5901c0
- Use most recent docker on travis
  fpoms
  committed
  c0addd5
- Assume Caffe uses all CPUs
  fpoms
  committed
  a9c8188
- Support different devices for input/output cols, py kernel config
  fpoms
  committed
  b16f613
Commits on Nov 30, 2017
- Fix broken links in README
  fpoms
  committed
  2be9892
- Support new GRPC version (1.7.2)
  fpoms
  committed
  956c1e0
- Fix error in shot detection example
  fpoms
  committed
  dd1a566
- Fix scanner not shutting down when receiving SIGINT
  fpoms
  committed
  65e9ac5
Commits on Dec 10, 2017
- Fix missing ascii conversion
  willcrichton
  committed
  4957893
Commits on Dec 18, 2017
- Working deps script
  fpoms
  committed
  b3b03f3
- Export env variables in deps.sh, add missing resource files
  fpoms
  committed
  3032266
- Add cmake find for GRPC, add swscale to ffmpeg cmake
  fpoms
  committed
  13f9adb
- GRPC libraries were in wrong order
  fpoms
  committed
  f687e6a
- Typo
  fpoms
  committed
  9588b79
- Merge scanner-docker dockerfiles, update docker to work with deps.sh
  fpoms
  committed
  eee2709
Commits on Dec 19, 2017
- Update docker files to build properly
  fpoms
  committed
  0caab05
- Update travis build to new dockerfile location
  fpoms
  committed
  d45a3cf
- Dockerfile should be specified on build, not run cmd
  fpoms
  committed
  69d1e61
- Dependencies are already built in base image
  fpoms
  committed
  a83e5df
- Do not include openface op in dockerfile for now
  fpoms
  committed
  169cdf5
- Fix not finding halide dir
  fpoms
  committed
  a76bc3a
- Caffe should be installed by default
  fpoms
  committed
  725288c
- Fix TinyToml and Storehouse not being found
  fpoms
  committed
  7ef520e
- Typo
  fpoms
  committed
  b699800
- Don't use root logger
  willcrichton
  committed
  d59f8d0
- Multicore boost build
  willcrichton
  committed
  b1e2045
- Fix grpc not using proper include flags
  fpoms
  committed
  d146aff
- Typo
  fpoms
  committed
  5c94963
- Fix Caffe build in deps.sh
  willcrichton
  committed
  48af7bd
Commits on Dec 20, 2017
- Fix grpc install
  willcrichton
  committed
  05888ac
- storehousepy -> storehouse
  willcrichton
  committed
  59a3797
- Make docker build context the scanner root
  fpoms
  committed
  584c7f2
- Include nvcuvid in docker
  fpoms
  committed
  1809a6f
Commits on Dec 21, 2017
- Updated INSTALL instructions, proper python package for scanner
  fpoms
  committed
  42e248e
- Update Docker to build and install python package
  fpoms
  committed
  6833076
- Attempt to fix docker build
  fpoms
  committed
  1a03316
- Build wheel
  fpoms
  committed
  3375e06
- Do not need to add scanner to python path
  fpoms
  committed
  dc99c73
- stdlib is in scanner, not scannerpy package
  fpoms
  committed
  d01faf9
Commits on Dec 22, 2017
- Add header and cmake to pip package, add cuda stubs to library path
  fpoms
  committed
  f23e337
- Remove extraneous ln
  fpoms
  committed
  b0fbc05
- Typo
  fpoms
  committed
  5f598a5
- Add print functions to build_flags
  willcrichton
  committed
  e6fba17
- Include generated C++ protobuf headers
  fpoms
  committed
  b03574b
- Fix storehouse + boost build
  willcrichton
  committed
  172281b
- Link stdlib against scanner
  fpoms
  committed
  520b80e
- Remove broken code
  fpoms
  committed
  032f8d5
Commits on Dec 23, 2017
- Add inplace ingest support. Closes #28
  fpoms
  committed
  e8f9fed
Commits on Dec 25, 2017
- Need to add cuda stubs to library path before building scanner
  fpoms
  committed
  625803f
Commits on Dec 27, 2017
- Update hwang to fix multi-gpu decode issue
  fpoms
  committed
  4a7b460
- Fix multi-gpu hwang issue (same as previous commit)
  fpoms
  committed
  b9f1a74
- Cache caffe install
  fpoms
  committed
  f6c65b0
- Add new build script
  willcrichton
  committed
  8969c91
- Fix cuda link and custom op link
  willcrichton
  committed
  c3e95ac
- Port changes from openpose-scanner
  willcrichton
  committed
  6c899f2
- Bump storehouse version
  willcrichton
  committed
  5b2e7c8
- Fix custom op build
  willcrichton
  committed
  62fff16
Commits on Dec 28, 2017
- Add openpose to build
  willcrichton
  committed
  914fc53
- Fix docker resources not being committed
  willcrichton
  committed
  f434995
- Add thirdparty files
  willcrichton
  committed
  66dce54
- Add table list/get/delete to rpc methods, make python use them
  fpoms
  committed
  a3e146d
- ascii for boost python api
  fpoms
  committed
  0c27342
- Typo
  fpoms
  committed
  b75c595
- Write db metadata after delete tables
  fpoms
  committed
  3f0f706
- Also prefetch uncommitted tables
  fpoms
  committed
  3b60874
- Add exp backoff for checking if db exists
  fpoms
  committed
  87637d8
- Ignore nodes that can't be ssh'ed into during cluster start
  fpoms
  committed
  429985f
- Check # of worker conns, not addresses
  fpoms
  committed
  95faeef
- Missing extra changes
  fpoms
  committed
  e91f76c
- Parallelize table metadata write
  fpoms
  committed
  6db0613
- Write table metadata in parallel
  fpoms
  committed
  afba708
- Typo
  fpoms
  committed
  e0f3ba1
- Using wrong id
  fpoms
  committed
  59a8c67
- Use smaller worker pool
  fpoms
  committed
  7d016ab
- Typo
  fpoms
  committed
  9e4a97a
- Initial changes to base image size
  willcrichton
  committed
  b949bb8
- Remove collections from python api
  willcrichton
  committed
  45c49d9
Commits on Dec 29, 2017
- Typo
  fpoms
  committed
  e3d933f
- Add ID to summarize
  fpoms
  committed
  296cb13
- Improved base image build
  willcrichton
  committed
  2d9871b
- Add install none option for docker build
  willcrichton
  committed
  b2c7e00
- Improve face detect pipeline
  willcrichton
  committed
  b1d522b
- Remove collections test
  willcrichton
  committed
  9998e1a
- More stable failure procedure
  fpoms
  committed
  3dcb00a
- Do no route outputs
  fpoms
  committed
  93b9bc3
- Changed db metadata prefetch to use thread pool
  willcrichton
  committed
  a7a10fa
- Chunk up reading of table info
  fpoms
  committed
  0d2ab55
- Fix not chunking properly
  fpoms
  committed
  d019982
- Add option to prefetch table metadata
  willcrichton
  committed
  0cc6fe3
- Python client also uses prefetch flag
  willcrichton
  committed
  18de7a7
- Make workers wait for all work to be finished
  fpoms
  committed
  27f509d
Commits on Dec 30, 2017
- Move progress bar to Python side
  willcrichton
  committed
  1b4eb24
- Fix getting wrong job total
  willcrichton
  committed
  2dc87ad
- Fix worker not shutting down properly if fail to connect to master
  willcrichton
  committed
  e3af05c
- Start watchdog after checking master
  willcrichton
  committed
  337c90e
- Fix total tasks pbar race condition, add more info to pbar
  fpoms
  committed
  2843531
- Fix typo
  fpoms
  committed
  8420bbd
- Fix worker failed message
  fpoms
  committed
  e6817d2
- Print time of failure for progress bar
  fpoms
  committed
  7e316cb
- Prefetch metadata in workers to accelerate startup
  fpoms
  committed
  e2f2949
- Make adding failed workers initiated by processing loop
  fpoms
  committed
  f62b0dd
Commits on Dec 31, 2017
- Move job waiting into standalone function
  willcrichton
  committed
  e5ea75c
- Add prefetch option to worker
  willcrichton
  committed
  7477e66
- Allow longer timeout on tests
  willcrichton
  committed
  c26da0a
- travis_wait doesn't exist?
  willcrichton
  committed
  ed0ab78
- Avoid travis timeout
  fpoms
  committed
  01a1285
Commits on Jan 1, 2018
- Add exponential backoff for master grpc calls, warn instead of fail
  fpoms
  committed
  78276c2
- Fix reusing grpc client context
  fpoms
  committed
  209fc33
- Fix debug path failing
  fpoms
  committed
  911c6e8
- Add GRPC_BACKOFF to worker calls
  fpoms
  committed
  5e5f2af
- Add job matrix for travis so that each job can run longer
  fpoms
  committed
  a735de4
- Change GRPC_BACKOFF to warn instead of fail after max backoff
  fpoms
  committed
  8d741cb
- Only prefetch necessary tables in worker
  willcrichton
  committed
  d0b057b
- Add method for accessing keyframe indices from video columns
  fpoms
  committed
  3124cf1
- Provide explanation for errors in db debug mode
  fpoms
  committed
  1672401
- Move new table from database to master. Fixes #119
  willcrichton
  committed
  18c19fa
Commits on Jan 2, 2018
- Bump storehouse version
  willcrichton
  committed
  ed2dec7
- Use so_paths as op cache
  willcrichton
  committed
  a1a7ab8
- Add support for blacklisting bad jobs
  fpoms
  committed
  ddd237f
- Improve metadata read times
  willcrichton
  committed
  fcebe29
- Add minimum read size
  willcrichton
  committed
  70d39ea
- Attempt to fix travis
  fpoms
  committed
  66202a4
- Add debug statement for pipeline instances
  fpoms
  committed
  b7f27ad
- Attempt to fix travis
  fpoms
  committed
  c509f51
- Small fixes to partitioner
  fpoms
  committed
  587341d
- Bump storehouse version
  fpoms
  committed
  e26f16b
- Eagerly commit tables
  willcrichton
  committed
  dc026db
Commits on Jan 3, 2018
- Add task timeout to stop workers that don't finish tasks
  fpoms
  committed
  0a33174
- Remove python logging
  willcrichton
  committed
  58867f2
Commits on Jan 4, 2018
- Temporarily comment unused commit checks
  willcrichton
  committed
  1f97b5b
- GetTables fetches video descriptors as well
  willcrichton
  committed
  16b5adc
Commits on Jan 5, 2018
- Change table metadata to megafile, instead of individual files
  fpoms
  committed
  43b4590
- Update storehouse commit to work with new megafile update
  fpoms
  committed
  3c730e5
- Fix a storehouse issue
  fpoms
  committed
  a315aa6
- Temporarily removed database write on startup
  willcrichton
  committed
  f4cf5ee
- Bump storehouse version
  willcrichton
  committed
  6bb7a62
- Move video metadata bulk fetch into standalone routine
  willcrichton
  committed
  938c7d0
- Add reset and bounded state for python ops/kernels
  willcrichton
  committed
  65593a6
- Take GIL in reset
  willcrichton
  committed
  fd092f4
- Improve logging
  willcrichton
  committed
  58e5f03
- More useful exception on missing descriptor
  willcrichton
  committed
  43be76a
- Fix table using old metadata
  willcrichton
  committed
  145d168
Commits on Jan 6, 2018
- Use block allocations when loading Other type columns, better eval profiling info
  willcrichton
  committed
  00aaf7c
- Use block allocation in Python as well
  willcrichton
  committed
  8696fc9
- Accelerate stencil cache lookups
  willcrichton
  committed
  c8435a3
- Spawn multiple workers in one call to create_worker
  willcrichton
  committed
  c1021c6
- process_per_core -> num_workers
  willcrichton
  committed
  bf985f0
Commits on Jan 7, 2018
- Improved logging
  willcrichton
  committed
  965a5d0
- table name -> id lookup from O(n) to O(1)
  willcrichton
  committed
  ef7fc58
- Remove backoff from op/kernel registration
  willcrichton
  committed
  061481a
- Remove grpc backoff in a few more places
  willcrichton
  committed
  7e36e5e
- Revert "Remove grpc backoff in a few more places"
  willcrichton
  committed
  580120d
- Revert "Remove backoff from op/kernel registration"
  willcrichton
  committed
  2be00f7
- Add backoff to file save in SaveWorker
  willcrichton
  committed
  c7ab505
- Fix test
  willcrichton
  committed
  397a79a
- Fix tests again
  willcrichton
  committed
  0a04685
- One more test fix
  willcrichton
  committed
  1053fc0
- Actually fixed test
  willcrichton
  committed
  643e345
Commits on Jan 8, 2018
- map -> unordered_map in a few places
  willcrichton
  committed
  64a66ff
- Workers send job result back on FinishedJob
  willcrichton
  committed
  3d8e4b9
- Cleanup Python kernel lib
  willcrichton
  committed
  28f4d2a
- Increase packet size
  willcrichton
  committed
  da1cda3
Commits on Jan 9, 2018
- Fix max message size + fix CPU build
  willcrichton
  committed
  d5f3519
- Workers receive database metadata from master (fixes worker startup during job race)
  willcrichton
  committed
  3ca0271
- Parallelize worker communication for op/kernel registratoin
  willcrichton
  committed
  189531a
- Fix worker not handling large GRPC messages
  willcrichton
  committed
  1b7fffc
- Fix grpc backoff not timing out properly
  willcrichton
  committed
  60c654d
- Remove grpc backoff on registration for now
  willcrichton
  committed
  b2ac8ad
- Typos
  willcrichton
  committed
  f330274
Commits on Jan 10, 2018
- Change checkpoint metric
  willcrichton
  committed
  a45a20f
- Make checkpoint frequency an explicit job parameter
  willcrichton
  committed
  be4e4d3
- Increase megafile write/read batch size
  fpoms
  committed
  d9e213c
- Add log messages for pinging
  fpoms
  committed
  42eb2b0
Commits on Jan 11, 2018
- Add log messages for PokeWatchdog
  fpoms
  committed
  ebb8e30
- Add timeouts for ping and poke
  fpoms
  committed
  782b612
- Typo
  fpoms
  committed
  e3fa536
- Add timeout for loading ops
  fpoms
  committed
  84e800c
- Add lock when calling remove_worker in ping
  fpoms
  committed
  6e46455
- Set timeout on loading ops
  fpoms
  committed
  298e0b9
- Add const variables for timeouts
  fpoms
  committed
  a3b13b2
- Clear blacklisted jobs set on new job
  fpoms
  committed
  8664a37
Commits on Jan 12, 2018
- Handle worker NewJob errors
  fpoms
  committed
  2e21b61
- Set tasks used to 0 to ensure progress bar starts at 0
  fpoms
  committed
  e398906
- Fix not checking if video data intervals are adjacent (for inplace)
  fpoms
  committed
  bde127d
Commits on Jan 13, 2018
- Update hwang to fix gpu decode issue
  fpoms
  committed
  b1a3dfa
- Further increase batch size read
  fpoms
  committed
  ecf6827
- Update hwang to fix decode bug
  fpoms
  committed
  f482af6
- Add more pipeline prints
  fpoms
  committed
  75efba4
- Share table cache with load workers
  fpoms
  committed
  dc55fe1
- Fix inplace decode not working after changes
  fpoms
  committed
  ceefa55
Commits on Jan 14, 2018
- Improve keyframe only decode performance
  fpoms
  committed
  8b1c6d9
- Get rid of potential memory leak in post-evaluate worker
  fpoms
  committed
  7c7e2fb
- Fix not creating frame size for raw video column
  fpoms
  committed
  6c0ca4a
- Ensure master does not hang if workers fail after job finishes
  fpoms
  committed
  9d63ae0
Commits on Jan 15, 2018
- Assert should allow packets equal in size to buffer
  fpoms
  committed
  d5a6be5
- Roll back enabling skip_frames since it can cause hangs
  fpoms
  committed
  a118ec6
- Roll back keyframe slicing for sparsity and roll back roll back
  fpoms
  committed
  ea04247
Commits on Jan 16, 2018
- Use stop cluster command to shutdown master
  fpoms
  committed
  cd524fa
- Fix io packet multiple issue for pipelines
  willcrichton
  committed
  8d10bcf
- Optimize sparse loading via Python API
  willcrichton
  committed
  be49822
- Add last row hacky optimization
  willcrichton
  committed
  880305f
Commits on Jan 18, 2018
- Update hwang to fix gpu decode issue
  fpoms
  committed
  4039d5c
Commits on Jan 19, 2018
- Autoscheduler for CPU
  willcrichton
  committed
  08bd255
Commits on Jan 21, 2018
- Fix bug causing decoder to output empty frames
  fpoms
  committed
  165ffb2
- Fix switched arguments in range sampler
  fpoms
  committed
  946f827
Commits on Jan 25, 2018
- Create visualization_utils.py
  swjz
  authored
  8afb54e
- Remove unnecessary dependencies
  swjz
  authored
  7a3c92d
- Use relative path instead of absolute path
  swjz
  authored
  8fe6c31
- Update source URL and relative path
  swjz
  authored
  efebc45
- Use custom .pbtxt parser to avoid complicated dependencies
  swjz
  authored
  c57cf7e
- Make module name consistent with current one
  swjz
  authored
  ce5995a
- Rename and register kernel
  swjz
  authored
  9dde6d4
- Fix execute() function
  swjz
  authored
  75c5961
- Add an example app using tensorflow kernel
  swjz
  authored
  b9bd68c
- Create __init__.py
  swjz
  authored
  a966cbd
- execute() returns list instead of numpy.ndarray
  swjz
  authored
  3bdb5b8
- Download the DNN model if not found in PATH_TO_GRAPH
  swjz
  authored
  409ba6d
- Bugfix: Indent not consistent
  swjz
  authored
  fa4ec1e
- Add label map data (taken from tensorflow)
  swjz
  authored
  9d506e2

Commits

Commits on Nov 6, 2017

Commits on Nov 12, 2017

Commits on Nov 25, 2017

Commits on Nov 26, 2017

Commits on Nov 27, 2017

Commits on Nov 28, 2017

Commits on Nov 29, 2017

Commits on Nov 30, 2017

Commits on Dec 10, 2017

Commits on Dec 18, 2017

Commits on Dec 19, 2017

Commits on Dec 20, 2017

Commits on Dec 21, 2017

Commits on Dec 22, 2017

Commits on Dec 23, 2017

Commits on Dec 25, 2017

Commits on Dec 27, 2017

Commits on Dec 28, 2017

Commits on Dec 29, 2017

Commits on Dec 30, 2017