Skip to content

Milestones

List view

  • Showcase Ozone with a big data set, such as census data. Census data has a number of interesting properties: 1. Lots of columns. 2. Individuals aren't available, only census tracts with counts that correspond to different demographics. Need to optimize for sums of individuals. 3. The full set can't fit in memory, nor can it be downloaded in a reasonable amount of time. At a minimum we need to be able to load columns independently. It may be necessary to combine data sets in clever ways, or to provide an asynchronous API. Other sources for interesting data sets: American Time Use Survey: http://www.bls.gov/tus/#data

    No due date
    0/1 issues closed
  • Build on the basic client/server API with bitmap-based columns and a bitmap-based binary format for columns.

    No due date
    2/3 issues closed
  • A bare-bones, general purpose API, most of which is shared both client and server. This is the foundation of Ozone, so it should be flexible but basic usage should be simple. The following steps represent the basic usage. It should be possible to do them without using the full names of any internal classes. 1. Install Ozone to Node.js via NPM. 2. Load a CSV file in Node. It may be possible to do filtering and sorting. Consider using a streaming API. 3. Save the loaded data as column-oriented JSON files. 4. Load the JSON data client-side. 5. Do some basic client-side queries.

    No due date
    2/2 issues closed