Milestone 2: March 15, 2024 #2
Description
Biweekly update:
Adam - Model
Reported findings on available models
Looked into using Lightning AI Studio for inference
Led discussion on quantitative/qualitative task measurements
Bibek - Writing + Implementation
Helped create general timeline for the project
Talked about parameters, precision, and quantization
Introduced tools: Google Colab & Lightning AI Studio
Sekou - Data Collection
Discussed the kinds of data to be extracted
Brought up creating an assistant model
Led a high-level discussion on tokenization & context
Shelah - Data Processing + Implementation
Reported findings on available GPUs
Discussed time limitations with some cloud-based computing options
Talked with Bibek about GPU alternatives (local, Colab, Lightning AI)