Skip to content

directory structure of the data set #230

@pengyuan0313

Description

@pengyuan0313

I would like to ask what the directory structure of the data set should look like.

I feel that the data set is not correct, and the training keeps reporting errors.
(base) root@autodl-container-d0fd4ba6f1-572ac147:~/autodl-tmp/DECA# python main_train.py --cfg configs/release_version/deca_pretrain.yml
Namespace(cfg='configs/release_version/deca_pretrain.yml', mode='train')

creating the FLAME Decoder
please check model path:
2024-12-23 19:21:34.142 | INFO | decalib.trainer:load_checkpoint:107 - model path not found, start training from scratch
total 300 images
[<decalib.datasets.aflw2000.AFLW2000 object at 0x7f0ad39653a0>]
2024-12-23 19:21:34.867 | INFO | decalib.trainer:prepare_data:364 - ---- training data numbers:
Epoch[1/10]: 0%| | 0/42 [00:00<?, ?it/s]
Traceback (most recent call last):
File "/root/autodl-tmp/DECA/decalib/trainer.py", line 388, in fit
batch = next(self.train_iter)
File "/root/miniconda3/lib/python3.8/site-packages/torch/utils/data/dataloader.py", line 363, in next
data = self._next_data()
File "/root/miniconda3/lib/python3.8/site-packages/torch/utils/data/dataloader.py", line 989, in _next_data
return self._process_data(data)
File "/root/miniconda3/lib/python3.8/site-packages/torch/utils/data/dataloader.py", line 1014, in _process_data
data.reraise()
File "/root/miniconda3/lib/python3.8/site-packages/torch/_utils.py", line 395, in reraise
raise self.exc_type(msg)
IndexError: Caught IndexError in DataLoader worker process 0.
Original Traceback (most recent call last):
File "/root/miniconda3/lib/python3.8/site-packages/torch/utils/data/_utils/worker.py", line 185, in _worker_loop
data = fetcher.fetch(index)
File "/root/miniconda3/lib/python3.8/site-packages/torch/utils/data/_utils/fetch.py", line 44, in fetch
data = [self.dataset[idx] for idx in possibly_batched_index]
File "/root/miniconda3/lib/python3.8/site-packages/torch/utils/data/_utils/fetch.py", line 44, in
data = [self.dataset[idx] for idx in possibly_batched_index]
File "/root/miniconda3/lib/python3.8/site-packages/torch/utils/data/dataset.py", line 207, in getitem
return self.datasets[dataset_idx][sample_idx]
File "/root/autodl-tmp/DECA/decalib/datasets/ethnicity.py", line 40, in getitem
name = self.data_lines[idx, i]
IndexError: too many indices for array

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
File "main_train.py", line 46, in
main(cfg)
File "main_train.py", line 38, in main
trainer.fit()
File "/root/autodl-tmp/DECA/decalib/trainer.py", line 391, in fit
batch = next(self.train_iter)
File "/root/miniconda3/lib/python3.8/site-packages/torch/utils/data/dataloader.py", line 363, in next
data = self._next_data()
File "/root/miniconda3/lib/python3.8/site-packages/torch/utils/data/dataloader.py", line 989, in _next_data
return self._process_data(data)
File "/root/miniconda3/lib/python3.8/site-packages/torch/utils/data/dataloader.py", line 1014, in _process_data
data.reraise()
File "/root/miniconda3/lib/python3.8/site-packages/torch/_utils.py", line 395, in reraise
raise self.exc_type(msg)
IndexError: Caught IndexError in DataLoader worker process 0.
Original Traceback (most recent call last):
File "/root/autodl-tmp/DECA/decalib/trainer.py", line 388, in fit
batch = next(self.train_iter)
File "/root/miniconda3/lib/python3.8/site-packages/torch/utils/data/dataloader.py", line 363, in next
data = self._next_data()
File "/root/miniconda3/lib/python3.8/site-packages/torch/utils/data/dataloader.py", line 989, in _next_data
return self._process_data(data)
File "/root/miniconda3/lib/python3.8/site-packages/torch/utils/data/dataloader.py", line 1014, in _process_data
data.reraise()
File "/root/miniconda3/lib/python3.8/site-packages/torch/_utils.py", line 395, in reraise
raise self.exc_type(msg)
IndexError: Caught IndexError in DataLoader worker process 0.
Original Traceback (most recent call last):
File "/root/miniconda3/lib/python3.8/site-packages/torch/utils/data/_utils/worker.py", line 185, in _worker_loop
data = fetcher.fetch(index)
File "/root/miniconda3/lib/python3.8/site-packages/torch/utils/data/_utils/fetch.py", line 44, in fetch
data = [self.dataset[idx] for idx in possibly_batched_index]
File "/root/miniconda3/lib/python3.8/site-packages/torch/utils/data/_utils/fetch.py", line 44, in
data = [self.dataset[idx] for idx in possibly_batched_index]
File "/root/miniconda3/lib/python3.8/site-packages/torch/utils/data/dataset.py", line 207, in getitem
return self.datasets[dataset_idx][sample_idx]
File "/root/autodl-tmp/DECA/decalib/datasets/ethnicity.py", line 40, in getitem
name = self.data_lines[idx, i]
IndexError: too many indices for array

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
File "/root/miniconda3/lib/python3.8/site-packages/torch/utils/data/_utils/worker.py", line 185, in _worker_loop
data = fetcher.fetch(index)
File "/root/miniconda3/lib/python3.8/site-packages/torch/utils/data/_utils/fetch.py", line 44, in fetch
data = [self.dataset[idx] for idx in possibly_batched_index]
File "/root/miniconda3/lib/python3.8/site-packages/torch/utils/data/_utils/fetch.py", line 44, in
data = [self.dataset[idx] for idx in possibly_batched_index]
File "/root/miniconda3/lib/python3.8/site-packages/torch/utils/data/dataset.py", line 207, in getitem
return self.datasets[dataset_idx][sample_idx]
File "/root/autodl-tmp/DECA/decalib/datasets/vggface.py", line 44, in getitem
name = self.data_lines[idx, i]
IndexError: too many indices for array

Looking for a solution

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions