Skip to content

fixed inconsistentcy between file and dataset in get_previous_build_file_spec when active jobs are missing #773

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
tmaeno merged 4 commits into from
Aug 20, 2026
Merged

fixed inconsistentcy between file and dataset in get_previous_build_file_spec when active jobs are missing #773

Changes from all commits
Commits
Show all changes
4 commits
Select commit Hold shift + click to select a range
1d16325
Add debug logging for SQL execution in JobComplexModule
tmaeno Aug 18, 2026
a1a0a0a
Add debug logging for SQL statements with no bound variables in JobCo…
tmaeno Aug 18, 2026
8f94ea7
Add debug logging for SQL statements and variables in JobComplexModule
tmaeno Aug 18, 2026
77d1794
fixed get_previous_build_file_spec to have consistent file and datase…
tmaeno Aug 19, 2026
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
8 changes: 5 additions & 3 deletions pandaserver/taskbuffer/db_proxy_mods/task_standalone_module.py
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -2038,10 +2038,10 @@ def get_previous_build_file_spec(
res_list = self.cur.fetchall()
# loop over all datasets
for res_item in res_list:
dataset_spec = JediDatasetSpec()
dataset_spec.pack(res_item)
tmp_dataset_spec = JediDatasetSpec()
tmp_dataset_spec.pack(res_item)
# get file
var_map = {":jediTaskID": jedi_task_id, ":datasetID": dataset_spec.datasetID, ":type": "lib", ":status1": "failed", ":status2": "cancelled"}
var_map = {":jediTaskID": jedi_task_id, ":datasetID": tmp_dataset_spec.datasetID, ":type": "lib", ":status1": "failed", ":status2": "cancelled"}
self.cur.execute(sql_read_file + comment, var_map)
res_file_list = self.cur.fetchall()
for res_file_item in res_file_list:
Expand All @@ -2050,6 +2050,7 @@ def get_previous_build_file_spec(
tmp_file_spec.pack(res_file_item)
if tmp_file_spec.status == "finished":
found_flag = True
dataset_spec = tmp_dataset_spec
file_spec = tmp_file_spec
break
# check if the corresponding job is still active
Expand All @@ -2060,6 +2061,7 @@ def get_previous_build_file_spec(
# no active job
tmp_log.debug(f"no active job for {tmp_file_spec.lfn} (PandaID={tmp_file_spec.PandaID})")
else:
dataset_spec = tmp_dataset_spec
file_spec = tmp_file_spec
# no more dataset lookup
if found_flag:
Expand Down