action #71605
Cleanup task `limit_results_and_logs` fails with database error
Start date:
2020-09-21
Due date:
% Done:
0%
Estimated time:
Difficulty:
Description
observation¶
On OSD a limit_results_and_logs task failed with the following database error:
{
"args" => [],
"attempts" => 1,
"children" => [],
"created" => "2020-09-19T22:00:03.56377Z",
"delayed" => "2020-09-19T22:03:04.33687Z",
"expires" => "2020-09-21T22:00:03.56377Z",
"finished" => "2020-09-19T22:25:10.5735Z",
"id" => 626723,
"lax" => 0,
"notes" => {
"gru_id" => 27740667
},
"parents" => [],
"priority" => 5,
"queue" => "default",
"result" => "bless( {\n 'msg' => 'DBIx::Class::Storage::DBI::_dbh_execute(): DBI Exception: DBD::Pg::st execute failed: ERROR: integer out of range [for Statement \"UPDATE jobs SET logs_present = ?, result_size = result_size - 7760462702, t_updated = ? WHERE ( id = ? )\" with ParamValues: 1=\\'0\\', 2=\\'2020-09-19 22:25:10\\', 3=\\'4269174\\'] at /usr/share/openqa/script/../lib/OpenQA/Schema/Result/Jobs.pm line 1158\n'\n }, 'DBIx::Class::Exception' )\n",
"retried" => "2020-09-19T22:02:04.33687Z",
"retries" => 3,
"started" => "2020-09-19T22:03:04.62529Z",
"state" => "failed",
"task" => "limit_results_and_logs",
"time" => "2020-09-21T14:30:19.38549Z",
"worker" => 350
}
The next limit_results_and_logs was successful again so this is not a persistent error preventing the cleanup to work at all. In fact I've seen this error only once so far.
suggestions¶
- Update this ticket if it happens more often.
- Take a look at the relevant code and try to provoke a situation which would lead to such an error. Try to extend unit tests. Change the code to avoid that situation.
Updated by