QA

action #152470

Updated by okurz 5 months ago

## Observation 

 Daily email with subject 
 "Cron <root@openqa-service> (date; fetch_openqa_bugs)> /tmp/fetch_openqa_bugs_osd.log" 

 and content 

 ``` 
 Exception occured while fetching bsc#1212271 
 Traceback (most recent call last): 
   File "/usr/lib/python3.6/site-packages/urllib3/connection.py", line 160, in _new_conn 
     (self._dns_host, self.port), self.timeout, **extra_kw 
   File "/usr/lib/python3.6/site-packages/urllib3/util/connection.py", line 84, in create_connection 
     raise err 
   File "/usr/lib/python3.6/site-packages/urllib3/util/connection.py", line 74, in create_connection 
     sock.connect(sa) 
 socket.timeout: timed out 

 During handling of the above exception, another exception occurred: 

 Traceback (most recent call last): 
   File "/usr/lib/python3.6/site-packages/urllib3/connectionpool.py", line 677, in urlopen 
     chunked=chunked, 
   File "/usr/lib/python3.6/site-packages/urllib3/connectionpool.py", line 381, in _make_request 
     self._validate_conn(conn) 
   File "/usr/lib/python3.6/site-packages/urllib3/connectionpool.py", line 978, in _validate_conn 
     conn.connect() 
   File "/usr/lib/python3.6/site-packages/urllib3/connection.py", line 309, in connect 
     conn = self._new_conn() 
   File "/usr/lib/python3.6/site-packages/urllib3/connection.py", line 167, in _new_conn 
     % (self.host, self.timeout), 
 urllib3.exceptions.ConnectTimeoutError: (<urllib3.connection.HTTPSConnection object at 0x7f70ef00c438>, 'Connection to bugzilla.suse.com timed out. (connect timeout=10)') 

 During handling of the above exception, another exception occurred: 

 Traceback (most recent call last): 
   File "/usr/lib/python3.6/site-packages/requests/adapters.py", line 449, in send 
     timeout=timeout 
   File "/usr/lib/python3.6/site-packages/urllib3/connectionpool.py", line 727, in urlopen 
     method, url, error=e, _pool=self, _stacktrace=sys.exc_info()[2] 
   File "/usr/lib/python3.6/site-packages/urllib3/util/retry.py", line 439, in increment 
     raise MaxRetryError(_pool, url, error or ResponseError(cause)) 
 urllib3.exceptions.MaxRetryError: HTTPSConnectionPool(host='bugzilla.suse.com', port=443): Max retries exceeded with url: /rest/bug/1212271?api_key=XXX /rest/bug/1212271?api_key=Nb6YixvhOHdPR4dqliWA8wgxIxAUAHEYxWK0SNzQ (Caused by ConnectTimeoutError(<urllib3.connection.HTTPSConnection object at 0x7f70ef00c438>, 'Connection to bugzilla.suse.com timed out. (connect timeout=10)')) 

 During handling of the above exception, another exception occurred: 

 Traceback (most recent call last): 
   File "/usr/bin/fetch_openqa_bugs", line 62, in <module> 
     raise e 
   File "/usr/bin/fetch_openqa_bugs", line 48, in <module> 
     issue = issue_fetcher.get_issue(bugid) 
   File "/usr/lib/python3.6/site-packages/openqa_bugfetcher/issues/__init__.py", line 88, in get_issue 
     return self.prefix_table[prefix](self.conf, bugid) 
   File "/usr/lib/python3.6/site-packages/openqa_bugfetcher/issues/__init__.py", line 24, in __init__ 
     self.fetch(conf) 
   File "/usr/lib/python3.6/site-packages/openqa_bugfetcher/issues/bugzilla_issue.py", line 27, in fetch 
     req = rest_get_bug(issue_id) 
   File "/usr/lib/python3.6/site-packages/openqa_bugfetcher/issues/bugzilla_issue.py", line 25, in rest_get_bug 
     return requests.get(url, params=get_params, timeout=10) 
   File "/usr/lib/python3.6/site-packages/requests/api.py", line 76, in get 
     return request('get', url, params=params, **kwargs) 
   File "/usr/lib/python3.6/site-packages/requests/api.py", line 61, in request 
     return session.request(method=method, url=url, **kwargs) 
   File "/usr/lib/python3.6/site-packages/requests/sessions.py", line 532, in request 
     resp = self.send(prep, **send_kwargs) 
   File "/usr/lib/python3.6/site-packages/requests/sessions.py", line 645, in send 
     r = adapter.send(request, **kwargs) 
   File "/usr/lib/python3.6/site-packages/requests/adapters.py", line 504, in send 
     raise ConnectTimeout(e, request=request) 
 requests.exceptions.ConnectTimeout: HTTPSConnectionPool(host='bugzilla.suse.com', port=443): Max retries exceeded with url: /rest/bug/1212271?api_key=XXX /rest/bug/1212271?api_key=Nb6YixvhOHdPR4dqliWA8wgxIxAUAHEYxWK0SNzQ (Caused by ConnectTimeoutError(<urllib3.connection.HTTPSConnection object at 0x7f70ef00c438>, 'Connection to bugzilla.suse.com timed out. (connect timeout=10)')) 
 ``` 

 first occurence seems to be since 2023-12-07 04:20. Could this be related to changes in the network infrastructure? 

 ## Steps to reproduce 

 `ssh root@openqa-service.suse.de` and execute commands from /etc/crontab 

 ## Suggestions 
 * Reproduce the error, fix it 
 * Create new bugzilla API key

Back